Ref: 06102020_1591811481

Data Engineer

USA, New York

Job Description

Data Engineer


Role & Responsibilities

* Develop, test and automate metadata upload/download, data quality control applications
* Release procedures using various technologies available, including Spark, Python, Hive, SAS, and SQL
* Perform data analysis on input and output data using the tools available, and solve any data related queries or issues
* Gather requirements from Operations and Products to define data definitions, transformation logic, and data model logical and physical designs, data flow and process

Skills & Qualifications

* 3+ years of experience with Hadoop eco-systems
* 2+ years of experience with Cloud technologies. Prior experience with Azure/AWS is a big plus
* Big Data (Hadoop, Hive, Pig, Spark)
* Programming (Python, Scala, Java)