• Location: USA, New York, Port Washington North
  • Salary: US$160000 - US$161000 per annum
  • Technology: AWS Big Data Jobs
  • Job Type: Permanent
  • Date Posted: 22nd May, 2020
  • Reference: oo052220AWS_1590175523
Role & Responsibilities

* Develop, test and automate metadata upload/download, data quality control applications
* Release procedures using various technologies available, including Spark, Python, Hive, SAS, and SQL
* Perform data analysis on input and output data using the tools available, and solve any data related queries or issues
* Gather requirements from Operations and Products to define data definitions, transformation logic, and data model logical and physical designs, data flow and process

Skills & Qualifications

* 3+ years of experience with Hadoop eco-systems
* 2+ years of experience with Cloud technologies. Prior experience with Azure/AWS is a big plus
* Big Data (Hadoop, Hive, Pig, Spark)
* Programming (Python, Scala, Java)