• Location: USA, New York, Port Washington North
  • Salary: Up to US$135000 per annum
  • Technology: AWS Big Data Jobs
  • Job Type: Permanent
  • Date Posted: 17th Apr, 2020
  • Reference: oo041720-AWS_1587140121
Role & Responsibilities

* Develop, test and automate metadata upload/download, data quality control applications
* Release procedures using various technologies available, including Spark, Python, Hive, SAS, and SQL
* Perform data analysis on input and output data using the tools available, and solve any data related queries or issues
* Gather requirements from Operations and Products to define data definitions, transformation logic, and data model logical and physical designs, data flow and process

Skills & Qualifications

* 3+ years of experience with Hadoop eco-systems
* 2+ years of experience with Cloud technologies. Prior experience with Azure/AWS is a big plus
* Big Data (Hadoop, Hive, Pig, Spark)
* Programming (Python, Scala, Java)

Benefits:

* Comprehensive Health benefits
* 401k w/match
* Maternity/Paternity leave
* Opportunity to work from home
* Comprehensive PTO/paid holidays
* Work/life balance