Job Description: As a lead data engineer you will be responsible for creating a new data pipeline, ETL process, and architecture for 2.0 of our client's platform. This could include multi-model databases (including PostgreSQL and graph databases).
Role & Responsibilities
* Creating and maintaining a scalable ETL data pipeline that ingests multiple data sets both structured and unstructured data
* Creating and maintaining a multi-model data storage system including PostgresSQL, AWS Architecture and graph databases
* Working with Data Science team to enable ML Ops
* Ability to efficiently query and obtain data via SQL
* Assist Dev and Data Science teams with processing and integrating data analysis
* Clearly documenting processes, methodologies and tools used
Skills & Qualifications
* Experience as Data Engineer in the AWS Ecosystem
* Usage and experience writing complex SQL queries and analysis of data correlations
* Heavy experience with Redshift, Glue, and other tools
* Experience with multi-model DB and ETL Pipelines
