Ref: dataawssen0507_1625499890

Data enginner AWS 5 ans exp

France, Île-de-France

  • 500 to 650 EUR
  • Data Science Role
  • Skills: aws, kubernetes, sql, python, apacheairflow, snowflake, jenkins
  • Level: Senior

Job description

Data enginner AWS 5 ans exp


Job Description

As a Senior Data Engineer, your mission will be to build & expand the Data Platform, used intensively by all internal teams and our products, supporting multiple domains (BI, Data Insights, Products Analytics, Data Science)

You Will Report To The Data Product Manager And Be Part Of The Central Data Team Composed Of ~20 People, Regrouping

* "Data Asset" departments, including Data Engineering team and Data Management team
* "Data activation" departments, including Data Insights team, Product Analytics Team, a BI factory and a Data Science team
Your Daily Work Will Consist Of

* Designing efficient patterns to store and analyze Terabytes of data
* Implementing complex acquisition and transformation workflows
* Building smart data models to serve our product teams and our BI, Insights and data science teams while minimizing the costs
* Developing tools to help our data scientists industrialize machine learning projects
* Working on data quality & reliability to ensure we provide trustable metrics to the whole company
* Developing tools to help our data scientists industrialize machine learning projects
* Developing our Data Science platform
* Industrializing machine learning projects with Data Scientists
The Data platform tech stack is built on AWS (S3, EC2, EMR) and Snowflake using some open source technologies such as Airflow, Spark, Sqoop, Jenkins, Elasticsearch, Docker, Kubernetes, etc...

With a minimum 5 years of experience, you have a perfect knowledge of data engineering patterns, technologies and are proficient in python (ideally with several other backend languages and are well versed in software development best practices, such as CI/CD, unit testing, QA and mocks creation ..).

As a senior data engineer, your role will also be to guide the team towards improved patterns, processes and technologies. We will appreciate a large data culture and curiosity for any new technologies.

Your profile

* Min 5 years data engineering experience or 5-10 years of Back-end dev experience + 3 years of data engineering experience.
* Great team player and at ease to interact with technical and business stakeholders
* Used to work in an agile environment & OK with priorities changes
* Curious, humble and exhibits a balance between creativity and pragmatism
* High willingness to learn and teach others
* Proficient in english (written and spoken)
Technical Skills

* Mastery of SQL and Python
* Snowflake
* Apache Airflow
* Infrastructure knowledge, AWS, Docker, Jenkins and Kubernetes appreciated
* Proficient with git and unix
* Streaming technologies (CDC pipelines, stream processing, ...)
* AWS Sagemaker, Databricks, Kubernetes and Google BigQuery are a plus