The AWS Data Engineer will deliver high quality data pipelines on the Bank Data Platform. As these are our first steps in our AWS journey, there is a big possibility to contribute to how we work, how we build and how we ensure quality.
The AWS Data Engineer will work in close collaboration with the AWS Data Engineer Lead, other Data Engineers and Data Analysts, implementing well-performing, re-usable code with a high degree of quality.
Key Responsibilities:
- Developing high-quality data pipelines, making data available on the Bank Data Platform.
- Create reusable components and enhance existing flows and components.
- Provide documentation at the right level, to help others understand and support what you have built.
- As we work in a DevOps fashion - be responsible for what you build and for the deliveries of the team as a whole.
Professional skills:
- Extensive knowledge of the AWS platform.
Extensive knowledge of the AWS Data Lake - related services, i.e. AWS Glue, AWS S3, AWS Athena, AWS Select and AWS Lambda.
- Good knowledge of Kafka integration.
- Good knowledge of data modelling.
- Good knowledge or relational databases.
Experience:
- Knowledge and experience from development of Data Lakes in AWS, using AWS technologies.
- Experience with ELT/ETL tools and processing.
- Experience with data lake concepts.
- Experience working with data quality.
- Experience working with Bank/Finance is an advantage
