Ref: 04022021pr_1612453771

Data/AWS Engineer - Kafka - Pyspark

England, London

Job description

Data/AWS Engineer - Kafka - Pyspark


Role: Data /AWS Engineer

Start Date - ASAP

SC Clearance or Eligible is a must

Key Responsibilities:

* Build data pipelines in AWS using technologies including Kafka, HBase, PySpark, Hive
* Implement security measures, monitoring and logging
* Ensure the solution built is scalable, resilient and high-performance
* Participate in 'Show and Tell' sessions to demo functionality and work with business users to ensure the features you develop satisfy their requirements

Skills & Experience:
* Must have in depth experience building data pipelines using Kafka, PySpark, Hive
* Experience building big data solutions hosted within AWS
* Familiar with auto-scaling functionality and security controls
* Experience in programming languages: Java, Kotlin, Python
* Good understanding of batch and streaming architectures
* Good understanding of cloud architecture concepts including replicas
* Experience working in an agile software development environment
* Excellent communication skills and stakeholder management skills

Please send your CV to or call 0203 879 8405