Referenz: 131021SMJFI_1634116723

AWS Data Engineer

England, London

  • 55000 to 65000 GBP
  • Engineer Stelle
  • Fähigkeiten: AWS, Data Engineer, Python, DMS, Glue, S3, Lambda
  • Niveau: Senior


AWS Data Engineer


AWS Data Engineer


£60,000 - £70,000 DOE

Reporting to: Chief Analytics Officer

This role arises from rapid business growth. My client's multi-tenanted, SaaS and mobile applications provide transaction processing for operational data from all customers' business and resource location minute-by-minute. Data is comprehensive, user extensible and includes customers' prospects, customers, customer correspondence, pricing, sales opportunities, orders, jobs, risk assessments, job worksheets, engineers/drivers, vehicles, stock and equipment, locations, and financial transactions. This role enables data to be assembled in a Data Lake in AWS so that business insights are available for customers and the company from exploring this data.

Role & Responsibilities

* Design, build, maintain, test and deploy data pipelines and architectures in AWS;
* Ensure the scalability of the data engineering architecture to meet future business demand;
* Extract, transform and load data from multiple source systems such as SQL Server, MongoDB, Flat Files etc;
* Performance tuning of data pipelines;
* Ensures customers' and companies personally identifiable information (PII) and any other sensitive data is secured within the BigChange Data Lake and Data Warehouse systems;
* Provide advice and support to other colleagues on system functionality;
* Be aware of the latest releases of relevant technologies;
* Manages, documents and improves data engineering processes and system records;
* Actively attends and contributes in Agile sprint ceremonies/meetings.

Skills & Qualifications

* 3+ years' experience in a similar data engineering role i.e. building data pipelines for either a Data Warehouse and/or a Data Lake
* 2+ years' experience using Python
* 2+ years' experience of using AWS cloud computing services
* 1+ years' experience using Linux or Unix
* Strong experience using SQL for querying data in any relational database
* Writes clear and concise technical documentation including run-books, play-books, specifications, software component designs and test cases with due regard for the knowledge and skill levels of the target readers
* Approachable and friendly to developers, support staff, business colleagues and customers, a trusted source of technical advice to others in the company
* Agile development approach with due regard for configuration management, specification/documentation, review and testing.
* Technically strong, with recent hands-on experience
* An ability to advise senior stakeholders, work comfortably without definition and apply a progressive technical approach to any problem