Ref: 28/04/22SMJFI_1651410016

Principal Data Engineer

Scotland, Edinburgh

  • 75000 to 105000 GBP
  • Engineer Role
  • Skills: Data Engineer, SQL, Python, SQL, Scala, Spark, Beam, Hadoop, Kafka, RabitMQ, Athena, Amazon EMR
  • Level: Senior

Job description

Principal Data Engineer


Principal Data Engineer

Remote UK wide

£75,000 - £105,000

Opportunity to join a world leading SaaS company focused on delivering industry leading cloud business management solutions. This role sits with the Artificial Intelligence Labs arm of the business where you will lead a team of Data Engineer's helping deliver necessary data and insights for the group's wider Data Science and Machine Learning efforts.

Role & Responsibilities

* Work alongside the Data Science and Machine Learning teams to build datawarehouses and data pipelines

* Closely collaborate with the group's AI Infrastructure, extending capabilities of the wider ML platform

* Drive and optimize quality performance of data pipelines and latest cloud native tools

* Collaboration across stakeholders/technical teams to integrate wider data sources, privacy and security

* Design and build analytics tools for detecting data anomalies and improve quality

Skills & Qualifications

* 5 or more years of experience working end to end across the data lifecycle, including data integration, modelling and metadata management.

* Strong database skills. SQL queries, schemas, OLAP, OLTP etc.

* Broad knowledge and strong expertise in some of the following (or equivalent that are relevant): SQL, Python, Scala, Python, AWS, Hadoop, Kafka etc.

* Strong communication skills - written and verbal. Ability to articulate to technical and non technical audiences.E

* Hands on experience building ETL/ELT processes, datalakes and warehouses at scale.

Sponsorship is not available for this role. Candidate must hold British or Irish citizenship, ILR or equivalent.

Apply below with your CV.