Ref: 05012021EC_1609860098

Lead Data Engineer

England, Greater Manchester

  • 65000 to 85000 GBP
  • Consultant Role
  • Skills: Big Data, Data Engineer, Lead Data Engineer, Python, Python 3, AWS, Amazon Web Services
  • Level: Senior

Job description

Lead Data Engineer

05012021EC_1609860098

Role: Lead Data Engineer

Salary: £65,000 - £85,000 per annum

Location: Holborn + remote

Benefits: To be dscussed over the phone (Long list)





Here at Jefferson Frank, we're dedicated to AWS recruitment-it's all we do.

We're the only global recruitment agency dedicated solely to AWS. Since June 2018, we've more than 1,600 AWS professionals across the world with great jobs working with AWS partners, ISVs and end users. No matter where you are in your career, or where you are in the country, we're in your corner making sure you land the right job with the right terms.





At Jefferson Frank we have an amazing opportunity to join one of the UK's leading IT consultancies to help create a brand-new engineering organisation. Perhaps you know what great engineering culture looks like, or you have an entrepreneurial side as well as outstanding coding skills? Whatever your aspirations, my client are striving to create the best engineering consultancy in the UK and are looking for brilliant engineers to be part of the journey.





They've been officially voted a "Great Place to Work" for five years in a row now. A big reason for this is that they have fostered an incredible environment where regular social events, inclusivity and an ego-free culture is embedded within the business.





They're not interested in cutting corners and believe in helping their clients to make the right choice for the long-term. They draw on their reputation for outstanding delivery to allow their engineers to do the right thing for their clients, and not necessarily the easy thing. Innovation is in the company's DNA, and encourage their engineers and consultants to work together to rethink conventional wisdom on how problems should be solved.





Here's what you will do (Not all of it, but some of the important stuff!)

* Solve the problems others cannot
* Spend a day a week working on a combination of internal products and your own development
* Create data platforms based around modern open source products and cloud-native technologies:

* AWS, Azure and Google Cloud
* Python
* Kafka / NiFi / Flume
* DB technologies: SQL Server / PosteSQL / MySQL
* Hive/Spark/Impala
* Dataiku
* Terraform
* Kubernetes



Requirements

The essentials?

* Experiece building data platforms using either cloud native products or commercial data analytics / data warehouse software
* Working knowledge of data pipelines & data transformation processes
* Experience creating and/or maintaining production software delivery pipelines using common CI/CD tools (e.g. Jenkins,GoCD,CircleCI)

* Demonstrable experience in automating operations tasks with one or more scripting languages
* Experience working with one or more of the main cloud providers (AWS, Azure or Google)
* Have a drive for self-improvement and learning, including learning new programming languages
* Approach solving problems pragmatically
* Experience of Hadoop big data platforms (either Cloudera / Hortonworks or cloud native equivalents)
* Experience with data reporting and visualisation tools (PowerBI, Tableau, Qlik)
* Experience productionising machine learning algorithms
* Experience with Infrastructure as Code (e.g. Terraform, Cloudformation)
* Experience supporting and operating production systems
* Familiarity with configuration management tooling (e.g. Ansible)





*

It would be great if you had these desirable skills

* Experience of Hadoop big data platforms (either Cloudera / Hortonworks or cloud native equivalents)
* Experience with data reporting and visualisation tools (PowerBI, Tableau, Qlik)
* Experience productionising machine learning algorithms
* Experience with Infrastructure as Code (e.g. Terraform, Cloudformation)
* Experience supporting and operating production systems
* Familiarity with configuration management tooling (e.g. Ansible)



To find out more, don't hesitate and reach out now to Elliott Collins by email - e.collins@jeffersonfrank.com or by phone on 0203 826 6692. We can run through the role in detail and discuss your ideals further.



If however this is not exactly what you're looking for, feel free to get in touch and we can talk about how we'll find the perfect opportunity for you.