Your current job search

Unlock your potential as an AV

AI Engineer

Location: London
Salary: £105,000

Are you an experienced engineer with hands‑on expertise in Python, LLMs, and modern cloud technologies? We're looking for a Lead Engineer to join a high-impact Generative AI feature team, building applications used by thousands of colleagues daily. This is a unique opportunity to drive AI innovation at scale within a highly regulated environment.



About the Role

As a Lead Engineer, you will design, develop, and enhance software solutions using modern engineering practices. You'll act as an SME within the Generative AI domain, shaping technical direction, guiding others, and influencing both strategy and implementation.

You will lead a small team, provide mentorship, conduct code reviews, and drive a culture of technical excellence. This role offers a blend of hands-on engineering, leadership, and strategic input - perfect for someone ready to step into a high-ownership position.



Key Responsibilities:

* Build high‑quality, scalable, maintainable Python-based applications.
* Develop and deploy AI-driven applications, including those using LLMs.
* Collaborate closely with product, design, and engineering teams.
* Contribute to solution design, architecture, and secure coding practices.
* Drive testing best practices and ensure repeatable, reliable deployments.

* Mentor and guide junior engineers; support ongoing capability development.
* Lead technical discussions, code reviews, and cross-functional collaboration.
* Influence decision‑making and contribute to policy/standards.
* Support risk management, governance, and control requirements.

* Contribute to the organisation's Generative AI strategy as a subject matter expert.
* Analyse complex, multi-source data to inform design and decision‑making.
* Communicate complex or sensitive information clearly to senior stakeholders.



Required Experience

To succeed in this role, you should have strong hands-on capability in:

* Python
* Working with Large Language Models (LLMs)
* Cloud technologies, ideally AWS (Bedrock, Lambda, S3, Lex, CloudWatch)
* Prompt optimisation and evaluation methodologies
* Strong communication skills, especially in cross-functional environments
* Mentoring, coaching, or guiding other engineers

Azure Databricks Engineer
Lloyd's of London Market

Hybrid 2 days in London Office

We are seeking an outstanding Lead Azure Databricks Engineer to own the design, build, optimisation and governance of our enterprise cloud data platforms. This is a senior, fully hands‑on engineering position requiring deep technical expertise, strong delivery capability and experience operating within the Lloyd's of London market and its regulatory demands.

You will shape the future of our cloud data strategy, enabling advanced analytics and building secure, scalable and highly performant data solutions across the organisation.

Key Responsibilities

* Lead the development, optimisation and governance of large‑scale data platforms using Azure Data Factory, Data Lake, Key Vault, Azure Functions, Databricks, Delta Lake, PySpark and Unity Catalog
* Partner closely with underwriting, actuarial, delegated authority, bordereaux, exposure management, reinsurance, finance, Solvency II and risk teams to deliver solutions aligned to Lloyd's of London regulatory and operational requirements
* Translate complex business needs into scalable cloud data architectures in partnership with architects, SMEs and product owners
* Resolve complex technical challenges rapidly and decisively, consistently delivering high‑quality outcomes
* Champion engineering best practices including design patterns, data lifecycle management, CI/CD automation and cloud‑native methodologies
* Provide hands‑on technical leadership, mentorship and uplift engineering capability across the team
* Drive continuous improvement across performance, cost optimisation, reliability and resilience
* Oversee end‑to‑end data engineering delivery ensuring quality, observability, robustness and compliance

Required Experience and Skills

* Expert‑level knowledge of Azure Data Services and Databricks within enterprise environments
* Deep understanding of Delta Lake, Medallion architecture, distributed compute, Lakehouse patterns, data modelling and performance optimisation
* Strong Python, PySpark and SQL experience, with hands‑on implementation of CI/CD for data solutions using Azure DevOps
* Strong understanding of data governance, lineage, access management, FinOps and secure cloud engineering
* Excellent communication skills with the ability to confidently engage senior stakeholders and simplify complex technical concepts
* Proven ability to take ownership, deliver at pace and operate effectively in high‑pressure, high‑expectation environments
* Experience working within or delivering solutions for the Lloyd's of London market or similarly regulated environments

Please send me a copy if your CV if you're interested

Senior Manager - Insurance | AI Delivery Lead

Engineering, AI & Data - Technology & Transformation
Location: London or Manchester - salary will vary
Contract Type: Permanent

About the Opportunity

A leading global consultancy is seeking a Senior Manager - AI Delivery Lead to support major clients in the insurance sector. This is a chance to work at the forefront of AI, data engineering, and next‑generation technology transformation, partnering with industry leaders to solve complex challenges and deliver high‑impact solutions at scale.

You'll join a collaborative community of experts focused on innovation, continuous learning, and measurable results. If you're passionate about shaping the future of AI-enabled transformation, this role offers the platform, support, and exposure to do exactly that.

What You'll Do

In this role, you will guide the delivery of cutting-edge AI and data-driven solutions. Responsibilities include:

* Working closely with clients to understand their strategic goals and design AI-driven solutions that create real business value.
* Leading multidisciplinary teams - including data scientists, engineers, developers, and analysts - throughout full project delivery.
* Managing end-to-end project lifecycle: scoping, budgeting, timelines, delivery, and stakeholder engagement.
* Bringing deep knowledge of traditional AI, Generative AI, and data science to shape high-quality, production-grade solutions.
* Ensuring ethical AI principles, data privacy, and security practices are embedded across all delivery phases.
* Staying ahead of emerging technologies and identifying where they can be applied to benefit clients.

What You'll Bring

Essential Experience

* Strong background in the insurance, financial services, or similar domain.
* Proven ability to deliver AI-enabled solutions at scale.
* Excellent project and stakeholder management capability.
* Deep understanding of AI technologies, including Generative AI.
* Experience leading diverse teams of technical and non‑technical specialists.
* Familiarity with agile delivery methodologies.

Desirable Skills

* Exposure to new and emerging AI tools and techniques.
* Confident communicator, able to translate complex concepts into compelling narratives.
* Experience designing solutions on cloud platforms.
* Knowledge of agile practices such as Scrum or Kanban.
* Data visualisation and insight storytelling skills.
* Programming experience (Python, Java, C#, etc.).

About the Team

You'll be part of an AI, Engineering & Data function focused on helping organisations reinvent their core operations. The team delivers large-scale transformations that unlock growth and improve outcomes for customers and citizens.

Colleagues describe the culture as flexible, supportive, and energised by innovation - a place where talented people come together to make an impact that matters

Please send me a copy of your CV if you meet the requirement

Data Architect - Databricks (Hybrid, UK)
Locations: London, Manchester, or Edinburgh
Hybrid: 2-3 days per week on-site
Salary: Competitive (Manager & Senior Manager grades available)

About the Role
We are seeking an experienced Data Architect with deep expertise in Databricks to help our clients design, build, and scale modern data platforms. You will play a pivotal role in shaping Lakehouse architectures that enable advanced analytics, AI/ML, and enterprise-wide data-driven decision-making.
Working closely with clients early in their data journey, you will assess business needs, define architectural direction, and guide the implementation of robust, secure, and scalable solutions. This is a hands-on architecture role suited to someone who has spent the last 2-3 years working directly with Databricks at an architectural level and is ready to progress towards programmes such as the Databricks DPP.

Key Responsibilities
* Architect and implement Databricks Lakehouse solutions across ingestion, processing, storage, and analytics layers.
* Recommend best practices and innovative approaches for modern data platforms.
* Build strong client relationships and confidently present architectural decisions to senior stakeholders.
* Shape client data strategies and promote governance, quality, and security standards.
* Lead architectural engagements and ensure delivery within scope, budget, and timelines.
* Optimise Databricks workloads for performance, scalability, and cost efficiency.
* Implement governance and compliance frameworks using Unity Catalog, Purview, and cloud-native controls.
* Develop CI/CD pipelines using Databricks Repos, GitHub Actions, or Azure DevOps.
* Contribute to RFI/RFP responses and deliver innovative Proofs of Concept.
* Support the internal Architecture Practice by developing reusable patterns and accelerators.

Skills & Experience
* Proven experience delivering enterprise-scale Databricks solutions end-to-end.
* Strong background in Lakehouse Architecture, including structured and unstructured data.
* Expertise in Spark, PySpark, Delta Lake, and Databricks workflows.
* Experience building scalable ETL/ELT pipelines, including Delta Live Tables.
* Strong programming skills in Python, Scala, or SQL.
* Solid understanding of data modelling (3NF, Kimball, Data Vault).
* Experience integrating Lakehouse architectures with BI tools such as Power BI and Tableau.
* Hands-on experience with at least one major cloud platform (Azure, AWS, or GCP) and understanding of Databricks implications across each.
* Knowledge of Databricks security best practices (RBAC, IAM, encryption).
* Excellent communication, stakeholder engagement, and problem-solving skills.

Highly Valued Certifications
* Databricks Certified Data Engineer (Associate/Professional)
* Databricks Certified Machine Learning (Associate/Professional)
* Databricks Generative AI Fundamentals
* Databricks Lakehouse Fundamentals

Why Join Us?
* Generous annual leave and private medical insurance.
* Strong focus on wellbeing and personal development.
* A culture that rewards high performance and nurtures talent.
* Opportunities to work on impactful client projects and drive meaningful change.
* Supportive environment with investment in certifications and career progression.

Additional Information
* This role is fully signed off and part of a growing Databricks capability.
* Candidates must be willing to travel between UK offices when required.
* Suitable for individuals with strong architectural experience rather than purely engineering backgrounds.

Please can you send me a copy of your CV if you're interested

Data Architect - Databricks (Hybrid, UK)
Locations: London, Manchester, or Edinburgh
Hybrid: 2-3 days per week on-site
Salary: Competitive (Manager & Senior Manager grades available)

About the Role
We are seeking an experienced Data Architect with deep expertise in Databricks to help our clients design, build, and scale modern data platforms. You will play a pivotal role in shaping Lakehouse architectures that enable advanced analytics, AI/ML, and enterprise-wide data-driven decision-making.
Working closely with clients early in their data journey, you will assess business needs, define architectural direction, and guide the implementation of robust, secure, and scalable solutions. This is a hands-on architecture role suited to someone who has spent the last 2-3 years working directly with Databricks at an architectural level and is ready to progress towards programmes such as the Databricks DPP.

Key Responsibilities
* Architect and implement Databricks Lakehouse solutions across ingestion, processing, storage, and analytics layers.
* Recommend best practices and innovative approaches for modern data platforms.
* Build strong client relationships and confidently present architectural decisions to senior stakeholders.
* Shape client data strategies and promote governance, quality, and security standards.
* Lead architectural engagements and ensure delivery within scope, budget, and timelines.
* Optimise Databricks workloads for performance, scalability, and cost efficiency.
* Implement governance and compliance frameworks using Unity Catalog, Purview, and cloud-native controls.
* Develop CI/CD pipelines using Databricks Repos, GitHub Actions, or Azure DevOps.
* Contribute to RFI/RFP responses and deliver innovative Proofs of Concept.
* Support the internal Architecture Practice by developing reusable patterns and accelerators.

Skills & Experience
* Proven experience delivering enterprise-scale Databricks solutions end-to-end.
* Strong background in Lakehouse Architecture, including structured and unstructured data.
* Expertise in Spark, PySpark, Delta Lake, and Databricks workflows.
* Experience building scalable ETL/ELT pipelines, including Delta Live Tables.
* Strong programming skills in Python, Scala, or SQL.
* Solid understanding of data modelling (3NF, Kimball, Data Vault).
* Experience integrating Lakehouse architectures with BI tools such as Power BI and Tableau.
* Hands-on experience with at least one major cloud platform (Azure, AWS, or GCP) and understanding of Databricks implications across each.
* Knowledge of Databricks security best practices (RBAC, IAM, encryption).
* Excellent communication, stakeholder engagement, and problem-solving skills.

Highly Valued Certifications
* Databricks Certified Data Engineer (Associate/Professional)
* Databricks Certified Machine Learning (Associate/Professional)
* Databricks Generative AI Fundamentals
* Databricks Lakehouse Fundamentals

Why Join Us?
* Generous annual leave and private medical insurance.
* Strong focus on wellbeing and personal development.
* A culture that rewards high performance and nurtures talent.
* Opportunities to work on impactful client projects and drive meaningful change.
* Supportive environment with investment in certifications and career progression.

Additional Information
* This role is fully signed off and part of a growing Databricks capability.
* Candidates must be willing to travel between UK offices when required.
* Suitable for individuals with strong architectural experience rather than purely engineering backgrounds.

Please can you send me a copy of your CV if you're interested

Head of Engineering - Permanent

Location: Remote
Reports to: CTO

A fast‑growing technology company is seeking a Head of Engineering with deep experience building and scaling complex, data‑driven platforms. This role requires someone who can lead multi‑disciplinary teams, improve engineering execution, and drive technical excellence across high‑scale distributed systems and machine‑learning environments.

Required Experience

* Leadership of engineering organisations of 20 or more across multiple disciplines, including backend, web, data, ML, QA, and DevOps.
* Proven track record designing, scaling, and maintaining distributed systems and high‑volume data pipelines.
* Strong background in cloud‑native architectures and modern data stacks such as Spark or Databricks.
* Experience working closely with Data Science teams, including delivering production‑grade ML models and pipelines.
* Solid understanding of modern frontend engineering practices (e.g., TypeScript, React) to guide cross‑functional technical decisions.
* Robust DevOps knowledge, including CI/CD pipelines, container orchestration, monitoring, reliability engineering, and cloud infrastructure management (AWS preferred).
* Demonstrated ability to balance delivery speed with long‑term technical quality, reliability, and maintainability.
* Experience hiring, mentoring, and developing engineering leaders and high‑performing teams.

Role Overview

You will own engineering execution for a platform that processes large datasets, supports distributed computation, and integrates machine‑learning capabilities at scale. The engineering organisation already uses AI‑assisted development, and you will refine these practices, improve delivery predictability, and strengthen the technical foundation for long‑term growth.

Responsibilities

* Lead the engineering roadmap and technical execution across all product and platform teams.
* Guide architectural decisions in data engineering, ML, and web application development.
* Implement engineering KPIs to improve delivery speed, quality, and reliability.
* Develop a strong engineering culture centred on ownership, collaboration, and high performance.
* Partner with Product, Data Science, and DevOps to deliver high‑quality, scalable solutions.
* Manage engineering budgets, tooling, and cloud infrastructure costs.

Preferred

* Experience in search, advertising technology, or competitive intelligence.
* Familiarity with ML lifecycle tooling and agentic coding approaches.

Please send me a copy of your CV of you meet all of the above

Senior Python Scraping Engineer - Permanent

UK BASED ONLY

What You'll Do:
Design and maintain large-scale Python scraping systems that operate reliably against Google and other highly defended websites
Build scrapers for dynamic, JavaScript-heavy pages using browser automation and hybrid approaches

Must have:
Strong Python background with production‑grade scraping, including protected platforms like Google.
Deep knowledge of browser automation, web protocols, parsing, and handling anti‑bot challenges (CAPTCHAs, IP rotation, fingerprinting).
Experienced running large‑scale, asynchronous scraping systems in the cloud with high resilience and reliability.

We are looking for a Web Scraper, not a Data Engineer

Remote
Start Date: ASAP

Please send CVs over if you meet the requirements

Senior Python Scraping Engineer - Permanent

What You'll Do:
Design and maintain large-scale Python scraping systems that operate reliably against Google and other highly defended websites
Build scrapers for dynamic, JavaScript-heavy pages using browser automation and hybrid approaches

Must have:
Strong Python background with production‑grade scraping, including protected platforms like Google.
Deep knowledge of browser automation, web protocols, parsing, and handling anti‑bot challenges (CAPTCHAs, IP rotation, fingerprinting).
Experienced running large‑scale, asynchronous scraping systems in the cloud with high resilience and reliability.

We are looking for a Web Scraper, not a Data Engineer

Remote
Start Date: ASAP

Please send CVs over if you meet the requirements

AI Delivery Lead - Associate Director - Insurance, Engineering AI and Data

Location: London
Business Area: Technology & Transformation
Job Type: Permanent / FTC

Role Overview

An industry‑leading professional services and technology organisation is seeking an AI Delivery Lead (Associate Director level) to help shape, design, and deliver next‑generation AI solutions for major Insurance clients. This is a senior role for someone passionate about blending strategic thinking, hands‑on delivery, and leadership to drive impactful outcomes.

You will work with high‑profile enterprise clients, guiding them through complex transformation programmes and developing AI‑enabled solutions across traditional AI, generative AI, data science, and cloud engineering.

Key Responsibilities

Client Engagement & Solution Design

* Partner with senior client stakeholders to understand business challenges and shape AI‑enabled solutions.
* Translate complex insurance domain needs into actionable technology strategies.
* Identify AI opportunities and lead go‑to‑market initiatives and strategic partnerships.

Delivery Leadership

* Lead and manage multidisciplinary teams including data scientists, engineers, developers, and analysts.
* Oversee end‑to‑end project delivery: scope, timelines, budget, and quality.
* Ensure implementation of robust governance, data privacy controls, and responsible/ethical AI practices.

Business Development

* Contribute to sales, proposals, client pitches, and long‑term account growth.
* Develop thought leadership and innovative approaches within the AI & Data domain.

Technical & Strategic Oversight

* Stay current with the evolving AI landscape, including GenAI and emerging technologies.
* Identify, evaluate, and integrate new tools, platforms, and methodologies.
* Communicate complex concepts to both technical and non‑technical audiences clearly and persuasively.

Essential Experience & Skills

* Extensive experience in the Insurance industry, with deep expertise across sub‑domains.
* Proven track record delivering large-scale, production-grade AI solutions.
* Strong ability to link complex business problems with technical AI solutions.
* Exceptional programme/project management capability.
* Deep understanding of AI technologies, including Generative AI.
* Demonstrated leadership skills and ability to manage diverse technical and non‑technical teams.
* Strong experience with agile methodologies and modern delivery practices.



Please send me a copy of your CV of you meet the requirements

Senior Databricks Data Engineer - London - Insurance - £100K

Are you ready to take your career to the next level in a rewarding environment that values your expertise?

We are seeking a Senior Azure Databricks Engineer for a permanent, hybrid role based in London. In this position, you will leverage Azure Databricks to drive innovative data solutions and contribute to enhancing our data engineering capabilities. This is an excellent opportunity for individuals who thrive in collaborative environments and are passionate about making an impact.

Key responsibilities include:
- Designing and implementing scalable data processing solutions using Azure Databricks.
- Collaborating with cross-functional teams to optimize data workflows.
- Ensuring data quality and governance across various pipelines.
- Mentoring and supporting junior data engineers to foster growth and innovation.

Requirements to be successful:

- Azure Data Services experience (including Azure ADF, Data Lake, Key Vault, Azure Functions and Databricks Delta Lake, PySpark and Unity Catalog)

- Experience within the Lloyds of London insurance market

If you are an experienced Azure Databricks engineer looking to make a meaningful contribution, we encourage you to apply for this exciting opportunity. Your skills could shape the future of data engineering with us.