Lead Databricks Architect

We are a specialist Data & AI staffing partner representing a boutique Data and AI consulting firm that has been engaged by a Fortune 500 enterprise to deliver a large scale Databricks implementation.

Due to increased delivery demand, our client is seeking a Lead Databricks Architect to take ownership of architecture and technical direction across the program. This consultant will play a key role in shaping the platform, leading delivery teams, and acting as a senior technical authority for both the consulting firm and the end client.

Role Overview

This is a hands on, senior level contract role where you will lead Databricks architecture decisions, guide engineering teams, and work directly with client stakeholders to ensure successful delivery of agreed SOWs and milestones.

Key Responsibilities

*

Lead the design and implementation of enterprise grade Databricks Lakehouse architectures
*

Act as the senior technical authority across the Databricks platform
*

Partner closely with Fortune 500 client stakeholders, architects, and data leaders
*

Define architectural standards, patterns, and best practices
*

Provide technical leadership and mentorship to Data Engineers and Analytics Engineers
*

Ensure scalability, performance, security, and cost optimization are built into the platform
*

Support roadmap planning, architectural decision making, and documentation
*

Troubleshoot complex platform and data challenges as they arise



Required Experience

*

Proven experience leading Databricks implementations at enterprise scale
*

Strong hands on Databricks expertise, including Spark, Delta Lake, and Databricks SQL
*

Deep understanding of Lakehouse architecture patterns
*

Prior experience working with Fortune 500 or large enterprise environments
*

Strong cloud background in AWS, Azure, or GCP
*

Advanced Python and SQL skills (Scala is a plus)
*

Experience working in consulting or professional services environments
*

Strong stakeholder management and communication skills



Preferred / Nice to Have

*

Databricks certifications (Architect or Professional level)
*

Experience with Unity Catalog, data governance, or security frameworks
*

Background leading multi team or multi workstream delivery programs