Tenth Revolution Group are working with a leading manufacturing organization who are seeking a technically strong professional to lead and manage the implementation, rollout, and subsequent utilization of Databricks across the organization. The successful candidate for this position will be responsible for designing and deploying scalable data pipelines and advanced analytics solutions using the Databricks platform.
Technical Responsibilities:
* Architect and implement data solutions using Databricks, including Delta Lake and Unity Catalog
* Build and optimize ETL/ELT pipelines using PySpark and SQL
* Configure and manage Databricks Workspaces, clusters, and job workflows
* Integrate Databricks with cloud platforms (AWS, Azure, or GCP) and data sources
* Implement CI/CD processes for Databricks using tools like Azure DevOps or GitHub Actions
* Set up data governance, access control, and monitoring within Databricks
* Collaborate with data engineers, platform teams, and stakeholders on technical delivery
Required Technical Expertise:
* Databricks (core platform, Delta Lake, Unity Catalog)
* PySpark and Spark SQL
* Cloud data services (AWS/GCP/Azure)
* CI/CD automation for data pipelines
* Git-based version control and release processes
* Data lake architecture and performance tuning
Candidates for this role must be able to demonstrate a deep technical fluency in Databricks and a strong track record of delivering complex data infrastructure projects
