Skills

SQL Data Engineering CI/CD DevOps Version Control Azure DevOps Azure Analytics Spark Databricks PySpark

Job Specifications

Venturi are partnered with a leading data & analytics consulting firm who are delivering into a well-known global car manufacturer. The project sits within a large-scale AI and data transformation programme, and we’re looking for an experienced Azure Databricks Engineer to join the team.

This is an opportunity to work on a high-impact, enterprise-level data platform with complex pipelines, advanced analytics use cases, and modern Azure engineering practices.

Responsibilities

Build, optimise and maintain scalable ETL/ELT pipelines using Databricks (PySpark, Spark SQL).
Design Delta Lake architectures and ensure high-quality, production-ready data models.
Support the integration of data into AI & ML workflows across the programme.
Implement engineering best practices including CI/CD, version control and testing.
Collaborate with analytics teams and client stakeholders to shape technical requirements.
Troubleshoot performance issues and drive cluster and job optimisation.
Produce clear technical documentation and contribute to architectural decisions.

Required Experience

Strong hands-on experience with Azure Databricks and the wider Azure data ecosystem.
Excellent working knowledge of PySpark, Spark SQL, and distributed data processing.
Experience with Azure Data Lake, Delta Lake, Data Factory or Synapse Pipelines.
Proven background in designing and delivering large-scale data engineering solutions.
Solid understanding of CI/CD (Azure DevOps preferred), governance and environment separation.
Ability to work in fast-paced consulting environments with complex stakeholder groups.

If this role sounds interesting, click apply and we’ll reach out to discuss the project in more detail.

About the Company

It's everything we stand for. Our role is to assemble incredible tech talent. The visionaries, disruptors and leaders who make things happen. The ones who spark progress and innovation. Without them, ideas, projects and strategies never leave the table. We play a vital role. Identifying individuals we deem best-in-class and uniting them with progressive businesses. Similar to the Venturi effect, which gave us our name, we believe businesses are more able to move at speed when they're under less pressure. Like, the pressure o... Know more