- Company Name
- UBDS Digital
- Job Title
- Test Engineer - Data Platforms
- Job Description
-
**Job Title**
Test Engineer – Data Platforms
**Role Summary**
Lead test engineer responsible for end-to-end testing of data pipelines, models, and reporting solutions on an Azure data platform (Databricks, Data Factory, Data Lake Storage, Power BI). Own the testing strategy, design and automate validation throughout the SDLC, ensuring data quality, performance, and compliance.
**Expectations**
- Act as sole testing subject‑matter expert on the delivery team.
- Deliver comprehensive test coverage and quality gates in CI/CD pipelines.
- Maintain ownership of testing artifacts, metrics, and documentation.
**Key Responsibilities**
- Define and own overall testing strategy for ingestion, transformation, storage, and presentation layers.
- Design and implement automated test frameworks (Python/PySpark, Great Expectations, Pytest, dbt tests).
- Execute data validation, exploratory, regression, and performance tests for Azure Databricks notebooks, ADF pipelines, ADLS layers, and Power BI dashboards.
- Establish data quality checks, reconciliation, and monitoring.
- Integrate test execution into CI/CD (Azure DevOps, GitHub Actions) enforcing quality gates.
- Advise data engineers, BI developers, architects, and product owners on testing and acceptance criteria.
- Represent testing in sprint planning, reviews, and delivery ceremonies.
**Required Skills**
- Proven experience as a test engineer in data engineering or analytics projects.
- Deep knowledge of Azure data services: Databricks, Data Factory, Data Lake Storage, Power BI.
- SQL proficiency and data profiling for test design.
- Hands‑on automation of data tests using Python/PySpark, Great Expectations, Pytest, dbt, etc.
- CI/CD integration experience (Azure DevOps, GitHub Actions).
- Strong problem‑solving, independence, and communication skills.
**Desired Skills**
- Familiarity with regulated data environments and public sector delivery frameworks.
- Data performance testing and monitoring.
- Agile delivery and DevOps practices.
- Exposure to TDD/BDD.
- ISTQB or equivalent testing certification.
**Required Education & Certifications**
- Bachelor’s degree in Computer Science, Information Systems, or related field (or equivalent work experience).
- ISTQB or comparable testing certification preferred.
Manchester, United kingdom
Hybrid
26-09-2025