- Company Name
- Exalto Consulting
- Job Title
- Senior Data Engineer (SC Cleared)
- Job Description
-
**Job title**
Senior Data Engineer (SC Cleared)
**Role Summary**
Design, develop, and maintain scalable data pipelines and ML workflows for a government department. Lead data exploration, labeling, and experiment tracking activities while ensuring reproducibility and data quality. Must hold active UK SC clearance and be UK resident.
**Expectations**
- Start immediately on a 6‑month contract (remote/hybrid, occasional travel).
- Deliver end‑to‑end data solutions that support ML model development and deployment.
- Collaborate with ML researchers, data scientists, and domain experts to refine data pipelines.
- Document and package workflows for repeatable execution.
**Key Responsibilities**
- Build reproducible data preprocessing and training pipelines in Python.
- Orchestrate workflows using Airflow, Prefect, or Luigi.
- Perform data exploration, quality checks, visualisation (matplotlib/plotly), and dataset profiling.
- Manage labeling workflows, annotation, QA, confidence scoring, and audit trails.
- Track experiments with MLflow or Weights & Biases, including runs, metrics, artefacts, and model registry.
- Maintain version control (Git) and, where possible, dataset/version artefacts (DVC).
- Package work for test & evaluation (T&E) style repeatable runs; deployment not required.
- Apply domain knowledge in signal processing (spectrograms, time‑series, acoustic features) as needed.
**Required Skills**
- Python: pandas, numpy, Jupyter; strong scripting and reusable code.
- ML frameworks: PyTorch, TensorFlow, scikit‑learn.
- Data exploration & visualisation (matplotlib/plotly).
- Annotation, ontology work, inter‑annotator agreement, and audit trail mindset.
- Pipeline orchestration (Airflow, Prefect, Luigi).
- Experiment tracking (MLflow, Weights & Biases).
- Version control (Git); DVC or similar is a plus.
- Knowledge of signal processing for sonar/acoustic data (bonus).
**Required Education & Certifications**
- Bachelor’s degree (or equivalent) in Computer Science, Data Science, Applied Mathematics, or related field.
- Active UK Security Clearance (SC).
- UK residency and UK passport required.