- Company Name
- Mars
- Job Title
- Senior Data Engineer
- Job Description
-
**Job title**: Senior Data Engineer
**Role Summary**:
Lead the design, implementation, and maintenance of trusted supply‑chain data assets in a cloud‑based environment. Own end‑to‑end data pipelines, ensure data quality, freshness, and usability, and provide technical leadership to product squads across data, analytics, and front‑end teams. Drive continuous improvement of platform technology, DevOps practices, and data governance in alignment with regulatory standards.
**Expactations**:
- Build and operate high‑quality, scalable data pipelines (Databricks/PySpark, Azure).
- Maintain data quality, governance, and compliance with GDPR and corporate security standards.
- Serve as the technical go‑to for supply‑chain data, translating requirements into deployable solutions.
- Mentor and collaborate with junior engineers, enforcing coding standards and best practices.
- Own end‑to‑end lifecycle of data assets, from ingestion to model delivery, including monitoring, alerting, and troubleshooting.
**Key Responsibilities**:
- Design, develop, and deploy reproducible data pipelines that ingest supply‑chain data from diverse sources.
- Apply unit testing, CI/CD, and DevOps practices to ensure reliability and rapid delivery.
- Implement data quality processes, metadata management, and access control across data assets.
- Provide architectural input to guarantee platform security, compliance, and performance standards.
- Lead technical discussions with product managers, data scientists, and domain experts to shape data solutions.
- Drive automation, cost optimization, and platform evolution initiatives.
- Coordinate with cross‑functional squads to validate requirements, estimate effort, and mitigate risks.
- Participate in and enhance data engineering community standards and shared libraries.
**Required Skills**:
- Strong experience with Python, PySpark, and Databricks in an Azure cloud environment.
- Expertise in supply‑chain data domains (procurement, manufacturing, logistics).
- Proven application of agile software development, DevOps, CI/CD, and unit testing.
- Deep understanding of data protection, privacy, GDPR, and security best practices.
- Excellent planning, prioritisation, and problem‑solving abilities.
- Effective communication with business and technical stakeholders.
- Ability to mentor peers and influence technical direction.
**Required Education & Certifications**:
- Bachelor’s degree in Computer Science, Data Engineering, or related field (Master’s preferred).
- Relevant certifications (e.g., Azure Data Engineer Associate, Databricks Certified Data Engineer) are advantageous.