- Company Name
- LT Harper - Cyber Security Recruitment
- Job Title
- Senior Data Engineer
- Job Description
-
**Job Title**
Senior Data Platform Engineer (Azure | Terraform Expert)
**Role Summary**
Leads the design, deployment, and governance of enterprise‑grade Azure data platforms using Terraform as the primary IaC tool. Owns reusable module libraries, CI/CD pipelines, and secure infrastructure patterns across multiple teams, while advising on architecture, compliance, and operational monitoring.
**Expactations**
- 5+ years of platform or cloud engineering, focused on Azure.
- Exceptional Terraform expertise (advanced HCL, modular design, state/workspace strategy).
- Proven track record delivering Azure Data Factory, Synapse, Data Lake, Key Vault, and AI/ML services via IaC.
- Deep understanding of Azure networking, Identity & Access Management, and security controls.
- Demonstrated ability to build and manage CI/CD pipelines (Azure DevOps, GitHub Actions).
- Strong scripting skills (PowerShell, Bash, or Python).
- Ability to mentor peers, influence standards, and communicate with senior stakeholders.
**Key Responsibilities**
- Own and evolve Terraform‑based infrastructure design for Azure data and AI platforms.
- Develop, maintain, and document reusable Terraform modules and best‑practice patterns.
- Automate provisioning of Azure services: Data Factory, Synapse, Data Lake, Key Vault, networking, and AI/ML workloads.
- Manage state, backends, workspaces, drift detection, and remediation workflows across multi‑environment estates.
- Build and maintain CI/CD pipelines incorporating Terraform plan/apply, approvals, and policy enforcement.
- Embed observability (monitoring, logging, alerting) directly into infrastructure code.
- Design secure-by‑design architectures with private endpoints, managed identities, Key Vault integration, and network security controls.
- Act as Terraform subject‑matter expert, providing guidance, training, and influencing platform standards.
- Collaborate with data engineers, architects, and stakeholders to deliver reliable, compliant data platforms.
**Required Skills**
- Advanced Terraform (HCL, modules, remote state, workspace, lifecycle).
- Azure infrastructure: Data Factory, Synapse Analytics, Data Lake, Key Vault, AI/ML, networking, App Gateway.
- CI/CD: Azure DevOps, GitHub Actions, plan/apply automation.
- Scripting: PowerShell, Bash, or Python.
- Azure networking, IAM, security, private endpoints, key vault integration.
- Governance, security controls, observability via code.
- Excellent communication, mentoring, and stakeholder engagement.
**Required Education & Certifications**
- HashiCorp Terraform Associate (004) or Terraform Professional.
- Azure DevOps Engineer (AZ‑400) preferred.
- Azure Solutions Architect or Azure Administrator certifications advantageous.