- Company Name
- Programmers.io
- Job Title
- DevOps Engineer
- Job Description
-
Job title: DevOps Engineer – Data Engineering Focus
Role Summary:
Design, build, and maintain CI/CD pipelines and infrastructure for data engineering workloads on AWS. Automate provisioning with Terraform and enable secure, scalable data lake architectures. Collaborate with Data Engineering, Analytics, Platform Infrastructure, and Security teams to ensure reliability, performance, and cost efficiency.
Expectations:
• 8–10 years of professional DevOps experience, with a strong focus on data engineering environments.
• Proven track record of delivering end‑to‑end CI/CD solutions on AWS.
• Experience in cross‑functional collaboration and stakeholder management.
Key Responsibilities:
- Design, implement, and maintain CI/CD pipelines for data ingestion, transformation, and analytics workflows.
- Automate infrastructure provisioning and environment management using Terraform across multiple AWS accounts.
- Build and secure scalable AWS data lake architectures (Glue, S3, Lambda, RDS, Snowflake).
- Integrate monitoring, logging, and alerting for data pipelines (e.g., CloudWatch, Grafana).
- Apply security best practices (IAM, secrets management, encryption).
- Optimize performance and manage costs for data workloads.
- Work closely with Data Engineering, Analytics, Platform Infrastructure, and Security teams to ensure system reliability and compliance.
Required Skills:
- Cloud Platform: AWS (EC2, S3, Lambda, Glue, RDS, Snowflake)
- Infrastructure as Code: Terraform
- CI/CD Tools: Jenkins, GitHub Actions, GitLab CI (or equivalent)
- Data Platforms: AWS Glue, S3, Lambda, RDS, Snowflake
- Data Analytics Tools: Qlik, dbt (or similar)
- Monitoring/Logging: CloudWatch, Prometheus, Grafana, ELK stack
- Security: IAM, secrets management, encryption, compliance frameworks
- Performance optimization and cost‑management for data workloads
Required Education & Certifications:
- Bachelor’s degree in Computer Science, Engineering, or a related technical field.
- Relevant certifications preferred: AWS Certified DevOps Engineer – Professional, AWS Certified Solutions Architect – Associate/Professional, Terraform Associate.