- Company Name
- Sentinel
- Job Title
- Cloud DevOps Engineer: Data, Python, Java, Scala, AWS / Azure, Spark, S3
- Job Description
-
**Job Title**
Cloud DevOps Engineer – Data, Python, Java, Scala, AWS/Azure, Spark, S3
**Role Summary**
Engineer end‑to‑end data platform operations, deploying and automating services across AWS and Azure. Lead CI/CD pipelines, infrastructure provisioning, and container orchestration for big‑data workloads. Collaborate with data science and software teams to deliver scalable, reliable solutions.
**Expectations**
- Mastery of Python, Java, Scala.
- Deep knowledge of AWS/Azure services, Spark, S3, NiFi.
- Hands‑on experience with IaC (Terraform, CloudFormation).
- Proficient in Docker/Kubernetes and Git/Jenkins/Ansible.
- Strong data‑management and architecture background.
- Agile, fast‑paced environments; English fluency mandatory.
**Key Responsibilities**
- Design, build, and maintain reusable IaC modules for cloud infrastructure.
- Configure and manage CI/CD pipelines for data applications.
- Deploy and scale Spark jobs, NiFi flows, and other big‑data pipelines.
- Implement containerization (Docker) and orchestration (K8s, Swarm).
- Monitor, troubleshoot, and optimize cloud resources (compute, storage, networking).
- Ensure security, compliance, and cost efficiency across platforms.
- Collaborate with data architects, developers, and stakeholders to align infrastructure with business goals.
**Required Skills**
- Programming: Python, Java, Scala.
- Cloud Platforms: AWS (EC2, S3, RDS, Redshift, EMR), Azure (VMs, Blob, Data Factory).
- Big‑Data Frameworks: Apache Spark, NiFi, Hadoop ecosystem.
- IaC Tools: Terraform, AWS CloudFormation, Azure Resource Manager.
- Containerization & Orchestration: Docker, Kubernetes, Docker Swarm.
- Automation & CI/CD: Git, Jenkins, Ansible, CircleCI, GitHub Actions.
- Data Management: ETL/ELT, data warehousing concepts, schema design.
- Monitoring & Observability: CloudWatch, Prometheus, Grafana.
- Agile Methodologies: SCRUM, Kanban.
- Strong analytical, problem‑solving, and communication skills (English).
**Required Education & Certifications**
- Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field.
- Industry certifications preferred: AWS Certified DevOps Engineer, Azure DevOps Engineer, Certified Kubernetes Administrator (CKA), etc.