- Company Name
- 360 Technology
- Job Title
- Sr. Cloud Data Platform Engineer
- Job Description
-
**Job title**
Sr. Cloud Data Platform Engineer
**Role Summary**
Design, build, and maintain scalable cloud‑based data platforms for a banking client. Leverage Azure, AWS, or GCP to deploy data lakes, warehouses, and processing workloads, ensuring high performance, security, and compliance with financial regulations.
**Expectations**
* Deploy and manage cloud data services in a regulated banking environment.
* Manage end‑to‑end data pipelines, including ingestion, transformation, and analytics.
* Collaborate with cross‑functional teams to deliver data solutions on schedule and within budget.
* Apply DevOps best practices to enable rapid, reliable delivery of data platform changes.
**Key Responsibilities**
1. Architect and implement data lakes, warehouses (Snowflake, Redshift, etc.), and stream‑processing pipelines on cloud platforms.
2. Develop, schedule, and monitor ETL/ELT jobs using Python, Java, or Scala.
3. Design and maintain Databricks clusters, jobs, notebooks, and workspaces; optimize performance and cost.
4. Provision infrastructure with Terraform or CloudFormation; enforce IaC standards.
5. Create and maintain CI/CD pipelines for data platform artifacts, ensuring automated testing and deployment.
6. Perform capacity planning, monitoring, and troubleshooting of data platform components.
7. Document platform architecture, data flows, and operational procedures for audit and compliance.
8. Mentor junior engineers and promote best practices across the team.
**Required Skills**
* Cloud platforms: Azure, AWS, or GCP – with hands‑on deployment experience.
* Data engineering: Data warehousing, data lakes, ETL/ELT pipelines.
* Databricks: Deep knowledge of cluster management, notebooks, jobs, and workspace governance.
* SQL & NoSQL databases; relational database tuning.
* Programming: Python, Java, or Scala for data processing.
* IaC: Terraform or CloudFormation for infrastructure provisioning.
* DevOps: CI/CD pipelines, automation, monitoring, and alerting.
* Strong analytical, problem‑solving, and communication skills.
**Required Education & Certifications**
* Bachelor’s degree in Computer Science, Information Technology, Data Engineering, or related field.
* Professional certifications preferred: AWS Certified Solutions Architect / Databricks Certified Professional Data Engineer / Google Cloud Professional Data Engineer.
---