- Company Name
- Devoteam Data Driven
- Job Title
- Data Engineer (H/F)
- Job Description
-
**Job title:** Data Engineer
**Role Summary:** Design, build, and maintain scalable, secure data pipelines that ingest, transform, and store large volumes of structured and unstructured data across multiple cloud platforms. Work closely with data scientists and analysts to deliver high‑quality data, while ensuring governance, security, and continuous improvement of data architecture.
**Expectations:**
- Deliver robust, performance‑optimized data pipelines on cloud platforms (AWS, GCP, Azure).
- Own data quality, security, and governance from source to consumption.
- Collaborate cross‑functionally, communicate complex concepts clearly, and drive continuous learning.
- Demonstrate curiosity, autonomy, and strong problem‑solving skills in complex data scenarios.
**Key Responsibilities:**
1. Develop and maintain end‑to‑end data pipelines (ingestion, ETL/ELT, storage, retrieval).
2. Architect data solutions on cloud (data lakes, warehouses, streaming).
3. Integrate, transform, and store data from diverse sources (batch, streaming, APIs).
4. Ensure data quality, security, and compliance with governance policies.
5. Collaborate with Data Scientists & Analysts to provide ready‑to‑use datasets.
6. Optimize performance, cost, and scalability of data architectures.
7. Stay current with emerging data engineering tools, best practices, and cloud services.
**Required Skills:**
- Programming: Python or Scala.
- Big data frameworks: Hadoop, Spark (and ecosystem tools).
- Cloud platforms: Proven experience on AWS, GCP, and/or Azure.
- Databases: SQL and NoSQL (e.g., PostgreSQL, MySQL, MongoDB, Cassandra).
- Data pipeline orchestration: Airflow, Prefect, or equivalent.
- Knowledge of data governance, security, and metadata management.
- Strong analytical, problem‑solving, and communication skills.
- Team orientation, self‑direction, and learning mindset.
**Required Education & Certifications:**
- Master’s degree (Bac+5) in Computer Science, Data Engineering, or related field.
- Cloud certification(s) (AWS Certified Data Analytics, GCP Professional Data Engineer, Azure Data Engineer Associate) or equivalent data engineering credentials preferred.