- Company Name
- Coelate Technologies
- Job Title
- Data Engineer
- Job Description
-
Job Title: Data Engineer
Role Summary
Contribute as an individual member of an Agile SDLC team, designing, developing, and maintaining robust data pipelines, data warehouses, and reporting solutions to support enterprise data needs.
Expectations
- Deliver clean, reusable code and design solid ETL architectures.
- Build and optimize SQL queries across multiple database platforms.
- Model data using dimensional and normalized schemas.
- Foster integration across systems via APIs, ETL tools, and data services.
Key Responsibilities
- Engineer and maintain ETL pipelines using Python, including drafting custom scripts and leveraging Airflow DAGs.
- Develop and optimize complex SQL queries (SQL Server, DB2, Oracle) for reporting and analytics.
- Create and manage database objects: tables, views, stored procedures, triggers, and materialized views.
- Design data models (schemas, entity‑relationship diagrams) for data warehouses, lakes, and MDM initiatives.
- Build interactive dashboards and reports using Qlik, Tableau, or Power BI.
- Integrate data between systems using SOAP, REST, ETL, and SSIS.
- Experiment with Spark for large‑scale data processing.
- Adapt to new cloud‑based platforms and data services as required.
Required Skills
- Object‑oriented programming proficiency in C, C++, or Java.
- Advanced SQL development across multiple dialects.
- Expertise in relational database concepts and data engineering fundamentals.
- Experience with DDL/DML, stored procedures, triggers, and materialized views.
- Hands‑on with ETL/ELT tools (SSIS, custom Python) and orchestration (Airflow).
- Familiarity with Node.js, JSON, and web service protocols.
- Ability to design and implement data models and entity‑relationship structures.
- Proficiency in data visualization tools (Qlik, Tableau, Power BI).
Required Education & Certifications
- Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or related field.
- Certifications in SQL, database administration, or data engineering (e.g., Microsoft SQL Server, Oracle DBA, or AWS Glue/EMR) are preferred.