- Company Name
- TechDoQuest
- Job Title
- Technical Lead- Azure Data Engineer
- Job Description
-
Job Title: Technical Lead – Azure Data Engineer
Role Summary: Lead the design, development, and maintenance of end‑to‑end data solutions on Microsoft Azure, ensuring high‑performance, scalable pipelines and data warehouses while mentoring and guiding a team of data engineers.
Expactations:
- Minimum 5 years of professional data engineering experience, with at least 2 years in a technical leadership role.
- Extensive hands‑on experience with Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Azure SQL Data Warehouse, and Synapse Analytics.
- Strong SQL and relational data‑modeling skills.
- Proficiency in Python or Scala for data transformation and processing pipelines.
- Demonstrated experience building and maintaining BI reports using Power BI or Tableau.
- Ability to translate business requirements into robust, cost‑effective Azure data architectures.
Key Responsibilities:
- Design, build, and optimize Azure‑native data pipelines (ADF, Databricks, Data Lake).
- Develop and maintain Synapse workspaces and Azure SQL Data Warehouse schemas.
- Implement, test, and monitor data quality, latency, and reliability.
- Provide technical guidance, code reviews, and mentorship to junior engineers.
- Collaborate with data scientists, analysts, and stakeholders to define KPIs and reporting needs.
- Drive continuous improvement of data engineering processes, tooling, and best practices.
- Manage security, governance, and compliance requirements for data assets.
Required Skills:
- Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Synapse Analytics, Azure SQL Data Warehouse.
- SQL (T‑SQL, U-SQL) and relational data‑modeling.
- Python or Scala for ETL/ELT pipelines.
- BI reporting with Power BI, Tableau, or similar tools.
- Strong understanding of data integration patterns, data governance, and DevOps practices on Azure.
- Excellent problem‑solving, communication, and teamwork abilities.
Required Education & Certifications:
- Bachelor’s degree in Computer Science, Information Systems, or related field (Masters preferred).
- Microsoft Certified: Azure Data Engineer Associate (DP‑203; DCA‑103) or equivalent.
- Preferred: Azure Solutions Architect Expert or Azure DevOps Engineer certifications.