- Company Name
- NextGen Consulting Inc.
- Job Title
- Sr. Azure Data Engineer
- Job Description
-
Job Title: Sr. Azure Data Engineer
Role Summary: Lead the design, development, and maintenance of enterprise‑scale data pipelines and lakehouse solutions on Microsoft Azure. Own end‑to‑end data workflows, optimize performance and cost, and mentor junior engineers while ensuring alignment with business objectives.
Expectations: Deliver high‑quality, scalable data solutions that meet performance, cost, and reliability targets. Provide technical leadership, code reviews, and mentorship. Communicate effectively with stakeholders to translate business requirements into robust Azure‑based architectures.
Key Responsibilities:
- Design, build, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Azure SQL Data Warehouse, and Synapse Analytics.
- Implement data integration, transformation, and cleansing processes, ensuring data quality and compliance.
- Optimize storage and retrieval for performance and cost efficiency across Azure services.
- Develop data processing scripts in Python or Scala and integrate with Power BI, Tableau, or other reporting tools.
- Lead architecture reviews, code reviews, and enforce coding standards and best practices.
- Troubleshoot complex technical issues, provide root‑cause analysis, and drive resolution.
- Mentor and guide development teams, fostering a culture of continuous improvement.
- Collaborate with stakeholders to align technical solutions with business goals and timelines.
- Understand and integrate legacy SAS code where required.
Required Skills:
- Proven experience as a Data Engineer and Technical Lead focused on Azure technologies.
- Deep expertise in Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Azure SQL Data Warehouse, and Synapse Analytics.
- Strong SQL and data modeling capabilities.
- Proficiency in Python or Scala for data processing.
- Hands‑on experience with Power BI, Tableau, or equivalent reporting tools.
- Solid understanding of Azure architecture, services, and best practices.
- Excellent problem‑solving, communication, and leadership skills.
- Ability to work with or understand SAS code (plus).
Required Education & Certifications:
- Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related field (or equivalent experience).
- Azure certifications preferred: Azure Developer Associate, Azure Data Engineer Associate, or Azure Solutions Architect Expert.
- Authorization to work in Canada.