Job Specifications
Overview
The Business Intelligence Specialist – Senior (ETL Developer) will support the Ministry of Children and Community Services (MCCSS) by reviewing, redesigning, and developing scalable data ingestion and reporting solutions. The role focuses on modernizing the existing reporting environment by migrating data from Oracle systems to Azure Data Lake and Databricks, supporting analytical and operational reporting needs across multiple ministry programs.
Key Responsibilities
Design, develop, and implement end-to-end ETL pipelines from Oracle sources to Azure Data Lake and Databricks.
Build and maintain ingestion frameworks for initial loads and incremental (CDC) loads using Azure Data Factory and Oracle GoldenGate.
Develop data transformations using Azure Databricks (PySpark, Python, SQL) to move data from raw to curated zones and into datamarts.
Review existing reporting models, identify gaps, inefficiencies, and recommend improvements.
Design physical data models and source-to-target mappings for reporting and analytics.
Reverse engineer and document existing SQL logic to support redesign efforts.
Develop and maintain dynamic ETL pipelines to onboard new tables and data elements.
Perform unit testing, performance tuning, data validation, and consistency checks.
Troubleshoot ETL, performance, and data quality issues across environments.
Prepare design artifacts including low-level design documents, test cases, and release documentation.
Support deployment activities including Go-Live planning, production deployment, and post-Go-Live support.
Proactively communicate with business, IT partners, and stakeholders regarding changes, risks, dependencies, and timelines.
Conduct knowledge transfer sessions and provide detailed documentation to Ministry staff.
Must-Have Requirements
7+ years of experience in ETL and database development using SQL Server, T-SQL, Oracle, PL/SQL.
2+ years of hands-on experience with Azure Data Factory, Azure Data Lake, Databricks.
Strong experience with Python and PySpark for data transformation.
Proven experience building data warehouses and dimensional data marts, including full and incremental loads.
Strong knowledge of dimensional modeling and slowly changing dimensions (SCD).
Experience with ETL tools such as SSIS and strong SQL scripting skills.
Understanding of Delta Lake architecture and modern data warehouse design.
Experience analyzing requirements, designing ETL solutions, testing, and documenting pipelines.
Strong database performance tuning and optimization skills.
Experience working in Agile environments.
Ability to work onsite 5 days per week in Toronto.
Nice-to-Have
Experience with Oracle GoldenGate for change data capture (CDC).
Experience using data modeling tools such as SAP PowerDesigner, Visio, or similar.
Experience working with Azure DevOps for CI/CD and pipeline management.
Experience supporting reporting and analytics platforms post-production.
Strong stakeholder communication and presentation skills.
Prior experience conducting knowledge transfer and training sessions.
About the Company
Teckhorizon Inc. is a leading IT solutions and staffing company that offers innovative technology solutions and staffing services to businesses of all sizes. We specialize in a wide range of IT services, including software development, cloud computing, cybersecurity, and more, and provide high-quality IT services and staffing solutions tailored to our client's needs. Our team of experienced professionals helps clients optimize their operations and achieve their business objectives. Additionally, we offer staffing solutions t...
Know more