Job Specifications
Senior Data Engineer
Company: Celebal Technologies
Work Model: Hybrid (No permanent remote)
Location: Edmonton, Calgary Canada
Position Overview
Celebal Technologies is seeking an experienced Senior Data Engineer to design, build, and maintain scalable data infrastructure and systems. In this role, you will enable the collection, storage, and analysis of large and complex datasets while ensuring data is accessible, reliable, secure, and high quality. You will collaborate closely with data scientists, analysts, architects, and engineering teams to deliver robust data solutions that support analytics and business decision-making.
Key Responsibilities
Data Pipeline Development: Design, develop, and maintain robust, scalable, and efficient data pipelines for processing large datasets.
Data Integration: Integrate data from diverse sources, including databases, APIs, and third-party systems, ensuring data consistency and quality.
Data Warehousing: Design and implement data warehousing solutions to support analytics, reporting, and business intelligence.
Performance Optimization: Optimize and tune data processing systems for performance, scalability, and cost efficiency.
Data Quality & Governance: Implement data quality checks, monitoring, and governance practices to ensure data accuracy, integrity, and compliance.
Continuous Improvement: Identify opportunities to enhance data quality, optimize pipelines, and improve overall data infrastructure efficiency.
Collaboration: Work closely with data architects, data scientists, analysts, and stakeholders to understand data requirements and deliver effective solutions.
Documentation: Maintain clear, accurate, and comprehensive documentation of data architectures, pipelines, and processes.
Cross-Functional Support: Collaborate with application, security, infrastructure, and operational teams to resolve design, implementation, and operational issues.
Knowledge, Skills, and Abilities
Strong experience in data modeling, database design, data storage, and data analytics.
Proficiency in Python, Java, or Scala.
Hands-on experience with data processing frameworks such as Apache Spark, Hadoop, or similar technologies.
Advanced knowledge of SQL and experience with relational databases such as MySQL.
Experience designing and supporting ETL architectures using Oracle, SQL Server, and MySQL across multiple operating systems.
Experience with cloud platforms, preferably Microsoft Azure.
Knowledge of the ITIL service delivery framework, including change management and best practices.
Familiarity with data governance principles and practices.
Strong analytical, problem-solving, and troubleshooting skills.
Excellent verbal and written communication skills with strong attention to detail.
Commitment to data accuracy, integrity, and continuous improvement.
Continuous learning mindset with a desire to stay current with emerging data engineering and analytics trends.
Preferred Qualifications
Bachelor’s degree in Computer Science, Information Technology, or a related field.
7+ years of experience in data engineering or a related role.
Relevant data engineering or cloud certifications.
Knowledge of machine learning concepts, techniques, and tools.