Skills

Python Data Governance CI/CD Docker Kubernetes Monitoring Programming Google Cloud Platform GCP Spark python programming CI/CD Pipelines

Job Specifications

Job Title: GCP Data Engineer

Location: Toronto, ON (3x onsite a week)

Employment Type: Contract

Job Description

We are looking for a skilled GCP Data Engineer with strong experience in building and optimizing data pipelines on Google Cloud Platform. The ideal candidate will have hands-on expertise in ETL workflow design using Spark Serverless and Spark on GKE, combined with proficiency in Python programming for data processing and automation. This role requires deep knowledge of GCP services, data governance, and monitoring practices.

Key Responsibilities

Design, develop, and maintain scalable ETL workflows using Spark Serverless, Spark on GKE, and Python.
Implement data ingestion, transformation, and loading processes for structured and unstructured data.
Utilize GCP services such as BigQuery, CloudSQL, Cloud Storage, and Pub/Sub for efficient data processing.
Optimize performance and cost for large-scale data workflows.
Implement data governance, data quality checks, and data lineage tracking using GCP tools.
Ensure compliance with organizational and regulatory standards.
Set up Cloud Logging, Cloud Monitoring, and alerting for data pipelines and infrastructure.
Troubleshoot and resolve issues proactively to maintain high availability.
Work closely with data scientists, analysts, and architects to deliver reliable solutions.
Automate workflows and processes using Python and GCP-native tools.

Required Skills And Qualifications

Strong experience with Google Cloud Platform and its data services.
Hands-on expertise in Spark Serverless, Spark on GKE, and Python programming.
Proficiency in BigQuery, CloudSQL, and GCP-native ETL tools.
Knowledge of data governance, data quality frameworks, and lineage tools.
Experience with Cloud Logging, Cloud Monitoring, and observability best practices.

Preferred Qualifications

GCP Professional Data Engineer certification.
Experience with containerization such as Docker and Kubernetes and CI/CD pipelines.
Familiarity with data security and compliance standards such as GDPR and HIPAA.

About the Company

AarornTech is a Guelph, ON based disruptive technology boutique firm specializing in Intelligent process automation development and consulting, we provide Managed RPA as a service, cloud based ready to configure Bots and end to end development and maintenance of process automation. We also support various small and large organizations (Banks, Telecom, Insurance) with their disruptive technology needs within Robotics Process Automation (RPA), Machine Learning (ML), Artificial Intelligence (AI), Blockchain, QA Automation, Perf... Know more