Skills

Communication Python SQL Data Governance Data Engineering Apache Spark AWS Lambda Architecture apache angular Organization AWS Spark Terraform

Job Specifications

Job title : Lead AWS Platform/Data Engineering Lead

Location: Toronto, ON

Duration: 6 months Contract

Digital: Terraform- 7+ years

Job Description:

Must Have Technical/Functional Skills

Client is looking for engineers with the following skills:

* Strong Experience with AWS Services: S3, Lake Formation, Glue, EMR, EC2 Athena, Lambda, EventBridge, SNS, SQS

* Strong Experience in SQL, Python and Spark for Data Engineering tasks

* Expertise in Terraform

* Experience in designing and implementing Data Pipeline on AWS using native and configurable AWS services

* Excellent design and troubleshooting skills.

* Proficiency in Apache Spark for distributed data processing

* Experience with Amazon Neptune DB for graph-based metadata management

* Strong understanding of Data lake architecture, data governance and security best practices

* Strengthen Entitlement capability

* Launch self-serve data subscription and sharing of data products through Data Portal

* Improve data discovery by displaying composite data products only, simplifying catalog organization, Low Latency Solutions

* Build, design and implement scalable data lake architecture using AWS S3 and Lakeformation

* Build and optimize ETL Pipelines using AWS Glue, EMR and Spark

* Implement Event-Driven workflows using EventBridge, SNS and SQS

* Design and query datasets using Athena

* Manage metadata and data lineage using Amazon Neptune DB

* Expose APIs for data subscription and sharing using API Gateway and AWS Lambda

* Automate infrastructure provisioning using Terraform

* Ensure data security and compliance by implementing robust IAM policies and access controls.

* Develop and maintain a self-serve data portal using Angular and integrate it with backend service

Managerial Skills (Must Have)

* Strong Communication Skills

* Experience in Leading Teams

About the Company

IMCS Group is an IT, Healthcare, and Professional Staffing Company that helps Enterprises optimize the business value of their Staffing investments and enables them to achieve world-class business performance. IMCS Group supports strategic and operational aspects of IT implementations to help businesses implement growth strategies and leverage technology to achieve competitive advantage. In addition, IMCS provides hospitals and medical facilities with high-quality clinical professionals with the highest standards and complia... Know more