Skills

Communication Python SQL Data Governance Data Engineering Apache Spark AWS Lambda Architecture apache angular Organization AWS Spark Terraform

Job Specifications

Hi,

Hope you are doing Great,

I believe this opportunity could be worth exploring. If you're open to discussing this further, I would love to discuss with you! Please feel free to reply to this email or let me know a good time for a call.

(Note: If you are not Interested, please share this with your Friends/Colleagues )

Lead AWS Platform/Data Engineering Lead

Experience Range > 12 Years

Mandatory 4 Days, In Person - In Office, Downtown Toronto

Must Have Technical/Functional Skills

Client is looking for engineers with the following skills:

* Strong Experience with AWS Services: S3, Lake Formation, Glue, EMR, EC2 Athena, Lambda, EventBridge, SNS, SQS

* Strong Experience in SQL, Python and Spark for Data Engineering tasks

* Expertise in Terraform

* Experience in designing and implementing Data Pipeline on AWS using native and configurable AWS services

* Excellent design and troubleshooting skills.

* Proficiency in Apache Spark for distributed data processing

* Experience with Amazon Neptune DB for graph-based metadata management

* Strong understanding of Data lake architecture, data governance and security best practices

* Strengthen Entitlement capability

* Launch self-serve data subscription and sharing of data products through Data Portal

* Improve data discovery by displaying composite data products only, simplifying catalog organization, Low Latency Solutions

* Build, design and implement scalable data lake architecture using AWS S3 and Lakeformation

* Build and optimize ETL Pipelines using AWS Glue, EMR and Spark

* Implement Event-Driven workflows using EventBridge, SNS and SQS

* Design and query datasets using Athena

* Manage metadata and data lineage using Amazon Neptune DB

* Expose APIs for data subscription and sharing using API Gateway and AWS Lambda

* Automate infrastructure provisioning using Terraform

* Ensure data security and compliance by implementing robust IAM policies and access controls.

* Develop and maintain a self-serve data portal using Angular and integrate it with backend service

Managerial Skills (Must Have)

* Strong Communication Skills

* Experience in Leading Teams

About the Company

Apptoza is a boutique IT service provider, offering a comprehensive range of IT services and solutions. We take pride in delivering excellence in IT consulting to businesses of all sizes, from large enterprises to mid-sized and small businesses. Founded by a team of seasoned IT professionals, Apptoza provides the expertise and leadership necessary to drive successful IT projects and help companies achieve their strategic goals. Whether you require full-scale IT project execution, application management services, or short-ter... Know more