- Company Name
- Lorvenk Technologies
- Job Title
- Data Engineer (Ex-Capital One)
- Job Description
-
Job Title: Data Engineer
Role Summary: Design, develop, and maintain scalable data pipelines, lakes, warehouses, and real‑time streaming solutions in AWS. Ensure reliable data flow, optimize performance, and support data‑driven decision making across the organization.
Expectations: Minimum 5+ years of data engineering experience, including proven work at Capital One. 12+ month W2 contract. Demonstrated expertise in AWS data services and end‑to‑end pipeline ownership.
Key Responsibilities:
- Architect and build data pipelines and ETL workflows using AWS Glue, Lambda, Step Functions, Kinesis, Redshift, Athena, S3, EMR, and related services.
- Design and maintain data lakes, data warehouses, and streaming architectures.
- Collaborate with data scientists, analysts, and business stakeholders to deliver clean, structured datasets.
- Enforce data quality, security, governance, encryption, and IAM best practices.
- Integrate data from RDBMS, APIs, logs, and other sources into centralized platforms.
- Monitor, troubleshoot, and optimize pipeline performance and reliability.
- Automate pipeline processes and optimize resource usage for cost efficiency.
Required Skills:
- Strong proficiency in Python, SQL, and ETL development.
- Hands‑on experience with AWS Glue, Lambda, Athena, Redshift, Kinesis, S3, EMR, Step Functions.
- Solid understanding of data modeling, warehousing, and lake architectures.
- Experience with CI/CD, Git, and IaC tools (Terraform, CloudFormation).
- Excellent problem‑solving skills, attention to detail, and strong communication.
- Deep knowledge of data security, encryption, and IAM configuration.
Required Education & Certifications:
- Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent professional experience).
- AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect (Associate/Professional) preferred.