Intuition IT – Intuitive Technology Recruitment

Home
Jobs
Intuition IT – Intuitive Technology Recruitment
AWS Data Engineer

AWS Data Engineer

Hybrid

London, United kingdom

Freelance

12-11-2025

Share this job:

Score my CV

Skills

Python Data Engineering Apache Spark CI/CD Version Control Architecture Programming apache AWS Agile Spark

Job Specifications

Job Title: AWS Data Engineer

Location: London,UK

Work Type: Hybrid

Start Date: Immediate (Notice period/joining within 1-2 weeks)

Key Responsibilities

• Designing and developing scalable, testable data pipelines using Python and Apache Spark

• Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3

• Applying modern software engineering practices: version control, CI/CD, modular design, and automated testing

• Contributing to the development of a lakehouse architecture using Apache Iceberg

• Collaborating with business teams to translate requirements into data-driven solutions

• Building observability into data flows and implementing basic quality checks

• Participating in code reviews, pair programming, and architecture discussions

• Continuously learning about the financial indices domain and sharing insights with the team

WHAT YOU'LL BRING:

Writes clean, maintainable Python code (ideally with type hints, linters, and tests like pytest)
Understands data engineering basics: batch processing, schema evolution, and building ETL pipelines
Has experience with or is eager to learn Apache Spark for large-scale data processing
Is familiar with the AWS data stack (e.g. S3, Glue, Lambda, EMR)
Enjoys learning the business context and working closely with stakeholders
Works well in Agile teams and values collaboration over solo heroics

About the Company

IT'S NOT RECRUITMENT. IT'S BUSINESS TRANSFORMATION. We help businesses align their people, process and technology with their business strategy and vision. Recruitment companies find people who fit the job spec. We find the people that drive business forward, combining talent with technology to ensure a perfect fit for your CONTRACT and PERMANENT needs. AREAS: * Business Change & Transformation * Cloud & Enterprise * Cyber Sec, Data Analytics & Tech * ERP & Business Intelligence VENDORS: Workday, ServiceNow, Salesforce... Know more