Skills

Python SQL CI/CD DevOps Scrum Architecture apache git Agile Spark Databricks

Job Specifications

Senior Data Engineer - Commodities Trading

Compensation up to £100,000

Hybrid working 2-3 days on site Central London

A top market leading Commodities Trading Firm is looking for a Senior Data Engineer to join a greenfield initiative to build a brand-new data platform on the principles of a modern data Lakehouse architecture.

In this role, you will be a key member in the processing of real-time data streams and create scalable ingestion and transformation workflows using Python, SQL, and modern Lakehouse technologies such as Iceberg, Parquet, and Apache Hudi.

This is a rare opportunity to join at an early stage and become one of the most senior technical contributors, helping define architecture, set engineering best practices, and drive the firm's transition to a modern data platform that underpins critical trading decisions.

Required:

5+ years of Python development experience in an enterprise environment.
Experienced with end-to-end involvement in building a data Lakehouse.
Experience using Databricks.
Solid knowledge of related data Lakehouse technologies like Parquet, Apache Iceberg, Apache Hudi, Spark (or similar).
Strong Computer Science, Engineering (or a related subject) background.
Able to work in a modern software engineering environment, using Agile and DevOps methodologies and tools including Scrum, git and CI/CD.

Benefits:

Market leading Compensation and Benefit packages.
Working in a modern office in the heart of London, with the ability to work from home when required.
The opportunity to work for a top Commodities Trading firm in an incredibly collaborative culture.

About the Company

Stanford Black is one of London's leading technology and trading recruitment firms; with all of the experience, resources and contacts you need to take full advantage of today's fast moving business environments. Stanford Black connects leading hedge funds, proprietary trading firms, investment banks, scientific research houses, big data analytics firms and ambitious tech start-ups with the highest calibre professionals at every level. We source only the best candidates from an array of backgrounds and institutions and a... Know more