Fractile

About the Company

Fractile is building chips to run large language models two orders of magnitude faster. Existing hardware is good for training LLMs, but very poorly suited to subsequent inference of the trained model, which is increasingly the dominant workload. A network’s weights need to be moved onto a chip once per word generated, and this movement takes a few hundred times longer than the subsequent computations themselves. Fractile’s revolutionary approach to fusing computation with memory eliminates this bottleneck, and can scale to allow running the world’s largest models at a global scale.

Listed Jobs

Company Name

Fractile

Job Title

Sr ML Runtime Engineer

Job Description

Job Title: Senior Machine Learning Runtime Engineer Role Summary: Design, develop, and maintain high‑performance Rust runtime for AI acceleration hardware, integrating with major ML frameworks (PyTorch, vLLM, SGLang). Collaborate with hardware, lower‑level software, and ML teams under a hardware‑software co‑design methodology to deliver fast inference pipelines. Expectations: Deliver production‑ready runtime components, validate performance against hardware specifications, and continuously improve scalability and reliability. Drive technical ownership in a fast‑paced, cross‑functional environment. Key Responsibilities: - Build and extend Rust runtime for AI acceleration devices. - Integrate runtime with open‑source ML ecosystems (PyTorch, vLLM, SGLang). - Collaborate with hardware, firmware, and software teams to align runtime design with accelerator architecture. - Benchmark and optimize inference workloads, ensuring target performance metrics. - Participate in code reviews, design discussions, and maintain high code quality. - Troubleshoot runtime issues across development, staging, and production environments. Required Skills: - Proficiency in Rust and Python. - Experience with ML software ecosystem projects (PyTorch, vLLM, SGLang, or similar). - Strong understanding of modern ML inference workloads and deployment challenges. - Familiarity with industry‑standard development tools (CI/CD, version control, testing frameworks). - Ability to work collaboratively in interdisciplinary teams and take ownership of complex problems. Required Education & Certifications: - Bachelor’s or Master’s degree in Computer Science, Electrical/Electronics Engineering, Mathematics, Physics, or related field. - Minimum 5 years of industry experience in software engineering focused on machine learning systems. (No specific certifications required.)

London, United kingdom

On site

Mid level

18-11-2025