Red Hat

Company Name: Red Hat
Job Title: Machine Learning Engineer, vLLM Inference - Tool Calling and Structured Output
Job Description: **Job Title** Machine Learning Engineer, vLLM Inference – Tool Calling & Structured Output **Role Summary** Design, develop, and maintain the vLLM inference engine layers that enable tool‑calling and structured output for large language models. Build Python/Pydantic services, implement deterministic parsers, and optimize logit‑level control mechanisms while improving performance and scalability across enterprise deployments. **Expectations** - Deliver clean, well‑tested Python code that integrates with vLLM core systems. - Collaborate across cross‑functional teams, provide architectural insights, and mentor peers. - Participate actively in code reviews, design discussions, and continuous learning initiatives. **Key Responsibilities** - Implement function and tool‑calling parsers, and structured output engines within vLLM. - Optimize inference performance through efficient parsing, beam/greedy decoding, and logit manipulation. - Conduct performance analysis, model profiling, and numerical method validation. - Write production‑grade code, tests, and documentation; engage in prompt code review. - Mentor junior engineers, fostering innovation and knowledge sharing. **Required Skills** - Strong proficiency in Python and Pydantic. - Deep understanding of LLM inference concepts (logits processing, decoding loops). - Expertise with OpenAI Chat Completions API and related standards. - Familiarity with parsing libraries (Outlines, XGrammar, Guidance, Llama.cpp grammars). - Experience with Jinja2 chat templating and constrained decoding (beam search, greedy). - Knowledge of inference metrics, trade‑offs, and efficiency techniques. - Experience with tensor libraries such as PyTorch (advantage). - Excellent communication with technical and non‑technical stakeholders. **Required Education & Certifications** - Bachelor’s or Master’s in Computer Science, Computer Engineering, Mathematics, or related field. - PhD in an ML‑related domain considered a plus. ---

Toronto, Canada

Hybrid

31-12-2025

Company Name: Red Hat
Job Title: Software Engineer
Job Description: Job title: Software Engineer Role Summary: Design, develop, test, and maintain the Red Hat Ansible Automation Platform, delivering automated provisioning, upgrading, monitoring and healing features to a global customer base. Expectations: Minimum 2 years of industry software development experience; proficiency in Python; familiarity with GitHub, Jenkins, SDLC, and Agile/Scrum processes. Demonstrated ability to work independently and collaborate within a geographically distributed team. Key Responsibilities: • Translate business and technical requirements into modular development tasks. • Architect, code, unit‑test, and integrate new features for the Ansible Automation Platform. • Create and execute test plans to achieve high quality and reliability. • Contribute to product documentation, deployment pipelines, and system design discussions. • Participate in code reviews, troubleshooting, and continuous improvement of development workflows. Required Skills: • Python programming and software engineering best practices. • Source‑control and CI/CD tools (Git, GitHub, Jenkins). • Agile/Scrum methodology and release cycle management. • Test design, automation, and debugging. • Strong communication and teamwork skills for remote collaboration. Additional desired skills: • Writing Ansible playbooks and administering the Ansible platform. • Experience with observability tools (Dynatrace, DataDog, etc.). • Cloud‑native development/administration experience. • Prior remote, globally distributed team experience. Required Education & Certifications: Not specified. ---

Durham, United states

Hybrid

Junior

05-01-2026

Company Name: Red Hat
Job Title: Strategic Account Manager – EU Institutions (Brussels, Belgium)
Job Description: **Job Title** Strategic Account Manager – EU Institutions **Role Summary** Senior account leader responsible for acquiring, expanding, and managing business relationships with the European Commission, Parliament, Council, and EU agencies. Drives adoption of enterprise open‑source solutions, consultative services, and cross‑sell opportunities while navigating EU procurement processes and long‑cycle sales. **Expactations** - Deliver year‑over‑year revenue growth and meet or exceed sales targets. - Build and sustain trusted partnerships with senior decision‑makers. - Demonstrate deep understanding of EU procurement frameworks, contracts, and funding. - Execute disciplined account planning, forecasting, and pipeline management. - Advocate Red Hat’s portfolio and consultative value to C‑level executives. **Key Responsibilities** - Develop and execute account strategies aligned with EU digital and modernization priorities. - Identify, influence, and close complex, multi‑stakeholder deals with long lead times. - Position proofs of concept, pilots, and full‑scale implementations of core Red Hat solutions. - Collaborate with solution architects, product engineering, professional services, and support to deliver customer success. - Partner with ecosystem technology and services providers to maximize value. - Maintain accurate forecasting, disciplined account planning, and reporting. - Serve as trusted advisor to senior IT and business executives. **Required Skills** - 5+ years of enterprise software sales, preferably in the public sector. - Proven consultative selling, solution‑selling, and exceeding revenue targets. - Strong knowledge of EU procurement processes, frameworks, and contracting models. - Experience managing complex sales cycles with multiple stakeholders and long lead times. - Excellent communication, presentation, and negotiation skills; ability to engage C‑level executives. - Fluency in English and French; proficiency in Dutch or other EU languages a plus. - Cross‑functional collaboration and ability to work across multiple offerings. - Strategic and tactical mindset for long‑term growth and short‑term execution. **Required Education & Certifications** - Bachelor’s degree in Business, Information Technology, or related field. - Relevant certifications in enterprise software sales or public sector procurement (e.g., Microsoft Certified: Dynamics 365 Sales, Red Hat Certified Engineer, or equivalent) preferred.

Belgium

Remote

Mid level

21-01-2026

Company Name: Red Hat
Job Title: Machine Learning Engineer
Job Description: Job Title: Machine Learning Engineer Role Summary: Design, develop, and maintain distributed inference infrastructure for large‑scale language model deployments, leveraging Kubernetes and open‑source inference frameworks such as vLLM. Expectations: Deliver production‑ready code, optimize resource utilization and fault tolerance, contribute to open‑source communities, collaborate cross‑functionally, and provide mentorship to junior team members. Key Responsibilities: - Design, implement, and test new features for the AI Inference platform. - Build and maintain distributed inference workloads using Kubernetes APIs, operators, and the Gateway Inference Extension. - Develop system components in Go, Rust, or Python to integrate with vLLM and related inference runtimes. - Create KV‑cache‑aware routing and scoring algorithms for optimized memory usage and request distribution. - Enhance stack stability, resource utilization, and fault tolerance. - Participate in technical design discussions and continuous improvement initiatives. - Conduct code reviews and share technical knowledge with the team. Required Skills: - Proficiency in Python and/or Go or a comparable language. - Experience with Kubernetes, service mesh technologies (Istio, Cilium, Envoy WASM), CNI, and gateway APIs. - Strong understanding of Layer 7 networking, HTTP/2, gRPC, API gateways, and reverse proxies. - Knowledge of LLM serving runtimes (vLLM, SGLang, TensorRT‑LLM). - Excellent written and verbal communication. - Ability to work independently in a fast‑paced, dynamic environment. - Preferred: Proficiency in Rust, C, or C++; experience with custom Kubernetes APIs/operators; familiarity with high‑performance networking (UCX, RDMA); GPU profiling tools; deep understanding of GPU architecture and parallel computing. Required Education & Certifications: - Bachelor’s degree in Computer Science, Electrical Engineering, or a related field (hands‑on experience prioritized). - Active engagement in the ML research community (publications, conferences, open‑source contributions) considered an advantage.

Boston, United states

Hybrid

21-01-2026

About the Company

Listed Jobs