Baseten

About the Company

Inference is everything. Baseten is an AI infrastructure platform giving you the tooling, expertise, and hardware needed to bring great AI products to market - fast. Our proprietary Inference Stack utilizes the cutting-edge of performance research combined with highly performant and reliable infrastructure to give you out-of-the-box global availability with 99.99% of uptime.

Listed Jobs

Company Name

Baseten

Job Title

Software Engineer - Infrastructure

Job Description

Job title Software Engineer - Infrastructure Role Summary Develop and maintain core infrastructure components for a machine‑learning inference platform, enabling efficient model deployment, scaling, and monitoring across multi‑cloud environments. Expactations * Build Python and Go based services that support model serving * Design and manage Kubernetes deployments and orchestration layers * Implement monitoring, logging, and resource‑management solutions for ML workloads * Automate deployment workflows and improve reliability and performance * Collaborate closely with peer teams to evaluate and adopt infrastructure best practices Key Responsibilities * Develop and extend platform components for inference on varied GPU resources (e.g., B200, fractional H100) * Create and maintain Kubernetes manifests, Helm charts, and deployment pipelines for model serving workloads * Design service‑level monitoring dashboards and alerting for inference performance metrics * Engineer efficient resource provisioning and autoscaling strategies for distributed inference workloads * Enhance automation scripts and CI/CD pipelines to streamline model deployment processes * Participate in architectural reviews and technical discussions to shape long‑term infrastructure strategy * Mentor junior engineers on coding standards, DevOps practices, and ML infrastructure concepts Required Skills * 1–3 years software engineering or infrastructure experience * Proficiency in Python; Go knowledge preferred * Hands‑on experience with Kubernetes, containerization (Docker, containerd) * Familiarity with distributed system concepts and resource scheduling * Experience with monitoring/logging tools (Prometheus, Grafana, ELK) * Basic understanding of ML model serving and inference workflows * Strong written and verbal communication; collaborative mindset Required Education & Certifications * Bachelor’s degree or higher in Computer Science, Engineering, or related field (or equivalent experience) ---

New york, United states

Hybrid

Fresher

11-02-2026

Company Name

Baseten

Job Title

Software Engineer - Internal Platform

Job Description

**Job Title:** Software Engineer – Internal Platform **Role Summary:** Develop and maintain scalable internal engineering platforms that improve productivity, collaboration, and quality across all product teams. Focus on tooling, monorepo workflows, CI/CD pipelines, shared libraries, and infrastructure automation. **Expectations:** - Deliver robust, reusable engineering tools that integrate seamlessly with existing workflows. - Continuously improve performance, reliability, and developer experience. - Own the end‑to‑end lifecycle of platform components from design to production. **Key Responsibilities:** 1. Design, implement, and maintain diversified tooling for engineering teams. 2. Enhance monorepo infrastructure and create standardized project templates. 3. Build and evolve shared libraries focused on observability and observability instrumentation. 4. Optimize CI/CD pipelines for speed, reliability, and completeness. 5. Develop and manage Terraform modules for cloud infrastructure. 6. Introduce solutions that increase transparency in continuous delivery processes. 7. Provide hands‑on support, troubleshooting, and guidance to engineering teams. **Required Skills:** - Strong proficiency in Go and/or Python. - Experience with Kubernetes, Docker, Helm, and related container tooling. - Proven ability to manage and develop large monorepos; familiarity with Bazel, Pants, Turborepo, or similar. - Deep understanding of CI/CD concepts and pipeline orchestration. - Solid grasp of infrastructure-as-code (Terraform) and IaC best practices. - Excellent developer tooling mindset; knowledge of open‑source developer tools is a plus. - Ability to write clean, maintainable, and well‑documented code. **Required Education & Certifications:** - Bachelor’s degree in Computer Science, Software Engineering, or related field, or equivalent practical experience. ---

Montreal, Canada

Hybrid

03-03-2026