cover image
Franklin Fitch

Senior ML Ops Engineer

Hybrid

New york city, United states

Senior

Full Time

16-03-2026

Share this job:

Skills

Communication Leadership DevOps Monitoring Training Architecture benchmarking Langchain NLP

Job Specifications

Senior ML Ops Engineer | High-Growth AI Startup | $190,000 - $210,000 | NYC (Hybrid)

A venture-backed AI startup is expanding its engineering team and hiring a Senior MLOps Engineer to build and scale production-grade AI systems for healthcare automation.

This role is focused on building secure, scalable AI infrastructure that supports real enterprise deployment.

Responsibilities:

Deploy NLP, OCR, and multimodal AI models in secure cloud environments
Design scalable ML pipelines with strong observability, reliability, and performance
Build data schemas and ETL workflows for annotations, training, tuning, and benchmarking
Establish best practices in experiment tracking, model versioning, and reproducibility
Write high-quality, maintainable production code
Build internal AI tools to support engineering and product teams
Identify and mitigate technical risks early in the release cycle

Requirements:

8–10+ years total engineering experience
4+ years in MLOps, SRE, DevOps, ML Platform, or similar
Strong background in AI data modeling, versioning, and annotation workflows
Recent experience delivering scalable enterprise AI products
Familiarity with MLflow, LangChain, LangFuse, W&B, CrewAI, or similar frameworks
Understanding of monitoring, experiment comparison, and evaluation frameworks
Experience with multiple database technologies
Strong communication skills and comfort in cross-functional environments
Preference for candidates with a mix of startup and tech-company experience
Heavy big-bank or Fortune 500 backgrounds are less aligned

Why This Role:

High-impact AI work in a complex, meaningful domain
Early-stage ownership with influence over AI architecture and engineering culture
Competitive compensation, equity, benefits, and flexible time off
Flat structure and direct access to leadership

Location: NYC area (hybrid). Local candidates preferred.

About the Company

Franklin Fitch ist ein Personaldienstleister, der seinen Kunden ein umfassendes Dienstleistungsangebot zur Personalbeschaffung bietet. Mit dem Fokus auf zwei Kerntechnologiebereiche garantiert das Spezialistenteam von Franklin Fitch professionelles Recruitment in den folgenden Märkten: - Netzwerkinfrastruktur - Server- und Cloudinfrastruktur - Informationssicherheit - Big Data und Datenbank Wir vertreten Kandidaten sowohl für Festanstellungen als auch Vertragsarbeit, von Junior- bis Seniorlevel und von der Adm... Know more