Bioscope AI

About the Company

Bioscope AI is a cloud-based, per-patient subscription service for primary care physicians, especially those in concierge or functional medicine practices. It integrates with their EMR to serve as an artificially intelligent consultant that can collaborate with the physician to optimize patient care. The first year of the service includes whole genome sequencing (WGS), so Bioscope AI can help physicians deliver truly personalized, precision care.

Listed Jobs

Company Name

Bioscope AI

Job Title

Data Scientist (AI Quality & Evaluation)

Job Description

Job title: Data Scientist (AI Quality & Evaluation) Role Summary: Design, build, and maintain end‑to‑end systems that evaluate and certify the quality, safety, and reliability of clinical AI models. Lead the development of automated pipelines, uncertainty quantification, and feedback loops that enable continuous improvement and regulatory compliance. Expectations: - Deliver scalable evaluation frameworks for model output assessment. - Achieve calibrated confidence metrics that align with real‑world accuracy. - Integrate clinician‑validated test cases and maintain stringent quality gates. - Collaborate with modeling, production, and regulatory teams to align AI behavior with safety standards. Key Responsibilities: - Architect and develop automated evaluation pipelines at scale. - Create uncertainty quantification modules that provide meaningful confidence scores. - Build evaluation frameworks combining automated metrics with clinician‑validated benchmarks. - Implement continuous feedback loops to refine model outputs. - Establish scalable quality gates to detect errors prior to end‑user delivery. - Contribute to model alignment, fine‑tuning, and performance monitoring activities. Required Skills: - Proficiency in deep learning frameworks (PyTorch) and large‑language‑model architectures. - Expertise in model evaluation, benchmarking, and quality metrics. - Strong statistical analysis capabilities. - Advanced Python programming and modern ML tooling. - Ability to interpret, extend, and implement research papers. - Excellent communication and documentation skills. Required Education & Certifications: - Master’s degree in Computer Science, Machine Learning, Statistics, or a related quantitative discipline (PhD preferred). Optional / Preferred: - Publications in top ML/AI conferences (NeurIPS, ICML, ICLR, ACL). - Experience with RLHF, DPO, or other preference‑optimization techniques. - Background in healthcare AI or regulated industries. - Practical experience building evaluation systems for production LLM applications.

Boston, United states

Hybrid

03-03-2026