- Company Name
- Ampliwork
- Job Title
- Applied AI Intern
- Job Description
-
Job title: Applied AI Intern
Role Summary: Collaborate with AI, ML, and product teams to enhance enterprise‑grade AI agents. Focus on diagnosing agent failures, refining planning and tool‑use strategies, optimizing prompts, and reducing latency while maintaining quality.
Expactations: Deliver measurable performance improvements, build and maintain automated evaluation harnesses, publish self‑contained research findings or prototypes that ship to production, and provide clear dashboards and acceptance criteria for all releases.
Key Responsibilities:
- Diagnose and address failure modes of AI agents, refining routing, planning, and tool‑use strategies.
- Design balanced, adversarial, and scenario‑based evaluation sets and extend an automated evaluation harness.
- Track metrics such as win‑rates, pass@k, precision/recall/F1, and overall task success.
- Scout, reproduce, and prototype research ideas (e.g., self‑reflection, retrieval augmentation, tool composition).
- Conduct A/B tests, define guardrails, and ship improvements with concise dashboards and clear acceptance criteria.
- Collaborate with ML, engineering, and product teams for rapid iteration and deployment.
Required Skills:
- Strong analytical mindset, meticulous attention to detail, and crisp written and verbal communication.
- Proficiency in Python and SQL, familiarity with Git, Jupyter, and experiment tracking tools.
- Experience with RAG pipelines, document parsing/extraction, evaluation pipelines, and metrics dashboards.
- Knowledge of LLM planning, retrieval augmentation, and agent architecture concepts.
- Ability to design balanced evaluation sets and understand evaluation metrics (precision, recall, F1, etc.).
Required Education & Certifications:
- Current undergraduate or graduate study in Engineering, Computer Science/IT, or Physical Sciences.
- English proficiency required; French is an asset.