- Company Name
- Sunlighten
- Job Title
- Data Scientist - AI & BI
- Job Description
-
**Job Title:** Data Scientist - AI & BI
**Role Summary:** Lead AI and business intelligence initiatives, leveraging applied machine learning (ML), large language models (LLMs), analytics, and experimentation to drive outcomes in sales, marketing, customer experience, and operations.
**Expectations:** Candidate must be authorized to work in the U.S. without visa sponsorship and reside locally in the Kansas City area.
**Key Responsibilities:**
- Own LLM/agent quality via evaluation strategies, rubric-based scoring, monitoring, and adversarial testing for agent safety, accuracy, and compliance.
- Partner with AI engineers to design prompt strategies, retrieval patterns, and secure workflows for production-ready AI.
- Lead core BI data science tasks, including predictive modeling (forecasting, scoring), experimentation, and operationalizing models into decision systems.
- Translate analytics insights into operational workflows (dashboards, alerts, CRM integrations) and improve data clarity via metric definitions and quality checks.
- Collaborate with stakeholders to align data science initiatives with business priorities and support BI/analytics tasks as required.
- Implement MLOps/LLMOps practices, including versioning, monitoring, documentation, and incident response for AI systems.
**Required Skills:**
- Proficiency in Python (pandas, scikit-learn), SQL, and statistical analysis.
- Experience deploying ML models/analytics in production (e.g., forecasting, CRM scoring).
- Knowledge of LLM evaluation, prompting, retrieval, and red team testing.
- Familiarity with MLOps/LLMOps, Git-based workflows, and tools for monitoring/alerting.
- Expertise in experimental design (A/B testing, power analysis) and data visualization/dashboards.
- Ability to partner with cross-functional stakeholders for data-driven decision-making.
**Required Education & Certifications:**
- Bachelor’s or Master’s degree in Data Science, Computer Science, Statistics, or Operations Research.
- 2–6 years of enterprise applied data science/analytics experience with stakeholder-facing deliverables.
- Portfolio or GitHub showcasing shipped models, analytics, or AI solutions preferred.