cover image
Invisible Expert Marketplace

Invisible Expert Marketplace

www.invisible.co

22 Jobs

5,001 Employees

About the Company

We are the AI training and scaling partner for the leading foundation model providers, enterprises, and governments, bridging the gap between AI potential and production.

Our unique AI Process Platform combines elite global human expertise, cutting edge technology, and deep institutional knowledge gained by training 80% of the world’s leading AI models.

Listed Jobs

Company background Company brand
Company Name
Invisible Expert Marketplace
Job Title
Vietnamese Language Specialist – AI Trainer
Job Description
Job title: Vietnamese Language Specialist – AI Trainer Role Summary: Evaluate, test, and refine large‑scale AI language models on Vietnamese. Provide linguistic expertise on phonology, orthography, syntax, semantics, pragmatics, dialects, and sociolinguistics, recording failures and suggesting improvements. Expectations: Demonstrate clear, metacognitive communication; document error traces; deliver actionable feedback for prompt engineering and evaluation metrics. Key Responsibilities: • Interact with AI models across Vietnamese linguistic scenarios. • Verify factual accuracy and logical consistency of model outputs. • Capture reproducible error traces and categorize failure modes. • Propose adjustments to prompts, prompts‑engineering, and evaluation criteria. • Communicate findings in concise, well‑structured reports. Required Skills: • Deep knowledge of Vietnamese phonology, orthography, grammar, semantics, pragmatics, dialectal variation, and sociolinguistics. • Experience in linguistic analysis, translation or interpretation, or teaching Vietnamese. • Strong written and oral communication, ability to “show work.” • Familiarity with AI‑model evaluation or ability to learn rapidly. • Self‑directed, detail‑oriented, and able to deliver consistent documentation. Required Education & Certifications: • Master’s or PhD in Vietnamese language, linguistics, or a closely related field. • Peer‑reviewed publications, recognized teaching credentials, or hands‑on linguistic projects are preferred. • Relevant certifications in AI model evaluation or NLP are a plus.
France
Remote
29-10-2025
Company background Company brand
Company Name
Invisible Expert Marketplace
Job Title
AI QA Trainer – LLM Evaluation
Job Description
**Job Title:** AI QA Trainer – LLM Evaluation **Role Summary:** Execute rigorous quality assurance for large language models, focusing on safety, prompt robustness, factual consistency, bias, and system reliability. Design evaluation rubrics, conduct adversarial red‑team testing, perform regression and grounding verification, and report reproducible failures to improve model performance. **Expectations:** - Mastery of LLM evaluation frameworks and safety standards. - Ability to translate complex AI behavior issues into clear, actionable findings. - Strong cross‑functional communication with engineering, data science, and product teams. **Key Responsibilities:** 1. Design and implement test plans, regression suites, and rubrics for hallucination, factuality, jailbreak resistance, bias, and chain-of-reasoning validation. 2. Run daily prompts against models, verify accuracy, logical soundness, and latency SLOs. 3. Capture error traces, generate root‑cause hypotheses, and document failures for internal knowledge base. 4. Automate test pipelines using Python/SQL and frameworks such as PyTest. 5. Perform adversarial red‑team exercises and safety audits. 6. Create dashboards (e.g., W&B, custom) to track quality metrics over time. 7. Recommend prompt engineering, guardrail, and metric improvements. 8. Collaborate with model devs to triage bugs and prioritize fixes. **Required Skills:** - Expert knowledge of LLM evaluation tools (OpenAI Evals, RAG evaluators). - Experience in creating evaluation rubrics and pass/fail criteria. - Proficiency in adversarial testing / red‑team methodologies. - Strong regression testing at scale. - Bias/fairness audit expertise. - Grounding and retrieval‑augmentation verification. - Prompt and system‑prompt engineering. - Test automation with Python/SQL (PyTest, unit testing). - Clear, documented communication; “show your work” mindset. **Required Education & Certifications:** - Bachelor’s, Master’s, or PhD in Computer Science, Data Science, Computational Linguistics, Statistics, or related field. - Certifications in AI/ML safety or relevant QA/testing frameworks preferred. ---
United kingdom
Remote
04-11-2025
Company background Company brand
Company Name
Invisible Expert Marketplace
Job Title
Machine Learning & Coding Expert (SME)
Job Description
**Job Title** Machine Learning & Coding Expert (SME) **Role Summary** Serve as a technical consultant for AI training data projects, defining quality metrics, reviewing code and model outputs, and guiding contractors to meet stringent technical standards. Deliver structured QA, SOPs, and best‑practice resources across diverse ML domains while ensuring timely project completion. **Expactations** - Apply 5+ years of industry experience in software engineering, machine learning, or data science. - Maintain high technical standards for code, annotations, and model configurations. - Communicate clearly with engineers and non‑technical stakeholders. - Work within fixed project timelines and scopes, producing actionable feedback and training materials. - Fluently speak and write in English, ensuring concise documentation and guidance. **Key Responsibilities** - Define domain‑specific success metrics, SOPs, QA rubrics, and reference materials. - Review and validate contractor outputs (code, annotations, model configs) against technical standards. - Conduct daily/weekly QA passes, flag defects, and provide remediation notes. - Advise on tools, frameworks, and workflows to meet quality benchmarks. - Handle specification changes, edge‑case scenarios, and evaluate new model architectures or data formats. - Create “gold standard” libraries for calibration and comparability. - Participate in technical talent vetting, code review tests, and ML task evaluations. - Deliver targeted training resources for clean code, hyper‑parameter tuning, and dataset preparation. - Support project scoping, technical requirements, and post‑project reviews. - Build dashboards tracking defect categories and recurrence; conduct post‑mortems and recommend process improvements. **Required Skills** - Mastery of Python, C++, or Java; proficiency with PyTorch, TensorFlow, HuggingFace, or scikit‑learn. - Expertise in defining quality metrics and SOPs for ML workflows. - Strong QA methods, defect tracking, and documentation discipline. - Excellent written and verbal communication; ability to produce technical documentation and training materials. - Ability to mentor and evaluate contractor talent. - Familiarity with diverse ML domains: NLP, CV, MLOps, NLP, statistical modeling, data engineering, feature engineering, time series, recommender systems, XAI, and data storytelling. **Required Education & Certifications** - Bachelor’s or Master’s degree in Computer Science, Data Science, Machine Learning, or related technical field. - Certifications in ML frameworks or software quality (e.g., TensorFlow Developer, PyTorch Practitioner, ISTQB, or equivalent) are preferred.
United kingdom
Remote
Mid level
04-11-2025
Company background Company brand
Company Name
Invisible Expert Marketplace
Job Title
Linguistics Expert (SME)
Job Description
**Job Title:** Linguistics Expert (SME) **Role Summary:** Provide specialized linguistic consultation for AI training data projects. Define and enforce domain‑specific quality metrics, develop SOPs and QA rubrics, review outputs, give targeted feedback, and improve processes to ensure high‑quality, accurate, and consistent annotated datasets delivered on schedule. **Expectations:** - 5+ years of professional experience in linguistic analysis, annotation standards, and data quality control. - Advanced degree (PhD preferred) in Linguistics, Applied Linguistics, Computational Linguistics, or a related field. - Proven ability to set, enforce, and maintain rigorous technical standards in data creation projects. - Strong communication skills for clear technical guidance and documentation. - Ability to work within fixed project timelines and deliver precise, actionable feedback to contractors. **Key Responsibilities:** 1. Define domain‑specific quality success metrics (e.g., transcription accuracy, IPAs, Universal Dependencies). 2. Develop project‑specific SOPs, QA rubrics, and reference materials aligned with client technical standards. 3. Review and audit transcriptions, annotations, and datasets; flag and correct defects before delivery. 4. Perform structured QA passes on daily/weekly deliverables; track defects and expedite resolution. 5. Provide remedial notes to contractors and recommend process improvements. 6. Advise on tools, workflows, and specification changes, addressing edge‑case scenarios and rare dialects. 7. Curate gold‑standard libraries and calibration samples for consistency checks. 8. Vet contractor talent, administer accuracy tests, and offer precise feedback. 9. Create training resources and guidelines (e.g., phonetic transcription rules, morphology instructions). 10. Build dashboards or defect trackers; analyze trends, conduct post‑mortems, and propose process tweaks. 11. Document lessons learned and contribute to standard evolution for future projects. **Required Skills:** - In‑depth knowledge of linguistic annotation standards (IPA, UD, etc.). - Expertise in quality control, QA methodology, and metric development. - Strong technical documentation and rubric creation abilities. - Data analysis, dashboard creation, and defect tracking proficiency. - Problem‑solving for rare dialects, ambiguous constructs, and edge‑case handling. - Excellent written and verbal communication in English; additional language proficiency is a plus. **Required Education & Certifications:** - PhD (or advanced degree) in Linguistics, Applied Linguistics, Computational Linguistics, or equivalent. - Minimum 5 years of professional experience in linguistic analysis, annotation, and quality control. - Certifications in QA or documentation are beneficial but not required.
United kingdom
Remote
Mid level
04-11-2025