Job Specifications
Role: Agentforce Tester
Job Title: Agentforce Tester
Location: London (Remote)
Clearance: SC Clearance (Desirable)
Contract Type: 6 Months
Salary: 575-595 (Inside)
Start Date: April
________________________________________
About the Role
We are seeking a highly skilled and detail oriented Agentforce Tester to join our growing team. In this role, you will be responsible for ensuring the quality, reliability, and performance of AI Agents built on the Agentforce platform.
You will play a crucial part in validating agent behaviour, testing workflows, identifying defects, and ensuring safe, accurate, and compliant conversational outputs.
This is an exciting opportunity for someone passionate about AI, automation, and quality assurance—working closely with developers, product owners, and business stakeholders to enhance the performance of our intelligent agent solutions.
________________________________________
Key Responsibilities
Testing & Quality Assurance
• Develop and execute comprehensive test plans and test cases for AI agents.
• Perform manual and automated testing across conversational pathways, integrations, APIs, and end to end user journeys.
• Validate agent accuracy, response quality, business rule adherence, and safety standards.
• Conduct regression testing following model updates or training cycles.
• Test agents across multiple channels, including web, mobile, CRM, and chat interfaces.
Defect Identification & Resolution
• Log and document defects with clear, reproducible steps and supporting diagnostics.
• Work closely with engineering teams to investigate issues and verify resolutions.
• Spot edge cases, requirement gaps, and failure points early in the development lifecycle.
Data & Performance Analysis
• Review conversation logs to identify misclassifications and optimisation opportunities.
• Monitor agent performance metrics such as accuracy, latency, handoff rates, and user satisfaction.
• Provide data driven insights to refine training data, prompts, and configurations.
Compliance & Safety
• Ensure AI agents comply with organisational and regulatory standards.
• Validate adherence to safety guardrails and prohibited content constraints.
• Support documentation and audit readiness for quality and compliance reviews.
Collaboration & Continuous Improvement
• Partner with Product, Engineering, and SMEs to ensure testing alignment.
• Contribute to evolving testing frameworks, automation capabilities, and best practices.
• Participate in agile ceremonies and cross functional working sessions.
________________________________________
Required Skills & Experience
• Proven experience in software testing, QA, or conversational AI testing.
• Familiarity with functional, regression, exploratory, and UAT methodologies.
• Understanding of AI/ML concepts, LLM based systems, or chatbot testing (preferred).
• Experience working with JSON, APIs, and automation tools.
• Strong analytical skills with a keen eye for inconsistencies and patterns.
• Excellent communication skills and high attention to detail.
• Ability to thrive in Agile environments and manage competing priorities.
________________________________________
Desired Qualifications
• Experience with Salesforce Agentforce, Einstein, or similar AI agent platforms.
• Knowledge of NLP, prompt engineering, or training data quality.
• Background working in secure or regulated environments.
________________________________________
Success Measures
• High test coverage and minimal release defects.
• Improvements in agent accuracy, reliability, and user satisfaction.
• Strong collaboration and communication with cross functional teams.
• Meaningful contributions to testing processes, frameworks, and automation.
About the Company
Anson McCade is a specialist recruitment agency focusing on four primary sectors: Quant Research, Trading & Risk; Digital & Data Analytics; IT & Cyber Security; Business Change & Transformation and Strategy. With offices in London, Belfast, Paris and Sydney, Anson McCade operates globally, working on mandates across Europe, Asia and US. In an ever changing business and technological landscape, the need for exceptional, agile talent is crucial to almost every organisation’s success over the long term. We target the highest c...
Know more