Job Specifications
QA Automation Engineer (AI) – Montreal / Hybrid – $95,000 + Benefits
Yolk Recruitment are excited to be working with a global B2B SaaS technology business that’s continuing to invest heavily in AI-enabled platforms and modern engineering practices. Known for their collaborative culture and strong focus on quality, they’re offering an excellent opportunity for a Quality Assurance Engineer to play a key role in delivering reliable, production-ready AI solutions.
We’re looking for an experienced AI QA Engineer with a strong automation background and a genuine interest in AI-driven systems. You’ll work closely with Engineering, Product, and Data teams to define intelligent test strategies, build scalable automation, and ensure quality across complex, cloud-native SaaS platforms.
What you’ll be doing:
Define and own AI-driven test strategies covering functional, non-functional, data, and model-level validation.
Design, document, and maintain scalable test frameworks, reusable components, and comprehensive test cases.
Build and maintain robust automated test suites using modern frameworks such as Playwright or Cypress.
Validate AI and ML workflows, including model behaviour, output quality, bias, hallucination risks, and regression across versions.
Test APIs, microservices, integrations, and data pipelines to ensure accuracy, security, and reliability.
Embed automated testing into CI/CD pipelines, working closely with DevOps teams to support continuous testing.
Support performance and scalability testing, including inference latency and system throughput.
The skills you’ll need:
5+ years’ experience in software quality engineering or SDET roles.
Strong hands-on experience with modern test automation frameworks (Playwright, Cypress, or similar).
Experience testing APIs, microservices, and distributed systems.
Solid understanding of test architecture, automation design patterns, and QA best practices.
Experience integrating automated tests into CI/CD pipelines.
Familiarity with AI/ML concepts such as LLMs, prompts, inference, and model lifecycles.
Experience using defect tracking and test management tools (JIRA, TestRail).
Comfortable working in Agile/Scrum environments with cross-functional teams.
Company Benefits:
Hybrid working model
Integrated mental health and wellbeing support
Annual leave starting at 3 weeks
Wellness Days and an Annual Giving Day
Comprehensive medical and dental coverage
Company-wide end-of-year shutdown to fully switch off and recharge
Ready to apply?
Please apply with your latest CV.
Know someone who’d be great for this role? We offer a referral scheme, so feel free to get in touch.
Note: We aim to respond to every application, but due to volume this isn’t always possible. If you haven’t heard back within 7 days, unfortunately you haven’t been successful on this occasion. Please keep an eye on our website for future opportunities.
About the Company
We are Yolk.
An award-winning multi-sector specialist recruitment brand, partnering with businesses nationally from our headquarters in Cardiff.
Through our partnership approach to talent acquisition, we help our UK-wide client base of SMEs to global brands find the permanent, contract, and temporary staff they need.
Whether it be 1 hire, 10 hires or 100 hires, we have a suite of services to suit. Our cross-divisional offering ensures we can embed within your business and offer you recruitment solutions across multiple...
Know more