AI Quality Assurance Engineer

We’re looking for a QA Test Engineer to join a fast-moving team building a cutting-edge, AI-driven product powered by multi-agent systems. This is a hands-on role focused on ensuring the quality, reliability, and accuracy of AI-powered features—from user interfaces to conversational outputs.

You’ll collaborate closely with engineers, data scientists, and product teams to execute test strategies, validate AI behaviour, and identify defects. This role is ideal for someone who enjoys problem-solving, has strong QA fundamentals, and is interested in developing expertise in AI and LLM-based systems.

What You’ll Be Doing

Test Execution & Quality Assurance

• Execute test plans and test cases across features and components
• Support the creation and maintenance of test documentation
• Perform functional, regression, exploratory, and smoke testing
• Participate in release validation cycles
• Validate bug fixes and ensure issues are resolved effectively

AI Response Validation

• Evaluate AI-generated outputs against defined scenarios and acceptance criteria
• Identify inconsistencies, inaccuracies, and hallucinations in AI responses
• Execute structured and exploratory validation scenarios
• Work with AI engineers to reproduce and analyse model behaviour
• Ensure consistency across varying inputs and contexts

UI & End-to-End Testing

• Test user interfaces and conversational workflows for usability and accuracy
• Validate end-to-end user journeys across systems
• Ensure alignment with product requirements

Automation & Tooling

• Develop and maintain automated test scripts using existing frameworks
• Execute automated test suites and investigate failures
• Contribute to improving automation coverage

Interested in remote work opportunities in QA & Testing? Discover QA & Testing Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

• Support CI/CD-driven testing processes

Performance & Reliability

• Execute basic performance and latency testing
• Support validation of access controls and data handling
• Identify and report stability or reliability issues

Collaboration & Communication

• Write clear, reproducible defect reports
• Track issues through to resolution using Jira
• Communicate progress, risks, and blockers effectively
• Participate in agile ceremonies

What We’re Looking For

Experience & Core QA Skills

• 3–5 years of experience in software testing
• Strong understanding of functional, regression, and exploratory testing
• Experience with test design techniques (e.g. boundary value analysis, equivalence partitioning)
• Ability to create test scenarios from incomplete or evolving requirements
• Experience with risk-based testing

Technical & AI Awareness

• Understanding of conversational AI or LLM-based systems
• Ability to assess correctness, consistency, and completeness of outputs
• Familiarity with non-deterministic system behaviour
• Experience identifying subtle defects in AI-generated responses

Automation Skills

• Experience with tools such as Playwright, Cypress, Selenium, or similar
• Ability to debug and stabilise automated tests
• Basic knowledge of CI/CD pipelines
• Comfortable reading and understanding automation code

Mindset & Communication

• Strong analytical thinking and attention to detail
• Clear and concise communication skills
• Ability to work independently and take ownership of testing efforts
• Proactive approach to problem-solving

Nice to Have

• Experience testing AI or LLM-based products
• Exposure to performance, load, or security testing
• Interest in progressing toward a senior or AI-focused QA role

Why Join Us?

• Work on innovative AI technology at the forefront of the industry
• Fully remote environment with flexible working
• Opportunity to develop specialised expertise in AI quality engineering
• Collaborative, fast-paced, and supportive team

If you’re passionate about quality and curious about the future of AI, we’d love to hear from you.