Lead AI Test Engineer
- Compensation
- Not disclosed
- Location
- London, GB
- Work setup
- Hybrid
- Seniority
- Lead
- Employment
- Not specified
- Experience
- 10+ years
- Category
- Qa
- Posted
Skills
Full description
Job Title: Lead AI Test Engineer
Location: London
About the Job you are considering:**
We are seeking an experienced Lead AI Test Engineer to drive quality assurance and testing strategies for AIML powered applications Generative AI solutions and intelligent automation platforms The ideal candidate will combine strong expertise in software test engineering with handson experience validating AI models LLM based applications machine learning systems and data driven solutions across the full development lifecycle.
Hybrid working**:
The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home; noting that you will be unable to work at home 100% of the time.
Your Role:**
- Define and implement end-to-end testing strategies for AI Machine Learning and Generative AI solutions
- Lead QA activities across AI product development ensuring quality reliability performance security and compliance
- Design and execute test plans for LLM powered applications chatbots copilots RAG solutions and AI agents
- Validate AI model accuracy bias fairness explainability robustness and performance
- Develop and maintain AI test automation frameworks using Python and modern testing tools
- Perform functional integration regression API performance and security testing for AI platforms
- Establish test data management practices and synthetic data generation approaches
- Define and monitor AI quality metrics model drift hallucination rates response consistency and user experience KPIs
- Collaborate with Data Scientists AI Engineers Product Owners Architects and business stakeholders
- Support CICD integration and quality gates for AI model deployment pipelines
- Mentor QA teams and promote best practices in AI testing and automation
Your Skills:**
- 10 years of experience in Software Testing Test Automation and Quality Engineering
- Handson experience testing AIML and Generative AI solutions
- Strong knowledge of Large Language Models LLMs RetrievalAugmented Generation RAG Prompt Engineering and AI Agents
- Experience with AI platforms such as Azure OpenAI Microsoft Copilot Studio OpenAI AWS Bedrock Vertex AI or similar