Quality Assurance Engineer - GenAI & Automation Testing

QA Engineer / Senior QA Engineer - GenAI TestingExperience: 4 - 8 Years

Location: PAN India

Work Model: Hybrid - 3 Days Work From Office

Employment Type: Full-Time

Notice Period: Immediate to 30 Days Preferred

Job Summary:

We are looking for a skilled QA Engineer / Senior QA Engineer with strong experience in Python, UI Automation, UiPath, API Testing, and Database Testing, along with exposure to GenAI application testing. The candidate will be responsible for testing both traditional software applications and AI-powered solutions, including LLM-based applications, RAG systems, AI chatbots, Agentic AI workflows, and enterprise automation solutions.

Key Responsibilities:

• Develop and execute test strategies and test cases for software and GenAI applications.

• Design and execute test cases for LLM and RAG-based systems.

• Build and maintain Python-based test automation frameworks.

• Perform UI, API, database, integration, and end-to-end testing.

• Perform UiPath workflow and automation testing.

• Validate AI-generated responses for accuracy, consistency, relevance, and quality.

• Perform prompt testing, output validation, grounding validation, and hallucination detection.

• Test AI chatbots, virtual assistants, document processing, and document Q&A solutions.

• Validate Agentic AI and multi-agent workflows, including agent decisions and human-in-the-loop processes.

• Automate regression test suites and support continuous testing.

• Perform performance and reliability testing for AI applications.

• Identify, document, and track defects using Jira.

• Support root-cause analysis and troubleshooting.

• Collaborate with Architects, Developers, Product Owners, and Business teams.

Mandatory Skills:Python:

• Python-based test automation

• API automation using Python

• Data validation scripts

• JSON processing

UI Automation & UiPath:

• UiPath Studio

• UiPath Test Suite

• UiPath Orchestrator

• Workflow validation

• End-to-end automation testing

API Testing:

• Postman

• REST APIs

• Swagger

• JSON/XML validation

Database Testing:

• SQL

• Data reconciliation

• Backend/data validation

Defect Management & Agile:

• Jira

• Agile/Scrum methodologies

• Sprint testing

• Test planning and estimation

GenAI Testing - Good to Have:

Hands-on experience in one or more of the following:

• GenAI application testing/validation

• LLM-based application testing

• RAG solution testing

• Prompt testing

• Prompt engineering validation

• AI output verification

• Hallucination detection

• Grounding validation

• Toxicity and bias testing

• Response quality evaluation

• Agentic AI testing

• Multi-agent workflow testing

• Agent decision validation

• Human-in-the-loop testing

• AI chatbot / virtual assistant testing

• Document processing solutions