Senior Quality Engineer, AI and Automation
Senior quality engineer defining and driving the quality strategy for C3 AI's enterprise AI products: building scalable automated test frameworks (UI, API, end-to-end), validating AI-generated outputs and agentic workflows, and integrating automated quality gates into CI/CD. Core stack: Java/Python, Playwright/Selenium/Cypress, Git.
- Compensation
- Not disclosed
- Location
- Guadalajara, Jalisco, Mexico
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- 5+ years
- Category
- Industrial engineering
- Posted
Skills
Must have
- Bachelor's degree in Computer Science, Software Engineering, Computer Engineering, or related field
- 5+ years of experience in Quality Engineering, Test Automation, SDET, or Software Engineering roles
- Strong programming experience in Java, Python, or a similar object-oriented language
- Hands-on experience developing and maintaining automated test frameworks (UI, API, end-to-end)
- Experience with modern test automation tools such as Playwright, Selenium, or Cypress
- Experience integrating automated tests into CI/CD pipelines and working with Git
- Strong understanding of SDLC, Agile methodologies, and quality engineering best practices
- Ability to analyze complex systems, architect test frameworks, and identify quality risks
- Excellent written and verbal communication skills
Nice to have
- Experience testing AI-powered applications, machine learning systems, LLMs, or AI agents
- Experience designing evaluation strategies for AI outputs (accuracy, reliability, consistency, safety)
- Familiarity with AI evaluation frameworks such as DeepEval, LangSmith, or Ragas
- Experience validating RAG systems and knowledge of prompt engineering and AI model evaluation
- Experience building automated quality gates for AI workflows and AI-assisted test generation
- Experience with cloud platforms (AWS, Azure, GCP), containerized environments, and observability/monitoring tools
- Experience mentoring engineers and driving quality initiatives across teams
Full description
C3 AI (NYSE: AI), is the Enterprise AI application software company. C3 AI delivers a family of fully integrated products including the C3 Agentic AI Platform, an end-to-end platform for developing, deploying, and operating enterprise AI applications, C3 AI applications, a portfolio of industry-specific SaaS enterprise AI applications that enable the digital transformation of organizations globally, and C3 Generative AI, a suite of domain-specific generative AI offerings for the enterprise. Learn more at: C3 AI
C3 AI is looking for a Senior Quality Engineer, AI and Automation to define and drive the quality strategy for our next generation of AI-enabled products and platforms. In this role, you will design and build scalable automated test frameworks, develop novel approaches for validating AI-generated outputs and agentic workflows, and establish the metrics that keep our products reliable at enterprise scale. You will work at the intersection of software quality engineering and applied AI, ensuring that quality is engineered into every stage of the development lifecycle.
This is a great role for an experienced quality engineer who is passionate about AI and automation and wants to operate with a high degree of autonomy on complex, high-visibility initiatives. You will influence quality strategy across multiple teams, provide technical leadership and mentorship, and partner closely with software engineering, product, and AI stakeholders to raise the bar on how enterprise AI is tested and delivered.
Responsibilities
- Define and execute quality strategies for AI-enabled products and platforms.
- Design, develop, and maintain scalable, automated test frameworks across UI, API, and end-to-end testing.
- Create test plans covering functional, integration, end-to-end, performance, and reliability testing.
- Develop automated validation approaches for AI-generated outputs and agentic workflows, including accuracy, reliability, consistency, and safety.
- Establish quality metrics and dashboards to measure product health and AI system effectiveness.
- Integrate automated tests into CI/CD pipelines and build automated quality gates for AI workflows.
- Identify quality risks early and drive resolution strategies across complex systems.
- Evaluate and implement AI-powered testing tools and methodologies.
- Mentor engineers, promote quality engineering best practices, and drive continuous improvement initiatives across the organization.
Qualifications
- Bachelor's degree in Computer Science, Software Engineering, Computer Engineering, or a related field.
- 5+ years of experience in Quality Engineering, Test Automation, SDET, or Software Engineering roles.