QA / Test Automation Engineer (TypeScript/Playwright/Cypress) - Hybrid Porto (3 days/week office)
Owns test automation end to end for a major Belgian telecom operator's engineering team — building unit, API, integration, E2E/UI and contract tests with TypeScript and Playwright/Cypress, wiring them into CI/CD with quality gates, and pioneering ways to test non-deterministic AI voice/chat agents. Hybrid role: 3 days/week in the Porto office.
- Compensation
- Not disclosed
- Location
- Porto, Portugal
- Work setup
- Hybrid
- Seniority
- Lead
- Employment
- Contract
- Experience
- Not specified
- Category
- Qa
- Posted
Skills
Must have
- Strong programming ability in TypeScript/JavaScript, writing production-grade code
- Comfortable reading and navigating application code (Node.js, React/Vue)
- Proven experience building an automated test suite from a low or fragmented baseline and consolidating inconsistent tests
- Experience with modern test automation frameworks (e.g. Playwright, Cypress, Vitest/Jest)
- API and integration testing, including test data and mocking strategies
- Experience with CI/CD pipelines and integrating automated tests (e.g. Azure DevOps, GitHub Actions)
- Hands-on, current use of AI coding assistants (e.g. Claude, Copilot, Cursor) in real delivery work
- Practical experience designing and evaluating LLM-based systems: evaluation sets, prompt regression testing, prompts/context windows/retrieval/tool calling
- Comfortable reasoning about non-deterministic results rather than binary pass/fail
- Solid SQL and database knowledge for verification and test data setup
- Git and standard engineering workflows
- B2 English (Upper Intermediate) or above
Nice to have
- Experience with contract testing (e.g. Pact) or performance testing tools (e.g. k6)
- Prior experience testing voice-based or conversational AI agents
- Background in telecom or other large-scale, regulated platform environments
Full description
QA / Test Automation Engineer (TypeScript/Playwright/Cypress) - Hybrid Porto (3 days/week office)ABOUT THE OPPORTUNITY
Join the engineering team of a major Belgian telecom operator to take full ownership of test automation, including one of the most technically interesting challenges in QA today: testing AI Voice and Chat Agents that don't behave deterministically. This is a greenfield role with real influence — you'll propose the tooling, agree it with the Tech Leads, and then own it end to end.
PROJECT & CONTEXT
You will design, build, and maintain the automated test suite across all levels — unit and component guidance for developers, API and integration tests, end-to-end and UI tests, and contract tests for integrations — while assessing existing tests to keep, refactor, or replace them under a common approach. You'll build supporting infrastructure such as test data management, mocks, and service virtualisation, act as the testing expert alongside each product's Tech Lead to define strategy and release criteria, and integrate tests into CI/CD with quality gates that block unsafe releases. A first major deliverable is establishing how to test the AI Voice Agent (already live) and the upcoming AI Chat Agent — building an end-to-end approach that survives non-determinism, with scripted multi-turn conversations, criteria-based quality judgment, and statistical thresholds instead of exact matching.
WHAT WE'RE LOOKING FOR (Required)
- Strong programming ability in TypeScript/JavaScript, writing production-grade code
- Comfortable reading and navigating application code (Node.js, React/Vue)
- Proven experience building an automated test suite from a low or fragmented baseline, and consolidating inconsistent existing tests
- Modern test automation frameworks (e.g. Playwright, Cypress, Vitest/Jest, or equivalents)
- API and integration testing, including test data and mocking strategies
- Experience with CI/CD pipelines and integrating automated tests into them (e.g. Azure DevOps, GitHub Actions)
- Hands-on, current use of AI coding assistants (e.g. Claude, Copilot, Cursor) in real delivery work
- Practical experience designing and evaluating LLM-based systems: building evaluation sets, prompt regression testing, and working knowledge of how prompts, context windows, retrieval, and tool calling affect output
- Comfortable reasoning about non-deterministic results rather than expecting a binary pass/fail
- Solid SQL and database knowledge for verification and test data setup
- Git and standard engineering workflows
- B2 English (Upper Intermediate) or above