Data Engineer

Data Engineer

Fixed-term contract to March 2027, with a view to going permanent | Cardiff / South Wales (hybrid) | 3 days per week in the office

The company

This is an established, fast-growing bespoke software company in South Wales. It builds custom applications and complex system integrations for public sector bodies, higher education, healthcare and the private sector. Its engineers work directly with clients, with no sales layer in between, and act as an extension of the client’s own team. It holds ISO 27001 and Cyber Essentials Plus, and is a trusted supplier to UK public sector organisations.

The role

You’ll be a senior, hands‑on Data Engineer on a major public sector programme. You’ll build and run the data pipelines that move data from a set of Java-based applications, each with its own database technology, into Microsoft Dataverse as the target platform, all in Azure. You’ll also lead workstreams and help steer the rest of the engineering team.

This contract runs to March, and the clear plan is for the right person to stay on permanently.

What you’ll be doing

• Building, testing and maintaining data pipelines and integrations from source systems into Dataverse
• Extracting, transforming and loading data from Java applications backed by a mix of databases (SQL Server, Oracle, PostgreSQL, MySQL and similar)
• Developing integration solutions in Azure, using services such as Azure Data Factory, Synapse, Logic Apps, Functions and Service Bus
• Carrying out data mapping, cleansing, validation and migration into the Dataverse data model
• Making sure solutions meet public sector standards for data quality, security and governance
• Leading delivery workstreams, mentoring other engineers and promoting good engineering practice
• Working closely with architects, developers and client stakeholders to turn requirements into working solutions

Essential – you must have:

• Public sector experience: you’ve delivered data engineering work for public sector organisations (central or local government, NHS, education or similar)
• Leadership experience: you’ve led a technical workstream or small team, mentored engineers and taken ownership of delivery
• Microsoft / Azure tech stack: you have strong hands‑on experience of building data solutions in Microsoft Azure and the wider Microsoft ecosystem, ideally including Dataverse / the Power Platform

We’d also like to see:

• Strong SQL skills and experience across several relational database technologies
• Experience of extracting data from, or integrating with, Java-based applications
• Knowledge of ETL/ELT, APIs and data migration methods