Data engineer in health research

Описание

We're creating a data platform that enables cutting‑edge health research at unprecedented scale. As a Data Engineer, you'll play a critical role in designing and building the secure, high‑quality data pipelines that power research used by scientists and healthcare innovators around the world.

Задачи

• Building and maintaining data pipelines across our Azure-based platform
• Translating technical specifications, architecture designs, and Jira tickets into secure, scalable implementations
• Developing data transformation and ETL processes using Python and PySpark
• Working with healthcare and NHS datasets to curate trusted, research‑ready data assets
• Reviewing and approving code through pull requests, ensuring consistency, quality, security, and adherence to engineering standards
• Collaborating with researchers, engineers, and stakeholders to understand requirements and deliver solutions
• Identifying risks, challenging assumptions, and asking the right questions to improve designs before implementation
• Producing documentation, source‑to‑target mappings, and supporting technical standards across the platform
• Contributing to best practices in data engineering, security, governance, and cloud architecture

Требования

• Proven experience building production‑grade data pipelines and ETL processes
• Excellent Python skills with experience developing scalable data solutions
• Experience working with PySpark or distributed data processing frameworks
• Experience using GitHub and modern software engineering practices
• Understanding of cloud‑based data platforms, ideally Azure
• Experience working with sensitive or regulated data and knowledge of secure data handling principles
• Ability to review technical designs and architecture documents and translate them into practical implementations
• Excellent problem‑solving skills and an ability to challenge requirements constructively when needed
• Experience conducting code reviews and maintaining engineering standardsExcellent stakeholder management and communication skills
• Будет плюсом: Experience working with NHS or healthcare datasets; Knowledge of healthcare coding systems and standards such as SNOMED CT, ICD, or READ codes; Experience with Databricks; Experience with Kubernetes; Experience using Dagster or other workflow orchestration platforms; SQL and data modelling experience; Understanding of metadata management and data governance frameworks

Условия

Salary from £62,000 per annum. We are interested in applications from people with a range of experience for this role

• Generous Pension Scheme - We invest in your future with employer contributions of up to 12%