Senior Data Engineer: Azure Data Pipelines Lead
Senior Data Engineer at DWP (UK Department for Work and Pensions) designing and building scalable ETL/ELT pipelines with Python and PySpark on Azure. Day to day involves leading technical teams, delivering cloud-based data platforms, and working with stakeholders across multiple data domains to create trusted data assets.
- Compensation
- Not disclosed
- Location
- Lancashire, United Kingdom
- Work setup
- Not specified
- Seniority
- Lead
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Design, build and enhance scalable ETL/ELT pipelines using Python and PySpark
- Lead technical teams to deliver cloud-based data platforms
- Collaborate with stakeholders to transform requirements into trusted data assets
- Adhere to engineering standards
Full description
DWP is seeking a Data Engineer to design, build and enhance scalable ETL/ELT pipelines using Python and PySpark, ensuring data solutions are reliable and efficient. The role requires leadership of technical teams to deliver cloud-based data platforms that support decision-making across the organisation.
Successful candidates will work across multiple data domains, collaborating with stakeholders to transform requirements into trusted data assets while adhering to engineering standards and