DWP
Senior Data Engineer — Azure Pipelines, Hybrid
Senior Data Engineer at DWP (UK government) building and enhancing scalable ETL/ELT pipelines with Python and PySpark in Azure. Day to day: designing cloud data solutions, translating stakeholder needs into data models, and mentoring the team on engineering best practices.
- Compensation
- Not disclosed
- Location
- Stafford, United Kingdom
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Experience designing, building and enhancing scalable ETL/ELT pipelines
- Python
- PySpark
- Azure (cloud-based data solutions)
- Designing efficient data models from complex stakeholder requirements
- Working with stakeholders to deliver data solutions
- Mentoring team and promoting engineering best practices
Full description
DWP is seeking an experienced Data Engineer to design, build and enhance scalable ETL/ELT pipelines using Python and PySpark in Azure. You will lead the design and delivery of modern cloud-based data solutions, ensuring high-quality, trusted data for decision-making across the organisation.
You will work with stakeholders to translate complex requirements into efficient data models, while mentoring the team and promoting engineering best practices.