Senior Data Engineer: Azure & Databricks
Senior Data Engineer building data foundations for front-office trading at a world-leading energy trader. Day to day they roll out Data Foundation initiatives, coordinate change/incident/problem management, and build scalable ELT pipelines using Azure, Databricks, Data Factory, Synapse, Airflow and related tooling.
- Compensation
- Not disclosed
- Location
- London, United Kingdom
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Master-level AWS/Azure/SAP
- Master-level ELT
- Master-level Data Modeling
- Data Integration & Ingestion
- Data Manipulation and Processing
- GitHub, GitHub Actions, Azure DevOps
- Data Factory, Databricks, SQL DB, Synapse, Stream Analytics
- Glue, Airflow, Kinesis, Redshift
- SonarQube, PyTest
- Strong communicator across technical and business audiences
- Trusted collaborator with leaders and staff
Nice to have
- Curiosity and continuous learning
Full description
Overview
As a Senior Data Engineer, you will drive data foundations and enable data-driven decisions in front-office trading. You’ll work within a data-flow project to improve insight for trading desks, collaborating with cross-functional teams to embed foundational data capabilities. You will champion efficient implementation, cost control, and scalable data platforms, delivering tangible value. This role offers a chance to shape data strategy in a world-leading energy trader while building community and governance around data innovation.
Responsibilities
- Roll out and embed Data Foundation initiatives to support key business programs
- Coordinate change, incident, and problem management processes
- Present reports and findings to stakeholders as SME in Data Analysis & Design
- Drive efficiency and speed of implementation across pilots and future projects
- Contribute to CoE/CoP and community-building initiatives
- Support trading information flow improvements and data-driven decision making
Key requirements
- Master in AWS/Azure/SAP
- Master in ELT
- Master in Data Modeling
- Data Integration & Ingestion (skill)
- Data Manipulation and Processing (skill)
- GITHUB, Action, Azure DevOps (skill)
- Data Factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest (skill)
- Curiosity and continuous learning
- Strong communicator across technical and business audiences
- Trusted collaborator with leaders and staff
- Data Modeling
- ELT
- Data Integration & Ingestion