IG KnowHow
Data Engineering Team Lead
- Compensation
- Not disclosed
- Location
- Kraków, Poland
- Work setup
- Hybrid
- Seniority
- Lead
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Hands‑on experience designing and operating large‑scale data pipelines on GCP (BigQuery, Cloud Composer/Airflow, GCS), with proven knowledge of Apache Kafka and real‑time streaming architectures.
- Demonstrated experience leading or technically mentoring a team of data engineers, with the ability to set standards, conduct code and design reviews, and grow engineers’ capabilities.
- Strong grasp of data quality practices: data contracts, pipeline observability, SLA/SLO definition, and automated alerting and remediation.
- Solid understanding of SQL transformation patterns and modern tooling such as dbt, alongside experience managing ingestion estates with third‑party connectors and in‑house integrations.
- Clear and confident communicator able to work cross‑functionally with non‑technical stakeholders; comfortable in a regulated financial services environment with structured delivery disciplines (sprint
Full description
Data Engineering Team Lead
Minimum compensation: starting from 16000PLN. Final offer will be determined based on the candidate’s experience and competencies.
Overview
IG Group is a FTSE 100 fintech operating across five continents, serving over 1.3million customers and handling billions of dollars in transactions. We focus on solving genuinely complex problems with the right technology and resources.
About the Data Team
The Data function serves central and divisional business lines across the entire IG estate. The Data Engineering team builds the platforms that underpin analytics, reporting, compliance, and client‑facing data products, and will increasingly power AI and machine‑learning use cases.
Key Responsibilities
- Lead and deliver data pipeline and platform work within the GCP consolidation programme, owning squad commitments end‑to‑end across batch and real‑time (Kafka) workloads.
- Coach, develop, and performance‑manage a squad of data engineers across London, India, and Poland, fostering a culture of engineering excellence, ownership, and continuous improvement.
- Drive data quality as a first‑class concern: embed data contracts, observability, and SLA monitoring across ingestion and transformation layers in the Medallion architecture.
- Act as the technical point of contact for stakeholders in Compliance, Marketing, and Data Science, translating requirements into well‑scoped engineering deliverables.
- Maintain delivery rigour: run sprint cadences, manage commitments, elevate risks early, and report on pipeline SLOs, data freshness, and DORA‑style engineering metrics.
Required Qualifications
- Hands‑on experience designing and operating large‑scale data pipelines on GCP (BigQuery, Cloud Composer/Airflow, GCS), with proven knowledge of Apache Kafka and real‑time streaming architectures.
- Demonstrated experience leading or technically mentoring a team of data engineers, with the ability to set standards, conduct code and design reviews, and grow engineers’ capabilities.
- Strong grasp of data quality practices: data contracts, pipeline observability, SLA/SLO definition, and automated alerting and remediation.
- Solid understanding of SQL transformation patterns and modern tooling such as dbt, alongside experience managing ingestion estates with third‑party connectors and in‑house integrations.
- Clear and confident communicator able to work cross‑functionally with non‑technical stakeholders; comfortable in a regulated financial services environment with structured delivery disciplines (sprint cadences, change control, escalation).
How we work
We follow a hybrid working model with 3 days in the office.
- Lead and Inspire: drive trust, alignment, and enthusiasm.