Deutsche Telekom Digital Labs
Data Engineer II
- Compensation
- Not disclosed
- Location
- Gurgaon
- Work setup
- Not specified
- Seniority
- Middle
- Employment
- Not specified
- Experience
- 4+ years
- Category
- Data engineering
- Posted
Skills
Must have
- 4+ years of hands-on data engineering experience.
- Strong GCP, BigQuery, SQL, and Python expertise.
- Hands-on ETL/ELT development experience.
- Experience with Cloud Composer / Apache Airflow.
- Experience with Dataform and/or dbt.
- Experience with Dataflow/Apache Beam or Dataproc/Spark/PySpark.
- Strong understanding of data modelling and large-scale datasets.
- Experience with incremental/idempotent pipelines and data quality.
- Knowledge of Git, automated testing, CI/CD, monitoring, and troubleshooting.
- Ability to independently design and deliver production solutions.
Nice to have
- Apache Iceberg / modern lakehouse technologies.
- Streaming / event-driven processing and CDC.
- Data Mesh / Data Product principles.
- Terraform / Infrastructure as Code.
- Experience building reusable platform components.
- Core Stack: GCP, BigQuery, GCS, SQL, Python, Dataform/dbt, Airflow, Dataflow/Beam, Spark/PySpark, Git, CI/CD.
Full description
We are looking for a Data Engineer II with strong GCP and data engineering expertise to build scalable data pipelines, transformations, and reusable data-platform solutions.
Responsibilities:
- Build and maintain production-grade ETL/ELT pipelines on GCP.
- Develop batch and incremental processing using BigQuery, Dataform/dbt, and Airflow/Cloud Composer.
- Build distributed processing solutions using Dataflow/Apache Beam or Dataproc/Spark/PySpark.
- Develop reusable, metadata-driven, and configuration-driven data components.
- Design data models, schemas, data contracts, and incremental/idempotent pipelines.
- Implement data quality, validation, reconciliation, monitoring, and lineage.
- Optimize BigQuery queries and pipelines for performance and cloud cost.
- Implement automated testing and CI/CD for data workloads.
- Troubleshoot production issues and perform root-cause analysis.
- Collaborate with data, platform, DevOps, architecture, and business teams.
Requirements:
- 4+ years of hands-on data engineering experience.
- Strong GCP, BigQuery, SQL, and Python expertise.
- Hands-on ETL/ELT development experience.
- Experience with Cloud Composer / Apache Airflow.
- Experience with Dataform and/or dbt.
- Experience with Dataflow/Apache Beam or Dataproc/Spark/PySpark.
- Strong understanding of data modelling and large-scale datasets.
- Experience with incremental/idempotent pipelines and data quality.
- Knowledge of Git, automated testing, CI/CD, monitoring, and troubleshooting.
- Ability to independently design and deliver production solutions.
Good to Have:
- Apache Iceberg / modern lakehouse technologies.
- Streaming / event-driven processing and CDC.
- Data Mesh / Data Product principles.
- Terraform / Infrastructure as Code.
- Experience building reusable platform components.
- Core Stack: GCP, BigQuery, GCS, SQL, Python, Dataform/dbt, Airflow, Dataflow/Beam, Spark/PySpark, Git, CI/CD.