emagine
Senior GCP Data Engineer
12-month B2B contract through consultancy emagine, building scalable batch and real-time data platforms for a telecommunications client on GCP. Day to day: designing end-to-end streaming architectures with Kafka and Flink, plus data lakes and ETL/ELT pipelines using Python, Spark, and SQL.
- Compensation
- Not disclosed
- Location
- Poland
- Work setup
- Remote
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Strong Google Cloud Platform (GCP) Data Engineering experience
- Strong hands-on coding skills
- Proven streaming experience
- Experience with Apache Kafka and Apache Flink
- Proficiency in Python, Spark, PySpark, and SQL
- Experience with Hadoop and Snowflake, including data lakes and ETL/ELT pipelines
- Fluent in English
Nice to have
- Experience with Agile methodologies
- Keen problem-solving abilities
- Familiarity with telecom industry standards
Full description
Details:
Industry: Telecommunications
Work model: Remote
Team Size: Approximately 10 people
Assignment type: B2B
Project Duration: 12 months, starting ASAP
The role of the Senior GCP Data Engineer revolves around building scalable data platforms for the telecommunications industry, contributing to a critical project at the onset of team development.
Responsibilities:
- Design and build scalable batch and real-time data platforms.
- Develop high-throughput, event-driven streaming pipelines processing large volumes of events per second.
- Implement end-to-end streaming architectures.
- Work with temporal joins, watermarks, state management, checkpointing, and exactly-once processing.
- Monitor backpressure and optimize pipeline performance.
- Design and develop data lakes, ETL/ELT pipelines and analytics-ready data platforms.
- Write production-ready code and successfully complete live coding assessments.
Must Haves:
- Strong Google Cloud Platform (GCP) Data Engineering experience.
- Strong hands-on coding skills.
- Proven streaming experience.
- Experience with Apache Kafka and Apache Flink.
- Proficiency in Python, Spark, PySpark, and SQL.
- Experience with Hadoop and Snowflake, including data lakes and ETL/ELT pipelines.
- Fluent in English.
Nice to Haves:
- Experience with Agile methodologies.
- Keen problem-solving abilities.
- Familiarity with telecom industry standards.