Senior Data Engineer - Google Cloud Platform

About the job :

We are seeking a Senior GCP Data Engineer with 4 to 8 years experience to design, build, and operate scalable batch and real-time data pipelines on Google Cloud Platform (GCP).

The ideal candidate has strong foundations in cloud-native data engineering, is highly self-driven, accountable, and excels as a collaborative team player in Agile environments.

Key Responsibilities :

• Design, develop, and maintain batch and real-time ETL/ELT pipelines on GCP.

• Build and optimize data pipelines using Python.

• Implement streaming solutions using Pub/Sub and Dataflow.

• Develop and manage batch workflows using Cloud Composer.

• Design and optimize data models and queries in BigQuery.

• Work with large-scale, low-latency data stores such as Bigtable.

• Ensure data quality, reliability, performance, and scalability.

• Manage source code, reviews, and collaboration using GitHub.

• Build and maintain CI/CD pipelines using GitHub Actions.

• Collaborate with product, platform, and analytics teams in an Agile setup.

Required Skills & Qualifications :

• Strong hands-on experience with Google Cloud Platform (GCP).

• Proven expertise in batch and real-time data pipelines.

• Strong programming experience in Python.

• Hands-on experience with BigQuery, Bigtable, Pub/Sub, Dataflow, and Cloud Composer.

• Solid understanding of data modeling, ETL/ELT, and distributed data systems.

• Proficiency with GitHub and GitHub Actions-based CI/CD.

• Experience working in Agile environments.

• Strong knowledge of data security and access management.

Nice to Have :

• Experience with data governance, lineage, and observability tools.

• Exposure to large-scale analytics or enterprise data platforms.

Technical Skills :

• Primary Skills: GCP, Bigdata, PySpark, Bigquery, Composer, Python.

• Secondary Skills: SQL, Spark/Python.

• Good to Have: Gen AI.