(INACTIVE/ONHOLD) Senior Data Engineer (GCP) | Onsite in Manila
Senior Data Engineer building and optimizing batch and real-time data pipelines on Google Cloud Platform (Dataflow, Cloud Composer, BigQuery), including ETL/ELT, SQL tuning, streaming with Pub/Sub, and pipeline monitoring. Full-time, onsite in Manila/Taguig on a shifting schedule, minimum 2 years of data engineering experience.
- Compensation
- Not disclosed
- Location
- Manila, Philippines
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Full time
- Experience
- 2+ years
- Category
- Data engineering
- Posted
Skills
Must have
- Minimum of 2 years of relevant experience in data engineering
- Strong hands-on experience with GCP, particularly Dataflow, Cloud Composer, and BigQuery
- Experience developing batch and real-time streaming data pipelines
- Advanced SQL skills, including query optimization and performance tuning
- Proficiency in Python or Java
- Experience with Apache Beam, Apache Airflow, and workflow orchestration
- Strong understanding of data modeling and ETL/ELT processes
- Experience processing Avro, Parquet, JSON, and CSV file formats
- Knowledge of GCP Cloud Monitoring, Cloud Logging, debugging, and alerting
- Strong analytical, troubleshooting, problem-solving, and communication skills
- Currently residing in the Philippines and legally authorized to work in the country
- Willing to work onsite in Manila / Taguig on a shifting schedule
- Must not have an active or recent application with the hiring client
- Must not be currently or recently employed by the hiring client
Nice to have
- Google Cloud Certified Professional Data Engineer certification
- Working knowledge of Google Cloud Spanner
- Experience with CI/CD pipelines, Terraform, and GitHub Actions
- Familiarity with GCP data governance and security practices, including IAM, KMS, and DLP
Full description
Senior Data Engineer - GCP (CL10)
Location: Manila / Taguig, PhilippinesWork Setup: OnsiteShift: Shifting ScheduleExperience: Minimum 2 YearsEmployment Type: Full-Time
Job Description
We are looking for a skilled Senior Data Engineer to design, develop, and optimize data solutions on Google Cloud Platform (GCP). The ideal candidate will have hands-on experience building scalable batch and real-time data pipelines, implementing ETL/ELT processes, optimizing SQL queries, and maintaining reliable data infrastructure.
The role involves developing robust data architectures, orchestrating complex workflows, ensuring data quality, and troubleshooting high-volume data processing systems.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Google Cloud Platform (GCP).
- Build and optimize batch and real-time data processing solutions using Dataflow, Cloud Composer, and BigQuery.
- Develop and maintain ETL/ELT processes for efficient data integration and migration across systems.
- Design and optimize complex SQL queries to improve data processing performance.
- Implement streaming data pipelines using Pub/Sub and Dataflow.
- Manage workflow orchestration and automation using Cloud Composer and Apache Airflow.
- Process structured and semi-structured data in formats such as Avro, Parquet, JSON, and CSV.
- Monitor data pipelines, troubleshoot failures, and implement logging and alerting mechanisms.
- Ensure data quality, reliability, security, and performance across the data ecosystem.
- Collaborate with cross-functional teams to deliver scalable data engineering solutions.
Required Qualifications & Skills
- Minimum of 2 years of relevant experience in data engineering.
- Strong hands-on experience with Google Cloud Platform (GCP), particularly Dataflow, Cloud Composer, and BigQuery.
- Experience developing batch and real-time streaming data pipelines.
- Advanced SQL skills, including query optimization and performance tuning.
- Proficiency in Python or Java.
- Experience with Apache Beam, Apache Airflow, and workflow orchestration.
- Strong understanding of data modeling and ETL/ELT processes.
- Experience processing Avro, Parquet, JSON, and CSV file formats.
- Knowledge of GCP Cloud Monitoring, Cloud Logging, debugging, and alerting.
- Strong analytical, troubleshooting, problem-solving, and communication skills.