Capgemini Technology Services
Data Engineer - Google Cloud Platform
- Compensation
- Not disclosed
- Location
- Bangalore; Mumbai; Pune
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- 6+ years
- Category
- Data engineering
- Posted
Skills
Full description
Experience :
Optimally between 6 - 12 years of experience as Google Cloud Data Engineer responsible for building and optimizing data pipelines, designing scalable data architectures, and enabling advanced analytics and machine learning workflows on Google Cloud Platform (GCP).
Educational qualifications expected :
Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
Key Responsibilities :
- Must have working knowledge in GCP Dataflow, BigQuery, Pub/Sub, Cloud Composer, and Cloud Storage.
- Hands-on experience with CI/CD tools and DevOps practices.
- Collaborate with data scientists, analysts, and application developers to deliver high quality data solutions.
- Ensure data quality, governance, and security across all pipelines and storage layers.
- Write efficient and maintainable code in Python and PySpark.
- Develop and optimize SQL queries for data extraction and transformation.
- Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience with relational databases such as Microsoft SQL Server, MySQL, PostgreSQL, Oracle and NoSQL databases such as Hadoop, Cassandra, MongoDB.
- Strong analytic skills related to working with structured, semi structured, unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- Implement data quality checks and monitoring, ensuring data accuracy and reliability.
- Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
Tech Stack :
- GCP Dataflow, BigQuery, Pub/Sub, Cloud Composer, Cloud Storage
- Python, PySpark, SQL
- Hadoop, Spark, Kafka
- Microsoft SQL Server, MySQL, PostgreSQL, Oracle, Cassandra, MongoDB
Additional Information :
- Reporting to: Director - Intelligent Insights and Data Strategy
- Travel: Must be willing to be deployed at client locations anywhere in the world for long and short term as well as should be flexible to travel on shorter duration within India and abroad