Data Engineer
Data Engineer in Gurugram who designs, builds, and maintains scalable data pipelines and ETL processes feeding a data warehouse, working with data scientists and analysts. Core stack is Google Cloud Platform (BigQuery, Cloud Composer, Dataproc) with Python, SQL, and PySpark.
- Compensation
- Not disclosed
- Location
- Gurugram
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Full time
- Experience
- 5+ years
- Category
- Data engineering
- Posted
Skills
Must have
- Strong experience with Google Cloud Platform (GCP) and its data services, particularly BigQuery
- Proficiency in programming languages such as Python and SQL
- Experience with data processing frameworks like PySpark
- Familiarity with data orchestration tools such as Cloud Composer
- Ability to work with large datasets and perform data analysis
- Strong problem-solving skills and attention to detail
Full description
We are seeking a skilled Data Engineer to join our team in Haryana. The ideal candidate will have a strong background in data engineering and be proficient in utilizing various tools and technologies to manage and analyze large datasets. As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines that facilitate the flow of data from various sources into our data warehouse. You will work closely with data scientists and analysts to ensure that the data is accessible and usable for analysis and reporting.
Key Responsibilities:
- Design and implement scalable data pipelines using GCP services such as BigQuery, Cloud Composer, and Dataproc.
- Develop and maintain ETL processes to extract, transform, and load data from multiple sources.
- Collaborate with data scientists and analysts to understand data requirements and provide solutions that meet their needs.
- Optimize data storage and retrieval processes to improve performance and efficiency.
- Monitor and troubleshoot data pipeline performance and resolve any issues that arise.
- Ensure data quality and integrity throughout the data lifecycle.
Required Skills:
- Strong experience with Google Cloud Platform (GCP) and its data services, particularly BigQuery.
- Proficiency in programming languages such as Python and SQL.
- Experience with data processing frameworks like PySpark.
- Familiarity with data orchestration tools such as Cloud Composer.
- Ability to work with large datasets and perform data analysis.
- Strong problem-solving skills and attention to detail.
If you are passionate about data engineering and want to work in a dynamic environment, we encourage you to apply for this exciting opportunity.