Tesco
Data Engineer
- Compensation
- Not disclosed
- Location
- Bangalore
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- 4+ years
- Category
- Data engineering
- Posted
Skills
Must have
- 4-6 years of hands-on experience in data engineering or related roles.
- Proven experience developing Spark applications in Scala.
- Strong experience working in the Google Cloud Platform (GCP) ecosystem, including Dataproc, BigQuery, and Cloud Storage.
- Proficient in SQL (especially BigQuery SQL dialects).
- Strong experience with Unix/Linux scripting for data automation.
- Familiarity with version control (Git) and CI/CD processes.
- Excellent problem-solving and debugging skills.
- Strong communication and documentation abilities.
Full description
Responsibilities:
- Design, develop, and deploy data ingestion and transformation pipelines using Apache Spark (Scala).
- Work within Google Cloud Platform (GCP) components, including Dataproc, BigQuery & Cloud Storage.
- Write complex SQL queries for data analysis, validation, and transformation in BigQuery.
- Develop Unix shell scripts for automation, data movement, and pipeline orchestration.
- Optimise and troubleshoot data pipelines for performance, scalability, and reliability.
- Collaborate with data engineers, analysts, and business stakeholders to understand requirements and ensure data quality.
- Contribute to code reviews, documentation, and CI/CD integration of data workflows.
Requirements:
- 4-6 years of hands-on experience in data engineering or related roles.
- Proven experience developing Spark applications in Scala.
- Strong experience working in the Google Cloud Platform (GCP) ecosystem, including Dataproc, BigQuery, and Cloud Storage.
- Proficient in SQL (especially BigQuery SQL dialects).
- Strong experience with Unix/Linux scripting for data automation.
- Familiarity with version control (Git) and CI/CD processes.
- Excellent problem-solving and debugging skills.
- Strong communication and documentation abilities.