Tata Consultancy Services
Data Engineer (Python/Pyspark)
- Compensation
- Not disclosed
- Location
- Kolkata; Chennai; Bengaluru
- Work setup
- Onsite
- Seniority
- Not specified
- Employment
- Full time
- Experience
- 4+ years
- Category
- Data engineering
- Posted
Skills
Full description
Role- Data Engineer (Python/PySpark)
Desired Experience Range- 4-8 yrs
Location- Kolkata, Chennai, Bangalore
Mandatory Skills
- Python
- PySpark
- Apache Spark
- SQL
- ETL / Data Pipelines
- Data transformation and processing
- Cloud exposure: AWS / Azure / GCP
- Git and CI/CD
Roles & Responsibilities-
- Develop scalable data pipelines using Python and PySpark.
- Build and optimize ETL/ELT workflows for large datasets.
- Perform data transformation, cleansing, and validation.
- Write complex SQL queries and optimize data-processing workloads.
- Work with Spark-based distributed data-processing solutions.
- Integrate data from multiple structured and unstructured sources.
- Monitor and troubleshoot data pipelines and production issues.
- Collaborate with data architects, analysts, and engineering teams.