Senior Data Engineer (Senior Associate Data Engineering)

Senior Data Engineer (Senior Associate Data Engineering)

Company: Innova ESI Private Limited
Job Location: New Delhi, Delhi, India
Employment Type: Full-time
Experience Required: 9+ years

Role :Senior Data Engineer (Senior Associate Data Engineering)

Experience : 9+ Years

Location : Delhi NCR

Immediate Joiners Only.

We are looking for an experienced Senior Data Engineer with strong hands-on expertise in PySpark and Apache Spark who can independently support job validation, optimize data pipelines, and guide client teams on effective data validation techniques.

Key Responsibilities

Design, develop, and support large-scale batch and real-time data pipelines.
Build and optimize ETL/ELT pipelines using PySpark, Apache Spark, and AWS services.
Perform job validation, troubleshoot issues, and ensure data quality and accuracy.
Guide client teams on data validation strategies and best practices.
Develop and optimize data transformation workflows and data models.
Integrate third-party vendor data through APIs.
Collaborate with cross-functional teams to deliver scalable data engineering solutions.
Contribute to infrastructure optimization, automation, and CI/CD initiatives.

Required Skills

Strong hands-on experience with PySpark and Apache Spark 7+ years of experience building ETL pipelines for large datasets 3+ years of experience with AWS services such as S3, Glue, Aurora, and Databricks Strong SQL and Python programming skills Experience in data modeling, database design, and legacy data migration Good understanding of data quality, job validation, and pipeline optimization

Good to Have

API development and Redis or other in-memory database experienceAWS Lambda, IAM, Step Functions, and Cloud WatchInfrastructure as Code (IaC), automation tools, and CI/CD pipelines Relevant AWS certifications .