Data Engineer - PySpark/Python

Need senior Data Engineers who have experience in pyspark , Elastic Search , API development and AI skills as well

Role Overview :

We are seeking a seasoned Data Engineer to join our core engineering team in Pune, where you will architect and scale robust data pipelines that serve as the backbone of our analytical ecosystem.

In this role, you will bridge the gap between raw data and actionable business intelligence, collaborating closely with data scientists, product managers, and cross-functional engineering teams to ensure data integrity and accessibility.

Your work will directly influence strategic decision-making by providing high-performance data solutions that empower our stakeholders to derive meaningful insights, ultimately driving product innovation and operational efficiency at scale.

Key Responsibilities :

• Design and implement scalable ETL/ELT workflows to consolidate data from disparate sources, ensuring high availability and performance for downstream analytics.

• Optimize data storage and retrieval processes to reduce latency and improve query efficiency for business intelligence dashboards.

• Partner with data science teams to build and maintain production-grade data pipelines that support machine learning models and predictive analytics.

• Establish and enforce data governance and quality standards to ensure accuracy and compliance across all organizational data assets.

• Mentor junior engineers and lead technical initiatives to modernize our data infrastructure, fostering a culture of engineering excellence and continuous improvement.

Required Skillset :

• Demonstrated expertise in building distributed data systems using Big Data technologies such as Spark, Kafka, and Flink, with a deep understanding of cloud-native data warehousing solutions like Snowflake, BigQuery, or Redshift.

• Advanced proficiency in Python or Scala for data processing, coupled with strong SQL skills for complex data modeling and performance tuning.

• Proven ability to communicate complex technical concepts to non-technical stakeholders, ensuring alignment between engineering outputs and business objectives.

• Strong problem-solving mindset with the ability to navigate ambiguous requirements and adapt to the fast-paced, hybrid work environment of our Pune office.

• A Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field, supported by 8 to 10 years of hands-on experience in designing large-scale data architectures.