Data Analyst - Python/PySpark

Company Overview :

Pegasus Knowledge Solutions India Private Limited is a specialized technology services firm focused on delivering high-end data engineering, analytics, and software solutions. Operating at the intersection of complex data ecosystems and emerging technologies, the company partners with global enterprises to solve critical infrastructure challenges. With a strong footprint in India, Pegasus empowers organizations to leverage data-driven insights to accelerate innovation in sectors ranging from automotive technology to large-scale enterprise operations.

Role Overview :

As a Data Analyst for AV Support Data Infrastructure & Analytics, you will be at the forefront of processing and interpreting massive datasets generated by autonomous vehicle systems. You will work closely with cross-functional engineering teams to maintain the integrity of data pipelines and derive actionable insights that drive vehicle performance and safety improvements. This role is pivotal in ensuring that complex sensor and telemetry data is transformed into structured intelligence, directly influencing the development lifecycle of autonomous driving technologies.

Key Responsibilities :

• Develop and optimize complex SQL queries to extract, manipulate, and analyze large-scale datasets from distributed storage environments.

• Build and maintain robust data pipelines using Python and Spark to ensure high-quality data availability for downstream engineering and research teams.

• Collaborate with autonomous vehicle domain experts to identify data gaps and implement automated validation checks that improve overall data infrastructure reliability.

• Translate technical findings into clear, data-backed reports for stakeholders to support decision-making in vehicle software development.

• Monitor data infrastructure performance within Hive environments to identify bottlenecks and implement efficient solutions that enhance query processing speeds.

Required Skillset :

• Demonstrated proficiency in writing complex SQL queries and utilizing Python for data manipulation and automation tasks.

• Strong understanding of big data frameworks, specifically Spark and Hive, with the ability to manage and query large-scale datasets effectively.

• Solid grasp of data structures and algorithms to design efficient data processing workflows that handle high-velocity autonomous vehicle data.

• Proven ability to communicate technical insights to non-technical stakeholders, ensuring alignment between data findings and business objectives.

• Capacity to work independently and collaboratively within a hybrid work environment in Bangalore or Hyderabad, adapting to the fast-paced requirements of the autonomous vehicle industry.

• A Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field, backed by 4 to 7 years of professional experience in data analysis and infrastructure support.