Data Engineer - PySpark/AWS

Hiring Data Engineer for Bangalore Location.

Experience : 9 -13 Years

Job Location : Bangalore

F2F interview only

Must have experience in BFSI domain experience

Job Description :

Key Responsibilities :

• Design and implement scalable ETL/ELT pipelines to ingest and transform large-scale datasets, ensuring seamless data flow across the enterprise architecture.

• Develop and optimize data warehousing solutions that support complex analytical queries and reporting requirements for diverse business stakeholders.

• Build and maintain high-performance data processing applications using PySpark to handle distributed computing tasks efficiently.

• Collaborate with cross-functional teams to identify data gaps and implement automated solutions that improve data quality and pipeline reliability.

• Manage cloud-based data infrastructure on AWS, ensuring cost-effective resource utilization and adherence to security best practices.

Required Skillset :

• Demonstrated proficiency in designing and managing data warehouses, with a deep understanding of schema design and performance tuning.

• Advanced technical capability in writing complex SQL queries and optimizing database performance for large-scale production environments.

• Hands-on experience in developing data processing workflows using PySpark and Python to manage distributed data sets.

• Strong working knowledge of AWS services, specifically in the context of data storage, processing, and orchestration.

• Excellent communication skills with the ability to translate technical data challenges into clear, actionable insights for non-technical stakeholders.

• Proven ability to thrive in a collaborative, hybrid work environment, demonstrating self-motivation and a structured approach to problem-solving.

• A degree in Computer Science, Engineering, or a related quantitative field, reflecting a strong foundation in data structures and algorithms.