Lead Data Engineer
Lead Data Engineer at Circana (Bangalore office) who architects and optimizes cloud data warehouses and ETL/ELT pipelines using PySpark, Python, and SQL across AWS/Azure/GCP. Leads a team of data engineers, mentors staff, drives data governance and performance tuning, and integrates in-house data tools to power the company's consumer analytics platform.
- Compensation
- Not disclosed
- Location
- Bangalore, Karnataka, India
- Work setup
- Not specified
- Seniority
- Lead
- Employment
- Not specified
- Experience
- 11+ years
- Category
- Data engineering
- Posted
Skills
Must have
- Bachelor's or Master's degree in Computer Science, Engineering, or related field
- 7-11 years of experience in data engineering with focus on cloud-native data solutions
- Deep expertise in Python, PySpark, and SQL for data processing and analytics
- Proven experience with Cloud platforms (AWS, Azure, or GCP) and their data services
- Strong understanding of data warehousing concepts, data modeling, and distributed systems
- Experience working with and enhancing internal/in-house tools for data processing and analytics
- Excellent leadership, communication, and stakeholder management skills
- Experience with orchestration tools like Apache Airflow
- Knowledge of BI tools (e.g., Power BI, Tableau) and data visualization best practices
- Experience in Agile environments and DevOps practices
Full description
Lead Data EngineerLet’s be unstoppable together!
Circana is a leading provider of technology, AI, and data solutions for consumer packaged goods companies, manufacturers, and retailers. Our predictive analytics and Liquid Data® platform help clients measure market share, uncover consumer behavior, and drive growth—powered by six decades of expertise and an expansive, high-quality data set.
At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We’re a global company dedicated to fostering inclusivity and belonging. We value and celebrate the unique experiences, cultures, and viewpoints that each individual brings. By embracing a wide range of backgrounds, skills, expertise, and beyond, we create a stronger, more innovative environment for our employees, clients, and communities. With us, you can always bring your full self to work. Join our inclusive, committed team to be a challenger, own outcomes, and stay curious together. Circana is proud to be Certified™ by Great Place To Work®. This prestigious award is based entirely on what current employees say about their experience working at Circana. Learn more at
What will you be doing?
We are looking for a strategic and technically strong Lead Data Engineer to drive the architecture, development, and optimization of our cloud-based data warehouse and analytics platforms. This role involves leading a team of data engineers, collaborating with stakeholders across the organization, and working with both open-source and proprietary in-house tools to deliver scalable, high-performance data solutions.
Job Responsibilities
- Lead the design and development of complex ETL/ELT pipelines using PySpark, Python, and SQL.
- Architect and manage data warehouse solutions on Cloud platforms (AWS, Azure, GCP), ensuring scalability, reliability, and cost-efficiency.
- Own and drive the adoption and enhancement of in-house data tools, ensuring seamless integration with existing systems.
- Collaborate with data scientists, analysts, and business teams to understand data needs and deliver actionable insights.
- Establish and enforce best practices in data engineering, including coding standards, testing, and documentation.
- Mentor and guide junior and senior engineers, fostering a culture of technical excellence and continuous learning.
- Lead performance tuning, data governance, and automation initiatives across the data platform.
- Participate in strategic planning, roadmap development, and cross-functional leadership discussions.