Director, Data Engineering
- Compensation
- Not disclosed
- Location
- Bengaluru
- Work setup
- Onsite
- Seniority
- Not specified
- Employment
- Full time
- Experience
- 13+ years
- Category
- Data engineering
- Posted
Skills
Must have
- 10+ years of relevant work experience with a Bachelors Degree or at least 7 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 4 years of work experience with a PhD, OR 13
Nice to have
- 12 or more years of work experience with a Bachelors Degree or 8-10 years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 6+ years of work experience with a PhD
- 10+ years of relevant work experience and a Bachelor''s degree, OR 13+ years of relevant work experience.
- Experience in leading large-scale data engineering teams and projects in a complex enterprise environment.
- Experience in data architecture, ETL/ELT pipelines, data warehousing, and real-time data processing.
- Experience with cloud platforms (e.g., AWS, GCP, Azure) and big data technologies (e.g., Spark, Kafka, Hadoop).
- Experience in data modeling, data governance, and data quality frameworks.
- Experience delivering high-impact data solutions that drive business outcomes.
- Experience working with Data and AI, designing, and building ML infrastructure to train or serve models.
- Experience with open-source data engineering tools or communities.
- Experience in financial services, payments, or a highly regulated industry.
- Experience in mentoring and developing talent within engineering teams.
- 12 or more years of work experience with a Bachelors Degree or 8-10 years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 6+ years of work experience with a PhD.
- Masters, PhD in Computer Science or related technical discipline.
- Experience in working on large open-source projects, preferably in the ML infrastructure domain like TensorFlow, Ray, JAX, PyTorch, Horovod.
Full description
About Us
Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid.
At Visa, you''ll have the opportunity to create impact at scale tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world.
Join Visa and do work that matters to you, to your community, and to the world. Progress starts with you.
Job Description
The Director, Data Engineering leads the design, development, and deployment of scalable and secure data pipelines, platforms, and ML/AI infrastructure, leveraging cloud-native technologies and big data frameworks. This role oversees the integration of structured and unstructured data sources to support advanced analytics, machine learning, and AI initiatives, and champions new tools and technologies to improve productivity, scalability, and effectiveness of data engineering efforts. The Director establishes and enforces data engineering best practices, technical standards, governance, and quality standards, ensuring continuous improvement and technical excellence, while ensuring data security, privacy, compliance, system performance, scalability, and availability across all data engineering projects and platforms.
All roles require digital fluency, including the ability to work with emerging technologies such as Generative AI tools (e.g. ChatGPT, Microsoft Copilot) to support everyday work.
Key Responsibilities:
- Lead the design, development, and deployment of scalable and secure data pipelines, platforms, and ML/AI infrastructure.
- Oversee integration of structured and unstructured data sources to support advanced analytics, machine learning, and AI initiatives.
- Evaluate, implement, and champion new tools and technologies to improve productivity, scalability, and effectiveness of data engineering efforts.
- Establish and enforce data engineering best practices, technical standards, governance, and quality standards.
- Ensure data security, privacy, compliance, system performance, scalability, and availability across all data engineering projects and platforms.
- Define, monitor, and report on key performance indicators (KPIs) to measure the success and impact of data engineering activities.
- Lead incident response, root cause analysis, and resolution for data platform issues, ensuring high availability and reliability.
- Collaborate with cross-functional teams to deliver robust data-driven business solutions and define technical roadmaps.
- Mentor, coach, and grow a high-performing team of data engineers, fostering a culture of innovation, excellence, and continuous learning.