Lead - Data Engineering
- Compensation
- Not disclosed
- Location
- Mumbai, Maharashtra, India
- Work setup
- Not specified
- Seniority
- Lead
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Full description
Who We Are
At Kyndryl, we run and reimagine the mission-critical technology systems that drive advantage for the world’s leading businesses. We are at the heart of progress; with proven expertise and a continuous flow of AI-powered insight, enabling smarter decisions, faster innovation, and a lasting competitive edge. For our people—Kyndryls—that means doing purposeful work that powers human progress. Join us and experience a flexible, supportive environment where your well-being is prioritized and your potential can thrive.
The Role
Your role
As an AI Data Engineer at Kyndryl, you’ll be the architect behind the high-performance data infrastructure that powers our autonomous systems. We aren't just moving tables; we’re building the real-time pipelines that allow agentic AI to reason over the world’s most complex enterprise environments.
Join Kyndryl and gain the trust, autonomy and teamwork to help define what comes next.
What you will do
Orchestrate Intelligence
•Architect for RAG: You’ll design and scale the pipelines for Retrieval-Augmented Generation (RAG), transforming massive volumes of unstructured IT logs and documentation into optimized Vector Embeddings.
•Scale vector infrastructure: You will be responsible for the health and performance of our vector databases (e.g., Pinecone, Milvus, or Weaviate), ensuring sub-second retrieval speeds for agentic reasoning loops.
Master Data Transformation
•Engineer semantic layers: Move beyond simple ETL to build knowledge graphs and semantic layers that provide agents with the necessary context to navigate complex infrastructure puzzles.
•Automate data excellence: Using a keen eye for detail, you’ll build automated data guardrails to detect noise, bias, or PII (Personally Identifiable Information) before it reaches the model, ensuring our AI remains safe and impactful.
Own the Backbone
•Solve meaningful challenges: Serve as the bridge between raw, messy data sources and deep technical AI work, identifying and resolving quality issues at the source.
•Progress to production: With a well-defined methodology and software engineering prowess, you will build, deploy, and maintain the CI/CD pipelines for our data infrastructure, ensuring that our context window remains fresh and reliable.
Who You Are
Required skills and experience
•Expertise in ELK (ElasticSearch, Logstash, Kibana)
•Expertise in Phython
•Expertise in data mining, data storage and Extract-Transform-Load (ETL) processes
•Experience in data pipelines development and tooling
•Experience with both relational and NoSQL databases, PostgreSQL, DB2, MongoDB