Staff ML Engineer
The Staff ML Engineer will architect and scale the Gaia Emblem engine, focusing on LLM integration, RAG pipelines, and GPU-aware infrastructure. This role involves leading technical strategy, mentoring engineers, and building high-throughput distributed systems for AI-powered data security.
- Compensation
- Not disclosed
- Location
- Pune - Panchshil - India (Office)
- Work setup
- Not specified
- Seniority
- Staff
- Employment
- Full time
- Experience
- 3+ years
- Category
- Ml / AI
- Posted
Skills
Must have
- 10+ years of professional software engineering experience
- 8+ years building distributed, production-grade backend systems
- 3+ years of hands-on experience with LLM-based systems, RAG architectures, or applied ML infrastructure
- Experience operating services on Kubernetes at production scale, including GPU-backed workloads
- Track record of technical leadership and mentoring at Staff/Senior level
- Bachelor’s degree in Computer Science, Engineering, or a related technical field
Nice to have
- Master’s degree or PhD in Computer Science, Machine Learning, or a related field
- Experience with Node.js and back-end web development
- Experience with Jenkins and other CI/CD tooling
- Experience with formal verification or correctness-focused engineering practices
- Prior experience in enterprise data protection, storage, or infrastructure software
Full description
Cohesity is the leader in AI-powered data security. Over 13,600 enterprise customers, including over 85 of the Fortune 100 and nearly 70% of the Global 500, rely on Cohesity to strengthen their resilience while providing Gen AI insights into their vast amounts of data. Formed from the combination of Cohesity with Veritas’ enterprise data protection business, the company’s solutions secure and protect data on-premises, in the cloud, and at the edge. Backed by NVIDIA, IBM, HPE, Cisco, AWS, Google Cloud, and others, Cohesity is headquartered in Santa Clara, CA, with offices around the globe.
We’ve been named a Leader by multiple analyst firms and have been globally recognized for Innovation, Product Strength, and Simplicity in Design , and our culture.
Want to join the leader in AI-powered data security?
Staff ML Engineer
Level: Staff Software Engineer (Level 5)
Team: Gaia Emblem Engine
Location: India | Type: Full-Time
About the Role
Cohesity is looking for a Staff ML Engineer (Level 5) to help design and scale the Gaia Emblem engine, the intelligence layer powering our next-generation data platform. In this role, you will architect and build large-scale, production-grade ML/LLM systems — spanning model serving, retrieval-augmented generation (RAG), GPU infrastructure, and distributed backend services. As a Staff-level engineer, you will set technical direction, mentor senior engineers, and partner closely with Product and Data Engineering to bring Gaia Emblem’s roadmap to life.
Key Responsibilities
- Architect and drive the technical roadmap for the Gaia Emblem engine, including LLM integration, RAG pipelines, and prompt-engineering frameworks.
- Design and operate scalable, GPU-aware infrastructure on Kubernetes (vanilla K8s, OpenShift, EKS, GKE, or equivalent), including GPU scheduling, autoscaling, and costefficient resource utilization.
- Build resilient, high-throughput distributed systems and microservices exposed via gRPC and REST APIs.
- Own data engineering pipelines feeding ML workflows, including ingestion, transformation, and storage across SQL, NoSQL, and search systems (PostgreSQL, Redis, Elasticsearch).
- Define and enforce engineering best practices: CI/CD, test automation, observability, and infrastructure-as-code (Terraform, Helm).
- Lead design reviews, set coding and architectural standards, and mentor engineers across the organization.
- Partner with Product, Applied ML, and SRE teams to translate business requirements into scalable technical solutions.
- Drive root-cause debugging and performance optimization across distributed, GPUbacked services.