Senior Product Architect, K8s-Based AI Infrastructure

NVIDIA is the engine of modern Artificial Intelligence, Parallel Compute Infrastructure, and Agentic AI - the biggest technology breakthroughs of our time. We’re on a mission to redefine how data moves, connects, and accelerates workloads at scale, and we’re seeking a visionary Product Architect with strong expertise in systems architecture to join our cause. As a key member of our team, you’ll design and shape the architectures that connect the world’s most powerful AI clusters. As a Product Architect at NVIDIA, you'll be the linchpin in transforming ideas into well-defined, functional products, balancing technical feasibility with user needs and market demands. You'll be responsible for designing and overseeing the development of cutting-edge AI solutions from conception through their entire lifecycle. Working at NVIDIA is all about efficiency and multiplying efforts; being a Product Architect is at the nexus of this ethos!

What you’ll be doing:

• Stay at the forefront of technology trends in AI Infrastructure & Agentic AI, proposing new product concepts

• Define detailed product architectures, including performance, scalability, interoperability, and datacenter deployment requirements

• Lead prototyping and testing processes to validate product design and functionality, with a focus on scale, diagnosing bottlenecks and driving innovations in performance

• Iterate and refine designs based on feedback, testing results, and evolving requirements

• Collaborate with internal hardware, software, security and systems teams to ensure flawless integration of networking, compute and storage ecosystems

• Work closely with partners and customers to conceptualize ideal solutions, build proof-of-concepts (POCs) and minimum viable products (MVPs) that demonstrate your vision

• Provide comprehensive documentation for product designs, including technical specifications and user guides

• Develop targeted content such as whitepapers, blogs, and curriculum for customers, partners, and users

What we need to see:

• 8+ years of experience architecting datacenter-scale HPC or AI infrastructure as a Principal Architect, Solutions Architect, Principal Engineer, or equivalent

• Bachelors degree in computer science or related field (or equivalent experience).

• Strong background in technologies that enable large scale infrastructure management of complex systems, networks, and storage

• Extensive experience with DevOps solutions, including Python, Ansible, Container Runtimes, Kubernetes, and data center deployments

• Familiarity with AI workloads, including agentic & RAG-based workflows, inference at scale, large scale training & fine-tuning, and model evaluation