Staff Software Engineer - Infrastructure Storage
Lead storage software architecture for Lambda's AI cloud infrastructure, designing and scaling petabyte-scale distributed storage systems across file, block, and object protocols. Day-to-day involves technical leadership, mentoring senior engineers, and collaborating cross-functionally to optimize storage for AI/ML workloads. Core technologies include C/C++/Go/Rust, NFS/NVMe-oF/S3, RDMA, and high-
- Compensation
- $349K–$465K / yr
- Location
- San Francisco Office (Fremont St)
- Work setup
- Hybrid
- Seniority
- Staff
- Employment
- Not specified
- Experience
- 5+ years
- Category
- Software engineering
- Posted
Skills
Nice to have
- Experience with NVIDIA BlueField DPUs or SuperNICs for accelerated storage data paths, including GPUDirect Storage implementation.
- Deep production experience with enterprise or HPC storage platforms: Vast Data, Weka, NetApp, or Lustre.
- Experience deploying and operating Ceph like service at scale (100PB+) in an HPC or AI infrastructure environment.
- Familiarity with emerging storage technologies such as CXL memory pooling, computational storage, or ZNS (Zoned Namespace) SSDs.
- Experience contributing to or maintaining open-source storage projects (e.g., Ceph, DAOS, Lustre, MinIO).
Full description
Lambda, The Superintelligence Cloud, is a leader in AI cloud infrastructure serving tens of thousands of customers. Our customers range from AI researchers to enterprises and hyperscalers. Lambda's mission is to make compute as ubiquitous as electricity and give everyone the power of superintelligence. One person, one GPU.
If you'd like to build the world's best AI cloud, join us.
*Note: This position requires presence in our San Francisco/Bellevue office location 4 days per week; Lambda’s designated work from home day is currently Tuesday.
In the world of distributed AI, raw GPU and CPU horsepower is just a part of the story. High-performance networking and storage are the critical components that enable and unite these systems, making groundbreaking AI training and inference possible.
The Lambda Infrastructure Engineering organization forges the foundation of high-performance AI clusters by welding together the latest in AI storage, networking, GPU and CPU hardware.
Our expertise lies at the intersection of:
- High-Performance Distributed Storage Solutions and Protocols: We engineer the protocols and systems that serve massive datasets at the speeds demanded by modern clustered GPUs.
- Dynamic Networking: We design advanced networks that provide multi-tenant security and intelligent routing without compromising performance, using the latest in AI networking hardware.
- Compute Virtualization: We enable cutting-edge virtualization and clustering that allows AI researchers and engineers to focus on AI workloads, not AI infrastructure, unleashing the full compute bandwidth of clustered GPUs.
About the Role:
We are seeking a seasoned Staff Storage Software Engineer with deep experience designing and deploying storage protocol solutions at scale across object, block, and file paradigms.
This is a unique opportunity to work at the intersection of large-scale distributed systems and the rapidly evolving field of artificial intelligence infrastructure. This is an opportunity to have a significant impact on the future of AI. You will be building the foundational infrastructure that powers some of the most advanced AI research and products in the world.
What You’ll Do
- Technical Leadership: Set technical direction for storage software architecture across petabyte-scale deployments, authoring and reviewing design docs, mentoring senior engineers, and serving as the technical anchor for cross-functional initiatives spanning storage, networking, compute, and control plane teams. Represent the storage software team in architectural reviews, roadmap planning, and customer-facing technical discussions.