Senior Software Engineer

Overview

The HPC/AI (High-Performance Computing and Artificial Intelligence) team builds the networking and systems infrastructure that powers Azure's largest AI supercomputing clusters. We develop scalable distributed systems, communication libraries, and network technologies that enable efficient training and deployment of next-generation AI models across thousands of accelerators.

We're seeking Senior Software Engineers to solve challenging problems in backend network architecture, RDMA communication libraries, network transport protocols, and large-scale distributed systems. You'll work on technologies that deliver ultra-low latency, high throughput, and predictable performance for distributed AI workloads, where communication efficiency directly impacts model training and inference performance.

In this role, you'll design and build next-generation networking solutions spanning transport protocols, collective communication frameworks, observability systems, and performance optimization technologies. You'll develop RDMA-based communication libraries and networking software that operate at the scale of modern AI supercomputers, enabling efficient communication across large GPU and accelerator clusters.

You'll collaborate closely with engineers across networking, hardware, silicon, AI frameworks, and datacenter infrastructure to deliver end-to-end solutions. Your work will involve performance analysis, scalability optimization, fault tolerance, telemetry, and the development of innovative networking technologies that advance the state of large-scale distributed AI systems.

Generative AI and distributed computing are driving unprecedented demand for scalable infrastructure. As a Senior Software Engineer on our team, you'll help shape the networking backbone behind Azure's AI supercomputing platform, influencing how future generations of AI systems are built, trained, and deployed at global scale.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

• Design, develop, and optimize networking solutions for large-scale AI training and inference infrastructure, with a focus on performance, scalability, and reliability.
• Lead the design and implementation of network transport protocols, RDMA-based communication libraries, and distributed systems technologies that power AI supercomputing clusters.
• Analyze and optimize end-to-end communication performance, including latency, throughput, congestion management, collective communication efficiency, and workload scalability.