Software Engineer, Infrastructure Services (Cloud Network Fault Tolerance)
Software engineer building fault-tolerant systems for Apple's hyper-scale cloud network — designing sensing, decision-making, and automated remediation layers that detect and fix network anomalies in real time using distributed systems, control theory, and graph algorithms.
- Compensation
- Not disclosed
- Location
- San Francisco Bay Area
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- 6+ years
- Category
- Software engineering
- Posted
Skills
Must have
- Bachelor's degree in CS, CE, EE, or equivalent practical experience
- 4-6+ years of professional SWE experience in distributed systems/backend infrastructure
- Deep foundation in distributed systems architecture, concurrency models, graph algorithms, systems design
- Strong proficiency in at least one of Go, C++, Rust, or Python
- Direct experience building fault-tolerant mechanisms: self-healing, circuit breaking, load shedding, blast-radius mitigation
- Ability to model complex failure domains, handle network partitions and split-brain scenarios
- Practical experience with chaos engineering, fault injection, simulation-based testing, stress testing
- Track record of technical ownership: design docs, code reviews, post-mortem RCAs
Nice to have
- Master's or Ph.D. in CS, Distributed Systems, Networking, or related discipline
- Deep domain knowledge in cloud networking, SDN control planes, L3/L4 routing, overlay networks, Linux networking (eBPF, XDP, OVS)
- Experience implementing distributed consensus algorithms (Raft, Paxos) and closed-loop control/reconciliation systems
- Experience architecting high-throughput telemetry pipelines and automated anomaly detection systems
- Ability to digest academic papers and translate resilience concepts into production systems
- Open-source contributions, technical publications, or patents in distributed networking and systems reliability
Full description
Do you want to help build some of the largest and most consequential enterprise and customer technology systems in the world? Join Apple’s Information Systems and Technology (IS&T) organization.
IS&T is the engine behind everything Apple does for customers and for the people who build for them. It’s Apple’s central nervous system. Supporting 2.5 billion active Apple devices, processing billions of secure transactions, and keeping the technology that defines modern life running flawlessly, IS&T makes the impossible feel effortless.”
Do you love building solutions to handle global complexity and immense scale? Imagine what you could do here.
Infrastructure Services is part of IS&T and the foundation of Apple's global network operations — managing data center equipment and systems to deliver compute, storage, and networking services for teams across Apple, including its internal developer community. From individual facilities to a worldwide network, Infrastructure Services ensures the technology underneath everything works without question.
This is not a traditional network engineering role. This is a software engineering role for builders who love deep technical challenges, have strong fundamentals in distributed systems and fault-tolerant design, and want to turn cutting-edge ideas into production systems running at massive scale. We welcome early-career engineers with exceptional technical depth, if you have the intellectual horsepower and hunger to solve problems that don't have textbook answers yet, we want to talk to you.
You will join a team chartered to make Apple's hyper-scale cloud network dramatically more fault-tolerant by building systems that detect and remediate failures automatically, with minimal or no human intervention. This means designing and building the sensing, decision-making, and remediation layers that allow the network to identify anomalies, localize root cause, and take corrective action in real time.
You'll work on problems like: how do you detect a degrading network path before it causes an outage? How do you safely automate remediation actions on live production infrastructure without introducing new risk? How do you build a system that learns from past incidents to prevent recurrence? These are open, hard problems, and you will be expected to bring rigorous thinking, creativity, and strong engineering execution to solve them.
This role is ideal for someone who loves taking a deep, formal understanding of distributed systems, control theory, graph algorithms, or fault-tolerant design patterns and turning it into resilient, real-world software running in production at enormous scale. You should be comfortable reading research papers and translating relevant ideas into working systems, while also being pragmatic about the constraints of operating in a live, hyper-scale environment.