Senior Software Engineer (Serverless)
Nebius is seeking a Senior Software Engineer to build and scale their GPU-native Serverless AI platform. You will design core components like schedulers and runtimes, optimize for low-latency performance, and lead technical architecture for AI infrastructure.
- Compensation
- Not disclosed
- Location
- Amsterdam, Netherlands; London, United Kingdom
- Work setup
- Onsite
- Seniority
- Senior
- Employment
- Contract
- Experience
- 7+ years
- Category
- Software engineering
- Posted
Skills
Must have
- 7+ years of professional software engineering experience
- Track record of shipping production distributed systems at scale
- Excellent knowledge of Golang or readiness to quickly switch to it
- Deep experience with Kubernetes and container orchestration
- Strong distributed-systems instincts
- Experience designing and operating high-throughput, low-latency services
Nice to have
- Experience building serverless or function-as-a-service platforms
- GPU scheduling experience
- ML inference experience
- Cold-start optimization experience
- Experience writing Kubernetes operators
- Contributions to relevant open-source projects
Full description
About Nebius:
Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.
Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.
Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.
**The role
We're looking for a Senior Software Engineer to help us build Nebius Serverless AI — our GPU-native platform for deploying inference endpoints, batch jobs, and AI workloads without managing infrastructure. Customers run production AI on it today; the mission now is to make it the fastest, cheapest, most reliable place to ship GPU workloads on the planet.
This is a senior, high-ownership position on a fast-evolving service. You'll set the technical bar: own the architecture of the parts you ship, drive the hard design decisions, and raise the standard of everything around you through code reviews, design reviews, and the way you operate. The work is end-to-end — from cold-start latency in the runtime to the API contract customers integrate against.
You'll work from our office in Amsterdam or London, hybrid.
In this position, your responsibility will be to:
- Design and build core components of the Serverless platform — the control plane, scheduler, runtime, autoscaler, and the APIs customers integrate against.
- Own the hardest engineering problems on the service: cold-start latency, GPU scheduling under contention, multi-tenant isolation, fair-share quotas, request routing at the edge.
- Set the technical direction for the areas you own — drive architecture decisions, write the design docs, and align the team behind the chosen approach.
- Raise the engineering bar across the team through code reviews, design reviews, and example — the kind of senior presence that compounds.
- Run the service like an SRE: define SLOs, build observability, lead incident response, and make sure every postmortem changes the platform, not just the runbook.
- Work directly with customers on architecture reviews, performance escalations, and the production problems that don't fit a ticket template.
- Partner closely with Product, GTM, and infrastructure teams to translate customer needs into a coherent technical roadmap.