Forward Deployed Engineer – AI Inference (Intern)
Internship owning the technical side of AI inference deals: matching customers to the right LLMs, GPUs and configurations for dedicated inference, running technical customer sessions, and translating needs into specs for engineering. Key tech: LLM inference, GPUs, and engines like vLLM, SGLang and TensorRT-LLM.
- Compensation
- Not disclosed
- Location
- Berlin
- Work setup
- Onsite
- Seniority
- Intern
- Employment
- Internship
- Experience
- Not specified
- Category
- Solutions engineering
- Posted
Skills
Must have
- Studies in computer science, data science or a closely related field
- Interest in or first exposure to AI inference: LLMs, inference engines, GPUs
- Real excitement about working with customers and the commercial side
- Strong communication skills with customers and engineers alike
- Entrepreneurial mindset: find a way without getting blocked
- Stay calm and constructive when ideas are challenged
- Fluent English
Nice to have
- Coursework or projects on inference engines or ML systems (e.g. vLLM, SGLang, TensorRT-LLM)
- Experience with GPU sizing, model serving, benchmarking or performance optimization
- Previous internship at an AI infrastructure or inference company
- Startup experience
- German language skills
Full description
The Role
As a Forward Deployed Engineer Intern, you own the technical side of our AI inference deals. You help customers figure out which models, GPUs and configurations fit their needs, run technical sessions with them, and work hand in hand with our commercial team to get deals closed.
This is not a pure engineering role: you'll spend a lot of time with customers, and we're looking for someone who enjoys exactly that. Much of this work is still manual today – you'll help us turn it into product.
What You'll Do
- Match customer requirements to the right models, GPUs and configurations for dedicated inference
- Run technical sessions with customers and help them make confident decisions
- Work in tandem with our commercial team to move deals forward
- Support serverless and API customizations, and help turn recurring ones into product
- Translate customer needs into clear technical specs for our engineering team
- Collect benchmarks and learnings that help us automate matching and customizations
##
What We're Looking For
- Studies in computer science, data science or a closely related field
- Interest in or first exposure to AI inference: LLMs, inference engines, GPUs
- Real excitement about working with customers and the commercial side – not just the technical one
- Strong communication skills: you talk confidently to customers and engineers alike
- An entrepreneurial mindset: give you an outcome, and you find a way without getting blocked
- You stay calm and constructive when your ideas are challenged
- Fluent English
##
Bonus Points
- Coursework or projects on inference engines or ML systems (e.g. vLLM, SGLang, TensorRT-LLM)
- Experience with GPU sizing, model serving, benchmarking or performance optimization
- A previous internship at an AI infrastructure or inference company
- Startup experience
- German
Why us?
- Outstanding team: Work with some of the best engineers in the world, coming from hedge funds, big tech, AI startups and top universities
- Once in a lifetime opportunity: Early-stage company in the fastest-growing market in the world
- Ownership: Shape how European AI companies access GPU compute
- European mission: Build sovereign, GDPR-compliant AI infrastructure for the next generation of deep-tech