Senior Staff Machine Learning Engineer, GenAI Platform
Reddit is hiring a Senior Staff ML Engineer to lead the vision, architecture, and roadmap of its large-scale GenAI Platform, including the LLM Gateway (unified APIs, rate/token limits, intelligent failover), enterprise RAG, and agentic AI workflows. Core stack includes Kubernetes, AWS/GCP cloud infra, Terraform, Go, and Python, plus MLOps/LLMOps practices.
- Compensation
- $292.5K–$409.5K / yr
- Location
- Remote - United States
- Work setup
- Remote
- Seniority
- Staff
- Employment
- Contract
- Experience
- 10+ years
- Category
- Ml / AI
- Posted
Skills
Must have
- 10+ years of experience in ML Engineering, AI Platform Engineering, or Cloud AI Deployment roles
- Track record of leading technical strategy and delivering AI platforms in cloud-based production environments at scale
- Strong execution turning strategy into action and driving complex initiatives end to end
- Deep experience operating Kubernetes and other orchestration systems in large-scale production environments
- Deep experience with cloud technologies for supporting an ML platform, including AWS, Google Cloud Storage, and Terraform
- Proficiency with common ML programming languages and frameworks such as Go and Python
- Excellent communication skills, able to articulate technical AI concepts to non-technical stakeholders
- Strong focus on scalability, reliability, performance, and developer experience
Nice to have
- Strong knowledge of model serving, inference pipelines, monitoring, and observability for AI systems
Full description
Reddit is a community of communities. It’s built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 130 million daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit .
**Who We Are:
**The Machine Learning Platform team at Reddit is a high-impact team that owns the infrastructure that powers recommendations, content discovery, user and content quantification, while directly impacting other teams such as Growth, Ads, Feeds, and Core Machine Learning teams.
**What You’ll Do:
As a Senior StaffSoftware Engineer,** you will help define and lead the vision for Reddit’s large-scale GenAI Platform, shaping the strategy, architecture, and operating model that enable teams across the company to build, deploy, and scale generative AI products with confidence.
Contribute to the design, implementation, and maintenance of the LLM Gateway, focusing on features like unified API endpoints for internal/externally hosted LLM, rate/token limit management, and intelligent failover mechanisms to boost uptime and reliability.
- Lead and execute the vision, strategy, and roadmap for Reddit’s large-scale GenAI Platform.
- Define the platform architecture and operating model that enable teams to build, deploy, and scale GenAI products reliably.
- Drive the strategy for a unified LAG Gateway supporting internally and externally hosted LLMs through consistent APIs and abstractions.
- Set the direction for core platform capabilities such as rate and token limit management, intelligent failover, and production resilience.
- Shape Reddit’s approach to an enterprise-grade RAG system
- Establish the strategic direction for agentic AI workflows and tool-use patterns across the platform.
- Own the end-to-end platform strategy from concept through production adoption and long-term evolution.
- Drive MLOps and LLMOps standards across CI/CD, testing, versioning, evaluation, and lifecycle management.
- Define best practices for observability, monitoring, governance, and operational excellence across GenAI systems.
- Partner across engineering, product, and leadership to align platform investments with company priorities and user needs.
- Champion platform thinking with a strong focus on scalability, reliability, performance, and developer experience.
- Influence technical direction across teams by turning emerging AI capabilities into a scalable platform strategy.