mirantis
Principal Software Engineer
Senior technical lead for Mirantis' Enterprise AI platform: owns the architecture of the AI gateway, LLM model serving on Kubernetes, identity, metering and observability, and sets the technical bar for a small remote-first senior team building largely in Go and Python.
- Compensation
- Not disclosed
- Location
- Austin, TX, us
- Work setup
- Remote
- Seniority
- Principal
- Employment
- Not specified
- Experience
- 10+ years
- Category
- Software engineering
- Posted
Skills
Must have
- 10+ years in infrastructure or distributed systems, including several as technical lead
- Shipped multi-service systems that enterprises run in production, including self-installed software
- Expert Kubernetes: operators, CRDs, scheduling, Helm, debugging at scale
- Production experience with GPU workloads, LLM inference or AI gateways
- Expert Go, strong Python, solid CI/CD and infrastructure as code
- Leads through writing and influence, uses AI-assisted development tools fluently, thrives with autonomy on a distributed team
Nice to have
- Inference performance work: quantization, batching, KV-cache management, disaggregated prefill and decode
- AI gateway or LLM routing: failover, rate limiting, token metering, policy enforcement
- Took a new product to its first enterprise customers
Full description
As Principal Software Engineer, you are the senior technical voice for Enterprise AI. You own its architecture together with the teams that share the platform, and set the technical bar for a small, senior, remote-first team.
- Own the architecture across the AI gateway, control plane, model serving, identity, metering and observability, for hosted and installed editions.
- Lead the gateway strategy, including the data plane choice and policy-based routing with per-request metering and audit records.
- Set direction for LLM serving on Kubernetes: GPU scheduling and sharing, autoscaling, multi-tenant and disaggregated serving, and cost per token.
- Define how enterprises run the product: Helm installs and upgrades, air-gapped networks, preflight checks and supply-chain security.
- Run design reviews, make build vs. buy calls, and record decisions as ADRs.
- Build hands-on in the critical path, and mentor senior engineers, including on AI-assisted development.
- Work with design partners and customers, and represent Mirantis in the Kubernetes and ML-infrastructure communities.
- 10+ years in infrastructure or distributed systems, including several as technical lead.
- Shipped multi-service systems that enterprises run in production, including software they install themselves.
- Expert Kubernetes: operators, CRDs, scheduling, Helm, and debugging at scale.
- Production experience with GPU workloads, LLM inference or AI gateways
- Expert Go, strong Python, and solid CI/CD and infrastructure as code.
- Leads through writing and influence, uses AI-assisted development tools fluently, and thrives with autonomy on a distributed team.
Nice to have
- Inference performance work: quantization, batching, KV-cache management, disaggregated prefill and decode.
- AI gateway or LLM routing: failover, rate limiting, token metering, policy enforcement.
- Took a new product to its first enterprise customers.
Why you’ll love Mirantis
- Work with an established leader in the cloud infrastructure industry.
- Work with exceptionally passionate, talented and engaging colleagues, helping Fortune 500 and Global 2000 customers implement next-generation cloud technologies.
- Be a part of cutting-edge, open-source innovation.
- Thrive in the high-energy environment of a young company where openness, collaboration, risk-taking, and continuous growth are valued.
- Receive a competitive compensation package with strong benefits plan.