Senior Software Engineer - ML Ops
Truveta is hiring a Senior Software Engineer for its Big Data/ML Ops team in Seattle (hybrid) to build cloud-native platform infrastructure, including deploying large-scale ML/LLM models with GPU optimization (vLLM) and building distributed systems and self-service capabilities that support AI development across the company.
- Compensation
- $155K–$190K / yr
- Location
- Seattle, WA
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- 2+ years
- Category
- Devops
- Posted
Skills
Must have
- 5+ years of experience building production quality software in a team setting
- 2+ years of experience working on modern cloud-native platforms and languages (AWS, GCP, Azure)
- B.S. or M.S. in Computer Science or related field
- Experience working with machine learning infrastructure, including scaling GPU resources to optimize model throughput and performance at large scale
- Familiarity with vLLM and GPU optimization techniques to maximize compute utilization and improve inference efficiency
- Familiarity with LLMs and generative models for various applications
- Experience deploying large-scale machine learning models in production environments
- Knowledge and experience in using and designing distributed systems, data pipelines, APIs and consumption experiences
- Some familiarity with crafting modular APIs and building engaging and intuitive web experiences
- Willingness to commit to ongoing training on key topics like privacy, ethics, and security
- Strict adherence to Truveta principles in support of ethical innovation
Nice to have
- Prior experience with Agentic AI platform
Full description
Senior Software Engineer - ML Ops
Truveta is the world’s first health provider led data platform with a vision of Saving Lives with Data. Our mission is to enable researchers to find cures faster, empower every clinician to be an expert, and help families make the most informed decisions about their care. Achieving Truveta’ s ambitious vision requires an incredible team of talented and inspired people with a special combination of health, software and big data experience who share our company values.
This position is based out of our headquarters in the Greater Seattle area. #LI-hybridWho We Need
Truveta is rapidly building a talented and diverse team to tackle complex health and technical challenges. We are seeking candidates inspired by the opportunity to apply data in the development of real-world health solutions. Beyond core capabilities, we are seeking problem solvers, passionate and collaborative teammates, and those willing to roll up their sleeves while making a difference.
If you are interested in the opportunity to pursue purposeful work, join a mission-driven team, and build a rewarding career while having fun, Truveta may be the perfect fit for you.
This Opportunity
If you are seeking a sense of purpose in your software job and are motivated by solving computing problems that can have a direct impact on people’s lives, then we have opportunities for you in an exciting startup environment.
We are looking for a Senior Engineer to participate in note processor. This role requires deep technical expertise in cloud-native infrastructure, distributed systems, as well as strong product thinking. You will partner closely with Compute Platform, security, ML engineering, and applied AI teams to understand business needs, define platform requirements, and build self-service capabilities that help teams move quickly and safely. Success in this role will directly influence how Truveta delivers data at using AI development and tools.
Responsibilities
- Leverage software engineering skills to build and deliver reliable, secure and scalable software solutions using modern cloud-based paradigms across different components in Truveta.
- Collaborate closely with partner teams inside & outside of Truveta.
- Show creativity and curiosity to build integration proof of concepts across the Truveta and partner ecosystems.
- Bring your curiosity, entrepreneurial spirit, and passion to deliver on the promise of technology in the difficult, competitive, and exciting industry of healthcare.
We are seeking software engineers who:
- Have proven experience designing and building reliable, secure, and scalable software solutions using modern cloud-based architectures and engineering practices.