Software Engineer - Kernels
Designs and optimizes compute kernels that interface directly with MatX's custom hardware for training and running the largest ML/AGI workloads, working alongside ML research and hardware teams. Stack centers on Rust plus low-level optimization (C/C++, assembly, SIMD, GPU/CUDA); hybrid role, 3 days/week in Mountain View.
- Compensation
- $160K–$600K / yr
- Location
- Mountain View (HQ) or Remote
- Work setup
- Hybrid
- Seniority
- Not specified
- Employment
- Full time
- Experience
- 10+ years
- Category
- Software engineering
- Posted
Skills
Must have
- Bachelor of Computer Science or equivalent degree
- 10+ years of software development experience
- Experience optimizing software for specialized hardware (parallelism, SIMD, C, assembly-level optimization, GPU/CUDA programming)
- Proficiency in at least one of: assembly, C++, C, Zig, or Rust
- Work from Mountain View, CA office 3 days a week (Tuesday-Thursday)
Nice to have
- Experience implementing kernels for ML models such as Transformers
- Experience with distributed parallelism techniques (AllReduce, AllToAll, data parallelism, tensor parallelism)
- Familiarity with how compilers work
Full description
What MatX Is Building
MatX is on a mission to be the compute platform for AGI. We are developing vertically integrated full-stack solutions from silicon to systems including hardware and software to train and run the largest ML workloads for AGI. We primarily use the Rust programming language.
What You'll Do Here
- Design and optimize kernels that interface directly with our hardware
- Work in partnership with our ML Research and Hardware Engineering teams
- Provide expertise and guidance on hardware architecture from a programmer's perspective, ensuring seamless integration with the software stack
Who You Are
- Bachelor of Computer Science or equivalent degree
- 10+ years of software development experience
- Experience optimizing software for specialized hardware, employing techniques such as parallelism, SIMD programming, C, assembly-level optimization, or GPU/CUDA programming
- Language: at least one of assembly, C++, C, Zig, or Rust
- This is a hybrid role that will require you to work from our Mountain View, CA office 3 days a week on Tuesday through Thursday
Bonus Points If You Have
- Experience implementing kernels for ML models such as Transformers
- Experience using and implementing distributed parallelism techniques such as AllReduce, AllToAll, data parallelism, tensor parallelism.
- Familiarity with how compilers work
Compensation
The US base salary for this full-time position is determined based on a variety of factors including role, experience, location, job-related skills, and relevant education and training. Career length is only a guideline for compensation.
- Early Career - $160,000 - $275,000 + equity
- Mid Career - $175,000 - $400,000 + equity
- Senior Career - $250,000 - $600,000 + equity
What We Offer
- Time off: 4 weeks PTO (accrued) + 12 company Holidays + up to 3 weeks remote work
- Health: Company-subsidized Medical (Kaiser or Anthem) for employees & dependents, Guardian Dental and Vision insurances for employee & dependents, and life insurance (employee only), plus HSA and FSA offerings via Lively.
- Financial Security: Choose from Roth or pre-tax 401K (or both) with a 5% company contribution (even if you don't contribute), 100% company-paid life insurance (up to $300K), long-term disability and travel insurance.
- Professional Development: $1500 per year Professional Development Budget