Lead Software Engineer, Kernels
MatX is hiring a hands-on tech lead to manage and grow a kernel engineering team while personally designing high-performance compute kernels for its custom AI hardware. Day to day blends people leadership with low-level optimization work (C/C++, assembly, SIMD, GPU/CUDA) in close partnership with ML research and hardware teams.
- Compensation
- $160K–$600K / yr
- Location
- Mountain View
- Work setup
- Hybrid
- Seniority
- Lead
- Employment
- Full time
- Experience
- 2+ years
- Category
- Software engineering
- Posted
Skills
Must have
- 2+ years of engineering team management experience
- 7+ years working directly within engineering teams
- Bachelor of Computer Science or equivalent degree
- Experience optimizing software for specialized hardware (parallelism, SIMD, C, assembly-level optimization, GPU/CUDA programming)
- Proficiency in at least one of: assembly, C++, C, Zig, or Rust
- Ability to navigate ambiguity, manage escalations, and align stakeholders around infrastructure decisions
- Excellent communication and collaboration skills, translating complex technical trade-offs with founders and stakeholders
Nice to have
- Experience implementing kernels for ML models such as Transformers
- Experience with distributed parallelism techniques such as AllReduce, AllToAll, data parallelism, tensor parallelism
- Familiarity with how compilers work
Full description
What MatX Is Building
MatX is on a mission to be the compute platform for AGI. We are developing vertically integrated full-stack solutions from silicon to systems including hardware and software to train and run the largest ML workloads for AGI.
We are seeking a hands-on engineering TLM to lead the Kernel team. You will manage, mentor, and grow a team of kernel engineers while setting technical direction and executing. At the same time, you will be an active coding contributor by designing and implementing high-performance compute kernels for specialized AI hardware.
You will partner with the ML team to maximize output and improve diagnostic tools, and collaborate with hardware to co-design next-generation AI architectures.
What You'll Do Here
- Manage, mentor, and build a team of highly specialized kernel engineers and software developers
- Design and optimize kernels that interface directly with our hardware
- Work in partnership with our ML Research and Hardware Engineering teams
- Provide expertise and guidance on hardware architecture from a programmer's perspective, ensuring seamless integration with the software stack
Who You Are
- 2+ years of engineering team management experience
- 7+ years of working directly within engineering teams experience
- Bachelor of Computer Science or equivalent degree
- Experience optimizing software for specialized hardware, employing techniques such as parallelism, SIMD programming, C, assembly-level optimization, or GPU/CUDA programming
- Language: at least one of assembly, C++, C, Zig, or Rust
- Ability to navigate ambiguity, manage escalations, and align stakeholders around infrastructure decisions.
- Excellent communication and collaboration skills, with a track record of translating complex technical trade-offs with the founders and stakeholders
Bonus Points If You Have
- Experience implementing kernels for ML models such as Transformers
- Experience using and implementing distributed parallelism techniques such as AllReduce, AllToAll, data parallelism, tensor parallelism.
- Familiarity with how compilers work
Compensation
The US base salary for this full-time position is determined based on a variety of factors including role, experience, location, job-related skills, and relevant education and training. Career length is only a guideline for compensation.
- Early Career - $160,000 - $275,000 + equity
- Mid Career - $175,000 - $400,000 + equity