Member of Technical Staff - AI Training Platform
A Member of Technical Staff on the AI Training Platform builds and scales the infrastructure used to train, evaluate, and benchmark models — including multi-node distributed training, the proprietary training framework, and CUDA/Triton kernel optimization — to help researchers map neural networks onto the company's novel physics-based compute hardware.
- Compensation
- Not disclosed
- Location
- Mountain View, CA or Greater Seattle Area
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- 5+ years
- Category
- Software engineering
- Posted
Skills
Must have
- BS in Computer Science, Physics, Electrical Engineering, or Applied Math
- 5+ years of experience in AI/ML engineering
- Ability to map state-of-the-art AI model architectures (transformers, Mixture of Experts, diffusion models) to system performance implications
- Deep expertise in model partitioning across a cluster, communication primitives, and parallelism strategies
- Strong programming skills in Python or C++
- Track record implementing, debugging, and maintaining production-grade training frameworks (e.g., Megatron-LM, DeepSpeed, Ray, PyTorch Lightning)
Nice to have
- MS/PhD or equivalent research/project experience in AI/ML or high-performance computing, with publications
- Experience training and post-training large-scale LLMs and generative models
- Experience with Kubernetes, GPU kernels and performance tuning, LLM inference, CUDA, Triton, NCCL, vLLM, SGLang, VeRL, or TRL
Full description
About Unconventional
Since 2022, AI has entered the mainstream, reshaping entire industries from education and software development to fundamental consumer behaviors. This revolution has created an unprecedented demand for computation - a demand that is now fundamentally limited by energy, not just in the datacenter, but at a global scale.
At Unconventional, our mission is to solve this. We are rethinking computing from the ground up to build a new foundation for AI that is 1000x more efficient. We're doing this by exploiting the rich physics of semiconductors, mapping neural networks directly to the device physics rather than relying on layers of inefficient abstraction.
The Role
As a Member of Technical Staff, AI Training Platform, you will be a core contributor to the infrastructure that powers our model training ecosystem. You will build and scale the end-to-end tooling required to train, evaluate, and benchmark models. Your work will directly accelerate researchers' ability to map neural networks to novel hardware and push the boundaries of physics-based compute.
Responsibilities
- Training Infrastructure: Architect, scale, and maintain the core AI/ML/RL training platform and infrastructure. Design and scale multi-node distributed training systems, implementing elastic sharding and robust data streaming pipelines for fast, large-scale iteration. Implement and robust model checkpointing and recovery mechanisms.
- Framework Development: Maintain and expand our proprietary training framework, ensuring it provides a robust and flexible foundation for all internal model training.
- Optimization & Benchmarking: Develop and optimize kernels using low-level programming models like CUDA and Triton. Design rigorous benchmarking suites to track Model Flops Utilization (MFU), memory bandwidth, and convergence stability.
- Hardware Evaluation Tooling: Build and iterate on tooling to enable rapid, high-level evaluation of novel hardware ideas against benchmarks.
- Cross-Functional Collaboration: Act as a translator, discussing algorithmic trade-offs with theorists and converting model requirements into concrete specifications for infrastructure and hardware engineering teams.
- Optimization & ML Hillclimbing: Design systems to track and visualize quality-vs-efficiency Pareto frontiers, enabling researchers to optimize models for both performance and energy consumption.
Minimum Qualifications
- Education: BS in Computer Science, Physics, Electrical Engineering, or Applied Math.
- Experience: 5+ years of experience in AI/ML engineering. Veteran of the modern ML software stack. Demonstrated ability to map state-of-the-art AI model architectures (e.g., transformers, Mixture of Experts, diffusion models) to system performance implication. Deep expertise in how models are partitioned across a cluster, with a mastery of communication primitives, and parallelism strategies.