Senior AI Engineer
- Compensation
- Not disclosed
- Location
- Sydney
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- 3+ years
- Category
- Ai engineering
- Posted
Skills
Must have
- 3+ years of hands-on AI/ML engineering experience, including end-to-end model development and production deployment.
- Demonstrable experience building LLM-powered applications - RAG pipelines, agentic workflows, fine-tuned models, or similar.
- Strong Python engineering skills; experience with ML frameworks (PyTorch, TensorFlow, scikit-learn) and LLM tooling (LangChain, LlamaIndex, or equivalent).
- Experience deploying models and AI services in cloud or enterprise environments (AWS, Azure, GCP, on-prem Kubernetes).
Full description
H2O.ai is on a mission to democratize AI for Good. As the world’s leading agentic AI company, H2O.ai converges Generative and Predictive AI to help enterprises and public sector agencies develop purpose-built Agents, SLMs, and solutions on their private data. With a focus on secure, compliant, and infrastructure-flexible Sovereign AI deployments, H2O.ai delivers solutions that align with the highest standards of data privacy and control.
Its open-source technology is trusted by over 20,000 organizations worldwide, including more than half of the Fortune 500. H2O.ai powers AI transformation for companies like AT&T, Commonwealth Bank of Australia, Wells Fargo, Bank of America, Workday, Progressive Insurance, and NIH.
For more information, visit
About This Opportunity
We are looking for a Senior AI Engineer who builds things that matter. You will design and ship end-to-end AI solutions for some of APAC's most complex enterprise problems - spanning agentic AI systems, LLM applications, and production ML pipelines. This is a hands-on engineering role embedded within a customer-facing field team, meaning your work will be seen, used, and evaluated by real enterprises from day one.
You will work alongside Kaggle Grandmasters, ML engineers, and domain experts to deliver AI that goes beyond demos - into production, into workflows, and into measurable business outcomes.
This position is based in Sydney, Australia.
What You Will Do
Agentic AI & LLM Engineering
- Model distillation and synthetic data generation for fine-tuning an open source model (eg. Gemma). Experience with PEFT-QLORA frameworks
- Design and build agentic AI systems and multi-agent frameworks that automate complex, multi-step workflows for enterprise customers.
- Develop and deploy LLM-powered applications using techniques including RAG, fine-tuning, prompt engineering, function calling, and tool use.
- Implement guardrails, evaluation frameworks, and responsible AI controls to ensure production-grade reliability and safety.
- Stay current with the rapidly evolving agentic AI landscape - MCP, LLM orchestration frameworks, reasoning models - and bring the best of it into customer engagements.
End-to-End AI Application Development
- Own the full development lifecycle: from problem framing and data exploration through model development, API integration, and production deployment.
- Build scalable backend services and APIs that expose AI capabilities to enterprise applications and workflows.
- Integrate AI models into customer environments - cloud, on-prem, and hybrid - ensuring performance, stability, and maintainability at scale.
- Develop ML pipelines and LLMOps infrastructure that support continuous model improvement and monitoring in production.