Backend Data Engineer - Production ML & AWS
Endgame Economics is seeking a mid-level backend data engineer to build and maintain backend services and data pipelines that support their optimization models. The role involves collaborating with senior engineers to productionise models and manage AWS infrastructure.
- Compensation
- Not disclosed
- Location
- Sydney, Australia
- Work setup
- Not specified
- Seniority
- Middle
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Experience designing, building, and maintaining backend services
- Experience with data pipelines
- Experience with AWS infrastructure
- Ability to productionise machine learning models
- Proficiency in writing quality production code
Full description
Endgame is a boutique, technology-led consultancy providing expert mathematical and economic advice to clients across energy, aviation, road and rail, and water. We combine advanced mathematical optimisation and machine learning with deep sectorexpertise. As aGurobiPremier Partner, we build models that sit at the core of how clients make high-stakes decisions.
THE ROLE
You’llbe a mid-level engineerina small team,working alongside senior engineers to build andmaintainbackend services and the data pipelines that feed our models and platforms. This is a genuinely hybrid backend/data role–you’llspend your timeevenlybetween building APIs and services, building pipelines and productionising models.
We’rea small, flat team of consultants and software engineers.There’sno bureaucracy to navigate here; the people who build things are the people who decide how they get built.
WHAT YOU’LL BE DOING
- Design, build andmaintainclean, well-tested backend services and APIs that expose our models and forecasts to clients and internal users
- Take models built by our quantitative team from research code to production systems that run at scale
- Contribute to architecture decisions and code review across the team
- Own your own infrastructure on AWS: write theIaC, build the deployment and CI/CD pipelines, and run long or large solve workloads reliably and cost-effectively
- Build andmaintainthe data pipelines that feed the models
WHAT WE’RE LOOKING FOR
Our target stack is Python, PostgreSQL, extensive use of AWS, Docker, Airflow with a React frontend and Python-based optimisation layer and services.
We’relooking for someone who cares deeply about the craft of software engineering and is motivated to ship high-qualityproductioncode using best practices
- 3-5 years professional software engineering experience
- Strong python knowledge and experience
- StrongSQL and experience designing schemas
- Experience working with data pipelines
- Comfortability withcloud services (AWS preferred)
- Can communicate when A.I. is beneficial and what its limitations are
- Strong communicationskills, including with non-technical stakeholders
Nice to have
- Infrastructure and DevOps exposure: infrastructure-as-code (Terraform, CDK), containers, CI/CD pipelines
- Mathematical optimisation: linear or mixed integer programming, exposure to solvers such asGurobi, CPLEX orHiGHS, or modelling libraries likePyomoorJuMP
- Energy market experience, particularly the NEM, or experience in another regulated, data-rich market
LIFE AT ENDGAME
We know that our people are our greatest asset. That’s why we invest in our team by fostering opportunities for growth, development, and recognition.