Senior Data Engineer - PySpark & Cloud ETL for SaaS
Senior data engineer building and maintaining scalable PySpark ETL/ELT pipelines across Azure and AWS for a SaaS platform. Day to day: developing in-house PySpark frameworks, embedding data services into the product architecture, and ensuring data quality, security, and observability. Remote-first, based in Sydney with some travel to client sites across Australia.
- Compensation
- Not disclosed
- Location
- Sydney, Australia
- Work setup
- Remote
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- PySpark expertise
- Senior-level data engineering experience
- Experience with Azure and AWS cloud platforms
- Experience designing and maintaining scalable data pipelines
- Experience implementing ETL/ELT pipelines
- Ability to build in-house PySpark frameworks
Nice to have
- Focus on data quality, security, and observability
Full description
Halo Labs is seeking a Data Engineer with PySpark expertise to design and maintain scalable data pipelines across Azure and AWS in our SaaS platform. You will build in-house PySpark frameworks, implement ETL/ELT pipelines, and collaborate with software engineers to embed data services into the product architecture, while ensuring data quality, security, and observability.
We offer a remote-first work environment with opportunity for travel to client locations across Australia, a learning budget,