Lead Data Engineer: Cloud Analytics & AI Platform

iSelect and Compare the Market are trusted, well-known brands dedicated to helping millions of Australians compare and buy personal finance and household products such as insurance, energy, and loans. Together, we provide a seamless, customer-focused experience that makes it easier for Australians to find the right products to suit their needs.

What You’ll Be Doing

Reporting to the Data Engineering Manager, the Lead Data Engineer provides technical leadership for CTM’s Data and Analytics platforms, engineering practices, and technology capabilities. The role is responsible for shaping the enterprise data technology stack, establishing engineering standards, and delivering scalable, secure, and high-performing data solutions that support reporting, analytics, AI, and business innovation.

As the organisation’s technical SME for data engineering, the Lead Data Engineer drives the design, governance, and optimisation of cloud-based data warehouse, lakehouse, and AI-enabled platforms. Working closely with engineers, analysts, architects, and business stakeholders, the role champions modern engineering practices, platform automation, DataOps, MLOps, and AI engineering capabilities to ensure the data ecosystem remains robust, future-ready, and aligned to strategic objectives.

The role oversees the technical health, security, performance, scalability, and continuous improvement of the data platform landscape while fostering a culture of engineering excellence, innovation, and knowledge sharing. It also provides technical mentorship and governance across the Data and Analytics team, guiding solution design, architecture standards, and development practices to ensure the consistent delivery of high-quality data products and services.

• Provide technical leadership and architectural oversight across the Data & Analytics function, ensuring solutions align with enterprise architecture, security, scalability, and business objectives.
• Own and optimise the analytics ecosystem, including cloud data platforms, lakehouse environments, data integration, governance, and AI readiness.
• Lead the design and delivery of scalable data products, advanced analytics, and GenAI-enabled solutions that support self-service insights and future AI capabilities.
• Drive engineering excellence through standards, frameworks, DataOps, SecOps, CI/CD, Infrastructure as Code, automated testing, observability, and automation.
• Ensure platform reliability, security, governance, and compliance through robust controls for data quality, lineage, metadata, access management, monitoring, and privacy.
• Mentor engineers and business users while partnering with stakeholders to drive innovation, platform optimisation, emerging technology adoption, and data and AI maturity.

What’s In It For You

At Compare the Market and iSelect, we’re all about helping people make smart choices – and joining us might just be yours.We offer an environment where your ideas are heard, your contributions are valued, and your growth genuinely matters. Collaboration is part of our DNA and you’ll be joining a supportive, forward-thinking team where you can do meaningful work (and be recognised for it!)