Data Engineer
Senior Data Engineer at The Warehouse Group, NZ's largest general merchandise retailer, designing, building and optimising scalable data pipelines and the enterprise data platform. Core stack: Snowflake, dbt, Azure, Airflow, advanced SQL and Python, with mentoring and technical leadership duties. Hybrid work from Auckland.
- Compensation
- Not disclosed
- Location
- Takapuna, Auckland
- Work setup
- Hybrid
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- 5+ years
- Category
- Data engineering
- Posted
Skills
Must have
- 5+ years' experience in Data Engineering, designing and delivering enterprise-scale data solutions
- Strong expertise in modern data architecture, data modelling and cloud-based data platforms
- Advanced SQL development and performance optimisation
- Strong Python development skills
- Extensive experience with Snowflake and modern data warehousing practices
- Expert-level dbt development and data transformation experience
- Strong experience with Azure cloud services and ETL/ELT design and implementation
- Data warehousing and dimensional modelling
- CI/CD and DevOps practices
- Source control using Git/Azure DevOps
- Airflow or similar orchestration tools
Full description
Company Description
The Warehouse Group (TWG) is a Kiwi household name, and we proudly recognise the role that we play in communities throughout New Zealand. We are the largest general merchandise retailer in NZ across The Warehouse, Warehouse Stationery & Noel Leeming. We continue to have our customers top of mind as we work purposefully together, “Helping Kiwis live better every day”. Brand-led and retail-focused, we’re continuing our drive to deliver quality products and unparalleled experience for our customers, in a retail world that is dynamic and ever-changing!
Our Technology footprint is extensive and underpins the successful running of our group operation. From our digital presence to our warehouse and order management systems and everything in between, we’re a place Technologists want to be and we’d like you to be a part of that.
Job Description
Sitting within our Data function and reporting to the Tech Team Lead: Data Engineering, you will play a pivotal role in shaping and evolving our enterprise data platform. As a Senior Data Engineer, you'll be responsible for designing, building and optimising scalable data solutions that enable trusted insights across the business.
You'll bring deep technical expertise and a passion for data engineering, while also acting as a trusted advisor to stakeholders and a mentor to other engineers. Working across a modern cloud-based data ecosystem, you'll help drive engineering best practices, influence technical direction, and ensure our data platforms continue to meet the evolving needs of the business.
Key aspects of your role:
- Design, develop, and maintain scalable data pipelines and ETL processes
- Lead the design and implementation of data architecture, models and integration patterns
- Drive best practices for data engineering, including code quality, testing, documentation and observability
- Optimise data platforms and solutions for performance, scalability, reliability and cost efficiency
- Partner with architects, analysts, data scientists and business stakeholders to translate business requirements into robust technical solutions
- Champion data quality, governance and security across our data ecosystem
- Mentor and support other Data Engineers, fostering continuous improvement and knowledge sharing
- Contribute to strategic planning and the ongoing evolution of TWG's data platform and capabilities
- Troubleshoot complex data issues and provide technical leadership in resolving challenges
- Stay ahead of industry trends and identify opportunities to improve our data engineering practices and tooling
Qualifications
First and foremost, you're passionate about building modern, scalable data solutions that create meaningful business outcomes. You're equally comfortable getting into technical detail as you are engaging with stakeholders to understand business challenges and shape the right solution.