Senior Data Engineer
Senior Data Engineer at Blackbook.ai, an Australian AI/automation consultancy in Brisbane. You'll consult directly with multiple clients, gathering requirements and designing Azure/Databricks cloud architectures, building data pipelines into data lakes, and creating scalable data warehouse models with BI visualisation.
- Compensation
- A$150K–A$200K / yr
- Location
- Brisbane QLD
- Work setup
- Hybrid
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Bachelor's degree or higher
- Azure or Databricks certification in Data Engineering or Architecture
- Professional presentation and communication skills: written and verbal, formal documentation, diagramming and modelling
- Critical thinking and problem solving skills
- Designing and building relational, star and snowflake models and schemas
- Designing and building Modern Data Warehouse architectures
- Fast, high-quality development in SQL Server or a similar relational database engine such as Oracle or PostgreSQL
- Visualising data effectively using Power BI, Tableau or QlikSense
Nice to have
- Working experience in either Databricks or MS Fabric building data pipelines
- Experience with Snowflake, Synapse or Databricks
- PowerShell, Azure/AWS CLI, or Terraform for managing cloud infrastructure
Full description
Salary: $150,000 – $200,000 per year
Blackbook.ai is one of Australia's most successful and progressive automation companies. Our use of Data and AI to deliver on our client's pursuit of bottom-line benefits has resulted in a company that can claim a 100% success rate in solution delivery. We have an agile approach to tackling problems. We understand that there isn't just one solution to every problem! Our unique approach to problem-solving will see you working directly with our customers, capturing additional requirements and developing intuitive solutions while drawing on the vast knowledge of existing team members.
The Senior Data Engineer role will see you working with multiple clients, projects and stakeholders. You will find yourself working with fellow experts in the DataOps, Digital, and AI teams. You will have skills and working experience in either Databricks or MS Fabric, in building data pipelines.
Your responsibilities as a Data Engineer are as follows:
- Work directly with clients as a Blackbook.ai consultant
- Gather requirements, design, build and test analytics solutions
- Design and build cloud platform architectures to support scalable analytics on Azureand Databricks
- Design and build metadata-driven data ingestion into data lakes and databases
- Design and build data models to support highly scalable and cost-efficient data analysis
- Work with traditional BI and Modern Data Warehouse architectures
- Take ownership of the end-to-end process from requirements gathering to implementation
- Leverage the skill and knowledge of your peers, technical leads and management
- Apply best practices and be self-motivating to keep up with emerging technologies
To be considered for the position you must have a bachelor's degree or higher, and be comfortable demonstrating your skills in the following areas:
- Professional presentation and communication skills: written and verbal, formal documentation, diagramming and modelling
- Critical thinking and problem solving skills
- Azure or Databricks certification in Data Engineering or Architecture
- Designing and building relational, star and snowflake models and schemas
- Designing and building Modern Data Warehouse architectures
- Fast, high-quality development in SQL Server or a similar relational database engine such as Oracle or PostgreSQL
- Visualising data effectively using Power BI, Tableau or QlikSense