Senior Data Engineer – Databricks / AWS
Otic Group, an Australian technology consultancy, seeks a Melbourne-based Senior Data Engineer to design, build and deploy enterprise data platforms and pipelines on AWS using Databricks, Python/PySpark, Spark, dbt, Terraform and CI/CD. Applicants must hold Australian citizenship, PR, or other permanent work rights.
- Compensation
- Not disclosed
- Location
- Melbourne, Australia
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Full time
- Experience
- 7+ years
- Category
- Data engineering
- Posted
Skills
Must have
- Strong commercial experience with Databricks, including scalable data architectures and pipelines
- Advanced Python and PySpark development skills
- Strong AWS cloud experience supporting data engineering solutions
- Experience building and maintaining ETL/data pipelines using Apache Spark and dbt
- Strong Terraform / Infrastructure as Code experience, ideally managing Databricks environments
- Experience implementing automated CI/CD pipelines, preferably GitHub Actions or similar
- Strong understanding of modern data lake, data warehouse and cloud data architecture patterns
- Experience processing and transforming large-scale datasets
- Strong software engineering practices: Git, testing, deployment automation, code quality
- Ability to translate business and technical requirements into practical, scalable data solutions
- Strong stakeholder communication and ability to operate independently in complex enterprise environments
- Based locally in Melbourne
- Australian Citizenship, Permanent Residency (PR), or other permanent work rights
Nice to have
- 7+ years of data engineering experience with recent hands-on delivery in large enterprise environments
- Passion and flair for creating professional prototypes and dashboards
Full description
“Otic” means smart people doing smart work, together.
We are a wholly owned Australian company committed to helping our clients design and build intelligent software solutions that unlock value in their business.
Otic Group was formed to provide talented technology professionals an opportunity to work with not only some of the most prominent companies in Australia, but work with incredibly talented peers in an exciting, dynamic young environment.
We are seeking a Senior Data Engineer with strong hands‑on experience designing, building and deploying enterprise data platforms and pipelines within cloud environments.
Key Skills And Experience Required
- Strong commercial experience with Databricks, including development of scalable data architectures and data pipelines.
- Advanced Python and PySpark development skills.
- Strong AWS cloud experience supporting data engineering solutions.
- Experience building and maintaining ETL/data pipelines using technologies such as Apache Spark and dbt.
- Strong Terraform / Infrastructure as Code experience, ideally provisioning and managing Databricks environments.
- Experience implementing automated CI/CD pipelines, preferably using GitHub Actions or similar tooling.
- Strong understanding of modern data lake, data warehouse and cloud data architecture patterns.
- Experience processing and transforming large-scale datasets.
- Strong software engineering practices including Git, testing, deployment automation and code quality.
- Ability to translate business and technical requirements into practical, scalable data solutions.
- Strong stakeholder communication skills and the ability to operate independently in a complex enterprise environment.
- Ideally 7+ years of data engineering experience with recent hands‑on delivery in large enterprise environments.
Over and above having these technical skills, you will also have a strong passion and flair for creating professional prototypes and dashboards.
Being a Melbourne based organisation, we’re looking for our team to be based locally. We also require applicants to hold an Australian Citizenship, Permanent Residency (PR), or have other permanent work rights.