Tech Aalto Pte ltd
Sr Data Engineer
Senior Data Engineer in Sydney building and maintaining dbt transformation models and complex Snowflake SQL, developing Airflow DAGs on AWS ECS, and Lambda/Python ingestion pipelines across AWS services (S3, Glue, Lake Formation, EventBridge), with YAML data quality tests and GitHub Actions CI/CD.
- Compensation
- Not disclosed
- Location
- Sydney, Australia
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Strong SQL
- Proficiency with dbt Core
- Apache Airflow experience
- AWS working knowledge of S3, Lambda, MWAA, ECS, Glue Catalogs, Lake Formation, SQS, EventBridge
- Experience with fixed-format or structured financial data files
- CI/CD with GitHub Actions
Nice to have
- Apache Iceberg Table format
Full description
Sr Data Engineer
Responsibilities
- Building and maintaining dbt transformation models across multiple pipeline layers — from raw ingestion through to governed, consumer-ready datasets
- Writing Snowflake SQL for complex transformations: type casting, deduplication, incremental load logic, surrogate key generation
- Developing and debugging Apache Airflow DAGs on AWS ECS
- Contributing to AWS Lambda-based ingestion( Python) — file validation, control file generation, S3 event handling
- Maintaining source-to-target mapping documentation and aligning models to business requirements anddataspecs
- Supporting onboarding of downstream consumers viadatasharing mechanisms and event-driven notifications
- Participating in code reviews, writing YAML-baseddataquality tests, and owning tickets from design through to production
Tech stack required
- Strong SQL
- Proficiency with dbt Core
- Apache Iceberg Table format (Nice to have)
- Apache Airflow
- AWS - Working Knowledge of S3, Lambda, MWAA, ECS, Glue Catalogs, Lake Formation, Lambda, SQS, EventBridge
- Experience with fixed-format or structured financialdatafiles
- CICD with Github Actions.