ThoughtStorm Inc.
Senior ETL Developer – Azure, AWS & Databricks
A Senior ETL Developer designs, builds, and optimizes data pipelines feeding data warehouse and BI solutions, handling daily loads, scheduling, data quality, and modeling. Core stack: Azure Data Factory, Azure SQL/Data Lake, Databricks, AWS (Glue, Aurora, OpenSearch), Power BI, and complex SQL.
- Compensation
- Not disclosed
- Location
- Toronto, Canada
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Hands-on experience with Azure Data Factory, Azure SQL Database, Azure Data Lake, and Power BI
- Experience with the Databricks Platform and AWS data technologies including AWS Glue, Amazon Aurora, and OpenSearch
- Strong expertise in complex SQL queries, performance tuning, database administration, and data modeling for data warehouses and data marts
- Experience developing ETL processes for initial and daily loads across structured, semi-structured, relational, and multidimensional sources
- Build and maintain ETL scheduling, job dependencies, data integration, data cleansing, and data quality processes
- Use Git and source control strategies while following SDLC practices (development, testing, QA, delivery)
- Prepare technical documentation: ETL source-to-target mappings, data models, architecture artifacts, design documents
- Collaborate with business stakeholders to gather, document, and validate requirements
Nice to have
- C#, APIs, Azure Functions, PowerShell
- Dashboard/report development and knowledge of AODA standards
Full description
We are seeking a Senior ETL Developer to design, develop, maintain, and optimize data pipelines supporting Data Warehouse and Business Intelligence solutions.
- Develop and maintain ETL processes for initial and daily data loads across structured, semi-structured, relational, and multidimensional data sources.
- Hands‑on experience with Azure Data Factory, Azure SQL Database, Azure Data Lake, and Power BI.
- Experience with the Databricks Platform and AWS data technologies, including AWS Glue, Amazon Aurora, and OpenSearch.
- Build and maintain ETL scheduling, job dependencies, data integration, data cleansing, and data quality processes.
- Strong expertise in complex SQL queries, performance tuning, database administration, and data modeling for data warehouses and data marts.
- Use Git and source control strategies while following software development lifecycle practices, including development, testing, QA, and delivery.
- Prepare technical documentation, including ETL source-to-target mappings, data models, architecture artifacts, and detailed design documents.
- Collaborate with business stakeholders to gather, document, and validate requirements while ensuring scalable, maintainable, and high‑quality data solutions.
- Nice to have: C#, APIs, Azure Functions, PowerShell, dashboard/report development, and knowledge of AODA standards.