RQ11258 - Sr. Software Developer - ETL
This role involves designing and developing scalable data lakehouse architectures and complex ETL/ELT pipelines using Azure Data Factory, Databricks, and dbt. The developer will also handle database modeling, CI/CD automation, and data quality reporting in an onsite environment.
- Compensation
- CA$71–CA$106 / hr
- Location
- Toronto, ON, Canada
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Contract
- Experience
- 10+ years
- Category
- Software engineering
- Posted
Skills
Must have
- 10+ years of experience designing and developing scalable Medallion Data Lakehouse architectures
- Expertise in data ingestion, transformation, and curation using Delta Lake and Databricks
- Building, automating, and optimizing complex ETL/ELT pipelines using Azure Data Factory (ADF), Databricks (PySpark, SQL, Delta Live Tables), and dbt
- Strong knowledge of relational (SQL Server, Synapse, PostgreSQL) and dimensional modeling
- CI/CD automation (Azure DevOps, GitHub Actions) for data pipelines
- Power BI
Nice to have
- Public Sector Enterprise Architecture artifacts (or similar)
Full description
**RQ11258 - Sr. Software Developer - ETL9-month contract (188 business days) - possible extensionONSITE 5 days - 5700 Yonge StreetSecurity Level: CRJMCMust-haves:10+ years of experience in:
- Designing and developing scalable Medallion Data Lakehouse architectures.
- Expertise in data ingestion, transformation, and curation using Delta Lake and Databricks.
- Building, automating, and optimizing complex ETL/ELT pipelines using Azure Data Factory (ADF), Databricks (PySpark, SQL, Delta Live Tables), and dbt.
- Strong knowledge of relational (SQL Server, Synapse, PostgreSQL) and dimensional modeling.
- CI/CD automation (Azure DevOps, GitHub Actions) for data pipelines.
- Power BINice-to-have:
- Public Sector Enterprise Architecture artifacts (or similar)
Description:
· Design technical solutions for data acquisition and storage into our centralized data repository.
· Develop ELT scripts, design data-driven logic and conduct unit testing.
· Conduct database modeling and design as to improve overall performance.
· Produce design artifacts and documentation which will allow future support of the implemented solutions.
· Investigate and resolve incidents and identify whether the problem is caused by the data loading code or is due to bad data received from the data provider.
· Execute service requests related to routine and ad-hoc data loads.
· Provide the data quality check and report on the data quality issue.
AI Disclaimer: Source Code may use artificial intelligence (AI) tools to assist in certain aspects of its recruiting and business operations.Note: The higher end of the range is intended for absolutely exceptional candidates who meet all must-have requirements and most or all nice-to-have qualifications. The client will evaluate candidates based on both rate expectations and overall skill set when shortlisting.INCORPORATED RATE RANGE (7.25 billable hours per day)
- $88.52/hr - $106.25/hr Inc.T4 RATE RANGE (7.25 billable hours per day)
- $70.82/hr - $85.00/hr T4