Databricks Data Engineer | Azure, PySpark & CDC Pipelines
Databricks Data Engineer (Canada) designing, building, and optimizing end-to-end data pipelines on Azure for retail datasets. Day-to-day work centers on PySpark, SQL, and Kafka streaming, with CDC-based pipelines, data quality checks, and CI/CD delivery to production; Delta Lake and data modeling are a plus.
- Compensation
- Not disclosed
- Location
- Canada
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Design, build, and optimize end-to-end data pipelines in Azure
- PySpark proficiency
- Strong SQL skills
- Kafka streaming experience
- Implement CDC-based pipelines
- Ensure data quality
- Move development to production using CI/CD practices
- Databricks experience
Nice to have
- Delta Lake familiarity
- Data modeling knowledge
Full description
V-Soft Consulting Group, Inc. is seeking a Databricks Data Engineer to design, build, and optimize end-to-end data pipelines in an Azure environment. The role emphasizes PySpark, SQL, and Kafka streaming to deliver reliable data solutions for retail datasets.
You will implement CDC-based pipelines, ensure data quality, and collaborate across teams to move from development to production with CI/CD practices. Familiarity with Delta Lake and data modeling is a plus.