Senior Data Fabric Data Engineer
Lead the design and delivery of end-to-end Microsoft Fabric data solutions (Lakehouse, Warehouse, Pipelines, semantic models) for multiple consulting clients, combining hands-on T-SQL/PySpark/Python engineering with architecture, CI/CD via Azure DevOps/GitHub Actions, and mentoring.
- Compensation
- Not disclosed
- Location
- Midrand, South Africa
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Full time
- Experience
- 5+ years
- Category
- Data engineering
- Posted
Skills
Must have
- Microsoft Fabric: Lakehouse, Warehouse, Pipelines, Dataflows Gen2 and Notebooks
- Azure Synapse Analytics, Azure SQL, Azure Data Lake and Azure Data Factory
- Strong T-SQL, PySpark, Python and Spark SQL skills
- Power BI, DAX, data modelling and semantic modelling
- DirectLake, Import/DirectQuery and composite models
- Delta Lake, SSIS, Power Query (M) and SQL Server
- Azure DevOps or GitHub Actions, Git-based source control and CI/CD
- Data platform security, access controls, governance, monitoring and backup/recovery
- 5+ years in data engineering, BI development or data warehousing
- Hands-on production experience delivering Microsoft Fabric solutions
- Experience migrating legacy BI/ETL platforms to modern cloud architectures
- Experience leading technical workstreams or small teams and mentoring
- Bachelor's degree or diploma in Computer Science, Information Systems, Data Science or related field (NQF 6+)
- Microsoft Certified: Fabric Analytics Engineer Associate (required or in progress)
- Microsoft Certified: Azure Data Engineer Associate (required or in progress)
Nice to have
- Microsoft Certified: Power BI Data Analyst Associate
- Databricks and exposure to AWS or GCP
- Machine learning workflows on Microsoft Fabric or data science tooling (Python/R)
- SQL Server high-availability and disaster-recovery concepts
- Agile/Scrum or Kanban delivery methods
- Consulting experience managing multiple concurrent client engagements
Full description
Senior Data Fabric Data Engineer
Johannesburg (Hybrid) - Midrand | Full-time, Permanent | Senior Level
About the Opportunity
An established data and analytics consulting environment is seeking a Senior Data Fabric Data Engineer to lead the design, build and delivery of modern, end-to-end data solutions across multiple client engagements. The role has a strong Microsoft technology focus, particularly Microsoft Fabric, Azure and Power BI, and combines hands‑on engineering with solution architecture, client engagement and technical leadership.
Role Overview
You will take ownership of the technical architecture of client data platforms, from ingestion and Bronze/Silver/Gold Lakehouse and Warehouse layers through to semantic models supporting Power BI. The role includes production implementations, legacy BI migrations, proof‑of‑concept initiatives, ongoing platform support and mentoring of junior and mid‑level engineers.
Key Responsibilities
- Design and build end‑to‑end Microsoft Fabric solutions, including Lakehouses, Warehouses, Data Pipelines, Dataflows Gen2 and Notebooks.
- Architect medallion (Bronze/Silver/Gold) data models and define ingestion, transformation and curation standards.
- Build and optimise ingestion pipelines from sources such as SQL Server, Azure SQL, REST APIs, Excel/SharePoint and ERP/finance systems.
- Develop semantic models using DirectLake, Import, DirectQuery and composite modelling to support Power BI and self‑service analytics.
- Lead migrations from legacy BI and ETL platforms such as QlikView/Qlik Sense, Synapse, SSIS and SSRS to modern cloud architectures.
- Write and optimise T‑SQL, PySpark and Python for transformation, data quality and performance tuning.
- Implement CI/CD, source control, workspace governance and environment promotion using Azure DevOps or GitHub Actions.
- Establish monitoring, alerting, data validation, security and governance practices.
- Lead client requirements workshops, translate business needs into technical designs and document current/future‑state architectures.
- Lead technical workstreams and proof‑of‑concept implementations, support critical platform issues and mentor less experienced engineers.
Required Skills & Technology
- Microsoft Fabric: Lakehouse, Warehouse, Pipelines, Dataflows Gen2 and Notebooks.
- Azure technologies including Azure Synapse Analytics, Azure SQL, Azure Data Lake and Azure Data Factory.
- Strong T‑SQL, PySpark, Python and Spark SQL skills.
- Power BI, DAX, data modelling and semantic modelling.
- DirectLake, Import/DirectQuery and composite models.
- Delta Lake, SSIS, Power Query (M) and SQL Server.
- Azure DevOps or GitHub Actions, Git‑based source control and CI/CD.