Microsoft Fabric Data Engineer

Role Overview :

We are seeking a highly skilled Microsoft Fabric Data Engineer to design, develop, and maintain modern data platforms leveraging Microsoft Fabric. The ideal candidate should have hands-on experience with OneLake, Lakehouse, Data Factory, Data Pipelines, PySpark, SQL, and Medallion Architecture to support enterprise-scale analytics and reporting requirements.

Key Responsibilities : Data Engineering & Integration :

• Design, develop, and maintain scalable data ingestion and transformation pipelines using Microsoft Fabric.

• Build and manage ETL/ELT workflows using Fabric Data Factory and Data Pipelines.

• Integrate data from multiple sources including databases, APIs, flat files, cloud storage, and SaaS applications.

• Implement incremental data loads and Change Data Capture (CDC) strategies.

Lakehouse Development :

• Design and maintain Fabric Lakehouse environments.

• Develop and optimize Delta Tables for high-performance analytics workloads.

• Implement Medallion Architecture (Bronze, Silver, Gold layers) to support data quality and governance requirements.

• Create curated datasets for reporting, analytics, and AI/ML use cases.

Data Transformation & Processing :

• Develop data transformation logic using PySpark, Spark SQL, and notebooks.

• Create reusable frameworks and data engineering best practices.

• Perform data cleansing, enrichment, and standardization activities.

Data Modeling & Analytics Support :

• Design dimensional and analytical data models.

• Collaborate with Business Intelligence teams to support Power BI semantic models and reporting requirements.

• Ensure data consistency, quality, and accuracy across data platforms.

Performance Optimization & Governance :

• Monitor data pipeline performance and troubleshoot production issues.

• Optimize Spark jobs, Lakehouse storage, and query performance.

• Implement security controls, role-based access, and data governance standards.

• Support data lineage, auditing, and compliance requirements.

DevOps & Collaboration :

• Implement CI/CD processes using Git integration and deployment pipelines.

• Participate in Agile ceremonies and collaborate with architects, analysts, and business stakeholders.

• Maintain technical documentation and operational runbooks.