Senior Engineer (SA1 DES - Azure Data Engineer)

Roles & responsibilities

Role Overview: The Senior Associate 1 - “Azure Data Engineer with Gen AI/Fabric skills” will be part of the GDC Technology Solutions (GTS) team, working in a technical role in the Audit Data & Analytics domain that requires developing expertise in KPMG proprietary D&A (Data and analytics)) tools and audit methodology. He/she will be a part of the team responsible for extracting and processing datasets from client ERP systems (SAP/Oracle/Microsoft Dynamics) or other sources to provide insights through data warehousing, ETL and dashboarding solutions to Audit/internal teams and be involved in developing solutions using a variety of tools & technologies

The Senior Associate 1 - “Azure Data Engineer” will be predominantly responsible for:

Data Engineering (Primary Skills)

·Azure data engineer expertise having experience working on all major Azure resources including expertise in development and debugging of programs using Databricks expertise.

·Utilize Azure Databricks notebooks to build and manage data transformations, create tables, and ensure data quality and consistency. Leverage Unity Catalog for data governance and maintaining a unified data view across the organization.

·Design, develop, and maintain scalable and efficient data pipelines to process large datasets from various sources using Azure Data Factory (ADF).

·Integrate data from multiple data sources and ensure data consistency, quality, and accuracy, leveraging Azure Data Lake Storage (ADLS).

·Develop and manage data warehouses to store and organize large volumes of structured and unstructured data using Azure Synapse Analytics and other relevant Azure services.

·Design and implement ETL (Extract, Transform, Load) processes to ensure seamless data flow across systems using Azure cloud platform

·Work experience on Microsoft Fabric experience is an added advantage

·Professional should be enthusiastic to learn, adapt and integrate Gen AI into the business process and should have experience working in Azure AI services

·Optimize data storage and retrieval processes to enhance system performance and reduce latency.

Power BI (Secondary Skills)

·Design and develop visuals, reports, and dashboard solutions in Power BI with RLS and other features as per business needs.

·Hands on experience connecting to various data sources to load and transform data and Implement complex joins with multiple tables, using power query.

·Highly skilled in writing DAX expressions to implement complex business calculations and data modeling needs.