Data Architect - Azure Databricks

Databricks Data ArchitectLocation : Ahmedabad, Gujarat

Experience : 15 Years

Function : Data Engineering / Architecture - Databricks Lakehouse Platform

Role Summary :

We are looking for an experienced Databricks Data Architect to lead the architecture, design, and implementation of enterprise-scale data platforms using the Databricks Lakehouse Platform.

The ideal candidate will have strong expertise in Databricks, PySpark, Delta Lake, Unity Catalog, Azure Databricks, SQL, and dimensional data modeling. The candidate will act as the technical owner of the data platform, providing architectural direction, establishing engineering standards, mentoring teams, and ensuring scalable and high-performance data solutions.

Key Responsibilities :

• Design and implement enterprise-scale data platforms using Databricks Lakehouse Architecture.

• Define end-to-end data architecture covering ingestion, transformation, storage, governance, and consumption.

• Establish architecture standards, coding guidelines, frameworks, reusable patterns, and best practices.

• Drive technical decisions related to scalability, performance, reliability, security, and maintainability.

• Conduct architecture and design reviews and provide technical recommendations.

• Design and develop scalable ETL/ELT pipelines using PySpark and Databricks.

• Architect Bronze, Silver, and Gold data transformation frameworks.

• Design and manage Delta Lake storage architecture, including partitioning, optimization, and data lifecycle management.

• Implement Databricks Lakeflow pipelines for orchestration and automation.

• Define data quality, validation, reconciliation, monitoring, and governance frameworks.

• Oversee CI/CD and DevOps practices for data engineering projects.

• Design enterprise data models using dimensional modeling, star schemas, fact tables, dimension tables, and conformed dimensions.

• Define business metrics, KPI layers, semantic models, Metric Views, and curated Gold datasets.

• Collaborate with business stakeholders to translate requirements into scalable analytical solutions.

• Provide technical leadership, mentoring, and guidance to data engineers and developers.

• Conduct code reviews and ensure compliance with architecture and engineering standards.

• Troubleshoot complex technical issues and guide teams in solution design.