Databricks/Unified Data Analytics Platform Engineer

We are looking for an experienced Databricks Unified Data Analytics Platform Engineer to design, develop, and optimize scalable data solutions on the Databricks platform.

The ideal candidate should have hands-on experience with big data technologies, ETL pipelines, cloud platforms, and modern data engineering practices.

Key Responsibilities :

• Design, develop, and maintain scalable data pipelines using Databricks.

• Build and optimize ETL/ELT workflows for structured and unstructured data.

• Develop data processing solutions using Apache Spark (PySpark/Scala).

• Work with Delta Lake, Databricks SQL, and Unity Catalog.

• Integrate data from multiple sources into enterprise data platforms.

• Optimize data processing performance and ensure high availability.

• Collaborate with data scientists, analysts, and business stakeholders.

• Implement data governance, security, and best practices.

• Troubleshoot and resolve production issues.

Required Skills :

• Strong hands-on experience with Databricks Unified Data Analytics Platform.

• Apache Spark (PySpark/Scala).

• Delta Lake.

• Databricks SQL.

• SQL.

• Python.

• ETL/ELT Development.

• Azure Databricks, AWS Databricks, or GCP Databricks.

• Data Warehousing concepts.

• Git/Version Control.

• Performance Tuning and Optimization.

Preferred Skills :

• Unity Catalog.

• Azure Data Factory (ADF), AWS Glue, or similar ETL tools.

• Apache Kafka.

• Airflow.

• CI/CD pipelines.

• Knowledge of Data Lakehouse architecture.