Databricks Developer - Data Engineering

Job Summary:

We are looking for an experienced Databricks Developer with strong expertise in Python, SQL, and Databricks to develop scalable data solutions, build curated datasets, and support self-service analytics using Databricks Genie and AI/BI capabilities.

Key Responsibilities:

• Develop modular Python applications, reusable utilities, APIs, and scalable data solutions on Databricks.

• Build and maintain curated datasets and semantic layers using Databricks SQL and Unity Catalog.

• Configure and optimize Databricks Genie/AI-BI spaces to enable natural-language querying and self-service analytics.

• Manage metadata, instructions, and data definitions to improve the accuracy and quality of natural-language queries.

• Develop and optimize SQL queries and data processing workflows.

• Work with Apache Spark and PySpark for data transformation and processing.

• Implement data governance, access controls, and security best practices using Unity Catalog.

• Debug technical issues, troubleshoot data pipelines, and optimize application and query performance.

• Collaborate with data engineers, analysts, and business stakeholders to deliver reliable data solutions.

Required Skills:

• 5+ years of experience in Python development and data engineering.

• Strong proficiency in Python, SQL, and Databricks.

• Hands-on experience with Databricks SQL and Unity Catalog.

• Experience building APIs, reusable Python modules, and data processing solutions.

• Knowledge of Apache Spark/PySpark and data transformation techniques.

• Exposure to Databricks Genie, AI/BI spaces, and natural-language query configuration.

• Understanding of data governance, metadata management, debugging, and performance optimization.

• Strong analytical, problem-solving, and communication skills.