Lead Generative AI Engineer - Databricks Ecosystem

Job Title :Role : Lead Generative AI Engineer (Databricks Genie)Role Overview :

We are looking for a Senior to Lead Generative AI Engineer with 7 - 12 years of experience to drive the architecture, development, and scaling of our enterprise compound AI systems.

In this role, you will design and implement production-ready agentic workflows natively within the Databricks ecosystem.

You will lead the creation of intelligent automation solutions using DB Genie, Agent bricks, and advanced multi-agent orchestration frameworks, while ensuring absolute data security through Unity Catalog.Key Responsibilities :

• Agentic Architecture: Design, build, and deploy robust multi-agent orchestration systems capable of handling complex, non-linear enterprise workflows and decision-making logic.

• Autonomous Workflows: Leverage Agent bricks to create reusable, task-specific autonomous agents that securely interact with corporate knowledge bases.

• Conversational Data Interfaces: Implement and optimize DB Genie to deliver seamless, highly accurate text-to-SQL capabilities and conversational analytics across enterprise datasets.

• Governance & Security: Architect all AI pipelines natively within Unity Catalog to enforce strict data lineage, fine-grained access control, and regulatory compliance.

• Enterprise LLMOps & Monitoring: Establish end-to-end evaluation frameworks and build custom DBX metrics views to track model safety, system latency, token costs, and hallucinatory behavior in production.

• Technical Leadership: Guide the engineering team on LLMOps best practices, conduct code reviews, and collaborate with cross-functional data teams to optimize feature stores and vector databases.

Required Technical Skills :

• Databricks Ecosystem: Deep, production-tested experience with Databricks workspaces, Delta Lake, MLflow, and Unity Catalog.

• GenAI & Agentic Frameworks: Proven hands-on experience building multi-agent systems using DB Genie, Agent bricks, and orchestration layers (such as LangGraph, CrewAI, AutoGen, or native Databricks Agent frameworks).

• Observability: Strong expertise in setting up LLM tracking and operational dashboards using DBX metrics views.

• Expert-level proficiency in and advanced . Strong experience with deep learning and embedding frameworks (PyTorch, Hugging Face).