Senior/Lead Data Engineer - Databricks

Role Overview:

As a Senior / Lead Data Engineer, you will serve as a technical anchor for our data platform initiatives, architecting scalable solutions that handle high-volume data ingestion and transformation. You will work closely with cross-functional teams, including data scientists, product managers, and infrastructure engineers, to build robust pipelines that power business-critical analytics. Your contribution will directly influence the reliability and performance of our data products, ensuring that stakeholders have seamless access to high-quality, governed data to support their strategic objectives in a fully remote environment.

Required Qualifications:

• Strong hands-on Data Engineering experience.

• Expert-level experience with Databricks.

• Strong hands-on experience with Databricks Unity Catalog.

• Strong experience designing Medallion Architecture (Bronze/Silver/Gold) data pipelines.

• Advanced Python/PySpark and SQL skills.

• Strong experience with AWS, particularly S3 and AWS Glue.

• Hands-on experience with Databricks Asset Bundles (DABs).

• Strong Git experience with GitHub Enterprise and GitHub Actions.

• Experience implementing CI/CD for data engineering and Databricks workloads.

• Strong understanding of data engineering best practices, data modeling, and pipeline optimization.

• Experience working in Agile/Scrum development environments.

Ideal Candidate:

The ideal candidate is a senior-level, hands-on Databricks Data Engineer. They should be comfortable writing code, building pipelines, troubleshooting production issues, implementing CI/CD, and working directly in Databricks and AWS on a daily basis.