Senior Data Engineer - Remote Databricks Lakehouse
A Senior Data Engineer will migrate a 15-year-old legacy data warehouse to a governed Databricks Lakehouse, designing batch and streaming pipelines with PySpark and Delta Lake across bronze/silver/gold layers. They own data quality, governance, and performance while moving legacy workloads with minimal disruption.
- Compensation
- Not disclosed
- Location
- Meta, Colombia
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Senior-level data engineering experience
- Design batch and streaming pipelines with PySpark
- Experience with Delta Lake and bronze/silver/gold medallion architecture
- Own data quality, governance, and performance
- Migrate legacy data warehouse workloads while preserving data parity and minimizing disruption
- Partner with analytics teams
Nice to have
- Leverage AI tools to accelerate development
Full description
AgileEngine is seeking a Senior Data Engineer to transform a 15-year-old data warehouse into a governed Databricks Lakehouse. You will design batch and streaming pipelines with PySpark and Delta Lake across bronze, silver, and gold layers, leveraging AI tools to accelerate development.
You will own data quality, governance, and performance, partner with analytics teams, and help migrate legacy workloads while preserving data parity and minimizing disruption.