Senior Data Engineer - Azure Databricks & Medallion Pipeline
Senior Data Engineer building and optimizing enterprise data pipelines with Azure Databricks, ADLS, ADF, PostgreSQL, and Azure DevOps in Mexico City, implementing Medallion architecture, data quality controls, and CI/CD in production while collaborating with architects, BI, QA, and analysts.
- Compensation
- Not disclosed
- Location
- México, Mexico
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Design, develop, and optimize enterprise data pipelines using Azure Databricks
- Experience with ADLS (Azure Data Lake Storage)
- Experience with ADF (Azure Data Factory)
- Experience with PostgreSQL
- Experience with Azure DevOps and CI/CD processes
- Implement Medallion architecture
- Implement data quality controls in production
- Collaborate with architects, BI teams, QA, and business analysts
Full description
Papigen is seeking a Senior Data Engineer / Databricks Engineer to design, develop, and optimize enterprise data pipelines using Azure Databricks, ADLS, ADF, PostgreSQL, and Azure DevOps in Mexico City. The role focuses on building ingestion, transformation, and reporting-ready datasets, implementing Medallion architecture, data quality controls, and CI/CD processes in a production environment.
You will collaborate with architects, BI teams, QA, and business analysts to ensure robust pipelines