Quickops
Azure Data Engineer: Databricks, PySpark & Delta Lake
Data Engineer at Quickops in Lisbon, designing, building, and optimizing data pipelines on Azure Databricks. Day-to-day centers on PySpark, Delta Lake, and Unity Catalog, handling large-scale batch and streaming data with Bronze/Silver/Gold medallion architecture and a focus on quality and governance.
- Compensation
- Not disclosed
- Location
- Portugal
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Experience as a Data Engineer with Azure
- Design, build and optimize data pipelines in Databricks
- Strong experience with PySpark
- Experience with Unity Catalog
- Experience with Delta Lake
- Strong experience with Spark SQL
- ETL/ELT and data architecture experience
- Ability to work with large volumes of data
- Experience with streaming scenarios
- Experience with Bronze/Silver/Gold (medallion) models
- Focus on data quality and governance
Full description
Quickops procura um Data Engineer - Azure para se juntar à equipa em Lisboa. Será responsável por desenhar, construir e otimizar pipelines de dados no ecossistema Databricks, com ênfase em PySpark, Unity Catalog e Delta Lake.
Procuramos alguém com forte experiência em Spark SQL, ETL/ELT e arquitetura de dados, capaz de trabalhar com grandes volumes de dados, cenários de streaming e modelos Bronze/Silver/Gold, com foco em qualidade e governança.