Data Engineer: Azure & Databricks Pro (Delta Lake)
Builds and maintains ETL/ELT processes and data pipelines in Azure using Databricks, designing medallion-architecture (bronze/silver/gold) solutions with Delta Lake and Unity Catalog. Requires 3+ years' experience with SQL, Python, PySpark, Pandas, Polars, Azure Data Factory and Azure Functions.
- Compensation
- Not disclosed
- Location
- Warszawa, Poland
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- At least 3 years of experience
- Very good knowledge of SQL
- Proficiency in Python, PySpark, Pandas and Polars
- Experience with Azure Data Factory and Azure Functions
- Experience with Databricks, medallion architecture (bronze/silver/gold), Delta Lake and Unity Catalog
Full description
POLENERGIA S.A. poszukuje doświadczonego Data Engineera do budowy i utrzymania procesów ETL/ELT oraz pipeline’ów danych w środowisku Azure. Pracownik będzie korzystał z Databricks, projektując rozwiązania zgodne z medallion architecture (bronze/silver/gold) z Delta Lake i zarządzaniem danymi w Unity Catalog.
Oczekujemy co najmniej 3 lat doświadczenia, bardzo dobrej znajomości SQL, Pythona, PySpark, Pandas i Polars, a także doświadczenia z Azure Data Factory i Azure Functions.