Data Engineer (Databricks) | Enterprise Energy Data Platform
Polcode, a Polish software house, seeks a Data Engineer with strong Databricks experience for a long-term enterprise energy-sector data platform project running to end of 2027. Day to day: designing scalable Databricks solutions, integrating data into a Data Lake with Medallion Architecture, and building ETL/ELT pipelines with Python and SQL.
- Compensation
- PLN 110–PLN 150 / hr
- Location
- Warszawa, Poland
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Several years of commercial Data Engineering experience
- Hands-on commercial experience with Databricks
- Solid Python and SQL skills
- Experience with data modelling and ETL/ELT processes
- Experience building and orchestrating data pipelines
- Strong understanding of Data Lake / modern data platform concepts
- Understanding of layered data models such as Medallion Architecture (Bronze / Silver / Gold)
- Experience with permissions and access concepts
- Knowledge of continuous ingestion and continuous development practices
- Understanding of deployment processes and data quality practices
- Solution-oriented and structured approach to engineering challenges
- Strong communication skills and ability to work independently with stakeholders
- Experience working in agile projects, particularly Scrum
- Understanding of IT Service Management processes such as ITIL
- English allowing you to work effectively in an international environment
Nice to have
- Experience with Microsoft Azure in a Databricks / Data Engineering environment
- Experience with Spark or PySpark
- Experience with streaming, CDC, Auto Loader, Structured Streaming, or similar continuous ingestion approaches
- Experience with Machine Learning or LLM solutions in Databricks
- Experience with Jira and Confluence
- Good German language skills
Full description
Who we are
Polcode is a Poland-based software house working with clients worldwide since 2006. We build web, mobile, and eCommerce products for startups and well-established companies across Europe, the US, and beyond.
The role
We’re currently looking for a Data Engineer with strong Databricks experience to join a long-term project in the energy sector. The cooperation is planned until the end of 2027, with an option to extend.
The project focuses on developing and continuously improving a modern data platform, with particular attention to data quality, scalable data processes, and providing reliable data for reporting.
Key responsibilities
- Design and develop scalable data solutions in Databricks
- Integrate data into an enterprise Data Lake using a Medallion Architecture
- Build and maintain data models supporting reporting
- Develop and orchestrate ETL/ELT processes and data pipelines
- Work with Python and SQL on data transformation and processing
- Support continuous data ingestion and development processes
- Contribute to permissions and access concepts
- Work within multi-tier deployment environments and Quality Gates
- Optimize data processes for better performance, efficiency, and quality
- Document architectural decisions, processes, and project outcomes
- Collaborate with stakeholders in an agile environment
Requirements
- Several years of commercial Data Engineering experience
- Hands-on commercial experience with Databricks
- Solid Python and SQL skills
- Experience with data modelling and ETL/ELT processes
- Experience building and orchestrating data pipelines
- Strong understanding of Data Lake / modern data platform concepts
- Understanding of layered data models such as Medallion Architecture (Bronze / Silver / Gold)
- Experience with permissions and access concepts
- Knowledge of continuous ingestion and continuous development practices
- Understanding of deployment processes and data quality practices
- Solution-oriented and structured approach to engineering challenges
- Strong communication skills and ability to work independently with stakeholders
- Experience working in agile projects, particularly Scrum
- Understanding of IT Service Management processes such as ITIL
- English allowing you to work effectively in an international environment
Nice to have
- Experience with Microsoft Azure in a Databricks / Data Engineering environment
- Experience with Spark or PySpark
- Experience with streaming, CDC, Auto Loader, Structured Streaming, or similar continuous ingestion approaches