Data Engineer (databricks) - Credit Risk Data & Monitoring
Data engineer on BEC's Credit Risk Data & Monitoring team in Warsaw, helping migrate legacy Netezza data warehouse solutions to a new Azure/Databricks platform. Day to day: building end-to-end data pipelines and dashboards/reports using Databricks, PySpark, Python, and SQL to support bank monitoring, reporting, and regulatory compliance.
- Compensation
- Not disclosed
- Location
- Warszawa, Poland
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- 3+ years
- Category
- Data engineering
- Posted
Skills
Must have
- 3+ years of experience as Data Engineer
- Hands-on experience with Databricks & PySpark
- Hands-on experience in Python
- Hands-on experience in writing and optimizing SQL
- Deep knowledge of data modeling and data warehouse architecture
- Curious mind with an open nature and desire to knowledge-share with others
- Proactive and self-driven approach
Full description
This position is based at our friendly office in Warsaw and you will join our Credit Risk Data & Monitoring team placed in 2 locations - Poland and Denmark. It is in the Reporting Solutions domain which is responsible for delivering solutions supporting banks in their monitoring and reporting tasks, ensuring compliance with requirements from the Danish FSA and central bank.
The Data Engineer role offers you the possibility to work with data, BECs existing BI platform and participate in BEC’s tech transformation journey. At BEC, we prefer to collaborate often in the office, but we also keep the opportunity to work remotely up to 8 days per month.
Your direct manager will be Anders Bjerregaard Andersen.
Primary tasks and responsibilities include:
- Participate in the tech transformation of existing solutions from legacy Data Warehouse based on Netezza to the new data platform based on Azure and Databricks
- Create User Interfaces (i.e. Dashboards, reports or other forms of data visualization) enabling delivery of actionable insights for the end users
- Develop effective end-to-end data processing flows, including various data processing steps that include and are not limited to acquisition, cleansing, integration/ consolidation, transformation and delivery/exposure
- Ensure timely delivery of housekeeping and maintenance tasks
- Collaborate with the team architect, data engineers, business analysts and software developers in and outside of the Reporting Solutions domain
To succeed you will have:
- 3+ years of experience as Data Engineer
- Hands-on experience with Databricks & PySpark
- Hands-on experience in Python
- Hands-on experience in writing and optimizing SQL
- Deep knowledge of data modeling and data warehouse architecture
- A curious mind with an open nature and desire to knowledge-share with others
- A proactive and self-driven approach
Be your best self with BEC's benefits!
We offer a diverse range of benefits for our employees. Here are just a few of them.
- Mental health support
- Free lunch at the office
- Professional development budget
- Referral bonus up to PLN 10,000
- PLN 600 on a benefit platform a month
- Passion clubs and social events (tennis, salsa dancing, board games, family picnics and more)