Data engineer for investment banking
Data engineer at Sii Poland modernizing an investment bank's backend data processing platform on its internal cloud: designing scalable Scala/Apache Spark data pipelines, building ETL/ELT for large data volumes, and developing Java data-processing components. Hybrid role in Warsaw with 2-3 office days per week.
- Compensation
- Not disclosed
- Location
- Warszawa, Poland
- Work setup
- Hybrid
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- 4+ years
- Category
- Data engineering
- Posted
Skills
Must have
- Minimum 4 years of experience as a Data Engineer on large-scale data processing projects
- Strong knowledge of Scala and Apache Spark
- Practical experience with Java and backend or data processing development
- Experience designing and implementing ETL/ELT processes and data pipelines
- Good knowledge of SQL and relational databases
- Experience with distributed systems and Big Data environments
- Advanced Polish and English, and residency in Poland
Full description
Описание: We are looking for a skilled Data Engineer to join our team in Warsaw, working on a project focused on modernizing the backend data processing platform for an investment bank. This role involves collaborating with feature teams to enhance data processing capabilities using Big Data technology on an internal cloud. You will be part of a modern, data-driven environment, with a hybrid work model that includes 2-3 days in the office each week. If you are passionate about backend development and data engineering, this opportunity may be the right fit for you.
Задачи:
- Designing, developing, and maintaining scalable data pipelines using Scala and Apache Spark
- Implementing ETL/ELT processes and transformations for large volumes of data
- Developing and maintaining data processing components using Java
- Optimizing the performance of Spark applications and data processing workflows
- Integrating data from various sources and preparing it for further analysis and use by banking systems
- Collaborating with Data Engineers, Developers, Analysts, and business teams to design and deliver data solutions
- Monitoring code quality and conducting continuous integration
Требования:
- Minimum 4 years of experience as a Data Engineer working on projects involving large-scale data processing
- Strong knowledge of Scala and Apache Spark
- Practical experience with Java and developing backend applications or data processing solutions
- Experience designing and implementing ETL/ELT processes and data pipelines
- Good knowledge of SQL and relational databases
- Experience working with distributed systems and Big Data environments
- Advanced knowledge of both Polish and English, and residency in Poland
Условия:
- Great Place to Work
- Solid financial situation
- Contracts with the biggest brands
- Centre of internal trainings
- Many experts you can learn from
- Open and accessible management team
- Profit sharing
- Passion
- Sponsorship program