Mid-level Backend Spark developer

Job Description

We are looking for a Mid-Level Backend Spark Developer to join our Markets technology team. The successful candidate will contribute to the development and maintenance of data processing solutions using Spark and SQL-based technologies. This role involves working in a collaborative, agile environment, supporting data-driven initiatives, and improving existing systems through proactive analysis and teamwork.

The position is onsite and may be assigned to either the Málaga hub or the Poland hub, depending on business needs and geographic diversity guidelines.

Key Responsibilities

• Develop, maintain, and optimize data pipelines using Apache Spark

• Write efficient and scalable queries using SQL (ANSI SQL, Hive SQL, Spark SQL)

• Collaborate with cross-functional teams to analyze and refine business and technical requirements

• Participate in code reviews and ensure best practices in coding and version control using Git

• Support data processing and transformation tasks across distributed systems

• Contribute to continuous improvement by proactively identifying inefficiencies and proposing solutions

• Work closely with team members to ensure high-quality deliverables and timely project execution

Qualifications

Required Skills

• 1.5 to 2 years of experience in data engineering or software development

• Strong knowledge of SQL (ANSI SQL, Hive SQL, Spark SQL, or similar)

• Solid understanding of Apache Spark

• Programming experience in Scala, Python, or Java

• Experience with Git or similar version control systems

• English proficiency at B2+ level or higher

• Strong analytical thinking and problem-solving skills

• Ability to work effectively in a team environment

• Proactive attitude and willingness to take initiative

Nice to Have

• Experience with Azure Databricks, Amazon EMR, or Cloudera

• Understanding of Hive

• Experience with reporting tools such as Power BI

• Exposure to data visualization and reporting concepts

Additional Information