Vermont Solutions
Big Data Engineer: Flexible Hours, Spark & Market Risk
Design and maintain datalake pipelines with Spark, Scala, and SQL, and orchestrate batch processes with Control-M and Airflow, supporting data ingestion, transformation, and publication for Market Risk use cases in an agile Madrid-based team.
- Compensation
- Not disclosed
- Location
- Madrid, Spain
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Experience building and maintaining datalake pipelines with Spark
- Experience with Scala and SQL
- Experience orchestrating batch processes with Control-M and Airflow
- Experience with data ingestion, transformation, and publication for Market Risk use cases
- Experience working in agile, cross-functional teams
Nice to have
- Experience with Databricks
- Experience with Azure
- Experience with CI/CD
Full description
Vermont Solutions busca un/a Big Data Developer para impulsar soluciones de datos en Market Risk. Diseñarás y mantendrás pipelines de datalake con Spark, Scala y SQL, y orquestarás procesos batch con Control-M y Airflow.
Participarás en la ingesta, transformación y publicación de datos para casos de uso de Market Risk, asegurando rendimiento y fiabilidad en un entorno ágil. Se valora experiencia en Databricks, Azure y CI/CD; además de colaborar en equipos cross-funcionales y soporte a