Lead Data Engineer (Azure) — ETL, Spark & Architecture
Senior data engineer role at SoftServe in Chile: design and build scalable Azure data platforms, doing hands-on ETL pipeline development with SQL, Python, Spark/PySpark, Azure Data Factory and Airflow, plus data modeling, data quality and performance tuning, while providing technical leadership and working directly with clients and architects.
- Compensation
- Not disclosed
- Location
- Chile
- Work setup
- Not specified
- Seniority
- Lead
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- senior-level data engineering experience
- design and delivery of scalable data solutions in Azure
- hands-on ETL development
- building pipelines with SQL
- building pipelines with Python
- building pipelines with Spark / PySpark
- experience with Azure Data Factory
- experience with Airflow
- data modeling
- ensuring data quality
- performance optimization
- technical leadership and guiding the team
- working with clients and architects to translate business needs
Full description
SoftServe is seeking a senior Data Engineer to design and deliver scalable data solutions in Azure. You will combine hands-on ETL development with technical leadership, working with clients and architects to translate business needs into reliable data platforms.
You will build pipelines with SQL, Python, Spark, PySpark, Azure Data Factory, and Airflow; develop data models; ensure data quality; optimize performance; guide the team and support cross-functional delivery.