Senior Data Engineer: Scalable Spark & Cloud Data Pipelines
Senior Data Engineer designing, building, and maintaining scalable cloud data pipelines for large-volume datasets. Works with Spark, PySpark, Scala, and Python on ETL/ELT, uses Delta Lake or Snowflake for data lakes/storage, and implements CI/CD and testing with Airflow and Jenkins.
- Compensation
- Not disclosed
- Location
- Singapore, Singapore
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Design, develop and maintain scalable data pipelines for large-volume datasets in a cloud-first environment
- Experience with Spark, PySpark, Scala and Python
- Build ETL/ELT processes and optimize performance and cost
- Translate requirements into robust data models, storage architectures and data lakes using Delta Lake or Snowflake
- Implement CI/CD and testing with Airflow and Jenkins
- Collaborate with stakeholders on requirements
Full description
UNISYNC SYSTEMS PTE. LTD. is seeking a Senior Data Engineer to design, develop and maintain scalable data pipelines for large-volume datasets in a cloud-first environment.
You will work with Spark, PySpark, Scala and Python to build ETL/ELT processes and optimize performance and cost. Collaborate with stakeholders to translate requirements into robust data models, storage architectures and data lakes, using Delta Lake or Snowflake, while implementing CI/CD and testing with Airflow, Jenkins and