Streaming Data Engineer (Databricks & Python)
Design and maintain real-time data processing pipelines using Databricks, Apache Spark Structured Streaming, and Python, troubleshooting streaming jobs and collaborating with engineers and stakeholders to deliver scalable, reliable workflows. Suited for a data engineer with 5-10 years of experience and a distributed computing background.
- Compensation
- Not disclosed
- Location
- Singapore, Singapore
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- 5+ years
- Category
- Data engineering
- Posted
Skills
Must have
- 5-10 years of data engineering experience
- Experience developing and maintaining data processing solutions with Databricks
- Proficiency in Python
- Experience designing real-time pipelines with Apache Spark Structured Streaming
- Solid foundation in distributed computing
- Ability to troubleshoot streaming jobs
- Collaboration with data engineers and stakeholders
Full description
PERSOL Singapore Pte Ltd is seeking an experienced data engineer to develop and maintain data processing solutions using Databricks and Python in a fast-paced environment. You will design real-time pipelines with Apache Spark Structured Streaming, troubleshoot streaming jobs, and collaborate with data engineers and stakeholders to deliver scalable, reliable workflows.
The ideal candidate brings 5–10 years of data engineering experience, a solid foundation in distributed computing, and a