Senior Data Engineer - Real-Time Pipelines & Spark
Design, build, and optimize scalable batch and real-time data pipelines for large enterprise datasets using Spark/PySpark (incl. Structured Streaming), Python/Scala, Kafka, and cloud services, with a focus on data quality, security, and cost efficiency.
- Compensation
- Not disclosed
- Location
- Singapore, Singapore
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Experience as a Data Engineer designing, building and optimizing scalable data pipelines for large datasets
- Proficiency with Spark/PySpark
- Proficiency with Python/Scala
- Experience working with cloud services
- Experience with Spark Structured Streaming
- Experience with Kafka
- Experience delivering batch and real-time processing
- Experience with reliable ingestion, transformation and warehousing capabilities
- Ability to ensure data quality, security and cost efficiency
Nice to have
- Ability to collaborate with cross-functional teams in a fast-paced enterprise environment
Full description
UARROW PTE. LTD. is seeking an experienced Data Engineer to design, build and optimize scalable data pipelines for large datasets. You will work across Spark/PySpark, Python/Scala, and cloud services to deliver reliable ingestion, transformation and warehousing capabilities.
You will deploy batch and real-time processing using Spark Structured Streaming and Kafka, collaborate with cross‑functional teams, and ensure data quality, security and cost efficiency in a fast-paced enterprise environment.