Senior Data Engineer - Lakehouse & Cloud Pipelines
Senior Data Engineer designing, building, and maintaining cloud data pipelines on AWS and Databricks, architecting Bronze/Silver/Gold lakehouse layers with incremental ingestion/CDC and data quality, lineage, and observability for analytics, reporting, and ML workloads using Python, PySpark, and SQL.
- Compensation
- Not disclosed
- Location
- Singapore, Singapore
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Strong Python skills
- Strong PySpark skills
- Strong SQL skills
- AWS experience
- Databricks experience
- Design, build, deploy and maintain reliable cloud data pipelines
- Architect lakehouse Bronze/Silver/Gold layers
- Implement incremental ingestion and CDC
- Ensure data quality, lineage and observability
- Deliver scalable, secure data products for analytics, reporting and ML workloads
Full description
OPTIMUM SOLUTIONS (SINGAPORE) PTE LTD seeks a Senior Data Engineer to design, build, deploy and maintain reliable data pipelines on a cloud-based platform using AWS and Databricks. Lead data ingestion, transformation, quality, lineage and observability for analytics, reporting and ML workloads.
You will architect Bronze/Silver/Gold layers, implement incremental ingestion and CDC, and ensure scalable, secure data products. Strong Python, PySpark, SQL and AWS/Databricks experience are essential.