Senior Data Engineer & GenAI Solutions Architect
REGTECH INSIGHT PTE. LTD. in Singapore seeks a Senior Data Engineer & GenAI Solutions Architect to design, build and maintain scalable ETL/ELT pipelines plus batch and real-time streaming pipelines. Core stack: Python, PySpark, Spark SQL, Scala, Kafka, Kinesis, Spark Streaming, Airflow, and cloud data lakes/warehouses.
- Compensation
- Not disclosed
- Location
- Singapore, Singapore
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Design, develop and maintain scalable ETL/ELT pipelines for large datasets
- Process structured and unstructured data with Python, PySpark, Spark SQL and Scala
- Build batch and real-time pipelines with Kafka, Kinesis, Spark Streaming and Airflow
- Design data lakes and data warehouses on cloud platforms
- Collaborate with data scientists and product teams to deliver enterprise data solutions
Full description
REGTECH INSIGHT PTE. LTD. in Singapore seeks a Data Engineer to design, develop and maintain scalable ETL/ELT pipelines for large datasets.
You will use Python, PySpark, Spark SQL and Scala to process structured and unstructured data, and build batch and real-time pipelines with Kafka, Kinesis, Spark Streaming and Airflow. You will design data lakes and data warehouses on cloud platforms, collaborating with data scientists and product teams to deliver enterprise data solutions.