Data Engineer (DataLake) - All levels
Data Engineer at Capco (Bangkok) designing and building batch, CDC and streaming ingestion pipelines and Bronze/Silver/Gold data layers for Data Lake/Lakehouse programmes in financial services. Core stack: Databricks, Azure, SQL, Python/PySpark, Delta Lake, ETL/ELT, data quality and CI/CD.
- Compensation
- Not disclosed
- Location
- Thailand - Bangkok
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- 4+ years
- Category
- Data engineering
- Posted
Skills
Must have
- 4+ years of experience in data engineering or related roles
- Strong experience in Databricks, Azure, SQL, Python/PySpark, ETL/ELT, Delta Lake, data modelling, data quality and CI/CD
- Experience working on an end-to-end enterprise data transformation, from source ingestion through to governed data products and business reporting
Nice to have
- Experience in financial services, especially asset management or large-scale data transformation
- Experience in an asset management company, fintech, or other regulated industries
Full description
Capco, a Wipro company, is a global technology and management consultancy specializing in driving digital transformation in the financial services industry. With a growing client portfolio comprising of over 100 global organizations, Capco operates at the intersection of business and technology by combining innovative thinking with unrivalled industry knowledge to deliver end-to-end data-driven solutions and fast-track digital initiatives for banking and payments, capital markets, wealth and asset management, insurance, and the energy sector. Capco’s cutting-edge ingenuity is brought to life through its Innovation Labs and award-winning Be Yourself At Work culture and diverse talent.
Role Summary
As a Data Engineer (Intermediate/Senior), you will work closely with Data Architects, Business Analysts, BI developers, and client technology teams to design and implement reusable data ingestion and transformation pipelines in Data Lake/Lakehouse implementation programmeWhat You’ll Do
- Developing batch, CDC and/or streaming data ingestion pipelines from multiple source systems.
- Implementing Bronze, Silver and Gold data layers, including data cleansing, transformation and standardisation.
- Developing reusable data pipelines and supporting data product implementation.
- Implementing data quality, reconciliation, validation and monitoring controls.
- Supporting data migration, integration testing, UAT and production release.
- Working with the architecture team to ensure solutions follow agreed cloud, security, governance and engineering standards.
- Supporting knowledge transfer and BAU handover.
What We’re Looking For
- 4+ years of experience in data engineering or related roles.
- Strong experience in Databricks, Azure, SQL, Python/PySpark, ETL/ELT, Delta Lake, data modelling, data quality and CI/CD.
- Experience in financial services especially asset management or large-scale data transformation, would be advantageous.
- Experience in workong on an end-to-end enterprise data transformation, from source ingestion through to governed data products and business reporting.
Preferred:
- Experience in asset management company, fintech, or other regulated industries.
Why Join CAPCO
- Work on engaging projects with some of the largest banks/insurance in the world, on projects that will transform the financial services industry
- Work in a collaborative, flat, and entrepreneurial consulting culture