Data Engineer
Data Engineer at Arbeit Infotech, an IT consulting firm serving telecom clients in Indonesia. Day to day: designing and maintaining scalable ETL/ELT pipelines into data lakes/warehouses using Python, SQL, Spark, Kafka and Airflow on AWS, plus query optimization, data governance, and partnering with BI and data science teams.
- Compensation
- Not disclosed
- Location
- Indonesia
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- 2+ years
- Category
- Data engineering
- Posted
Skills
Must have
- Bachelor's (S1) in Computer Science, Information Systems, or Informatics
- Minimum 2 years experience as Data Engineer
- Strong proficiency in Python and SQL
- Big Data & Architecture: Spark, Hadoop, Kafka, Data Lakehouse, Apache Iceberg
- Cloud & DevOps (AWS): S3, Redshift, Glue, EC2, EKS, Git (GitHub/GitLab), CI/CD (Jenkins)
- Orchestration & Modeling: Apache Airflow, Data Warehousing, Dimensional Modeling (Star/Snowflake schema)
- Governance & Compliance: Data Contracts, schema change management, privacy laws (GDPR, UU PDP)
- Design, build, and maintain scalable ETL/ELT pipelines integrating multi-source data into centralized data lakes/warehouses
- Partner with BI, Data Science, and Analyst teams to deliver clean, modeling-ready datasets
- Optimize query performance, manage cloud storage/compute costs, monitor pipelines, troubleshoot bottlenecks
- Implement data validation/cleansing, maintain technical docs (schemas, data dictionaries), enforce data security
- Adhere to SOPs, HSE standards, audit remediations, risk controls, and drive continuous process improvements
Full description
Requirements
- 1. Bachelor's (S1) in Computer Science, Information Systems, or Informatics
- 2. Minimum 2 years experience as Data Engineer
- 3. Strong proficiency in Python and SQL.
- 4. Big Data & Architecture → Spark, Hadoop, Kafka, Data Lakehouse, and Apache Iceberg.
- 5. Cloud & DevOps (AWS): S3, Redshift, Glue, EC2, EKS, Git (GitHub/GitLab), and CI/CD (Jenkins).
- 6. Orchestration & Modeling: Apache Airflow, Data Warehousing, Dimensional Modeling (Star/Snowflake schema).
- 7. Governance & Compliance: Data Contracts, Data Entropy (schema change management), and privacy laws (GDPR, UU PDP).
- 8. Design, build, and maintain scalable ETL/ELT pipelines integrating multi-source data into centralized data lakes/warehouses.
- 9. Partner with BI, Data Science, and Analyst teams to deliver clean, modeling-ready datasets.
- 10. Optimize query performance, manage cloud storage/compute costs, monitor pipelines, and troubleshoot bottlenecks.
- 11. Implement data validation/cleansing, maintain technical docs (schemas, data dictionaries), and enforce data security.
- 12. Adhere to SOPs, HSE standards, audit remediations, risk controls, and drive continuous process improvements
Information Technology Services 51-100 employees
Arbeit is an IT-driven, Innovation-obsessed Consulting Firm with years of unparalleled expertise at helping telcos and other telecom-connected enterprises achieve enviable success in their business.
Arbeit is an IT-driven, Innovation-obsessed Consulting Firm with years of unparalleled expertise at helping telcos and other telecom-connected enterprises achieve enviable success in their business.