Big Data Engineer - Data Platform, Global E-Commerce
This Big Data Engineer on TikTok's Data Platform team in Singapore builds and maintains batch and real-time data warehouses, ETL pipelines, and data products/metrics for the global e-commerce business. Core work involves data modeling, ETL optimization, and distributed computing with tools like Hive, Spark, and Flink.
- Compensation
- Not disclosed
- Location
- Singapore, Singapore
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- 2+ years
- Category
- Data engineering
- Posted
Skills
Must have
- At least 3 years of experience in software engineering and 2 years of relevant experience in data engineering
- Proficient in creating and maintaining complex ETL pipelines end-to-end while maintaining high reliability and security
- Familiar with data warehouse concepts and have production experience in modeling design
- Familiar with at least 1 distributed computing engine (e.g. Hive, Spark, Flink)
Nice to have
- Familiar with at least 1 NoSQL database (e.g. HBase)
- Excellent interpersonal and communication skills with the ability to engage and manage internal and external stakeholders across all levels of seniority
- Strong collaboration skills with the ability to build rapport across teams and stakeholders
Full description
Responsibilities
The mission of the Data Platform Singapore Business Partnering (DPSG BP) team is to empower the business with data. Our goal is to build a Data Warehouse that can cater to batch and streaming data, Data Products that provide useful information to build efficient data metrics & dashboards which will be used to make smarter business decisions to support business growth. If you're looking for a challenging ground to push your limits, this is the team for you!
- Translate business requirements & end to end designs into technical implementations and responsible for building batch and real-time data warehouse.
- Manage data modeling design, writing, and optimizing ETL jobs.
- Collaborate with the business team to build data metrics based on data warehouse.
- Responsible for building and maintaining data products.
- Involvement in rollouts, upgrades, implementation, and release of data system changes as required for streamlining of internal practices.
- Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software.
- Apply data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets.
- Visualise, interpret, and report data findings and may create dynamic data reports as well.
Qualifications
Minimum Qualification(s):
- At least 3 years of experience in software engineering and 2 years of relevant experience in data engineering.
- Proficient in creating and maintaining complex ETL pipelines end-to-end while maintaining high reliability and security.
- Familiar with data warehouse concepts and have production experience in modeling design.
- Familiar with at least 1 distributed computing engine (e.g. Hive, Spark, Flink).
Preferred Qualification(s):
- Familiar with at least 1 NoSQL database is a plus (e.g. HBase).
- Excellent interpersonal and communication skills with the ability to engage and manage internal and external stakeholders across all levels of seniority.
- Strong collaboration skills with the ability to build rapport across teams and stakeholders.
About TikTok
TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.
Why Join Us
Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.