Lead Data Engineer
Leads a team of data engineers building and operating HKT's Enterprise Data Platform: designing cloud data warehouses/lakes, ETL/ELT pipelines, and data governance to deliver analytics and BI. Requires ~10 years in data engineering on cloud platforms (AWS, Azure, GCP, Snowflake, Databricks) plus team-leadership experience.
- Compensation
- Not disclosed
- Location
- Hong Kong, Hong Kong
- Work setup
- Not specified
- Seniority
- Lead
- Employment
- Not specified
- Experience
- 10+ years
- Category
- Data engineering
- Posted
Skills
Must have
- Bachelor's or Master's degree in Computer Science, Data Engineering, IT, or related quantitative field
- Advanced proficiency in SQL
- Proficiency in Python, Scala, Java, or R
- Experience building and operating enterprise-scale Data Warehouses and Data Lakes on cloud (AWS, Azure, GCP, Snowflake, Databricks)
- Proven expertise in conceptual, logical, and physical data modeling
- Experience with orchestration tools for distributed data processing
- At least 10 years of experience in Data Engineering and Data Platforms
- Track record leading engineering teams, managing resource allocation, and meeting delivery timelines with Agile/Scrum
- Strong business acumen connecting data capabilities with corporate strategic goals
- Exceptional analytical and problem-solving skills for integration and scaling challenges
- Strong written and verbal communication for cross-departmental alignment
Nice to have
- Ability to establish data governance: metadata management, data lineage, quality, privacy, and security
Full description
The Lead Data Engineer plays a pivotal role in driving the organization’s data strategy by overseeing the architecture, development, and operational excellence of our Enterprise Data Platform. This leadership role is responsible for directing a team of high-performing engineers to build scalable, high-throughput data processing systems that turn vast, diverse datasets into secure, actionable business intelligence. The ideal candidate blends deep technical expertise in modern cloud data architectures with strategic leadership and stakeholder management skills.
Key Responsibilities
Strategic Leadership & Governance
- Team Management: Lead, mentor, and foster a team of data engineers, driving high technical standards, professional growth, and alignment on delivery goals.
- Data Architecture & Governance: Establish and oversee data governance framework standards—including metadata management, data lineage, quality assurance, privacy, and end-to-end security protocols to safeguard sensitive information.
- Business Alignment & ROI: Identify innovative opportunities to leverage data technologies that drive operational efficiency, optimize costs, and support revenue-generating business initiatives.
Data Platform Architecture & Engineering
- Pipeline Infrastructure: Architect, construct, and optimize enterprise-grade ETL/ELT pipelines to ingestion, transform, and store high-volume structured and unstructured data streams.
- Storage & Modeling: Design, evaluate, and maintain scalable data lake and cloud data warehouse environments using robust data modeling principles optimized for analytics and reporting.
- Quality & Reliability: Establish continuous integration, automated testing, and comprehensive validation protocols to guarantee high data availability, accuracy, and integrity across all consumption points.
Stakeholder Collaboration & Operations
- Cross-Functional Partnership: Collaborate directly with Business Units (BUs), System Integration (SI/LPS) partners, IT teams, Data Scientists, and Analysts to translate complex business needs into scalable technical specifications.
- Performance Tuning & Monitoring: Monitor infrastructure health, identify and resolve architectural bottlenecks, and implement proactive system optimizations for maximum reliability and uptime.
- Technology Roadmap: Stay ahead of industry trends across big data processing, cloud architectures, and distributed computing to continually refine and modernize the organization’s tech stack.