Senior Data Engineer
Senior Data Engineer at Bybit (a major crypto exchange) in Abu Dhabi, building structured data delivery for Compliance and Trading teams, analytics dashboards, data governance, AI-powered data agents, and real-time data collection/scraping systems using Python, SQL, Spark/Hadoop, and OLAP engines.
- Compensation
- Not disclosed
- Location
- Kuala Lumpur, Malaysia
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Full time
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Strong Python skills for data analysis and modeling (Pandas, NumPy, Scikit-learn, Matplotlib, PyTorch, TensorFlow)
- Proficient with big data frameworks (Spark, Hadoop) and large-scale data processing
- Familiar with one or more OLAP engines such as Presto / Doris / StarRocks / ClickHouse
- Strong SQL skills, capable of complex queries and data modeling independently
- Experienced with AI coding tools (e.g., Codex, Claude Code, Kilo Code) and integrating AI into daily workflows
- Familiar with Git and standard version control practices
- Working knowledge of Java and mainstream frameworks (e.g., Spring / Spring Boot)
- Working knowledge of container-based deployment (Docker / Kubernetes)
Nice to have
- GitHub open-source contributions (any domain)
- Experience building autonomous agents — LLM-based automation, conversational systems, MCP Servers
- Practical experience in machine learning, deep learning, time-series modeling, anomaly detection
Full description
About Us
Established in 2018, Bybit is one of the world’s leading cryptocurrency exchanges and digital financial platforms, serving over 80 million users across more than 200 countries and regions. Powered by world-class technology and a user-first mindset, Bybit delivers a seamless ecosystem across trading, payments, wealth management, custody, institutional services, and Web3 — connecting users to the future of digital finance.
Our core values define how we build. We listen, care and improve to create products and experiences that put users first. Backed by a global team of ambitious builders, problem-solvers, and innovators, we foster a high-performance and fast-moving environment where talent is empowered to drive real impact at the global scale. Supported by 24/7 multilingual customer service and a strong commitment to innovation, we are shaping the future of finance through technology, collaboration, and bold execution.
Today, Bybit is recognized as one of the most trusted and transparent platforms in the digital asset industry, continuing to expand its global presence while building the infrastructure for the next generation of financial services.
Responsibilities
-
Routine Data Support: Leverage big data technologies to build a structured data delivery system for Compliance, Trading, and other business teams; ensure timely, accurate, and traceable data outputs, and maintain the team's existing data development workflows.
-
Analytics System Development: Develop analytical systems and monitoring dashboards for business teams; produce data reports to support performance attribution and data-driven operational oversight.
-
Data Asset Governance: Author application-layer data warehouse documentation, establish field-level data standards, and lead company-wide data asset management.
-
Data Agent Development: Build data agents (e.g., MCP Skills) to automate data retrieval and analysis workflows, improving team productivity.
-
Data Sourcing & Procurement: Build efficient, real-time data collection systems to scrape or procure the data resources the team needs — including but not limited to web scraping, procured API ingestion, and management of various procured accounts.
Requirements
-
Strong Python skills for data analysis and modeling (Pandas, NumPy, Scikit-learn, Matplotlib, PyTorch, TensorFlow); solid coding fundamentals.
-
Proficient with big data frameworks (Spark, Hadoop) and large-scale data processing; familiar with one or more OLAP engines such as Presto / Doris / StarRocks / ClickHouse.