Data engineer
Data engineer in Cape Town building and maintaining real-time and batch data pipelines, SQL processing, and streaming (Kafka/RabbitMQ) to power financial analytics, reporting, and payments for an online gaming company; needs 2-4 years' experience with SQL and Python or Java.
- Compensation
- Not disclosed
- Location
- Cape Town, South Africa
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- 4+ years
- Category
- Data engineering
- Posted
Skills
Must have
- Bachelor's degree in Computer Science, Data Engineering, Information Systems, or related field
- 2-4 years of experience in data engineering or related roles
- Strong SQL skills, including querying and optimizing database operations
- Experience developing data pipelines for real-time and batch processing
- Hands-on experience with data streaming platforms such as Kafka or RabbitMQ
- Familiarity with ETL processes and tools
- Proficiency in a programming language such as Python or Java for data tasks
- Knowledge of data modelling basics for relational databases
- Attention to detail and commitment to data accuracy and reliability
- Problem-solving skills and ability to troubleshoot data systems
Nice to have
- Relevant certifications (AWS Certified Data Analytics Specialty, Azure Data Engineer, Databricks Certified Data Engineer)
- Familiarity with cloud platforms (AWS, Azure, Google Cloud) and cloud-based data services
- Exposure to big data technologies such as Spark or Hadoop
- Exposure to Apache Spark, Airflow, Kafka
- Knowledge of data governance and compliance standards
- Experience with data formats like JSON or Parquet
- Writing clean, modular code for data processing, automation, and API/cloud integration
- Basic understanding of containerization tools such as Docker
- Interest in learning and adopting emerging data technologies
Full description
Who we are We are part of Super Group, the NYSE-listed digital gaming company behind some of the world’s leading Sports and i Gaming brands. At Digi Outsource, we bring passionate people and innovative tech together to create market-leading online gaming solutions. Our multidisciplinary teams are passionate about products, customer experience and security. We’re empowered to achieve the ultimate in high-performance gaming experiences using the best technology available.
Who we’re looking for We’re on a thrilling journey of growth and innovation, and we need passionate, driven individuals to join us. At Digi Outsource, every day is action-packed, and we expect you to bring your A-game. In return, you’ll find a supportive environment where your skills can flourish, and your career can soar.
Why we need you As a Data Engineer within our Fintech ecosystem, you’ll focus on building and maintaining the data pipelines and processes that power our financial analytics, reporting, and decision‑making. You’ll work with data from diverse systems—ranging from transactional platforms to customer engagement tools—ensuring it is reliable, accessible, and optimized for high-impact use. This role is essential to support our transition to modern data practices, including cloud‑native architectures and real‑time processing, while maintaining the continuity and stability of our on‑premises operations. Your work will directly enable smarter, faster financial services and help shape the future of data in Payments.
What you’ll be doing Developing and maintaining data pipelines to support real‑time and batch processing. Writing and optimizing SQL queries, stored procedures, and scripts for data processing. Supporting ETL/ELT workflows for data integration and transformation. Collaborating with team members to integrate data from various sources into centralized systems. Implementing and managing data streaming solutions using platforms like Kafka or Rabbit MQ. Ensuring data quality and reliability across all pipelines and processes. Monitoring and troubleshooting data pipelines to ensure performance and reliability. Documenting data workflows and providing support for data‑related issues. Essential skills you’ll bring to the table Bachelor’s degree in computer science, Data Engineering, Information Systems, or a related field. 2‑4 years of experience in data engineering or related roles. Strong SQL skills, including querying and optimizing database operations. Experience developing data pipelines for real‑time and batch processing. Hands‑on experience with data streaming platforms such as Kafka or Rabbit MQ. Familiarity with ETL processes and tools. Proficiency in a programming language such as Python or Java for data tasks. Knowledge of data modelling basics for relational databases. Attention to detail and a commitment to ensuring data accuracy and reliability. Problem‑solving skills and the ability to troubleshoot issues in data systems. Desirable skills you’ve got up your sleeve Relevant certifications (e.g., AWS Certified Data Analytics Specialty, Microsoft Certified: Azure Data Engineer, or Databricks Certified Data Engineer). Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and cloud‑based data services. Exposure to big data technologies such as Spark or Hadoop. Exposure to Apache Spark, Airflow, Kafka. Knowledge of data governance and compliance standards. Experience with data formats like JSON or Parquet. Writing clean, modular code for data processing, automation, and integration with APIs or cloud services. Basic understanding of containerization tools such as Docker. Interest in learning and adopting emerging data technologies. Our values are non‑negotiables Adaptability Ownership and accountability Initiating action Resilience Team orientation Integrity Innovation What you’ll get back Free Massages On-site Free On‑Site Gym Group Life Cover Funeral Fund Benefit Financial Services Assistance Employee Assistance Programme Curro School Fees Benefit Income Continuation Benefit Leadership Training Referral Bonus Medical Aid Subsidy Free Sleep Coaching On‑site Barista Retirement Annuity Subsidy Team buildings Shortlisted candidates may need to complete an assessment.