Senior Java Engineer (Data Engineering)
Senior Java engineer at a software consultancy delivering petabyte-scale data migration, retention, and privacy projects: building batch/streaming ETL pipelines, data-lineage and validation frameworks, and monitoring on Kubernetes and cloud platforms (AWS/GCP/Azure/Databricks), plus mentoring engineers. Hybrid, ~2 days/week in Cape Town.
- Compensation
- Not disclosed
- Location
- Cape Town, South Africa
- Work setup
- Hybrid
- Seniority
- Senior
- Employment
- Not specified
- Experience
- 8+ years
- Category
- Data engineering
- Posted
Skills
Must have
- 8+ years in software / data engineering, including several years of technical leadership
- Advanced Java with modern build systems (Gradle or Maven)
- Proven experience with large-scale data migration and ETL pipeline development
- Distributed storage (HDFS, S3 or GCS)
- A cloud data platform (AWS, GCP, Azure or Databricks)
- Hands-on Kubernetes for containerised data processing
- Degree in Computer Science, Engineering or equivalent experience
Nice to have
- Scala or Python for data processing, and Apache Spark / PySpark
- Hadoop ecosystem, Kafka or Kinesis streaming
- Modern data formats (Iceberg, Parquet, ORC, Avro)
- Observability tooling (Prometheus, Grafana)
- Data-privacy / compliance experience (e.g. GDPR)
Full description
We’re working with an established software consultancy that partners with everyone from startups to global brands, and they’re looking for a Senior Java Engineer with strong data-engineering expertise.
You’ll join an expert team delivering large-scale, production‑grade data projects — data retention, migration and privacy work at petabyte scale — combining hands‑on engineering with technical leadership.
What you’ll do
- Design and implement large‑scale data migration and transformation strategies across very large datasets
- Build data‑lineage, validation and testing frameworks that keep migrations accurate and data intact
- Develop scalable batch and streaming pipelines with parallel orchestration
- Implement monitoring and observability for pipeline performance and system health
- Provide technical leadership — mentoring engineers, running code reviews, leading design discussions and removing blockers
What you’ll bring
- 8+ years in software / data engineering, including several years of technical leadership
- Advanced Java with modern build systems (Gradle or Maven)
- Proven experience with large‑scale data migration and ETL pipeline development
- Distributed storage (HDFS, S3 or GCS) and a cloud data platform (AWS, GCP, Azure or Databricks)
- Hands‑on Kubernetes for containerised data processing
- A degree in Computer Science, Engineering or equivalent experience
Advantageous
- Scala or Python for data processing, and Apache Spark / PySpark
- Hadoop ecosystem, Kafka or Kinesis streaming, and modern data formats (Iceberg, Parquet, ORC, Avro)
- Observability tooling (Prometheus, Grafana), and data‑privacy / compliance experience (e.g. GDPR)
Working model
Hybrid in Cape Town — around two days a week in the office.