Junior to Mid Data Engineer
Junior to mid-level data engineer on a PYGIO client project in Johannesburg, building and maintaining Snowflake ETL/ELT pipelines (Matillion) from sources like Oracle and SharePoint, writing Python and SQL, delivering dashboards and automated reports, and adding LLM-powered features such as AI agents and Document AI extraction.
- Compensation
- Not disclosed
- Location
- Johannesburg, South Africa
- Work setup
- Hybrid
- Seniority
- Middle
- Employment
- Full time
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Practical experience with Python and SQL
- ETL/ELT pipeline development and maintenance, ideally with Matillion or a comparable tool, ingesting from multiple sources (databases, SharePoint, files)
- Snowflake development and deployment: data models, transformations, warehouses and scheduled jobs
- Automated document data extraction (Document AI or similar), including validation of results
- Dashboard development and automated reporting
- Understanding of data quality, validation, and production deployment practices
- Good analytical and problem solving skills
- Ability to learn quickly, collaborate effectively, and take ownership of assigned tasks
- Good communication skills and ability to work with technical and non-technical stakeholders
Nice to have
- Entity resolution: matching records across sources, including rematching cycles when data changes
- LLM solution development: AI agents, MCP connectors (e.g. Google Drive and Snowflake), prompt engineering and function calling
- Building, deploying and maintaining Python web applications (FastAPI, React)
- Experience integrating AI capabilities into data products or workflows
- Exposure to data science or predictive analytics
Full description
Seniority: Junior to Mid - level Individual Contributor
Core Focus: Python, SQL, Snowflake, ETL/ELT, LLM Integration
Work Model: Hybrid / Remote
Location: Johannesburg, South Africa
Employment Type: Full Time
Company: PYGIO
About the Role
PYGIO is looking for a Junior–Mid Data Engineer to join a client project focused on developing and maintaining data pipelines using Snowflake.
This is a hands-on engineering role for someone with a solid foundation in Python, SQL, and data engineering who is ready to contribute to production data solutions and grow their technical expertise. The role also offers opportunities to work with LLM-powered capabilities and integrate AI functionality into data workflows.
You will collaborate with experienced engineers and business stakeholders to build reliable data pipelines, improve data quality, and support the delivery of scalable data solutions.
Key Responsibilities
- Develop and maintain ETL/ELT data pipelines using Snowflake.
- Write Python and SQL code for data transformation, automation, and validation.
- Build and manage data workflows using ETL and orchestration tools.
- Work with Snowflake warehouses, pipelines, and deployment processes.
- Support the deployment, monitoring, troubleshooting, and optimisation of data solutions.
- Implement data quality checks and validation processes.
- Translate business requirements into practical technical solutions.
- Contribute to LLM integration initiatives, including prompt engineering, tool use, and function calling.
- Build native web applications using Python (FastAPI) and/or React.
- Maintain technical documentation and follow established development practices.
Required Skills & ExperienceMust have:
- Practical experience with Python and SQL.
- Experience working with Snowflake or another cloud data platform, with a willingness to develop deeper Snowflake expertise.
- Understanding of ETL/ELT processes and data pipeline development.
- Familiarity with data workflow orchestration tools.
- Understanding of data quality, validation, and production deployment practices.
- Good analytical and problem-solving skills.