Data QA Engineer: Databricks Data Quality & Automation
A Data QA Engineer in Manila who validates data quality across Bronze/Silver/Gold Delta Lake layers, testing SQL, PySpark, and Python pipelines in Databricks notebooks and workflows. The role involves building and automating test plans and contributing to data governance within an Agile team.
- Compensation
- Not disclosed
- Location
- Manila, Philippines
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- Not specified
- Category
- Qa
- Posted
Skills
Must have
- Test and validate SQL, PySpark, and Python data pipelines
- Validate data quality across Bronze/Silver/Gold Delta Lake layers
- Work with Databricks notebooks and workflows
- Build test plans and automate tests
- Contribute to the data governance and validation framework
- Collaborate with data architects, BI developers, and analysts
- Work in an Agile environment
Full description
Axos Business Center, Corp in Manila is seeking a Data QA Engineer to validate data quality across the Bronze/Silver/Gold Delta Lake layers. You will test SQL, PySpark, and Python pipelines, and contribute to the data governance and validation framework. Collaboration with data architects, BI developers, and analysts is required.
Responsibilities include building test plans, automating tests, and ensuring accuracy in Databricks notebooks and workflows while working in an Agile environment.