Senior Python/PySpark Engineer for AWS Data Platform
Luxoft's Toronto team is hiring a senior data engineer to build AWS-based data pipelines and integrate the Analytical Work Bench, working in Jupyter Lab. Day to day involves designing scalable PySpark data flows, ensuring code quality with PyTest/Pylint, and wiring CI/CD via Jenkins and Urban Code.
- Compensation
- Not disclosed
- Location
- Toronto, Canada
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Senior-level data engineering experience
- Python
- PySpark
- AWS-based data pipelines
- Jupyter Lab IDE
- Collaborate with end users to gather requirements
- Standard testing practices for code quality
Nice to have
- PyTest
- Pylint
- Jenkins CI/CD tooling
- Urban Code CI/CD tooling
Full description
Luxoft in Toronto is seeking a senior data engineer to support the Analytical Work Bench integration, including AWS-based data pipelines and Jupyter Lab IDE work. You will design and implement scalable data flows, collaborate with end users to gather requirements, and ensure code quality with standard testing practices.
Join a team that leverages PySpark, PyTest, and Pylint, while integrating with CI/CD tooling such as Jenkins and Urban Code to deliver robust, maintainable solutions in a