George Bernard Consulting
Python Developer (Lead)
Lead-level data engineering role: build and maintain scalable data pipelines with Python and PySpark, design and optimize MS SQL databases, and deploy solutions on Azure and Databricks. Includes data transformation, performance tuning, troubleshooting, and mentoring junior developers.
- Compensation
- Not disclosed
- Location
- Colombo, Sri Lanka
- Work setup
- Not specified
- Seniority
- Lead
- Employment
- Not specified
- Experience
- 4+ years
- Category
- Software engineering
- Posted
Skills
Must have
- Minimum 5+ years of total IT experience
- 4+ years hands-on experience with Python (Advanced / Hardcore development)
- 4+ years hands-on experience with PySpark
- 4+ years hands-on experience with MS SQL (queries, stored procedures, optimization)
- 4+ years hands-on experience with Azure cloud
- 4+ years hands-on experience with Databricks
- Strong understanding of relational databases and data engineering concepts
- Experience building end-to-end data pipelines and working with large datasets
- Ability to write clean, efficient, and scalable code
Full description
Job Description
- Develop and maintain scalable data pipelines using Python and PySpark.
- Work extensively with MS SQL to design, optimize, and manage database structures and queries.
- Build and deploy solutions in Azure and Databricks environments.
- Perform data transformations, cleaning, validation, and performance tuning.
- Collaborate with Data Engineers, Cloud Architects, and Business Teams to deliver data solutions.
- Ensure code quality through best practices, reviews, testing, and documentation.
- Troubleshoot complex data issues and optimize workflows for performance and reliability.
- Assist in guiding or mentoring junior developers when required
Requirements
- Minimum 5+ years of total IT experience.
- Minimum
4+ years of hands-on experience Python (Advanced / Hardcore
development), PySpark, MS SQL (queries, stored procedures,
optimization), Azure cloud, Databricks
- Strong understanding of relational databases and data engineering concepts.
- Experience building end-to-end data pipelines and working with large datasets.
- Ability to write clean, efficient, and scalable code.