Fabric Analytics Platform Engineer For Data Lakes-Hybrid
Hybrid data platform engineer at a risk management firm, building and supporting data lakes and analytics on AWS (EMR, S3, Redshift, Glue, Airflow). Day to day: ETL with SSIS, work across Netezza/SQL Server/PostgreSQL/Teradata, Hadoop-to-AWS migrations, query tuning, Linux, and production data platform support.
- Compensation
- Not disclosed
- Location
- North York, Canada
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- Not specified
- Category
- Devops
- Posted
Skills
Must have
- 10+ years of experience in Data Engineering / Big Data / Platform
- Strong experience in AWS Cloud services: EMR, EC2, S3, VPC, RDS, Redshift
- Experience with AWS Glue, IAM, CloudWatch, CloudFormation
- Experience with Airflow (or AWS Managed Workflows)
- Netezza experience (mandatory)
- Experience with SQL-based systems: SQL Server and PostgreSQL
- Experience with data warehouses: Teradata, Redshift, Netezza
- Hands-on experience with SSIS and ETL tools
- Strong proficiency in SQL
- Strong proficiency in shell scripting
- Strong experience in Unix/Linux environments
- Hands-on experience in AWS and Hadoop ecosystems
- Experience in data migration projects (e.g., Hadoop to AWS, DB migrations)
- Strong understanding of data warehousing concepts and ETL design patterns
- Expertise in query optimization and performance tuning
- Experience supporting production data platforms
- Bachelor's degree in Computer Science, Engineering, or related field
Nice to have
- Python
- Experience in Banking / Financial Services domain
- Experience with data lake architecture and governance
- Knowledge of DevOps tools and CI/CD pipelines
- Experience in platform engineering and framework development
Full description
Strong experience in AWS Cloud services:
EMR, EC2, S3, VPC, RDS, Redshift
AWS Glue, IAM, CloudWatch, CloudFormation Airflow (or AWS Managed Workflows) Databases
Experience working with: Netezza is mandatory
SQL-based systems: SQL Server and PostgreSQL Data warehouses: Teradata, Redshift, Netezza ETL Tools
Hands-on experience with: SSIS
Programming & Scripting
Strong proficiency in: SQL
Shell scripting
Good to have:
Python
Operating Systems
Strong experience in Unix/Linux environments
Key Qualifications 10+ years of experience in Data Engineering / Big Data / Platform
Hands-on experience in AWS and Hadoop ecosystems Experience in data migration projects (e.G., Hadoop to AWS, DB migrations) Strong understanding of data warehousing concepts and ETL design patterns Expertise in query optimization and performance tuning Experience supporting production data platforms Bachelor’s degree in Computer Science, Engineering, or related field
Preferred Qualifications Experience in Banking / Financial Services domain Experience with data lake architecture and governance Knowledge of DevOps tools and CI/CD pipelines Experience in platform engineering and framework development.