Senior Data Engineer

Purpose

The Senior Data Engineer will lead the design, development, and maintenance of scalable data products and pipelines across multiple cloud platforms, including AWS, Microsoft Azure, and Google Cloud Platform (GCP). This role is critical in driving data-driven decision-making by building robust, efficient, and secure data infrastructure in multi-cloud environments. The Senior Data Engineer will oversee a team of up to three Data Engineers, providing technical guidance and ensuring high-quality delivery of data solutions that support business objectives.

Accountabilities

• Design, build, and optimize data pipelines and architectures on cloud platforms to support data products, ensuring scalability, reliability, and performance.
• Lead a team of up to three Data Engineers, providing mentorship, technical direction, and performance feedback.
• Collaborate with cross-functional teams (e.g., Data Scientists, Product Managers, and Software Engineers) to understand requirements and deliver data products that align with business goals.
• Implement best practices for data governance, security, and compliance within cloud environments.
• Monitor and maintain data infrastructure, ensuring high availability, data quality, and efficient processing.
• Drive the adoption of modern data engineering tools and methodologies, including ETL/ELT processes, data modeling, and orchestration.
• Troubleshoot and resolve complex data pipeline issues, ensuring minimal downtime and optimal performance.
• Contributes to the evaluation and integration of new cloud services and third-party tools to enhance data capabilities.

Education

• Bachelor’s degree in computer science, Data Engineering, Information Technology, or a related field.
• A master’s degree is considered an asset.

Experience

• 6+ years of experience in data engineering, with at least 3 years focused on building data solutions across cloud platforms, including Microsoft Azure, AWS, and Google Cloud Platform (GCP). Specific hands‑on experience with Microsoft Azure and Databricks is highly desirable.
• Proven expertise in designing and implementing data pipelines using GCP tools such as BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Composer.
• 2+ years of experience leading or mentoring a team of engineers, with a track record of successful project delivery.
• Strong proficiency in programming languages such as Python, Java, or Scala, and SQL for data processing.
• Hands‑on experience with data modeling, schema design, and data warehousing concepts.
• Familiarity with CI/CD pipelines, version control (e.g., Git), and Infrastructure as Code (e.g., Terraform) is preferred.
• Excellent problem‑solving skills and the ability to communicate complex technical concepts to non‑technical stakeholders.