Magellanic Cloud - Data Engineer

Job Summary :

We are looking for an experienced Data Engineer with a strong background in SQL and Python, and hands-on experience with at least one BI Tool. You will be responsible for designing and building scalable data pipelines, transforming complex datasets, and supporting analytics and reporting needs across the organization.

Key Responsibilities :

• Design, develop, and maintain robust ETL/ELT pipelines using SQL and Python.

• Optimize and troubleshoot complex SQL queries to ensure high performance and scalability.

• Build and maintain data models and data marts to support business analytics and decision-making.

• Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver effective data solutions.

• Ensure data quality, integrity, and governance across all data sources and pipelines.

• Automate data workflows and assist in deployment of analytics products.

• Develop and publish dashboards and reports using BI tools such as Power BI, Tableau, or Looker.

• Maintain documentation related to data architecture, pipeline workflows, and schemas.

• Proven experience in technical leadership, including leading data engineering/analytics teams, mentoring junior team members, conducting code reviews, and driving best practices.

• Experience collaborating with business stakeholders, product teams, and leadership to translate business requirements into scalable data solutions.

• Strong project ownership with experience managing deliverables, prioritizing work, and coordinating cross-functional teams.

Required Skills and Qualifications :

• 5+ years of professional experience in data engineering or a related field.

• Strong proficiency in SQL, including performance tuning and writing complex queries.

• Advanced Python skills, especially for data manipulation (e.g., Pandas, PySpark, or similar).

• Experience with data warehousing concepts and technologies (e.g., Snowflake, Redshift, BigQuery, etc.).

• Working knowledge of a BI tool such as Power BI, Tableau, or Looker.

• Solid understanding of data modeling, data lakes, and data pipelines.

• Familiarity with version control (e.g., Git) and CI/CD practices.

• Strong problem-solving skills and the ability to work independently or within a team.

• Proven experience in technical leadership, including leading data engineering/analytics teams, mentoring junior team members, conducting code reviews, and driving best practices.