Lead Data Engineer

EXL is seeking a Senior Data Engineer to join our Data & Analytics practice and support strategic client engagements. This role will be responsible for designing, building, and managing scalable cloud-based data platforms, driving modern data engineering practices, and leading teams delivering high-impact data solutions. The ideal candidate will combine strong technical expertise with consulting and leadership capabilities, partnering closely with client stakeholders to translate business requirements into scalable data architectures and engineering solutions.

Data Engineering & Platform Development

• Design, develop, and maintain scalable data pipelines and data products supporting analytics, reporting, AI, and operational use cases.

• Build and optimize ETL/ELT frameworks for large-scale data ingestion, transformation, validation, and consumption.

• Develop and manage cloud-native data platforms leveraging Snowflake, AWS, Apache Airflow and modern data architectures.

• Create scalable data models, data marts, semantic layers, and curated datasets that support enterprise analytics initiatives.

• Optimize SQL workloads, transformation logic, and query performance to improve scalability and cost efficiency.

• Establish reusable engineering frameworks, accelerators, and best practices to improve delivery consistency across projects.

• Ensure high standards of data quality, reliability, governance, and observability throughout the data lifecycle.

• Develop and maintain Snowflake-based data ecosystems, leveraging advanced features for performance optimization and data sharing.

• Build and orchestrate data workflows using Airflow and other workflow scheduling platforms.

• Collaborate directly with client stakeholders to gather requirements, define roadmaps, and develop scalable technical solutions.

• Present solution designs, technical recommendations, and project updates to both technical and business audiences.

• Prepare and maintain comprehensive project documentation, technical specifications, architecture diagrams, and operational runbooks.

Required Qualifications

• 4+ years of experience in Data Engineering, Big Data Engineering, or Cloud Data Platform development.

• Bachelor's or Master's degree in Computer Science, Engineering, Analytics, Mathematics, Information Systems, or related disciplines.

• Strong hands-on expertise in SQL, Python, and PySpark.

• Extensive experience working with Snowflake, Databricks, or similar cloud-native data platforms.

• Proven experience building and supporting large-scale ETL/ELT data pipelines.