Coforge
Lead Data Engineer
- Compensation
- Not disclosed
- Location
- Dubai
- Work setup
- Not specified
- Seniority
- Lead
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Full description
Job Description :Key Responsibilities :
- Design, develop, and maintain scalable data pipelines and ETL/ELT solutions.
- Build Data Lake, Data Warehouse, BI, and Analytics platforms.
- Convert business requirements into robust technical solutions.
- Ensure data quality, security, governance, and performance optimization.
- Perform code reviews, troubleshooting, and production support.
- Collaborate with cross-functional teams on architecture and data engineering best practices.
- Maintain metadata, data lineage, and data governance standards.
Technical Skills :
- Cloud & Big Data : Azure, Cloudera, Hadoop, Spark, Scala, Hive, HBase, Kafka
- Data Engineering : Azure Data Factory (ADF), Databricks, Airflow, Apache NiFi, Oozie, Sqoop
- Storage & Processing : HDFS, ADLS Gen2, Snowflake, Streaming (Spark Streaming)
- Data Integration : SnapLogic, TIBCO
- Databases & BI : SQL, Power BI, MicroStrategy, Elasticsearch
- Version Control & DevOps : Git, Bitbucket, Azure DevOps
- File Formats : AVRO, PARQUET
Desired Profile :
- Strong hands-on experience in end-to-end Data Engineering.
- Familiarity with Data Lake, Data Warehouse, BI, and Analytics solutions.
- Exposure to Agile/Waterfall methodologies.
- Excellent problem-solving, communication, and stakeholder management skills.
- Team player with a strong learning mindset