Data Engineer
Onsite Data Engineer in Abu Dhabi building and maintaining scalable ETL/ELT pipelines, data warehouses/lakes, and real-time batch infrastructure that power analytics and AI/ML products. Core stack: Python, SQL, Airflow/Spark, cloud data warehouses (Snowflake/BigQuery/Redshift), AWS/Azure/GCP, Docker/Kubernetes.
- Compensation
- Not disclosed
- Location
- Abu Dhabi, United Arab Emirates
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Full time
- Experience
- 4+ years
- Category
- Data engineering
- Posted
Skills
Must have
- Bachelor's degree in Computer Science, Software Engineering, Information Systems, or related field
- 4+ years of experience in Data Engineering or Backend/Data Platform development
- Strong proficiency in Python and SQL
- Experience building ETL/ELT pipelines using orchestration tools such as Airflow, Prefect, or Dagster
- Strong knowledge of relational and NoSQL databases including PostgreSQL, MySQL, MongoDB, or Cassandra
- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform
- Hands-on experience with cloud data warehouses such as Snowflake, BigQuery, Amazon Redshift, or Azure Synapse
- Experience with distributed data processing frameworks such as Apache Spark
- Familiarity with message streaming technologies such as Kafka or RabbitMQ
- Experience with Docker, Kubernetes, and CI/CD pipelines
- Strong understanding of data modeling, partitioning, indexing, and performance optimization
- Experience working with Git and collaborative software development workflows
Nice to have
- Experience building data platforms supporting AI or Machine Learning workloads
- Knowledge of Delta Lake, Apache Iceberg, or Apache Hudi
- Experience with dbt for analytics engineering
- Familiarity with Terraform or Infrastructure as Code
- Understanding of data governance, metadata management, and data cataloging
- Experience working in high-growth technology or AI companies
- Experience supporting Generative AI or LLM applications
- Experience with vector databases such as Pinecone, Weaviate, or Milvus
- Familiarity with data observability platforms such as Monte Carlo or Great Expectations
- Experience with event-driven architectures and real-time analytics
- Exposure to MLOps platforms and feature stores
Full description
Data Engineer
Location: Onsite - AbuDhabi UAE
Employment Type: Full-Time
Department: Engineering / Data & AI
About the Role
We are looking for a skilled Data Engineer to build, optimize, and maintain scalable data infrastructure that powers analytics, AI, and machine learning products. You will be responsible for designing robust data pipelines, integrating data from multiple sources, ensuring data quality, and enabling data accessibility across the organization.
This role is ideal for someone who enjoys solving complex data challenges, building modern data platforms, and working closely with software engineers, data scientists, and product teams to transform raw data into business value.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines for structured and unstructured data.
- Build and manage modern data warehouses and data lakes.
- Develop reliable batch and real-time data processing pipelines.
- Integrate data from APIs, databases, third-party platforms, and cloud services.
- Ensure high standards of data quality, integrity, security, and governance.
- Optimize data models and database performance for analytics and reporting.
- Monitor, troubleshoot, and improve data pipeline reliability and performance.
- Collaborate with Data Scientists, ML Engineers, Product Managers, and Software Engineers to deliver data solutions.
- Implement CI/CD practices and infrastructure automation for data workflows.
- Document data architecture, pipeline designs, and engineering best practices.
- Stay current with emerging technologies in cloud data engineering and big data ecosystems.
Requirements
- Bachelor's degree in Computer Science, Software Engineering, Information Systems, or a related field.
- 4+ years of experience in Data Engineering or Backend/Data Platform development.
- Strong proficiency in Python and SQL.
- Experience building ETL/ELT pipelines using modern orchestration tools such as Airflow, Prefect, or Dagster.
- Strong knowledge of relational and NoSQL databases including PostgreSQL, MySQL, MongoDB, or Cassandra.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Hands-on experience with cloud data warehouses such as Snowflake, BigQuery, Amazon Redshift, or Azure Synapse.