Ignitho
Azure Data Engineer
- Compensation
- Not disclosed
- Location
- Chennai
- Work setup
- Hybrid
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- 7+ years
- Category
- Data engineering
- Posted
Skills
Must have
- 7+ years of experience in data engineering, with strong hands-on experience in Azure data services.
- Strong expertise in Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, and Azure Synapse Analytics.
- Proficiency in SQL, Python/PySpark, Spark performance tuning, and Delta Lake.
- Experience with Lakehouse, Medallion architecture, and data modeling.
- Knowledge of data governance, security, metadata management, and Azure DevOps CI/CD.
- Working knowledge of Microsoft Fabric is preferred.
- Strong problem-solving, communication, and collaboration skills.
Nice to have
- Microsoft Azure Data Engineer Associate or equivalent certification.
- Experience with large-scale data migrations and enterprise data platforms.
- Exposure to Life Sciences or Pharma domain and Veeva CTMS is an advantage.
- Familiarity with AI/ML data pipelines and modern cloud data architectures.
Full description
Job Description: Senior Azure Data Engineer
Role Summary
We are looking for a Senior Azure Data Engineer with strong hands-on experience in building, optimizing, and maintaining scalable data pipelines and cloud-based data platforms using Microsoft Azure. The ideal candidate should have expertise in data engineering, Lakehouse architecture, and working with distributed teams to deliver high-quality data solutions.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory and Synapse Pipelines.
- Build and optimize data processing solutions using Azure Databricks, PySpark, SQL, and Delta Lake.
- Work with Azure Data Lake Storage Gen2, Azure Synapse Analytics, and Microsoft Fabric.
- Implement Lakehouse and Medallion architectures for batch and real-time data processing.
- Ensure data quality, governance, security, and compliance across data platforms.
- Optimize pipeline performance, troubleshoot issues, and manage data integration workflows.
- Implement CI/CD pipelines using Azure DevOps and Infrastructure as Code.
- Collaborate with architects, business stakeholders, and distributed engineering teams.
Required Skills & Experience
- 7+ years of experience in data engineering, with strong hands-on experience in Azure data services.
- Strong expertise in Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, and Azure Synapse Analytics.
- Proficiency in SQL, Python/PySpark, Spark performance tuning, and Delta Lake.
- Experience with Lakehouse, Medallion architecture, and data modeling.
- Knowledge of data governance, security, metadata management, and Azure DevOps CI/CD.
- Working knowledge of Microsoft Fabric is preferred.
- Strong problem-solving, communication, and collaboration skills.
Preferred Qualifications
- Microsoft Azure Data Engineer Associate or equivalent certification.
- Experience with large-scale data migrations and enterprise data platforms.
- Exposure to Life Sciences or Pharma domain and Veeva CTMS is an advantage.
- Familiarity with AI/ML data pipelines and modern cloud data architectures.