India Health Link Pvt Ltd
SENIOR DATA ENGINEER-AZURE AND SNOWFLAKE IMMEDIATE JOINERS
- Compensation
- Not disclosed
- Location
- Bangalore, KA, India
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- 6+ years
- Category
- Data engineering
- Posted
Skills
Nice to have
- DBT (Data Build Tool)
- Apache Spark / PySpark
- Airflow
- Terraform or Infrastructure as Code
- Data governance and metadata management
- API integration and real-time data ingestion
- Monitoring and observability frameworks
Full description
Job Summary
We are looking for a highly skilled Senior Data Engineer with 6 to 9 years of hands-on experience in SQL, Python for data engineering, Azure data engineering services, and Snowflake analytical layer development. The ideal candidate should have strong expertise in designing, developing, optimizing, and maintaining enterprise-grade data pipelines, scalable data warehouses, data marts, and analytical models.
The candidate should be capable of leading technical implementations, mentoring junior engineers, collaborating with architects and business stakeholders, and driving best practices across data engineering initiatives. Experience with DBT, CI/CD, DevOps practices, and performance optimization is highly preferred.
Key Responsibilities
Core Duties
- Understand business requirements, architecture documents, and translate them into scalable technical solutions.
- Lead end-to-end development of Azure Data Factory (ADF) pipelines and enterprise data workflows.
- Design and develop scalable ELT/ETL frameworks using Azure services and Snowflake.
- Build and optimize analytical layers, dimensional models, data marts, and semantic data structures in Snowflake.
- Create reusable, maintainable, and performance-optimized SQL and Python-based data transformation frameworks.
- Drive data quality, validation, reconciliation, and governance processes across data platforms.
- Conduct detailed code reviews, design reviews, and ensure engineering best practices are followed.
- Troubleshoot complex production issues, optimize pipeline performance, and reduce data processing latency.
- Participate actively in solution architecture discussions and provide technical recommendations.
- Lead technical demos, walkthroughs, sprint reviews, and stakeholder presentations.
- Mentor junior and mid-level engineers and guide them in technical problem-solving.
- Contribute to framework development, automation initiatives, and process standardization.
- Support release management, CI/CD deployment processes, and environment migrations.
- Collaborate with cross-functional teams including business analysts, architects, QA teams, DevOps, and product owners.
Technical Skills or Knowledge Areas
Mandatory Skills
- Advanced SQL (complex joins, CTEs, window functions, query optimization, stored procedures)
- Python for data engineering and automation
- Azure Data Engineering Services:
- Azure Data Factory (ADF)
- Azure Data Bricks
- Azure Data Lake
- Azure Functions
- Azure Synapse Analytics
- Logic Apps
- Key Vault
- Snowflake Data Warehouse Development