Azure Data Engineer - Python

Role Overview:

We are seeking a seasoned Azure Data Engineer to join our high-performing data team in Hyderabad. In this role, you will architect, build, and maintain scalable data pipelines that serve as the backbone for our analytical and operational platforms. You will collaborate closely with cross-functional teams, including data scientists, product managers, and business stakeholders, to transform complex raw data into actionable insights. Your work will directly influence strategic business outcomes by ensuring high data availability, integrity, and performance, ultimately empowering our organization to make data-driven decisions at scale.

Key Responsibilities:

• Design and implement robust ETL/ELT workflows using Azure Data Factory to streamline data ingestion from diverse sources, ensuring seamless integration across the enterprise ecosystem.

• Develop and optimize complex data processing logic within Azure Databricks to handle large-scale datasets, significantly reducing latency for downstream reporting and analytics.

• Architect sophisticated data models that support evolving business requirements, ensuring optimal query performance and data consistency across SQL and MySQL environments.

• Lead the end-to-end lifecycle of data engineering projects, from requirement gathering and technical design to deployment and post-production monitoring, to maintain high service reliability.

• Mentor junior engineers and foster a culture of technical excellence by conducting code reviews and implementing best practices in Python-based data automation.

Required Skillset:

• Demonstrated expertise in building and managing end-to-end data pipelines within the Azure cloud ecosystem, with a deep understanding of cloud-native data architecture.

• Advanced proficiency in SQL and Python, with the ability to write highly optimized, maintainable code for complex data transformations and automation tasks.

• Proven experience in data modeling and schema design, capable of translating complex business logic into efficient database structures.

• Strong interpersonal skills with the ability to communicate technical concepts to non-technical stakeholders, facilitating alignment on project goals and deliverables.

• A collaborative mindset suited for a hybrid work environment in Hyderabad, with the ability to work effectively in agile, fast-paced team settings.

• A Bachelor's or Master's degree in Computer Science, Information Technology, or a related quantitative field, backed by a track record of delivering enterprise-grade data solutions.