Data Engineer
Build and maintain scalable data pipelines and architectures on Azure and Databricks, using PySpark to process large data volumes for analytics and BI. Daily work involves pipeline development, data quality monitoring, and collaborating with data scientists and analysts.
- Compensation
- Not disclosed
- Location
- Hyderabad, Telangana
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Full time
- Experience
- 6+ years
- Category
- Data engineering
- Posted
Skills
Must have
- Proven experience as a Data Engineer or in a similar role
- Strong proficiency in Azure cloud services and Databricks
- Experience with PySpark for data processing and transformation
- Familiarity with data modeling, ETL processes, and data warehousing concepts
- Excellent problem-solving skills and ability to work collaboratively in a team
Full description
We are seeking a skilled Data Engineer to join our dynamic team in Andhra Pradesh. The ideal candidate will have a strong background in data engineering, with expertise in Azure, Data Bricks, and PySpark. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures that support our data analytics and business intelligence initiatives.
Key Responsibilities:
- Develop and maintain robust data pipelines to ingest, process, and store large volumes of data from various sources.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
- Optimize data processing workflows for performance and efficiency using Azure and Data Bricks.
- Implement data quality checks and monitoring to ensure the integrity and reliability of data.
- Stay updated with the latest trends and technologies in data engineering and contribute to continuous improvement initiatives.
Required Skills:
- Proven experience as a Data Engineer or in a similar role.
- Strong proficiency in Azure cloud services and Data Bricks.
- Experience with PySpark for data processing and transformation.
- Familiarity with data modeling, ETL processes, and data warehousing concepts.
- Excellent problem-solving skills and the ability to work collaboratively in a team environment.
If you are passionate about data engineering and eager to work in a fast-paced environment, we encourage you to apply for this exciting opportunity.