Appsierra
Data Engineer - PySpark/SQL
- Compensation
- Not disclosed
- Location
- Pune
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- 3+ years
- Category
- Data engineering
- Posted
Skills
Full description
About the Role :
We are seeking a Data Engineer to join our team. This role involves building and maintaining data pipelines on AWS and on-premises platforms.
Key Responsibilities :
- Design and implement data pipelines using AWS services such as S3, Glue, Lambda, and EMR.
- Develop ETL workflows in DBT and Pyspark.
- Set up and manage Airflow DAGs for scheduling and monitoring.
- Integrate and expose APIs using API Gateway for data consumption.
- Perform data modeling and documentation.
- Collaborate with clients and stakeholders to gather requirements and ensure project lifecycle adherence.
Required Qualifications :
- Bachelor's degree in Engineering (B.Tech) or equivalent.
- 3 - 5 years of experience in data engineering.
- Proficiency in SQL and Pyspark.
- Experience with AWS services (S3, Glue, Lambda, EMR).
- Strong communication skills and client-facing experience.
- Experience with Airflow and API development.
Nice to have :
- Knowledge of data modeling concepts.
- Experience with Nifi and Cloudera on-premise cloud environments.
- Experience with API REST and SOAP services.