Careernet
Aws Data Engineer
- Compensation
- Not disclosed
- Location
- Thiruvananthapuram
- Work setup
- Onsite
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- 4+ years
- Category
- Data engineering
- Posted
Skills
Nice to have
- Experience with Amazon ECS and Amazon DynamoDB.
Full description
Key Skills: AWS Ecs, DynamoDb
Roles and Responsibilities:
- Design and develop scalable batch and streaming data pipelines on AWS.
- Build transformation and processing workflows using Python and PySpark.
- Develop and manage data processing jobs using AWS Glue and Amazon EMR.
- Orchestrate dependent data workflows and production schedules using AWS Step Functions.
- Implement data integrations and cloud-based services with attention to reliability, security, and operational efficiency.
Skills Required:
- 4 - 10 years of relevant experience in data engineering or big data platform development.
- Strong hands-on experience designing and implementing data engineering solutions on AWS.
- Proficiency in Python and PySpark for large-scale data processing.
- Experience developing and operating data pipelines using AWS Glue and Amazon EMR.
- Understanding of distributed data processing, cloud architecture, and production data workflows.
Good to Have:
- Experience with Amazon ECS and Amazon DynamoDB.
Education: Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.