Sparity
Senior Software Engineer- AWS Data Engineer
Sparity is hiring a Senior Data Engineer in Hyderabad to build and maintain AWS ETL/ELT pipelines with Glue, PySpark, and Python, orchestrate via Lambda and Step Functions, and tune SQL across Oracle, PostgreSQL, MongoDB, and DynamoDB, using CI/CD tools like GitHub Actions, Jenkins, Terraform, and Docker.
- Compensation
- ₹1M–₹2M / yr
- Location
- Hyderabad
- Work setup
- Onsite
- Seniority
- Senior
- Employment
- Full time
- Experience
- 6+ years
- Category
- Data engineering
- Posted
Skills
Must have
- 6-8 years of experience in Data Engineering or ETL Development
- Strong hands-on experience with AWS Glue, PySpark, Python, and SQL
- Hands-on experience with Oracle, MongoDB, and DynamoDB
- Good knowledge of Aurora PostgreSQL, Amazon RDS, batch and streaming data integration
- Working knowledge of Amazon ECS and Terraform
- Familiarity with AWS Lambda, Step Functions, Docker, EKS, OpenShift, VPC, Security Groups, IAM, and encryption
- Experience with CI/CD tools such as GitHub Actions and Jenkins
- Strong debugging, performance optimization, data validation, and production support skills
- Understanding of AI/LLM models and prompt engineering
- Practical experience using AI-assisted development tools such as Devin AI, Cursor, and Claude Skills
- Ability to review and validate AI-generated code, SQL queries, and data transformations
- Awareness of secure AI usage and protection of sensitive data
- Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field
Nice to have
- Experience in the US healthcare, health insurance, or payer domain
- Knowledge of claims, eligibility, enrollment, provider, or member data
- Familiarity with HIPAA, HL7, FHIR, or X12 EDI standards
- Exposure to AWS Athena, Redshift, Kinesis, or EMR
- AWS Data Engineer or Data Analytics certification
- Experience using AI tools for data profiling and technical documentation
Full description
Dear All,
Greetings from Sparity!
Sparity is a global technology company specializing in AI, Digital Transformation, Cloud, Cybersecurity, and IT Consulting services. With a strong presence across India and international markets, we are committed to innovation, growth, and delivering scalable business solutions.
Role:Senior Software Engineer Data EngineeringPosition: Full TimeExperience : 6-8 yearsLocation:HyderabadKey Responsibilities
- Design, develop, and maintain ETL/ELT pipelines using AWS Glue, PySpark, and Python.
- Implement batch and streaming data integration with reliable error handling, retry, and replay mechanisms.
- Develop and optimize SQL queries and stored procedures for Oracle, Aurora PostgreSQL, and Amazon RDS.
- Work with MongoDB and DynamoDB data models and large-scale, multi-terabyte datasets.
- Use AWS Lambda and Step Functions for pipeline orchestration.
- Perform data profiling, validation, debugging, and performance tuning.
- Develop unit tests and data quality checks and support production deployments.
- Work with GitHub, GitHub Actions, Jenkins, ECS, Terraform, Docker, and AWS security services.
- Participate in design reviews, code reviews, root-cause analysis, and production support.
- Maintain technical documentation and provide backup support for the Data Engineering Technical Lead.
Required Skills
- 6-8 years of experience in Data Engineering or ETL Development.
- Strong hands-on experience with AWS Glue, PySpark, Python, and SQL.
- Hands-on experience with Oracle, MongoDB, and DynamoDB.
- Good knowledge of Aurora PostgreSQL, Amazon RDS, batch and streaming data integration.
- Working knowledge of Amazon ECS and Terraform.
- Familiarity with AWS Lambda, Step Functions, Docker, EKS, OpenShift, VPC, Security Groups, IAM, and encryption.
- Experience with CI/CD tools such as GitHub Actions and Jenkins.
- Strong debugging, performance optimization, data validation, and production support skills.
AI Knowledge & AI-Assisted Development
- Understanding of AI/LLM models and prompt engineering.
- Practical experience using AI-assisted development tools such as Devin AI, Cursor, and Claude Skills.
- Ability to review and validate AI-generated code, SQL queries, and data transformations.
- Experience using AI tools for data profiling and technical documentation.
- Awareness of secure AI usage and protection of sensitive data.
Preferred Qualifications
- Experience in the US healthcare, health insurance, or payer domain.
- Knowledge of claims, eligibility, enrollment, provider, or member data.