EPAM Systems
Senior Data Engineer (Java/Scala/Python, Spark, AWS)
Senior Data Engineer designing and maintaining large-scale data pipelines and distributed processing systems using AWS and Spark to power Gen AI and ML applications.
- Compensation
- Not disclosed
- Location
- Poland
- Work setup
- Remote
- Seniority
- Senior
- Employment
- Not specified
- Experience
- 5+ years
- Category
- Data engineering
- Posted
Skills
Must have
- 5+ years of experience in Data Engineering with exposure to Gen AI/ML-based applications
- Background in building and maintaining large-scale data pipelines and distributed processing systems using Spark with Java or Scala
- Familiarity with AI/ML, Generative AI, or data platforms supporting AI-driven initiatives
- Expertise in AWS cloud environments and cloud-native architectures
- Advanced proficiency in SQL
- Skills in data modeling and modern data lakehouse architectures
- Understanding of data quality, governance, monitoring, and operational best practices
- Competency in building secure, scalable, and highly available data solutions
- ETL/ELT development experience
- Proficiency in English at Upper-Intermediate level (B2) or higher
Nice to have
- Hands-on experience with Databricks or Snowflake
- Background in Financial Services
Full description
We are seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. In this role, you will leverage your expertise in AWS, Spark, and modern data architectures to deliver secure, scalable, and highly available data solutions supporting Gen AI and ML applications.
Responsibilities
- Design, build, and maintain large-scale data pipelines and distributed processing systems using Spark
- Develop and support data platforms that enable AI/ML and Generative AI applications
- Architect and implement solutions within AWS cloud environments using cloud-native patterns
- Build and optimize ETL/ELT workflows to support analytical and operational use cases
- Implement data modeling strategies aligned with modern data lakehouse architectures
- Ensure data quality, governance, and monitoring across all data assets
- Deliver secure, scalable, and highly available data solutions following operational best practices
- Collaborate with cross-functional teams to support AI-driven business initiatives
- Write advanced SQL queries and production-grade code in Java or Scala or Python
Requirements
- 5+ years of experience in Data Engineering with exposure to Gen AI/ML-based applications
- Background in building and maintaining large-scale data pipelines and distributed processing systems using Spark with Java or Scala or Python
- Familiarity with AI/ML, Generative AI, or data platforms supporting AI-driven initiatives
- Expertise in AWS cloud environments and cloud-native architectures
- Advanced proficiency in SQL
- Skills in data modeling and modern data lakehouse architectures
- Understanding of data quality, governance, monitoring, and operational best practices
- Competency in building secure, scalable, and highly available data solutions
- Showcase of ETL/ELT development experience
- Proficiency in English at an Upper-Intermediate level (B2) or higher
Nice to have
- Hands-on experience with Databricks or Snowflake, with the ability to work across modern cloud-based data platforms (experience with both is advantageous)
- Background in Financial Services
Benefits
We gather like-minded people:
- Top tech minds driving innovation in AI, cloud and digital platform modernization
- Supportive team and agile, startup-like culture
- Hybrid by design mode and opportunity to work remotely within Poland
- Chance to work abroad for up to 60 days annually
- Business-driven relocation opportunities