Senior Java Engineer (AWS & Data Pipelines) – Remote
Senior Java engineer who designs REST/GraphQL microservices and builds ETL/ELT data pipelines on AWS (S3, Lambda, Kinesis, EventBridge Pipes), using IaC, CI/CD, Python, and databases like Snowflake, PostgreSQL, Redis, and DynamoDB. The role is with KWAN, a Portuguese IT staffing firm placing engineers on client projects.
- Compensation
- Not disclosed
- Location
- Portugal
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Software engineering
- Posted
Skills
Must have
- Proven experience with Java and modern web architecture frameworks
- Experience with AWS Cloud and managed services, including S3, Lambda, EventBridge Pipes, and Kinesis
- Proficiency in automated testing (unit, mock, and integration)
- Demonstrable experience managing infrastructure as code (IaC)
- Proven ability building and integrating RESTful and/or GraphQL services
- Working knowledge of CI/CD pipelines, GitHub, and bash scripting
- Familiarity with microservices-based backend architectures
- Experience building and maintaining production data pipelines with ETL/ELT processes and data orchestration
- Proficiency in SQL and strong understanding of relational and non-relational databases, including Snowflake, PostgreSQL, Redis, and DynamoDB
- Experience with cloud data warehouse and analytics platforms, such as Snowflake, Redshift, or BigQuery
- Use Python for data processing, transformation, and automation scripting
Nice to have
- Experience developing and orchestrating ETL/ELT data pipelines with Airflow 3
Full description
We are looking for a Senior Java Engineer (AWS & Data Pipelines) who's eager to embark on an exciting new opportunity!
We connect IT professionals with projects that match their skills, professional experience, and goals, then we offer a career progression program, delivered by in-house specialists - our People Experience Partners - to guide them through our journey with us.
What is this challenge about:
- Design, build, and integrate RESTful and/or GraphQL services using Java and modern web architecture frameworks.
- Develop and manage cloud infrastructure using AWS managed services such as S3, Lambda, Kinesis, and EventBridge Pipes.
- Implement and maintain infrastructure as code (IaC) for reliable, repeatable deployments.
- Build and maintain automated test suites, including unit, mock, and integration tests.
- Develop and orchestrate ETL/ELT data pipelines feeding production systems, ideally with Airflow 3.
- Work with relational and non-relational databases such as Snowflake, PostgreSQL, Redis, and DynamoDB.
- Contribute to microservices-based backend architectures and cloud data warehouse platforms (Snowflake, Redshift, BigQuery).
- Maintain CI/CD pipelines, working with GitHub and bash scripting.
- Use Python for data processing, transformation, and automation scripting.
What we are looking for:
- Proven experience with Java and modern web architecture frameworks.
- Experience with AWS Cloud and managed services, including S3, Lambda, EventBridge Pipes, and Kinesis.
- Proficiency in automated testing (unit, mock, and integration).
- Demonstrable experience managing infrastructure as code (IaC).
- Proven ability building and integrating RESTful and/or GraphQL services.
- Working knowledge of CI/CD pipelines, GitHub, and bash scripting.
- Familiarity with microservices-based backend architectures.
- Experience building and maintaining production data pipelines, with expertise in ETL/ELT processes and data orchestration.
- Proficiency in SQL and a strong understanding of relational and non-relational databases, including Snowflake, PostgreSQL, Redis, and DynamoDB.
- Experience with cloud data warehouse and analytics platforms, such as Snowflake, Redshift, or BigQuery.
What we offer
- A project that matches your skills and ambitions, as well as your preferences for working policies and culture.
- A competitive salary with awesome benefits and opportunities to leverage your knowledge and network to earn additional income.