Senior Data Engineer

This is a remote position.

Short Service Description:

• Development & integration of pipeline to integrate data from different data sources

• Testing and maintenance of the platform

• Facilitate deployment of code to stage and production environments

• Participation on architecture of end-to-end solutions

• Collaboration on feature deliverables

• Documentation of implemented logic in a structured manner

• Assistance with data-related technical issues and support their data infrastructure optimization

Technical knowledge

• Python, Spark, Streaming, Big Data, graphQL, devOps, CICD, git

• Azure cloud - Azure Data Factory, Databricks, Azure Functions, Azure DevOps

• AWS cloud - serverless, Amazon Neptune

• GCP cloud