Data Engineer

As a Data
Engineer you will have the opportunity to design, build, and maintain systems
for collecting, storing, and processing large datasets. You will develop data
pipelines, ensure data integrity, and optimize data workflows for analytics or
machine learning. With your proficiency in programming languages like Python or
Java and tools such as SQL, PySpark, and cloud platforms, you will collaborate
with teams to enable efficient data access and support decision-making
processes. Strong problem-solving and communication skills are essential for
this role.

Responsibilities:

• Develop and

enhance data-processing, orchestration, monitoring, and more by leveraging
popular open-source software, AWS, and GitLab automation.

• Collaborate with

product and technology teams to design and validate the capabilities of the
data platform

• Identify, design,

and implement process improvements: automating manual processes, optimizing for
usability, re-designing for greater scalability

• Provide technical

support and usage guidance to the users of our platform’s services.

• Drive the

creation and refinement of metrics, monitoring, and alerting mechanisms to give
us the visibility we need into our production services.

Requirements

• Experience

building and optimizing data pipelines in a distributed environment

• Experience

supporting and working with cross-functional teams

• Proficiency

working in Linux environment

• 4+ years of

advanced working knowledge of SQL, Python, and PySpark

• 2+ years of

experience with using a broad range of AWS technologies

• Experience using

tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline

• Experience with

platform monitoring and alerts tools

Benefits

Working at VentureSoft means being part of a team driven by
success and care. We believe in helping each other achieve their aspirations.
We prioritize your growth through exceptional mentorship opportunities,