Senior Data Engineer - Big Data/Python/AWS

**Requirements :

• Ensuring and validating data quality developing and maintaining end to end data pipelines and insight products.

• We are looking for someone with strong data lake fundamentals, AWS, spark, python, airflow etc. hands-on experience in all layers of data Integration and analytics.

RESPONSIBILITIES :

• Sr Data Engineer will understand the business need and design the data pipelines, translate

data into business insights, data cleansing and ETL.

• Experience in Databricks, GitHub Actions.

• Understand CI/CD, Aerospike

• Gather requirements from vested teams to build features.

• Self-motivated individual will use their love of user interfaces to balance design and function, and thrive in a fast-paced environment, knowledge in Angular / Play Framework is a plus.

• Understand the priorities and ensures the deliverables stick to the timeline and complete projects on time

• Be a team player who works effortlessly with people

Requirements :

• 3 to 7 years of development experience at an Enterprise level in the following tools and languages :

o Spark Scala

o python

o Mysql

o Apache Parquet / any columnar formats

• Desired Pluses

o Java

o Play framework / Angular

o Tableau

o Advertising Tech Industry experience

o AWS Services, Hadoop architecture and EMR management

o Linux

• Strong experience with digital media.

• Strong experience with relational databases like MySQL. NoSQL databases experience is a plus.

• Strong background with data modeling, data access, and data storage techniques

• Experience with design, development, and implementation of highly scalable, high-volume software systems and components, source of truth systems for different business areas.

• Bachelor's degree in Computer Science or related field or equivalent combination of industry related professional experience and education