Data Platform Engineer -MRF-00661

Overview

Job Title: Data Platform Engineer

Responsibilities

• Implement and manage tools and applications that enhance productivity and user experience on enterprise data platforms such as data access management tools, metadata management tools (including data catalogs and lineage tracking), and data quality monitoring tools

• Configure and implement security modules of enterprise data platforms to ensure controlled and encrypted network access, encrypted storage, data masking, and data integrity, including data validation, quality checks, integrity constraints, and checksums/hashing for accuracy and trustworthiness.

• Develop and maintain the data lifecycle management specifically backup, archiving, recovery, and purging data from enterprise data platforms.

• Proactively identify and implement API-driven automation solutions to streamline data security, access controls, metadata management, and data lifecycle management processes on enterprise data platforms

Knowledge, Skills, and Behaviors

• Strong understanding of data management and governance practices including metadata management, data quality management, master data management, and data lifecycle management

• Ability to collaborate with diverse stakeholders and effectively communicate technical concepts to both technical and non-technical audiences.

• Keeps up-to-date with the latest technologies and trends in data security, access control, automation, data lifecycle management, and metadata management

• Proficient in Python programming, to automate tasks related to data security and access control, metadata management, and data lifecycle management processes. This includes developing and maintaining automation scripts, as well as building web applications and tools using frameworks like Django to enhance the enterprise data platform functionality and user experience.

• Ability to analyze complex data challenges and design effective solutions.

• Flexibility to learn new tools, adapt to changing technologies, and solve unexpected challenges.

• Bachelor's degree in computer science, information management, or a related field.

• Overall exp shall be at lease 3 years. while relevant exp can be at least 2 to 3 years of experience in data management and governance practices such as metadata management, data lifecycle management, data quality management, and master data management

• Familiarity with data management technologies and tools, including data governance platforms, metadata management systems, data quality tools, and master data management solutions.

• Experience working with SQL is required

• Experience working with Python is required.

• Experience working with Enterprise Data Warehouse platforms preferred

• Experience working with Data Lake, Streaming & Big Data technologies preferred.

• Experience working with cloud data platforms (AWS or Alibaba Cloud) preferred

• Experience working with Agile methodologies (Scrum or Kanban) is preferred