Amex: GCP Data Engineer(Chennai) Kumar

Salary: INR 30 lakhs per year.

Position Required : Google Cloud - Data Engineer.

We are looking for energetic, high-performing and highly skilled data engineers to help shape our technology and product roadmap. You will be part of the fast-paced, entrepreneurial Global Campaign Tracking (GCT) team under Enterprise Personalization Portfolio focused on delivering the next generation of global marketing capabilities. The team is responsible for marketing campaign tracking of new accounts acquisition and bounty payments and leverages large scale data engineering technologies, such as SQL, PySpark, GCP, Big Query, Data Proc, Adobe Analytics, Google Analytics, Hive, Kafka & Java.

Focus: Designs, develops, solves problems, debugs, evaluates, modifies, deploys, and documents software and systems that meet the needs of customer-facing applications, business applications, and/or internal end user applications.

Responsibilities

· Develop and maintain large scale data processing pipeline using PySpark Data Proc, Big Query and SQL.

· Use Big Query and Data proc to migrate existing Hadoop/Spark/Hive workloads to Google Cloud.

· Proficient in Big Query to carry out batch and interactive data analysis.

· Function as member of an agile team by contributing to software builds through consistent development practices (tools, common components, and documentation)

· Develops and tests software, including ongoing refactoring of code, and drives continuous improvement in code structure and quality

· Enable the deployment, support, and monitoring of software across test, integration, and production environments

Minimum Qualifications:

This high energy Engineer must have:

• A Bachelor’s degree in computer science, computer engineering, other technical discipline, or equivalent work experience
• 6 – 9 years of software development experience. Hands-on expertise with application design, software development, and automated testing.
• Strong programming knowledge in SQL, PySpark, Data Proc, Big Query
• Hands-on experience in Big Data technologies (Spark, Hive)
• Understanding and experience with UNIX / Shell / Perl / Python scripting
• Database query optimization and indexing
• Web services design and implementation using REST / SOAP and Java is a plus
• Experience collaborating with the business to drive requirements/Agile story analysis.
• Experience with design and coding across one or more platforms and languages as appropriate

Bonus skills:

• Machine learning/data mining