Senior Technical Consultant - GCP Data Engineer
Senior data engineering consultant at Perficient, a global digital consultancy, designing and migrating enterprise ETL/big data solutions to GCP. Day to day: gathering requirements, building and tuning data pipelines with BigQuery, Dataflow, Airflow and Pub/Sub, and leading mainframe-to-GCP migrations for clients.
- Compensation
- Not disclosed
- Location
- Chennai, TAMIL NADU, India
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Full time
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- 8+ years of Data Engineering experience
- 5+ years of Cloud experience (GCP preferred) with solutions at production scale
- Strong understanding of key GCP data services: BigQuery, Cloud Scheduler, Airflow, Postgres, Dataflow, Pub/Sub, Cloud Logging, Cloud Monitoring
- Experience with infrastructure as code (Terraform/GitHub)
- Experience in design, development and implementation of data pipelines using Data Warehousing applications
- Experience integrating data sources like Oracle, Teradata, DB2, BigQuery & flat files
- Hands-on experience in performance tuning and debugging ETL jobs
- BE/BTech in CS/IT or equivalent degree in relevant domain
- Proven experience in data engineering (IBM DataStage or equivalent Cloud ETL preferred)
- Strong knowledge of ETL processes, data integration and data management
- Proficiency in programming languages such as SQL, Python or Java
- Familiarity with cloud computing platforms and data storage solutions
- Experience leading large-scale solutions and operationalization of data warehouses, data lakes, and analytics platforms on cloud
Nice to have
- Professional Certification in GCP (e.g., Professional Data Engineer)
- Experience in Mainframe to GCP migration considered plus
- Agile Methodology Practitioner
Full description
We currently have a career opportunity for a Senior Technical Consultant to join our team located (location).
As a Senior Technical Consultant you will participate in all aspects of the software development lifecycle which includes estimating, technical design, implementation, documentation, testing, deployment and support of application developed for our clients. As a member working in a team environment you will take direction from solution architects and Leads on development activities.
Perficient is always looking for the best and brightest talent and we need you! We’re a quickly-growing, global digital consulting leader, and we’re transforming the world’s largest enterprises and biggest brands. You’ll work with the latest technologies, expand your skills, and become a part of our global community of talented, diverse, and knowledgeable colleagues.
Data & Analytics Product Group under FCSD Tech is looking to for a dynamic and result oriented candidate for the role of Senior Data Engineer within its Data Orchestration product line. The candidate will be responsible for designing the transformation and modernization of big data solutions on the GCP cloud. The candidate must have experience leading large-scale solutions and the operationalization of data warehouses, data lakes, and analytics platforms on a cloud platform, GCP preferred. We seek individuals with a wide range of technology skills in these domains, capable of designing the right solutions using a mix of GCP and third-party technologies for deployment on the GCP cloud.
- 8+ years of Data Engineering experience
- 5+ years of Cloud experience (GCP preferred) with solutions designed and implemented at production scale
- Strong understanding of key GCP services, especially those related to data processing [Batch/Real Time] Big Query, Cloud Scheduler, Airflow, Postgres, Data Flow, Pub/Sub, Cloud Logging and Cloud Monitoring
- Experience with infrastructure as code Terraform/ GitHub
- Experience in design, development and implementation of data pipelines using Data Warehousing applications
- Experience in integrating various data sources like Oracle, Teradata, DB2, Big Query & Flat files
- Hands on experience in performance tuning and debugging ETL jobs
- Involving in review meetings and coordinating with the team in job designing and fine-tuning the job performance.
Responsibilities
- Responsible for gathering business requirements and design ETL systems to meet application needs
- Work closely with stakeholders to gather requirements and provide technical guidance on the migration process
- Collaborate with the data engineering teams to understand the existing JCL/ETL jobs and their dependencies.
- Design and implement migration strategies for moving ETL to GCP native services.