Saksoft
Data Engineer
- Compensation
- ₹1M–₹1.8M / yr
- Location
- Pune; Chennai; Bengaluru
- Work setup
- Onsite
- Seniority
- Not specified
- Employment
- Full time
- Experience
- 4+ years
- Category
- Data engineering
- Posted
Skills
Nice to have
- Experience with GCP Dataflow, Dataproc, Cloud Composer, and Pub/Sub.
- Knowledge of Apache Spark, PySpark, and Airflow.
- Experience with cloud data warehouse solutions.
- Understanding of telecom data such as CDR, billing, customer, network, usage, and subscriber data.
- Exposure to telecom OSS/BSS systems and data migration projects.
- Strong problem-solving and analytical skills.
- Ability to independently manage data engineering and migration activities.
- Good communication and stakeholder management skills.
- Experience working in Agile development environments.
Full description
We are looking for an experienced Data Engineer with 47 years of hands-on experience in Google Cloud Platform (GCP), data engineering, and data migration. The ideal candidate should have strong experience in designing, developing, and implementing scalable data pipelines, along with expertise in migrating data from legacy systems to cloud-based platforms.
Experience in the Telecom domain is mandatory, with a good understanding of telecom data, systems, and business processes.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Google Cloud Platform (GCP).
- Perform end-to-end data migration from legacy systems, databases, and on-premises environments to GCP.
- Develop and optimize ETL/ELT processes for data extraction, transformation, and loading.
- Work on GCP services such as BigQuery, Cloud Storage, Dataflow, Dataproc, and Cloud Composer.
- Build and maintain data integration workflows to support business and analytical requirements.
- Perform data validation, reconciliation, quality checks, and troubleshooting during migration activities.
- Optimize data pipelines and queries for performance, scalability, and cost efficiency.
- Collaborate with business analysts, data architects, and cross-functional teams to understand data requirements.
- Ensure data security, governance, and compliance throughout the data migration lifecycle.
- Work with large volumes of structured and unstructured telecom data.
Mandatory Technical Skills
- 4-7 years of experience in Data Engineering.
- Hands-on experience with Google Cloud Platform (GCP).
- Strong experience in data migration from legacy/on-premises systems to cloud platforms.
- Experience in ETL/ELT development and data pipeline implementation.
- Strong SQL skills and experience with Python.
- Hands-on experience with BigQuery and Google Cloud Storage.
- Experience in data transformation, data modelling, data integration, and data quality validation.
Good to Have
- Experience with GCP Dataflow, Dataproc, Cloud Composer, and Pub/Sub.
- Knowledge of Apache Spark, PySpark, and Airflow.
- Experience with cloud data warehouse solutions.
- Understanding of telecom data such as CDR, billing, customer, network, usage, and subscriber data.
- Exposure to telecom OSS/BSS systems and data migration projects.
Domain Experience Telecom
- Prior experience working on telecom data engineering or data migration projects.
- Understanding of telecom data sources, including CDR, billing, CRM, network, and subscriber data.