Skills

Full description

Design, develop, and maintain large-scale data pipelines using Apache NiFi to integrate multiple sources into a centralized data lake.
Collaborate with cross-functional teams to identify business requirements and design scalable solutions for data ingestion, processing, and monitoring.
Develop high-performance ETL processes using Python or Java to extract, transform, and load (ETL) large datasets from various sources such as Kafka, PostgreSQL, Parquet files.
Ensure seamless deployment of data pipelines on Docker containers running on Kubernetes clusters.

7-10 years of experience in building complex data integration projects using tools like Apache NiFi.
Strong understanding of big data technologies including Hadoop ecosystem components like HDFS, YARN, MapReduce etc. .
Proficiency in programming languages such as Python or Java for developing ETL processes.
Experience working with containerization engines like Docker and orchestration platforms like Kubernetes.

Design, develop, and maintain large-scale data pipelines using Apache NiFi to integrate multiple sources into a centralized data lake.
Collaborate with cross-functional teams to identify business requirements and design scalable solutions for data ingestion, processing, and monitoring.
Develop high-performance ETL processes using Python or Java to extract, transform, and load (ETL) large datasets from various sources such as Kafka, PostgreSQL, Parquet files.
Ensure seamless deployment of data pipelines on Docker containers running on Kubernetes clusters.

7-10 years of experience in building complex data integration projects using tools like Apache NiFi.
Strong understanding of big data technologies including Hadoop ecosystem components like HDFS, YARN, MapReduce etc. .
Proficiency in programming languages such as Python or Java for developing ETL processes.
Experience working with containerization engines like Docker and orchestration platforms like Kubernetes.