GPU & ML Infrastructure Engineer(Exp 10+ yrs)

GPU & ML Infrastructure Engineer(Exp : 10+ yrs)

Company: ZecData Technology
Job Location: Remote (Work from home), India
Employment Type: Full-time
Experience Required: 10+ years
Salary: 1.5L1.75L a month

Experience: 10+ years preferred (8+ years for exceptional candidates)

Location: Remote

Overlap: Must be available until 11:00 AM PST

Role :

Were looking for an experienced GPU & ML Infrastructure Engineer to build and maintain infrastructure for NVIDIA GPU benchmarking, stress testing, ML workloads, telemetry, and data generation across data-center and edge/embedded platforms.

Responsibilities

Deploy and optimize LLM inference/training workloads, including Llama-family models.
Build GPU benchmarks and synthetic workloads: GEMM, convolution, compute, memory bandwidth, multi-GPU, and vision.
Collect and validate GPU/hardware telemetry using NVML, DCGM, BMC, IPMI, and Redfish.
Automate infrastructure deployment, workload execution, logging, data collection, and validation.
Diagnose GPU sensor, sampling, timing, power, and thermal issues.
Ensure workloads are reproducible and telemetry/data is accurate and well documented.
Maintain hardware, driver, firmware, workload, and run metadata.

Required Skills

Strong experience with NVIDIA GPUs and Linux systems.
Hands-on LLM inference/training experience.
Experience with quantized and full-precision models.
Strong knowledge of GPU drivers, process orchestration, scheduling, and automation.
Experience collecting and analyzing hardware telemetry programmatically.
Understanding of workload reproducibility and performance benchmarking.
Strong scripting/automation skills.

Nice to Have

NCCL, multi-GPU scaling, tensor/pipeline parallelismGPU benchmarking/stress-testingGPU power/thermal management and throttling
Hardware qualification or performance testing
Time-series telemetry and data-quality validation

Ideal candidate: An independent engineer comfortable owning the complete workflowfrom bringing up new GPU platforms and running ML workloads to collecting reliable telemetry and producing reproducible datasets.

Compensation: 150,000.00 - 175,000.00 per month

Benefits:

Provident Fund

Work Location: Remote .