Senior Software Engineer, AIOps and Observability
Build and lead NVIDIA’s AIOps and Observability platforms, designing scalable telemetry pipelines, ML-driven anomaly detection, and AI-native debugging tools to monitor millions of assets across cloud, on-prem, and edge.
- Compensation
- $200K–$322K / yr
- Location
- US, CA, Santa Clara
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- 5+ years
- Category
- Software engineering
- Posted
Skills
Full description
We are looking for a highly skilled Senior Software Engineer to design and develop AIOps & Observability platforms at NVIDIA. The platforms are used by internal teams to monitor, diagnose, and optimize the products, millions of assets and services in cloud, on-prem, data centers, supply chain, and edge. You will work with a team of engineers, product managers, and partners to define the observability strategy, roadmap, and standard methodologies for NVIDIA. You will also mentor and coach other engineers on observability, machine learning, tools and techniques.
What you will be doing:
- Lead the design, development, and deployment of AIOps & Observability platforms, including metrics, logs, traces, events, alerts, dashboards, and visualizations.
- Drive the technical vision and roadmap for AIOps and Observability initiatives, aligning with business goals and industry best practices.
- Collaborate with other teams and customers to understand their observability needs and provide solutions that meet their requirements and expectations.
- Establish and implement observability standards, guidelines, and processes across NVIDIA. Research, evaluate, and adopt new observability technologies and frameworks that can enhance user experience.
- Provide peer reviews to other engineers including feedback on performance, scalability, security and correctness.
- Work with Data scientists to implement machine learning models for anomaly detection, forecasting, and root cause analysis on logs, metrics, and events. Handle large volumes of data and ensure data quality, security, and compliance.
- Develop and operate scalable, reliable, and distributed systems that can handle high traffic and complex workloads.
- Develop AI agents and AI-native observability tools that help engineers detect, understand, and resolve production issues faster. Build agentic workflows that reason across logs, metrics, traces, events, alerts, topology, and incident history to support anomaly detection, forecasting, root cause analysis, automated debugging, and remediation recommendations.
What we need to see:
- Bachelor’s degree in computer science and engineering, or related field, or equivalent experience.
- 12+ years of experience in product development and full stack engineering, with 5+ years of experience in developing and operating observability platforms and solutions, preferably in a cloud-native environment.
- Strong knowledge and experience with observability tools, such as Prometheus, Victoria Metrics, Vector, Loki, Grafana, Alert Manager, Clickhouse, OpenTelemetry, etc.
- Hands-on knowledge in AIOps tools such as BigPanda, PagerDuty, Datadog, etc.