Title: Observability — NVIDIA Dynamo Documentation

URL Source: https://docs.nvidia.com/dynamo/latest/_sections/k8s_observability.html

Published Time: Fri, 07 Nov 2025 17:51:52 GMT

Markdown Content: Skip to main content

Back to top Ctrl+K

NVIDIA Dynamo Documentation

latest

latest0.6.10.6.00.5.10.5.00.4.10.4.00.3.20.3.10.3.00.2.10.2.0

Search Ctrl+K

• GitHub

Search Ctrl+K

NVIDIA Dynamo Documentation

latest

latest0.6.10.6.00.5.10.5.00.4.10.4.00.3.20.3.10.3.00.2.10.2.0

• GitHub

Table of Contents

Getting Started

• Quickstart
• Installation
• Support Matrix
• Examples

Kubernetes Deployment

• Deployment Guide

  • Kubernetes Quickstart
  • Detailed Installation Guide
  • Dynamo Operator
  • Minikube Setup

• Observability (K8s)

  • Metrics
  • Logging

• Multinode

  • Multinode Deployments
  • Grove

User Guides

• Tool Calling

• Multimodality Support

• Finding Best Initial Configs

• Dynamo Benchmarking Guide

• Tuning Disaggregated Performance

• Writing Python Workers in Dynamo

• Observability (Local)

  • Metrics

    • Metrics Visualization with Prometheus and Grafana

  • Logging

  • Health Checks

• Glossary

Components

• Backends

  • vLLM
  • SGLang
  • TensorRT-LLM

• Router

• Planner

  • Overview
  • SLA Planner Quick Start
  • SLA-Driven Profiling
  • SLA-based Planner

• KVBM

  • Overview
  • Motivation
  • Architecture
  • Components
  • Design Deep Dive
  • Integrations
  • KVBM in vLLM
  • KVBM in TRTLLM
  • LMCache Integration
  • Further Reading

Design Docs

• Overall Architecture

• Architecture Flow

• Disaggregated Serving

• Distributed Runtime

• Observability

Observability#

previous Minikube Setup Guidenext Dynamo Metrics Collection on Kubernetes

Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2024-2025, NVIDIA CORPORATION & AFFILIATES.

Links/Buttons:

• Skip to main content
• NVIDIA Dynamo Documentation
• latest
• 0.6.1
• 0.6.0
• 0.5.1
• 0.5.0
• 0.4.1
• 0.4.0
• 0.3.2
• 0.3.1
• 0.3.0
• 0.2.1
• 0.2.0
• GitHub
• Installation
• Support Matrix
• Examples
• Deployment Guide
• Kubernetes Quickstart
• Detailed Installation Guide
• Dynamo Operator
• Minikube Setup
• Observability (K8s)
• Metrics
• Logging
• Multinode
• Multinode Deployments
• Grove
• Tool Calling
• Multimodality Support
• Finding Best Initial Configs
• Dynamo Benchmarking Guide
• Tuning Disaggregated Performance
• Writing Python Workers in Dynamo
• Observability (Local)
• Metrics Visualization with Prometheus and Grafana
• Health Checks
• Glossary
• Backends
• vLLM
• SGLang
• TensorRT-LLM
• Router
• Planner
• SLA Planner Quick Start
• SLA-Driven Profiling
• SLA-based Planner
• KVBM
• Motivation
• Architecture
• Components
• Design Deep Dive
• Integrations
• KVBM in vLLM
• KVBM in TRTLLM
• LMCache Integration
• Further Reading
• Overall Architecture
• Architecture Flow
• Disaggregated Serving
• Distributed Runtime
• #
• Privacy Policy
• Manage My Privacy
• Do Not Sell or Share My Data
• Terms of Service
• Accessibility
• Corporate Policies
• Product Security
• Contact