Description

A specialized tool for managing local AI deployments, providing real-time visualization of model performance and hardware metrics. The dashboard tracks throughput (token generation speeds), TTFT, and detailed GPU utilization for multi-GPU setups running DeepSeek and GLM models via vLLM.

Descriptions, tags, and model credits may be AI-generated or inferred from public sources and can be incomplete or wrong. Learn more.