Dell Model Watch

Throughput, Active Model, Local Inventory.

Live dashboard for llama.cpp and local model artifacts Waiting for data... Dashboard URL unknown

At a Glance

Loaded Model
-
No live endpoint detected
Latest Gen TPS
-
Prompt TPS -
Rolling Avg Gen TPS
-
Last 10 timed requests
Local Models Found
-
GGUFs and Modelfiles on this Dell
Configured runtime unknown
GPU
Checking nvidia-smi...
Waiting for GPU metrics.
GPU metrics pending
GPU Utilization
-
Streaming multiprocessor load
Temperature
-
Current core temperature
Power Draw
-
Realtime board power
VRAM Usage
-
Waiting for GPU metrics.

Live Endpoints

Model Control

Ready.

Recent Generation TPS

Recent Requests

Available Models On This Dell

Chat with model
Loading...