LLM Gateway

connecting…
Gateway URL:
Queue Status

Queue Depth by Status

Vendor Slots

Throughput (last 10 min)

Errors — Last 24h

AI Usage & Cost
Total Calls
--
Total Tokens
--
Est. Cost
--
Success Rate
--

By Vendor / Model / Service

Vendor Model Service Calls In ✦=cache Out Est. Cost
Loading…

Daily Cost & Tokens (14 days)

Diagnostics

Vendor Connectivity

Click a vendor to test:

Schema Validator Test

Recent Requests

LLM Queue — Last 50

Status Vendor Model Service Operation User Priority Retries Queued At Started At
Loading…
Log Viewer

Gateway Logs

Loading logs…
Model Catalog

Available Models

Vendor Model ID Display Name Family Context Capabilities Active Last Seen
Loading…