llm-router live status
Request history
Request history: completed requests per series per bucket. Buckets are naive-UTC (a "day" starts at 00:00 UTC, matching the budget counter) and the last bucket is the current one — still filling in. 30d always uses day buckets (720 hourly buckets would exceed the cap). Proxy reads the router spend log (router era only, data from 2026-08-20); user reads ClickHouse llm_router.logs (full history incl. the litellm backfill) and charts the top 10 users by requests, folding the rest into others; user series are named from the users table (alias or email) when it knows them. The user selector works in both dimensions: in user it picks the series, in proxy it filters every per-proxy series down to the rows those users produced (an active filter shows as a chip; click it to clear). Hover for the per-bucket readout; click a line, bar or legend chip to isolate that series. The chart draws at most 12 series at once (the palette limit, not a data limit). Polled with the page; the server keeps each answer for 60s.
GLM
inflight 41 unreachable · 1 lockedAnthropic
inflight 0Kimi
inflight 0MiniMax
inflight 0OpenCode
inflight 01 throttledQPS column: now = queries in the current second · avg60 = queries/sec averaged over the last 60s (e.g. 0.47/s ≈ 28 queries/min) · peak60 = queries in the single busiest second of the last minute (what the ZAI per-second concurrency cap charges).
CREDITS 5h / 7d column: settled credits per backend against its 24,000-credits/5h and 120,000-credits/7d caps (each 85% of ZAI's own allowance) — read live from the SAME hourly buckets the budget settles into, so the display and the admission gate cannot disagree (a number here is at most ~30 s old). Amber when EITHER window is at 85% of its cap — spread the fleet before the cap sheds; red at 100% — already over, the backend is quarantining on its next admission check. SHED = our own credit budget is excluding this backend (until the instant in the tooltip); ZAI pause = ZAI itself is refusing the account (1310 quota / 1308 5h window / 1113-1313 lock) — a different action. — = the backend has no credit budget (request mode); its request counts stay on /health (volume) and in the chart above. stale = the credit counter could not be read; the numbers shown are the last good ones.