llm-gateway
Fragile: CRITICAL FRAGILE: ipv4_address MUST be pinned to 172.28.0.74 in compose. The iptables ACCEPT rule in prysm-llm-gw-enforce.sh must match this IP exactly. After any power outage or container recreation, verify with `iptables -L DOCKER-USER -n`. IP drift causes silent traffic DROP in DOCKER-USER chain — LLM jobs will timeout with no application-level error for up to 18+ hours before detection. IMAGE-COPY — requires build + up -d.
Description
LLM routing gateway — routes inference requests to appropriate LLM backends
Role
Receives LLM requests from agent-brain, routes to cloud or local (ollama) backends; enforces rate limits
Dependencies
None configured
Runbooks
LLM Gateway — Diagnose and fix iptables IP drift network-routing
Behavioral Assertions
None
Diagnostic Tools
None
Recent Issues
| # | Title | Severity | Status | Created |
|---|---|---|---|---|
| #651 | [anthropic] BILLING_LIMIT | critical | open | 6/1/2026 |
| #312 | [anthropic] BILLING_LIMIT | critical | resolved | 5/8/2026 |
| #236 | [anthropic] BILLING_LIMIT | critical | resolved | 5/6/2026 |
| #232 | [anthropic] BILLING_LIMIT | critical | resolved | 5/6/2026 |
| #99 | [anthropic] BILLING_LIMIT | critical | resolved | 4/27/2026 |
| #98 | [anthropic] BILLING_LIMIT | critical | resolved | 4/27/2026 |
| #93 | [anthropic] BILLING_LIMIT | critical | resolved | 4/27/2026 |
| #80 | [anthropic] BILLING_LIMIT | critical | resolved | 4/27/2026 |
| #79 | [anthropic] BILLING_LIMIT | critical | resolved | 4/27/2026 |
| #1 | LLM Gateway iptables IP drift — silent traffic DROP for ~18 hours | critical | resolved | 4/19/2026 |