How the pieces fit together

Gateway (your infra)
A hardened container. Runs in your VPC, on-prem, or on a laptop. Speaks the OpenAI API. Fans out to 20+ providers. Keeps audit logs local.
Dashboard (SaaS)
Configures providers, routes, guardrails, budgets, and teams. Reads aggregate telemetry from gateways. Never sees raw prompts or completions.
Control plane
Registration tokens, heartbeats, config sync, health signals. HTTPS only. Outbound from the gateway.
Local connection
For playground, logs, and traces the dashboard talks to the gateway directly over your LAN or a URL you expose. Authenticated with a per-session JWT.
What stays local, always
Where to go next
Deploy the gateway
Run the container.
Check requirements
CPU, memory, network.
Functionalities
Auth, RBAC, guardrails, compliance.
Environment variables
Full config reference.