Skip to main content
Providers are the upstream LLM services Guardway routes to. You add them once in the dashboard; each provider is then attached to one or more gateways, which means those gateways hold the credentials and can forward requests to it.

Step 1 — Open Providers

From the dashboard, go to Configuration → Providers (/dashboard/configuration/providers) and click Add Provider.
Providers list

Step 2 — Pick a preset

Guardway ships with presets for the most common providers. The preset pre-fills the base URL, headers, and any provider-specific quirks.
Custom (OpenAI-compatible)
Anything that speaks an OpenAI-compatible API works with the Custom preset — point it at any base URL (a self-hosted vLLM, a partner endpoint, etc.).

Step 3 — Fill in the form

Add provider form
FieldRequiredNotes
Provider typeYesThe preset. Defines the adapter.
Display nameYesWhat you’ll see in lists and logs.
API keyUsuallyEncrypted at rest. Required by most presets. Not required by local ones (Ollama, LM Studio).
Base URLPrefilledEditable for Custom and for presets with regional endpoints (Azure, Bedrock).
API versionOptionalAzure OpenAI and a few others.
Custom headersOptionalFor endpoints that require a routing header.

Step 4 — Attach to a gateway

After saving, the provider appears in the list with health status Unknown until you attach it to a gateway. Click Attach and pick one or more gateways — each attached gateway gets its own copy of the credentials and reports health independently.
Attach provider to gateway
Once attached, the row shows:
  • Health: healthy, degraded, down, or unknown
  • Latency: rolling p50 to the provider
  • Models: count discovered (zero until you sync, see next page)
  • Enabled: toggle to disable routing to this provider without deleting it

Next step

Sync models

With the provider attached, discover the models it exposes and enable the ones you want.