Skip to main content
AI Gateway is a standalone routing layer for production LLM traffic. Send requests through one OpenAI-compatible endpoint to access 500+ models across providers, with built-in fallbacks, retries, load balancing, and usage tracking.

​
Quick Start

Complete the first request in a few minutes.
1

Create an account

Sign up, then open the workspace and select AI Gateway in the sidebar. The workspace is your organization’s account, its shared settings live under Settings > Organization, and it contains one or more projects that group resources and scope API keys.
2

Connect a provider

Use Toqan Router Credits, or add a provider key under BYOK. To add a key, open BYOK, choose OpenAI, select Configure, and paste the key. See Providers overview.
3

Enable the model

Open the Models page (Model List in the AI Gateway sidebar), find openai/gpt-5.4, and toggle its Status to enable it. See Using the router.
4

Set up Toqan Router

Open Settings > Organization > API Keys and select Create API key. Pick the Project the key belongs to: requests made with the key are scoped to that project. Leave Permissions on All for this guide, because Read only or a Restricted key without Responses write access returns a 403 on the request below. See API keys for the other permission options. Create the key and copy it.
5

Run a request

Set the key in your terminal and send a request to the Responses endpoint. $TOQAN_API_KEY carries the key from the previous step as the bearer token.
For São Paulo, replace /eu with /br. See Regions.
6

Inspect the request

Open Traces to review the response, latency, token usage, and cost.

​
Next steps

Fallbacks & Retries

Keep requests flowing when a provider fails.

Supported Models

Browse the model catalog and provider capabilities.

Migrate to Toqan Router

Move an existing application from the OpenAI SDK, OpenRouter, or LiteLLM.

Model FAQ

Answers to common questions about models and their capabilities.

Model Fusion

Answer one request with a panel of models and a judge, under one model ID.