feat: adding AI Gateway support
Merged
KY
9mo ago+148+148+012345678901234567890123456789-53-53-01234567890123456789
why
New open source models are released, and don't necessarily have a great inference provider at all times. Seeing as we're already using the AI-SDK, it makes sense to add support for the AI Gateway.
what changed
Added Vercel AI Gateway as a provider to the llm providers list.
test plan
Testing with Evals
Summary by cubic
Adds Vercel AI Gateway as a provider to route model calls across vendors with a single API key; docs now cover gateway/{provider}/{model} usage, AI_GATEWAY_API_KEY setup, examples for Anthropic/Google, and optional baseURL config.
Also enforces JSON outputs for Kimi and DeepSeek, sets Kimi temperature=1, and fixes eval parsing by using the first slash in provider/model strings.