feat: adding AI Gateway support

Merged
KY
9mo ago
+148-53

why

New open source models are released, and don't necessarily have a great inference provider at all times. Seeing as we're already using the AI-SDK, it makes sense to add support for the AI Gateway.

what changed

Added Vercel AI Gateway as a provider to the llm providers list.

test plan

Testing with Evals


Summary by cubic

Adds Vercel AI Gateway as a provider to route model calls across vendors with a single API key; docs now cover gateway/{provider}/{model} usage, AI_GATEWAY_API_KEY setup, examples for Anthropic/Google, and optional baseURL config.

Also enforces JSON outputs for Kimi and DeepSeek, sets Kimi temperature=1, and fixes eval parsing by using the first slash in provider/model strings.