release(main): release onwards 2.0.0

PJ
8h ago
+80-3

:robot: I have created a release beep boop

2.0.0 (2026-11-15)

⚠ BREAKING CHANGES

  • onwards: hold API keys by SHA-256 hash (DW-1008) (#2140)
  • retire the serving-class presets, grants and default classes (#2068)
  • limits: replace gateway rate limits with per-account realtime in-flight limits (#1915)
  • onwards: frame SSE before applying buffer limit

Features

  • account files carry priority, latency targets and prices (#2075) (a2f91a6)
  • count the inference requests dwctl's own layers refuse (DW-851) (#1978) (b822bd0)
  • dwctl: let slow first tokens stream until a 20-second failover deadline (#1808) (444ad7c)
  • dwctl: per-process internal credential for calls into /ai (DW-1009) (#2154) (33457cb)
  • dwctl: record where a translated body fails its schema, without its content (DW-951) (#1991) (53b07dc)
  • dwctl: send each request's prices to dynamo endpoints as nvext.billing (#2124) (395efa5)
  • limits: cap batch requests in flight per model in onwards (#1924) (834827d)
  • limits: count in-flight limit checks and refusals per account (#1957) (f6a7486)
  • limits: name the account and report its limit on in-flight metrics (#1958) (72c6e97)
  • limits: replace gateway rate limits with per-account realtime in-flight limits (#1915) (be53043)
  • onwards: check legacy completions for unsupported parameters (DW-855) (#1996) (500873b)
  • onwards: conversation affinity for priority pools (#1892) (b2ff624)
  • onwards: count and log the requests onwards rejects itself (DW-851) (#1937) (98c234e)
  • onwards: count sanitized third-party errors (#2054) (dc82a0b)
  • onwards: flag chat parameters not every backend supports (#1925) (b2271fb)
  • onwards: hold API keys by SHA-256 hash (DW-1008) (#2140) (3b8e349)
  • onwards: make AIMD share control decide under overload and recover (#1803) (8bb4a6f)
  • onwards: per-model exceptions to the parameter reject list (#2163) (268e458)
  • onwards: record where a body fails the strict schema, without its content (DW-951) (#1990) (e1cb85a)
  • onwards: send a scheduling priority on every dynamo request (#1848) (094fe22)
  • onwards: stop logging rejections and unsupported parameters (#1963) (68315f4)
  • onwards: trace rejections and stop logging caller-limit refusals (#1952) (f051e4c)
  • overlay targets are scheduling hints, not a serving class (#2087) (4723cfa)
  • responses: accept Codex tool namespace groups (#1935) (9d46bf7)
  • route serving classes to their own upstreams (#2100) (7e40b8f)
  • serving classes v1 (#1774) (e1c9275)
  • tracing: customer attributes on request and batch spans (#1972) (60db3ec)

Bug Fixes

  • analytics: checkpoint records before enrichment (#1789) (7ed4000)
  • answer unreadable request formats with 415, and count content types (DW-985) (#2083) (58e3a52)
  • build: refresh the image CA bundle after eMudhra intermediate compromise (#2077) (ae3442c)
  • Correctly handle otel tracing through onwards (#1827) (107d619)
  • end interrupted streams with an error event (DW-851) (#1979) (843f421)
  • give every response the gateway id and send streamed usage only on request (#1973) (ccb3919)
  • keep API keys out of rate-limit and proxy debug logs (#1960) (43bf8e8)
  • onwards: answer every capacity refusal with 529 and Retry-After (#1913) (8ca5e6d)
  • onwards: frame SSE before applying buffer limit (5ebb4f1)
  • onwards: give trusted providers' errors the OpenAI envelope (#1977) (8d2960e)
  • onwards: return realtime-only failover statuses as sent when no provider is left (#1811) (2b954b9)
  • onwards: stop re-asking overloaded providers and answer 429 when every provider is full (#1911) (ad19d05)
  • preserve JSON key order in forwarded request bodies (#1930) (a8721a8)
  • proxy: preserve upstream rate-limit responses (#1800) (8a2052b)
  • set TCP_NODELAY on gateway sockets (#1931) (909a27e)
  • telemetry: redact credentials at the log and trace sinks (#2130) (5b3dcb1)

Performance Improvements

  • onwards: share a pool's key set between requests (#1901) (18cd38c)
  • tracing: filter and slim the spans sent to the trace backend (DW-931) (#1984) (4a07bb1)

Code Refactoring

  • retire the serving-class presets, grants and default classes (#2068) (a28e3b3)

Miscellaneous


This PR was generated with Release Please. See documentation.