Standardize eval policy, budgets, session metadata, traces, and cost accounting

Merged
MI
2mo ago
+4452-154

Defines one eval-owned autonomy policy and a shared result contract for external harnesses. Records policy channel/version, effective budget and unit, requested configuration, browser identity, execution reason, normalized usage and trace/timing metadata.

Unknown usage and subscription costs remain unavailable. Astra estimates also remain unavailable until per-request context-tier accounting exists. Other supported direct-provider estimates include the dated catalog source. Generic task JSON is preserved in results and verifier trajectories. Failed facade calls remain failures regardless of tool-output text; runner-owned telemetry determines run-level session loss. PR13 wires browser identity and budget helpers into existing adapters.

Validation: isolated shared-runner changes passed all 896 eval tests and eval typecheck. The complete repaired stack passed 30 build/typecheck tasks and 29 unit-test tasks, including 999 eval tests. Fresh CI passed on this PR’s current head.

Stack base: evals/consolidation-04-cdp-diagnostics. Review this PR relative to its immediate predecessor.

Reviewer entry points:

Readiness: CI passed on 2761befd8b. Human review status is unchanged.

Current open stack: #2893 → #2894 → #2902 → #2903 → #2889 → #2904 → #2905 → #2906 → #2907.