feat: comprehensive telemetry instrumentation
Merged
AN
8mo ago+995+995+012345678901234567890123456789-9-9-0123456789
Summary
- 25 telemetry event types instrumented across the CLI lifecycle β up from 10 defined (many never emitted) to full coverage
- Error visibility: auth failures, MCP server errors, Python engine crashes, provider errors, permission denials, doom loops
- Privacy-safe helpers:
categorizeToolName()for tool classification,bucketCount()for anonymized counts - Telemetry docs page with event table, privacy policy, opt-out instructions, and contributor guide
- 25 unit tests covering all helpers, event types, privacy validation, and naming conventions
Files changed (15)
| File | Changes |
|---|---|
src/telemetry/index.ts | 25 event types, categorizeToolName(), bucketCount(), sequence_index/previous_tool on tool_call |
src/session/processor.ts | tool_call sequencing, context_utilization, error_recovered, provider_error, doom_loop_detected |
src/session/prompt.ts | agent_outcome tracking |
src/mcp/index.ts | mcp_server_status + mcp_server_census |
src/bridge/engine.ts | engine_started, engine_error |
src/cli/cmd/auth.ts | auth_login (7 paths), auth_logout |
src/installation/index.ts | upgrade_attempted |
src/session/index.ts | session_forked |
src/session/compaction.ts | compaction_triggered (was defined, never emitted) |
src/permission/next.ts | permission_denied |
src/tool/project-scan.ts | environment_census |
test/telemetry/telemetry.test.ts | 25 tests, 81 assertions |
docs/docs/configure/telemetry.md | New telemetry docs page |
docs/docs/network.md | AppInsights firewall endpoint |
docs/mkdocs.yml | Nav entry for telemetry docs |
Test plan
-
npx tsc --noEmitβ no new type errors (2 pre-existing) -
bun testβ 1413 pass, 0 fail across 85 files (including 25 new telemetry tests) - Privacy: no SQL/code/credentials/file paths sent; error messages truncated to 500 chars; counts bucketed
- All events use snake_case
domain_actionnaming convention - Manual: start
altimate, trigger tool calls, verifytool_categoryandsequence_indexappear in events - Manual: disconnect network, verify telemetry failures are silent
π€ Generated with Claude Code