Files
hermes-agent/scripts
teknium1 d6e4e33d7d fix(telemetry): live relay smoke expects the v5 efficiency and adoption rows
The smoke's exact metric-set checks (SQLite store and export packages) were
never updated for v5: every attended CLI turn now also emits task_cost,
tool_output_truncation, tool_overhead and tool_enabled_unused, and the skill
lifecycle step latches feature_adoption(skills_created). A correct run failed
with "Unexpected SQLite counters", so the documented live gate could no
longer catch a real regression. Both sets now include the five metrics and a
shared _validate_v5_rows asserts their dims in the store and the packages
(task_cost provider/model `custom` for the canary model, api_calls 2,
tool_calls 1; read_file truncation; file toolset used; tool_overhead on cli).

Live smoke (loopback fake OpenAI server, no model spend):
  before: rc=1 AssertionError: Unexpected SQLite counters
  after:  rc=0 "Hermes -> NeMo Relay shared-metrics smoke test passed"
Sabotage: expecting the canary model id in task_cost is caught.
2026-09-28 12:43:03 -07:00
..