Shenrui Ma 4521e04add fix(evals): align Kanban probe with managed MCP overrides ...

Use hermes-tools for the probe's managed server configuration and tool-call target so it exercises the endpoint receiving worker overrides. Leave intentional user-defined hermes-mcp fixtures unchanged.

Scope-risk: narrow
Tested: Three complete isolated probe runs on macOS with Codex CLI 0.137.0; related regression selection 202 passed, 2 existing skips; Ruff and repository static checks
Not-tested: Full repository suite, native Linux/Windows, hosted CI, cloud-model turns

2026-09-15 19:05:29 -07:00

..

botmode-dm-delivery

fix(cron): keep deferred delivery exceptions from aborting ticks

2026-09-14 17:29:32 -07:00

botmode-dm-matrix

test(bot-mode): keep the reproducible mock patch whitespace-clean

2026-09-14 17:04:56 -07:00

browser_use

refactor: move live-model benchmark harnesses from scripts/ into evals/

2026-09-13 06:06:46 -07:00

codebase_navigability

…

codex_echo

docs: record independently repeated input-ownership wire probe

2026-09-07 08:09:57 -07:00

compaction

…

core_tool_deferral

manage_connections covers local MCP servers; setup_mcp leaves the schema (NS-867, PR1) (#109517)

2026-09-15 00:41:13 +05:30

dashboard_auth

fix(dashboard-auth): one refresh single-flight for the cookie gate and the native route, off the event loop

2026-09-13 09:40:44 -07:00

delegation_group_schema

fix: hide inactive grouping options from delegation schema

2026-09-08 13:38:18 -07:00

desktop_bug_campaign

fix: reject unavailable desktop profile and session targets

2026-09-07 06:26:22 -07:00

desktop_mcp_oauth

test(desktop): make MCP renderer relay regressions executable

2026-09-07 06:10:28 -07:00

desktop-pane-fixture

test: keep Desktop pane-focus setup outside cold imports

2026-09-08 07:29:26 -07:00

gateway

test(sessions): exercise pressure eviction and recovery boundaries

2026-09-07 06:10:54 -07:00

gateway_completion

fix: wake idle process watches on their owning profile transport

2026-09-07 14:16:57 -07:00

gateway_failure_ownership

fix(gateway): carry accepted-input ownership through persistence

2026-09-07 14:11:18 -07:00

gateway_status_render

refactor: repoint 10 MessageEvent/MessageType importers that landed on main after the event.py split

2026-09-07 22:47:33 +05:30

liveness

test(tui-gateway): add isolated websocket orphan reconnect probe

2026-09-07 07:05:21 -07:00

memory

test(honcho): exercise config precedence through local SDK recall

2026-09-07 08:12:23 -07:00

native_compaction

eval(native-compaction): real-AIAgent A/B probe for checkpoint preflight false-trigger

2026-09-06 09:09:00 -07:00

openrouter_pkce_ab

test(auth): OpenRouter PKCE invariants, fake-authority A/B harness, docs, contributor map

2026-09-12 22:07:41 -07:00

postmortem

refactor: repoint 10 MessageEvent/MessageType importers that landed on main after the event.py split

2026-09-07 22:47:33 +05:30

prompt_footprint

fix(desktop): load property card guidance only on demand

2026-09-08 13:39:01 -07:00

provider_fallback

test: publish credential-free fallback wire reproduction

2026-09-07 07:08:25 -07:00

provider_wire

test: distinguish completion capture from model metadata HTTP

2026-09-07 06:06:46 -07:00

providers

fix: structured reasoning no longer breaks chat consumers

2026-09-07 08:24:54 -07:00

readtool

…

session_search_schema

fix(session_search): a bare session id never reads another profile's state.db

2026-09-11 06:24:11 -07:00

subagent_process_handoff

feat(delegation): surface process accounting as top-level process_notes in the sync result; add live stress harness

2026-09-07 12:50:29 -07:00

token_accounting

fix: let provider evidence adjudicate past-window preflight estimates

2026-09-07 14:11:41 -07:00

tool_search

refactor: move live-model benchmark harnesses from scripts/ into evals/

2026-09-13 06:06:46 -07:00

toolperf_abeval

refactor: move live-model benchmark harnesses from scripts/ into evals/

2026-09-13 06:06:46 -07:00

update_streaming

fix(update): stream build progress without concealing silent stalls

2026-09-07 05:56:50 -07:00

webhook_auth

…

__init__.py

…

acp_empty_session_wire.py

test(acp): verify existing empty metadata over native session load

2026-09-07 04:46:04 -07:00

anthropic_proxy_thinking_replay.py

test(anthropic): trim DeepSeek proxy replay tests to two invariants + local wire probe

2026-09-06 05:37:03 -07:00

api_delegation_http_probe.py

test: verify API Runs continuation consumers over loopback HTTP

2026-09-09 10:55:32 -07:00

api_delegation_sync_probe.py

fix: persist API delegation units once without waking the model

2026-09-09 10:55:32 -07:00

approval_deny_dispatch.py

fix(approvals): honor GNU env split escapes and argv0 operands

2026-09-07 14:30:41 -07:00

auth_pool_controls.py

fix: reject independent Nous account refresh without clearing cooldown

2026-09-07 08:06:48 -07:00

auxiliary_resource_exhausted.py

fix(auxiliary): ResourceExhausted spellings reach the payment/quota fallback gate

2026-09-06 05:48:39 -07:00

cli_deferred_notice.py

…

cli_fallback_add_picker_error.py

test(fallback): keep the two persisted-config invariants; PTY harness for the picker error path

2026-09-06 05:41:46 -07:00

codex_masked_replay_review.py

fix(codex): masked "invalid_prompt: Request blocked." replay rejection reaches the replay-strip recovery

2026-09-06 05:40:02 -07:00

completion_backlog_probe.py

test: verify completion barriers and document local delivery proof

2026-09-07 08:27:07 -07:00

cron_error_diagnostics.py

test(cron): exercise historical error redaction in live probe

2026-09-07 08:18:56 -07:00

cron_timeout_fork_race.py

fix(process): stop late forks escaping deadline tree cleanup

2026-09-07 08:19:32 -07:00

delivery_flood_wire.py

refactor: repoint 10 MessageEvent/MessageType importers that landed on main after the event.py split

2026-09-07 22:47:33 +05:30

desktop-reap-clock-pressure.cjs

test: make desktop orphan-reap deadline checks deterministic

2026-09-07 17:08:51 -07:00

fanout_resource_bench.py

…

gemini_type_array_probe.py

fix: preserve native Gemini union constraints

2026-09-07 21:10:50 -07:00

goal_command_parity.py

test: retain a reproducible CLI goal parity oracle

2026-09-07 00:51:41 -07:00

heartbeat_idle_wire.py

fix: refund heartbeat admissions that never enter agent execution

2026-09-07 14:16:57 -07:00

kanban_graph_identity.py

fix: retain Kanban decomposition identity and inherit parent tenants

2026-09-07 07:09:59 -07:00

kanban_pr_acceptance_live.py

test(kanban): exercise acceptance races through real run lifecycle

2026-09-07 04:46:54 -07:00

kanban_scope_probe.py

fix(evals): align Kanban probe with managed MCP overrides

2026-09-15 19:05:29 -07:00

key_cmd_picker_live.py

fix: keep command-auth model discovery lazy across config and setup

2026-09-07 21:22:49 -07:00

mcp_device_flow.py

test: device login through a later issuer-bound authorization server

2026-09-15 19:00:42 -07:00

output_caps_local_capture.py

test: exercise output-cap removal across native and child surfaces

2026-09-07 06:15:43 -07:00

output_caps_scope.md

docs: record native output-cap save validation

2026-09-07 06:15:43 -07:00

output_caps_surfaces.py

test: exercise output-cap removal across native and child surfaces

2026-09-07 06:15:43 -07:00

process_result_receipt_probe.py

fix(tools): keep retained terminal results scoped to their owner

2026-09-07 08:25:33 -07:00

session_snapshot_removal.py

fix: remove automatic session JSON snapshots

2026-09-07 08:08:41 -07:00

slack_stream_wire_contract.py

…

update_check_ssh_pty.py

test: verify SSH update checks with real PTY authentication controls

2026-09-07 08:21:24 -07:00

update_obligation_identity.py

fix(update): settle stale receipt warnings from matching live gateways

2026-09-07 08:20:46 -07:00

update_unit_client_budget.py

test: pass snapshot listings to the catch-up restart budget probe

2026-09-07 08:20:09 -07:00

vault_fill_live_e2e.py

fix(vault): dogfood fixes — offer save-login on every backend, keep the model off passwords, bind to the login tab

2026-09-10 10:35:07 -07:00