Teknium 1d06f7a95a docs+evals(compression): token-accounting replay harness and developer-guide section (#104462) ...

evals/token_accounting/replay_gates.py runs the REAL AIAgent turn loop against a local fake
chat-completions server with scripted usage.prompt_tokens, in three shapes (CLI same-object
history, gateway JSON-reloaded history, SessionDB close/reopen + fresh agent) x two arms
(transcript 3x threshold by bytes/4 while real usage is under; transcript tiny while real usage is
over). Acceptance: no gate fires when real usage is under threshold regardless of estimate
inflation; every gate fires once real usage is over.

origin/main 5f406d88ea: cli/gateway/restore inflated all FAIL (1 local compaction each on the
estimate). This branch: 6/6 PASS, anchor restored in the fresh process.

2026-09-06 13:21:17 -07:00

..

browser_use

refactor(browser_exec): schema diet 803->663 tok/call, A/B-gated; eval harness runs on Windows + Nous auth (#96300)

2026-08-27 04:39:19 -07:00

codebase_navigability

docs+evals: AGENTS.md for the facade/siblings layout; codebase-navigability benchmark harness

2026-09-03 23:55:56 -07:00

compaction

fix(compression): lean compaction makes exactly one auxiliary request per attempt

2026-08-30 09:03:57 -07:00

core_tool_deferral

lint: explicit encoding on harness file opens (ruff unspecified-encoding)

2026-08-29 19:04:29 -07:00

gateway_status_render

refactor(gateway): iteration-progress formatter lives in agent/session_activity, tests trimmed to the invariant bar

2026-09-06 05:35:12 -07:00

native_compaction

eval(native-compaction): real-AIAgent A/B probe for checkpoint preflight false-trigger

2026-09-06 09:09:00 -07:00

postmortem

evals(postmortem): notice probes target a grouped unit (per-group split on main; ungrouped tasks already report individually)

2026-09-06 12:12:09 -07:00

readtool

…

session_search_schema

…

token_accounting

docs+evals(compression): token-accounting replay harness and developer-guide section (#104462)

2026-09-06 13:21:17 -07:00

webhook_auth

fix(webhook): only webhook-signature commits a delivery to the Standard Webhooks path

2026-09-06 05:35:48 -07:00

__init__.py

docs+evals: AGENTS.md for the facade/siblings layout; codebase-navigability benchmark harness

2026-09-03 23:55:56 -07:00

anthropic_proxy_thinking_replay.py

test(anthropic): trim DeepSeek proxy replay tests to two invariants + local wire probe

2026-09-06 05:37:03 -07:00

auxiliary_resource_exhausted.py

fix(auxiliary): ResourceExhausted spellings reach the payment/quota fallback gate

2026-09-06 05:48:39 -07:00

cli_deferred_notice.py

fix(banner): deferred update notice keeps prompt_toolkit routing; drop dead console arg; PTY harness

2026-09-06 05:36:26 -07:00

cli_fallback_add_picker_error.py

test(fallback): keep the two persisted-config invariants; PTY harness for the picker error path

2026-09-06 05:41:46 -07:00

codex_masked_replay_review.py

fix(codex): masked "invalid_prompt: Request blocked." replay rejection reaches the replay-strip recovery

2026-09-06 05:40:02 -07:00

fanout_resource_bench.py

bench: explicit utf-8 encoding on text-mode opens (ruff PLW1514)

2026-09-03 02:31:59 -07:00

slack_stream_wire_contract.py

test(evals): wire-contract A/B harness for Slack chat.*Stream payloads

2026-09-06 05:34:36 -07:00