teknium1
f3e62619c7
fix(moa): keep the aggregator prefix byte-stable across tool-loop iterations
...
Attach the per-turn reference guidance as its own trailing user message
instead of merging it into a trailing user turn. Iteration 1 of every user
turn ends on user(task), so the merged user(task + guidance) byte-differed
from the user(task) that iteration 2+ replayed: the provider prefix cache
collapsed to the system prompt + tool schemas on the second call of every
turn (#112358 — cachedTokens pinned at the system prompt while uncached
input grew 14k -> 214k on a Nous/OpenAI aggregator).
peel_reference_guidance shrinks to the one attach shape (plain string, or
its cache-decorated single text part) so a breakpoint never lands on the
guidance. Converters that require strict alternation (Anthropic Messages,
Converse, native Gemini) already merge adjacent same-role turns.
Live wire probe (loopback server, two user turns x two iterations, real
MoA facade -> call_llm(nous)): before, request i+1 diverged from request i
at messages[1] (user task) on the second iteration of each turn; after,
every request's messages[:-1] is a byte prefix of the next. The same probe
shows the aggregator already carries the main loop's sticky session_id +
tags on the nous provider, so the routing hypothesis is not a Hermes gap.
2026-09-16 17:18:10 -07:00
..
2026-09-16 16:50:07 -07:00
2026-09-13 05:07:50 -07:00
2026-09-13 05:07:11 -07:00
2026-09-16 00:32:15 -07:00
2026-09-16 16:53:20 -07:00
2026-09-15 04:56:01 -07:00
2026-09-06 20:50:02 +05:30
2026-09-16 11:06:06 -07:00
2026-09-13 09:18:02 -07:00
2026-09-16 17:16:06 -07:00
2026-09-16 17:16:06 -07:00
2026-09-15 18:19:26 -07:00
2026-09-14 20:01:19 +05:30
2026-09-16 17:16:06 -07:00
2026-09-06 05:37:03 -07:00
2026-09-06 05:37:03 -07:00
2026-09-14 20:01:19 +05:30
2026-09-16 17:01:52 -07:00
2026-09-11 19:39:12 -07:00
2026-09-07 06:02:22 -07:00
2026-09-13 05:19:48 -07:00
2026-09-07 07:06:58 -07:00
2026-09-14 06:55:54 -07:00
2026-09-15 04:45:33 -07:00
2026-09-16 11:06:06 -07:00
2026-09-15 03:39:07 -07:00
2026-09-16 17:08:02 -07:00
2026-09-07 05:24:15 -07:00
2026-09-07 05:24:15 -07:00
2026-09-16 17:16:06 -07:00
2026-09-16 14:23:20 -07:00
2026-09-16 16:53:20 -07:00
2026-09-06 22:45:31 +05:30
2026-09-15 03:47:15 -07:00
2026-09-16 17:12:33 -07:00
2026-09-13 05:09:43 -07:00
2026-09-07 05:59:08 -07:00
2026-09-16 17:12:33 -07:00
2026-09-11 02:07:48 -07:00
2026-09-16 17:17:47 -07:00
2026-09-16 16:59:03 -07:00
2026-09-13 05:20:26 -07:00
2026-09-16 17:12:33 -07:00
2026-09-16 17:10:13 -07:00
2026-09-15 04:17:31 -07:00
2026-09-16 17:16:06 -07:00
2026-09-16 17:16:06 -07:00
2026-09-16 17:16:06 -07:00
2026-09-11 03:45:33 +05:30
2026-09-15 19:03:33 -07:00
2026-09-16 16:58:22 -07:00
2026-09-07 08:19:32 -07:00
2026-09-15 06:08:20 -07:00
2026-09-15 18:42:10 -07:00
2026-09-16 17:09:30 -07:00
2026-09-15 20:44:42 +05:30
2026-09-09 11:29:56 -07:00
2026-09-15 06:20:15 -07:00
2026-09-15 03:54:01 -07:00
2026-09-14 06:44:54 -07:00
2026-09-11 15:26:46 -07:00
2026-09-16 17:09:50 -07:00
2026-09-12 01:35:05 -07:00
2026-09-15 03:58:05 -07:00
2026-09-12 08:23:13 -07:00
2026-09-09 13:08:25 +05:30
2026-09-09 10:58:16 -07:00
2026-09-07 08:28:43 -07:00
2026-09-15 18:41:19 -07:00
2026-09-11 11:54:49 -07:00
2026-09-15 19:03:33 -07:00
2026-09-13 05:19:48 -07:00
2026-09-15 03:47:15 -07:00
2026-09-14 20:35:28 +05:30
2026-09-16 17:18:10 -07:00
2026-09-16 10:52:32 -07:00
2026-09-16 17:09:50 -07:00
2026-09-13 05:09:43 -07:00
2026-09-15 20:44:42 +05:30
2026-09-06 09:11:04 -07:00
2026-09-13 05:09:06 -07:00
2026-09-11 15:26:46 -07:00
2026-09-16 11:06:06 -07:00
2026-09-13 05:09:43 -07:00
2026-09-16 17:17:47 -07:00
2026-09-14 06:55:54 -07:00
2026-09-12 13:44:52 -07:00
2026-09-15 06:16:38 -07:00
2026-09-11 03:45:33 +05:30
2026-09-15 18:20:13 -07:00
2026-09-14 20:35:28 +05:30
2026-09-13 21:27:35 -07:00
2026-09-10 09:22:31 -07:00
2026-09-15 18:59:55 -07:00
2026-09-15 03:44:36 -07:00
2026-09-16 17:10:13 -07:00
2026-09-13 19:23:09 +05:30
2026-09-13 05:09:43 -07:00
2026-09-08 04:38:47 -07:00
2026-09-15 19:23:53 -07:00
2026-09-15 04:56:40 -07:00
2026-09-06 05:35:12 -07:00
2026-09-15 04:18:34 -07:00
2026-09-13 05:07:11 -07:00
2026-09-15 19:03:33 -07:00
2026-09-07 07:10:28 -07:00
2026-09-15 19:03:33 -07:00
2026-09-15 18:19:26 -07:00
2026-09-09 10:31:26 +05:30
2026-09-15 04:13:13 -07:00
2026-09-16 06:27:23 -05:00
2026-09-13 05:20:26 -07:00
2026-09-15 04:12:13 -07:00
2026-09-16 17:03:25 -07:00
2026-09-10 02:21:16 +05:30
2026-09-16 17:08:25 -07:00
2026-09-12 21:07:46 -07:00
2026-09-06 22:56:51 +05:30
2026-09-12 08:25:14 -07:00
2026-09-16 17:10:13 -07:00
2026-09-16 17:09:30 -07:00
2026-09-14 20:35:28 +05:30
2026-09-10 10:45:57 -07:00
2026-09-06 13:21:17 -07:00
2026-09-15 04:18:34 -07:00
2026-09-15 04:12:13 -07:00
2026-09-16 21:15:30 +05:30
2026-09-15 04:18:34 -07:00
2026-09-15 04:18:34 -07:00
2026-09-15 04:12:13 -07:00
2026-09-13 14:46:42 -07:00
2026-09-16 10:43:48 -07:00
2026-09-15 04:12:13 -07:00
2026-09-09 12:17:57 +05:30
2026-09-15 04:12:13 -07:00
2026-09-15 04:12:13 -07:00
2026-09-06 13:21:17 -07:00
2026-09-06 13:21:17 -07:00
2026-09-16 17:09:30 -07:00
2026-09-07 06:15:43 -07:00
2026-09-15 04:12:13 -07:00
2026-09-16 14:23:55 -07:00
2026-09-15 20:44:42 +05:30
2026-09-15 04:12:13 -07:00
2026-09-16 14:23:55 -07:00
2026-09-15 18:23:07 -07:00
2026-09-06 13:21:17 -07:00
2026-09-10 02:44:26 -07:00
2026-09-10 11:48:01 -07:00
2026-09-15 04:56:01 -07:00
2026-09-13 05:08:29 -07:00
2026-09-12 13:44:52 -07:00
2026-09-15 04:48:20 -07:00