teknium1
d7a4065568
perf(local-endpoints): disk L2 for server-type + ollama ctx probes, faster timeouts
...
Local-model users paid a fresh probe waterfall on EVERY CLI cold start
inside AIAgent.__init__: detect_local_server_type (up to 4 HTTP GETs,
2s timeout each on a hung server) + /api/show (3s timeout). The
existing caches were in-process only, so back-to-back invocations
(chat -q, cron ticks, subagents) re-paid the network every time.
- New 300s-TTL disk L2 at HERMES_HOME/cache/local_endpoint_probes.json
for detect_local_server_type verdicts and query_ollama_num_ctx
results. Only SUCCESSFUL probes persist (a down server never pins a
negative verdict); stale entries pruned on write; corrupted cache
degrades to a miss; atomic writes. 300s is strictly fresher than the
1h in-process TTL that already accepts server-swap staleness.
- models.dev fetch timeout 15 -> (5, 10) connect/read tuple: a
blackholed connect stalled the first-turn critical path 15s; now
fails in 5s (matches the OpenRouter fetch convention, #46620 ).
- _auto_detect_local_model timeout 5 -> (2, 3): runs inside
_get_model_config() at startup against a LOCAL endpoint; a hung local
server cost 5s before the banner.
E2E (real HTTP server, two fresh subprocesses, isolated HERMES_HOME):
proc1 = 2 HTTP hits, proc2 = 0 HTTP hits, identical results
(ollama/131072), probe wall 74.5 -> 35.5 ms. 222 targeted tests green
incl. 9 new disk-L2 contract tests.
2026-07-29 10:52:13 -07:00
..
2026-07-29 09:33:48 -07:00
2026-07-28 12:08:10 -07:00
2026-07-22 16:51:01 -04:00
2026-07-29 15:37:14 +00:00
2026-07-20 11:35:21 -07:00
2026-07-24 15:53:38 -07:00
2026-07-26 12:54:45 -07:00
2026-07-28 14:47:36 -07:00
2026-07-28 17:34:21 -07:00
2026-07-28 12:11:52 -05:00
2026-07-29 16:49:07 +05:30
2026-07-26 21:13:03 -07:00
2026-07-26 17:49:03 -07:00
2026-07-17 11:37:25 +05:30
2026-07-29 10:13:50 -07:00
2026-07-11 12:28:55 +05:30
2026-07-25 21:44:43 -07:00
2026-07-29 10:09:14 -07:00
2026-06-11 10:49:47 -07:00
2026-07-18 02:49:28 -07:00
2026-07-26 17:46:55 -07:00
2026-07-24 16:01:06 -07:00
2026-07-24 11:45:57 -07:00
2026-07-28 03:54:25 -05:00
2026-07-22 08:11:09 +05:30
2026-07-29 08:42:16 -07:00
2026-07-29 08:42:16 -07:00
2026-07-21 05:27:13 -07:00
2026-07-01 23:51:54 +05:30
2026-07-28 07:56:45 -07:00
2026-07-29 10:08:53 -07:00
2026-07-29 10:14:32 -07:00
2026-07-29 10:14:32 -07:00
2026-07-22 16:51:01 -04:00
2026-07-28 22:41:09 -07:00
2026-07-22 21:17:21 -07:00
2026-07-24 11:45:57 -07:00
2026-07-19 03:02:21 -07:00
2026-07-28 11:52:47 -07:00
2026-07-25 19:27:17 -07:00
2026-07-26 21:22:40 -07:00
2026-06-27 21:30:37 -07:00
2026-07-05 13:42:46 -07:00
2026-06-24 18:56:26 -07:00
2026-06-27 20:45:31 -07:00
2026-06-30 17:29:23 -07:00
2026-07-07 04:09:35 -07:00
2026-07-29 00:16:21 -07:00
2026-07-28 00:15:00 +05:00
2026-07-29 10:32:25 -07:00
2026-07-26 23:41:54 -07:00
2026-07-16 07:19:36 -07:00
2026-07-26 18:10:34 -07:00
2026-07-08 16:55:32 +10:00
2026-07-26 17:50:54 -07:00
2026-07-26 08:43:24 -07:00
2026-07-20 05:38:25 -07:00
2026-07-27 21:10:51 -07:00
2026-07-26 17:46:29 -07:00
2026-07-15 07:39:42 -07:00
2026-07-28 03:52:33 -05:00
2026-07-01 16:25:48 -05:00
2026-07-27 21:10:51 -07:00
2026-07-15 07:39:17 -07:00
2026-07-09 16:13:59 -05:00
2026-07-15 07:39:17 -07:00
2026-06-21 17:06:48 -07:00
2026-07-26 13:42:33 -07:00
2026-07-27 21:10:51 -07:00
2026-07-05 13:42:46 -07:00
2026-07-29 10:32:25 -07:00
2026-06-19 07:46:33 -07:00
2026-07-29 10:16:44 -07:00
2026-07-28 17:34:21 -07:00
2026-07-28 00:53:16 -05:00
2026-06-21 19:05:27 -07:00
2026-07-26 14:14:03 -07:00
2026-06-22 19:16:47 -05:00
2026-07-28 22:40:33 -07:00
2026-07-27 21:10:51 -07:00
2026-07-23 18:11:57 -07:00
2026-07-23 21:07:18 -07:00
2026-07-15 00:10:31 -07:00
2026-06-10 00:24:06 -07:00
2026-07-27 19:32:12 +05:30
2026-07-26 21:22:40 -07:00
2026-07-29 10:56:19 +05:30
2026-07-27 11:53:48 -04:00
2026-07-29 02:19:13 +05:30
2026-06-12 08:51:10 +00:00
2026-06-21 22:43:48 -07:00
2026-07-29 10:13:50 -07:00
2026-07-28 23:52:49 -07:00
2026-07-29 10:14:11 -07:00
2026-07-26 17:46:55 -07:00
2026-07-02 05:10:31 -07:00
2026-06-24 13:48:38 -05:00
2026-07-28 17:34:21 -07:00
2026-07-27 21:10:51 -07:00
2026-07-28 22:42:19 -07:00
2026-07-15 07:39:17 -07:00
2026-07-28 17:34:21 -07:00
2026-07-24 17:10:39 -07:00
2026-06-25 16:40:26 -05:00
2026-07-21 10:09:31 -04:00
2026-07-26 18:06:21 -07:00
2026-06-25 13:52:06 -07:00
2026-07-29 17:13:48 +05:30
2026-07-24 09:49:00 -07:00
2026-07-29 10:14:11 -07:00
2026-07-07 15:15:37 -07:00
2026-06-27 15:59:00 -07:00
2026-07-29 17:13:48 +05:30
2026-07-29 10:52:13 -07:00
2026-06-17 01:04:26 +08:00
2026-07-29 10:14:11 -07:00
2026-07-29 09:33:48 -07:00
2026-06-19 07:46:33 -07:00
2026-07-27 19:19:01 +05:30
2026-07-09 19:54:02 -07:00
2026-07-07 12:36:41 -07:00
2026-07-07 13:29:58 -07:00
2026-07-26 19:30:21 -07:00
2026-07-03 13:44:00 -07:00
2026-07-17 04:53:38 -07:00
2026-07-26 23:34:29 -07:00
2026-07-26 08:43:24 -07:00
2026-06-11 07:51:01 -07:00
2026-07-29 00:20:50 -07:00
2026-07-09 19:57:54 -07:00
2026-07-28 23:16:27 -07:00
2026-07-21 21:00:43 -05:00
2026-07-21 21:00:43 -05:00
2026-07-29 09:33:48 -07:00
2026-07-24 16:00:03 -07:00
2026-07-25 23:05:30 -07:00
2026-06-25 16:40:26 -05:00
2026-07-28 22:42:19 -07:00
2026-07-05 13:42:46 -07:00
2026-07-26 12:54:45 -07:00
2026-07-29 09:02:19 -07:00
2026-06-26 14:07:43 +05:30
2026-07-28 11:53:12 -07:00
2026-07-11 12:28:55 +05:30
2026-07-29 08:24:00 -07:00
2026-07-28 17:34:21 -07:00
2026-07-29 10:15:07 -07:00
2026-07-29 12:39:09 -05:00
2026-07-24 11:45:57 -07:00
2026-07-29 10:14:11 -07:00
2026-07-24 11:45:57 -07:00
2026-06-09 23:21:14 -07:00
2026-07-05 23:00:34 +05:30