Teknium
6da034a60d
fix(mcp): a vision model sees MCP ImageContent instead of only its MEDIA: path
...
An MCP tool's ImageContent was cached and the model got back only a
`MEDIA:/path` line, so a vision main model could never read the image
(a raw cua-driver MCP server could not see the screen at all).
The registry handler now returns the `_multimodal` envelope when the
active route takes images inside tool results, decided by the same gate
vision_analyze and browser screenshots use (`agent.image_input_mode`, an
explicit `auxiliary.vision` backend, catalog vision, provider support).
The image is re-encoded from the sniffed cache file, normalized to a
provider-accepted format and sized to `vision.embed_target_bytes` /
1568 px (it is re-sent every later turn), at most 4 per result; the text
half keeps the MEDIA: paths. Paths come from this call's own cache
writes, never parsed out of server text. The resize runs on the tool
thread, off the shared MCP loop. Plugins' `ctx.call_mcp` keeps its
string contract (native_images is set only on the registry handler).
Builds on #131374 by @sarahwu185, which reused the computer_use capture
gate (ignores image_input_mode, native for catalog text-only models) and
inlined the server's raw base64 unvalidated and unresized.
2026-10-06 22:54:13 -07:00
..
2026-09-29 02:06:58 +05:30
2026-10-06 23:49:41 -05:00
2026-10-07 01:01:14 +05:30
2026-10-07 01:29:02 +05:30
2026-10-05 14:35:39 -04:00
2026-09-29 12:25:29 -05:00
2026-09-28 10:21:41 -07:00
2026-10-06 14:22:13 -07:00
2026-10-06 14:22:13 -07:00
2026-10-05 01:15:16 -07:00
2026-10-01 13:23:12 -07:00
2026-10-06 14:22:13 -07:00
2026-10-06 14:22:13 -07:00
2026-10-02 01:24:41 +05:30
2026-09-28 10:21:41 -07:00
2026-10-01 16:18:46 +05:30
2026-09-30 10:00:37 -05:00
2026-09-30 10:00:37 -05:00
2026-09-28 06:06:17 -07:00
2026-10-01 16:18:46 +05:30
2026-09-28 10:21:41 -07:00
2026-09-28 10:21:41 -07:00
2026-10-05 17:10:58 -07:00
2026-10-05 17:10:58 -07:00
2026-09-28 12:43:03 -07:00
2026-10-05 16:42:57 -05:00
2026-10-02 22:54:53 -05:00
2026-10-01 03:18:09 -05:00
2026-10-02 22:54:53 -05:00
2026-10-02 11:24:58 -05:00
2026-09-29 14:12:41 -04:00
2026-10-01 13:23:12 -07:00
2026-10-05 01:15:16 -07:00
2026-09-28 10:21:41 -07:00
2026-09-28 06:42:00 -07:00
2026-09-28 10:11:33 -07:00
2026-09-28 12:43:03 -07:00
2026-09-28 10:21:41 -07:00
2026-09-28 10:11:33 -07:00
2026-10-02 01:18:03 +05:30
2026-10-03 16:31:09 +05:30
2026-10-06 14:51:26 -04:00
2026-10-05 16:40:38 -05:00
2026-10-02 20:24:30 -05:00
2026-10-02 21:49:36 -05:00
2026-10-05 16:40:38 -05:00
2026-10-02 21:49:36 -05:00
2026-09-28 10:21:41 -07:00
2026-10-01 01:53:55 -05:00
2026-09-28 10:21:41 -07:00
2026-09-29 12:25:29 -05:00
2026-10-05 16:46:53 -05:00
2026-09-28 10:21:41 -07:00
2026-09-28 10:21:41 -07:00
2026-09-28 10:21:41 -07:00
2026-10-06 15:39:24 +00:00
2026-10-02 01:15:39 +05:30
2026-10-02 21:47:39 -05:00
2026-10-06 15:39:24 +00:00
2026-09-27 01:10:56 +05:30
2026-10-06 15:39:24 +00:00
2026-10-06 15:39:24 +00:00
2026-10-06 15:39:24 +00:00
2026-09-28 10:21:41 -07:00
2026-10-02 01:15:39 +05:30
2026-10-05 01:15:16 -07:00
2026-10-01 16:22:28 +05:30
2026-10-01 16:22:28 +05:30
2026-09-26 18:27:10 -05:00
2026-10-07 11:19:10 +05:30
2026-10-02 20:24:01 -05:00
2026-09-29 15:08:07 +05:30
2026-10-04 00:10:54 +05:30
2026-10-03 10:26:12 -07:00
2026-09-25 14:27:51 +05:30
2026-09-28 10:21:41 -07:00
2026-09-28 10:21:41 -07:00
2026-10-07 01:01:14 +05:30
2026-09-28 02:03:42 +05:30
2026-10-04 12:42:25 -05:00
2026-10-06 22:54:13 -07:00
2026-10-04 12:42:25 -05:00
2026-09-27 21:30:10 -07:00
2026-10-06 22:54:13 -07:00
2026-10-03 09:38:33 -07:00
2026-09-27 21:30:10 -07:00
2026-10-06 22:54:13 -07:00
2026-10-05 16:47:32 -05:00
2026-09-28 05:24:26 -07:00
2026-10-02 20:29:17 -05:00
2026-09-28 10:21:41 -07:00
2026-10-05 22:07:41 -07:00
2026-10-05 22:07:41 -07:00
2026-09-28 10:21:41 -07:00
2026-09-28 10:21:41 -07:00
2026-09-28 10:21:41 -07:00
2026-10-06 15:39:24 +00:00
2026-09-28 10:21:41 -07:00
2026-10-03 09:43:03 -07:00
2026-10-03 09:43:03 -07:00
2026-09-28 10:21:41 -07:00
2026-09-26 17:19:34 -05:00
2026-10-06 00:00:57 -04:00
2026-09-26 22:19:53 -05:00
2026-10-05 14:35:39 -04:00
2026-10-07 01:03:03 +05:30
2026-09-28 10:21:41 -07:00
2026-10-07 01:03:03 +05:30
2026-09-29 12:25:29 -05:00
2026-09-29 12:25:29 -05:00
2026-09-28 10:21:41 -07:00
2026-10-07 01:03:03 +05:30
2026-10-05 18:39:43 -05:00
2026-10-04 00:08:20 -07:00
2026-10-05 18:39:43 -05:00
2026-09-28 10:21:41 -07:00
2026-09-28 10:21:41 -07:00
2026-10-03 23:05:48 -07:00
2026-10-03 23:05:48 -07:00
2026-10-06 12:00:47 -04:00
2026-10-03 23:05:48 -07:00
2026-09-28 10:21:41 -07:00
2026-10-01 22:05:55 -07:00
2026-10-05 15:56:28 -07:00
2026-09-28 12:43:03 -07:00
2026-10-05 15:56:28 -07:00
2026-10-05 15:56:28 -07:00
2026-09-28 10:21:41 -07:00
2026-10-05 16:00:48 -07:00
2026-09-28 10:21:41 -07:00
2026-10-05 00:23:05 -07:00
2026-10-03 23:05:48 -07:00
2026-09-28 10:21:41 -07:00
2026-09-30 15:16:40 -05:00
2026-10-02 01:24:41 +05:30
2026-09-28 10:21:41 -07:00
2026-09-28 12:33:01 -07:00
2026-09-26 18:27:10 -05:00
2026-09-26 18:27:10 -05:00
2026-09-26 18:27:10 -05:00
2026-10-02 22:42:55 -05:00
2026-10-05 20:08:11 +05:30
2026-10-05 20:08:11 +05:30
2026-10-06 14:22:13 -07:00
2026-10-06 09:53:34 -04:00
2026-10-06 02:53:56 -07:00
2026-09-28 10:21:41 -07:00
2026-10-04 11:56:08 +05:30
2026-10-07 01:01:14 +05:30
2026-10-07 01:02:34 +05:30
2026-10-07 01:02:34 +05:30
2026-10-06 12:08:49 -07:00
2026-10-06 12:08:49 -07:00
2026-10-05 16:40:15 -05:00
2026-10-06 22:01:38 -07:00
2026-10-06 22:01:38 -07:00
2026-10-06 12:50:31 -07:00
2026-10-06 12:08:49 -07:00
2026-10-05 12:37:46 -04:00
2026-10-02 18:35:34 -05:00
2026-10-06 00:52:41 -07:00
2026-09-30 23:02:33 -05:00
2026-09-28 12:23:25 -07:00
2026-10-06 00:52:41 -07:00
2026-09-26 06:19:34 +05:30
2026-10-05 16:42:22 -05:00
2026-09-28 10:21:41 -07:00
2026-10-01 01:50:16 -05:00
2026-10-04 17:54:05 -07:00
2026-10-06 12:50:31 -07:00
2026-10-06 12:50:31 -07:00
2026-09-29 19:14:28 -05:00
2026-09-28 10:21:41 -07:00
2026-10-01 23:55:54 +05:30
2026-10-06 02:53:56 -07:00
2026-09-28 10:21:41 -07:00
2026-10-05 20:08:11 +05:30
2026-09-28 10:21:41 -07:00