From 30de041b011aa3d3830a7ffa05815e2cb2f063be Mon Sep 17 00:00:00 2001 From: teknium1 <127238744+teknium1@users.noreply.github.com> Date: Sat, 19 Sep 2026 15:00:41 -0700 Subject: [PATCH] docs: explain the three gateway connection-failure replies The chat reply now differs for an interrupted connection, a refused/unroutable endpoint and a cause-free SDK connection error; the FAQ names each wording and what to do about it so a user reading one on Telegram/Discord/Slack knows whether to restart the model server or just /retry (#116323). --- website/docs/reference/faq.md | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/website/docs/reference/faq.md b/website/docs/reference/faq.md index 9d96c5474d..db9777c1db 100644 --- a/website/docs/reference/faq.md +++ b/website/docs/reference/faq.md @@ -236,6 +236,16 @@ See [Security](../user-guide/security.md) for Hermes' documented execution contr **Solution:** if the request is large (hundreds of KB — long coding sessions reach this once the context grows) and short new chats work, the endpoint or a proxy in front of it is likely rejecting bodies that size: raise its body limit, or run `/compress` to shrink the context. If the request is small, the endpoint is unreachable — check the `base_url`, then retry with `/retry`. `logs/agent.log` records the exception chain for each attempt. +#### Messaging replies: "interrupted mid-request" vs "not running or is unreachable" vs "could not reach" + +Chat surfaces (Telegram, Discord, Slack, …) never show the raw transport exception; the gateway maps it to one of three short replies, and the difference tells you where to look: + +| Reply | What happened | What to do | +|---|---|---| +| "The connection to the AI model service was **interrupted mid-request** — usually transient." | An established connection was cut (`Connection reset by peer`, EOF, `RemoteProtocolError`). The endpoint answered the connect, so it is running. | `/retry`. If it recurs on large requests, see the "stream" entry above. | +| "The AI model service isn't reachable right now — the configured model endpoint is **not running or is unreachable**." | Nothing accepted the connection (`Connection refused`, no route to host, DNS failure). | Start the model server / check `base_url`, then `/retry`; `hermes doctor` on the host. | +| "Hermes **could not reach** the AI model service (no further detail from the SDK)." | The SDK reported a generic `APIConnectionError` and kept no cause; neither of the above is certain. | `/retry`; `hermes doctor` if it persists. The raw exception is in `hermes logs`. | + #### `/model` only shows one provider / can't switch providers **Cause:** `/model` (inside a chat session) can only switch between providers you've **already configured**. If you've only set up OpenRouter, that's all `/model` will show.