f2f4df064d
The Nous Portal profile publishes a top-level `session_id` that the Portal uses as its sticky routing key, pinning a conversation to one upstream endpoint so explicit Anthropic `cache_control` breakpoints stay warm (those caches are instance-local, so a reroute cold-writes instead of reads). `NousProfile.build_extra_body` sourced that key only from the explicit `session_id` argument. Auxiliary call sites — compression, title generation, vision, web_extract, session_search, MoA slots — funnel through `agent.auxiliary_client`, which has no session handle and never passes one. They carried the `conversation=` tag but NO sticky key at all, so each one routed independently of the conversation it belonged to. Resolve the key the way `nous_portal_tags` already resolves that tag: ambient lineage-ROOT contextvar first, explicit argument as fallback. Fixes every aux call site at once with no per-call-site plumbing. Also publish the root in the `_compress_context` forwarder when nothing is ambient. Out-of-turn entry points (`/compact`, the gateway `/compress` command and its hygiene sweep, partial head compression) call it outside `run_conversation`'s scope, so the summarizer's aux call ran untagged and unkeyed; the caller's value is restored in `finally` so a compaction never leaks its tag. Scope note: this does NOT keep the compaction turn's own prompt cache warm. Compaction replaces the history with a summary and rebuilds the system prompt, so that request is a cold write on any endpoint — what a stable key buys is the turns AFTER compaction reading the cache it wrote. Under the default `compression.in_place: true` (#38763) the session id does not rotate at compaction, so for the main loop the ambient root and the explicit argument already agree; the ambient resolution additionally holds the key stable for installs that opt back into rotating compaction and across delegate-subagent trees. Salvaged from #71747. Subsumes the aux-call half of #70883 (@webtecnica), which threaded `session_id` through `call_llm` to close the same gap. Tests: 4 cases in tests/agent/test_portal_tags.py; both fix halves verified to fail against the pre-fix behavior via sabotage runs.
Model Provider Plugins
Each subdirectory is a self-contained provider profile plugin. The
directory layout mirrors plugins/platforms/:
plugins/model-providers/
├── openrouter/
│ ├── __init__.py # registers the ProviderProfile
│ └── plugin.yaml # manifest: name, kind, version, description
├── anthropic/
│ ├── __init__.py
│ └── plugin.yaml
└── ...
How discovery works
providers/__init__.py._discover_providers() scans this directory (and
$HERMES_HOME/plugins/model-providers/) the first time anything calls
get_provider_profile() or list_providers(). Each __init__.py is
imported and expected to call providers.register_provider(profile).
User plugins at $HERMES_HOME/plugins/model-providers/<name>/ override
bundled plugins of the same name — last-writer-wins in
register_provider(). Drop a file there to replace a built-in.
Adding a new provider
-
Create
plugins/model-providers/<your_provider>/__init__.py:from providers import register_provider from providers.base import ProviderProfile my_provider = ProviderProfile( name="your-provider", aliases=("alias1", "alias2"), display_name="Your Provider", description="One-line description shown in the setup picker", signup_url="https://your-provider.example.com/keys", env_vars=("YOUR_PROVIDER_API_KEY", "YOUR_PROVIDER_BASE_URL"), base_url="https://api.your-provider.example.com/v1", default_aux_model="your-cheap-model", ) register_provider(my_provider) -
Create
plugins/model-providers/<your_provider>/plugin.yaml:name: your-provider-profile kind: model-provider version: 1.0.0 description: Short sentence about the provider author: Your Name
Nothing else needs to change. auth.py, config.py, models.py,
doctor.py, model_metadata.py, runtime_provider.py, and the
chat_completions transport all auto-wire from the registry.
Non-trivial profiles
Override the ProviderProfile hooks in a subclass for per-provider
quirks — see plugins/model-providers/openrouter/__init__.py for
build_extra_body and build_api_kwargs_extras examples, and
plugins/model-providers/gemini/__init__.py for thinking_config
translation.