8d256ff184
0.5.1 (11d0038) -> 0.6.0 (5d63426). Plugin is now a thin adapter over PyPI evalroute>=0.7,<0.8. Extends the dispatch disclosure with the env inheritance fact; the library (0.7.1) strips HERMES_YOLO_MODE from the worker, per the review on this PR.
20 lines
2.2 KiB
YAML
20 lines
2.2 KiB
YAML
name: evalroute
|
|
repo: https://github.com/keppy/hermes-plugin-evalroute
|
|
sha: 5d63426425d3aceaed75249191efe63b419a4c36
|
|
description: "Route a task to the right (model, reasoning effort) arm before you start. Classifies the task into a lane, prints a provenance-carrying route card, and installs per-model reasoning-effort defaults. Strong rules run locally; weak-signal classification calls the host LLM and consumes tokens. The separate harness and shim can make paid provider calls when explicitly run; no plugin-owned credentials. Disclosure — weak-signal task classification sends the task text to your active Hermes model via the host LLM facade (token cost). The model-callable tool, /route, /rate and observed /model and /reasoning commands append task text and command args to a local ledger at <HERMES_HOME>/evalroute/labels.jsonl. \"hermes evalroute install-routes\" rewrites agent.reasoning_overrides in config.yaml when you run it. The bundled harness and Hermes shim are never run by the plugin. When run by hand they make paid provider calls, execute model-generated code on the host via shell checkers, and run hermes -z with approvals bypassed. Disclosure — \"hermes evalroute sync\" (run by hand) downloads the route table from the Hugging Face dataset keppy/evalroute-flywheel into HERMES_HOME and route cards then show that dataset's text; \"hermes evalroute dispatch\" (run by hand) spawns a single-query hermes chat on the routed model (Nous provider by default) with the brief as its query, inheriting the current environment except HERMES_YOLO_MODE (the worker never inherits --yolo; its approvals follow approvals.single_query_mode, default deny), and writes its report and a .dispatch.json sidecar beside the brief. As of 0.6.0 the plugin is a thin adapter: all behaviour lives in the PyPI package evalroute (>=0.7,<0.8), declared as a Python dependency that Hermes installs on your confirmation."
|
|
maintainer: keppy
|
|
tier: community
|
|
category: tools
|
|
requires_hermes: ">=0.21"
|
|
version: "0.6.0"
|
|
docs_url: https://github.com/keppy/hermes-plugin-evalroute#readme
|
|
capabilities:
|
|
provides_tools:
|
|
- evalroute_route
|
|
provides_hooks:
|
|
- pre_llm_call
|
|
- pre_command
|
|
- post_llm_call
|
|
provides_middleware: []
|
|
requires_env: []
|