@wendellresearch-ai/benchwarmers 0.6.3 → 0.6.4

package/AGENTS.md

@@ -124,7 +124,9 @@ in `bench.skipped`. One the catalog knows nothing about sits once its model
 popup ticks Vision / OCR.
 After the person checks an answer against the real work, record a verdict
 (dashboard, or `POST /bench/verdict`); verdicts choose the next panels. See
-GATEWAY.md for the whole contract.
+GATEWAY.md for the whole contract. To set an app up on the gateway (opencode,
+VS Code, Codex, Zed, Continue, Cline, Kilo Code, Claude Code, goose, chat
+apps), CLIENTS.md has each one's configuration, file by file.
 
 ## Beyond this machine
 

package/BENCHMARKS.md

@@ -70,7 +70,7 @@ earlier scores on the same tasks, over the last 30 days (or 60).
 
 Whether the provider was there when the bench called it, from the calls the
 bench makes anyway: one cell a day, by provider and then by model, over the
-last 7 days (or 30). At a glance has each model's 7 days too.
+last 7 days (or 30).
 
 - **Down**: the provider was busy or overloaded (a 5xx, high demand, a shared
   pool's 429), unreachable (a broken stream, no reply), timed out (the

package/README.md

@@ -419,6 +419,8 @@ collections and MCP server, with a Copy button: opencode, VS Code chat, Codex
 CLI, Zed, Continue, Cline and Kilo Code, Claude Code, goose, and chat apps
 (LobeHub, AnythingLLM, Cherry Studio, Chatbox, LibreChat). Where keys are
 asked for, it makes one and fills it in, never into a file that may sync.
+The same set-ups are in [CLIENTS.md](CLIENTS.md), with a fresh install's
+address and collections, for reading here or handing to an agent.
 
 <!-- The MCP Registry's proof that the PyPI package is this server (server.json):
 mcp-name: io.github.WendellResearch-AI/benchwarmers -->

package/USAGE.md

@@ -25,15 +25,14 @@ coding agent doing it with you); the gateway's whole contract is in
 
 | Group | Page | What it is for |
 | --- | --- | --- |
-| Observe | **At a glance** | Every model on the bench: whether it works right now, its uptime over 7 days, its role, and its connection. Click a name for its popup: role, alias, facts, options, retire. |
+| Observe | **Benchmarks** | The home page. How models do on the suite and on real work: bugs found against false alarms, who is confidently wrong, each model against its own earlier scores, uptime, speed, and the decision models. Each report shares as an image or its table. |
 | | **Action needed** | What will not fix itself, by the connection it comes from, with Retry and Retire on each model. |
-| | **Benchmarks** | How models do on the suite and on real work: bugs found against false alarms, who is confidently wrong, each model against its own earlier scores, uptime, speed, and the decision models. Each report shares as an image or its table. |
 | | **Quota management** | A tile per provider: what is left, when it resets, and which of its models are resting. Then the week's resets, and what the bench sent. |
 | | **Logs** | Gateway calls (who sat and how it went, never the prompt), changes made from the dashboard, the scheduler, and onboarding runs. |
 | Gateway | **Endpoints** | Where models are served from. Add an endpoint (a provider's sign-in, or any OpenAI-compatible API key), change a key, and see what each one serves. A model server running on this machine, at its usual port or any other its process is listening on (LM Studio, Jan, llama.cpp, vLLM and the like), is offered under Found on this machine: Add opens the dialog with it filled in, to test and save. Also your own app registrations and rate limits per connection. |
-| | **Models** | Every model on the bench, by the connection it comes from. |
+| | **Models** | Every model on the bench, by the connection it comes from: what it holds, its reply time and its limits. One search above every table, each table folds, and Collapse all / Expand all. Click a name for its popup: role, alias, facts, options, retire. |
 | | **Collections** | The named panels your apps ask for, and the gateway's settings. |
-| | **Clients** | Each popular app's set-up (opencode, VS Code, Codex, Zed, Continue, Cline, Kilo Code, Claude Code, goose, chat apps), filled in from this install, with Copy and a gateway key made on the spot. |
+| | **Clients** | Each popular app's set-up (opencode, VS Code, Codex, Zed, Continue, Cline, Kilo Code, Claude Code, goose, chat apps), filled in from this install, with Copy and a gateway key made on the spot. [CLIENTS.md](CLIENTS.md) has the same, for a fresh install. |
 | | **Discover** | Models worth adding, from public catalogs, with the ways this install can reach each one. |
 | Control | **Settings** | Theme, gateway keys, the scheduler, the model client, providers whose free models work only in their own app, export and import, how the install is reached (shown only), and Restart. |
 | | **Info** | The source repository, the version (linking its release), Python, data folder and counts. |
@@ -52,8 +51,7 @@ clears the alert) and Retire. A group of two or more has Retry all and Retire
 all; a connection held because every model on it fails says so above its
 models, with any link the provider gave. Automatic retirements from the last
 week are folded at the end, each with Restore. Its count sits beside it in the
-sidebar, and At a glance opens on one line saying what is waiting and how
-soon. An alert whose models have all been retired goes at once. A model that
+sidebar. An alert whose models have all been retired goes at once. A model that
 is out of quota is not counting down: days the bench held its calls back until
 a stated reset, an account's shared free quota was spent, or the provider said
 the model's free quota is used up, pause its clock, and while it is still out

package/VERSION

@@ -1 +1 @@
-0.6.3
+0.6.4

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@wendellresearch-ai/benchwarmers",
-  "version": "0.6.3",
+  "version": "0.6.4",
   "description": "Self-hosted panel gateway for LLMs: ask a collection of models at once, keep every answer side by side, rotate explorer models in, and let your verdicts pick the next panel.",
   "mcpName": "io.github.WendellResearch-AI/benchwarmers",
   "license": "MIT",

package/scripts/check.py

@@ -49,6 +49,7 @@ CHECKS = [
     ("scripts/onboard.py", ["--selftest"], False),
     ("scripts/export_check.py", ["--selftest"], False),
     ("scripts/notice.py", ["--check"], False),
+    ("scripts/clients_doc.py", ["--check"], False),       # CLIENTS.md is what the Clients page shows
     ("scripts/check_themes.py", [], False),
     ("scripts/test_owui.py", [], False),
     ("scripts/test_hubs.py", [], False),

package/scripts/clients_doc.py

@@ -0,0 +1,98 @@
+"""Write CLIENTS.md from the dashboard's Clients page, so each app's set-up is in
+the repository for people and agents to read, and never drifts from the page.
+
+    python scripts/clients_doc.py           # write CLIENTS.md
+    python scripts/clients_doc.py --check   # fail if CLIENTS.md is not what it would write (check.py)
+
+One source: serve.client_setups, the function the Clients page draws. The page
+fills in this install (its address, its collections, a key made on the spot);
+here they are the defaults a fresh install has: the server at 127.0.0.1:8122,
+collections `core` and `fast`, and every call needing a gateway key, read from
+BENCHWARMERS_KEY. The page's HTML (code, links) becomes Markdown.
+"""
+
+from __future__ import annotations
+
+import html
+import os
+import pathlib
+import re
+import sys
+import tempfile
+
+ROOT = pathlib.Path(__file__).resolve().parent.parent
+OUT = ROOT / "CLIENTS.md"
+COLLECTIONS = [("core", None, False), ("fast", None, False)]
+
+
+def md(text: str) -> str:
+    """The page's inline HTML as Markdown: code, links, line breaks; any other tag dropped."""
+    text = re.sub(r"<code>(.*?)</code>", lambda m: "`" + html.unescape(m.group(1)) + "`", text)
+    text = re.sub(r"<a [^>]*href='([^']*)'[^>]*>(.*?)</a>", r"[\2](\1)", text)
+    text = re.sub(r"<br\s*/?>", "  \n", text)
+    return html.unescape(re.sub(r"<[^>]+>", "", text))
+
+
+def fence(lang: str, text: str) -> str:
+    tick = "````" if "```" in text else "```"
+    return f"{tick}{lang}\n{text}\n{tick}"
+
+
+def render() -> str:
+    # serve reads the data folder at import: an empty temp one, never the install's.
+    os.environ.setdefault("BENCHWARMERS_HOME", tempfile.mkdtemp(prefix="bench-clients-doc-"))
+    sys.path[:0] = [str(ROOT), str(ROOT / "metrics"), str(ROOT / "suite")]
+    import serve
+    root = serve.DEFAULT_SERVER
+    out = ["# Setting up clients",
+           "",
+           "Every app Benchwarmers has a ready set-up for, as the dashboard's **Clients** page shows it,"
+           " written out for people and for agents setting an app up. The page fills in your own install:"
+           " its address, your collections and a gateway key made on the spot. Here they are a fresh"
+           f" install's: the server at `{root}`, the collections `core` and `fast`, and a gateway key"
+           f" read from `{serve.KEY_ENV}`. Replace them with yours.",
+           "",
+           "Agents get a collection in route mode (one member with its tools, `bench/<collection>:route`);"
+           " chat windows a merged answer (`:merged`); the MCP server the panel itself, as ask and verdict"
+           f" tools. Gateway `{root}/v1` · MCP server `{root}/mcp`.",
+           "",
+           f"_Generated from `serve.client_setups` by `scripts/clients_doc.py`; each app's format follows its"
+           f" own docs as read on {serve.CLIENTS_READ}. Do not edit by hand: run the script._",
+           "",
+           "## The gateway key",
+           "",
+           "When every call needs a key (`BENCHWARMERS_REQUIRE_KEYS=1`, or an admin token), make one on"
+           " Settings or the Clients page. Most set-ups read it from"
+           f" `{serve.KEY_ENV}`:",
+           ""]
+    for s in serve._env_snips(serve.KEY_ENV):
+        out += [f"**{s['label']}**", "", fence(s["lang"], s["text"]), ""]
+    setups = serve.client_setups(root, COLLECTIONS, True)
+    out += ["## Contents", ""] + [f"- [{c['name']}](#{c['id']})" for c in setups] + [""]
+    for c in setups:
+        out += [f"<a id='{c['id']}'></a>", "", f"## {c['name']}", "", md(c["gets"]), "",
+                f"**Where it goes:** {md(c['where'])}", ""]
+        for s in c["blocks"]:
+            out += [f"**{s['label']}**", "", fence(s["lang"], s["text"]), ""]
+        docs = ", ".join(f"[{t}]({u})" for u, t in c["docs"])
+        out += [f"**Watch for:** {md(c['watch'])}", "",
+                f"Written from {docs}, read {serve.CLIENTS_READ}"
+                + (f": {md(c['docs_note'])}" if c.get("docs_note") else "."), ""]
+    return "\n".join(out).rstrip() + "\n"
+
+
+def main() -> int:
+    text = render()
+    if "--check" in sys.argv:
+        if not OUT.exists() or OUT.read_text(encoding="utf-8") != text:
+            print("CLIENTS.md is not what serve.client_setups gives: run python scripts/clients_doc.py")
+            return 1
+        print("CLIENTS.md matches the Clients page")
+        return 0
+    OUT.write_text(text, encoding="utf-8", newline="\n")
+    print(f"wrote {OUT.name}")
+    return 0
+
+
+if __name__ == "__main__":
+    sys.exit(main())

package/serve.py

@@ -2254,27 +2254,6 @@ def open_count(groups: dict) -> int:
     return sum(len(g["rows"]) + len(g["held"]) for g in groups.values())
 
 
-def and_list(parts: list[str]) -> str:
-    return " and ".join(parts) if len(parts) < 3 else ", ".join(parts[:-1]) + " and " + parts[-1]
-
-
-def actions_line(groups: dict) -> str:
-    """At a glance's one line about Action needed, when anything is open:
-    what is waiting and how soon, and the way to its page."""
-    rows = [r for g in groups.values() for r in g["rows"]]
-    held = sum(len(g["held"]) for g in groups.values())
-    if not rows and not held:
-        return ""
-    models = sum(1 for r in rows if r["alias"])
-    what = and_list([f"{n} {word}{'s' * (n != 1)}" for n, word in
-                     ((models, "model"), (held, "connection"), (len(rows) - models, "notice")) if n])
-    soon = min(r["days"] for r in rows) if rows else 99
-    many = sum(r["days"] == soon for r in rows)
-    when = (f"; {many} retire{'s' * (many == 1)} in {soon} day{'s' * (soon != 1)}" if soon < 99 else "")
-    return (f"<p class='a-line'><strong>Action needed</strong> <span>{what}{when}.</span>"
-            " <button type='button' class='linkish' data-go='needs'>Review →</button></p>")
-
-
 def actions_page(groups: dict, auto: list) -> str:
     """Action needed, its own page since 2026-11-02: it sat above every page
     and grew to a screen and more of red. Grouped by connection, because
@@ -2373,167 +2352,6 @@ def price_of(alias: str, served: str, f: dict) -> str:
     return "paid" if sources.is_free(f.get("cost")) is False else "unknown"
 
 
-def facet(name: str, label: str, values) -> str:
-    """A filter by one column's value, beside a panel's search box (bench.js
-    matches it against each row's data-<name>)."""
-    opts = "".join(f"<option value='{esc(v)}'>{esc(v)}</option>" for v in sorted(set(values) - {""}))
-    return (f"<label>{esc(label)} <select data-facet='{esc(name)}'><option value=''>any</option>"
-            f"{opts}</select></label>")
-
-
-def facts_cells(alias: str, f: dict | None = None) -> str:
-    """Context window and capabilities, from metrics/catalog.py; a value you
-    entered is marked, and an unknown one says so rather than looking empty."""
-    f = f or catalog.info(alias)
-    ctx = f.get("context_window")
-    src = f["sources"].get("context_window", "")
-    ctx_cell = (f"<td class='num' data-sort='{ctx}' title='{esc(src)}'>"
-                f"{ctx // 1000:,}k{'*' if src == 'you' else ''}</td>" if ctx
-                else "<td class='num muted' data-sort='-1' title='unknown: fill it in the model popup'>?</td>")
-    caps = [CAP_LABELS[c] for c in catalog.CAPS if f.get(c)]
-    return ctx_cell + (f"<td class='caps'>{' '.join(chip(c, '') for c in caps)}</td>" if caps
-                       else "<td class='muted'>—</td>")
-
-
-def roster() -> str:
-    """Every model on one table: its state, what it has done, what it scored.
-
-    Replaces a grid of offload cards that answered only "what was it used
-    for". Status first, because the first question on opening this page is
-    whether anything is broken; real work second; benchmarks after."""
-    try:
-        from offload import summary
-        work = summary()
-    except Exception:                              # noqa: BLE001
-        work = {}
-    try:
-        import auto_retire
-        rows, answers, _ = auto_retire.evidence()
-    except Exception:                              # noqa: BLE001
-        rows, answers = [], {}
-    last = dict(answers)
-    for r in rows:
-        if r["answered"]:
-            last[r["alias"]] = max(last.get(r["alias"], r["date"]), r["date"])
-    suite: dict[str, list[int]] = {}
-    for (_task, model), hit in suite_scores().items():
-        if (m := re.match(r"(\d+)/(\d+)", hit["found"])):
-            got = suite.setdefault(model, [0, 0, 0])
-            got[0] += int(m.group(1)); got[1] += int(m.group(2)); got[2] += 1
-    tiny = {r["model"]: float(r["p50_s"]) for r in perf_rows()
-            if r["prompt"] == "tiny" and int(r.get("answered") or 0) > 0}
-    status = model_status()
-    new = recently_onboarded()
-    stuck = onboard_issues(status)
-    directory = model_directory()
-    severity = {"err": 0, "warn": 1, "": 2, "ok": 3}
-
-    up = uptime_rows()["models"]
-    body = ["<table><thead><tr>", th("Model"), th("Status"), th("Uptime 7d", True), th("Role"),
-            th("Context", True), th("Can"),
-            th("Offloads", True), th("Helped"), th("Suite", True),
-            th("Reply time", True), th("Last answer"), "</tr></thead><tbody>"]
-    # The model browser: each row says its connection, status, role and price
-    # for the toolbar's filters, and the filters offer what the rows hold.
-    offered: dict[str, list[str]] = {"connection": [], "status": [], "role": [], "price": []}
-
-    def browse(**values) -> str:
-        for k, v in values.items():
-            offered[k].append(v)
-        return "".join(f" data-{k}='{esc(v)}'" for k, v in values.items())
-    for alias in sorted(status, key=lambda a: (-work.get(a, {}).get("offloads", 0), a)):
-        label, css, why = status[alias]
-        f = catalog.info(alias)
-        served = directory.get(alias, {}).get("served") or retired().get(alias, {}).get("served", "")
-        w = work.get(alias, {})
-        judged, useful = w.get("judged", 0), w.get("useful", 0)
-        if judged:
-            rate = useful / judged
-            helped = (f"<span class='helped'><span class='meter'><span"
-                      f"{' class=low' if rate < .5 else ''} style='width:{max(4, round(rate * 100))}%'>"
-                      f"</span></span><span class='mono'>{useful}/{judged}</span></span>")
-        else:
-            rate, helped = -1, "<span class='muted'>not judged</span>"
-        s = suite.get(alias)
-        suite_cell = (f"<td class='num' data-sort='{s[0] / s[1]:.3f}'"
-                      f" title='{s[2]} task{'s' * (s[2] != 1)}'>{s[0]}/{s[1]}</td>"
-                      if s and s[1] else "<td class='num muted' data-sort='-1'>—</td>")
-        p50 = tiny.get(alias)
-        seen = last.get(alias)
-        role = directory.get(alias, {}).get("role") or retired().get(alias, {}).get("role", "")
-        conn = catalog.connection_of(alias)
-        if conn == "?":                    # retired: no registration left to say, but its record does
-            conn = retired().get(alias, {}).get("tag", "").split("/")[0] or "unknown"
-        attrs = browse(connection=conn, status=re.sub(r" in \d+d$", "", label),
-                       role=role, price=price_of(alias, served, f))
-        body.append(
-            f"{tr(alias, attrs)}<td>{named(alias)}</td>"
-            f"<td data-sort='{severity[css]}'>{chip(label, css, why)}"
-            + (" " + chip("new", "new", "onboarded this week") if alias in new else "")
-            + (" " + chip("onboard stopped", stuck[alias]["css"],
-                          f"onboarding stopped at the {stuck[alias].get('step', 'probe')}:"
-                          f" {stuck[alias]['label']}. Open the model for the error.")
-               if alias in stuck else "")
-            + "</td>" + uptime_cell(up.get(alias)) + f"<td>{esc(role)}</td>{facts_cells(alias, f)}"
-            f"<td class='num'>{w.get('offloads', 0)}</td>"
-            f"<td data-sort='{rate:.3f}'>{helped}</td>{suite_cell}"
-            + (f"<td class='num' data-sort='{p50}'>{p50:.1f}s</td>" if p50 is not None
-               else "<td class='num muted' data-sort='99999'>—</td>")
-            + (f"<td class='mono' data-sort='{seen}'>{seen}</td>" if seen
-               else "<td class='muted' data-sort='0'>never</td>")
-            + "</tr>")
-    # Decision models are not in the llm yaml, so no probe, suite or reply time
-    # applies; the role column says what they are and what they answer.
-    for alias, d in sorted(decide.load().items()):
-        w = work.get(alias, {})
-        body.append(
-            "<tr" + browse(connection=d.get("via", ""), status="no probe", role="decision",
-                           price="free" if ":free" in d["served"] else "unknown") + ">"
-            f"<td>{named(alias)}</td>"
-            "<td data-sort='2'><span class='muted' title='decision models have no"
-            " availability probe yet'>—</span>"
-            + (" " + chip("new", "new", "onboarded this week") if d.get("onboarded", "") >=
-               (datetime.date.today() - datetime.timedelta(days=7)).isoformat() else "")
-            + "</td>" + uptime_cell(up.get(alias)) + f"<td>decision · {esc(', '.join(d['question_types']))}</td>"
-            "<td class='num muted' data-sort='-1'>—</td><td class='muted'>—</td>"
-            f"<td class='num'>{w.get('offloads', 0)}</td>"
-            "<td data-sort='-1'><span class='muted'>not judged</span></td>"
-            "<td class='num muted' data-sort='-1'>—</td><td class='num muted' data-sort='99999'>—</td>"
-            "<td class='muted' data-sort='0'>—</td></tr>")
-    body.append("</tbody></table>")
-    key = """<dl>
-      <dt>Status</dt><dd>From the latest probe. <em>healthy</em> answered;
-        <em>throttled</em> and <em>slow</em> are rate limits and timeouts, which
-        never retire a model inside 7 days; <em>retiring in Nd</em> is the
-        countdown before the bench retires it on its own. Hover a chip for the
-        provider's own words.</dd>
-      <dt>Uptime 7d</dt><dd>Of its calls in the last 7 days that say anything about the provider,
-        the share answered: busy, unreachable and timed out count against it; our own quota,
-        pacing and setup problems are left out. Benchmarks has it a day at a time.</dd>
-      <dt>Offloads, Helped</dt><dd>Real work handed over, and how much of what
-        was judged actually helped. Benchmarks never count here.</dd>
-      <dt>Suite</dt><dd>Verified findings located across the internal tasks:
-        the tier that decides routing.</dd>
-      <dt>Reply time</dt><dd>Median seconds to answer a one-word prompt: the
-        serving path's overhead, not the model's worth.</dd>
-      <dt>Last answer</dt><dd>The latest real answer from any source: probe,
-        suite or a useful offload. Seven days without one retires a model.</dd>
-      <dt>decision</dt><dd>A decision model: it answers typed questions (yes/no,
-        choice, score) with probabilities through a Decisions API, never chat.
-        The role column lists the question types it takes. No probe, suite or
-        reply time applies to it.</dd>
-      <dt>Filters</dt><dd>Connection is where a model's calls go (its Open WebUI
-        tag, or its own endpoint). Price: <em>free</em> for a <code>:free</code>
-        slug, a local model, a list price of 0 or a free-tier listing;
-        <em>paid</em> for a subscription or a list price; else unknown. Combine
-        them with the search box.</dd>
-    </dl>"""
-    facets = "".join(facet(k, k.title(), v) for k, v in offered.items())
-    return card("At a glance", "Every model on the bench: whether it works right "
-                "now, what it has been used for, and what it scored.",
-                "".join(body), key, facets)
-
-
 def on_bench() -> set[str]:
     """Aliases registered now: what the charts draw."""
     return set(registered().values())
@@ -3378,15 +3196,6 @@ def _uptime_window(cells: list, days: int) -> dict:
             "median": seconds[len(seconds) // 2] if seconds else None}
 
 
-def uptime_cell(cells: list | None, days: int = UPTIME_DAYS[0]) -> str:
-    """At a glance's Uptime column: answered of counted over the last `days`."""
-    t = _uptime_window(cells or [], days)
-    if t["pct"] is None:
-        return "<td class='num muted' data-sort='-1' title='no counted calls'>—</td>"
-    return (f"<td class='num{' err' if t['pct'] < .8 else ''}' data-sort='{t['pct']:.4f}'"
-            f" title='{t['up']} of {t['up'] + t['down']} answered'>{t['pct'] * 100:.1f}%</td>")
-
-
 def _why(kinds: dict, which) -> str:
     return ", ".join(f"{k} {n}" for k, n in sorted(kinds.items(), key=lambda kv: -kv[1]) if which(k))
 
@@ -3925,12 +3734,12 @@ def favicon(theme: str) -> str:
     return f"<link rel='icon' type='image/svg+xml' href='data:image/svg+xml,{quote(svg)}'>"
 
 
-def render(theme: str | None = None, shown: str = "glance") -> str:
+def render(theme: str | None = None, shown: str = "suite") -> str:
     with locked.snapshot():                    # each file read once a render (metrics/locked.py)
         return _page(theme, shown)
 
 
-def _page(theme: str | None, shown: str = "glance") -> str:
+def _page(theme: str | None, shown: str = "suite") -> str:
     theme = theme if theme in themes() else saved_theme()      # a ?theme preview, else the saved one
     return (
         f"<!doctype html><html lang='en' data-theme='{esc(theme)}'><meta charset='utf-8'>"
@@ -4406,9 +4215,10 @@ def collections_tab() -> str:
 # A grouped sidebar since 2026-10-19 (RELEASE-PLAN "The dashboard"): eight
 # pages were too many for a row of tabs. Collections holds the gateway's
 # requests under the collections they ran; Benchmarks holds Performance.
-SECTIONS = (("Observe", (("glance", "At a glance", "roster"),
+# At a glance (every model's state and uptime) was retired 2026-11-10: Benchmarks,
+# Uptime and Models said it all again. Benchmarks is the home page.
+SECTIONS = (("Observe", (("suite", "Benchmarks", "benchmarks_tab"),
                          ("needs", "Action needed", "actions_page"),
-                         ("suite", "Benchmarks", "benchmarks_tab"),
                          ("quotas", "Quota management", "quotas_page"),
                          ("logs", "Logs", "logs_page"))),
             ("Gateway", (("endpoints", "Endpoints", "endpoints_page"),
@@ -4433,7 +4243,9 @@ def collections_and_gateway() -> str:
 # names an environment variable, or the app asks, or (an MCP header in Zed,
 # Cline or goose, which take no variable) KEY_HOLDER stays for the reader.
 # Only blocks marked `key` (shell lines, fields typed into an app) get the key
-# made on the page, swapped in for KEY_HOLDER by bench.js.
+# made on the page, swapped in for KEY_HOLDER by bench.js. CLIENTS.md is written
+# from client_setups (scripts/clients_doc.py): after a change here, run it, as
+# check.py fails while the file differs.
 KEY_HOLDER = "<your gateway key>"
 KEY_ENV = "BENCHWARMERS_KEY"         # the plugin's and the CLI's name for it too
 CLIENTS_READ = "2026-11-08"
@@ -4729,20 +4541,20 @@ def _snip_html(group: str, i: int, s: dict) -> str:
 def pane(key: str, actions: tuple | None = None) -> str:
     """One tab's page, as its section holds it. The page renders the tab shown
     (tabs); bench.js fetches the others from GET /api/pane when first opened."""
-    if key in ("needs", "glance"):
+    if key == "needs":
         groups, auto = actions or open_actions()
-        return actions_page(groups, auto) if key == "needs" else actions_line(groups) + roster()
+        return actions_page(groups, auto)
     return globals()[next(fn for k, _, fn in TABS if k == key)]()
 
 
-def tabs(shown: str = "glance") -> str:
-    # Read once a render: Action needed's count in the sidebar, and its page or
-    # At a glance's line about it when one of those is shown. Only the tab
-    # shown is rendered (the bench_tab cookie, set by bench.js): rendering every
-    # one took seconds. The rest are empty until opened (data-lazy).
+def tabs(shown: str = "suite") -> str:
+    # Read once a render: Action needed's count in the sidebar, and its page when
+    # shown. Only the tab shown is rendered (the bench_tab cookie, set by bench.js):
+    # rendering every one took seconds. The rest are empty until opened (data-lazy).
+    # A tab that is gone (a cookie still saying glance) shows the home page.
     actions = open_actions()
     count = {"needs": open_count(actions[0])}
-    shown = shown if any(k == shown for k, _, _ in TABS) else "glance"
+    shown = shown if any(k == shown for k, _, _ in TABS) else "suite"
 
     def button(key: str, label: str) -> str:
         n = count.get(key)
@@ -5438,7 +5250,11 @@ def models_page() -> str:
     return ("<div class='panel'><h2>Models</h2><p class='sub'>Every model on the bench by the connection it"
             " comes from, with the endpoint it is reached through and what is known of its limits. A name"
             " opens the model.</p><div class='toolbar'><input type='search' data-filter='page'"
-            " placeholder='Find a model or connection' aria-label='Filter models'></div></div>"
+            " placeholder='Find a model or connection' aria-label='Filter models'>"
+            # One labelled toggle, as accordions do it (GOV.UK's "Show all sections"): Collapse all
+            # while every table is open, else Expand all (bench.js foldButtons keeps it right).
+            "<button class='fold-all' type='button' data-fold-all='close' aria-expanded='true'>"
+            "<span class='fold-chev' aria-hidden='true'></span>Collapse all</button></div></div>"
             + "".join(cards))
 
 
@@ -5615,11 +5431,16 @@ def logs_page() -> str:
                       for p in sorted((DATA / "runs").glob("onboard-*.log"), reverse=True)[:30])
 
     def section(title, body, n, open_=False):
-        return (f"<details class='panel'{' open' if open_ else ''}><summary><b>{esc(title)}</b>"
-                f" <span class='muted'>· {n}</span></summary>{body}</details>")
+        # CSV: this log alone, its own columns, the filter applied (bench.js); for a spreadsheet.
+        return (f"<details class='panel'{' open' if open_ else ''} data-log='{esc(title)}'><summary><b>{esc(title)}</b>"
+                f" <span class='muted'>· {n}</span> <button class='btn small' type='button' data-csv"
+                f" title='Save this log, as filtered, as a CSV file'>CSV</button></summary>{body}</details>")
     return (
-        "<div class='panel'><input data-filter='page' placeholder='Filter every log on this page'"
-        " aria-label='Filter logs'></div>"
+        "<div class='panel'><div class='toolbar'><input data-filter='page' placeholder='Filter every log on this page'"
+        " aria-label='Filter logs'>"
+        # bench.js: what the page shows, filter applied, as one .txt to read offline.
+        "<button class='btn small' type='button' id='logs-export' title='Save the logs on this page, as"
+        " filtered, to a text file'>Export as text</button></div></div>"
         + section("Gateway calls", "<table><thead><tr>" + th("When") + th("Collection") + th("Shape")
                   + th("Seats") + f"</tr></thead><tbody>{''.join(gw)}</tbody></table>", len(gw), True)
         + section("Changes", "<table><thead><tr>" + th("When") + th("By") + th("Model") + th("What")
@@ -5938,8 +5759,7 @@ class Handler(gateway.Handler):
         if self.path == "/api/needs":                  # after an action there: that page, not the whole one
             with locked.snapshot():
                 groups, auto = open_actions()
-                self._json(200, {"html": actions_page(groups, auto), "line": actions_line(groups),
-                                 "count": open_count(groups)})
+                self._json(200, {"html": actions_page(groups, auto), "count": open_count(groups)})
             return
         if path == "/api/pane":                        # a tab's page, when first opened (bench.js load)
             key = q.get("tab", [""])[0]
@@ -6058,7 +5878,7 @@ class Handler(gateway.Handler):
         theme = q.get("theme", [None])[0]               # a preview; else the saved one
         shown = re.search(r"(?:^|;)\s*bench_tab=(\w+)", self.headers.get("Cookie") or "")   # the tab last shown
         try:
-            page = render(theme, shown.group(1) if shown else "glance")
+            page = render(theme, shown.group(1) if shown else "suite")
         except RuntimeError as exc:                    # endpoints.json unreadable: say which and why
             page = f"<!doctype html><meta charset='utf-8'><title>Benchwarmers</title><p>{esc(exc)}</p>"
         self._page(page)                               # gzipped beyond this machine (_length)

package/ui/bench.css

@@ -117,8 +117,6 @@ main { max-width: var(--page, 104rem); margin: 0 auto; padding: 0 var(--gutter)
 
 /* Action needed: its own page, a panel per connection as on Models, each a
    table (name, state, the provider's words, actions). */
-.a-line { display: flex; flex-wrap: wrap; align-items: baseline; gap: .25rem .6rem; margin: 1.4rem 1.6rem 0;
-          padding: .45rem .75rem; background: var(--err-ground); border-radius: var(--radius); }
 .a-head { display: flex; flex-wrap: wrap; align-items: baseline; gap: .25rem .6rem; }
 .a-head .why { font-size: .875rem; }
 .a-head .why:empty { display: none; }
@@ -359,8 +357,7 @@ dialog h2 { margin: 0 0 .2rem; font-size: 1.375rem; font-weight: 700; }
 :is(dialog, .form-panel) .members .m-row { border-bottom: 1px solid var(--line); }
 :is(dialog, .form-panel) .members .m-row:nth-child(odd) { background: color-mix(in oklab, var(--band) 45%, transparent); }
 :is(dialog, .form-panel) .members .m-row:has(input:checked) { box-shadow: inset 3px 0 0 var(--bench-seat, var(--brand)); }
-:is(dialog, .form-panel) .members .m-name a.model { color: var(--ink); text-decoration: none; font-size: .875rem; }
-:is(dialog, .form-panel) .members .m-name a.model:hover { text-decoration: underline; }
+:is(dialog, .form-panel) .members .m-name a.model { font-size: .875rem; }
 :is(dialog, .form-panel) .members .m-ctx { font-family: var(--font-mono); font-size: .8125rem; color: var(--muted); text-align: right; }
 :is(dialog, .form-panel) .members .m-can { display: flex; flex-wrap: wrap; gap: .2rem; }
 :is(dialog, .form-panel) .members .m-can .chip { font-size: .6875rem; padding: 0 .4rem; }
@@ -541,6 +538,14 @@ h3.chart-head { font-size: 1rem; margin: 1rem 0 .2rem; }
 .chart-label { font-size: .875rem; font-weight: 600; margin: .9rem 0 .1rem; }
 /* Models: each connection a fold, its heading the summary */
 .model-card > summary h3.chart-head { display: inline; margin: 0; }
+/* Expand all / Collapse all: a text toggle with a chevron that turns, like a fold's own marker */
+button.fold-all { display: inline-flex; align-items: center; gap: .4rem; margin-left: auto; border: 0; padding: .2rem 0;
+                  background: none; color: var(--link); font: inherit; font-size: .9375rem; cursor: pointer; }
+button.fold-all:hover, button.fold-all:focus-visible { text-decoration: underline; text-underline-offset: .18em; }
+.fold-chev { width: .5rem; height: .5rem; border: solid currentColor; border-width: 0 2px 2px 0;
+             transform: rotate(-45deg); transition: transform .15s; }
+button.fold-all[aria-expanded="true"] .fold-chev { transform: rotate(45deg); margin-top: -.3rem; }
+@media (prefers-reduced-motion: reduce) { .fold-chev { transition: none; } }
 /* the Collections tab: the dialog's form, kept to a readable width */
 .panel.form-panel > :not(#c-list, table) { max-width: 46rem; }
 /* a list of things you open (collections), with its New button above */
@@ -595,7 +600,6 @@ dialog .pick { display: flex; gap: 1.5rem; }
   .toolbar input[type=search] { min-width: 0; width: 100%; }
   button.c-row { grid-template-columns: minmax(0, 1fr); }     /* the seats get the width; the whole row opens */
   .c-row .open-hint { display: none; }
-  .a-line { margin: 1rem 1rem 0; }
 }
 /* A narrow page (a phone, or a window with the sidebar beside it): name and
    state on one line, the words and actions under them. No gap between name

package/ui/bench.js

@@ -213,7 +213,7 @@
   var rendered = document.querySelector('.tab:not([data-lazy])');
   Promise.resolve().then(function () { if (rendered) setUp(rendered.id.slice(4)); });
   var wanted = store('bench.tab');            // else the one rendered: storage blocked or cleared, the cookie kept
-  show(wanted && $('tab-' + wanted) ? wanted : rendered ? rendered.id.slice(4) : 'glance');
+  show(wanted && $('tab-' + wanted) ? wanted : rendered ? rendered.id.slice(4) : 'suite');
 
   // ---- sortable tables -------------------------------------------------
   function key(cell) {
@@ -276,7 +276,75 @@
   document.addEventListener('input', function (ev) { if (ev.target.matches('input[data-filter]')) applyFilter(scopeOf(ev.target)); });
   document.addEventListener('change', function (ev) { if (ev.target.matches('select[data-facet]')) applyFilter(scopeOf(ev.target)); });
 
-  // ---- a link to another page (At a glance's line to Action needed) ----
+  // ---- Expand all / Collapse all: every fold of the page's groups (Models' connections).
+  // One labelled toggle, as accordions have it: Collapse all while every one is open,
+  // else Expand all. Kept right after any fold opens or shuts, by hand, by it or by a live swap.
+  function foldButtons(tab) {
+    var folds = tab.querySelectorAll('details.model-card'), open = 0;
+    folds.forEach(function (d) { if (d.open) open++; });
+    var all = open === folds.length;
+    tab.querySelectorAll('[data-fold-all]').forEach(function (b) {
+      b.dataset.foldAll = all ? 'close' : 'open';
+      b.setAttribute('aria-expanded', String(all));
+      b.lastChild.textContent = all ? 'Collapse all' : 'Expand all';
+    });
+  }
+  document.addEventListener('click', function (e) {
+    var b = e.target.closest('[data-fold-all]');
+    if (!b) return;
+    var tab = b.closest('.tab');
+    tab.querySelectorAll('details.model-card').forEach(function (d) { d.open = b.dataset.foldAll === 'open'; });
+    foldButtons(tab);
+  });
+  document.addEventListener('toggle', function (e) {            // toggle does not bubble: caught on its way down
+    if (e.target.matches && e.target.matches('details.model-card')) foldButtons(e.target.closest('.tab'));
+  }, true);
+
+  // ---- Logs: Export as text (every log in one .txt, to read) and CSV (one log, its
+  // own columns, for a spreadsheet). Both as the page shows them, the filter applied.
+  function stampNow() {                                     // local time, as the page shows
+    var now = new Date(), two = function (n) { return String(n).padStart(2, '0'); };
+    return now.getFullYear() + '-' + two(now.getMonth() + 1) + '-' + two(now.getDate()) + '-' + two(now.getHours()) + two(now.getMinutes());
+  }
+  // The file itself: Share's saveFile(blob, name) and csv(rows) (RFC 4180, with a BOM).
+  document.addEventListener('click', function (e) {
+    var b = e.target.closest('[data-csv]');
+    if (!b) return;
+    e.preventDefault();                                     // in the summary: no fold
+    var d = b.closest('details'), rows = [];
+    var cells = function (tr) {
+      return Array.prototype.map.call(tr.children, function (c) { return c.textContent.trim().replace(/\s+/g, ' '); });
+    };
+    var head = d.querySelector('thead tr');
+    if (head) {
+      rows.push(cells(head));
+      d.querySelectorAll('tbody tr').forEach(function (r) { if (!r.hidden) rows.push(cells(r)); });
+    } else {
+      rows.push(['Line']);
+      d.querySelectorAll('.log-line').forEach(function (r) { if (!r.hidden) rows.push([r.textContent.trim()]); });
+    }
+    var slug = d.dataset.log.toLowerCase().replace(/[^a-z0-9]+/g, '-');
+    saveFile(new Blob([csv(rows)], {type: 'text/csv;charset=utf-8'}), 'benchwarmers-' + slug + '-' + stampNow() + '.csv');
+  });
+  on('click', 'logs-export', function () {
+    var tab = $('tab-logs'), out = ['Benchwarmers logs, exported ' + new Date().toString()];
+    var q = (tab.querySelector('input[data-filter]') || {}).value;
+    if (q) out.push('Filtered by: ' + q);
+    tab.querySelectorAll('details.panel').forEach(function (d) {
+      out.push('', '== ' + d.dataset.log + ' ==');
+      var cells = function (tr) {
+        return Array.prototype.map.call(tr.children, function (c) { return c.textContent.trim().replace(/\s+/g, ' '); }).join('\t');
+      };
+      var head = d.querySelector('thead tr');
+      if (head) out.push(cells(head));
+      d.querySelectorAll('tbody tr, .log-line').forEach(function (r) {
+        if (!r.hidden) out.push(r.matches('tr') ? cells(r) : r.textContent.trim());
+      });
+    });
+    saveFile(new Blob([out.join('\n') + '\n'], {type: 'text/plain;charset=utf-8'}), 'benchwarmers-logs-' + stampNow() + '.txt');
+  });
+
+  // ---- a link to another page ----
   document.addEventListener('click', function (e) {
     var b = e.target.closest('[data-go]');
     if (b) { show(b.dataset.go); scrollTo(0, 0); }
@@ -767,8 +835,8 @@
   });
 
   // ---- after an action: the part it changed, not the whole page ----------
-  // Action needed's page, its count in the sidebar and At a glance's line
-  // about it, from the server (GET /api/needs, a few ms): a page reload
+  // Action needed's page and its count in the sidebar, from the server
+  // (GET /api/needs, a few ms): a page reload
   // renders every tab, seconds.
   var needsAsked = 0;
   function refreshNeeds(live) {
@@ -783,10 +851,6 @@
         count.textContent = n.count;
         tab.setAttribute('aria-label', tab.firstChild.textContent + ', ' + n.count + ' open');
       }
-      var line = document.querySelector('#tab-glance > .a-line');
-      if (line) line.remove();
-      // Not into a page not fetched yet: it says Loading… while empty, and comes with its line.
-      if (n.line && $('tab-glance').firstChild) $('tab-glance').insertAdjacentHTML('afterbegin', n.line);
     }).catch(function () { location.reload(); });          // could not ask: the old way
   }
   // A retired model's rows grey out and hide behind Show retired, as the
@@ -2125,7 +2189,10 @@
       var first = fact(g.name), caps = first.caps || {};
       var line = el('div', {class: 'm-row', role: 'group', 'aria-label': g.name, 'data-family': g.family, 'data-name': g.name});
       var name = el('div', {class: 'm-name'});
-      name.appendChild(el('a', {href: '#', class: 'model mono', 'data-alias': g.name, title: 'Open ' + g.name}, g.name));
+      // The same link as every model name elsewhere (a.model > .alias: the highlight on hover).
+      var link = el('a', {href: '#', class: 'model', 'data-alias': g.name, title: 'Open ' + g.name});
+      link.appendChild(el('span', {class: 'alias'}, g.name));
+      name.appendChild(link);
       line.appendChild(name);
       line.appendChild(el('span', {class: 'm-ctx'}, first.context ? tokens(first.context) : '—'));
       var can = el('span', {class: 'm-can'});