toolmenu 0.21.0 → 0.24.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (62) hide show
  1. package/README.md +96 -37
  2. package/dist/apps.d.ts +56 -0
  3. package/dist/apps.js +99 -0
  4. package/dist/auto.js +2 -2
  5. package/dist/card.d.ts +18 -0
  6. package/dist/card.js +39 -0
  7. package/dist/cli.d.ts +1 -1
  8. package/dist/cli.js +70 -11
  9. package/dist/colour.d.ts +8 -0
  10. package/dist/colour.js +70 -0
  11. package/dist/config.d.ts +2 -0
  12. package/dist/config.js +2 -0
  13. package/dist/connect.d.ts +15 -0
  14. package/dist/connect.js +54 -7
  15. package/dist/diff.js +113 -6
  16. package/dist/explain.d.ts +16 -0
  17. package/dist/explain.js +14 -0
  18. package/dist/failures.d.ts +18 -5
  19. package/dist/failures.js +27 -12
  20. package/dist/help.d.ts +1 -1
  21. package/dist/help.js +18 -3
  22. package/dist/mcp-env.d.ts +5 -0
  23. package/dist/mcp-env.js +5 -0
  24. package/dist/mcp.d.ts +65 -0
  25. package/dist/mcp.js +293 -0
  26. package/dist/mrtr.d.ts +9 -1
  27. package/dist/mrtr.js +17 -0
  28. package/dist/options.d.ts +3 -0
  29. package/dist/options.js +1 -0
  30. package/dist/probe.d.ts +11 -1
  31. package/dist/probe.js +18 -3
  32. package/dist/report.js +12 -5
  33. package/dist/rule-docs.json +94 -4
  34. package/dist/rules/apps.d.ts +11 -0
  35. package/dist/rules/apps.js +156 -0
  36. package/dist/rules/capabilities.d.ts +21 -0
  37. package/dist/rules/capabilities.js +103 -0
  38. package/dist/rules/card.d.ts +7 -0
  39. package/dist/rules/card.js +65 -0
  40. package/dist/rules/clients.js +1 -0
  41. package/dist/rules/description.js +3 -0
  42. package/dist/rules/headers.d.ts +0 -2
  43. package/dist/rules/headers.js +7 -12
  44. package/dist/rules/ids.js +35 -1
  45. package/dist/rules/index.js +18 -2
  46. package/dist/rules/naming.js +3 -0
  47. package/dist/rules/network.d.ts +21 -0
  48. package/dist/rules/network.js +63 -0
  49. package/dist/rules/rule.d.ts +18 -0
  50. package/dist/rules/search.js +1 -0
  51. package/dist/rules/spec.d.ts +9 -1
  52. package/dist/rules/spec.js +117 -3
  53. package/dist/rules/write.d.ts +0 -6
  54. package/dist/rules/write.js +11 -5
  55. package/dist/session.js +60 -11
  56. package/dist/snapshot.d.ts +5 -0
  57. package/dist/snapshot.js +89 -5
  58. package/dist/types.d.ts +5 -0
  59. package/dist/words.d.ts +8 -0
  60. package/dist/words.js +30 -2
  61. package/package.json +8 -7
  62. package/schemas/server-card.json +260 -0
package/README.md CHANGED
@@ -3,46 +3,69 @@
3
3
  [![npm](https://img.shields.io/npm/v/toolmenu)](https://www.npmjs.com/package/toolmenu)
4
4
  [![ci](https://github.com/niksa90/toolmenu/actions/workflows/ci.yml/badge.svg)](https://github.com/niksa90/toolmenu/actions/workflows/ci.yml)
5
5
  [![license: MIT](https://img.shields.io/badge/license-MIT-blue)](https://github.com/niksa90/toolmenu/blob/main/LICENSE)
6
+ [![MCP: 2026-07-28 and 2025](https://img.shields.io/badge/MCP-2026--07--28%20%C2%B7%202025-6E56CF)](https://modelcontextprotocol.io)
6
7
 
7
- **Lint your MCP server's tool menu for changes that confuse agents or break caches.**
8
-
9
- The MCP linters I found grade one snapshot of the menu an agent reads: tool names,
10
- descriptions, schemas. toolmenu observes how the menu behaves across calls,
11
- connections and releases, and checks **when** it changes:
12
-
13
- - **Mid-session.** A menu that changes after the conversation has started can
14
- invalidate the cached conversation: most clients put the tool list at the start of
15
- the prompt, so any change to it, even a tool added at the end, means everything
16
- after it is processed again. In my logs, one mid-conversation unlock rewrote
17
- 40–57K tokens of cached prefix (from my own logs; more on this, with a benchmark
18
- of the setups, in [this write-up](https://niksa.me/agent-tools-design-lessons)). `session` catches it, pins it to the step that
19
- caused it, and says where in the list it happened.
20
- - **Ready for 2026-07-28.** That protocol version says the tool set **must not** vary
21
- per connection or as a side effect of other requests (the 2025 versions allow it).
22
- Per-session "unlock" designs, like the one I built, are ruled out. `session` tells you whether yours is one of them.
23
- It also checks the menu clients will actually show: a broken `x-mcp-header` or a
24
- `$ref` they can't resolve hides a tool or fails every call to it. And when a tool
25
- stops to ask the user something, `session` answers "no" and says whether the tool
26
- can take it. Handles a server mints (`session_id`) should say how long they last and
27
- fail readably when unknown; menus that differ by who asks (`--as`) shouldn't be
28
- cached as public; prompts and resources (`--lists`) are checked like tools. Run
29
- against the reference server, `@modelcontextprotocol/server-everything` 2.1.0, with
30
- no false findings ([bench/](bench/README.md)).
31
- - **For your client.** `--client claude-code | claude-api-search | openai` checks the
32
- menu the way that client loads it, from its own docs: what it costs up front and per
33
- tool a search loads, where it cuts descriptions, what its search can find, and names
34
- its API refuses.
35
- - **Between releases.** `diff` finds breaking changes and token growth, and checks
36
- the version bump.
8
+ **Checks for MCP servers' tool lists: changes that confuse agents, break prompt caches or break clients, caught before your users hit them.**
37
9
 
38
- ![toolmenu session output: tools inserted mid-list, a description edited, each pinned to the step that caused it](https://raw.githubusercontent.com/niksa90/toolmenu/main/docs/demo.svg)
10
+ Your MCP server's tool list is the menu every agent reads before it does anything.
11
+ toolmenu checks that menu the way clients and agents will meet it: across calls,
12
+ connections, clients and releases. No LLM is involved, so the same inputs always give
13
+ the same answer and it fits in CI.
39
14
 
40
- No LLM anywhere: the same inputs give the same answer, so it can sit in CI.
41
- (`history` installs old versions with today's dependencies, so it records what they
42
- serve now, which can differ from what they shipped with: FINDINGS F4.)
15
+ ```sh
16
+ npx toolmenu snapshot -- node dist/server.js # or: npx toolmenu snapshot https://example.com/mcp
17
+ npx toolmenu init -- node dist/server.js # CI: a baseline, a workflow, a comment on every PR
18
+ ```
43
19
 
44
- > **Status: 0.16, early.** Spec in [docs/SPEC.md](https://github.com/niksa90/toolmenu/blob/main/docs/SPEC.md). What it has found on
45
- > real servers: [docs/FINDINGS.md](https://github.com/niksa90/toolmenu/blob/main/docs/FINDINGS.md).
20
+ ![toolmenu session output: tools inserted mid-list, a description edited, each pinned to the step that caused it](https://raw.githubusercontent.com/niksa90/toolmenu/main/docs/demo.svg)
21
+
22
+ ## What it catches
23
+
24
+ | | |
25
+ |---|---|
26
+ | **A menu that changes mid-session** | `session` calls your tools and watches the list. A tool added mid-conversation can rewrite the whole cached prompt: one unlock cost 40–57K tokens of cache in my logs. |
27
+ | **Breaking releases** | `diff` compares two menus: removed tools, new required parameters, narrowed types, token growth. It also says whether your version bump is big enough. |
28
+ | **The 2026-07-28 protocol** | The tool set must not vary per connection, and results need `resultType`. Elicitation, multi round-trip input and `server/discover` are checked too, as are the 2025 handshakes. |
29
+ | **MCP Apps, Tasks, Server Cards** | It reads `ui://` resources as a host does and checks who may see each tool. It catches tasks sent to clients that can't poll them, and Server Cards that contradict the live server. |
30
+ | **Your client's view** | `--client claude-code \| claude-api-search \| openai` shows what each client loads, cuts, can find and refuses. |
31
+ | **What agents misread** | It flags vague `id`s, IDs no tool returns, instructions buried late in descriptions, and writes without annotations or marked read-only. |
32
+ | **Menus that drift** | It catches defaults built from the clock or a hash order, menus that differ per process, per connection or offline, and listings that depend on who asks. |
33
+
34
+ Every finding says what's wrong, where it is and what toolmenu saw, and ends with a `→ Next:` step.
35
+ It runs on the 22-server [bench](bench/README.md) and on hosted servers (GitHub, Atlassian, Sentry,
36
+ Notion, Supabase, Vercel…). What it has found on real servers is in
37
+ [docs/FINDINGS.md](https://github.com/niksa90/toolmenu/blob/main/docs/FINDINGS.md).
38
+
39
+ > **Status: 0.24.** Spec in [docs/SPEC.md](https://github.com/niksa90/toolmenu/blob/main/docs/SPEC.md),
40
+ > every rule in [docs/RULES.md](docs/RULES.md), changes in [CHANGELOG.md](CHANGELOG.md).
41
+
42
+ <details>
43
+ <summary><b>Why "when it changes" matters</b></summary>
44
+
45
+ The MCP linters I found grade one snapshot of the menu: tool names, descriptions,
46
+ schemas. toolmenu also checks **when** the menu changes:
47
+
48
+ - **Mid-session.** Most clients put the tool list at the start of the prompt, so any
49
+ change to it, even a tool added at the end, means everything after it is processed
50
+ again. More on this, with a benchmark of the setups, in
51
+ [this write-up](https://niksa.me/agent-tools-design-lessons). `session` pins each
52
+ change to the step that caused it, and says where in the list it happened.
53
+ - **Per connection.** 2026-07-28 says the tool set **must not** vary per connection or
54
+ as a side effect of other requests (the 2025 versions allow it). Per-session
55
+ "unlock" designs, like the one I built, are ruled out. `session` tells you whether
56
+ yours is one of them. It also checks the menu clients will actually show: a broken
57
+ `x-mcp-header` or a `$ref` they can't resolve hides a tool or fails every call to
58
+ it. When a tool stops to ask the user something, `session` answers "no" and says
59
+ whether the tool can take it.
60
+ - **Between releases.** `diff` finds breaking changes and token growth, and checks the
61
+ version bump. `history` does it across a package's published releases. It installs
62
+ old versions with today's dependencies, so it records what they serve now
63
+ (FINDINGS F4).
64
+
65
+ Run against the reference server, `@modelcontextprotocol/server-everything`, it
66
+ reports no false findings ([bench/](bench/README.md)).
67
+
68
+ </details>
46
69
 
47
70
  ## Start here
48
71
 
@@ -137,6 +160,34 @@ makes the exit code 2, because it wasn't checked; one marked `disabled` is liste
137
160
  left alone. URLs are printed without their query, which can hold a key. Nothing is
138
161
  written unless `--out-dir` names a folder for each server's menu file.
139
162
 
163
+ ## For the agent building your server: `mcp`
164
+
165
+ `toolmenu mcp` is toolmenu as an MCP server (stdio), so Claude Code, Cursor or any
166
+ other client can check the server it's working on while it works. In Claude Code, as a
167
+ plugin (the server, and a skill that says when to run it and how to read the report):
168
+
169
+ ```
170
+ /plugin marketplace add niksa90/toolmenu
171
+ /plugin install toolmenu@toolmenu
172
+ ```
173
+
174
+ Or just the server, in any client: `claude mcp add toolmenu -- npx -y toolmenu mcp`, or
175
+ `{"command": "npx", "args": ["-y", "toolmenu", "mcp"]}` in an `mcpServers` config.
176
+
177
+ | Tool | Runs |
178
+ |---|---|
179
+ | `snapshot_menu` | `snapshot`: findings and token cost; writes the menu file only with `save_as` |
180
+ | `diff_menus` | `diff`: breaking changes, the token change and the version bump between two menu files |
181
+ | `check_session` | `session --auto`: calls the read-only tools and reports each menu change |
182
+ | `explain_rule` | `explain`: what a rule checks and how to change its level |
183
+
184
+ Each tool runs the CLI in a child process and returns its text report, so options,
185
+ `toolmenu.config.json` and stored OAuth logins work as they do on the command line.
186
+ Relative paths resolve from the folder `toolmenu mcp` runs in, or a call's `cwd`.
187
+ `snapshot_menu` and `check_session` start the command you give them, as the CLI does;
188
+ clients ask before each tool call unless you allow it. toolmenu's own menu passes its
189
+ checks with no findings, on both protocols and in a session (the test suite checks).
190
+
140
191
  ## In CI: one PR comment
141
192
 
142
193
  ```yaml
@@ -235,6 +286,8 @@ serves, and 23 issue and pull-request tools that only the dynamic mode has.
235
286
  | `session/nothing-called` | warn | `--auto` called no tools (all open-world, missing values, or not read-only): the run only listed the menu |
236
287
  | `session/session-lost` | error | The server ended the session after toolmenu opened a second connection with the same credentials (servers with one session per client; 2025-era servers only). The run stops there; rerun with `--processes 1` |
237
288
  | `session/handle-error` | warn | 2026-07-28: `--auto` called a read-only tool with a handle that can't exist (`toolmenu-unknown-session`), and it answered with a protocol error instead of a tool error the model can read |
289
+ | `session/error-not-flagged` | warn | A tool answered with an HTTP error from the API behind it (`{"status":401,"object":"error",…}`) as a plain result, not marked `isError`, so a client that reads `isError` takes the call for a success (Notion's server). An auth one also counts toward `session/untested`. Tools that take a URL are left out: their answer is the page's (heuristic) |
290
+ | `session/server-unresponsive` | error | The server stopped answering after a step: even `tools/list` timed out. The run stops there with this one finding, instead of every later step waiting out its timeout (a server that polls a device-code sign-in inside a tool call) |
238
291
  | `session/handle-roundtrip` | warn | With `--create-handles`: the tool that creates a session, basket or cart was called, and the tools that take it back refused the handle it had just returned (info when its result had no handle to find) |
239
292
  | `session/rate-limited` | error | The server kept refusing requests for being too many (a 429) after toolmenu waited about a minute, or a tool not marked `readOnlyHint` said it was rate-limited (it isn't called again). The run stops there, with the steps it didn't check; give the run its own server instance or raise the limit for it |
240
293
  | `session/scope-unchecked` | info | A second server process or connection couldn't start mid-session (a server that holds a file or a port), so whether a change was global wasn't checked. Said once for the run |
@@ -450,6 +503,8 @@ server, or from the spec itself. If a rule can't point to one, it doesn't ship.
450
503
  | `naming/client-name` | warn | With `--client`: tool names the client's API refuses: `^[a-zA-Z0-9_-]{1,128}$` for the Claude API, `^[a-zA-Z0-9_-]+$` up to 128 for OpenAI's functions. MCP allows names such as `files.read` that neither takes as they are |
451
504
  | `menu/auth-variance` | info | With `--as` (or `identities` in the config): the tool set differs by identity, what each adds, lacks or defines differently against the first, and its tokens. Allowed by the spec; a baseline of one identity's menu doesn't cover the others. An identity that can't be listed is said here too |
452
505
  | `spec/cache-scope-public` | warn | 2026-07-28, with `--as`: the tool set differs by identity, and `tools/list` says `cacheScope: "public"`, which lets shared caches serve one caller's list to another |
506
+ | `menu/capability-dependent` | info | Tools a server lists only to a client that supports elicitation, or only to one that doesn't. `snapshot` lists as a client with elicitation, so the menu file holds those tools (github-mcp-server 1.14 lists `delete_repository` only to a client that can ask the user to confirm; before 0.22 a baseline missed it), and once more without |
507
+ | `menu/network-dependent` | warn | With `--offline-check` (stdio): the menu listed once more with the network cut off (the proxy variables pointed at a closed port, loopback left alone) differs: inite-visibility serves 3 tools offline and 10 online, so a baseline made with the network doesn't match a machine without it. A server that doesn't start offline is info. A server that ignores the proxy variables still reaches the network where the machine has it directly; then nothing is reported, which isn't a pass |
453
508
  | `auth/invalid-accepted` | warn | HTTP with credentials: the menu listed once more with an invalid credential in the same scheme. A server that serves a menu to it, not 401, gives a client whose token expired no reason to log in again; the agent just has fewer tools (Atlassian Rovo served 4 tools to any `Authorization` header). `--processes 1` turns it off |
454
509
 
455
510
  The full list, `diff` and `session` rules included, is [docs/RULES.md](docs/RULES.md).
@@ -483,10 +538,13 @@ meant to steer away from, and toolmenu says so.
483
538
  "routes": "routes.yml",
484
539
  "tokenBudget": 4000,
485
540
  "descriptionLimit": "claude-code",
486
- "fullDescriptions": ["search_capabilities", "lookup_*"]
541
+ "fullDescriptions": ["search_capabilities", "lookup_*"],
542
+ "offlineCheck": true
487
543
  }
488
544
  ```
489
545
 
546
+ `offlineCheck` turns on `--offline-check` for every `snapshot` of a stdio server.
547
+
490
548
  `descriptionLimit` is where your client cuts tool descriptions: a number, or a client
491
549
  whose cut has been reported: `"claude-code"` (the default: Claude Code's own docs,
492
550
  [code.claude.com/docs/en/mcp](https://code.claude.com/docs/en/mcp), read 2026-11-02:
@@ -556,6 +614,7 @@ toolmenu sees what the server sends. Plenty of agent failures happen elsewhere:
556
614
  --as <name>:<cred> snapshot: list the menu as this identity too, repeatable:
557
615
  "reader:Authorization: Bearer …" (HTTP) or "admin:ROLE=admin"
558
616
  (stdio). The first is the menu saved; the others are compared
617
+ --offline-check snapshot (stdio): also list the menu with the network cut off
559
618
  --concurrency <n> scan: servers checked at a time (default: 4)
560
619
  --out-dir <dir> scan: write each server's menu file there, as <name>.json
561
620
  ```
package/dist/apps.d.ts ADDED
@@ -0,0 +1,56 @@
1
+ import type { Connection } from './connect.js';
2
+ import type { Menu, MenuTool } from './types.js';
3
+ /** The deprecated flat key, before `_meta.ui` ("will be removed before GA"). */
4
+ export declare const LEGACY_URI_KEY = "ui/resourceUri";
5
+ export interface UiMeta {
6
+ /** `_meta.ui.resourceUri`. */
7
+ resourceUri?: unknown;
8
+ /** `_meta["ui/resourceUri"]`, the deprecated spelling. */
9
+ legacyUri?: unknown;
10
+ /** `_meta.ui.visibility`, as sent. */
11
+ visibility?: unknown;
12
+ }
13
+ /** The tool's MCP Apps metadata, or undefined when it has none. */
14
+ export declare function uiMeta(tool: object): UiMeta | undefined;
15
+ /** The UI resource the host renders for this tool: `_meta.ui.resourceUri`, else the deprecated key. */
16
+ export declare function resourceUriOf(tool: object): string | undefined;
17
+ /**
18
+ * Listed for the app only: `visibility` is a list without "model". An Apps host MUST
19
+ * NOT put such a tool in the agent's tool list, so the agent never reads its name,
20
+ * description or schema. Absent, visibility is ["model", "app"].
21
+ */
22
+ export declare function isAppOnly(tool: object): boolean;
23
+ /** The tools the agent is shown: all of them but the app-only ones. */
24
+ export declare function agentTools<T extends object>(tools: T[]): T[];
25
+ /**
26
+ * The menu the agent is shown, its token total recomputed, and what was left out: one
27
+ * view for the report, the agent-scope rules and the --client cost.
28
+ */
29
+ export declare function agentMenu(menu: Menu): {
30
+ shown: Menu;
31
+ appOnly?: {
32
+ tools: number;
33
+ tokens: number;
34
+ };
35
+ };
36
+ /** What resources/read gave for one UI resource. */
37
+ export interface AppResource {
38
+ uri: string;
39
+ /** The tools that name it. */
40
+ tools: string[];
41
+ /** resources/read failed: the error's first line. */
42
+ error?: string;
43
+ /** Each content item's mimeType, in order ("" when absent). */
44
+ mimeTypes?: string[];
45
+ /** Some content item for this URI carries text or a blob. */
46
+ hasContent?: boolean;
47
+ /** The content items' URIs that differ from the one asked for. */
48
+ otherUris?: string[];
49
+ }
50
+ /**
51
+ * Read each `ui://` resource the menu's tools name (resources/read: a read, not a tool
52
+ * call), at most `limit` of them. Each is read once, however many tools name it.
53
+ */
54
+ export declare function readAppResources(connection: Connection, tools: MenuTool[], timeoutMs?: number, limit?: number): Promise<AppResource[]>;
55
+ /** Whether a content type is the one MCP Apps allow, compared without case or spaces around `;`. */
56
+ export declare function isAppsMimeType(mime: string): boolean;
package/dist/apps.js ADDED
@@ -0,0 +1,99 @@
1
+ import { APPS_MIME_TYPE } from './connect.js';
2
+ /** The deprecated flat key, before `_meta.ui` ("will be removed before GA"). */
3
+ export const LEGACY_URI_KEY = 'ui/resourceUri';
4
+ const isObject = (v) => typeof v === 'object' && v !== null && !Array.isArray(v);
5
+ /** The tool's MCP Apps metadata, or undefined when it has none. */
6
+ export function uiMeta(tool) {
7
+ const raw = tool._meta;
8
+ const meta = isObject(raw) ? raw : undefined;
9
+ if (!meta)
10
+ return undefined;
11
+ const ui = isObject(meta.ui) ? meta.ui : undefined;
12
+ const out = {
13
+ ...(ui && 'resourceUri' in ui ? { resourceUri: ui.resourceUri } : {}),
14
+ ...(LEGACY_URI_KEY in meta ? { legacyUri: meta[LEGACY_URI_KEY] } : {}),
15
+ ...(ui && 'visibility' in ui ? { visibility: ui.visibility } : {}),
16
+ };
17
+ return Object.keys(out).length ? out : undefined;
18
+ }
19
+ /** The UI resource the host renders for this tool: `_meta.ui.resourceUri`, else the deprecated key. */
20
+ export function resourceUriOf(tool) {
21
+ const ui = uiMeta(tool);
22
+ // An empty _meta.ui.resourceUri names nothing: the deprecated key, when it has one, is what's left.
23
+ const uri = typeof ui?.resourceUri === 'string' && ui.resourceUri ? ui.resourceUri : typeof ui?.legacyUri === 'string' ? ui.legacyUri : undefined;
24
+ return uri || undefined;
25
+ }
26
+ /**
27
+ * Listed for the app only: `visibility` is a list without "model". An Apps host MUST
28
+ * NOT put such a tool in the agent's tool list, so the agent never reads its name,
29
+ * description or schema. Absent, visibility is ["model", "app"].
30
+ */
31
+ export function isAppOnly(tool) {
32
+ const v = uiMeta(tool)?.visibility;
33
+ return Array.isArray(v) && !v.includes('model');
34
+ }
35
+ /** The tools the agent is shown: all of them but the app-only ones. */
36
+ export function agentTools(tools) {
37
+ return tools.some(isAppOnly) ? tools.filter((t) => !isAppOnly(t)) : tools;
38
+ }
39
+ /**
40
+ * The menu the agent is shown, its token total recomputed, and what was left out: one
41
+ * view for the report, the agent-scope rules and the --client cost.
42
+ */
43
+ export function agentMenu(menu) {
44
+ const tools = agentTools(menu.tools);
45
+ if (tools === menu.tools)
46
+ return { shown: menu };
47
+ const tokens = tools.reduce((n, t) => n + t.tokens, 0);
48
+ return { shown: { ...menu, tools, totalTokens: tokens }, appOnly: { tools: menu.tools.length - tools.length, tokens: menu.totalTokens - tokens } };
49
+ }
50
+ /**
51
+ * Read each `ui://` resource the menu's tools name (resources/read: a read, not a tool
52
+ * call), at most `limit` of them. Each is read once, however many tools name it.
53
+ */
54
+ export async function readAppResources(connection, tools, timeoutMs = 30_000, limit = 50) {
55
+ const byUri = new Map();
56
+ for (const t of tools) {
57
+ const uri = resourceUriOf(t);
58
+ if (uri && uri.startsWith('ui://'))
59
+ byUri.set(uri, [...(byUri.get(uri) ?? []), t.name]);
60
+ }
61
+ const queue = [...byUri].slice(0, limit);
62
+ const out = new Array(queue.length);
63
+ // All of them within 2 × the request timeout, 4 at a time: a server whose reads hang
64
+ // costs one bounded wait, not one timeout per resource.
65
+ const deadline = Date.now() + 2 * timeoutMs;
66
+ const readOne = async (i) => {
67
+ const [uri, names] = queue[i];
68
+ const left = deadline - Date.now();
69
+ if (left <= 0) {
70
+ out[i] = { uri, tools: names, error: `not read: the reads took longer than ${Math.round((2 * timeoutMs) / 1000)} s in all` };
71
+ return;
72
+ }
73
+ try {
74
+ const result = await connection.client.readResource({ uri }, { timeout: Math.min(timeoutMs, left) });
75
+ const contents = Array.isArray(result?.contents) ? result.contents : [];
76
+ out[i] = {
77
+ uri,
78
+ tools: names,
79
+ mimeTypes: contents.map((c) => (typeof c.mimeType === 'string' ? c.mimeType : '')),
80
+ hasContent: contents.some((c) => (typeof c.text === 'string' && c.text.length > 0) || (typeof c.blob === 'string' && c.blob.length > 0)),
81
+ otherUris: contents.flatMap((c) => (typeof c.uri === 'string' && c.uri !== uri ? [c.uri] : [])),
82
+ };
83
+ }
84
+ catch (error) {
85
+ out[i] = { uri, tools: names, error: (error instanceof Error ? error.message : String(error)).split('\n')[0].trim() };
86
+ }
87
+ };
88
+ let next = 0;
89
+ const worker = async () => {
90
+ while (next < queue.length)
91
+ await readOne(next++);
92
+ };
93
+ await Promise.all(Array.from({ length: Math.min(4, queue.length) }, worker));
94
+ return out.filter((r) => r !== undefined);
95
+ }
96
+ /** Whether a content type is the one MCP Apps allow, compared without case or spaces around `;`. */
97
+ export function isAppsMimeType(mime) {
98
+ return mime.toLowerCase().replace(/\s*;\s*/g, ';') === APPS_MIME_TYPE;
99
+ }
package/dist/auto.js CHANGED
@@ -3,7 +3,7 @@ import { isMap, isNode, isScalar, parseDocument } from 'yaml';
3
3
  import { synthesizeArgs } from './args.js';
4
4
  import { CREATABLE_KINDS, createdKinds, creatorOf, handleParams } from './rules/handles.js';
5
5
  import { MAX_UNLOCKS, unlockers } from './session.js';
6
- import { COLLECTION_VERBS, commonWords, leadingVerb, LOOKUP_VERBS, verbOf, WRITE_VERBS } from './words.js';
6
+ import { COLLECTION_VERBS, prefixWords, leadingVerb, LOOKUP_VERBS, verbOf, WRITE_VERBS } from './words.js';
7
7
  /** Marked or named as a write: never called on the user's word. Says why, or undefined. */
8
8
  export function writeSign(tool) {
9
9
  const a = tool.annotations ?? {};
@@ -44,7 +44,7 @@ export function autoScenario(menu, options = {}) {
44
44
  }
45
45
  // The server's readOnlyHint, but not against a name that says it writes: a hosted
46
46
  // server marked create_my_ideal_account read-only (write/read-only-mismatch).
47
- const common = commonWords(menu.tools.map((t) => t.name));
47
+ const common = prefixWords(menu.tools.map((t) => t.name));
48
48
  const namedWrite = (t) => WRITE_VERBS.has(leadingVerb(t.name, common) ?? '');
49
49
  const readOnly = (t) => (t.annotations?.readOnlyHint === true && !namedWrite(t)) || assumed.has(t.name);
50
50
  const { perTool, ignored: unusedValues } = resolveValues(menu, options.values ?? {});
package/dist/card.d.ts ADDED
@@ -0,0 +1,18 @@
1
+ export declare const CARD_MEDIA_TYPE = "application/mcp-server-card+json";
2
+ export interface CardRead {
3
+ /** Where it was asked for: the server URL's origin and path, then /server-card. */
4
+ url: string;
5
+ status?: number;
6
+ contentType?: string;
7
+ /** The document, when the answer was JSON. */
8
+ card?: unknown;
9
+ /** Why it couldn't be read (network, timeout). */
10
+ error?: string;
11
+ }
12
+ /** The reserved card location for a Streamable HTTP URL: its query left out, /server-card appended to its path. */
13
+ export declare function cardUrl(serverUrl: string): string;
14
+ /**
15
+ * GET the card from its reserved location. No credentials: cards are public by design,
16
+ * and the request goes to a path the MCP endpoint didn't ask to receive them on.
17
+ */
18
+ export declare function readServerCard(serverUrl: string, timeoutMs?: number): Promise<CardRead>;
package/dist/card.js ADDED
@@ -0,0 +1,39 @@
1
+ /*
2
+ * MCP Server Cards (SEP-2127, ext-server-card): a static document describing a remote
3
+ * server, read before connecting. Its reserved location is `<streamable-http-url>/server-card`,
4
+ * served as application/mcp-server-card+json. Its version and protocol versions SHOULD NOT
5
+ * contradict what the live connection reports (ext-server-card docs/discovery.md,
6
+ * "Consistency with Runtime Behavior"). Schema: schemas/server-card.json, from
7
+ * modelcontextprotocol/ext-server-card at 526201bb.
8
+ */
9
+ export const CARD_MEDIA_TYPE = 'application/mcp-server-card+json';
10
+ /** The reserved card location for a Streamable HTTP URL: its query left out, /server-card appended to its path. */
11
+ export function cardUrl(serverUrl) {
12
+ const u = new URL(serverUrl);
13
+ return `${u.origin}${u.pathname.replace(/\/+$/, '')}/server-card`;
14
+ }
15
+ /**
16
+ * GET the card from its reserved location. No credentials: cards are public by design,
17
+ * and the request goes to a path the MCP endpoint didn't ask to receive them on.
18
+ */
19
+ export async function readServerCard(serverUrl, timeoutMs = 10_000) {
20
+ const url = cardUrl(serverUrl);
21
+ try {
22
+ const response = await fetch(url, { headers: { Accept: `${CARD_MEDIA_TYPE}, application/json;q=0.9` }, signal: AbortSignal.timeout(timeoutMs), redirect: 'follow' });
23
+ const contentType = response.headers.get('content-type') ?? '';
24
+ const out = { url, status: response.status, contentType };
25
+ if (!response.ok || !/json/i.test(contentType))
26
+ return out;
27
+ const text = await response.text();
28
+ try {
29
+ out.card = JSON.parse(text);
30
+ }
31
+ catch {
32
+ // Says JSON, isn't: no card.
33
+ }
34
+ return out;
35
+ }
36
+ catch (error) {
37
+ return { url, error: (error instanceof Error ? error.message : String(error)).split('\n')[0] };
38
+ }
39
+ }
package/dist/cli.d.ts CHANGED
@@ -1,2 +1,2 @@
1
1
  #!/usr/bin/env node
2
- export declare function main(argv: string[]): Promise<number>;
2
+ export declare function main(given: string[]): Promise<number>;
package/dist/cli.js CHANGED
@@ -1,4 +1,5 @@
1
1
  #!/usr/bin/env node
2
+ import { colourFor, colourise, colouriseError } from './colour.js';
2
3
  import { mkdir, writeFile } from 'node:fs/promises';
3
4
  import { join } from 'node:path';
4
5
  import { parseArgs } from 'node:util';
@@ -23,6 +24,7 @@ import { authDir, listLogins, login, logout } from './auth.js';
23
24
  import { existingMessage, initReport, planInit, shellWord, writeInit } from './init.js';
24
25
  import { SEVERITY_RANK } from './types.js';
25
26
  import { VERSION } from './version.js';
27
+ import { SECRET_ARGS_ENV } from './mcp-env.js';
26
28
  import { CLI_OPTIONS } from './options.js';
27
29
  import { editDistance } from './words.js';
28
30
  import { formatScan, ListError, loadList, scan, scanExit } from './scan.js';
@@ -30,7 +32,8 @@ import { explain, findRule, formatExplained, listRules, ruleDocs } from './rule-
30
32
  import { commandHelp, commandOptions, isCommand, overview, unknownCommand } from './help.js';
31
33
  class UsageError extends Error {
32
34
  }
33
- export async function main(argv) {
35
+ export async function main(given) {
36
+ const argv = withSecretArgs(given);
34
37
  const dash = argv.indexOf('--');
35
38
  const before = dash === -1 ? argv : argv.slice(0, dash);
36
39
  const command = dash === -1 ? undefined : argv.slice(dash + 1);
@@ -64,9 +67,22 @@ export async function main(argv) {
64
67
  process.stdout.write(sub && isCommand(sub) ? commandHelp(sub) : overview());
65
68
  return sub || values.help ? 0 : 2;
66
69
  }
70
+ // An option another command takes is ignored here: say so, or scan --no-auth reads as
71
+ // done while the stored logins are used anyway. A warning, not an error: CI scripts pass
72
+ // the shared options (--timeout) to every command.
73
+ const takes = new Set([...commandOptions(sub), 'help', 'version']);
74
+ const at = (k) => before.findIndex((a) => a === `--${k}` || a.startsWith(`--${k}=`));
75
+ // In the order they were typed.
76
+ const stray = Object.keys(values).filter((k) => !takes.has(k)).sort((a, b) => at(a) - at(b)).map((k) => `--${k}`);
77
+ if (stray.length) {
78
+ const one = stray.length === 1;
79
+ process.stderr.write(`toolmenu: ${sub} ignores ${stray.join(', ')}: ${one ? 'it is' : 'they are'} for other commands.\n → Next: Leave ${one ? 'it' : 'them'} out to silence this; toolmenu ${sub} --help lists the options ${sub} takes.\n`);
80
+ }
67
81
  const format = (values.json ? 'json' : values.format ?? 'text');
68
82
  if (!['text', 'json', 'github', 'markdown'].includes(format))
69
83
  throw new UsageError(`--format must be text, json, github or markdown`);
84
+ // Colour for a report read in a terminal (colour.ts); piped, CI and other formats stay plain.
85
+ const show = (report) => (format === 'text' && colourFor(process.stdout) ? colourise(report) : report);
70
86
  const failOn = (values['fail-on'] ?? 'error');
71
87
  if (!(failOn in SEVERITY_RANK))
72
88
  throw new UsageError(`--fail-on must be error, warn or info`);
@@ -77,6 +93,14 @@ export async function main(argv) {
77
93
  return authCommand(rest, values);
78
94
  if (sub === 'explain')
79
95
  return explainCommand(rest, command, format);
96
+ if (sub === 'mcp') {
97
+ if (command || rest.length)
98
+ throw new UsageError('mcp takes no server: it is one. Add it to a client as: npx -y toolmenu mcp');
99
+ // Loaded only here: the CLI's other commands don't need the server SDK.
100
+ const { serveMcp } = await import('./mcp.js');
101
+ await serveMcp();
102
+ return 0;
103
+ }
80
104
  // The invocation up to the server, for examples in messages: a session example
81
105
  // without --auto or --scenario wouldn't run.
82
106
  const scenarioFlag = values.scenario ? ` --scenario ${shellWord(values.scenario)}` : '';
@@ -99,6 +123,8 @@ export async function main(argv) {
99
123
  throw new UsageError('--client goes with snapshot.');
100
124
  if (values.client !== undefined && !Object.hasOwn(CLIENTS, values.client))
101
125
  throw new UsageError(`--client must be one of ${CLIENT_NAMES.join(', ')}`);
126
+ if (values['offline-check'] && sub !== 'snapshot')
127
+ throw new UsageError('--offline-check goes with snapshot.');
102
128
  if (values.as !== undefined && sub !== 'snapshot')
103
129
  throw new UsageError('--as goes with snapshot: it lists the menu once per identity.');
104
130
  if (values.elicitation !== undefined && sub !== 'session')
@@ -125,7 +151,12 @@ export async function main(argv) {
125
151
  throw new UsageError(error.message);
126
152
  throw error;
127
153
  }
128
- const withProtocol = entries.map((e) => (e.target && protocol !== 'auto' ? { ...e, target: { ...e.target, protocol } } : e));
154
+ const noAuth = values['no-auth'] === true;
155
+ const withProtocol = entries.map((e) => {
156
+ if (!e.target || e.target.kind !== 'http')
157
+ return e.target && protocol !== 'auto' ? { ...e, target: { ...e.target, protocol } } : e;
158
+ return { ...e, target: { ...e.target, ...(protocol !== 'auto' ? { protocol } : {}), ...(noAuth ? { noAuth } : {}) } };
159
+ });
129
160
  const outDir = values['out-dir'];
130
161
  if (outDir)
131
162
  await mkdir(outDir, { recursive: true });
@@ -139,6 +170,8 @@ export async function main(argv) {
139
170
  descriptionLimit: config.descriptionLimit,
140
171
  fullDescriptions: config.fullDescriptions,
141
172
  ...(config.client ? { client: config.client } : {}),
173
+ // stdio servers only: snapshot skips it for HTTP.
174
+ ...(config.offlineCheck ? { offlineCheck: true } : {}),
142
175
  onDone: (row, done, total) => {
143
176
  if (tty)
144
177
  process.stderr.write(`\r\x1b[K ${done}/${total} ${row.name}`);
@@ -150,7 +183,7 @@ export async function main(argv) {
150
183
  for (const r of rows)
151
184
  if (r.menu)
152
185
  await writeFile(join(outDir, `${r.name.replace(/[^\w.@-]+/g, '_')}.json`), JSON.stringify(r.menu, null, 2) + '\n');
153
- process.stdout.write(formatScan(rows, format, rest[0]) + '\n');
186
+ process.stdout.write(show(formatScan(rows, format, rest[0])) + '\n');
154
187
  return scanExit(rows, failOn);
155
188
  }
156
189
  if (sub === 'diff') {
@@ -167,7 +200,7 @@ export async function main(argv) {
167
200
  release,
168
201
  serverVersionIsRelease: values['server-version-is-release'] ?? config.serverVersionIsRelease,
169
202
  });
170
- process.stdout.write(formatDiff(result, before.tools.length, after.tools.length, format) + '\n');
203
+ process.stdout.write(show(formatDiff(result, before.tools.length, after.tools.length, format)) + '\n');
171
204
  return result.findings.some((f) => SEVERITY_RANK[f.severity] >= SEVERITY_RANK[failOn]) ? 1 : 0;
172
205
  }
173
206
  if (sub === 'history') {
@@ -200,7 +233,7 @@ export async function main(argv) {
200
233
  });
201
234
  if (values.csv)
202
235
  await writeFile(values.csv, historyCsv(result));
203
- process.stdout.write(formatHistory(result, format, outDir, values.csv) + '\n');
236
+ process.stdout.write(show(formatHistory(result, format, outDir, values.csv)) + '\n');
204
237
  return result.rows.length > 0 && result.rows.every((r) => r.status === 'failed') ? 1 : 0;
205
238
  }
206
239
  if (sub === 'session' && values.init) {
@@ -242,7 +275,7 @@ export async function main(argv) {
242
275
  const plan = planInit({ cwd: process.cwd(), target, out: values.out, session: values['with-session'] });
243
276
  if (plan.existing.length)
244
277
  throw new UsageError(existingMessage(plan));
245
- const { menu, findings } = await snapshot(target, { timeoutMs, processes, rules: config.rules, ignore: config.ignore, descriptionLimit: config.descriptionLimit, fullDescriptions: config.fullDescriptions });
278
+ const { menu, findings } = await snapshot(target, { timeoutMs, processes, rules: config.rules, ignore: config.ignore, descriptionLimit: config.descriptionLimit, fullDescriptions: config.fullDescriptions, ...(config.offlineCheck && target.kind === 'stdio' ? { offlineCheck: true } : {}) });
246
279
  await writeInit(plan, JSON.stringify(menu, null, 2) + '\n');
247
280
  process.stdout.write(initReport(plan, { server: menu.server.name, version: menu.server.version, tools: menu.tools.length, tokens: menu.totalTokens, counts: counts(findings) }, target));
248
281
  return 0;
@@ -330,7 +363,7 @@ export async function main(argv) {
330
363
  await writeFile(values['union-out'], JSON.stringify(result.union, null, 2) + '\n');
331
364
  const output = formatSession(result, format);
332
365
  if (output)
333
- process.stdout.write(output + '\n');
366
+ process.stdout.write(show(output) + '\n');
334
367
  return result.findings.some((f) => SEVERITY_RANK[f.severity] >= SEVERITY_RANK[failOn]) ? 1 : 0;
335
368
  }
336
369
  if (sub === 'session') {
@@ -355,7 +388,7 @@ export async function main(argv) {
355
388
  await writeFile(values['union-out'], JSON.stringify(result.union, null, 2) + '\n');
356
389
  const output = formatSession(result, format);
357
390
  if (output)
358
- process.stdout.write(output + '\n');
391
+ process.stdout.write(show(output) + '\n');
359
392
  return result.findings.some((f) => SEVERITY_RANK[f.severity] >= SEVERITY_RANK[failOn]) ? 1 : 0;
360
393
  }
361
394
  const target = parseTarget(rest, command, values.header ?? [], values.env ?? [], values['no-auth'], prefix, protocol);
@@ -363,13 +396,16 @@ export async function main(argv) {
363
396
  const routesPath = values.routes ?? config.routes;
364
397
  const routes = routesPath ? await loadRoutes(routesPath) : undefined;
365
398
  const client = values.client ?? config.client;
366
- const { menu, findings, cost, notOffered } = await snapshot(target, { routes, timeoutMs, processes, identities, client, lists, catalog: values.catalog ? (config.catalog ?? true) : undefined, rules: config.rules, ignore: config.ignore, descriptionLimit: config.descriptionLimit, fullDescriptions: config.fullDescriptions });
399
+ const offlineCheck = values['offline-check'] ?? config.offlineCheck;
400
+ if (values['offline-check'] && target.kind !== 'stdio')
401
+ throw new UsageError("--offline-check goes with a stdio server: an HTTP server's network isn't this machine's to cut.");
402
+ const { menu, findings, cost, notOffered } = await snapshot(target, { offlineCheck: offlineCheck && target.kind === 'stdio', routes, timeoutMs, processes, identities, client, lists, catalog: values.catalog ? (config.catalog ?? true) : undefined, rules: config.rules, ignore: config.ignore, descriptionLimit: config.descriptionLimit, fullDescriptions: config.fullDescriptions });
367
403
  const outPath = values['no-write'] ? undefined : values.out ?? 'menu.json';
368
404
  if (outPath)
369
405
  await writeFile(outPath, JSON.stringify(menu, null, 2) + '\n');
370
406
  const output = formatSnapshot(menu, findings, format, outPath, cost, notOffered);
371
407
  if (output)
372
- process.stdout.write(output + '\n');
408
+ process.stdout.write(show(output) + '\n');
373
409
  return findings.some((f) => SEVERITY_RANK[f.severity] >= SEVERITY_RANK[failOn]) ? 1 : 0;
374
410
  }
375
411
  function parseTarget(positionals, command, headers, env, noAuth, prefix, protocol) {
@@ -484,7 +520,8 @@ for (const method of ['log', 'info', 'debug']) {
484
520
  console[method] = (...args) => console.error(...args);
485
521
  }
486
522
  main(process.argv.slice(2)).then(exitWhenFlushed, (error) => {
487
- process.stderr.write(`toolmenu: ${failureMessage(error)}\n`);
523
+ const message = `toolmenu: ${failureMessage(error)}`;
524
+ process.stderr.write(`${colourFor(process.stderr) ? colouriseError(message) : message}\n`);
488
525
  exitWhenFlushed(2);
489
526
  });
490
527
  function explainCommand(rest, command, format) {
@@ -541,6 +578,28 @@ function commandIn(args) {
541
578
  }
542
579
  return undefined;
543
580
  }
581
+ /**
582
+ * toolmenu mcp passes header and env values (credentials) in TOOLMENU_MCP_ARGS, a JSON
583
+ * array of arguments, not on the command line: argv is readable by any local user.
584
+ * They go before the server command's "--". Removed from the environment once read.
585
+ */
586
+ function withSecretArgs(argv) {
587
+ const raw = process.env[SECRET_ARGS_ENV];
588
+ if (raw === undefined)
589
+ return argv;
590
+ delete process.env[SECRET_ARGS_ENV];
591
+ let extra;
592
+ try {
593
+ extra = JSON.parse(raw);
594
+ }
595
+ catch {
596
+ extra = undefined;
597
+ }
598
+ if (!Array.isArray(extra) || !extra.every((a) => typeof a === 'string'))
599
+ throw new UsageError(`${SECRET_ARGS_ENV} must be a JSON array of strings.`);
600
+ const dash = argv.indexOf('--');
601
+ return dash === -1 ? [...argv, ...extra] : [...argv.slice(0, dash), ...extra, ...argv.slice(dash)];
602
+ }
544
603
  function parseRelease(value) {
545
604
  const m = /^(.+?)\.\.(.+)$/.exec(value);
546
605
  if (!m)
@@ -0,0 +1,8 @@
1
+ /** Whether text written to this stream gets colour. */
2
+ export declare function colourFor(stream: {
3
+ isTTY?: boolean;
4
+ }, env?: NodeJS.ProcessEnv): boolean;
5
+ /** The report with ANSI colour: the same characters otherwise. */
6
+ export declare function colourise(text: string): string;
7
+ /** An error that stopped a command, with colour: what failed, the labelled evidence, the next step. */
8
+ export declare function colouriseError(text: string): string;