mcp-scraper 0.51.1 → 0.51.2

package/README.md

@@ -90,7 +90,7 @@ Build the branded one-click bundle:
 npm run build:mcpb
 ```
 
-The generated bundle is written to `build/mcpb/mcp-scraper-<version>.mcpb` and copied to `public/downloads/` for the hosted download. The current public bundle is `https://mcpscraper.dev/downloads/mcp-scraper.mcpb` (`0.51.1`, SHA-256 `c460ad09a5fbe65088078feeede7c7f49a3af83b3ed6b5228be4f618e0479425`). Install it by opening or dragging it into Claude Desktop. Claude displays the `MCP Scraper` install card, icon, and API-key configuration field from the bundle manifest.
+The generated bundle is written to `build/mcpb/mcp-scraper-<version>.mcpb` and copied to `public/downloads/` for the hosted download. The current public bundle is `https://mcpscraper.dev/downloads/mcp-scraper.mcpb` (`0.51.2`, SHA-256 `7fe018b71b68a98ad84451e2bf007c08a74a284545feaa2f1876be65b8b51ca6`). Install it by opening or dragging it into Claude Desktop. Claude displays the `MCP Scraper` install card, icon, and API-key configuration field from the bundle manifest.
 
 The MCPB install exposes every tool — web-intelligence plus all `browser_*` tools — through the one `mcp-scraper` server.
 
@@ -210,7 +210,7 @@ Google Search Console exposes eight bounded reads and eight gated property and s
 
 - Start unknown-location recall with `memory-search`. It uses Hybrid Smart RAG and returns ranked excerpts, not complete notes.
 - Read strong candidates with `memory-get` before relying on, summarizing, linking, or editing them.
-- Use `memory-list` for an exhaustive vault inventory. It returns every note's metadata plus a sorted list of every represented folder and nested folder.
+- Use `memory-list` for an exhaustive inventory. Pass `allVaults:true` for every note and folder across the whole entitled Memory account; omit it for one logical vault. Account-wide results include aggregate totals and complete per-vault note/folder groups, so a default-vault count is never mistaken for the account total.
 - Use `list-memory-tags` for the complete account-wide canonical tag vocabulary, aliases, usage counts, and per-vault distribution.
 - `memory-put` replaces the complete note body. For edits, read the note, merge the requested change into the full body, write with `baseRevision`, then read back and verify it.
 

package/dist/bin/api-server.cjs

@@ -41595,7 +41595,7 @@ var PACKAGE_VERSION;
 var init_version = __esm({
   "src/version.ts"() {
     "use strict";
-    PACKAGE_VERSION = "0.51.1";
+    PACKAGE_VERSION = "0.51.2";
   }
 });
 
@@ -41892,12 +41892,15 @@ note, registers canonical tags, writes it, and verifies readback. Reserve low-le
 deliberate edits and migrations. Use
 **table-create**/**table-insert-rows**/**table-query** instead when the caller wants row-shaped data
 they'll filter/sort by exact value. **memory-search** is meaning-based over full content (embeds, slower);
-**memory-list** filters one vault by kind/tags (fast, exact).
+**memory-list** filters one vault by kind/tags (fast, exact), or lists the whole entitled account when
+\`allVaults:true\`.
 
-Choose the read surface by completeness, not convenience. **list-vaults** is the account inventory and
-reports each vault's note count. **memory-list** returns the complete metadata inventory for one vault but
-no note bodies, plus a sorted complete folder inventory derived from those paths; use it to identify every
-stable \`vault + path\` address. **list-memory-tags** returns the
+Choose the read surface by completeness, not convenience. **list-vaults** is the compact account inventory and
+reports each vault's note count. **memory-list** returns the complete metadata inventory for one vault by
+default, with no note bodies and a sorted complete folder inventory derived from those paths. When the user
+asks for every note or folder they have across Memory, call **memory-list** once with \`allVaults:true\`; use
+its account totals and per-vault groups, and never present the default single-vault count as the account
+total. Use the result to identify every stable \`vault + path\` address. **list-memory-tags** returns the
 complete account-wide canonical tag inventory, including aliases, usage counts, and per-vault distribution.
 **memory-search** returns ranked
 content chunks, not an exhaustive inventory or complete documents: deduplicate hits by vault/path and call
@@ -49347,7 +49350,7 @@ var init_browser_agent_mcp_server = __esm({
 });
 
 // src/mcp/memory-tool-schemas.ts
-var import_zod47, AcceptShareSchema, ApproveSenderSchema, DeclineShareSchema, GetChatLinkSchema, GetVaultAppLinkSchema, InboxSettingsSchema, InviteAccountSchema, issueKeyTool_scopeShape, IssueKeySchema, ListApprovedSendersSchema, ListKeysSchema, NoteInboxSchema, RemoveApprovedSenderSchema, RevokeChatLinkSchema, RevokeKeySchema, RevokeShareSchema, RevokeVaultAppLinkSchema, SetAgentIdentitySchema, SetScopeSchema, ShareNoteSchema, ShareVaultSchema, SwapVaultSchema, SwitchAccountSchema, UnlinkShareSchema, memoryCaptureTool_notePropsSchema, MemoryCaptureSchema, MemoryQuestionsSchema, PrepareMemoryWriteSchema, validateMemoryWriteTool_notePropsSchema, ValidateMemoryWriteSchema, CreateChannelSchema, GetMessageNoteSchema, ListChannelMembersSchema, ListChannelMessagesSchema, MyMentionsSchema, PollChannelSchema, PostMessageSchema, ReactMessageSchema, RemoveChannelMemberSchema, ReplyMessageSchema, factHistoryTool_entryShape, FactHistorySchema, recordFactTool_factShape, RecordFactSchema, NoteBacklinksSchema, GraphPathSchema, GraphUniverseSchema, LibraryIngestSchema, bulkDeleteNotesTool_FilterSchema, BulkDeleteNotesSchema, DeleteNoteSchema, ExportSchema, getTool_notePropsSchema, GetSchema, ListSchema, putTool_notePropsSchema, PutSchema, searchTool_primitiveValue, SearchSchema, SuggestSchema, UploadSchema, TemporalRecallSchema, ScheduledArtifactSelectionSchema2, CreateScheduledActionSchema, UpdateScheduledActionSchema, DeleteScheduledActionSchema, GetScheduleLinkSchema, GetScheduleStatusSchema, ListScheduledActionsSchema, PauseScheduledActionSchema, ProposeScheduledActionSchema, ResumeScheduledActionSchema, RevokeScheduleLinkSchema, SetScheduleDefaultsSchema, SetScheduleEntitlementSchema, CostUsageSchema, StorageUsageSchema, CreateTableSchema, deleteTableRowsTool_FilterSchema, DeleteTableRowsSchema, DescribeTableSchema, DropTableSchema, InsertTableRowsSchema, ListTablesSchema, queryTableTool_FilterSchema, QueryTableSchema, ListTagsSchema, MergeTagsSchema, ResolveTagsSchema, UpsertTagSchema, AddVaultSchema, CreateSecureVaultSchema, DeleteVaultSchema, GetVaultContractSchema, ListSharedWithMeSchema, ListVaultsSchema, ProvisionDefaultsSchema, RouteMemorySchema, VideoAnalyzeStartSchema, VideoAnalyzeStatusSchema, CreateWebhookSchema, ListWebhooksSchema, RevokeWebhookSchema, MEMORY_TOOL_SCHEMAS;
+var import_zod47, AcceptShareSchema, ApproveSenderSchema, DeclineShareSchema, GetChatLinkSchema, GetVaultAppLinkSchema, InboxSettingsSchema, InviteAccountSchema, issueKeyTool_scopeShape, IssueKeySchema, ListApprovedSendersSchema, ListKeysSchema, NoteInboxSchema, RemoveApprovedSenderSchema, RevokeChatLinkSchema, RevokeKeySchema, RevokeShareSchema, RevokeVaultAppLinkSchema, SetAgentIdentitySchema, SetScopeSchema, ShareNoteSchema, ShareVaultSchema, SwapVaultSchema, SwitchAccountSchema, UnlinkShareSchema, memoryCaptureTool_notePropsSchema, MemoryCaptureSchema, MemoryQuestionsSchema, PrepareMemoryWriteSchema, validateMemoryWriteTool_notePropsSchema, ValidateMemoryWriteSchema, CreateChannelSchema, GetMessageNoteSchema, ListChannelMembersSchema, ListChannelMessagesSchema, MyMentionsSchema, PollChannelSchema, PostMessageSchema, ReactMessageSchema, RemoveChannelMemberSchema, ReplyMessageSchema, factHistoryTool_entryShape, FactHistorySchema, recordFactTool_factShape, RecordFactSchema, NoteBacklinksSchema, GraphPathSchema, GraphUniverseSchema, LibraryIngestSchema, bulkDeleteNotesTool_FilterSchema, BulkDeleteNotesSchema, DeleteNoteSchema, ExportSchema, getTool_notePropsSchema, GetSchema, listNoteSchema, ListSchema, putTool_notePropsSchema, PutSchema, searchTool_primitiveValue, SearchSchema, SuggestSchema, UploadSchema, TemporalRecallSchema, ScheduledArtifactSelectionSchema2, CreateScheduledActionSchema, UpdateScheduledActionSchema, DeleteScheduledActionSchema, GetScheduleLinkSchema, GetScheduleStatusSchema, ListScheduledActionsSchema, PauseScheduledActionSchema, ProposeScheduledActionSchema, ResumeScheduledActionSchema, RevokeScheduleLinkSchema, SetScheduleDefaultsSchema, SetScheduleEntitlementSchema, CostUsageSchema, StorageUsageSchema, CreateTableSchema, deleteTableRowsTool_FilterSchema, DeleteTableRowsSchema, DescribeTableSchema, DropTableSchema, InsertTableRowsSchema, ListTablesSchema, queryTableTool_FilterSchema, QueryTableSchema, ListTagsSchema, MergeTagsSchema, ResolveTagsSchema, UpsertTagSchema, AddVaultSchema, CreateSecureVaultSchema, DeleteVaultSchema, GetVaultContractSchema, ListSharedWithMeSchema, ListVaultsSchema, ProvisionDefaultsSchema, RouteMemorySchema, VideoAnalyzeStartSchema, VideoAnalyzeStatusSchema, CreateWebhookSchema, ListWebhooksSchema, RevokeWebhookSchema, MEMORY_TOOL_SCHEMAS;
 var init_memory_tool_schemas = __esm({
   "src/mcp/memory-tool-schemas.ts"() {
     "use strict";
@@ -50629,31 +50632,42 @@ var init_memory_tool_schemas = __esm({
         openWorldHint: false
       }
     };
+    listNoteSchema = import_zod47.z.object({
+      path: import_zod47.z.string().describe("Vault-relative note path, e.g. projects/q3-plan."),
+      title: import_zod47.z.string().describe("Human-readable note title."),
+      kind: import_zod47.z.string().describe("Note kind: note, library, capture, or decision."),
+      tags: import_zod47.z.array(import_zod47.z.string()).describe("The note's tags, if any."),
+      updatedAt: import_zod47.z.string().describe("ISO-8601 timestamp of the note last update.")
+    });
     ListSchema = {
       id: "memory-list",
       upstreamName: "listTool",
-      description: "Return every note in one vault as a complete metadata inventory \u2014 stable path, title, kind, tags, and last-updated \u2014 plus a sorted list of every unique folder and nested folder represented by those paths. It contains no bodies. Use memory-get for exact full content, memory-search for ranked semantic recall, or memory-export only when explicitly asked for every full note. Defaults to the active or first entitled vault; also returns entitled vaults. Requires read scope.",
+      description: "Return a complete note-and-folder metadata inventory without note bodies. Set allVaults:true when the user asks for every note or folder they have across their whole Memory account; the result is grouped by vault and includes aggregate totals. Otherwise list one exact vault, defaulting to the active or first entitled vault. Never report a single-vault count as the account total. Use memory-get for exact full content, memory-search for ranked semantic recall, or memory-export only when explicitly asked for every full note. Requires read scope.",
       input: {
         vault: import_zod47.z.string().optional().describe(
           "Vault to list. Optional; defaults to the session active vault, then the first vault the caller is entitled to."
         ),
+        allVaults: import_zod47.z.boolean().optional().describe("Set true for one complete account-wide inventory across every entitled vault. Omit or set false for one vault. When true, vault is ignored and reads run sequentially to avoid backend contention."),
         kind: import_zod47.z.enum(["note", "library", "capture", "decision"]).optional().describe("Filter to a single note kind. Optional; omit to list every kind in the vault."),
         tags: import_zod47.z.array(import_zod47.z.string()).optional().describe("Filter to notes tagged with any of these tags (matches the note's tags primitive). Optional; omit to not filter by tag.")
       },
       output: {
         ok: import_zod47.z.boolean().describe("True when the listing succeeded; false on an auth/scope/lookup error."),
+        scope: import_zod47.z.enum(["vault", "account"]).optional().describe("Whether the result covers one logical vault or the whole entitled account."),
+        partial: import_zod47.z.boolean().optional().describe("Account-wide mode only: true if one vault failed and vaultInventories contains only the completed prefix."),
         vault: import_zod47.z.string().optional().describe("The vault that was actually listed (after defaulting)."),
-        notes: import_zod47.z.array(
-          import_zod47.z.object({
-            path: import_zod47.z.string().describe("Vault-relative note path, e.g. projects/q3-plan."),
-            title: import_zod47.z.string().describe("Human-readable note title."),
-            kind: import_zod47.z.string().describe("Note kind: note, library, capture, or decision."),
-            tags: import_zod47.z.array(import_zod47.z.string()).describe("The note's tags, if any."),
-            updatedAt: import_zod47.z.string().describe("ISO-8601 timestamp of the note last update.")
-          })
-        ).optional().describe("The notes in the vault (metadata only, no content). Present when ok is true."),
+        notes: import_zod47.z.array(listNoteSchema).optional().describe("The notes in the vault (metadata only, no content). Present when ok is true."),
         folders: import_zod47.z.array(import_zod47.z.string()).optional().describe("Sorted complete folder inventory derived from note paths, including represented nested parent folders. Present when ok is true."),
         vaults: import_zod47.z.array(import_zod47.z.string()).optional().describe("All vaults the caller is entitled to, for choosing a different vault to list."),
+        totalNotes: import_zod47.z.number().int().nonnegative().optional().describe("Account-wide mode only: total notes across every completed vault inventory."),
+        totalFolders: import_zod47.z.number().int().nonnegative().optional().describe("Account-wide mode only: total represented folder instances across vaults."),
+        vaultInventories: import_zod47.z.array(import_zod47.z.object({
+          vault: import_zod47.z.string().describe("Exact vault handle for every note and folder in this group."),
+          noteCount: import_zod47.z.number().int().nonnegative(),
+          folderCount: import_zod47.z.number().int().nonnegative(),
+          notes: import_zod47.z.array(listNoteSchema).describe("Every note metadata record in this vault."),
+          folders: import_zod47.z.array(import_zod47.z.string()).describe("Every represented folder and nested parent folder in this vault.")
+        })).optional().describe("Account-wide mode only: complete note and folder inventories grouped by vault so paths remain unambiguous."),
         error: import_zod47.z.string().optional().describe("Human-readable failure reason when ok is false.")
       },
       annotations: {
@@ -51924,7 +51938,50 @@ function folderInventory(result) {
 }
 function enrichMemoryResult(toolName, result) {
   if (toolName !== "listTool" || result.ok !== true) return result;
-  return { ...result, folders: folderInventory(result) };
+  if (result.scope === "account") return result;
+  return { ...result, scope: "vault", folders: folderInventory(result) };
+}
+async function buildAccountMemoryInventory(args, listOne) {
+  const filters = { ...args };
+  delete filters.allVaults;
+  delete filters.vault;
+  const initial = enrichMemoryResult("listTool", await listOne(filters));
+  if (initial.ok !== true) return initial;
+  const vaults = Array.isArray(initial.vaults) ? initial.vaults.filter((vault) => typeof vault === "string") : [];
+  const initialVault = typeof initial.vault === "string" ? initial.vault : null;
+  if (!vaults.length && initialVault) vaults.push(initialVault);
+  const vaultInventories = [];
+  for (const vault of vaults) {
+    const listed = vault === initialVault ? initial : enrichMemoryResult("listTool", await listOne({ ...filters, vault }));
+    if (listed.ok !== true) {
+      return {
+        ok: false,
+        scope: "account",
+        partial: true,
+        vaults,
+        vaultInventories,
+        error: typeof listed.error === "string" ? `Could not list vault ${vault}: ${listed.error}` : `Could not list vault ${vault}`
+      };
+    }
+    const notes = Array.isArray(listed.notes) ? listed.notes : [];
+    const folders = Array.isArray(listed.folders) ? listed.folders : [];
+    vaultInventories.push({
+      vault,
+      noteCount: notes.length,
+      folderCount: folders.length,
+      notes,
+      folders
+    });
+  }
+  return {
+    ok: true,
+    scope: "account",
+    partial: false,
+    vaults,
+    totalNotes: vaultInventories.reduce((sum, inventory) => sum + Number(inventory.noteCount), 0),
+    totalFolders: vaultInventories.reduce((sum, inventory) => sum + Number(inventory.folderCount), 0),
+    vaultInventories
+  };
 }
 var MemoryMcpToolExecutor;
 var init_memory_mcp_tool_executor = __esm({
@@ -51939,22 +51996,25 @@ var init_memory_mcp_tool_executor = __esm({
       }
       async callMemoryTool(toolName, args) {
         try {
-          const res = await fetch(`${this.baseUrl}/memory/mcp-call`, {
-            method: "POST",
-            headers: {
-              "content-type": "application/json",
-              "x-api-key": this.apiKey
-            },
-            body: JSON.stringify({ toolName, args })
-          });
-          const data = await res.json().catch(() => null);
-          if (!res.ok) {
-            const message = data?.error ?? `memory ${toolName} failed (HTTP ${res.status})`;
-            return { content: [{ type: "text", text: message }], isError: true };
-          }
+          const callOne = async (input) => {
+            const res = await fetch(`${this.baseUrl}/memory/mcp-call`, {
+              method: "POST",
+              headers: {
+                "content-type": "application/json",
+                "x-api-key": this.apiKey
+              },
+              body: JSON.stringify({ toolName, args: input })
+            });
+            const data2 = await res.json().catch(() => null);
+            if (!res.ok) {
+              throw new Error(data2?.error ?? `memory ${toolName} failed (HTTP ${res.status})`);
+            }
+            return data2 ?? { ok: false, error: `memory ${toolName} returned no result` };
+          };
+          const data = toolName === "listTool" && args.allVaults === true ? await buildAccountMemoryInventory(args, callOne) : await callOne(args);
           const result = enrichMemoryResult(
             toolName,
-            data ?? { ok: false, error: `memory ${toolName} returned no result` }
+            data
           );
           return {
             content: [{ type: "text", text: JSON.stringify(result) }],
@@ -52157,10 +52217,8 @@ function registerReadCutovers() {
     return { content: [{ type: "text", text: JSON.stringify(result ?? {}) }], structuredContent: result ?? {}, isError: false };
   });
   registerCutover("listTool", async (input, apiKey) => {
-    const result = enrichMemoryResult(
-      "listTool",
-      await import_list.listTool.execute({ ...input, apiKey }, {}) ?? {}
-    );
+    const listOne = async (args) => await import_list.listTool.execute({ ...args, apiKey }, {}) ?? {};
+    const result = input.allVaults === true ? await buildAccountMemoryInventory(input, listOne) : enrichMemoryResult("listTool", await listOne(input));
     return { content: [{ type: "text", text: JSON.stringify(result) }], structuredContent: result, isError: false };
   });
   registerCutover("searchTool", async (input, apiKey) => {