token-goat 2.9.12 → 2.9.13

package/README.md

@@ -117,7 +117,11 @@ The fastest way to reduce AI token costs is fixing these five, not writing short
 | Subagent reads a ≥30 KB markdown file whole, on its first look at it | Off by default. Set `subagent_markdown_first_read_deny = true` under `[hints]` to block that read and answer with the heading tree instead. Only fires in a subagent, only on a first, un-ranged read of a `.md`/`.mdx`/`.markdown` file with at least three headings; a read that already asks for a line range, and every main-session read, pass through untouched |
 | A source file is read whole for the first time, with no earlier copy to compare it against | Keeps each function's declaration and its first eight lines, replacing the rest with one line naming the symbol, the exact range removed, and the command that returns it. Set `fold_code_bodies = false` under `[hints]` to turn it off. Comment blocks of twelve lines or more fold to their first two on the same terms. Imports, signatures, type declarations, classes and interfaces are never folded, and a file whose index no longer matches what is on disk keeps its bodies. Measured on this repository's own source: 229 of 256 files fold, and 43% of what a read of them delivers is removed. A read that already names an offset or a limit, and any file holding something that looks like a secret, pass through untouched |
 | PDF opened via Read | Full read denied; PDF shows page count and outline (`token-goat pdf-extract` pulls the actual text, optionally paged/sliced, when the outline isn't enough) |
-| Excel/PowerPoint/Word file (.xlsx/.pptx/.docx) opened via Read | Full read denied; redirects to the matching narrow-slice command family (`xlsx-sheets`/`xlsx-head`/`xlsx-range`/`xlsx-query`, `pptx-outline`/`pptx-slide`/`pptx-notes`/`pptx-text`, `docx-outline`/`docx-text`) instead of extracting the whole document as text |
+| Excel/PowerPoint/Word file (.xlsx/.pptx/.docx) opened via Read | Full read denied; redirects to the matching narrow-slice command family (`xlsx-sheets`/`xlsx-columns`/`xlsx-head`/`xlsx-range`/`xlsx-query`, `pptx-outline`/`pptx-slide`/`pptx-notes`/`pptx-text`, `docx-outline`/`docx-tables`/`docx-text`) instead of extracting the whole document as text |
+| SQLite database (.db, .sqlite, .sqlite3, .db3) opened via Read | Full read denied; redirects to the SQLite narrow-slice family (`sqlite-tables`/`sqlite-schema`/`sqlite-query`) instead of reading binary bytes into context |
+| Parquet file (.parquet) opened via Read | Full read denied; redirects to DuckDB for SQL querying instead of reading binary columnar data |
+| Large JSON or YAML file (≥20 KB) read in full | Top-level keys or array summary previewed; redirects to `json-outline`/`json-query` or `yaml-outline`/`yaml-query` instead of blowing context on multi-megabyte payloads |
+| Large JSON Lines file (.jsonl ≥20 KB) read in full | Record count and first-record schema shown; suggests slicing records with offset/limit instead of loading millions of tokens |
 | Other Office binary (.odt, .ods, .ott, .odp) opened via Read | Full read denied; redirects to `pandoc` for text extraction (no dedicated reader for these formats yet) |
 | Large CSV or TSV file (≥10 KB) read in full | Column headers, row count, and 3 sample rows shown; `token-goat csv-query` projects columns and/or filters rows instead of a full read; `duckdb` query suggestion for very large tabular data |
 | WebFetch returns a page's full raw HTML | HTML-to-text extraction strips markup/scripts/styles before the model ever sees it — readable prose instead of a wall of tags |
@@ -519,6 +523,8 @@ The pipeline is written in TypeScript and decodes PNG, JPEG, GIF, and BMP itself
 
 The one thing the decoders will do is decline. A file whose header asks for more than 256 MB of pixel buffer, or that is in a variant token-goat cannot read exactly, is refused rather than guessed at, and the untouched original goes to the model. An untouched original is the right picture, so the only cost of a refusal is that the read is not shrunk.
 
+When `tesseract.js` is installed, text-heavy images can also have their text extracted via OCR (`token-goat image-text <file>`) to replace raw pixel data with plain text. English (`eng`) is always enabled by default, and users can combine one or more additional languages (`token-goat image-text <file> --lang "fra,spa"`). Language preferences persist across version updates when saved globally (`token-goat config set image_shrink.ocr_lang "fra,spa"`), per-project in `.token-goat.toml` (`[image_shrink] ocr_lang = "fra+spa"`), or via `TOKEN_GOAT_OCR_LANG`. 16 languages are supported (`eng`, `fra`, `spa`, `deu`, `ita`, `por`, `nld`, `pol`, `rus`, `tur`, `swe`, `ara`, `chi_sim`, `chi_tra`, `jpn`, `kor`), each cryptographically verified against pinned package checksums to protect against supply-chain tampering.
+
 ## Stats display
 
 `token-goat stats` uses 24-bit ANSI color and Unicode block characters for gradient bars, sparklines, and the activity heatmap. In the right terminal it renders sharply. In the wrong one you get broken characters, flat gray blocks, or a "rich is not installed" error.

package/dist/{token-goat-chunk-6NIGPPN6.mjs → token-goat-chunk-2WC4ZUXN.mjs}

@@ -2,7 +2,7 @@ import { createRequire as __cjsRequire } from 'node:module';
 const require = __cjsRequire(import.meta.url);
 import {
   detectHarness
-} from "./token-goat-chunk-TOGYS5A7.mjs";
+} from "./token-goat-chunk-UMXJN7DI.mjs";
 import {
   init_define_import_meta_env
 } from "./token-goat-chunk-A37V4PBF.mjs";

package/dist/{token-goat-chunk-GCXX67HM.mjs → token-goat-chunk-3ESRORNM.mjs}

@@ -1,5 +1,25 @@
 import { createRequire as __cjsRequire } from 'node:module';
 const require = __cjsRequire(import.meta.url);
+import {
+  DEFAULT_RECONCILE_BUDGET_MS,
+  HOOK_EVENTS,
+  WEB_OUTPUT_SUBDIR,
+  accumulateResidentLine,
+  buildCommandManifest,
+  checkSymbolBodySize,
+  createResidentContextStats,
+  filterCommandManifest,
+  formatBytes,
+  formatCommandManifest,
+  formatTokenEstimate,
+  getWebOutput,
+  getWebOutputByUrlFromDisk,
+  getWebOutputRaw,
+  readStdinJson,
+  runReconcile,
+  storeWebOutput,
+  summarizeResidentContext
+} from "./token-goat-chunk-FQCNJV4V.mjs";
 import {
   ALL_SYMBOLS_IN_FILE_LIMIT,
   AMBIGUOUS_HEADING_LIMIT,
@@ -15,6 +35,7 @@ import {
   extractTranscriptText,
   filterSimilarHeadings,
   findSpecSeparator,
+  guardJsonRows,
   healStaleIndex,
   isAvailable as isAvailable2,
   load,
@@ -75,6 +96,7 @@ import {
   runSkeleton,
   runSqliteQuery,
   runSqliteSchema,
+  runSqliteTables,
   runSymbol,
   runTestFor,
   runTypes,
@@ -87,33 +109,11 @@ import {
   symbolNamesInFile,
   upsertNote,
   warnIfFilesStale
-} from "./token-goat-chunk-4CK445AW.mjs";
-import {
-  DEFAULT_RECONCILE_BUDGET_MS,
-  HOOK_EVENTS,
-  WEB_OUTPUT_SUBDIR,
-  accumulateResidentLine,
-  buildCommandManifest,
-  checkSymbolBodySize,
-  createResidentContextStats,
-  filterCommandManifest,
-  formatBytes,
-  formatCommandManifest,
-  formatTokenEstimate,
-  getWebOutput,
-  getWebOutputByUrlFromDisk,
-  getWebOutputRaw,
-  readStdinJson,
-  runReconcile,
-  storeWebOutput,
-  summarizeResidentContext
-} from "./token-goat-chunk-A6QTLAWO.mjs";
+} from "./token-goat-chunk-U7X6LQD2.mjs";
 import {
   AGENT_SALT_MARKER,
   BASH_OUTPUT_SUBDIR,
   CONTEXT_AUTOCOMPACT_TOKENS,
-  DEFAULT_MAX_AGE_MS,
-  DEFAULT_MAX_COUNT,
   MAX_FILES_SCANNED,
   PARSER_FINGERPRINT,
   RECALL_DEFAULT_LIMIT,
@@ -137,6 +137,7 @@ import {
   detectWalkMode,
   dirtyQueuePathFor,
   docxOutline,
+  docxTables,
   docxText,
   drainHeartbeatPathFor,
   embeddingBackendLoadError,
@@ -158,8 +159,10 @@ import {
   findSystemTempFiles,
   formatAge,
   formatCsvTable,
+  formatDocxTables,
   formatMemSuggestions,
   formatProjectMap,
+  formatXlsxColumns,
   formatXlsxRange,
   getBashOutput,
   getContextPressure,
@@ -192,13 +195,11 @@ import {
   isSuppressionCategory,
   isTreeSitterAvailable,
   isWorkerRunning,
-  listBlobs,
   listOutputs,
   listRecentRecall,
   listSections,
   listSheets,
   listSkills,
-  loadBlob,
   loadRegexExtractors,
   loadSessionCache,
   mapLookupBytesSaved,
@@ -211,7 +212,6 @@ import {
   pptxOutline,
   pptxSlideText,
   pptxTextGrep,
-  pruneBlobs,
   pruneBlockedRoot,
   pruneDeletedFiles,
   pruneOrphanedChunks,
@@ -239,56 +239,32 @@ import {
   urlPolicyDenialReason,
   visionTokensSavedByText,
   walkProject,
-  writeCompact
-} from "./token-goat-chunk-GM6QZWCF.mjs";
+  writeCompact,
+  xlsxColumns
+} from "./token-goat-chunk-ZZI3IDQZ.mjs";
 import {
-  C,
-  CONFIG_KEY_ENV_OVERRIDES,
   CompressedOutput,
   FILTERS,
   GEMINI_TOOL_NAME_MAP,
   HOOKS_SCRIPT_FILE,
   MATERIALIZE_SHRUNK_IMAGE_JS,
-  PROJECT_LOCKED_KEYS,
-  PROJECT_LOCKED_SECTIONS,
-  RESET,
   TOOL_FILTERS,
-  TREE_SITTER_LANGUAGES,
   ToolFilter,
-  _useRichStats,
   anchoredMarkerPattern,
   bundledCliPath,
   capJsonRows,
   clipLongMatchLine,
-  colorStdout,
   combineStreams,
-  compileCustomPatterns,
   copilotCliConfigPath,
   copilotCliMcpToolsDir,
   copilotCliScriptPath,
   copilotCliUserRoot,
-  defaultConfig,
   deliverCompressed,
   detectFromCommand,
-  detectLanguage,
-  detectLanguageOfFile,
   dropEmptyServers,
-  envBool,
   estimateTokens,
   estimateTokensFromLength,
-  fenceFor,
-  fg,
-  fileIsAbsent,
-  findProject,
   findStrayClaudeMdBlocks,
-  fingerprintContent,
-  fingerprintFile,
-  formatLocalTimestamp,
-  getDb,
-  getDisplayRoot,
-  getLastConfigParseError,
-  getLastProjectConfigParseError,
-  getProjectConfigInfo,
   groupHasTokenGoat,
   hasManagedServer,
   installClaudeMd,
@@ -300,38 +276,18 @@ import {
   installSkill,
   installVisualStudio,
   installVscode,
-  invalidateConfigCache,
   isCodexInstalled,
   isCopilotCliInstalled,
-  isDotenvPath,
   isGrokInstalled,
   isInstalled,
   isKimiInstalled,
   isVisualStudioInstalled,
-  lastProjectConfigLockedKeys,
-  loadConfig,
-  loadPersistedConfig,
-  nonTreeSitterLanguageCount,
   otherScopeHasManagedServer,
-  parse,
-  readConfigSource,
   readCopilotMcpTools,
   readServersJson,
-  readUnmappedTools,
-  recordStat,
-  redactIfDotenv,
-  redactSecrets,
-  renderShortStats,
-  renderStats,
-  resolveConfigKeyLayer,
-  resolveProjectRoot,
-  saveConfig,
-  savedTokensFromBytes,
   serversOf,
   setTokenGoatServer,
   settingsPath,
-  stripAnsi,
-  summarize,
   toolMatcherFor,
   trimToBudget,
   uninstallClaudeMd,
@@ -343,8 +299,6 @@ import {
   uninstallSkill,
   uninstallVisualStudio,
   uninstallVscode,
-  validateEnumField,
-  validateNumericField,
   visualStudioDuplicateNote,
   visualStudioManagedEntry,
   visualStudioMcpStatus,
@@ -356,7 +310,65 @@ import {
   vscodeHooksInstalled,
   vscodeScopeFromFlags,
   vscodeUsesClaudeHooks
-} from "./token-goat-chunk-TOGYS5A7.mjs";
+} from "./token-goat-chunk-JOXLE672.mjs";
+import {
+  DEFAULT_MAX_AGE_MS,
+  DEFAULT_MAX_COUNT,
+  listBlobs,
+  loadBlob,
+  pruneBlobs
+} from "./token-goat-chunk-UM47DRD3.mjs";
+import {
+  C,
+  CONFIG_KEY_ENV_OVERRIDES,
+  PROJECT_LOCKED_KEYS,
+  PROJECT_LOCKED_SECTIONS,
+  RESET,
+  SUPPORTED_OCR_LANG_CODES,
+  TREE_SITTER_LANGUAGES,
+  _useRichStats,
+  colorStdout,
+  compileCustomPatterns,
+  defaultConfig,
+  detectLanguage,
+  detectLanguageOfFile,
+  envBool,
+  fenceFor,
+  fg,
+  fileIsAbsent,
+  findProject,
+  fingerprintContent,
+  fingerprintFile,
+  formatLocalTimestamp,
+  getDb,
+  getDisplayRoot,
+  getLastConfigParseError,
+  getLastProjectConfigParseError,
+  getProjectConfigInfo,
+  invalidateConfigCache,
+  isDotenvPath,
+  isSupportedOcrLang,
+  lastProjectConfigLockedKeys,
+  loadConfig,
+  loadPersistedConfig,
+  nonTreeSitterLanguageCount,
+  parse,
+  readConfigSource,
+  readUnmappedTools,
+  recordStat,
+  redactIfDotenv,
+  redactSecrets,
+  renderShortStats,
+  renderStats,
+  resolveConfigKeyLayer,
+  resolveProjectRoot,
+  saveConfig,
+  savedTokensFromBytes,
+  stripAnsi,
+  summarize,
+  validateEnumField,
+  validateNumericField
+} from "./token-goat-chunk-UMXJN7DI.mjs";
 import {
   ENV_KEYS,
   LOCK_WAIT_MS_HARDENED,
@@ -387,6 +399,7 @@ import {
   fenceUntrustedContent,
   fenceUntrustedOcrText,
   foldPath,
+  formatSymbolLocation,
   globalDbPath,
   installSingleFilePlugin,
   isTestFile,
@@ -425,7 +438,7 @@ import {
   withRetryOnLock,
   writeIfDifferent,
   writeJsonSettings
-} from "./token-goat-chunk-LOCOX2ML.mjs";
+} from "./token-goat-chunk-QKXBGBQR.mjs";
 import {
   __export,
   init_define_import_meta_env
@@ -11051,7 +11064,7 @@ function formatFrameBody(frame, projectRoot, seen) {
   if (resolved === null) {
     return [`    # body: No symbols enclosing line ${frame.lineNo} in '${frame.file}'`];
   }
-  const header = `    # body: ${resolved.name}  ${resolved.kind}  ${resolved.filePath}:${resolved.lineStart}-${resolved.lineEnd}`;
+  const header = `    # body: ${resolved.name}  ${resolved.kind}  ${formatSymbolLocation(resolved.filePath, resolved.lineStart, resolved.lineEnd)}`;
   if (seen.has(resolved.key)) {
     return [`${header} (same as above)`];
   }
@@ -16171,7 +16184,7 @@ async function cmdMcpServe() {
   let StdioServerTransport;
   try {
     ;
-    ({ createMcpServer } = await import("./token-goat-chunk-SBYRP3X4.mjs"));
+    ({ createMcpServer } = await import("./token-goat-chunk-FZU7GMUS.mjs"));
     ({ StdioServerTransport } = await import("./token-goat-chunk-EVC4TOLE.mjs"));
   } catch (err2) {
     process.stderr.write(
@@ -16196,7 +16209,7 @@ async function cmdHook(event, opts) {
   if (typeof opts.harness === "string" && opts.harness.length > 0) {
     process.env[ENV_KEYS.HARNESS_OVERRIDE] = opts.harness;
   }
-  const { relay } = await import("./token-goat-chunk-VRWX6QYW.mjs");
+  const { relay } = await import("./token-goat-chunk-P2PU4CR5.mjs");
   await relay(event);
 }
 function projectHooksCommitNote(pathFiles, hooksConfigPath) {
@@ -16233,7 +16246,7 @@ async function cmdInstall(opts) {
   if (opts.project === true && opts.user === true) {
     throw new Error("install takes either -p/--project or --user, not both.");
   }
-  await import("./token-goat-chunk-VRWX6QYW.mjs");
+  await import("./token-goat-chunk-P2PU4CR5.mjs");
   const scope = opts.project === true ? "project" : "user";
   if (wantsClaudeCodeBase(opts)) {
     const result = installHooks(scope);
@@ -16917,7 +16930,14 @@ function fenceOcrText(text) {
   return fenceUntrustedOcrText(text);
 }
 async function cmdImageText(file, opts = {}) {
-  const result = await runImageText(file);
+  if (opts.lang) {
+    const tokens = opts.lang.split(/[+,;\s]+/).map((s) => s.trim().toLowerCase()).filter(Boolean);
+    const invalid = tokens.filter((t) => !isSupportedOcrLang(t));
+    if (invalid.length > 0) {
+      throw new CliError(`unsupported OCR language(s) '${invalid.join(", ")}'; must be from: ${SUPPORTED_OCR_LANG_CODES.join(", ")}`);
+    }
+  }
+  const result = await runImageText(file, opts.lang);
   if (!result.ocrAvailable) {
     const msg = "image-text unavailable (install tesseract.js to use this feature)";
     const text2 = opts.json === true ? displaySafeJson({ ocrAvailable: false, error: msg }) : msg;
@@ -17003,10 +17023,28 @@ async function cmdXlsxSheets(file, opts = {}) {
 }
 async function cmdXlsxHead(file, opts) {
   const rows = opts.rows !== void 0 ? requireNonNegativeInt("--rows", opts.rows) : 20;
-  const text = fenceFileText(await headSheet(file, opts.sheet, rows));
+  const columns = opts.columns ? opts.columns.split(",").map((c) => c.trim()).filter(Boolean) : void 0;
+  const text = fenceFileText(await headSheet(file, opts.sheet, rows, columns));
   out(text);
   recordXlsxStat("xlsx_head", file, text);
 }
+async function cmdXlsxColumns(file, opts = {}) {
+  const maxRows = opts.head !== void 0 ? requireNonNegativeInt("--head", opts.head) : 100;
+  const result = await xlsxColumns(file, opts.sheet, maxRows);
+  if (opts.json === true) {
+    const text = displaySafeJson({
+      ...result,
+      sheetName: fenceFileFieldIfMatched(result.sheetName),
+      columns: result.columns.map((c) => ({ ...c, name: fenceFileFieldIfMatched(c.name), sampleValues: c.sampleValues.map(fenceFileFieldIfMatched) }))
+    });
+    out(text);
+    recordXlsxStat("xlsx_columns", file, text);
+  } else {
+    const text = fenceFileText(formatXlsxColumns(result));
+    out(text);
+    recordXlsxStat("xlsx_columns", file, text);
+  }
+}
 async function cmdXlsxRange(file, opts) {
   const result = await rangeSheet(file, opts.sheet, opts.range, opts.formulas === true);
   const text = fenceFileText(formatXlsxRange(result));
@@ -17021,9 +17059,26 @@ async function cmdXlsxQuery(file, opts) {
     ...wheres !== void 0 ? { wheres } : {},
     ...opts.head !== void 0 ? { head: requireNonNegativeInt("--head", opts.head) } : {}
   });
-  const text = fenceFileText(formatCsvTable(result, (opts.where ?? []).map((w) => `--where ${w}`)));
-  out(text);
-  recordXlsxStat("xlsx_query", file, text);
+  if (opts.json === true) {
+    const rowsJson = result.rows.map((r) => Object.fromEntries(result.header.map((h, i) => [h, fenceFileFieldIfMatched(r[i] ?? "")])));
+    const headTruncated = result.rows.length < result.totalRows;
+    const capped = guardJsonRows(rowsJson);
+    const text = displaySafeJson(
+      {
+        items: capped.items,
+        truncated: capped.truncated || headTruncated,
+        totalCount: result.totalRows,
+        ...result.totalRows === 0 && result.preFilterRows > 0 ? { filteredFromRows: result.preFilterRows } : {}
+      },
+      0
+    );
+    out(text);
+    recordXlsxStat("xlsx_query", file, text);
+  } else {
+    const text = fenceFileText(formatCsvTable(result, (opts.where ?? []).map((w) => `--where ${w}`)));
+    out(text);
+    recordXlsxStat("xlsx_query", file, text);
+  }
 }
 function recordDocStat(kind, file, emitted) {
   const fullSourceBytes = fileSizeOrZero(file);
@@ -17075,6 +17130,35 @@ async function cmdDocxOutline(file, opts) {
   out(text);
   recordDocStat("docx_outline", file, text);
 }
+async function cmdDocxTables(file, opts) {
+  const tableIdx = opts.table !== void 0 ? parseInt(opts.table, 10) : void 0;
+  if (tableIdx !== void 0 && (Number.isNaN(tableIdx) || tableIdx < 1)) {
+    throw new CliError(`--table must be a positive integer, got: ${opts.table}`);
+  }
+  const tables = await docxTables(file);
+  if (tables.length === 0) {
+    if (opts.json === true) {
+      out(displaySafeJson([]));
+    } else {
+      out("no tables found in document");
+    }
+    return;
+  }
+  const selected = tableIdx !== void 0 ? tables.filter((t) => t.tableIndex === tableIdx) : tables;
+  if (selected.length === 0) {
+    throw new CliError(`table ${tableIdx} not found (document has ${tables.length} table${tables.length === 1 ? "" : "s"})`);
+  }
+  if (opts.json === true) {
+    const fenced = selected.map((t) => ({ ...t, rows: t.rows.map((r) => r.map(fenceFileFieldIfMatched)) }));
+    const text2 = displaySafeJson(tableIdx !== void 0 ? fenced[0] : fenced);
+    out(text2);
+    recordDocStat("docx_tables", file, text2);
+    return;
+  }
+  const text = fenceFileText(formatDocxTables(tables, tableIdx !== void 0 ? { tableIndex: tableIdx } : void 0));
+  out(text);
+  recordDocStat("docx_tables", file, text);
+}
 async function cmdDocxText(file, opts) {
   const text = await docxText(file);
   const printed = _applyFiltersAndPrint(text, opts, true, UNTRUSTED_FILE_TAG);
@@ -17171,6 +17255,9 @@ async function cmdZipRead(file, entry, opts) {
 function cmdPrSlice(pr, slice, opts) {
   process.exitCode = runPrSlice({ pr, slice, ...opts });
 }
+function cmdSqliteTables(file, opts) {
+  process.exitCode = runSqliteTables({ file, ...opts });
+}
 function cmdSqliteSchema(file, opts) {
   process.exitCode = runSqliteSchema({ file, ...opts });
 }
@@ -17236,7 +17323,7 @@ function emitExtraFileArgsNote(command, first, extras, opts = {}) {
 }
 async function cmdCompress(opts) {
   try {
-    const bashRunner = await import("./token-goat-chunk-SF2CKCFQ.mjs");
+    const bashRunner = await import("./token-goat-chunk-RDITECDL.mjs");
     if (opts.compress === false) {
       process.exitCode = bashRunner.runRaw(opts.cmd, parseTimeout(opts.timeout, bashRunner.DEFAULT_TIMEOUT_SECONDS));
       return;
@@ -18341,9 +18428,10 @@ function generateCompactHelp() {
     "  exports, imports, find, grep",
     "",
     "File Formats: pdf-meta, pdf-outline, pdf-extract, pdf-locate, xlsx-sheets,",
-    "  xlsx-head, xlsx-query, xlsx-range, yaml-outline, yaml-query, json-outline,",
-    "  json-query, xml-outline, xml-query, html-outline, html-query, html-lint,",
-    "  docx-outline, docx-text, pptx-outline, pptx-slide, pptx-text, pptx-notes",
+    "  xlsx-head, xlsx-columns, xlsx-query, xlsx-range, yaml-outline, yaml-query,",
+    "  json-outline, json-query, xml-outline, xml-query, html-outline, html-query,",
+    "  html-lint, docx-outline, docx-tables, docx-text, pptx-outline, pptx-slide, pptx-text,",
+    "  pptx-notes",
     "",
     "Index & Search: index, map, reconcile, doctor, commands, ask, pack, tokens,",
     "  budget, failures, todo, trace, logfold, lockdeps, dep-docs, recent, hot,",
@@ -18365,8 +18453,8 @@ function generateCompactHelp() {
     "  bridges-status, worker, statusline, version, config, config-get,",
     "  capabilities, help",
     "",
-    "Data: note, note-add, note-get, note-list, sqlite-query, sqlite-schema,",
-    "  csv-profile, csv-query",
+    "Data: note, note-add, note-get, note-list, sqlite-query, sqlite-tables,",
+    "  sqlite-schema, csv-profile, csv-query",
     "",
     "Utils: ignores, bash-history, web-history, openapi-op, openapi-outline,",
     "  gdrive-sections, screenshot, opencode-*, fetch-image, image-meta,",
@@ -18877,23 +18965,25 @@ function buildProgram() {
   program2.command("pdf-outline <file>").description("list a PDF's bookmark/outline tree with page numbers instead of a raw Read").option("-j, --json", "output as JSON").action(guard(cmdPdfOutline));
   program2.command("pdf-meta <file>").description("page count, title/author, and whether a PDF has an extractable text layer").option("-j, --json", "output as JSON").action(guard(cmdPdfMeta));
   program2.command("image-meta <file>").description("dimensions, byte size, format, and what a shrink would cost -- image metadata only, never runs OCR").option("-j, --json", "output as JSON").action(guard(cmdImageMeta));
-  program2.command("image-text <file>").description("OCR text for an image instead of a raw Read, honest about low-confidence results").option("-j, --json", "output as JSON").action(guard(cmdImageText));
+  program2.command("image-text <file>").description("OCR text for an image instead of a raw Read, honest about low-confidence results").option("--lang <lang>", "OCR language code (e.g. eng, fra, spa)").option("-j, --json", "output as JSON").action(guard(cmdImageText));
   program2.command("sharepoint-resolve <shareUrl>").description("best-effort resolve a SharePoint/OneDrive sharing URL to a local synced file path (no network call)").action(guard(cmdSharepointResolve));
   program2.command("video-chapters <file>").description("list a video's embedded chapter markers and subtitle streams via ffprobe, instead of downloading/transcoding it").action(guard(cmdVideoChapters));
   program2.command("xlsx-sheets <file>").description("list sheet names + used range/dimensions in an Excel workbook instead of a raw Read").option("-j, --json", "output as JSON").action(guard(cmdXlsxSheets));
-  program2.command("xlsx-head <file>").description("preview the header + first N rows of one sheet instead of a raw Read").requiredOption("--sheet <name>", "sheet name (see xlsx-sheets)").option("--rows <n>", "number of data rows to show (default 20)").action(guard(cmdXlsxHead));
-  program2.command("xlsx-range <file>").description("extract one cell range (e.g. A1:D50) from a sheet instead of a raw Read").requiredOption("--sheet <name>", "sheet name (see xlsx-sheets)").requiredOption("--range <a1-notation>", "cell range, e.g. A1:D50").option("--formulas", "show formulas instead of computed values where present").action(guard(cmdXlsxRange));
-  program2.command("xlsx-query <file>").description("project columns / filter rows from one sheet instead of a raw Read").requiredOption("--sheet <name>", "sheet name (see xlsx-sheets)").option("--columns <a,b,c>", "comma-separated columns to project (default: all)").option(
+  program2.command("xlsx-head <file>").description("preview the header + first N rows of one sheet instead of a raw Read").option("--sheet <name>", "sheet name (default: first sheet, see xlsx-sheets)").option("--rows <n>", "number of data rows to show (default 20)").option("--columns <a,b,c>", "comma-separated column names or letters to project (default: all)").action(guard(cmdXlsxHead));
+  program2.command("xlsx-columns <file>").description("column names, letters, fill rates, and sample values instead of a raw Read").option("--sheet <name>", "sheet name (default: first sheet, see xlsx-sheets)").option("--head <n>", "max rows to sample for fill rates and distinct values (default: 100)").option("--json", "emit column summaries as JSON").action(guard(cmdXlsxColumns));
+  program2.command("xlsx-range <file>").description("extract one cell range (e.g. A1:D50) from a sheet instead of a raw Read").option("--sheet <name>", "sheet name (default: first sheet, see xlsx-sheets)").requiredOption("--range <a1-notation>", "cell range, e.g. A1:D50").option("--formulas", "show formulas instead of computed values where present").action(guard(cmdXlsxRange));
+  program2.command("xlsx-query <file>").description("project columns / filter rows from one sheet instead of a raw Read").option("--sheet <name>", "sheet name (default: first sheet, see xlsx-sheets)").option("--columns <a,b,c>", "comma-separated columns to project (default: all)").option(
     "--where <spec>",
     "filter, repeatable (ANDed): col=value, col!=value, col>value, col<value, col~=regex",
     (v, prev) => [...prev, v],
     []
-  ).option("--head <n>", "max rows to show").action(guard(cmdXlsxQuery));
+  ).option("--head <n>", "max rows to show").option("--json", "emit rows as a JSON array of objects instead of a table").action(guard(cmdXlsxQuery));
   program2.command("pptx-outline <file>").description("per-slide title + body size + notes flag instead of a raw Read").option("-j, --json", "output as JSON").action(guard(cmdPptxOutline));
   program2.command("pptx-slide <file>").description("full text of one slide instead of a raw Read").requiredOption("--slide <n>", "slide number (see pptx-outline)").option("--notes", "include this slide's speaker notes").action(guard(cmdPptxSlide));
   program2.command("pptx-notes <file>").description("speaker notes for one slide, or all slides, instead of a raw Read").option("--slide <n>", "slide number (default: all slides)").action(guard(cmdPptxNotes));
   program2.command("pptx-text <file>").description("find slides whose text matches a pattern instead of a raw Read").requiredOption("--grep <pattern>", "regex to search slide text for").action(guard(cmdPptxText));
   program2.command("docx-outline <file>").description("heading tree of a Word document instead of a raw Read").option("-j, --json", "output as JSON").action(guard(cmdDocxOutline));
+  program2.command("docx-tables <file>").description("extract tables from a Word document instead of a raw Read").option("--table <n>", "show only the Nth table (1-based index)").option("-j, --json", "output as JSON").action(guard(cmdDocxTables));
   program2.command("docx-text <file>").description("full body text of a Word document instead of a raw Read").option("--head <n>", "show only the first N lines").option("--tail <n>", "show only the last N lines").option("--grep <pattern>", "filter to lines matching this regex").option("--section <heading>", "extract one markdown section by heading").option("--max-matches <n>", "cap the number of --grep matches shown").action(guard(cmdDocxText));
   program2.command("transcript-outline <file>").description("speaker list, duration, and time-bucketed markers for a WebVTT/SRT transcript instead of a raw Read").option("-j, --json", "output as JSON").action(guard(cmdTranscriptOutline));
   program2.command("transcript <file>").description("slice a WebVTT/SRT transcript by speaker/time range/pattern instead of a raw Read").option("--speaker <name>", "only cues from this speaker").option("--from <hh:mm:ss>", "only cues starting at or after this time").option("--to <hh:mm:ss>", "only cues starting at or before this time").option("--grep <pattern>", "only cues whose text matches this regex").action(guard(cmdTranscript));
@@ -18934,6 +19024,7 @@ function buildProgram() {
   program2.command("pr-slice <pr> <slice>").description(
     "one slice of a GitHub PR (files / one file's diff / review comments / description) via `gh` instead of a full `gh pr view`/`gh pr diff` dump\n\npr is a PR number or URL. slice is one of: files (changed files with +/- counts), diff:<path> (one file's diff hunk), comments (review comments), description (title/body/metadata)"
   ).option("--repo <owner/repo>", "target repo (default: resolved from the current directory's git remote 'origin')").option("--json", "emit the slice as JSON instead of text").action(guard(cmdPrSlice));
+  program2.command("sqlite-tables <file>").description("compact inventory of tables and views with row counts and column counts instead of a raw Read").option("--json", "emit the table inventory as JSON instead of text").action(guard(cmdSqliteTables));
   program2.command("sqlite-schema <file>").description("tables/views, columns, indexes, foreign keys, and row counts of a SQLite database instead of a raw Read").option("--json", "emit the schema as JSON instead of text").action(guard(cmdSqliteSchema));
   program2.command("sqlite-query <file> <sql>").description("run a read-only SELECT against a SQLite database instead of a raw Read or shelling out to sqlite3 -- rejects any non-SELECT statement").option("--head <n>", "limit to the first N returned rows").option("--json", "emit rows as a JSON array of objects instead of a table").action(guard(cmdSqliteQuery));
   program2.command("coverage-report-gaps <file>").description(

package/dist/token-goat-chunk-4NXUKV7D.mjs

@@ -0,0 +1,56 @@
+import { createRequire as __cjsRequire } from 'node:module';
+const require = __cjsRequire(import.meta.url);
+import {
+  OCR_LANG_FILE,
+  OCR_LANG_PATH,
+  OCR_LANG_SHA256,
+  SUPPORTED_OCR_LANGS,
+  buildChildScript,
+  formatOcrSummary,
+  getActiveOcrLangs,
+  getOcrLangSpec,
+  isOcrEngineAvailable,
+  isTextHeavy,
+  ocrBlockedOffline,
+  ocrImage,
+  ocrIntegrityFailed,
+  quarantineOcrLangCache,
+  resetOcrStateForTesting,
+  resolveOcrLang,
+  setOcrTimeoutForTesting,
+  setTesseractEntryForTesting,
+  verifyOcrLangCache
+} from "./token-goat-chunk-YOA4N6WA.mjs";
+import "./token-goat-chunk-UM47DRD3.mjs";
+import {
+  DEFAULT_OCR_LANG,
+  isSupportedOcrLang,
+  resolveOcrLangs
+} from "./token-goat-chunk-UMXJN7DI.mjs";
+import "./token-goat-chunk-EEIDFMEM.mjs";
+import "./token-goat-chunk-QKXBGBQR.mjs";
+import "./token-goat-chunk-A37V4PBF.mjs";
+export {
+  DEFAULT_OCR_LANG,
+  OCR_LANG_FILE,
+  OCR_LANG_PATH,
+  OCR_LANG_SHA256,
+  SUPPORTED_OCR_LANGS,
+  buildChildScript,
+  formatOcrSummary,
+  getActiveOcrLangs,
+  getOcrLangSpec,
+  isOcrEngineAvailable,
+  isSupportedOcrLang,
+  isTextHeavy,
+  ocrBlockedOffline,
+  ocrImage,
+  ocrIntegrityFailed,
+  quarantineOcrLangCache,
+  resetOcrStateForTesting,
+  resolveOcrLang,
+  resolveOcrLangs,
+  setOcrTimeoutForTesting,
+  setTesseractEntryForTesting,
+  verifyOcrLangCache
+};

package/dist/{token-goat-chunk-OTW7LC4Y.mjs → token-goat-chunk-6B44WLIF.mjs}

@@ -25,7 +25,7 @@ import {
   extractSwift,
   extractThrift,
   extractWgsl
-} from "./token-goat-chunk-6F5TLJC7.mjs";
+} from "./token-goat-chunk-B3CTCQTH.mjs";
 import {
   assignBraceBlockSpans,
   assignFlatEndLines,
@@ -56,7 +56,7 @@ import {
   stripMultilineStringSpan,
   stripStringLiterals,
   stripXmlComments
-} from "./token-goat-chunk-LOCOX2ML.mjs";
+} from "./token-goat-chunk-QKXBGBQR.mjs";
 import {
   init_define_import_meta_env
 } from "./token-goat-chunk-A37V4PBF.mjs";
@@ -2225,13 +2225,13 @@ function stripGraphqlDescriptions(text) {
       const tripleOpenerPos = line.indexOf('"""');
       if (hashPos !== -1 && (tripleOpenerPos === -1 || hashPos < tripleOpenerPos)) {
         const head = line.slice(0, hashPos);
-        const { code: code2, state: nextState2 } = stripMultilineStringSpan(head, null, "kotlin");
+        const { code: code2, state: nextState2 } = stripMultilineStringSpan(head, null, "graphql");
         state = nextState2;
         outLines.push(stripStringLiterals(code2) + line.slice(hashPos));
         continue;
       }
     }
-    const { code, state: nextState } = stripMultilineStringSpan(line, state, "kotlin");
+    const { code, state: nextState } = stripMultilineStringSpan(line, state, "graphql");
     state = nextState;
     outLines.push(stripStringLiterals(code));
   }
@@ -3761,7 +3761,7 @@ function metadataName(filePath, content, suffix) {
 function addFlowElements(symbols, seen, content, filePath, flowName) {
   const lineIndex = buildLineIndex(content);
   const tagAlternation = Object.keys(FLOW_TAG_KIND).join("|");
-  const re = new RegExp(`<(${tagAlternation})>\\s*([\\s\\S]*?)\\s*</\\1\\s*>`, "g");
+  const re = new RegExp(`<(?:[A-Za-z_][\\w.-]*:)?(${tagAlternation})(?:\\s[^>]*)?>\\s*([\\s\\S]*?)\\s*</(?:[A-Za-z_][\\w.-]*:)?\\1\\s*>`, "g");
   for (const match of content.matchAll(re)) {
     if (symbols.length >= MAX_SYMBOLS11) return;
     const tag = match[1] ?? "";