@gmickel/gno 1.27.0 → 1.28.0

package/README.md

@@ -112,7 +112,7 @@ gno daemon --detach  # headless continuous indexing (background; --status / --st
 
 <!-- public-truth:current-version -->
 
-> Current release: **v1.26.0** — see [CHANGELOG.md](./CHANGELOG.md)
+> Current release: **v1.27.1** — see [CHANGELOG.md](./CHANGELOG.md)
 
 <!-- /public-truth -->
 
@@ -904,7 +904,7 @@ graph TD
 | **Document Editor**  | Create, edit, delete docs with live markdown preview                           |
 | **Web UI**           | Visual dashboard for search, browse, edit, and AI Q&A                          |
 | **REST API**         | HTTP API for custom tools and integrations                                     |
-| **Multi-Format**     | Markdown, PDF, DOCX, XLSX, PPTX, plain text                                    |
+| **Multi-Format**     | Markdown, PDF, Office, JSONL, EML/MBOX, ICS, transcript, and browser exports   |
 | **Local LLM**        | AI answers via llama.cpp, no API keys                                          |
 | **Remote Inference** | Optional HTTP endpoints for embedding, reranking, expansion, and generation    |
 | **Privacy First**    | Local by default; no telemetry; network use is explicit or model provisioning  |

package/assets/skill/SKILL.md

@@ -192,7 +192,32 @@ gno get gno://work/report.md --json
 gno multi-get gno://work/doc1.md gno://work/doc2.md
 ```
 
-**Editable vs read-only**: `gno get --json` returns a `capabilities` field showing whether a document is editable at its source. Markdown and plain text files are editable in place. Converted documents (PDF, DOCX, XLSX) are read-only -- to edit their content, create a new markdown note instead of overwriting the binary source.
+**Editable vs read-only**: `gno get --json` returns a `capabilities` field showing whether a document is editable at its source. Markdown and plain text files are editable in place. Converted documents (PDF, DOCX, XLSX) and logical records from JSONL, mail, calendar, transcript, or browser exports are read-only -- edit/regenerate the source export or create a new markdown note instead of overwriting GNO's virtual record.
+
+**Export records**: search/get JSON may include a `record` object containing an
+exact bounded source locator, people/dates, thread/event/session identity,
+attachment inventory, and cue/message/event anchors. `source.relPath` is the
+real export file; `record.adapter` identifies the exact adapter version and
+configuration fingerprint. Use the result's unique `uri` or `docid` with
+`gno get`. If update/index reports a partial export snapshot, valid siblings
+were indexed but unseen old records were intentionally preserved; regenerate
+the export and rerun the command.
+
+| Export source                | Activation                                              | Logical record                         | Important boundary                                                                                 |
+| ---------------------------- | ------------------------------------------------------- | -------------------------------------- | -------------------------------------------------------------------------------------------------- |
+| JSONL/NDJSON                 | Automatic; optional `recordAdapters.jsonl.fieldMapping` | One object per line                    | Configure/map an ID for update-in-place identity; content-derived fallback edits become remove+add |
+| EML/MBOX                     | Automatic                                               | One message                            | MIME/body bounded; attachments inventoried, never opened or indexed                                |
+| ICS                          | Automatic                                               | One event/exception                    | Timezone normalized; recurrence anchors capped at 64                                               |
+| VTT/SRT                      | Automatic                                               | One cue/segment                        | Speaker and timestamp anchors retained                                                             |
+| Generic JSON/text transcript | Explicit `recordAdapters.transcript.format`             | One segment/record                     | Never guessed from generic JSON/text                                                               |
+| `.browser-export`            | Explicit export file                                    | One bookmark/history/reading-list item | Live profiles/databases/cookies rejected; URLs never fetched                                       |
+
+Shared defaults: 100 MiB/container, 2,000,000 canonical characters/record,
+100,000 metadata characters/record, 50,000,000 characters or 100,000
+records/snapshot, 1,000 retained failures, and a 60-second adapter deadline.
+Only complete authoritative snapshots tombstone disappeared records. No export
+adapter authenticates to a live account, fetches remote content, executes
+embedded content, or unpacks attachments/archives.
 
 ## Search Then Get (common pipeline)
 

package/browser-extension/artifacts/gno-browser-clipper-v1.28.0.zip.sha256

@@ -0,0 +1 @@
+5cdb85ddd0e73801a566527b7a908c8e0854a83c56cae281bab5f1285dae6734  gno-browser-clipper-v1.28.0.zip

package/browser-extension/dist/manifest.json

@@ -21,5 +21,5 @@
   "content_security_policy": {
     "extension_pages": "script-src 'self'; object-src 'none'; connect-src http://127.0.0.1:*"
   },
-  "version": "1.27.0"
+  "version": "1.28.0"
 }

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@gmickel/gno",
-  "version": "1.27.0",
+  "version": "1.28.0",
   "description": "Local semantic search for your documents. Index Markdown, PDF, and Office files with hybrid BM25 + vector search.",
   "keywords": [
     "embeddings",
@@ -220,7 +220,7 @@
     "playwright": "1.58.2",
     "pptxgenjs": "4.0.1",
     "ultracite": "7.1.5",
-    "vitest": "4.0.18",
+    "vitest": "4.1.0",
     "web-tree-sitter": "0.26.8"
   },
   "peerDependencies": {

package/spec/cli.md

@@ -73,8 +73,8 @@ equivalent files fail closed as ambiguous.
 | collection list    | yes    | no      | no    | yes  | no    | terminal |
 | collection remove  | no     | no      | no    | no   | no    | terminal |
 | collection rename  | no     | no      | no    | no   | no    | terminal |
-| update             | no     | no      | no    | no   | no    | terminal |
-| index              | no     | no      | no    | no   | no    | terminal |
+| update             | yes    | no      | no    | no   | no    | terminal |
+| index              | yes    | no      | no    | no   | no    | terminal |
 | embed              | no     | no      | no    | no   | no    | terminal |
 | search             | yes    | yes     | yes   | yes  | yes   | terminal |
 | vsearch            | yes    | yes     | yes   | yes  | yes   | terminal |
@@ -772,13 +772,14 @@ Sync files from disk into the index (ingestion without embedding).
 **Synopsis:**
 
 ```bash
-gno update [--git-pull]
+gno update [--git-pull] [--json]
 ```
 
 **Options:**
 | Option | Type | Description |
 |--------|------|-------------|
 | `--git-pull` | boolean | Run `git pull` in git repositories before scanning |
+| `--json` | boolean | Emit the complete deterministic sync result on stdout |
 
 **Behavior:**
 
@@ -789,6 +790,13 @@ gno update [--git-pull]
 5. Update FTS index
 6. Mark missing files as inactive
 
+**JSON output:** The top-level value is the complete sync result. Each entry in
+`collections[].files[]` may contain a `recordImport` receipt conforming to
+[`record-import@1.0`](./output-schemas/record-import.schema.json). Receipt items
+are sorted deterministically and capped at 1,000; `itemsTruncated` reports
+omitted actions. Partial snapshots expose `warnings[]` even when no individual
+record failure was reported. Human progress and diagnostics remain on stderr.
+
 **Exit Codes:**
 
 - 0: Success (conversion warnings do not affect exit code)
@@ -803,7 +811,7 @@ Build or update the index end-to-end (update + embed).
 **Synopsis:**
 
 ```bash
-gno index [--collection <name>] [--no-embed] [--models-pull] [--git-pull] [--yes]
+gno index [collection] [--no-embed] [--models-pull] [--git-pull] [--json] [--yes]
 ```
 
 **Options:**
@@ -813,6 +821,7 @@ gno index [--collection <name>] [--no-embed] [--models-pull] [--git-pull] [--yes
 | `--no-embed` | boolean | Run ingestion only, skip embedding |
 | `--models-pull` | boolean | Download models if missing (prompts unless `--yes`) |
 | `--git-pull` | boolean | Run `git pull` in git repositories |
+| `--json` | boolean | Emit the complete deterministic sync and embedding result on stdout |
 | `--yes` | boolean | Accept defaults, no prompts |
 
 **Behavior:**
@@ -820,6 +829,13 @@ gno index [--collection <name>] [--no-embed] [--models-pull] [--git-pull] [--yes
 - Runs `update` then `embed` by default
 - With `--no-embed`, runs `update` only
 
+**JSON output:** Emits `{ syncResult, embedSkipped, embedResult? }`.
+`syncResult.collections[].files[].recordImport`, when present, conforms to
+[`record-import@1.0`](./output-schemas/record-import.schema.json) with the same
+deterministic ordering, bounds, truncation disclosure, and partial-snapshot
+warnings as `gno update --json`. Human progress and diagnostics remain on
+stderr.
+
 **Exit Codes:**
 
 - 0: Success
@@ -1034,6 +1050,27 @@ broad-to-specific path-prefix order. The field is absent when no scope matches;
 `uri` and `docid` remain the exact source identity. The same contract applies to
 `vsearch`, `query`, and the `results` array returned by `ask`.
 
+Logical documents created from file/export adapters additionally include a
+bounded `record` object with their opaque record key, exact export locator,
+people/dates, thread/event/session identity, attachment inventory, and anchors.
+`source.relPath` names the real export container; `uri` and `docid` address the
+individual virtual document. The closed `record.adapter` identity contains the
+adapter ID, version, and configuration fingerprint. `get` and `multi-get`
+preserve the same fields.
+
+File/export adapter iteration has a 60-second deadline in addition to the byte,
+record, metadata, and total-character caps. A partial import that retains valid
+siblings exits successfully but is never silent: terminal output includes the
+file, bounded warning count, and snapshot state; `--verbose` adds stable failure
+codes, bounded source locators, retryability, and redacted messages.
+`gno update --json`, `gno index --json`, and internal and SDK-facing sync
+results include a `recordImport` receipt conforming to
+[`record-import@1.0`](./output-schemas/record-import.schema.json), with adapter
+identity, configuration fingerprint, snapshot authority, cap state, bytes read,
+per-action identity/provenance/attachment receipts, truncation disclosure,
+warnings, and bounded failures. `.gno/records/` is a reserved virtual
+namespace and is never walked as physical collection content.
+
 **Exit Codes:**
 
 - 0: Success (including zero results)

package/spec/db/schema.sql

@@ -92,6 +92,12 @@ CREATE TABLE IF NOT EXISTS documents (
   converter_version TEXT,
   language_hint TEXT,               -- BCP-47 or NULL
   content_type_source TEXT,         -- frontmatter | rules | default | extension | null
+  record_key TEXT,                  -- opaque stable logical-record identity
+  record_source_path TEXT,          -- collection-relative export/container path
+  record_source_locator TEXT,       -- bounded exact record/cue/message/event locator
+  record_metadata TEXT,             -- bounded canonical JSON record metadata
+  record_anchors TEXT,              -- bounded canonical JSON exact anchors
+  record_adapter_fingerprint TEXT,  -- config-bound adapter identity for re-import invalidation
 
   -- Status
   active INTEGER NOT NULL DEFAULT 1,
@@ -116,6 +122,12 @@ CREATE INDEX IF NOT EXISTS idx_documents_active ON documents(active);
 CREATE INDEX IF NOT EXISTS idx_documents_mirror_hash ON documents(mirror_hash);
 CREATE INDEX IF NOT EXISTS idx_documents_docid ON documents(docid);
 CREATE INDEX IF NOT EXISTS idx_documents_uri ON documents(uri);
+CREATE UNIQUE INDEX IF NOT EXISTS idx_documents_record_key
+  ON documents(collection, record_source_path, record_key)
+  WHERE record_source_path IS NOT NULL AND record_key IS NOT NULL;
+CREATE INDEX IF NOT EXISTS idx_documents_record_source_path
+  ON documents(collection, record_source_path)
+  WHERE record_source_path IS NOT NULL;
 
 -- ─────────────────────────────────────────────────────────────────────────────
 -- Content (content-addressed markdown mirrors)

package/spec/mcp.md

@@ -697,6 +697,11 @@ Search result items include `contentType` when available and always include
 human-oriented; structured clients should read `structuredContent.results`.
 Structured result items also preserve optional `context` guidance in
 global-to-specific order without changing the result `uri` or `docid`.
+File/export records also include bounded `record` provenance in structured
+search/get/multi-get/Ask output. Their `source.relPath` is the real local export
+container while the unique `uri` remains the required exact retrieval ref. The
+closed `record.adapter` object identifies the adapter ID, version, and
+configuration fingerprint used to produce the logical record.
 When `explain: true`, `structuredContent.meta.explain` includes deterministic
 stage lines and per-result score receipts. Non-neutral configured content-type
 rules add `contentTypeBoost` with base/raw scores, factor, capped contribution,

package/spec/output-schemas/ask.schema.json

@@ -131,6 +131,131 @@
           "type": "string",
           "description": "Matching text snippet from document mirror"
         },
+        "record": {
+          "type": "object",
+          "additionalProperties": false,
+          "description": "Bounded logical-record provenance for a file/export source",
+          "required": ["recordKey", "sourceLocator", "anchors", "adapter"],
+          "properties": {
+            "recordKey": { "type": "string", "pattern": "^[a-f0-9]{64}$" },
+            "sourceLocator": {
+              "type": "string",
+              "minLength": 1,
+              "maxLength": 512
+            },
+            "anchors": {
+              "type": "array",
+              "maxItems": 256,
+              "items": {
+                "type": "object",
+                "additionalProperties": false,
+                "required": ["kind", "value"],
+                "properties": {
+                  "kind": {
+                    "enum": [
+                      "line",
+                      "cue",
+                      "timestamp",
+                      "message",
+                      "event",
+                      "record"
+                    ]
+                  },
+                  "value": {
+                    "type": "string",
+                    "minLength": 1,
+                    "maxLength": 512
+                  },
+                  "endValue": {
+                    "type": "string",
+                    "minLength": 1,
+                    "maxLength": 512
+                  }
+                }
+              }
+            },
+            "adapter": {
+              "type": "object",
+              "additionalProperties": false,
+              "required": ["id", "version", "fingerprint"],
+              "properties": {
+                "id": { "type": "string", "minLength": 1, "maxLength": 128 },
+                "version": {
+                  "type": "string",
+                  "minLength": 1,
+                  "maxLength": 64
+                },
+                "fingerprint": { "type": "string", "pattern": "^[a-f0-9]{64}$" }
+              }
+            },
+            "author": { "type": "string", "maxLength": 2048 },
+            "participants": {
+              "type": "array",
+              "maxItems": 256,
+              "items": { "type": "string", "minLength": 1, "maxLength": 2048 }
+            },
+            "categories": {
+              "type": "array",
+              "maxItems": 256,
+              "items": { "type": "string", "minLength": 1, "maxLength": 512 }
+            },
+            "dateFields": {
+              "type": "object",
+              "maxProperties": 256,
+              "propertyNames": { "type": "string", "maxLength": 128 },
+              "additionalProperties": {
+                "type": "string",
+                "minLength": 1,
+                "maxLength": 256
+              }
+            },
+            "messageId": { "type": "string", "maxLength": 2048 },
+            "inReplyTo": { "type": "string", "maxLength": 2048 },
+            "references": {
+              "type": "array",
+              "maxItems": 256,
+              "items": {
+                "type": "string",
+                "minLength": 1,
+                "maxLength": 2048
+              }
+            },
+            "threadId": { "type": "string", "maxLength": 2048 },
+            "eventId": { "type": "string", "maxLength": 2048 },
+            "sessionId": { "type": "string", "maxLength": 2048 },
+            "attachments": {
+              "type": "array",
+              "maxItems": 256,
+              "items": {
+                "type": "object",
+                "additionalProperties": false,
+                "required": ["name"],
+                "properties": {
+                  "name": {
+                    "type": "string",
+                    "minLength": 1,
+                    "maxLength": 512
+                  },
+                  "mime": {
+                    "type": "string",
+                    "minLength": 1,
+                    "maxLength": 256
+                  },
+                  "bytes": {
+                    "type": "integer",
+                    "minimum": 0,
+                    "maximum": 9007199254740991
+                  },
+                  "disposition": { "enum": ["inline", "attachment"] },
+                  "sha256": {
+                    "type": "string",
+                    "pattern": "^[a-f0-9]{64}$"
+                  }
+                }
+              }
+            }
+          }
+        },
         "snippetRange": {
           "type": "object",
           "description": "Line range of snippet in mirror content",

package/spec/output-schemas/context-capsule-v1.schema.json

@@ -330,6 +330,98 @@
     }
   },
   "definitions": {
+    "recordAnchor": {
+      "type": "object",
+      "additionalProperties": false,
+      "required": ["kind", "value"],
+      "properties": {
+        "kind": {
+          "enum": ["line", "cue", "timestamp", "message", "event", "record"]
+        },
+        "value": { "type": "string", "minLength": 1, "maxLength": 512 },
+        "endValue": { "type": "string", "minLength": 1, "maxLength": 512 }
+      }
+    },
+    "recordAttachment": {
+      "type": "object",
+      "additionalProperties": false,
+      "required": ["name"],
+      "properties": {
+        "name": { "type": "string", "minLength": 1, "maxLength": 512 },
+        "mime": { "type": "string", "minLength": 1, "maxLength": 256 },
+        "bytes": {
+          "type": "integer",
+          "minimum": 0,
+          "maximum": 9007199254740991
+        },
+        "disposition": { "enum": ["inline", "attachment"] },
+        "sha256": { "$ref": "#/definitions/sha256" }
+      }
+    },
+    "recordEvidenceMetadata": {
+      "type": "object",
+      "additionalProperties": false,
+      "required": ["recordKey", "sourceLocator", "anchors", "adapter"],
+      "properties": {
+        "recordKey": { "$ref": "#/definitions/sha256" },
+        "sourceLocator": { "type": "string", "minLength": 1, "maxLength": 512 },
+        "anchors": {
+          "type": "array",
+          "maxItems": 256,
+          "items": { "$ref": "#/definitions/recordAnchor" }
+        },
+        "adapter": {
+          "type": "object",
+          "additionalProperties": false,
+          "required": ["id", "version", "fingerprint"],
+          "properties": {
+            "id": { "type": "string", "minLength": 1, "maxLength": 128 },
+            "version": {
+              "type": "string",
+              "minLength": 1,
+              "maxLength": 64
+            },
+            "fingerprint": { "$ref": "#/definitions/sha256" }
+          }
+        },
+        "author": { "type": "string", "maxLength": 2048 },
+        "participants": {
+          "type": "array",
+          "maxItems": 256,
+          "items": { "type": "string", "minLength": 1, "maxLength": 2048 }
+        },
+        "categories": {
+          "type": "array",
+          "maxItems": 256,
+          "items": { "type": "string", "minLength": 1, "maxLength": 512 }
+        },
+        "dateFields": {
+          "type": "object",
+          "maxProperties": 256,
+          "propertyNames": { "type": "string", "maxLength": 128 },
+          "additionalProperties": {
+            "type": "string",
+            "minLength": 1,
+            "maxLength": 256
+          }
+        },
+        "messageId": { "type": "string", "maxLength": 2048 },
+        "inReplyTo": { "type": "string", "maxLength": 2048 },
+        "references": {
+          "type": "array",
+          "maxItems": 256,
+          "items": { "type": "string", "minLength": 1, "maxLength": 2048 }
+        },
+        "threadId": { "type": "string", "maxLength": 2048 },
+        "eventId": { "type": "string", "maxLength": 2048 },
+        "sessionId": { "type": "string", "maxLength": 2048 },
+        "attachments": {
+          "type": "array",
+          "maxItems": 256,
+          "items": { "$ref": "#/definitions/recordAttachment" }
+        }
+      }
+    },
     "sha256": { "type": "string", "pattern": "^[a-f0-9]{64}$" },
     "nullableSha256": {
       "oneOf": [{ "$ref": "#/definitions/sha256" }, { "type": "null" }]
@@ -577,7 +669,8 @@
         "trust": { "const": "untrusted" },
         "egress": {
           "enum": ["local_only", "lan", "remote", "unclassified", "unavailable"]
-        }
+        },
+        "record": { "$ref": "#/definitions/recordEvidenceMetadata" }
       }
     },
     "coverage": {

package/spec/output-schemas/get.schema.json

@@ -129,6 +129,100 @@
         "reason": { "type": "string" }
       }
     },
+    "record": {
+      "type": "object",
+      "additionalProperties": false,
+      "description": "Bounded logical-record provenance for a file/export source",
+      "required": ["recordKey", "sourceLocator", "anchors", "adapter"],
+      "properties": {
+        "recordKey": { "type": "string", "pattern": "^[a-f0-9]{64}$" },
+        "sourceLocator": { "type": "string", "minLength": 1, "maxLength": 512 },
+        "anchors": {
+          "type": "array",
+          "maxItems": 256,
+          "items": {
+            "type": "object",
+            "additionalProperties": false,
+            "required": ["kind", "value"],
+            "properties": {
+              "kind": {
+                "enum": [
+                  "line",
+                  "cue",
+                  "timestamp",
+                  "message",
+                  "event",
+                  "record"
+                ]
+              },
+              "value": { "type": "string", "minLength": 1, "maxLength": 512 },
+              "endValue": { "type": "string", "minLength": 1, "maxLength": 512 }
+            }
+          }
+        },
+        "adapter": {
+          "type": "object",
+          "additionalProperties": false,
+          "required": ["id", "version", "fingerprint"],
+          "properties": {
+            "id": { "type": "string", "minLength": 1, "maxLength": 128 },
+            "version": { "type": "string", "minLength": 1, "maxLength": 64 },
+            "fingerprint": { "type": "string", "pattern": "^[a-f0-9]{64}$" }
+          }
+        },
+        "author": { "type": "string", "maxLength": 2048 },
+        "participants": {
+          "type": "array",
+          "maxItems": 256,
+          "items": { "type": "string", "minLength": 1, "maxLength": 2048 }
+        },
+        "categories": {
+          "type": "array",
+          "maxItems": 256,
+          "items": { "type": "string", "minLength": 1, "maxLength": 512 }
+        },
+        "dateFields": {
+          "type": "object",
+          "maxProperties": 256,
+          "propertyNames": { "type": "string", "maxLength": 128 },
+          "additionalProperties": {
+            "type": "string",
+            "minLength": 1,
+            "maxLength": 256
+          }
+        },
+        "messageId": { "type": "string", "maxLength": 2048 },
+        "inReplyTo": { "type": "string", "maxLength": 2048 },
+        "references": {
+          "type": "array",
+          "maxItems": 256,
+          "items": { "type": "string", "minLength": 1, "maxLength": 2048 }
+        },
+        "threadId": { "type": "string", "maxLength": 2048 },
+        "eventId": { "type": "string", "maxLength": 2048 },
+        "sessionId": { "type": "string", "maxLength": 2048 },
+        "attachments": {
+          "type": "array",
+          "maxItems": 256,
+          "items": {
+            "type": "object",
+            "additionalProperties": false,
+            "required": ["name"],
+            "properties": {
+              "name": { "type": "string", "minLength": 1, "maxLength": 512 },
+              "mime": { "type": "string", "minLength": 1, "maxLength": 256 },
+              "bytes": {
+                "type": "integer",
+                "minimum": 0,
+                "maximum": 9007199254740991
+              },
+              "disposition": { "enum": ["inline", "attachment"] },
+              "sha256": { "type": "string", "pattern": "^[a-f0-9]{64}$" }
+            }
+          }
+        }
+      }
+    },
     "tags": {
       "type": "array",
       "description": "Tags associated with the document",

package/spec/output-schemas/mcp-job-status.schema.json

@@ -74,6 +74,34 @@
               }
             }
           }
+        },
+        "files": {
+          "type": "array",
+          "items": {
+            "$ref": "#/$defs/fileSyncResult"
+          }
+        }
+      }
+    },
+    "fileSyncResult": {
+      "type": "object",
+      "additionalProperties": false,
+      "required": ["relPath", "status"],
+      "properties": {
+        "relPath": { "type": "string" },
+        "status": {
+          "enum": ["added", "updated", "unchanged", "error", "skipped"]
+        },
+        "docid": { "type": "string" },
+        "mirrorHash": { "type": "string", "pattern": "^[a-f0-9]{64}$" },
+        "contentType": { "type": "string" },
+        "contentTypeSource": {
+          "enum": ["frontmatter-type", "prefix", "path-ext", "fallback"]
+        },
+        "errorCode": { "type": "string" },
+        "errorMessage": { "type": "string" },
+        "recordImport": {
+          "$ref": "gno://schemas/record-import@1.0"
         }
       }
     },