bunnyquery 1.4.2 → 1.4.4

package/README.md

@@ -24,6 +24,9 @@ you can build your own chat UI on top of it. See
   first load and on scroll-up.
 - **Attachments** — drag-and-drop files and folders, per-file upload status
   (uploading / failed / indexed), and overflow collapsing for large batches.
+  Images are read with vision/OCR, Office/text/code files are extracted
+  server-side, and PDFs are fetched by the model — see
+  [Supported file types](#supported-file-types).
 - **Attachment parser plugins** — register a client-side parser so the widget
   extracts text in the browser from formats the model can't otherwise read, and
   indexes it directly. See [Attachment parser plugins](#attachment-parser-plugins).
@@ -137,12 +140,79 @@ BunnyQuery.logout();
 > instance rather than re-mounting. On a successful mount it logs its version, e.g.
 > `[bunnyquery] v1.3.5`.
 
+## Supported file types
+
+When a user attaches a file, BunnyQuery makes its contents available to the AI
+automatically — detected by extension (with a MIME-type fallback), nothing to
+configure. There are three paths, plus a couple of caveats.
+
+### 1. Images — read directly by the model (vision + OCR)
+
+`.jpg` · `.jpeg` · `.png` · `.gif` · `.webp`
+
+The image is attached to the request inline, so the model both **describes the
+picture** and **reads any text in it (OCR)**. Works on both Claude and OpenAI.
+Only images referenced in the **most recent** message are inlined (older links
+may have expired).
+
+### 2. Documents, data & code — extracted on the server (inlined as text)
+
+The skapi proxy downloads the file, extracts its text **server-side**, and
+inlines that text into the request — the model reads it directly, with no
+fetching. This keeps indexing consistent across model providers.
+
+**Office & e-book** (binary/zip, parsed):
+`.docx` · `.xlsx` · `.pptx` · `.hwp` · `.hwpx` · `.ods` · `.odt` · `.odp` · `.epub`
+
+**Text, data, markup & source code** (decoded as text; `.html`/`.htm` have their
+tags stripped):
+
+```
+.csv .tsv .tab .txt .text .log .md .markdown .rst .json .ndjson .jsonl .geojson
+.xml .yaml .yml .toml .ini .conf .cfg .properties .env .rtf .html .htm
+.js .mjs .cjs .ts .tsx .jsx .py .rb .go .rs .java .kt .c .h .cpp .cc .hpp .cs
+.php .swift .sh .bash .zsh .sql .css .scss .less .vue .svelte .tex .srt .vtt
+```
+
+Plus a **MIME fallback**: any file whose content type is text-like (`text/*`,
+`application/json`, `application/xml`, `*+json`, `*+xml`, `*+yaml`, …) is decoded
+even when its extension isn't in the list above.
+
+Encoding is auto-detected — UTF-8 (BOM-aware) → CP949/EUC-KR (Korean) → Latin-1.
+Extracted text is capped at **200,000 characters**; longer files are truncated
+with a `...[truncated for length; original N characters]` marker.
+
+### 3. PDFs & other links — fetched by the model
+
+`.pdf` (and any file that is neither an image nor server-extractable) is handed
+to the model as a temporary link, which it opens with its built-in web tool:
+**Claude** via `web_fetch`, **OpenAI** via `web_search` (external web access is
+enabled). Both can open and read PDFs, so PDFs work on either provider.
+
+> A provider's web tool opens document/page-style URLs such as PDFs, but not
+> necessarily a bare *data-file* download (e.g. a raw `.csv`/`.tsv` link). That's
+> why those data formats are extracted **server-side** (path 2 above) instead of
+> being left to the model to fetch.
+
+### Caveats
+
+- **Legacy / macro Office** — `.doc` `.xls` `.ppt` (legacy binary) and `.docm`
+  `.xlsm` `.pptm` (macro-enabled) have no reliable server-side reader. They
+  upload fine but are indexed from **metadata only**; re-save as
+  `.docx` / `.xlsx` / `.pptx` (or PDF) to capture their contents.
+- **Anything else** — a format covered by none of the above is indexed from its
+  metadata. To support it, register your own
+  [Attachment parser plugin](#attachment-parser-plugins) — it runs in the browser
+  and feeds parsed text straight into indexing.
+
 ## Attachment parser plugins
 
-By default the chat agent reads most uploads via the model's `web_fetch` tool
-(text, CSV, PDF, …), and Office/OpenDocument/EPUB files are extracted on the
-server. For any format that can be read by **neither** (e.g. a proprietary
-binary format), register a **parser plugin**: it runs in the browser, turns the
+By default the chat agent reads images with vision/OCR, extracts
+Office/OpenDocument/EPUB and text/data/code files on the server, and lets the
+model fetch PDFs with its built-in web tool (`web_fetch` on Claude, `web_search`
+on OpenAI) — see [Supported file types](#supported-file-types). For any format
+read by **none** of these (e.g. a proprietary binary format), register a
+**parser plugin**: it runs in the browser, turns the
 uploaded file into text (or an HTML string), and the widget sends that content
 **inline** for indexing — no `web_fetch`, no server extraction for that file.
 

package/bunnyquery.js

@@ -1116,13 +1116,38 @@ ${options.inlineContentPlaceholder}
       }).catch(function(err) {
         return { content: getErrorMessage(err), isError: true };
       }).then(function(result) {
-        var existing = self.aiChatHistoryCache[params.key] || { messages: [], endOfList: false, startKeyHistory: [] };
-        self.aiChatHistoryCache[params.key] = {
-          messages: existing.messages.concat([{ role: "assistant", content: result.content, isError: result.isError }]),
-          endOfList: existing.endOfList,
-          startKeyHistory: existing.startKeyHistory
-        };
         delete self.pendingAgentRequests[params.key];
+        var existing = self.aiChatHistoryCache[params.key] || { messages: [], endOfList: false, startKeyHistory: [] };
+        var reply = { role: "assistant", content: result.content, isError: result.isError };
+        var onThisVisibleChat = self.host.isViewMounted() && self.getHistoryCacheKey() === params.key;
+        if (onThisVisibleChat) {
+          self.aiChatHistoryCache[params.key] = {
+            messages: existing.messages.concat([reply]),
+            endOfList: existing.endOfList,
+            startKeyHistory: existing.startKeyHistory
+          };
+        } else {
+          var msgs = existing.messages.slice();
+          var idx = -1;
+          for (var i = msgs.length - 1; i >= 0; i--) {
+            var m = msgs[i];
+            if (m && m.isPending && m.role === "assistant" && !m.isBackgroundTask) {
+              idx = i;
+              break;
+            }
+          }
+          if (idx !== -1) {
+            reply._serverItemId = msgs[idx]._serverItemId;
+            msgs[idx] = reply;
+          } else {
+            msgs.push(reply);
+          }
+          self.aiChatHistoryCache[params.key] = {
+            messages: msgs,
+            endOfList: existing.endOfList,
+            startKeyHistory: existing.startKeyHistory
+          };
+        }
         return result;
       });
       this.pendingAgentRequests[params.key] = run;
@@ -1212,7 +1237,6 @@ ${options.inlineContentPlaceholder}
         serviceId: id.serviceId,
         history: historyForLlm
       });
-      var requestToken = this.state.gateRefreshToken;
       var run = this.dispatchAgentRequest({
         key,
         serviceId: id.serviceId,
@@ -1227,7 +1251,7 @@ ${options.inlineContentPlaceholder}
       });
       Promise.resolve(run).catch(function() {
       }).then(function() {
-        if (requestToken !== self.state.gateRefreshToken || self.getHistoryCacheKey() !== key) return;
+        if (!(self.host.isViewMounted() && self.getHistoryCacheKey() === key)) return;
         self.state.sending = false;
         return Promise.resolve(self.typewriteLatestReply(key)).then(function() {
           self.host.scrollToBottom(true);
@@ -1841,7 +1865,7 @@ ${options.inlineContentPlaceholder}
             if (item.status !== "running" && item.status !== "pending") return;
             if (!item.poll || !item.id) return;
             if (self.historyItemPolls.has(item.id)) return;
-            if (item.status === "running" && self.pendingAgentRequests[self.getHistoryCacheKey()]) return;
+            if ((item.status === "running" || item.status === "pending") && self.pendingAgentRequests[self.getHistoryCacheKey()]) return;
             self.historyItemPolls.set(item.id, true);
             var capturedId = item.id;
             var pp = item.poll({
@@ -2084,7 +2108,7 @@ ${options.inlineContentPlaceholder}
   (function() {
     var MCP_PROD = "https://mcp.broadwayinc.computer";
     var MCP_DEV = "https://mcp-dev.broadwayinc.computer";
-    var BQ_VERSION = "1.4.2" ;
+    var BQ_VERSION = "1.4.4" ;
     var ATTACHMENT_URL_EXPIRES_SECONDS = 600;
     var GOOGLE_AUTH_URL = "https://accounts.google.com/o/oauth2/v2/auth";
     var GOOGLE_TOKEN_URL = "https://oauth2.googleapis.com/token";
@@ -2492,6 +2516,43 @@ ${options.inlineContentPlaceholder}
       var mismatched = !!tok && !!currentSub && !!tokenSub && tokenSub !== currentSub;
       return expired || mismatched;
     }
+    function refreshMcpToken() {
+      var client = getStoredMcpClient();
+      var current = getStoredMcpToken();
+      if (!client || !current || !current.refresh_token) return Promise.resolve(null);
+      var body = new URLSearchParams({
+        grant_type: "refresh_token",
+        refresh_token: current.refresh_token,
+        client_id: client.client_id
+      });
+      var headers = { "Content-Type": "application/x-www-form-urlencoded" };
+      if (client.client_secret) {
+        headers.Authorization = basicAuthHeader(client.client_id, client.client_secret);
+      }
+      return fetch(mcpBaseUrl() + "/oauth/token", {
+        method: "POST",
+        headers,
+        body: body.toString()
+      }).then(function(res) {
+        return res.ok ? res.json() : null;
+      }).then(function(json) {
+        if (!json || !json.access_token) return null;
+        var token = Object.assign({}, json, {
+          refresh_token: json.refresh_token || current.refresh_token,
+          expires_at: typeof json.expires_in === "number" ? Date.now() + json.expires_in * 1e3 : void 0
+        });
+        lsSet(skey(SK.mcpToken), JSON.stringify(token));
+        return token;
+      }).catch(function() {
+        return null;
+      });
+    }
+    function ensureMcpGrantFresh() {
+      if (!S.user || !mcpGrantNeedsRefresh(S.user)) return Promise.resolve(true);
+      return refreshMcpToken().then(function(tok) {
+        return !!(tok && !mcpGrantNeedsRefresh(S.user));
+      });
+    }
     function googleEnabled() {
       return !!S.opts.googleClientId;
     }
@@ -3759,6 +3820,8 @@ ${options.inlineContentPlaceholder}
     }
     function refreshSkapiSession() {
       return S.skapi.getProfile({ refreshToken: true }).then(function() {
+        return ensureMcpGrantFresh();
+      }).then(function() {
         return true;
       }).catch(function() {
         return false;
@@ -5099,9 +5162,12 @@ ${options.inlineContentPlaceholder}
           return;
         }
         if (mcpGrantNeedsRefresh(user)) {
-          return beginMcpOAuthOnLogin("chat").catch(function(err) {
-            console.error("[bunnyquery] MCP refresh failed", err);
-            return enterAfterLogin();
+          return refreshMcpToken().then(function(tok) {
+            if (tok && !mcpGrantNeedsRefresh(user)) return enterAfterLogin();
+            return beginMcpOAuthOnLogin("chat").catch(function(err) {
+              console.error("[bunnyquery] MCP refresh failed", err);
+              return enterAfterLogin();
+            });
           });
         }
         return enterAfterLogin();
@@ -5158,6 +5224,12 @@ ${options.inlineContentPlaceholder}
           scheduleAttachmentOverflowRecompute();
         });
       }
+      if (!S._visBound && typeof document !== "undefined" && document.addEventListener) {
+        S._visBound = true;
+        document.addEventListener("visibilitychange", function() {
+          if (document.visibilityState === "visible" && S.user) ensureMcpGrantFresh();
+        });
+      }
       boot();
       return PUBLIC;
     }

package/dist/engine.cjs

@@ -1150,13 +1150,38 @@ var ChatSession = class {
     }).catch(function(err) {
       return { content: getErrorMessage(err), isError: true };
     }).then(function(result) {
-      var existing = self.aiChatHistoryCache[params.key] || { messages: [], endOfList: false, startKeyHistory: [] };
-      self.aiChatHistoryCache[params.key] = {
-        messages: existing.messages.concat([{ role: "assistant", content: result.content, isError: result.isError }]),
-        endOfList: existing.endOfList,
-        startKeyHistory: existing.startKeyHistory
-      };
       delete self.pendingAgentRequests[params.key];
+      var existing = self.aiChatHistoryCache[params.key] || { messages: [], endOfList: false, startKeyHistory: [] };
+      var reply = { role: "assistant", content: result.content, isError: result.isError };
+      var onThisVisibleChat = self.host.isViewMounted() && self.getHistoryCacheKey() === params.key;
+      if (onThisVisibleChat) {
+        self.aiChatHistoryCache[params.key] = {
+          messages: existing.messages.concat([reply]),
+          endOfList: existing.endOfList,
+          startKeyHistory: existing.startKeyHistory
+        };
+      } else {
+        var msgs = existing.messages.slice();
+        var idx = -1;
+        for (var i = msgs.length - 1; i >= 0; i--) {
+          var m = msgs[i];
+          if (m && m.isPending && m.role === "assistant" && !m.isBackgroundTask) {
+            idx = i;
+            break;
+          }
+        }
+        if (idx !== -1) {
+          reply._serverItemId = msgs[idx]._serverItemId;
+          msgs[idx] = reply;
+        } else {
+          msgs.push(reply);
+        }
+        self.aiChatHistoryCache[params.key] = {
+          messages: msgs,
+          endOfList: existing.endOfList,
+          startKeyHistory: existing.startKeyHistory
+        };
+      }
       return result;
     });
     this.pendingAgentRequests[params.key] = run;
@@ -1246,7 +1271,6 @@ var ChatSession = class {
       serviceId: id.serviceId,
       history: historyForLlm
     });
-    var requestToken = this.state.gateRefreshToken;
     var run = this.dispatchAgentRequest({
       key,
       serviceId: id.serviceId,
@@ -1261,7 +1285,7 @@ var ChatSession = class {
     });
     Promise.resolve(run).catch(function() {
     }).then(function() {
-      if (requestToken !== self.state.gateRefreshToken || self.getHistoryCacheKey() !== key) return;
+      if (!(self.host.isViewMounted() && self.getHistoryCacheKey() === key)) return;
       self.state.sending = false;
       return Promise.resolve(self.typewriteLatestReply(key)).then(function() {
         self.host.scrollToBottom(true);
@@ -1875,7 +1899,7 @@ var ChatSession = class {
           if (item.status !== "running" && item.status !== "pending") return;
           if (!item.poll || !item.id) return;
           if (self.historyItemPolls.has(item.id)) return;
-          if (item.status === "running" && self.pendingAgentRequests[self.getHistoryCacheKey()]) return;
+          if ((item.status === "running" || item.status === "pending") && self.pendingAgentRequests[self.getHistoryCacheKey()]) return;
           self.historyItemPolls.set(item.id, true);
           var capturedId = item.id;
           var pp = item.poll({