@steipete/summarize 0.10.0 → 0.11.1

package/docs/smoketest.md

@@ -9,55 +9,64 @@ read_when:
 Goal: exercise URL + file inputs, extraction + LLM summary paths, multiple models.
 
 ## Preconditions
+
 - API keys set for at least: `OPENAI_API_KEY`, `GEMINI_API_KEY`.
 - Optional: `FIRECRAWL_API_KEY` to test fallback (if available).
 
 ## Models (cheap/fast)
+
 - `openai/gpt-5-mini`
 - `google/gemini-3-flash-preview`
 
 ## Matrix (20 cases)
 
 ### Websites (LLM summary, 10)
-1) Static HTML: `https://example.com` (model: gemini-3-flash)
-2) Wikipedia article: `https://en.wikipedia.org/wiki/Swift_(programming_language)` (model: gpt-5-mini)
-3) MDN doc: `https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/200` (model: gemini-3-flash)
-4) Reuters article: `https://www.reuters.com/world/` (model: gpt-5-mini)
-5) BBC article: `https://www.bbc.com/news` (model: gemini-3-flash)
-6) GitHub README: `https://github.com/vitejs/vite` (model: gpt-5-mini)
-7) Substack post: pick any public post (model: gemini-3-flash)
-8) Medium post: pick any public post (model: gpt-5-mini)
-9) JS-heavy page: `https://vercel.com` (model: gemini-3-flash)
-10) 404 page: `https://example.com/does-not-exist` (model: gpt-5-mini)
+
+1. Static HTML: `https://example.com` (model: gemini-3-flash)
+2. Wikipedia article: `https://en.wikipedia.org/wiki/Swift_(programming_language)` (model: gpt-5-mini)
+3. MDN doc: `https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/200` (model: gemini-3-flash)
+4. Reuters article: `https://www.reuters.com/world/` (model: gpt-5-mini)
+5. BBC article: `https://www.bbc.com/news` (model: gemini-3-flash)
+6. GitHub README: `https://github.com/vitejs/vite` (model: gpt-5-mini)
+7. Substack post: pick any public post (model: gemini-3-flash)
+8. Medium post: pick any public post (model: gpt-5-mini)
+9. JS-heavy page: `https://vercel.com` (model: gemini-3-flash)
+10. 404 page: `https://example.com/does-not-exist` (model: gpt-5-mini)
 
 ### YouTube (LLM summary, 2)
-11) Captions available: pick a popular talk/interview (model: gemini-3-flash, `--youtube auto`)
-12) No captions: pick a random channel upload w/o captions (model: gpt-5-mini, `--youtube auto`)
+
+11. Captions available: pick a popular talk/interview (model: gemini-3-flash, `--youtube auto`)
+12. No captions: pick a random channel upload w/o captions (model: gpt-5-mini, `--youtube auto`)
 
 ### Remote files (LLM summary, 4)
-13) PDF URL: any public PDF report (model: gemini-3-flash)
-14) PNG URL: `https://upload.wikimedia.org/wikipedia/commons/7/70/Example.png` (model: gpt-5-mini)
-15) MP3 URL: any public MP3 sample (model: gemini-3-flash)
-16) CSV URL: any public CSV sample (model: gpt-5-mini)
+
+13. PDF URL: any public PDF report (model: gemini-3-flash)
+14. PNG URL: `https://upload.wikimedia.org/wikipedia/commons/7/70/Example.png` (model: gpt-5-mini)
+15. MP3 URL: any public MP3 sample (model: gemini-3-flash)
+16. CSV URL: any public CSV sample (model: gpt-5-mini)
 
 ### Local files (LLM summary, 4)
-17) `tests/fixtures/sample.txt` (create if missing) (model: gemini-3-flash)
-18) `tests/fixtures/sample.md` (create if missing) (model: gpt-5-mini)
-19) `tests/fixtures/sample.json` (create if missing) (model: gemini-3-flash)
-20) `tests/fixtures/sample.png` (create if missing; use a real PNG, not 1x1) (model: gpt-5-mini)
+
+17. `tests/fixtures/sample.txt` (create if missing) (model: gemini-3-flash)
+18. `tests/fixtures/sample.md` (create if missing) (model: gpt-5-mini)
+19. `tests/fixtures/sample.json` (create if missing) (model: gemini-3-flash)
+20. `tests/fixtures/sample.png` (create if missing; use a real PNG, not 1x1) (model: gpt-5-mini)
 
 ## Commands (template)
+
 - Website: `pnpm summarize -- "<url>" --model <model> --length short`
 - YouTube: `pnpm summarize -- "<url>" --model <model> --youtube auto`
 - File URL: `pnpm summarize -- "<url>" --model <model>`
 - Local file: `pnpm summarize -- "<path>" --model <model>`
 
 ## Capture
+
 - Log: stdout + stderr, exit code, and timing line.
 - Note extraction path (HTML vs Firecrawl vs YouTube transcript).
 - File errors: media type rejection, size limits, token preflight.
 
 ## Bug bar
+
 - Crash, hang, or non-zero exit.
 - Empty summary with non-empty input.
 - Incorrect mode selection (e.g., YouTube treated as normal URL).

package/docs/timestamps.md

@@ -7,6 +7,7 @@ read_when:
 # Transcript Timestamps Plan
 
 Short scope
+
 - Add `--timestamps` flag to request timed transcripts.
 - Preserve existing plain transcript text; add structured segments + timed text.
 - Chat mode: include timed transcript + prompt for `[mm:ss]` references.
@@ -14,6 +15,7 @@ Short scope
 - Coverage: YouTube, podcasts, embedded captions, generic media; whisper.cpp = no segments unless we add verbose output later.
 
 ## 1) API / data model
+
 - New option: `FetchLinkContentOptions.transcriptTimestamps?: boolean`.
 - Thread through provider options (`ProviderFetchOptions`).
 - New types:
@@ -24,52 +26,65 @@ Short scope
 - Keep `TranscriptResolution.text` unchanged (plain transcript).
 
 Notes
+
 - `--timestamps` should only alter output when requested; default output remains stable.
 - For JSON output, include both `transcriptSegments` and `transcriptTimedText` when requested.
 
 ## 2) Provider updates
+
 YouTube (youtubei)
+
 - Parse `startMs` (and duration if present) from `transcriptSegmentRenderer`.
 - Build segments array; `text` still plain (join of text).
 
 YouTube (captionTracks json3 / xml)
+
 - json3 provides `events[].tStartMs` and `dDurationMs`; parse segments from `events.segs[].utf8`.
 - XML captions include `start` + `dur`; parse segments when present.
 
 Podcast RSS transcripts
+
 - VTT parser should output segments (start/end + cue text).
 - JSON transcript: support `segments` with `start`/`startMs` + `end`/`endMs` + `text`.
 - Plain text transcripts: `segments = null`.
 
 Generic embedded captions
+
 - When track is VTT/JSON, parse into segments; otherwise `null`.
 
 yt-dlp / whisper / whisper.cpp
+
 - Keep `segments = null` (plain text only).
 - Optional future: request verbose or SRT output from OpenAI/FAL when supported.
 
 ## 3) Cache behavior
+
 - Store `segments` in transcript metadata (or dedicated cache field).
 - If `--timestamps` and cached transcript lacks segments, treat as miss and refetch.
 - Keep cache keys stable; only bypass when timestamps requested.
 
 ## 4) CLI / daemon
+
 - Add `--timestamps` to CLI help + config.
 - Map to `FetchLinkContentOptions.transcriptTimestamps`.
 - `--extract --json`: include `transcriptSegments` + `transcriptTimedText`.
 - Non-JSON extract: keep plain transcript unless `--timestamps`, then output timed text block.
 
 ## 5) Chat prompt + content
+
 - `buildChatPageContent`: when timestamps requested, include `Timed transcript:` block using `[mm:ss]`.
 - `buildChatSystemPrompt`: add instruction:
   - “When referencing moments, include `[mm:ss]` timestamps from the transcript.”
 
 ## 6) Chrome extension UI
+
 Render
+
 - Linkify `[mm:ss]` and `[hh:mm:ss]` in assistant messages.
 - Convert to `timestamp:<seconds>` hrefs (or data attribute).
 
 Seek handler
+
 - On click: prevent default, parse seconds, send `panel:seek` → background → content script.
 - Content script:
   - Find `<video>` or `<audio>`.
@@ -80,24 +95,30 @@ Seek handler
   - If `window.ytplayer` / YT IFrame API available, `player.seekTo(seconds, true)`.
 
 ## 7) Tests
+
 Core
+
 - youtubei transcript parsing yields segments + plain text.
 - captionTracks json3 + xml yield segments.
 - VTT parser yields segments.
 - Cache: timestamps requested + cached without segments → refetch.
 
 Daemon / CLI
+
 - `--timestamps` propagates into fetch options.
 - JSON extract includes `transcriptSegments` + `transcriptTimedText`.
 
 Chrome extension
+
 - Chat content includes timed transcript when requested.
 - Sidepanel: timestamp link emits `panel:seek`.
 - Content script seek: playing stays playing, paused stays paused; audio + video.
 
 ## 8) Changelog
+
 - Entry: `--timestamps` flag, timed transcripts in chat, clickable timestamps in extension, podcast support.
 
 ## 9) Notes / open
+
 - “VisPoR” = whisper.cpp: no timestamps unless we add verbose output path.
 - Decide exact format of `transcriptTimedText` (recommend `[mm:ss] text` per line).

package/docs/website.md

@@ -20,8 +20,9 @@ Use this for non-YouTube URLs.
 - With `--format md`, `--markdown-mode auto|llm|readability` can also convert HTML → Markdown via an LLM using the configured `--model` (no provider fallback).
 - With `--format md`, `--markdown-mode auto` may fall back to `uvx markitdown` when available (disable with `--preprocess off`).
 - For podcast URLs (Apple Podcasts, RSS, Spotify episodes), it downloads the episode audio and transcribes via Whisper (prefers local `whisper.cpp` when installed + model available); progress shows “Downloading audio …” then “Transcribing …” (duration uses RSS hints or `ffprobe` when available).
- 
+
 Daemon note:
+
 - `/v1/summarize` accepts `format: "markdown"` plus `markdownMode`/`preprocess` to return extracted Markdown (especially when `extractOnly: true`).
 
 ## Short content

package/docs/youtube.md

@@ -54,5 +54,9 @@ summarize "https://www.youtube.com/watch?v=..." --slides --slides-ocr
 Slides are written to `./slides/<videoId>/` by default (override with `--slides-dir`). OCR results
 are stored in `slides.json` and included in JSON output (`--json`).
 
+If yt-dlp gets a 403 from YouTube, set `SUMMARIZE_YT_DLP_COOKIES_FROM_BROWSER=chrome` (or
+`chrome:Profile 1`) to pass cookies through to yt-dlp.
+
 Relevant flags:
+
 - `--slides-scene-threshold <value>`: starting threshold for scene detection (auto-tuned as needed)

package/package.json

@@ -1,12 +1,19 @@
 {
   "name": "@steipete/summarize",
-  "version": "0.10.0",
+  "version": "0.11.1",
   "description": "Link → clean text → summary.",
-  "type": "module",
   "bin": {
     "summarize": "./dist/cli.js",
     "summarizer": "./dist/cli.js"
   },
+  "files": [
+    "dist",
+    "docs",
+    "CHANGELOG.md",
+    "README.md",
+    "LICENSE"
+  ],
+  "type": "module",
   "main": "./dist/esm/index.js",
   "module": "./dist/esm/index.js",
   "types": "./dist/types/index.d.ts",
@@ -24,64 +31,58 @@
       "import": "./dist/esm/prompts/index.js"
     }
   },
-  "files": [
-    "dist",
-    "docs",
-    "CHANGELOG.md",
-    "README.md",
-    "LICENSE"
-  ],
-  "engines": {
-    "node": ">=22"
-  },
   "dependencies": {
-    "@mariozechner/pi-ai": "^0.49.2",
-    "commander": "^14.0.2",
+    "@mariozechner/pi-ai": "^0.52.12",
+    "commander": "^14.0.3",
     "file-type": "^21.3.0",
     "gpt-tokenizer": "^3.4.0",
     "json5": "^2.2.3",
     "markdansi": "^0.2.1",
     "mime": "^4.1.0",
-    "ora": "^9.1.0",
+    "ora": "^9.3.0",
     "osc-progress": "^0.3.0",
     "tokentally": "^0.1.1",
     "tslog": "^4.10.2",
-    "@steipete/summarize-core": "0.10.0"
+    "@steipete/summarize-core": "0.11.1"
   },
   "devDependencies": {
-    "@biomejs/biome": "^2.3.11",
-    "@fal-ai/client": "^1.8.3",
+    "@fal-ai/client": "^1.9.1",
     "@types/jsdom": "^27.0.0",
-    "@types/node": "^25.0.9",
+    "@types/node": "^25.2.3",
     "@types/sanitize-html": "^2.16.0",
-    "@vitest/coverage-v8": "^4.0.17",
-    "esbuild": "^0.27.2",
-    "oxlint": "^1.41.0",
-    "oxlint-tsgolint": "^0.11.1",
+    "@vitest/coverage-v8": "^4.0.18",
+    "esbuild": "^0.27.3",
+    "oxfmt": "0.32.0",
+    "oxlint": "^1.47.0",
+    "oxlint-tsgolint": "^0.12.2",
     "rimraf": "^6.1.2",
     "tsx": "^4.21.0",
     "typescript": "^5.9.3",
-    "vitest": "^4.0.17"
+    "vitest": "^4.0.18"
+  },
+  "engines": {
+    "node": ">=22"
   },
   "scripts": {
-    "clean": "rimraf dist packages/core/dist",
     "build": "pnpm clean && pnpm -C packages/core build && pnpm build:lib && pnpm build:cli",
-    "build:lib": "tsc -p tsconfig.build.json",
-    "build:cli": "node scripts/build-cli.mjs",
     "build:bun": "bun scripts/build-bun.js",
     "build:bun:test": "bun scripts/build-bun.js --test",
+    "build:cli": "node scripts/build-cli.mjs",
+    "build:lib": "tsc -p tsconfig.build.json",
+    "check": "pnpm format:check && pnpm lint && pnpm test:coverage",
+    "clean": "rimraf dist packages/core/dist",
     "docs:list": "tsx scripts/docs-list.ts",
-    "typecheck": "tsc -p tsconfig.build.json --noEmit",
-    "summarize": "tsx src/cli.ts",
+    "format": "oxfmt --write",
+    "format:check": "oxfmt --check",
+    "lint": "oxlint --type-aware --tsconfig tsconfig.build.json --config .oxlintrc.json .",
+    "lint:fix": "oxlint --type-aware --tsconfig tsconfig.build.json --config .oxlintrc.json --fix . && pnpm format",
+    "release": "bash scripts/release.sh",
     "s": "tsx src/cli.ts",
-    "format": "biome format --write .",
-    "lint": "biome check . && oxlint --type-aware --tsconfig tsconfig.build.json --config .oxlintrc.json .",
-    "lint:fix": "biome check --write . && oxlint --type-aware --tsconfig tsconfig.build.json --config .oxlintrc.json --fix .",
-    "check": "pnpm lint && pnpm test:coverage",
-    "test:extension-e2e": "pnpm -C apps/chrome-extension test:e2e",
+    "summarize": "tsx src/cli.ts",
     "test": "vitest run",
     "test:coverage": "vitest run --coverage",
     "test:coverage:build": "pnpm build && pnpm test:coverage",
-    "release": "bash scripts/release.sh"
+    "test:extension-e2e": "pnpm -C apps/chrome-extension test:e2e",
+    "typecheck": "tsc -p tsconfig.build.json --noEmit"
   }
 }