@steipete/summarize 0.3.0 → 0.4.0

package/docs/site/docs/openai.html

@@ -31,7 +31,7 @@
           <a href="./index.html">Overview</a>
           <a href="./website.html">Website mode</a>
           <a href="./youtube.html">YouTube mode</a>
-          <a href="./extract-only.html">Extract-only</a>
+          <a href="./extract-only.html">Extract</a>
           <a href="./llm.html">LLM</a>
           <a href="./openai.html">OpenAI</a>
           <a href="./firecrawl.html">Firecrawl</a>
@@ -45,7 +45,7 @@
 
           <h2>Notes</h2>
           <ul>
-            <li>Some modes (like <code>--extract-only</code>) don’t need an LLM at all.</li>
+            <li>Some modes (like <code>--extract</code>) don’t need an LLM at all.</li>
             <li>When output is used downstream, prefer <code>--json</code> and pin <code>--model</code>.</li>
           </ul>
 

package/docs/site/docs/website.html

@@ -31,7 +31,7 @@
           <a href="./index.html">Overview</a>
           <a href="./website.html">Website mode</a>
           <a href="./youtube.html">YouTube mode</a>
-          <a href="./extract-only.html">Extract-only</a>
+          <a href="./extract-only.html">Extract</a>
           <a href="./llm.html">LLM</a>
           <a href="./openai.html">OpenAI</a>
           <a href="./firecrawl.html">Firecrawl</a>
@@ -41,20 +41,23 @@
         <article class="doc reveal">
           <p class="kicker">mode</p>
           <h1>Website mode</h1>
-          <p>Fetch HTML → extract “article-ish” content → normalize to clean text. If extraction looks blocked or too thin, retry via Firecrawl Markdown (optional).</p>
+          <p>Fetch HTML → extract “article-ish” content → normalize to clean text. If extraction looks blocked or too thin, retry via Firecrawl Markdown (optional). With <code>--format md</code>, the CLI prefers Firecrawl Markdown when configured and can also convert HTML → Markdown via <code>--markdown-mode</code> (LLM) or <code>uvx markitdown</code>.</p>
 
           <h2>Flags</h2>
           <ul>
             <li><code>--firecrawl off|auto|always</code></li>
             <li><code>--timeout 30s|2m|5000ms</code> (default <code>2m</code>)</li>
-            <li><code>--extract-only</code> (print extracted content; no summary call)</li>
+            <li><code>--extract</code> (print extracted content; no summary call)</li>
+            <li><code>--format md|text</code> (default <code>text</code>)</li>
+            <li><code>--markdown-mode off|auto|llm</code> (only with <code>--format md</code>)</li>
+            <li><code>--preprocess off|auto|always</code> (default <code>auto</code>; controls markitdown usage)</li>
             <li><code>--json</code> (emit a single JSON object)</li>
             <li><code>--verbose</code> (progress + which extractor was used)</li>
             <li><code>--metrics off|on|detailed</code></li>
           </ul>
 
           <div class="note">
-            Plain-text mode: <code>--firecrawl off --markdown off</code>.
+            Plain-text mode: <code>--extract --format text</code>.
           </div>
         </article>
       </section>

package/docs/site/docs/youtube.html

@@ -31,7 +31,7 @@
           <a href="./index.html">Overview</a>
           <a href="./website.html">Website mode</a>
           <a href="./youtube.html">YouTube mode</a>
-          <a href="./extract-only.html">Extract-only</a>
+          <a href="./extract-only.html">Extract</a>
           <a href="./llm.html">LLM</a>
           <a href="./openai.html">OpenAI</a>
           <a href="./firecrawl.html">Firecrawl</a>
@@ -45,7 +45,7 @@
 
           <h2>Tip</h2>
           <ul>
-            <li>If you only want the transcript: use <code>--extract-only</code>.</li>
+            <li>If you only want the transcript: use <code>--extract</code>.</li>
             <li>For pipelines: add <code>--json</code>.</li>
           </ul>
         </article>

package/docs/site/index.html

@@ -104,7 +104,7 @@
         </div>
         <div class="card reveal">
           <h2>Built for pipelines</h2>
-          <p><code>--extract-only</code>, <code>--json</code>, and <code>--metrics</code> make it scriptable.</p>
+          <p><code>--extract</code>, <code>--json</code>, and <code>--metrics</code> make it scriptable.</p>
           <div class="small">Compose it with your own tools</div>
         </div>
         <div class="card reveal">

package/docs/website.md

@@ -7,21 +7,24 @@ Use this for non-YouTube URLs.
 - Fetches the page HTML.
 - Extracts “article-ish” content and normalizes it into clean text.
 - If extraction looks blocked or too thin, it can retry via Firecrawl (Markdown).
-- In `--extract-only` mode, Firecrawl is only used when HTML extraction looks blocked/thin (or when forced via `--firecrawl always`).
-- In `--extract-only` mode, `--markdown auto|llm` can convert HTML → Markdown via an LLM using the configured `--model` (no provider fallback).
+- With `--format md`, the CLI prefers Firecrawl Markdown by default when `FIRECRAWL_API_KEY` is configured.
+- With `--format md`, `--markdown-mode auto|llm` can also convert HTML → Markdown via an LLM using the configured `--model` (no provider fallback).
+- With `--format md`, `--markdown-mode auto` may fall back to `uvx markitdown` when available (disable with `--preprocess off`).
 
 ## Flags
 
 - `--firecrawl off|auto|always`
-- `--markdown off|auto|llm` (default: `auto`; only affects `--extract-only` for non-YouTube URLs)
-- Plain-text mode: use `--firecrawl off --markdown off`.
+- `--format md|text` (default: `text`)
+- `--markdown-mode off|auto|llm` (default: `auto`; only affects `--format md` for non-YouTube URLs)
+- `--preprocess off|auto|always` (default: `auto`; controls markitdown usage; `always` only affects file inputs)
+- Plain-text mode: use `--format text`.
 - `--timeout 30s|30|2m|5000ms` (default: `2m`)
-- `--extract-only` (print extracted content; no summary LLM call)
+- `--extract` (print extracted content; no summary LLM call)
 - `--json` (emit a single JSON object)
 - `--verbose` (progress + which extractor was used)
 - `--metrics off|on|detailed` (default: `on`; `detailed` prints a breakdown to stderr)
 
 ## API keys
 
-- Optional: `FIRECRAWL_API_KEY` (for the Firecrawl fallback)
-- Optional: `XAI_API_KEY` / `OPENAI_API_KEY` / `GEMINI_API_KEY` (also accepts `GOOGLE_GENERATIVE_AI_API_KEY` / `GOOGLE_API_KEY`) (required only when `--markdown llm` is used, or when `--markdown auto` falls back to LLM conversion)
+- Optional: `FIRECRAWL_API_KEY` (for the Firecrawl fallback / preferred Markdown output)
+- Optional: `XAI_API_KEY` / `OPENAI_API_KEY` / `GEMINI_API_KEY` (also accepts `GOOGLE_GENERATIVE_AI_API_KEY` / `GOOGLE_API_KEY`) (required only when `--markdown-mode llm` is used, or when `--markdown-mode auto` falls back to LLM conversion)

package/docs/youtube.md

@@ -31,5 +31,5 @@ YouTube URLs use transcript-first extraction.
 ## Example
 
 ```bash
-pnpm summarize -- --extract-only "https://www.youtube.com/watch?v=I845O57ZSy4&t=11s"
+pnpm summarize -- --extract "https://www.youtube.com/watch?v=I845O57ZSy4&t=11s"
 ```

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@steipete/summarize",
-  "version": "0.3.0",
+  "version": "0.4.0",
   "description": "Link → clean text → summary.",
   "type": "module",
   "bin": {