@apmantza/greedysearch-pi 1.7.0 → 1.7.3

package/CHANGELOG.md

@@ -1,5 +1,28 @@
 # Changelog
 
+## v1.7.3 (2026-04-10)
+
+### Fixes
+- **Force English in Google AI results** — Added `hl=en` query parameter to Google AI Mode search URL so responses are always returned in English, regardless of the user's IP-based region (fixes #1).
+
+## v1.7.2 (2026-04-08)
+
+### Release
+- **Patch release** — version bump and npm package verification for the `bin/` runtime layout (`bin/search.mjs`, `bin/launch.mjs`, `bin/cdp.mjs`, `bin/coding-task.mjs`).
+
+## v1.7.1 (2026-04-08)
+
+### Performance
+- **Bounded source-fetch concurrency** — source fetching now uses a small worker pool (default `2`, configurable via `GREEDY_FETCH_CONCURRENCY`) to reduce burstiness while keeping deep-research fast.
+
+### Project structure
+- **Runtime scripts moved to `bin/`** — `search.mjs`, `launch.mjs`, `cdp.mjs`, and `coding-task.mjs` now live under `bin/` for a cleaner repository root.
+- **Path references updated** — extension runtime, tests, extractor shared utilities, and docs now point to `bin/*` paths.
+
+### Packaging & docs
+- **Package file list updated** — npm package now includes `bin/` directly instead of root script entries.
+- **README simplified** — rewritten into a shorter, concise format with quick install, usage, and layout guidance.
+
 ## v1.6.5 (2026-04-04)
 
 ### Security

package/LICENSE

@@ -1,21 +1,21 @@
-MIT License
-
-Copyright (c) 2026
-
-Permission is hereby granted, free of charge, to any person obtaining a copy
-of this software and associated documentation files (the "Software"), to deal
-in the Software without restriction, including without limitation the rights
-to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
-copies of the Software, and to permit persons to whom the Software is
-furnished to do so, subject to the following conditions:
-
-The above copyright notice and this permission notice shall be included in all
-copies or substantial portions of the Software.
-
-THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
-IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
-FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
-AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
-LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
-OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
-SOFTWARE.
+MIT License
+
+Copyright (c) 2026
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

package/README.md

@@ -1,12 +1,10 @@
 # GreedySearch for Pi
 
-Pi extension that adds `greedy_search`, `deep_research`, and `coding_task` tools -- multi-engine AI search via browser automation. **NO API KEYS needed.**
+Multi-engine AI web search for Pi via browser automation.
 
-Fans out queries to Perplexity, Bing Copilot, and Google AI simultaneously. Returns AI-synthesized answers with fetched source content. Streams progress as each engine completes.
-
-**New in v2.0:** HTTP-first source fetching with Mozilla Readability extraction (~3x faster), smart query-aware source ranking.
-
-Forked from [GreedySearch-claude](https://github.com/apmantza/GreedySearch-claude).
+- No API keys
+- Real browser results (Perplexity, Bing Copilot, Google AI)
+- Optional Gemini synthesis with source grounding
 
 ## Install
 
@@ -14,248 +12,61 @@ Forked from [GreedySearch-claude](https://github.com/apmantza/GreedySearch-claud
 pi install npm:@apmantza/greedysearch-pi
 ```
 
-Or directly from git:
+Or from git:
 
 ```bash
 pi install git:github.com/apmantza/GreedySearch-pi
 ```
 
-## Quick Start
-
-Once installed, Pi gains a `greedy_search` tool with two modes.
-
-```javascript
-// Default: multi-engine + source fetch + synthesis
- Greedy_search({ query: "What's new in React 19?" })
-
-// Fast: single engine, no synthesis
- greedy_search({ query: "What's new in React 19?", depth: "fast", engine: "perplexity" })
-```
-
-## Parameters
-
-| Parameter | Type | Default | Description |
-|-----------|------|---------|-------------|
-| `query` | string | required | The search question |
-| `engine` | string | `"all"` | `all`, `perplexity`, `bing`, `google`, `gemini` |
-| `depth` | string | `"standard"` | `fast` (1 engine, no fetch), `standard` (3 engines + fetch + synthesis) |
-| `fullAnswer` | boolean | `false` | Return complete answer (~3000+ chars) vs truncated preview (~300 chars) |
-
-## Depth Levels
-
-| Depth | Engines | Synthesis | Source Fetch | Time | Best For |
-|-------|---------|-----------|--------------|------|----------|
-| `fast` | 1 | no | no | 10-30s | Quick lookup, single perspective |
-| `standard` | 3 | yes | yes (top 5) | 15-30s | **Default** -- balanced, grounded answers |
-
-**Standard mode** (default for `engine: "all"`): Queries 3 engines, fetches content from top 5 sources via HTTP (with Readability extraction), synthesizes grounded answer with citations.
-
-**Fast mode**: Single engine, no source fetching or synthesis. Good for quick checks.
-
-## Engines
-
-| Engine | Alias | Best for |
-|--------|-------|----------|
-| `all` | - | **Default** -- all 3 engines with synthesis + source fetch |
-| `perplexity` | `p` | Technical Q&A, code explanations, documentation |
-| `bing` | `b` | Recent news, Microsoft ecosystem |
-| `google` | `g` | Broad coverage, multiple perspectives |
-| `gemini` | `gem` | Google's AI with different training data |
-
-## Streaming Progress
-
-When using `engine: "all"`, the tool streams progress as each engine completes:
-
-```
-**Searching...** pending: perplexity, bing, google
-**Searching...** done: perplexity, pending: bing, google
-**Searching...** done: perplexity, done: bing, pending: google
-**Searching...** done: perplexity, done: bing, done: google
-**Synthesizing...** with Gemini
-```
-
-## Source Fetching (HTTP-First)
-
-GreedySearch now uses **HTTP-first source fetching** with Mozilla Readability for content extraction:
-
-- **HTTP**: Fast (~200-800ms), parallel, structured markdown output
-- **Browser fallback**: Only when HTTP fails (bot protection, JS-heavy sites)
-- **Typical success rate**: 90%+ of documentation sites work via HTTP
-- **Speed improvement**: ~3x faster than browser-only fetching (15-30s vs 60-180s)
-
-The old regex-based HTML stripping has been replaced with professional-grade content extraction that preserves document structure, code blocks, and headings.
-
-## Smart Source Ranking
-
-Sources are now ranked using query-aware domain boosting:
-
-- **Query keywords** boost official docs (e.g., "react" → react.dev +10 points)
-- **Consensus**: Sources found by multiple engines rank higher
-- **Source type**: Official docs > repos > blogs > community
-- **URL patterns**: `/docs/`, `/api/`, `/reference/` get extra boost
-
-40+ tech stacks have preferred domain mappings including React, Node.js, Python, Rust, Go, Prisma, Supabase, and more.
-
-## GitHub Content Extraction
-
-GreedySearch handles GitHub URLs intelligently:
-
-- **Blob URLs** (`/blob/`) — Automatically rewritten to `raw.githubusercontent.com` for instant raw file access
-- **Tree/Root URLs** — Clones repo locally with `git clone --depth 1`, returns README preview + file tree for agent exploration
-- **Benefits**: Real file contents (not rendered HTML), accurate line numbers, works with private repos via `gh` CLI auth
-
-## Security
-
-- **Private URL blocking** — Requests to localhost, RFC1918 addresses (10.x, 192.168.x), and .local/.internal domains are automatically blocked
-- **Cross-host redirect detection** — Detects redirects to authentication/login pages and falls back to browser extraction
-- **File protocol blocking** — `file://` URLs are rejected
-
-## Examples
-
-**Default research (multi-engine + sources + synthesis):**
-
-```javascript
-greedy_search({ query: "Best practices for monorepo structure" })
-```
-
-**Quick lookup (fast):**
-
-```javascript
-greedy_search({ query: "How to use async await in Python", depth: "fast", engine: "perplexity" })
-```
-
-**Compare tools:**
-
-```javascript
-greedy_search({ query: "Prisma vs Drizzle in 2026" })
-```
-
-**Debug an error:**
-
-```javascript
-greedy_search({ query: "Error: Cannot find module 'react-dom/client' Next.js 15" })
-```
+## Tools
 
-## Full vs Short Answers
+- `greedy_search` - fast or grounded multi-engine search
+- `coding_task` - browser-routed Gemini/Copilot coding assistance
 
-Default mode returns ~300 char summaries to save tokens. Use `fullAnswer: true` for complete responses:
+## Quick usage
 
-```javascript
-greedy_search({ query: "explain the React compiler", engine: "perplexity", fullAnswer: true })
+```js
+greedy_search({ query: "React 19 changes" })
+greedy_search({ query: "Prisma vs Drizzle", engine: "all", depth: "fast" })
+greedy_search({ query: "Best auth architecture 2026", engine: "all", depth: "deep" })
 ```
 
-## Requirements
+## Parameters (`greedy_search`)
 
-- **Chrome** -- must be installed. The extension auto-launches a dedicated Chrome instance on port 9222 with its own isolated profile and DevTools port file, separate from your main browser session.
-- **Node.js 22+** -- for built-in `fetch` and WebSocket support.
+- `query` (required)
+- `engine`: `all` (default), `perplexity`, `bing`, `google`, `gemini`
+- `depth`: `standard` (default), `fast`, `deep`
+- `fullAnswer`: return full single-engine output instead of preview
 
-## Setup (first time)
+## Depth modes
 
-To pre-launch the dedicated GreedySearch Chrome instance:
+- `fast` - quickest, no synthesis/source fetching
+- `standard` - balanced default for `engine: "all"` (synthesis + fetched sources)
+- `deep` - strongest grounding and confidence metadata
 
-```bash
-node ~/.pi/agent/git/GreedySearch-pi/launch.mjs
-```
-
-Stop it when done:
+## Runtime commands
 
 ```bash
-node ~/.pi/agent/git/GreedySearch-pi/launch.mjs --kill
+node ~/.pi/agent/git/GreedySearch-pi/bin/launch.mjs
+node ~/.pi/agent/git/GreedySearch-pi/bin/launch.mjs --status
+node ~/.pi/agent/git/GreedySearch-pi/bin/launch.mjs --kill
 ```
 
-Check status:
-
-```bash
-node ~/.pi/agent/git/GreedySearch-pi/launch.mjs --status
-```
-
-## Troubleshooting
-
-### "Chrome not found"
-
-Set the path explicitly:
-
-```bash
-export CHROME_PATH="/path/to/chrome"
-```
-
-### "CDP timeout" or "Chrome may have crashed"
-
-Restart GreedySearch Chrome:
-
-```bash
-node ~/.pi/agent/git/GreedySearch-pi/launch.mjs --kill
-node ~/.pi/agent/git/GreedySearch-pi/launch.mjs
-```
-
-### Google / Bing "verify you're human"
-
-The extension auto-clicks verification buttons and Cloudflare Turnstile challenges using broad keyword matching -- resilient to variations like "Verify you are human" or localised button text. For hard CAPTCHAs (image puzzles), solve manually in the Chrome window that opens.
-
-### Parallel searches failing
-
-Each search creates a fresh isolated browser tab that is closed after completion, allowing safe parallel execution without tab state conflicts.
-
-### Search hangs
-
-Chrome may be unresponsive. Restart it with `launch.mjs --kill` then `launch.mjs`.
-
-### Sources are empty or junk links
+## Requirements
 
-Sources are now extracted by regex-parsing Markdown links (`[title](url)`) from the clipboard text captured after each engine responds -- not from DOM selectors that break when the engine's UI updates. If sources are empty, the engine's clipboard copy didn't include formatted links (Bing Copilot currently falls into this category).
+- Chrome
+- Node.js 22+
 
-## How It Works
+## Project layout
 
-- `index.ts` -- Pi extension, registers `greedy_search` tool with streaming progress
-- `search.mjs` -- CLI runner, spawns extractors in parallel, emits `PROGRESS:` events to stderr
-- `launch.mjs` -- launches dedicated Chrome on port 9222 with isolated profile
-- `extractors/` -- per-engine CDP scrapers (Perplexity, Bing Copilot, Google AI, Gemini)
-- `cdp.mjs` -- Chrome DevTools Protocol CLI for browser automation
-- `skills/greedy-search/SKILL.md` -- skill file that guides the model on when/how to use greedy_search
+- `bin/` - runtime CLIs (`search.mjs`, `launch.mjs`, `cdp.mjs`, `coding-task.mjs`)
+- `extractors/` - engine-specific automation
+- `src/` - ranking/fetching/formatting internals
+- `skills/` - Pi skill metadata
 
 ## Changelog
 
-### v1.6.1 (2026-03-31)
-- **Single-engine full answers by default** -- `engine: "google"` (or any single engine) now returns complete answers instead of truncated previews. Multi-engine (`all`) still truncates to save tokens during synthesis.
-- **Codebase refactored** -- extracted 438 lines from `index.ts` into modular formatters (`src/formatters/`) reducing cognitive complexity from 360 to ~60 and maintainability index from 11.2 to ~40+
-- **Removed codebase search confusion** -- clarified that `greedy_search` is WEB SEARCH ONLY (not for searching local code)
-
-### v1.6.0 (2026-03-29)
-- **Merged deep_research into greedy_search** -- new `depth` parameter: `fast` (1 engine), `standard` (3 engines + synthesis), `deep` (3 engines + fetch + synthesis + confidence)
-- **Simpler API** -- one tool with clear speed/quality tradeoffs instead of separate tools with overlapping flags
-- **Backward compatible** -- `deep_research` still works as alias, `--synthesize` and `--deep-research` flags still function
-- **Updated documentation** -- README and skill docs now use `depth` parameter throughout
-
-### v1.5.1 (2026-03-29)
-- Fixed npm package -- added `.pi-lens/` and test files to `.npmignore`
-
-### v1.5.0 (2026-03-29)
-
-- **Code extraction fixed** -- `coding_task` now uses clipboard interception to preserve markdown code blocks (was losing them via DOM scraping)
-- **Chrome targeting hardened** -- all tools now consistently target the dedicated GreedySearch Chrome via `CDP_PROFILE_DIR`, preventing fallback to user's main Chrome session
-- **Shared utilities** -- extracted ~220 lines of duplicate code from extractors into `common.mjs` (cdp wrapper, tab management, clipboard interception)
-- **Documentation leaner** -- skill documentation reduced 61% (180 -> 70 lines) while preserving all decision-making info
-- **NO API KEYS** -- updated messaging to emphasize this works via browser automation, no API keys needed
-
-### v1.4.2 (2026-03-25)
-
-- **Fresh isolated tabs** -- each search now always creates a new `about:blank` tab via `Target.createTarget` and refreshes the CDP page cache immediately after, preventing SPA navigation failures and stale DOM state from prior queries
-- **Regex-based citation extraction** -- all extractors (Perplexity, Bing, Gemini) now parse sources from clipboard Markdown links (`[title](url)`) instead of DOM selectors that break on UI updates
-- **Relaxed verification detection** -- `consent.mjs` now uses broad keyword matching (`includes('verify')`, `includes('human')`) instead of anchored regexes, correctly catching button text variants like "Verify you are human" across Cloudflare, Microsoft, and generic modals
-
----
-
-### v1.4.1
-
-- **Fixed parallel synthesis** -- multiple `greedy_search` calls with `synthesize: true` now run safely in parallel. Each search creates a fresh Gemini tab that gets cleaned up after synthesis, preventing tab conflicts and "Uncaught" errors.
-
-### v1.4.0
-
-- **Grounded synthesis** -- Gemini now receives a normalized source registry with stable source IDs, agreement summaries, caveats, and cited claims
-- **Real deep research** -- top sources are fetched before synthesis so deep research answers are grounded in fetched evidence, not just engine summaries
-- **Richer source metadata** -- source output now includes canonical URLs, domains, source types, per-engine attribution, and confidence metadata
-- **Cleaner tab lifecycle** -- temporary Perplexity, Bing, and Google tabs are closed after each fan-out search, and synthesis finishes on the Gemini tab
-- **Isolated Chrome targeting** -- GreedySearch now refuses to fall back to your normal Chrome session, preventing stray remote-debugging prompts
+See `CHANGELOG.md`.
 
 ## License