@antmanler/websearch-mcp 0.1.0

package/README.md

@@ -0,0 +1,94 @@
+# Websearch MCP (Go)
+
+## Design
+
+Goal: rewrite `tools/websearch.py` as a standalone MCP server in Go, using
+`modelcontextprotocol/go-sdk` for the MCP transport and `openai/openai-go` for
+LLM calls. The server should expose a single tool, `web_search`, that performs
+query rewriting, web search aggregation, and summarization similar to the
+Python implementation.
+
+Key behaviors to preserve:
+- Config-driven defaults and engine enable/disable flags.
+- Query rewrite via OpenAI-compatible model.
+- Multi-engine web search: Tavily, Zhipu, Volcengine.
+- Content sampling, Chinese/English heuristics, and filtering.
+- LLM-based summarization with citations and language selection.
+- Save raw search results to disk (configurable path).
+
+## Plan
+
+1. Create Go module under `scripts/websearch-go` with clear package layout:
+   - `cmd/websearch-mcp/main.go` for server entrypoint.
+   - `internal/config` for YAML config loading/merging.
+   - `internal/search` for engine implementations and selection logic.
+   - `internal/llm` for OpenAI-compatible rewrite + summary calls.
+   - `internal/tool` for MCP tool wiring and request/response types.
+2. Implement config parity with `tools/.websearch.yaml`, including defaults and
+   environment variable handling for API keys and base URLs.
+3. Implement engine clients:
+   - Tavily via HTTPS (results formatting and Chinese filtering).
+   - Zhipu and Volcengine via HTTPS (payloads and response parsing).
+4. Implement search orchestration:
+   - Rewrite queries, run engine calls with timeouts and concurrency limits.
+   - Aggregate and sample snippets.
+   - Save raw results to disk.
+   - Summarize with OpenAI-compatible API.
+5. Wire up MCP server and tool schema; ensure JSON-compatible outputs.
+6. Verify build with `go test` (if any) and `go build`.
+
+## Notes
+
+- Keep docstrings concise and one-line for MCP tools.
+- Use ASCII-only in source unless required.
+
+## Client Test
+
+Build and run the MCP client against the server binary:
+
+```bash
+npm run build
+npm run client -- -query "your question here"
+```
+
+Optional flags:
+- `-server-cmd` to point at a different server binary path.
+
+The client loads `.env` from the nearest parent directory (repo root) to pick up API keys.
+
+## npm Distribution
+
+This project bundles platform binaries in the npm package and installs the right one at postinstall time. It supports:
+- Linux amd64
+- macOS arm64
+
+Build local binaries and bundle into `bin/<platform>/websearch-mcp`:
+
+```bash
+npm run build:linux
+npm run build:macos
+```
+
+If you still want release tarballs, use:
+
+```
+npm run build:package
+```
+
+The npm install flow runs `install.js` to select the correct binary.
+
+To test the packed tarball locally with `npx`:
+
+```bash
+npm run npx-test -- --help
+```
+
+`npx-test` uses the packed tarball and runs the binary with a short timeout.
+
+## Publish
+
+Publish to the official npm registry:
+
+```bash
+npm publish --access public --registry=https://registry.npmjs.org/
+```

package/install.js

@@ -0,0 +1,29 @@
+#!/usr/bin/env node
+const fs = require("fs");
+const path = require("path");
+
+const platform = process.platform;
+const arch = process.arch;
+
+let subdir = "";
+if (platform === "linux" && arch === "x64") {
+  subdir = "linux-amd64";
+} else if (platform === "darwin" && arch === "arm64") {
+  subdir = "darwin-arm64";
+} else {
+  console.error(`Unsupported platform/arch: ${platform}/${arch}`);
+  process.exit(1);
+}
+
+const src = path.join(__dirname, "bin", subdir, "websearch-mcp");
+const dst = path.join(__dirname, "bin", "websearch-mcp");
+
+if (!fs.existsSync(src)) {
+  console.error(`Missing bundled binary: ${src}`);
+  process.exit(1);
+}
+
+fs.mkdirSync(path.dirname(dst), { recursive: true });
+fs.copyFileSync(src, dst);
+fs.chmodSync(dst, 0o755);
+console.log(`Installed ${dst}`);

package/package.json

@@ -0,0 +1,30 @@
+{
+  "name": "@antmanler/websearch-mcp",
+  "version": "0.1.0",
+  "description": "Go-based MCP web search server",
+  "license": "MIT",
+  "main": "index.js",
+  "bin": {
+    "websearch-mcp": "./bin/websearch-mcp"
+  },
+  "scripts": {
+    "build": "./build.sh --linux-amd64",
+    "build:linux": "./build.sh --linux-amd64",
+    "build:macos": "./build.sh --macos",
+    "build:package": "./build.sh --linux-amd64 --package && ./build.sh --macos --package",
+    "test": "/usr/local/go/bin/go test ./...",
+    "client": "./run-client.sh",
+    "npx-test": "./npx-test.sh",
+    "postinstall": "node install.js",
+    "pack": "npm run build:linux && npm run build:macos && npm pack"
+  },
+  "dependencies": {},
+  "files": [
+    "bin/linux-amd64/websearch-mcp",
+    "bin/darwin-arm64/websearch-mcp",
+    "install.js",
+    "package.json",
+    "README.md",
+    "LICENSE"
+  ]
+}