promptgraph-mcp 1.0.2 → 1.1.0

package/README.md

@@ -1,159 +1,159 @@
-# PromptGraph
-
-Semantic skill router for Claude Code. Instead of loading all your skills into context on every request, PromptGraph indexes them with vector embeddings and loads only the relevant one on demand.
-
-## The Problem
-
-Claude Code loads all `.md` files from `~/.claude/commands/` into the system prompt on every session. With 40+ skills, that's **20,000–50,000 tokens wasted per conversation** — before you've even said hello.
-
-## The Solution
-
-```
-~/.claude/commands/
-  pg.md          ← one tiny router skill (~150 tokens)
-
-~/.claude/skills-store/
-  game-audit.md
-  chain.md
-  hunt-sqli.md
-  ...            ← 40+ skills, NOT loaded into context
-```
-
-When you ask Claude a question, it calls `pg_search("your task")` → finds the right skill via vector search → reads only that file. **One skill loaded instead of forty.**
-
-## Features
-
-- **Vector search** via `fastembed` (`BGE-Small-EN`, 23MB, runs locally, no API needed)
-- **Semantic matching** — Russian query finds English skill, synonyms work
-- **Auto-reindex** via file watcher when skills change
-- **Graph edges** — tracks which skills call other skills
-- **MCP server** — integrates directly into Claude Code and Claude Desktop
-
-## Installation
-
-### Via npx (recommended)
-
-```bash
-npx promptgraph-mcp init
-```
-
-### From source
-
-```bash
-git clone https://github.com/NeiP4n/promptgraph
-cd promptgraph
-npm install
-npm link
-promptgraph init
-```
-
-`init` will:
-1. Ask for extra skill directories (optional)
-2. Download the embedding model (~23MB, one time)
-3. Index all your skills
-4. Print the config snippet to add to `settings.json`
-
-## Setup
-
-### Claude Code (`~/.claude/settings.json`)
-
-```json
-{
-  "mcpServers": {
-    "promptgraph": {
-      "command": "npx",
-      "args": ["promptgraph-mcp"]
-    }
-  }
-}
-```
-
-### Claude Desktop
-
-Add the same block to `claude_desktop_config.json`.
-
-### Router skill (`~/.claude/commands/pg.md`)
-
-```markdown
----
-name: pg
-description: PromptGraph router — finds and loads the right skill for any task
----
-
-# PromptGraph Router
-
-You have access to a semantic skill index via the `promptgraph` MCP server.
-
-## How to handle any task
-
-1. Call `pg_search` with the user's task as query (in English)
-2. Pick the top result with score > 0.6
-3. Read the skill file at the returned `path`
-4. Execute that skill's instructions
-
-## If no good match (score < 0.6)
-
-Handle the task directly without a skill.
-```
-
-Move all your other skills from `commands/` to `skills-store/`:
-
-```bash
-mkdir -p ~/.claude/skills-store
-mv ~/.claude/commands/*.md ~/.claude/skills-store/
-mv ~/.claude/skills-store/pg.md ~/.claude/commands/
-```
-
-## Commands
-
-```bash
-promptgraph init      # First-time setup (interactive)
-promptgraph reindex   # Re-index all skills
-```
-
-## MCP Tools
-
-| Tool | Description |
-|---|---|
-| `pg_search` | Semantic search by task description |
-| `pg_list` | List all indexed skills |
-| `pg_context` | Full details for a skill |
-| `pg_callers` | Which skills reference this one |
-| `pg_callees` | Which skills this one references |
-| `pg_impact` | What breaks if this skill changes |
-
-## Token Savings
-
-| | Before | After |
-|---|---|---|
-| Skills in context | All 40+ | 1 (router) |
-| Tokens per session | ~20,000–50,000 | ~150 + 1 skill |
-| Scales to | ~50 skills | 5,000+ skills |
-
-## File Structure
-
-```
-promptgraph/
-  index.js       ← MCP server + CLI
-  config.js      ← Config management
-  db.js          ← SQLite setup
-  embedder.js    ← fastembed wrapper
-  indexer.js     ← Skill indexer
-  parser.js      ← .md parser
-  search.js      ← Vector search + graph queries
-  watcher.js     ← File watcher (auto-reindex)
-
-~/.claude/.promptgraph/
-  promptgraph.db       ← SQLite index
-  model-cache/         ← Embedding model cache
-  config.json          ← Skill directory config
-```
-
-## Requirements
-
-- Node.js 18+
-- Claude Code or Claude Desktop
-
----
-
-*Generated with [Claude](https://claude.ai) by Anthropic*
+# PromptGraph
+
+Semantic skill router for Claude Code. Instead of loading all your skills into context on every request, PromptGraph indexes them with vector embeddings and loads only the relevant one on demand.
+
+## The Problem
+
+Claude Code loads all `.md` files from `~/.claude/commands/` into the system prompt on every session. With 40+ skills, that's **20,000–50,000 tokens wasted per conversation** — before you've even said hello.
+
+## The Solution
+
+```
+~/.claude/commands/
+  pg.md          ← one tiny router skill (~150 tokens)
+
+~/.claude/skills-store/
+  game-audit.md
+  chain.md
+  hunt-sqli.md
+  ...            ← 40+ skills, NOT loaded into context
+```
+
+When you ask Claude a question, it calls `pg_search("your task")` → finds the right skill via vector search → reads only that file. **One skill loaded instead of forty.**
+
+## Features
+
+- **Vector search** via `fastembed` (`BGE-Small-EN`, 23MB, runs locally, no API needed)
+- **Semantic matching** — Russian query finds English skill, synonyms work
+- **Auto-reindex** via file watcher when skills change
+- **Graph edges** — tracks which skills call other skills
+- **MCP server** — integrates directly into Claude Code and Claude Desktop
+
+## Installation
+
+### Via npx (recommended)
+
+```bash
+npx promptgraph-mcp init
+```
+
+### From source
+
+```bash
+git clone https://github.com/NeiP4n/promptgraph
+cd promptgraph
+npm install
+npm link
+promptgraph-mcp init
+```
+
+`init` will:
+1. Ask for extra skill directories (optional)
+2. Download the embedding model (~23MB, one time)
+3. Index all your skills
+4. Print the config snippet to add to `settings.json`
+
+## Setup
+
+### Claude Code (`~/.claude/settings.json`)
+
+```json
+{
+  "mcpServers": {
+    "promptgraph": {
+      "command": "npx",
+      "args": ["promptgraph-mcp"]
+    }
+  }
+}
+```
+
+### Claude Desktop
+
+Add the same block to `claude_desktop_config.json`.
+
+### Router skill (`~/.claude/commands/pg.md`)
+
+```markdown
+---
+name: pg
+description: PromptGraph router — finds and loads the right skill for any task
+---
+
+# PromptGraph Router
+
+You have access to a semantic skill index via the `promptgraph` MCP server.
+
+## How to handle any task
+
+1. Call `pg_search` with the user's task as query (in English)
+2. Pick the top result with score > 0.6
+3. Read the skill file at the returned `path`
+4. Execute that skill's instructions
+
+## If no good match (score < 0.6)
+
+Handle the task directly without a skill.
+```
+
+Move all your other skills from `commands/` to `skills-store/`:
+
+```bash
+mkdir -p ~/.claude/skills-store
+mv ~/.claude/commands/*.md ~/.claude/skills-store/
+mv ~/.claude/skills-store/pg.md ~/.claude/commands/
+```
+
+## Commands
+
+```bash
+promptgraph-mcp init      # First-time setup (interactive)
+promptgraph-mcp reindex   # Re-index all skills
+```
+
+## MCP Tools
+
+| Tool | Description |
+|---|---|
+| `pg_search` | Semantic search by task description |
+| `pg_list` | List all indexed skills |
+| `pg_context` | Full details for a skill |
+| `pg_callers` | Which skills reference this one |
+| `pg_callees` | Which skills this one references |
+| `pg_impact` | What breaks if this skill changes |
+
+## Token Savings
+
+| | Before | After |
+|---|---|---|
+| Skills in context | All 40+ | 1 (router) |
+| Tokens per session | ~20,000–50,000 | ~150 + 1 skill |
+| Scales to | ~50 skills | 5,000+ skills |
+
+## File Structure
+
+```
+promptgraph/
+  index.js       ← MCP server + CLI
+  config.js      ← Config management
+  db.js          ← SQLite setup
+  embedder.js    ← fastembed wrapper
+  indexer.js     ← Skill indexer
+  parser.js      ← .md parser
+  search.js      ← Vector search + graph queries
+  watcher.js     ← File watcher (auto-reindex)
+
+~/.claude/.promptgraph/
+  promptgraph.db       ← SQLite index
+  model-cache/         ← Embedding model cache
+  config.json          ← Skill directory config
+```
+
+## Requirements
+
+- Node.js 18+
+- Claude Code or Claude Desktop
+
+---
+
+*Generated with [Claude](https://claude.ai) by Anthropic*

package/chunker.js

@@ -0,0 +1,17 @@
+const CHUNK_SIZE = 400;
+const CHUNK_OVERLAP = 80;
+
+export function chunkText(text) {
+  const words = text.split(/\s+/);
+  const chunks = [];
+  let i = 0;
+
+  while (i < words.length) {
+    const chunk = words.slice(i, i + CHUNK_SIZE).join(' ');
+    chunks.push(chunk);
+    if (i + CHUNK_SIZE >= words.length) break;
+    i += CHUNK_SIZE - CHUNK_OVERLAP;
+  }
+
+  return chunks.length > 0 ? chunks : [text];
+}

package/config.js

@@ -1,51 +1,51 @@
-import fs from 'fs';
-import path from 'path';
-import os from 'os';
-import readline from 'readline';
-
-const CONFIG_PATH = path.join(os.homedir(), '.claude', '.promptgraph', 'config.json');
-
-const DEFAULTS = {
-  sources: [
-    { dir: path.join(os.homedir(), '.claude', 'skills-store'), source: 'skills-store' },
-    { dir: path.join(os.homedir(), '.claude', 'skills'), source: 'skills' },
-    { dir: path.join(os.homedir(), '.claude', 'commands'), source: 'commands' },
-  ],
-};
-
-export function loadConfig() {
-  if (fs.existsSync(CONFIG_PATH)) {
-    return JSON.parse(fs.readFileSync(CONFIG_PATH, 'utf8'));
-  }
-  return DEFAULTS;
-}
-
-export function saveConfig(config) {
-  fs.mkdirSync(path.dirname(CONFIG_PATH), { recursive: true });
-  fs.writeFileSync(CONFIG_PATH, JSON.stringify(config, null, 2));
-}
-
-export async function promptConfig() {
-  const rl = readline.createInterface({ input: process.stdin, output: process.stdout });
-  const ask = (q) => new Promise(r => rl.question(q, r));
-
-  console.log('\n=== PromptGraph Setup ===\n');
-  console.log('Default skill directories:');
-  DEFAULTS.sources.forEach((s, i) => console.log(`  ${i + 1}. ${s.dir}`));
-
-  const extra = await ask('\nAdd extra skill directories? (comma-separated paths, or press Enter to skip): ');
-  rl.close();
-
-  const config = { ...DEFAULTS };
-
-  if (extra.trim()) {
-    const extraDirs = extra.split(',').map(d => d.trim()).filter(Boolean);
-    for (const dir of extraDirs) {
-      config.sources.push({ dir, source: 'custom' });
-    }
-  }
-
-  saveConfig(config);
-  console.log(`\nConfig saved to ${CONFIG_PATH}`);
-  return config;
-}
+import fs from 'fs';
+import path from 'path';
+import os from 'os';
+import readline from 'readline';
+
+const CONFIG_PATH = path.join(os.homedir(), '.claude', '.promptgraph', 'config.json');
+
+const DEFAULTS = {
+  sources: [
+    { dir: path.join(os.homedir(), '.claude', 'skills-store'), source: 'skills-store' },
+    { dir: path.join(os.homedir(), '.claude', 'skills'), source: 'skills' },
+    { dir: path.join(os.homedir(), '.claude', 'commands'), source: 'commands' },
+  ],
+};
+
+export function loadConfig() {
+  if (fs.existsSync(CONFIG_PATH)) {
+    return JSON.parse(fs.readFileSync(CONFIG_PATH, 'utf8'));
+  }
+  return DEFAULTS;
+}
+
+export function saveConfig(config) {
+  fs.mkdirSync(path.dirname(CONFIG_PATH), { recursive: true });
+  fs.writeFileSync(CONFIG_PATH, JSON.stringify(config, null, 2));
+}
+
+export async function promptConfig() {
+  const rl = readline.createInterface({ input: process.stdin, output: process.stdout });
+  const ask = (q) => new Promise(r => rl.question(q, r));
+
+  console.log('\n=== PromptGraph Setup ===\n');
+  console.log('Default skill directories:');
+  DEFAULTS.sources.forEach((s, i) => console.log(`  ${i + 1}. ${s.dir}`));
+
+  const extra = await ask('\nAdd extra skill directories? (comma-separated paths, or press Enter to skip): ');
+  rl.close();
+
+  const config = { ...DEFAULTS };
+
+  if (extra.trim()) {
+    const extraDirs = extra.split(',').map(d => d.trim()).filter(Boolean);
+    for (const dir of extraDirs) {
+      config.sources.push({ dir, source: 'custom' });
+    }
+  }
+
+  saveConfig(config);
+  console.log(`\nConfig saved to ${CONFIG_PATH}`);
+  return config;
+}

package/db.js

@@ -1,32 +1,40 @@
-import Database from 'better-sqlite3';
-import path from 'path';
-import os from 'os';
-import fs from 'fs';
-
-const DB_PATH = path.join(os.homedir(), '.claude', '.promptgraph', 'promptgraph.db');
-
-export function getDb() {
-  fs.mkdirSync(path.dirname(DB_PATH), { recursive: true });
-  const db = new Database(DB_PATH);
-  db.pragma('journal_mode = WAL');
-
-  db.exec(`
-    CREATE TABLE IF NOT EXISTS skills (
-      id INTEGER PRIMARY KEY AUTOINCREMENT,
-      name TEXT UNIQUE NOT NULL,
-      description TEXT,
-      path TEXT NOT NULL,
-      source TEXT NOT NULL,
-      content TEXT NOT NULL,
-      embedding TEXT
-    );
-
-    CREATE TABLE IF NOT EXISTS edges (
-      from_skill TEXT NOT NULL,
-      to_skill TEXT NOT NULL,
-      PRIMARY KEY (from_skill, to_skill)
-    );
-  `);
-
-  return db;
-}
+import Database from 'better-sqlite3';
+import path from 'path';
+import os from 'os';
+import fs from 'fs';
+
+const DB_PATH = path.join(os.homedir(), '.claude', '.promptgraph', 'promptgraph.db');
+
+export function getDb() {
+  fs.mkdirSync(path.dirname(DB_PATH), { recursive: true });
+  const db = new Database(DB_PATH);
+  db.pragma('journal_mode = WAL');
+
+  db.exec(`
+    CREATE TABLE IF NOT EXISTS skills (
+      id INTEGER PRIMARY KEY AUTOINCREMENT,
+      name TEXT UNIQUE NOT NULL,
+      description TEXT,
+      path TEXT NOT NULL,
+      source TEXT NOT NULL,
+      content TEXT NOT NULL
+    );
+
+    CREATE TABLE IF NOT EXISTS chunks (
+      id INTEGER PRIMARY KEY AUTOINCREMENT,
+      skill_name TEXT NOT NULL,
+      chunk_index INTEGER NOT NULL,
+      text TEXT NOT NULL,
+      embedding TEXT NOT NULL,
+      UNIQUE(skill_name, chunk_index)
+    );
+
+    CREATE TABLE IF NOT EXISTS edges (
+      from_skill TEXT NOT NULL,
+      to_skill TEXT NOT NULL,
+      PRIMARY KEY (from_skill, to_skill)
+    );
+  `);
+
+  return db;
+}

package/embedder.js

@@ -1,32 +1,32 @@
-import { EmbeddingModel, FlagEmbedding } from 'fastembed';
-import path from 'path';
-import os from 'os';
-
-const CACHE_DIR = path.join(os.homedir(), '.claude', '.promptgraph', 'model-cache');
-
-let model = null;
-
-async function getModel() {
-  if (!model) {
-    model = await FlagEmbedding.init({
-      model: EmbeddingModel.BGESmallENV15,
-      cacheDir: CACHE_DIR,
-    });
-  }
-  return model;
-}
-
-export async function embed(text) {
-  const m = await getModel();
-  const results = [];
-  for await (const batch of m.embed([text])) {
-    results.push(...batch);
-  }
-  return Array.from(results[0]);
-}
-
-export function cosineSimilarity(a, b) {
-  let dot = 0;
-  for (let i = 0; i < a.length; i++) dot += a[i] * b[i];
-  return dot;
-}
+import { EmbeddingModel, FlagEmbedding } from 'fastembed';
+import path from 'path';
+import os from 'os';
+
+const CACHE_DIR = path.join(os.homedir(), '.claude', '.promptgraph', 'model-cache');
+
+let model = null;
+
+async function getModel() {
+  if (!model) {
+    model = await FlagEmbedding.init({
+      model: EmbeddingModel.BGESmallENV15,
+      cacheDir: CACHE_DIR,
+    });
+  }
+  return model;
+}
+
+export async function embed(text) {
+  const m = await getModel();
+  const results = [];
+  for await (const batch of m.embed([text])) {
+    results.push(...batch);
+  }
+  return Array.from(results[0]);
+}
+
+export function cosineSimilarity(a, b) {
+  let dot = 0;
+  for (let i = 0; i < a.length; i++) dot += a[i] * b[i];
+  return dot;
+}

package/github-import.js

@@ -0,0 +1,48 @@
+import { execSync } from 'child_process';
+import path from 'path';
+import os from 'os';
+import fs from 'fs';
+import { indexAll } from './indexer.js';
+import { loadConfig, saveConfig } from './config.js';
+
+const SKILLS_DIR = path.join(os.homedir(), '.claude', 'skills-store');
+
+export async function importFromGitHub(repoUrl) {
+  if (!repoUrl) {
+    console.error('Usage: promptgraph-mcp import <github-url-or-owner/repo>');
+    process.exit(1);
+  }
+
+  const url = repoUrl.startsWith('http') ? repoUrl : `https://github.com/${repoUrl}`;
+  const repoName = url.split('/').slice(-2).join('-').replace('.git', '');
+  const dest = path.join(SKILLS_DIR, 'github', repoName);
+
+  fs.mkdirSync(path.dirname(dest), { recursive: true });
+
+  if (fs.existsSync(dest)) {
+    console.log(`Updating ${repoName}...`);
+    execSync(`git -C "${dest}" pull --depth=1`, { stdio: 'inherit' });
+  } else {
+    console.log(`Cloning ${url}...`);
+    execSync(`git clone --depth=1 ${url} "${dest}"`, { stdio: 'inherit' });
+  }
+
+  const mdCount = execSync(`find "${dest}" -name "*.md" | wc -l`).toString().trim();
+  console.log(`Found ${mdCount} .md files`);
+
+  if (parseInt(mdCount) < 2) {
+    console.warn('Warning: repo has fewer than 2 .md files — may be empty');
+  }
+
+  const config = loadConfig();
+  const githubDir = path.join(SKILLS_DIR, 'github');
+  if (!config.sources.find(s => s.dir === githubDir)) {
+    config.sources.push({ dir: githubDir, source: 'github' });
+    saveConfig(config);
+    console.log('Added github dir to config');
+  }
+
+  console.log('\nReindexing...');
+  await indexAll();
+  console.log(`Done! Imported from ${repoName}`);
+}