@afterxleep/doc-bot 1.7.11 → 1.8.1

package/README.md

@@ -10,24 +10,21 @@ It's platform agnostic and designed to replace and extend the rule systems provi
 ## What is doc-bot?
 
 doc-bot is an intelligent documentation server that:
-- 🔍 **Searches** your project documentation instantly
-- 🧠 **Auto-indexes** content for smart inference (no manual keyword mapping!)
-- 📋 **Applies** global rules to every AI interaction
-- 🎯 **Suggests** contextual documentation based on file patterns
-- 🤖 **Detects** code patterns, frameworks, and keywords automatically
+- 🧠 **Auto-indexes** content for smart inference, based on metadata and keywords
+- 🤖 **Provides agentic tools** to query, and update your documentation
 - 🔄 **Updates** automatically when docs change
 
 ## Why MCP Instead of Static Rules?
 
-Traditional AI assistants use static rule files (like Cursor Rules or Copilot's .github/copilot-instructions.md) that have significant limitations. doc-bot's MCP approach offers powerful advantages:
+IDE's use static rule files (like Cursor Rules or Copilot's .github/copilot-instructions.md), and each one has their own format, metadata and approach.
 
 ### 🚀 Dynamic Search vs Static Rules
 
 **Static Systems:**
 - All rules must fit in a single file or limited token window
 - AI reads everything, even irrelevant rules
-- No way to search or filter documentation
-- Rules compete for precious context space
+- No way to search or filter documentation (besides plain 'grep')
+- Rules compete for context space
 
 **MCP with doc-bot:**
 - AI searches for exactly what it needs
@@ -38,9 +35,8 @@ Traditional AI assistants use static rule files (like Cursor Rules or Copilot's
 ### 🧠 Contextual Intelligence
 
 **Static Systems:**
-- Same rules applied everywhere
-- No awareness of what you're working on
-- Can't provide specific help for your current task
+- Duplicate or symlinked rules to work with multiple agents
+- Agents use `grep` for basic text-base searching
 
 **MCP with doc-bot:**
 - AI searches for relevant documentation based on your query
@@ -51,8 +47,8 @@ Traditional AI assistants use static rule files (like Cursor Rules or Copilot's
 ### 📈 Scalability Without Limits
 
 **Static Systems:**
-- Limited by token count (typically 2-4k tokens)
-- Adding more rules means removing others
+- Limited by token count
+- Adding more rules has impact in your context window
 - Documentation competes with your actual code for context
 
 **MCP with doc-bot:**
@@ -66,7 +62,7 @@ Traditional AI assistants use static rule files (like Cursor Rules or Copilot's
 **Static Systems:**
 - Changes require restarting your AI/IDE
 - No way to know if rules are current
-- Manual synchronization across tools
+- Manual synchronization across tools and AI agents
 
 **MCP with doc-bot:**
 - Hot reload on documentation changes
@@ -84,7 +80,7 @@ Traditional AI assistants use static rule files (like Cursor Rules or Copilot's
 **MCP with doc-bot:**
 - AI can list all available documentation
 - Discovers relevant docs automatically
-- Suggests documentation based on context
+- Suggests documentation based on relevance
 - Searchable knowledge base with intelligent ranking
 - No need for AI to grep through your codebase - dedicated search engine
 
@@ -99,7 +95,7 @@ Traditional AI assistants use static rule files (like Cursor Rules or Copilot's
      "mcpServers": {
        "doc-bot": {
          "command": "npx",
-         "args": ["@afterxleep/doc-bot"]
+         "args": ["@afterxleep/doc-bot@latest"]
        }
      }
    }
@@ -111,11 +107,13 @@ Traditional AI assistants use static rule files (like Cursor Rules or Copilot's
      "mcpServers": {
        "doc-bot": {
          "command": "npx",
-         "args": ["@afterxleep/doc-bot", "--docs", "./my-custom-docs"]
+         "args": ["@afterxleep/doc-bot@latest", "--docs", "./my-custom-docs"]
        }
      }
    }
    ```
+   Note: If a relative path does not work, you can use VSCode `${workspaceFolder}`environment variable `${workspaceFolder}/my-custom-docs`
+
 
    **With verbose logging (for debugging):**
    ```json
@@ -123,7 +121,7 @@ Traditional AI assistants use static rule files (like Cursor Rules or Copilot's
      "mcpServers": {
        "doc-bot": {
          "command": "npx",
-         "args": ["@afterxleep/doc-bot", "--verbose"]
+         "args": ["@afterxleep/doc-bot@latest", "--verbose"]
        }
      }
    }
@@ -193,6 +191,7 @@ alwaysApply: false
 title: "Testing Guide"
 description: "How to write and run tests"
 keywords: ["testing", "jest", "tdd", "unit-tests"]
+filePatterns: ["*.test.js", "*.spec.js", "__tests__/**/*"]
 ---
 
 # Testing Guide
@@ -208,14 +207,16 @@ Run tests with: `npm test`
 
 ## Frontmatter-Based Configuration
 
-doc-bot uses frontmatter in your markdown files to automatically detect and categorize rules - **no manifest.json required!**
+doc-bot uses frontmatter in your markdown files to automatically detect and categorize rules.
 
 ### Frontmatter Fields:
 
 - **`alwaysApply: true`** - Global rules applied to every AI interaction
 - **`alwaysApply: false`** - Contextual rules searched and applied based on relevance
 - **`keywords: ["list", "of", "keywords"]`** - For smart indexing and search
+- **`filePatterns: ["*.js", "src/**/*.ts"]`** - Apply docs to specific files (see below)
 - **`title`** and **`description`** - Standard metadata
+- **`confidence: 0.9`** - Relevance confidence score (0-1)
 
 ### 🎯 Automatic Intelligence
 
@@ -243,6 +244,31 @@ keywords: ["react", "components", "hooks", "jsx"]
 Your documentation content here...
 ```
 
+### File Pattern Matching
+
+doc-bot supports contextual documentation using file patterns. Documentation can be targeted to specific files:
+
+```markdown
+---
+alwaysApply: false
+title: "React Testing Guide"
+keywords: ["testing", "jest", "react"]
+filePatterns: ["*.test.jsx", "*.test.tsx", "__tests__/**/*"]
+---
+
+# React Testing Guide
+
+This documentation appears only when working with test files...
+```
+
+**Pattern Examples:**
+- `*.js` - All JavaScript files
+- `src/**/*.ts` - TypeScript files in src directory
+- `[Tt]est.js` - Test.js or test.js
+- `*.{jsx,tsx}` - React component files
+
+When AI requests documentation for a specific file (e.g., `Button.test.jsx`), only docs with matching patterns are returned.
+
 ## Development setup
 
 ### Running locally
@@ -267,13 +293,7 @@ Your documentation content here...
    ```bash
    npm run dev
    ```
-
-5. **Run with examples documentation:**
-   ```bash
-   npm run start:examples
-   ```
-
-6. **Run tests:**
+5. **Run tests:**
    ```bash
    npm test
    ```
@@ -291,7 +311,6 @@ doc-bot [options]
 
 Options:
   -d, --docs <path>        Path to docs folder (default: doc-bot)
-  -c, --config <path>      Path to manifest file (optional, for backward compatibility)
   -v, --verbose           Enable verbose logging
   -w, --watch             Watch for file changes
   -h, --help              Show help
@@ -307,9 +326,6 @@ doc-bot --docs ./my-docs
 
 # With verbose logging and file watching
 doc-bot --verbose --watch
-
-# With optional manifest for backward compatibility
-doc-bot --config ./manifest.json
 ```
 
 ## Publishing and Development
@@ -378,4 +394,4 @@ MIT License - see the [LICENSE](LICENSE) file for details.
 
 - [npm package](https://www.npmjs.com/package/@afterxleep/doc-bot)
 - [GitHub repository](https://github.com/afterxleep/doc-bot)
-- [Model Context Protocol](https://github.com/modelcontextprotocol/specification)
+- [Model Context Protocol](https://github.com/modelcontextprotocol/specification)

package/bin/doc-bot.js

@@ -1,17 +1,22 @@
 #!/usr/bin/env node
 
-const { program } = require('commander');
-const path = require('path');
-const fs = require('fs-extra');
-const { DocsServer } = require('../src/index.js');
-const packageJson = require('../package.json');
+import { program } from 'commander';
+import path from 'path';
+import fs from 'fs-extra';
+import { DocsServer } from '../src/index.js';
+import { readFileSync } from 'fs';
+import { fileURLToPath } from 'url';
+import { dirname, join } from 'path';
+
+const __filename = fileURLToPath(import.meta.url);
+const __dirname = dirname(__filename);
+const packageJson = JSON.parse(readFileSync(join(__dirname, '../package.json'), 'utf8'));
 
 program
   .name('doc-bot')
   .description('Generic MCP server for intelligent documentation access')
   .version(packageJson.version)
   .option('-d, --docs <path>', 'Path to docs folder', 'doc-bot')
-  .option('-c, --config <path>', 'Path to manifest file')
   .option('-v, --verbose', 'Enable verbose logging')
   .option('-w, --watch', 'Watch for file changes')
   .parse();
@@ -20,7 +25,6 @@ const options = program.opts();
 
 async function main() {
   const docsPath = path.resolve(options.docs);
-  const configPath = options.config ? path.resolve(options.config) : path.resolve(options.docs, 'manifest.json');
   
   // Check if documentation folder exists
   if (!await fs.pathExists(docsPath)) {
@@ -40,23 +44,8 @@ async function main() {
     process.exit(1);
   }
   
-  // Manifest is now optional - only create if explicitly requested
-  if (options.config && !await fs.pathExists(configPath)) {
-    if (options.verbose) {
-      console.error('📝 Creating default manifest.json...');
-    }
-    const defaultManifest = {
-      name: 'Project Documentation',
-      version: '1.0.0',
-      description: 'AI-powered documentation (auto-generated from frontmatter)',
-      note: 'This manifest is auto-generated. Configure rules using frontmatter in your markdown files.'
-    };
-    await fs.writeJSON(configPath, defaultManifest, { spaces: 2 });
-  }
-  
   const server = new DocsServer({
     docsPath,
-    configPath,
     verbose: options.verbose,
     watch: options.watch
   });
@@ -64,11 +53,7 @@ async function main() {
   if (options.verbose) {
     console.error('🚀 Starting doc-bot...');
     console.error(`📁 Documentation: ${docsPath}`);
-    if (await fs.pathExists(configPath)) {
-      console.error(`⚙️  Configuration: ${configPath}`);
-    } else {
-      console.error(`⚙️  Configuration: Auto-generated from frontmatter`);
-    }
+    console.error(`⚙️  Configuration: Frontmatter-based`);
     
     if (options.watch) {
       console.error('👀 Watching for file changes...');

package/package.json

@@ -1,7 +1,8 @@
 {
   "name": "@afterxleep/doc-bot",
-  "version": "1.7.11",
+  "version": "1.8.1",
   "description": "Generic MCP server for intelligent documentation access in any project",
+  "type": "module",
   "main": "src/index.js",
   "bin": {
     "doc-bot": "bin/doc-bot.js"
@@ -11,7 +12,7 @@
     "start:watch": "node bin/doc-bot.js --verbose --watch",
     "start:examples": "node bin/doc-bot.js --docs ./samples --verbose",
     "dev": "node bin/doc-bot.js --verbose --watch",
-    "test": "jest",
+    "test": "NODE_OPTIONS=--experimental-vm-modules jest",
     "test:watch": "jest --watch",
     "test:coverage": "jest --coverage",
     "lint": "eslint src/ bin/ --ext .js",
@@ -51,6 +52,10 @@
     "jest": "^29.7.0",
     "supertest": "^6.3.0"
   },
+  "jest": {
+    "testEnvironment": "node",
+    "transform": {}
+  },
   "engines": {
     "node": ">=18.0.0"
   },

package/src/index.js

@@ -1,18 +1,21 @@
-const { Server } = require('@modelcontextprotocol/sdk/server/index.js');
-const { StdioServerTransport } = require('@modelcontextprotocol/sdk/server/stdio.js');
-const { CallToolRequestSchema, ListResourcesRequestSchema, ListToolsRequestSchema, ReadResourceRequestSchema } = require('@modelcontextprotocol/sdk/types.js');
-const { DocumentationService } = require('./services/DocumentationService.js');
-const { InferenceEngine } = require('./services/InferenceEngine.js');
-const { ManifestLoader } = require('./services/ManifestLoader.js');
-const chokidar = require('chokidar');
-const path = require('path');
-const fs = require('fs').promises;
+import { Server } from '@modelcontextprotocol/sdk/server/index.js';
+import { StdioServerTransport } from '@modelcontextprotocol/sdk/server/stdio.js';
+import { CallToolRequestSchema, ListResourcesRequestSchema, ListToolsRequestSchema, ReadResourceRequestSchema } from '@modelcontextprotocol/sdk/types.js';
+import { DocumentationService } from './services/DocumentationService.js';
+import { InferenceEngine } from './services/InferenceEngine.js';
+import chokidar from 'chokidar';
+import path from 'path';
+import { promises as fs } from 'fs';
+import { fileURLToPath } from 'url';
+import { dirname } from 'path';
+
+const __filename = fileURLToPath(import.meta.url);
+const __dirname = dirname(__filename);
 
 class DocsServer {
   constructor(options = {}) {
     this.options = {
       docsPath: options.docsPath || './doc-bot',
-      configPath: options.configPath || './doc-bot/manifest.json', // Optional, for backward compatibility
       verbose: options.verbose || false,
       watch: options.watch || false,
       ...options
@@ -32,10 +35,8 @@ class DocsServer {
       }
     });
     
-    // ManifestLoader is now optional - only create if manifest exists
-    this.manifestLoader = null;
     this.docService = new DocumentationService(this.options.docsPath);
-    this.inferenceEngine = new InferenceEngine(this.docService, null);
+    this.inferenceEngine = new InferenceEngine(this.docService);
     
     this.setupHandlers();
     
@@ -60,7 +61,6 @@ class DocsServer {
   setupHandlers() {
     // List available resources
     this.server.setRequestHandler(ListResourcesRequestSchema, async () => {
-      const manifest = await this.manifestLoader.load();
       return {
         resources: [
           {
@@ -81,12 +81,6 @@ class DocsServer {
             description: 'Smart documentation suggestions based on your current context',
             mimeType: 'application/json'
           },
-          {
-            uri: 'docs://manifest',
-            name: 'Documentation Manifest',
-            description: 'Project documentation configuration',
-            mimeType: 'application/json'
-          },
           {
             uri: 'docs://system-prompt',
             name: 'System Prompt Injection',
@@ -122,24 +116,6 @@ class DocsServer {
             }]
           };
           
-        case 'docs://manifest':
-          // Generate manifest from frontmatter data
-          const manifestDocs = await this.docService.getAllDocuments();
-          const generatedManifest = {
-            name: 'Project Documentation',
-            version: '1.0.0',
-            description: 'Auto-generated from frontmatter',
-            globalRules: manifestDocs.filter(doc => doc.metadata?.alwaysApply === true).map(doc => doc.fileName),
-            contextualRules: this.extractContextualRules(manifestDocs)
-          };
-          return {
-            contents: [{
-              uri,
-              mimeType: 'application/json',
-              text: JSON.stringify(generatedManifest, null, 2)
-            }]
-          };
-
         case 'docs://system-prompt':
           const systemPrompt = await this.generateSystemPrompt();
           return {
@@ -267,6 +243,15 @@ class DocsServer {
               properties: {},
               additionalProperties: false
             }
+          },
+          {
+            name: 'get_document_index',
+            description: 'Get an index of all documents in the store with title, description, and last updated date.',
+            inputSchema: {
+              type: 'object',
+              properties: {},
+              additionalProperties: false
+            }
           }
         ]
       };
@@ -372,6 +357,16 @@ class DocsServer {
                 text: `✅ Documentation refreshed successfully!\n\n**Files indexed:** ${docCount}\n**Last updated:** ${new Date().toLocaleString()}\n\n💡 All manually added files should now be available for search and reading.`
               }]
             };
+
+          case 'get_document_index':
+            const documentIndex = await this.docService.getDocumentIndex();
+            
+            return {
+              content: [{
+                type: 'text',
+                text: await this.formatDocumentIndex(documentIndex)
+              }]
+            };
             
           default:
             throw new Error(`Unknown tool: ${name}`);
@@ -388,7 +383,7 @@ class DocsServer {
   }
   
   setupWatcher() {
-    const watcher = chokidar.watch([this.options.docsPath, this.options.configPath], {
+    const watcher = chokidar.watch(this.options.docsPath, {
       ignored: /(^|[\/\\])\../, // ignore dotfiles
       persistent: true
     });
@@ -398,15 +393,8 @@ class DocsServer {
         console.error(`📄 Documentation updated: ${path.relative(process.cwd(), filePath)}`);
       }
       
-      // Reload manifest if config changed
-      if (filePath === this.options.configPath) {
-        await this.manifestLoader.reload();
-      }
-      
       // Reload docs if documentation changed
-      if (filePath.startsWith(this.options.docsPath)) {
-        await this.docService.reload();
-      }
+      await this.docService.reload();
     });
   }
   
@@ -554,13 +542,37 @@ class DocsServer {
     return output;
   }
 
+  async formatDocumentIndex(documentIndex) {
+    if (!documentIndex || documentIndex.length === 0) {
+      return 'No documents found in the store.';
+    }
+    
+    let output = '# Document Index\n\n';
+    output += `Found ${documentIndex.length} document(s) in the store:\n\n`;
+    
+    documentIndex.forEach((doc, index) => {
+      output += `## ${index + 1}. ${doc.title}\n\n`;
+      output += `**File:** ${doc.fileName}\n`;
+      
+      if (doc.description) {
+        output += `**Description:** ${doc.description}\n`;
+      }
+      
+      output += `**Last Updated:** ${new Date(doc.lastUpdated).toLocaleString()}\n\n`;
+      output += '---\n\n';
+    });
+    
+    output += '💡 **Next Steps:** Use the `read_specific_document` tool with the file name to get the full content of any document above.\n';
+    
+    return output;
+  }
+
   async createOrUpdateRule({ fileName, title, description, keywords, alwaysApply, content }) {
-    const fs = require('fs-extra');
-    const path = require('path');
+    const { default: fsExtra } = await import('fs-extra');
     
     try {
       // Ensure the docs directory exists
-      await fs.ensureDir(this.options.docsPath);
+      await fsExtra.ensureDir(this.options.docsPath);
       
       // Create the full file path
       const filePath = path.join(this.options.docsPath, fileName);
@@ -581,7 +593,7 @@ class DocsServer {
       const fullContent = frontmatter + content;
       
       // Check if file exists to determine if this is create or update
-      const fileExists = await fs.pathExists(filePath);
+      const fileExists = await fsExtra.pathExists(filePath);
       const action = fileExists ? 'updated' : 'created';
       
       // Write the file
@@ -823,15 +835,6 @@ class DocsServer {
   }
   
   async start() {
-    // Initialize manifest loader if manifest exists (backward compatibility)
-    const fs = require('fs-extra');
-    if (await fs.pathExists(this.options.configPath)) {
-      this.manifestLoader = new ManifestLoader(this.options.configPath);
-      await this.manifestLoader.load();
-      // Update services with manifest loader
-      this.inferenceEngine = new InferenceEngine(this.docService, this.manifestLoader);
-    }
-    
     // Initialize services
     await this.docService.initialize();
     await this.inferenceEngine.initialize();
@@ -842,13 +845,9 @@ class DocsServer {
     
     if (this.options.verbose) {
       console.error('🔧 Server initialized with MCP transport');
-      if (this.manifestLoader) {
-        console.error('📄 Using manifest.json for additional configuration');
-      } else {
-        console.error('🚀 Using frontmatter-based configuration (no manifest needed)');
-      }
+      console.error('🚀 Using frontmatter-based configuration');
     }
   }
 }
 
-module.exports = { DocsServer };
+export { DocsServer };

package/src/index.test.js

@@ -0,0 +1,114 @@
+import { DocumentationService } from './services/DocumentationService.js';
+import fs from 'fs-extra';
+import path from 'path';
+import { fileURLToPath } from 'url';
+import { dirname } from 'path';
+
+const __filename = fileURLToPath(import.meta.url);
+const __dirname = dirname(__filename);
+
+describe('DocumentationService get_document_index functionality', () => {
+  let docService;
+  let tempDocsPath;
+
+  beforeEach(async () => {
+    // Create a temporary directory for test documents
+    tempDocsPath = path.join(__dirname, '../test-docs');
+    await fs.ensureDir(tempDocsPath);
+    
+    // Create test documents
+    const testDocs = [
+      {
+        fileName: 'react-guide.md',
+        content: '---\nalwaysApply: false\ntitle: "React Component Guide"\ndescription: "Learn how to build React components"\nkeywords: ["react", "components", "jsx"]\n---\n\n# React Components\n\nThis guide covers React components.'
+      },
+      {
+        fileName: 'testing-standards.md',
+        content: '---\nalwaysApply: true\ntitle: "Testing Standards"\ndescription: "Project testing requirements"\nkeywords: ["testing", "jest", "standards"]\n---\n\n# Testing Standards\n\nAll code must have tests.'
+      },
+      {
+        fileName: 'api-design.md',
+        content: '---\nalwaysApply: false\ntitle: "API Design Guidelines"\ndescription: "REST API design patterns"\nkeywords: ["api", "rest", "design"]\n---\n\n# API Design\n\nFollow REST principles.'
+      }
+    ];
+
+    // Write test documents to temp directory
+    for (const doc of testDocs) {
+      await fs.writeFile(path.join(tempDocsPath, doc.fileName), doc.content);
+    }
+
+    // Create DocumentationService instance
+    docService = new DocumentationService(tempDocsPath);
+    await docService.initialize();
+  });
+
+  afterEach(async () => {
+    // Clean up temporary directory
+    await fs.remove(tempDocsPath);
+  });
+
+  describe('getDocumentIndex method', () => {
+    it('should be implemented and return document index', async () => {
+      expect(typeof docService.getDocumentIndex).toBe('function');
+      
+      const index = await docService.getDocumentIndex();
+      
+      expect(Array.isArray(index)).toBe(true);
+      expect(index.length).toBe(3);
+      
+      // Check that each document has required fields
+      index.forEach(doc => {
+        expect(doc).toHaveProperty('title');
+        expect(doc).toHaveProperty('description');
+        expect(doc).toHaveProperty('fileName');
+        expect(doc).toHaveProperty('lastUpdated');
+        expect(typeof doc.lastUpdated).toBe('string');
+      });
+    });
+
+    it('should return documents sorted by title', async () => {
+      const index = await docService.getDocumentIndex();
+      
+      // Should be sorted alphabetically by title
+      expect(index[0].title).toBe('API Design Guidelines');
+      expect(index[1].title).toBe('React Component Guide');
+      expect(index[2].title).toBe('Testing Standards');
+    });
+
+    it('should include metadata from frontmatter', async () => {
+      const index = await docService.getDocumentIndex();
+      
+      const reactDoc = index.find(doc => doc.fileName === 'react-guide.md');
+      expect(reactDoc.title).toBe('React Component Guide');
+      expect(reactDoc.description).toBe('Learn how to build React components');
+      
+      const testingDoc = index.find(doc => doc.fileName === 'testing-standards.md');
+      expect(testingDoc.title).toBe('Testing Standards');
+      expect(testingDoc.description).toBe('Project testing requirements');
+    });
+
+    it('should use file name as title when no title in metadata', async () => {
+      // Create a document without title metadata
+      const docWithoutTitle = '---\ndescription: "A document without title"\n---\n\nSome content';
+      await fs.writeFile(path.join(tempDocsPath, 'no-title.md'), docWithoutTitle);
+      
+      // Reload documents to pick up the new file
+      await docService.reload();
+      
+      const index = await docService.getDocumentIndex();
+      const noTitleDoc = index.find(doc => doc.fileName === 'no-title.md');
+      
+      expect(noTitleDoc.title).toBe('no-title.md');
+      expect(noTitleDoc.description).toBe('A document without title');
+    });
+
+    it('should handle empty description gracefully', async () => {
+      const index = await docService.getDocumentIndex();
+      
+      // All test documents should have descriptions, but let's test the structure
+      index.forEach(doc => {
+        expect(typeof doc.description).toBe('string');
+      });
+    });
+  });
+});

package/src/services/DocumentIndex.js

@@ -376,4 +376,4 @@ class DocumentIndex {
   }
 }
 
-module.exports = { DocumentIndex };
+export { DocumentIndex };

package/src/services/DocumentationService.js

@@ -1,7 +1,7 @@
-const fs = require('fs-extra');
-const path = require('path');
-const glob = require('glob');
-const yaml = require('yaml');
+import fs from 'fs-extra';
+import path from 'path';
+import { glob } from 'glob';
+import yaml from 'yaml';
 
 class DocumentationService {
   constructor(docsPath, manifestLoader = null) {
@@ -308,6 +308,22 @@ class DocumentationService {
     return results;
   }
   
+  async getDocumentIndex() {
+    const index = [];
+    
+    for (const doc of this.documents.values()) {
+      index.push({
+        title: doc.metadata?.title || doc.fileName,
+        description: doc.metadata?.description || '',
+        fileName: doc.fileName,
+        lastUpdated: doc.lastModified.toISOString()
+      });
+    }
+    
+    // Sort by title for consistent ordering
+    return index.sort((a, b) => a.title.localeCompare(b.title));
+  }
+  
 }
 
-module.exports = { DocumentationService };
+export { DocumentationService };

package/src/services/InferenceEngine.js

@@ -1,10 +1,9 @@
-const path = require('path');
-const { DocumentIndex } = require('./DocumentIndex');
+import path from 'path';
+import { DocumentIndex } from './DocumentIndex.js';
 
 class InferenceEngine {
-  constructor(documentationService, manifestLoader = null) {
+  constructor(documentationService) {
     this.docService = documentationService;
-    this.manifestLoader = manifestLoader;
     this.documentIndex = new DocumentIndex();
     this.isIndexBuilt = false;
   }
@@ -106,52 +105,13 @@ class InferenceEngine {
   }
   
   async getDocsByKeywords(query) {
-    if (!this.manifestLoader) {
-      return [];
-    }
-    
-    const manifest = await this.manifestLoader.load();
-    const keywords = manifest.inference?.keywords || {};
-    
-    const docs = [];
-    const queryLower = query.toLowerCase();
-    
-    for (const [keyword, docPaths] of Object.entries(keywords)) {
-      if (queryLower.includes(keyword.toLowerCase())) {
-        for (const docPath of docPaths) {
-          const doc = this.docService.getDocument(docPath);
-          if (doc) {
-            docs.push(doc);
-          }
-        }
-      }
-    }
-    
-    return docs;
+    // Now handled by DocumentIndex
+    return [];
   }
   
   async getDocsByPatterns(codeSnippet) {
-    if (!this.manifestLoader) {
-      return [];
-    }
-    
-    const manifest = await this.manifestLoader.load();
-    const patterns = manifest.inference?.patterns || {};
-    
-    const docs = [];
-    
-    for (const [pattern, docPaths] of Object.entries(patterns)) {
-      if (codeSnippet.includes(pattern)) {
-        for (const docPath of docPaths) {
-          const doc = this.docService.getDocument(docPath);
-          if (doc) {
-            docs.push(doc);
-          }
-        }
-      }
-    }
-    
-    return docs;
+    // Now handled by DocumentIndex
+    return [];
   }
   
   async getDocsByFileExtension(filePath) {
@@ -245,4 +205,4 @@ class InferenceEngine {
   }
 }
 
-module.exports = { InferenceEngine };
+export { InferenceEngine };

package/src/services/__tests__/DocumentIndex.test.js

@@ -1,4 +1,4 @@
-const { DocumentIndex } = require('../DocumentIndex');
+import { DocumentIndex } from '../DocumentIndex.js';
 
 describe('DocumentIndex', () => {
   let documentIndex;

package/src/services/__tests__/InferenceEngine.integration.test.js

@@ -1,13 +1,17 @@
-const { InferenceEngine } = require('../InferenceEngine');
-const { DocumentationService } = require('../DocumentationService');
-const { ManifestLoader } = require('../ManifestLoader');
-const fs = require('fs-extra');
-const path = require('path');
+import { jest } from '@jest/globals';
+import { InferenceEngine } from '../InferenceEngine.js';
+import { DocumentationService } from '../DocumentationService.js';
+import fs from 'fs-extra';
+import path from 'path';
+import { fileURLToPath } from 'url';
+import { dirname } from 'path';
+
+const __filename = fileURLToPath(import.meta.url);
+const __dirname = dirname(__filename);
 
 describe('InferenceEngine Integration', () => {
   let inferenceEngine;
   let mockDocService;
-  let mockManifestLoader;
   let tempDir;
 
   beforeEach(async () => {
@@ -109,19 +113,7 @@ Building REST APIs with Express.js.
       getContextualDocs: jest.fn().mockResolvedValue([])
     };
 
-    // Create mock ManifestLoader
-    mockManifestLoader = {
-      load: jest.fn().mockResolvedValue({
-        globalRules: [],
-        contextualRules: {},
-        inference: {
-          keywords: {},
-          patterns: {}
-        }
-      })
-    };
-
-    inferenceEngine = new InferenceEngine(mockDocService, mockManifestLoader);
+    inferenceEngine = new InferenceEngine(mockDocService);
     await inferenceEngine.initialize();
   });
 
@@ -257,7 +249,7 @@ Building REST APIs with Express.js.
         getContextualDocs: jest.fn().mockResolvedValue([])
       };
 
-      const fallbackEngine = new InferenceEngine(failingDocService, mockManifestLoader);
+      const fallbackEngine = new InferenceEngine(failingDocService);
       await fallbackEngine.initialize();
 
       expect(fallbackEngine.isIndexBuilt).toBe(false);

package/src/services/ManifestLoader.js

@@ -1,135 +0,0 @@
-const fs = require('fs-extra');
-const path = require('path');
-
-class ManifestLoader {
-  constructor(configPath) {
-    this.configPath = configPath;
-    this.manifest = null;
-    this.lastModified = null;
-  }
-  
-  async load() {
-    try {
-      const stats = await fs.stat(this.configPath);
-      
-      // Only reload if file has changed
-      if (this.manifest && this.lastModified && stats.mtime <= this.lastModified) {
-        return this.manifest;
-      }
-      
-      const content = await fs.readFile(this.configPath, 'utf8');
-      this.manifest = JSON.parse(content);
-      this.lastModified = stats.mtime;
-      
-      // Validate manifest structure
-      this.validateManifest();
-      
-      return this.manifest;
-    } catch (error) {
-      if (error.code === 'ENOENT') {
-        // Create default manifest if file doesn't exist
-        this.manifest = this.createDefaultManifest();
-        await this.save();
-        return this.manifest;
-      }
-      throw new Error(`Failed to load manifest: ${error.message}`);
-    }
-  }
-  
-  async reload() {
-    this.manifest = null;
-    this.lastModified = null;
-    return await this.load();
-  }
-  
-  async save() {
-    if (!this.manifest) {
-      throw new Error('No manifest to save');
-    }
-    
-    await fs.ensureDir(path.dirname(this.configPath));
-    await fs.writeJSON(this.configPath, this.manifest, { spaces: 2 });
-  }
-  
-  validateManifest() {
-    if (!this.manifest) {
-      throw new Error('Manifest is null');
-    }
-    
-    // Required fields
-    if (!this.manifest.name) {
-      this.manifest.name = 'Project Documentation';
-    }
-    
-    if (!this.manifest.version) {
-      this.manifest.version = '1.0.0';
-    }
-    
-    // Optional fields with defaults
-    if (!this.manifest.globalRules) {
-      this.manifest.globalRules = [];
-    }
-    
-    if (!this.manifest.contextualRules) {
-      this.manifest.contextualRules = {};
-    }
-    
-    if (!this.manifest.inference) {
-      this.manifest.inference = {
-        keywords: {},
-        patterns: {}
-      };
-    }
-    
-    // Validate globalRules is array
-    if (!Array.isArray(this.manifest.globalRules)) {
-      throw new Error('globalRules must be an array');
-    }
-    
-    // Validate contextualRules is object
-    if (typeof this.manifest.contextualRules !== 'object') {
-      throw new Error('contextualRules must be an object');
-    }
-    
-    // Validate inference structure
-    if (!this.manifest.inference.keywords) {
-      this.manifest.inference.keywords = {};
-    }
-    
-    if (!this.manifest.inference.patterns) {
-      this.manifest.inference.patterns = {};
-    }
-  }
-  
-  createDefaultManifest() {
-    return {
-      name: 'Project Documentation',
-      version: '1.0.0',
-      description: 'AI-powered documentation',
-      globalRules: [],
-      contextualRules: {},
-      inference: {
-        keywords: {},
-        patterns: {}
-      }
-    };
-  }
-  
-  getManifest() {
-    return this.manifest;
-  }
-  
-  getGlobalRules() {
-    return this.manifest?.globalRules || [];
-  }
-  
-  getContextualRules() {
-    return this.manifest?.contextualRules || {};
-  }
-  
-  getInferenceConfig() {
-    return this.manifest?.inference || { keywords: {}, patterns: {} };
-  }
-}
-
-module.exports = { ManifestLoader };