@equinor/fusion-framework-cli-plugin-ai-index 1.0.0

package/CHANGELOG.md

@@ -0,0 +1,63 @@
+# @equinor/fusion-framework-cli-plugin-ai-index
+
+## 1.0.0
+
+### Major Changes
+
+- [`e2d2a76`](https://github.com/equinor/fusion-framework/commit/e2d2a76d08b86c3a9d8783fed1606551df9d5633) Thanks [@odinr](https://github.com/odinr)! - Add new AI indexing plugin package for document embedding and chunking utilities.
+
+  This plugin extends the Fusion Framework CLI with comprehensive document embedding and indexing capabilities for building searchable vector stores from code and documentation.
+
+  **Features:**
+
+  - Document chunking and embedding generation
+  - Git metadata extraction for context-aware embeddings
+  - Markdown/MDX and TypeScript/TSX documentation parsing
+  - File change tracking (new, modified, removed) via git diff
+  - Batch operations for efficient vector store updates
+  - Package metadata resolution
+  - TSDoc extraction utilities
+  - Dry-run mode for testing
+
+  **Quick Usage:**
+
+  1. Install the plugin:
+
+  ```sh
+  pnpm add -D @equinor/fusion-framework-cli-plugin-ai-index
+  ```
+
+  2. Configure in `fusion-cli.config.ts`:
+
+  ```typescript
+  import { defineFusionCli } from "@equinor/fusion-framework-cli";
+
+  export default defineFusionCli(() => ({
+    plugins: ["@equinor/fusion-framework-cli-plugin-ai-index"],
+  }));
+  ```
+
+  3. Use the embeddings command:
+
+  ```sh
+  # Process all TypeScript and Markdown files
+  ffc ai embeddings "*.ts" "*.md" "*.mdx"
+
+  # Dry-run to preview what would be processed
+  ffc ai embeddings --dry-run ./src
+
+  # Process only changed files (git diff mode)
+  ffc ai embeddings --diff
+
+  # Clean and re-index all documents
+  ffc ai embeddings --clean "*.ts"
+  ```
+
+  The plugin supports Azure OpenAI and Azure Cognitive Search configuration via command-line options or environment variables. Configure file patterns and chunking options via `fusion-ai.config.ts`.
+
+### Patch Changes
+
+- Updated dependencies [[`e2d2a76`](https://github.com/equinor/fusion-framework/commit/e2d2a76d08b86c3a9d8783fed1606551df9d5633), [`e2d2a76`](https://github.com/equinor/fusion-framework/commit/e2d2a76d08b86c3a9d8783fed1606551df9d5633), [`e2d2a76`](https://github.com/equinor/fusion-framework/commit/e2d2a76d08b86c3a9d8783fed1606551df9d5633)]:
+  - @equinor/fusion-framework-cli-plugin-ai-base@1.0.0
+  - @equinor/fusion-framework-cli@13.0.0
+  - @equinor/fusion-framework-module-ai@2.0.0

package/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2022 Equinor
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

package/README.md

@@ -0,0 +1,114 @@
+# @equinor/fusion-framework-cli-plugin-ai-index
+
+AI indexing plugin for Fusion Framework CLI providing document embedding and chunking utilities.
+
+## Installation
+
+```sh
+pnpm add -D @equinor/fusion-framework-cli-plugin-ai-index
+```
+
+## Configuration
+
+After installing the plugin, create a `fusion-cli.config.ts` file in your project root:
+
+```typescript
+import { defineFusionCli } from '@equinor/fusion-framework-cli';
+
+export default defineFusionCli(() => ({
+  plugins: [
+    '@equinor/fusion-framework-cli-plugin-ai-index',
+  ],
+}));
+```
+
+The CLI will automatically discover and load plugins listed in this configuration file. The config file can be `.ts`, `.js`, or `.json`. The `defineFusionCli` helper provides type safety and IntelliSense support.
+
+## Features
+
+This plugin extends the Fusion Framework CLI with AI indexing capabilities:
+
+- **Document embedding** and chunking utilities
+- Markdown/MDX document chunking with frontmatter extraction
+- TypeScript/TSX TSDoc extraction and chunking
+- Glob pattern support for file collection
+- Git diff-based processing for workflow integration
+- Dry-run mode for testing without actual processing
+
+## Usage
+
+Once installed, the embeddings command is automatically available:
+
+```sh
+# Generate embeddings from documents
+ffc ai embeddings ./src
+```
+
+## Commands
+
+### `ai embeddings`
+
+Document embedding utilities for Large Language Model processing.
+
+**Features:**
+- Markdown/MDX document chunking with frontmatter extraction
+- TypeScript/TSX TSDoc extraction and chunking
+- Glob pattern support for file collection
+- Git diff-based processing for workflow integration
+- Dry-run mode for testing without actual processing
+- Configurable file patterns via fusion-ai.config.ts
+
+**Options:**
+- `--dry-run` - Show what would be processed without actually doing it
+- `--config <config>` - Path to a config file (default: fusion-ai.config.ts)
+- `--diff` - Process only changed files (workflow mode)
+- `--base-ref <ref>` - Git reference to compare against (default: HEAD~1)
+- `--clean` - Delete all existing documents from the vector store before processing
+- `--openai-api-key <key>` - API key for Azure OpenAI
+- `--openai-api-version <version>` - API version (default: 2024-02-15-preview)
+- `--openai-instance <name>` - Azure OpenAI instance name
+- `--openai-embedding-deployment <name>` - Azure OpenAI embedding deployment name
+- `--azure-search-endpoint <url>` - Azure Search endpoint URL
+- `--azure-search-api-key <key>` - Azure Search API key
+- `--azure-search-index-name <name>` - Azure Search index name
+
+**Examples:**
+```sh
+$ ffc ai embeddings --dry-run ./src
+$ ffc ai embeddings "*.ts" "*.md" "*.mdx"
+$ ffc ai embeddings --diff
+$ ffc ai embeddings --diff --base-ref origin/main
+$ ffc ai embeddings --clean "*.ts"
+```
+
+## Configuration
+
+The plugin requires Azure OpenAI and Azure Cognitive Search configuration. See the main CLI documentation for details on setting up API keys and endpoints.
+
+You can also create a `fusion-ai.config.ts` file to configure file patterns and metadata processing:
+
+```typescript
+import { configureFusionAI } from '@equinor/fusion-framework-cli-plugin-ai-index';
+import type { FusionAIConfigWithIndex } from '@equinor/fusion-framework-cli-plugin-ai-index';
+
+export default configureFusionAI((): FusionAIConfigWithIndex => ({
+  index: {
+    patterns: ['**/*.ts', '**/*.md', '**/*.mdx'],
+    metadata: {
+      attributeProcessor: (attributes, document) => {
+        // Custom metadata processing
+        return attributes;
+      },
+    },
+    embedding: {
+      chunkSize: 1000,
+      chunkOverlap: 200,
+    },
+  },
+}));
+```
+
+## License
+
+ISC
+

package/dist/esm/bin/apply-metadata.js

@@ -0,0 +1,63 @@
+import path from 'node:path';
+import { from, mergeMap, map, toArray } from 'rxjs';
+import { extractGitMetadata } from '../utils/git/index.js';
+import { resolvePackage } from '../utils/package-resolver.js';
+/**
+ * Creates a stream that applies metadata to documents.
+ * @internal
+ */
+export function applyMetadata(document$, indexConfig) {
+    // Resolve packages if enabled
+    const shouldResolvePackage = indexConfig?.metadata?.resolvePackage ?? false;
+    return document$.pipe(mergeMap((entry) => {
+        return from(entry.documents).pipe(
+        // Extract git metadata concurrently for all documents
+        mergeMap(async (document) => {
+            const rootPath = document.metadata.rootPath ?? process.cwd();
+            const sourcePath = path.join(rootPath, document.metadata.source);
+            const gitMetadata = document.metadata.source && indexConfig?.metadata?.resolveGit !== false
+                ? await extractGitMetadata(sourcePath)
+                : {};
+            // Resolve package information if enabled
+            let packageMetadata = {};
+            if (shouldResolvePackage && document.metadata.source) {
+                packageMetadata = await resolvePackage(sourcePath)
+                    .then((pkg) => {
+                    return {
+                        pkg_name: pkg?.name,
+                        pkg_version: pkg?.version,
+                        pkg_keywords: pkg?.keywords,
+                    };
+                })
+                    .catch(() => ({}));
+            }
+            return {
+                ...document,
+                metadata: {
+                    ...document.metadata,
+                    attributes: {
+                        ...document.metadata.attributes,
+                        ...gitMetadata,
+                        ...packageMetadata,
+                    },
+                },
+            };
+        }), 
+        // Apply custom attribute processor from config
+        map((document) => {
+            const attributeProcessor = indexConfig?.metadata?.attributeProcessor ||
+                ((attributes, _document) => attributes);
+            const attributes = attributeProcessor(document.metadata.attributes ?? {}, document);
+            return {
+                ...document,
+                metadata: {
+                    ...document.metadata,
+                    attributes,
+                },
+            };
+        }), 
+        // Group back by file for batch deletion in next step
+        toArray());
+    }));
+}
+//# sourceMappingURL=apply-metadata.js.map

package/dist/esm/bin/apply-metadata.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"apply-metadata.js","sourceRoot":"","sources":["../../../src/bin/apply-metadata.ts"],"names":[],"mappings":"AAAA,OAAO,IAAI,MAAM,WAAW,CAAC;AAC7B,OAAO,EAAE,IAAI,EAAE,QAAQ,EAAE,GAAG,EAAE,OAAO,EAAE,MAAM,MAAM,CAAC;AAGpD,OAAO,EAAE,kBAAkB,EAAE,MAAM,uBAAuB,CAAC;AAC3D,OAAO,EAAE,cAAc,EAAE,MAAM,8BAA8B,CAAC;AAI9D;;;GAGG;AACH,MAAM,UAAU,aAAa,CAC3B,SAAoC,EACpC,WAA6C;IAE7C,8BAA8B;IAC9B,MAAM,oBAAoB,GAAG,WAAW,EAAE,QAAQ,EAAE,cAAc,IAAI,KAAK,CAAC;IAE5E,OAAO,SAAS,CAAC,IAAI,CACnB,QAAQ,CAAC,CAAC,KAAK,EAAE,EAAE;QACjB,OAAO,IAAI,CAAC,KAAK,CAAC,SAAS,CAAC,CAAC,IAAI;QAC/B,sDAAsD;QACtD,QAAQ,CAAC,KAAK,EAAE,QAAQ,EAAgC,EAAE;YACxD,MAAM,QAAQ,GAAG,QAAQ,CAAC,QAAQ,CAAC,QAAQ,IAAI,OAAO,CAAC,GAAG,EAAE,CAAC;YAC7D,MAAM,UAAU,GAAG,IAAI,CAAC,IAAI,CAAC,QAAQ,EAAE,QAAQ,CAAC,QAAQ,CAAC,MAAM,CAAC,CAAC;YACjE,MAAM,WAAW,GACf,QAAQ,CAAC,QAAQ,CAAC,MAAM,IAAI,WAAW,EAAE,QAAQ,EAAE,UAAU,KAAK,KAAK;gBACrE,CAAC,CAAC,MAAM,kBAAkB,CAAC,UAAU,CAAC;gBACtC,CAAC,CAAC,EAAE,CAAC;YAET,yCAAyC;YACzC,IAAI,eAAe,GAAG,EAAE,CAAC;YACzB,IAAI,oBAAoB,IAAI,QAAQ,CAAC,QAAQ,CAAC,MAAM,EAAE,CAAC;gBACrD,eAAe,GAAG,MAAM,cAAc,CAAC,UAAU,CAAC;qBAC/C,IAAI,CAAC,CAAC,GAAG,EAAE,EAAE;oBACZ,OAAO;wBACL,QAAQ,EAAE,GAAG,EAAE,IAAI;wBACnB,WAAW,EAAE,GAAG,EAAE,OAAO;wBACzB,YAAY,EAAE,GAAG,EAAE,QAAQ;qBAC5B,CAAC;gBACJ,CAAC,CAAC;qBACD,KAAK,CAAC,GAAG,EAAE,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC;YACvB,CAAC;YACD,OAAO;gBACL,GAAG,QAAQ;gBACX,QAAQ,EAAE;oBACR,GAAG,QAAQ,CAAC,QAAQ;oBACpB,UAAU,EAAE;wBACV,GAAG,QAAQ,CAAC,QAAQ,CAAC,UAAU;wBAC/B,GAAG,WAAW;wBACd,GAAG,eAAe;qBACnB;iBACF;aACF,CAAC;QACJ,CAAC,CAAC;QACF,+CAA+C;QAC/C,GAAG,CAAC,CAAC,QAA6B,EAAE,EAAE;YACpC,MAAM,kBAAkB,GACtB,WAAW,EAAE,QAAQ,EAAE,kBAAkB;gBACzC,CAAC,CAAC,UAAmC,EAAE,SAA8B,EAAE,EAAE,CAAC,UAAU,CAAC,CAAC;YACxF,MAAM,UAAU,GAAG,kBAAkB,CAAC,QAAQ,CAAC,QAAQ,CAAC,UAAU,IAAI,EAAE,EAAE,QAAQ,CAAC,CAAC;YACpF,OAAO;gBACL,GAAG,QAAQ;gBACX,QAAQ,EAAE;oBACR,GAAG,QAAQ,CAAC,QAAQ;oBACpB,UAAU;iBACX;aACF,CAAC;QACJ,CAAC,CAAC;QACF,qDAAqD;QACrD,OAAO,EAAE,CACV,CAAC;IACJ,CAAC,CAAC,CACH,CAAC;AACJ,CAAC"}

package/dist/esm/bin/delete-removed-files.js

@@ -0,0 +1,36 @@
+import { map, mergeMap, toArray, filter } from 'rxjs';
+/**
+ * Creates a stream that deletes removed files from the vector store.
+ * @internal
+ */
+export function createDeleteRemovedFilesStream(removedFiles$, framework, options) {
+    return removedFiles$.pipe(toArray(), map((files) => {
+        if (files.length === 0) {
+            return { files: [], filterExpression: null };
+        }
+        // Build OData filter: "metadata/source eq 'path1' or metadata/source eq 'path2'"
+        const filterExpression = files
+            .map((file) => `metadata/source eq '${file.relativePath}'`)
+            .join(' or ');
+        return { files, filterExpression };
+    }), mergeMap(async ({ files, filterExpression }) => {
+        if (files.length === 0) {
+            return undefined;
+        }
+        for (const file of files) {
+            console.log('Removing entry from vector store', file.relativePath);
+        }
+        if (!options.dryRun) {
+            const vectorStoreService = framework.ai.getService('search', options.azureSearchIndexName);
+            // Single batch deletion - one file can produce multiple document chunks
+            await vectorStoreService.deleteDocuments({
+                filter: { filterExpression: filterExpression ?? undefined },
+            });
+        }
+        return {
+            status: 'deleted',
+            files: files,
+        };
+    }), filter((result) => Boolean(result)));
+}
+//# sourceMappingURL=delete-removed-files.js.map

package/dist/esm/bin/delete-removed-files.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"delete-removed-files.js","sourceRoot":"","sources":["../../../src/bin/delete-removed-files.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,GAAG,EAAE,QAAQ,EAAE,OAAO,EAAE,MAAM,EAAE,MAAM,MAAM,CAAC;AAMtD;;;GAGG;AACH,MAAM,UAAU,8BAA8B,CAC5C,aAAwC,EACxC,SAA4B,EAC5B,OAAuB;IAEvB,OAAO,aAAa,CAAC,IAAI,CACvB,OAAO,EAAE,EACT,GAAG,CAAC,CAAC,KAAK,EAAE,EAAE;QACZ,IAAI,KAAK,CAAC,MAAM,KAAK,CAAC,EAAE,CAAC;YACvB,OAAO,EAAE,KAAK,EAAE,EAAE,EAAE,gBAAgB,EAAE,IAAI,EAAE,CAAC;QAC/C,CAAC;QACD,iFAAiF;QACjF,MAAM,gBAAgB,GAAG,KAAK;aAC3B,GAAG,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,uBAAuB,IAAI,CAAC,YAAY,GAAG,CAAC;aAC1D,IAAI,CAAC,MAAM,CAAC,CAAC;QAChB,OAAO,EAAE,KAAK,EAAE,gBAAgB,EAAE,CAAC;IACrC,CAAC,CAAC,EACF,QAAQ,CAAC,KAAK,EAAE,EAAE,KAAK,EAAE,gBAAgB,EAAE,EAAE,EAAE;QAC7C,IAAI,KAAK,CAAC,MAAM,KAAK,CAAC,EAAE,CAAC;YACvB,OAAO,SAAS,CAAC;QACnB,CAAC;QACD,KAAK,MAAM,IAAI,IAAI,KAAK,EAAE,CAAC;YACzB,OAAO,CAAC,GAAG,CAAC,kCAAkC,EAAE,IAAI,CAAC,YAAY,CAAC,CAAC;QACrE,CAAC;QACD,IAAI,CAAC,OAAO,CAAC,MAAM,EAAE,CAAC;YACpB,MAAM,kBAAkB,GAAG,SAAS,CAAC,EAAE,CAAC,UAAU,CAAC,QAAQ,EAAE,OAAO,CAAC,oBAAoB,CAAC,CAAC;YAC3F,wEAAwE;YACxE,MAAM,kBAAkB,CAAC,eAAe,CAAC;gBACvC,MAAM,EAAE,EAAE,gBAAgB,EAAE,gBAAgB,IAAI,SAAS,EAAE;aAC5D,CAAC,CAAC;QACL,CAAC;QACD,OAAO;YACL,MAAM,EAAE,SAAS;YACjB,KAAK,EAAE,KAAmC;SAC3C,CAAC;IACJ,CAAC,CAAC,EACF,MAAM,CAAC,CAAC,MAAM,EAAsC,EAAE,CAAC,OAAO,CAAC,MAAM,CAAC,CAAC,CACxE,CAAC;AACJ,CAAC"}

package/dist/esm/bin/embed.js

@@ -0,0 +1,196 @@
+import { globbyStream } from 'globby';
+import { relative } from 'node:path';
+import multimatch from 'multimatch';
+import { concat, from, merge } from 'rxjs';
+import { concatMap, filter, map, mergeMap, shareReplay, toArray } from 'rxjs/operators';
+import { isMarkdownFile, parseMarkdownFile } from '../utils/markdown/index.js';
+import { getFileStatus, resolveProjectRoot } from '../utils/git/index.js';
+import { isTypescriptFile, parseTsDocFromFileSync } from '../utils/ts-doc/index.js';
+import { getDiff } from './get-diff.js';
+import { createDeleteRemovedFilesStream } from './delete-removed-files.js';
+import { applyMetadata } from './apply-metadata.js';
+import { readFileSync } from 'node:fs';
+import { generateChunkId } from '../utils/generate-chunk-id.js';
+/**
+ * Default directories to skip before expensive git operations.
+ * These are common build artifacts and dependencies that should be ignored.
+ * @internal
+ */
+const defaultIgnore = ['node_modules', '**/node_modules/**', 'dist', '**/dist/**', '.git'];
+/**
+ * Main entry point for the embeddings bin.
+ * Orchestrates the entire embeddings generation pipeline.
+ * @internal
+ */
+export async function embed(binOptions) {
+    const { framework, options, config, filePatterns } = binOptions;
+    // Handle clean operation (destructive - deletes all existing documents)
+    const vectorStoreService = framework.ai.getService('search', options.azureSearchIndexName);
+    if (options.clean && !options.dryRun) {
+        console.log('🧹 Cleaning vector store: deleting all existing documents...');
+        // OData filter: delete all documents with non-empty source (all indexed docs)
+        await vectorStoreService.deleteDocuments({
+            filter: { filterExpression: "metadata/source ne ''" },
+        });
+        console.log('✅ Vector store cleaned successfully');
+    }
+    // Handle diff-based processing (workflow mode)
+    const changedFiles = options.diff ? await getDiff(options) : [];
+    // Create file stream: diff mode uses git changes, normal mode uses globby
+    const files$ = (() => {
+        if (options.diff) {
+            return from(changedFiles);
+        }
+        // Directories to skip before expensive git operations.
+        // Note: Even with gitignore: true, globby still traverses ignored directories when .gitignore
+        // contains negation patterns (like !.yarn/releases), so we add explicit ignore patterns
+        // to prevent traversing these directories entirely.
+        const ignore = config.index?.ignore ?? defaultIgnore;
+        return from(globbyStream(filePatterns, {
+            ignore,
+            onlyFiles: true,
+            gitignore: true,
+            absolute: true,
+        })).pipe(
+        // Get git status concurrently, then flatten array results
+        mergeMap((path) => getFileStatus(path)), concatMap((files) => from(files)), 
+        // Share stream for multiple subscribers (removedFiles$ and indexFiles$)
+        shareReplay({ refCount: true }));
+    })();
+    // Process files: enrich with metadata and filter by allowed patterns
+    const allowedFilePatterns = config.index?.patterns ?? [
+        '**/*.ts',
+        '**/*.tsx',
+        '**/*.md',
+        '**/*.mdx',
+    ];
+    // Process files: enrich with metadata and filter by allowed patterns
+    const processedFiles$ = files$.pipe(map((file) => {
+        const { filepath, status } = file;
+        const projectRoot = resolveProjectRoot(filepath);
+        const relativePath = projectRoot ? relative(projectRoot, filepath) : filepath;
+        return {
+            path: filepath,
+            status,
+            projectRoot,
+            relativePath,
+        };
+    }), filter((file) => {
+        const matches = multimatch(file.relativePath, allowedFilePatterns);
+        return matches.length > 0;
+    }), 
+    // Share for multiple subscribers (removedFiles$, markdown$, typescript$)
+    shareReplay({ refCount: true }));
+    // Split stream: removed files for deletion, new/modified for indexing
+    const removedFiles$ = processedFiles$.pipe(filter((file) => file.status === 'removed'));
+    // Create processing streams
+    const delete$ = createDeleteRemovedFilesStream(removedFiles$, framework, options);
+    // New/modified files for indexing
+    const indexFiles$ = processedFiles$.pipe(filter((file) => file.status === 'new' || file.status === 'modified'), 
+    // Share for markdown$ and typescript$ pipelines
+    shareReplay({ refCount: true }));
+    const isRawFile = (file) => {
+        const matches = multimatch(file.relativePath, config.index?.rawPatterns ?? []);
+        if (matches.length > 0) {
+            return true;
+        }
+        return false;
+    };
+    const rawFiles$ = indexFiles$.pipe(filter(isRawFile), map((file) => {
+        const document = {
+            id: generateChunkId(file.relativePath),
+            pageContent: readFileSync(file.path, 'utf8'),
+            metadata: {
+                source: file.relativePath,
+                type: 'raw',
+            },
+        };
+        return { status: file.status, documents: [document] };
+    }));
+    const markdown$ = indexFiles$.pipe(filter((x) => !isRawFile(x)), filter((file) => isMarkdownFile(file.path)), mergeMap(async (file) => {
+        const documents = await parseMarkdownFile(file);
+        return { status: file.status, documents };
+    }));
+    const typescript$ = indexFiles$.pipe(filter((x) => !isRawFile(x)), filter((file) => isTypescriptFile(file.path)), map((file) => {
+        const documents = parseTsDocFromFileSync(file);
+        return { status: file.status, documents };
+    }));
+    // Apply metadata to documents
+    const applyMetadata$ = applyMetadata(merge(rawFiles$, markdown$, typescript$), config.index);
+    // Generate embeddings
+    const embeddingService = framework.ai.getService('embeddings', options.openaiEmbeddingDeployment);
+    const applyEmbedding$ = applyMetadata$.pipe(mergeMap((documents) => from(documents).pipe(mergeMap(async (document) => {
+        console.log('embedding document', document.metadata.source);
+        const embeddings = await embeddingService
+            .embedQuery(document.pageContent)
+            .catch((error) => {
+            console.error(`❌ Error: ${error instanceof Error ? error.message : 'Unknown error'}`);
+            console.error('document', document);
+            process.exit(1);
+        });
+        const metadata = { ...document.metadata, embedding: embeddings };
+        return { ...document, metadata };
+    }), toArray())));
+    // Update vector store
+    const upsert$ = applyEmbedding$.pipe(mergeMap(async (documents) => {
+        const vectorStoreService = framework.ai.getService('search', options.azureSearchIndexName);
+        if (documents.length === 0) {
+            return undefined;
+        }
+        for (const document of documents) {
+            console.log(`Adding entry [${document.id}] to vector store`, document.metadata.source);
+        }
+        if (!options.dryRun) {
+            // For multiple chunks from same file, delete existing chunks first
+            if (documents.length > 1) {
+                const sources = documents
+                    .map((document) => document.metadata.source)
+                    .reduce((acc, source) => acc.add(source), new Set());
+                const filterExpression = Array.from(sources)
+                    .map((source) => `metadata/source eq '${source}'`)
+                    .join(' or ');
+                // Fire-and-forget deletion (not awaited) - brief gap before new docs are indexed
+                vectorStoreService.deleteDocuments({ filter: { filterExpression } });
+            }
+            await vectorStoreService.addDocuments(documents);
+        }
+        return {
+            status: 'added',
+            documents,
+        };
+    }), filter((result) => Boolean(result)));
+    // Execute pipeline
+    // Track indexing results for reporting: deleted file paths and added document IDs
+    const indexingResults = {
+        deleted: [],
+        added: [],
+    };
+    // Execute pipeline: concat ensures deletions happen before additions
+    // This subscription triggers lazy RxJS execution and tracks all results
+    concat(delete$, upsert$).subscribe({
+        next: (result) => {
+            // Track deleted files by relative path
+            if (result.status === 'deleted') {
+                indexingResults.deleted.push(...result.files.map((file) => file.relativePath));
+            }
+            // Track added documents with source and ID (one file can produce multiple IDs)
+            else if (result.status === 'added') {
+                indexingResults.added.push(...result.documents.map((document) => ({
+                    source: document.metadata.source,
+                    id: document.id,
+                })));
+            }
+        },
+        error: (error) => {
+            console.error(`❌ Error: ${error instanceof Error ? error.message : 'Unknown error'}`);
+            process.exit(1);
+        },
+        complete: () => {
+            // Pipeline completed - log results and exit
+            console.log('🗂️ Indexing results:', indexingResults);
+            console.log('✅ Embeddings generation completed!');
+            process.exit(0);
+        },
+    });
+}
+//# sourceMappingURL=embed.js.map

package/dist/esm/bin/embed.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"embed.js","sourceRoot":"","sources":["../../../src/bin/embed.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,YAAY,EAAE,MAAM,QAAQ,CAAC;AACtC,OAAO,EAAE,QAAQ,EAAE,MAAM,WAAW,CAAC;AACrC,OAAO,UAAU,MAAM,YAAY,CAAC;AACpC,OAAO,EAAE,MAAM,EAAE,IAAI,EAAE,KAAK,EAAE,MAAM,MAAM,CAAC;AAC3C,OAAO,EAAE,SAAS,EAAE,MAAM,EAAE,GAAG,EAAE,QAAQ,EAAE,WAAW,EAAE,OAAO,EAAE,MAAM,gBAAgB,CAAC;AAExF,OAAO,EAAE,cAAc,EAAE,iBAAiB,EAAE,MAAM,4BAA4B,CAAC;AAC/E,OAAO,EAAE,aAAa,EAAE,kBAAkB,EAAE,MAAM,uBAAuB,CAAC;AAC1E,OAAO,EAAE,gBAAgB,EAAE,sBAAsB,EAAE,MAAM,0BAA0B,CAAC;AAEpF,OAAO,EAAE,OAAO,EAAE,MAAM,eAAe,CAAC;AACxC,OAAO,EAAE,8BAA8B,EAAE,MAAM,2BAA2B,CAAC;AAC3E,OAAO,EAAE,aAAa,EAAE,MAAM,qBAAqB,CAAC;AAQpD,OAAO,EAAE,YAAY,EAAE,MAAM,SAAS,CAAC;AACvC,OAAO,EAAE,eAAe,EAAE,MAAM,+BAA+B,CAAC;AAEhE;;;;GAIG;AACH,MAAM,aAAa,GAAG,CAAC,cAAc,EAAE,oBAAoB,EAAE,MAAM,EAAE,YAAY,EAAE,MAAM,CAAC,CAAC;AAE3F;;;;GAIG;AACH,MAAM,CAAC,KAAK,UAAU,KAAK,CAAC,UAAgC;IAC1D,MAAM,EAAE,SAAS,EAAE,OAAO,EAAE,MAAM,EAAE,YAAY,EAAE,GAAG,UAAU,CAAC;IAEhE,wEAAwE;IACxE,MAAM,kBAAkB,GAAG,SAAS,CAAC,EAAE,CAAC,UAAU,CAAC,QAAQ,EAAE,OAAO,CAAC,oBAAoB,CAAC,CAAC;IAC3F,IAAI,OAAO,CAAC,KAAK,IAAI,CAAC,OAAO,CAAC,MAAM,EAAE,CAAC;QACrC,OAAO,CAAC,GAAG,CAAC,8DAA8D,CAAC,CAAC;QAC5E,8EAA8E;QAC9E,MAAM,kBAAkB,CAAC,eAAe,CAAC;YACvC,MAAM,EAAE,EAAE,gBAAgB,EAAE,uBAAuB,EAAE;SACtD,CAAC,CAAC;QACH,OAAO,CAAC,GAAG,CAAC,qCAAqC,CAAC,CAAC;IACrD,CAAC;IAED,+CAA+C;IAC/C,MAAM,YAAY,GAAG,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,MAAM,OAAO,CAAC,OAAO,CAAC,CAAC,CAAC,CAAC,EAAE,CAAC;IAEhE,0EAA0E;IAC1E,MAAM,MAAM,GAAG,CAAC,GAAG,EAAE;QACnB,IAAI,OAAO,CAAC,IAAI,EAAE,CAAC;YACjB,OAAO,IAAI,CAAC,YAAY,CAAC,CAAC;QAC5B,CAAC;QAED,uDAAuD;QACvD,8FAA8F;QAC9F,wFAAwF;QACxF,oDAAoD;QACpD,MAAM,MAAM,GAAG,MAAM,CAAC,KAAK,EAAE,MAAM,IAAI,aAAa,CAAC;QAErD,OAAO,IAAI,CACT,YAAY,CAAC,YAAY,EAAE;YACzB,MAAM;YACN,SAAS,EAAE,IAAI;YACf,SAAS,EAAE,IAAI;YACf,QAAQ,EAAE,IAAI;SACf,CAAC,CACH,CAAC,IAAI;QACJ,0DAA0D;QAC1D,QAAQ,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,aAAa,CAAC,IAAI,CAAC,CAAC,EACvC,SAAS,CAAC,CAAC,KAAK,EAAE,EAAE,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC;QACjC,wEAAwE;QACxE,WAAW,CAAC,EAAE,QAAQ,EAAE,IAAI,EAAE,CAAC,CAChC,CAAC;IACJ,CAAC,CAAC,EAAE,CAAC;IAEL,qEAAqE;IACrE,MAAM,mBAAmB,GAAG,MAAM,CAAC,KAAK,EAAE,QAAQ,IAAI;QACpD,SAAS;QACT,UAAU;QACV,SAAS;QACT,UAAU;KACX,CAAC;IAEF,qEAAqE;IACrE,MAAM,eAAe,GAAG,MAAM,CAAC,IAAI,CACjC,GAAG,CAAC,CAAC,IAAI,EAAE,EAAE;QACX,MAAM,EAAE,QAAQ,EAAE,MAAM,EAAE,GAAG,IAAI,CAAC;QAClC,MAAM,WAAW,GAAG,kBAAkB,CAAC,QAAQ,CAAC,CAAC;QACjD,MAAM,YAAY,GAAG,WAAW,CAAC,CAAC,CAAC,QAAQ,CAAC,WAAW,EAAE,QAAQ,CAAC,CAAC,CAAC,CAAC,QAAQ,CAAC;QAE9E,OAAO;YACL,IAAI,EAAE,QAAQ;YACd,MAAM;YACN,WAAW;YACX,YAAY;SACb,CAAC;IACJ,CAAC,CAAC,EACF,MAAM,CAAC,CAAC,IAAI,EAAE,EAAE;QACd,MAAM,OAAO,GAAG,UAAU,CAAC,IAAI,CAAC,YAAY,EAAE,mBAAmB,CAAC,CAAC;QACnE,OAAO,OAAO,CAAC,MAAM,GAAG,CAAC,CAAC;IAC5B,CAAC,CAAC;IACF,yEAAyE;IACzE,WAAW,CAAC,EAAE,QAAQ,EAAE,IAAI,EAAE,CAAC,CAChC,CAAC;IAEF,sEAAsE;IACtE,MAAM,aAAa,GAAG,eAAe,CAAC,IAAI,CAAC,MAAM,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,IAAI,CAAC,MAAM,KAAK,SAAS,CAAC,CAAC,CAAC;IAExF,4BAA4B;IAC5B,MAAM,OAAO,GAAG,8BAA8B,CAAC,aAAa,EAAE,SAAS,EAAE,OAAO,CAAC,CAAC;IAElF,kCAAkC;IAClC,MAAM,WAAW,GAAG,eAAe,CAAC,IAAI,CACtC,MAAM,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,IAAI,CAAC,MAAM,KAAK,KAAK,IAAI,IAAI,CAAC,MAAM,KAAK,UAAU,CAAC;IACrE,gDAAgD;IAChD,WAAW,CAAC,EAAE,QAAQ,EAAE,IAAI,EAAE,CAAC,CAChC,CAAC;IAEF,MAAM,SAAS,GAAG,CAAC,IAAmB,EAAW,EAAE;QACjD,MAAM,OAAO,GAAG,UAAU,CAAC,IAAI,CAAC,YAAY,EAAE,MAAM,CAAC,KAAK,EAAE,WAAW,IAAI,EAAE,CAAC,CAAC;QAC/E,IAAI,OAAO,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;YACvB,OAAO,IAAI,CAAC;QACd,CAAC;QACD,OAAO,KAAK,CAAC;IACf,CAAC,CAAC;IAEF,MAAM,SAAS,GAAG,WAAW,CAAC,IAAI,CAChC,MAAM,CAAC,SAAS,CAAC,EACjB,GAAG,CAAC,CAAC,IAAI,EAAiB,EAAE;QAC1B,MAAM,QAAQ,GAAwB;YACpC,EAAE,EAAE,eAAe,CAAC,IAAI,CAAC,YAAY,CAAC;YACtC,WAAW,EAAE,YAAY,CAAC,IAAI,CAAC,IAAI,EAAE,MAAM,CAAC;YAC5C,QAAQ,EAAE;gBACR,MAAM,EAAE,IAAI,CAAC,YAAY;gBACzB,IAAI,EAAE,KAAK;aACZ;SACF,CAAC;QACF,OAAO,EAAE,MAAM,EAAE,IAAI,CAAC,MAAM,EAAE,SAAS,EAAE,CAAC,QAAQ,CAAC,EAAE,CAAC;IACxD,CAAC,CAAC,CACH,CAAC;IAEF,MAAM,SAAS,GAAG,WAAW,CAAC,IAAI,CAChC,MAAM,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,SAAS,CAAC,CAAC,CAAC,CAAC,EAC5B,MAAM,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,cAAc,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC,EAC3C,QAAQ,CAAC,KAAK,EAAE,IAAI,EAAE,EAAE;QACtB,MAAM,SAAS,GAAG,MAAM,iBAAiB,CAAC,IAAI,CAAC,CAAC;QAChD,OAAO,EAAE,MAAM,EAAE,IAAI,CAAC,MAAM,EAAE,SAAS,EAAE,CAAC;IAC5C,CAAC,CAAC,CACH,CAAC;IAEF,MAAM,WAAW,GAAG,WAAW,CAAC,IAAI,CAClC,MAAM,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,SAAS,CAAC,CAAC,CAAC,CAAC,EAC5B,MAAM,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,gBAAgB,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC,EAC7C,GAAG,CAAC,CAAC,IAAI,EAAE,EAAE;QACX,MAAM,SAAS,GAAG,sBAAsB,CAAC,IAAI,CAAC,CAAC;QAC/C,OAAO,EAAE,MAAM,EAAE,IAAI,CAAC,MAAM,EAAE,SAAS,EAAE,CAAC;IAC5C,CAAC,CAAC,CACH,CAAC;IAEF,8BAA8B;IAC9B,MAAM,cAAc,GAAG,aAAa,CAAC,KAAK,CAAC,SAAS,EAAE,SAAS,EAAE,WAAW,CAAC,EAAE,MAAM,CAAC,KAAK,CAAC,CAAC;IAE7F,sBAAsB;IACtB,MAAM,gBAAgB,GAAG,SAAS,CAAC,EAAE,CAAC,UAAU,CAAC,YAAY,EAAE,OAAO,CAAC,yBAAyB,CAAC,CAAC;IAClG,MAAM,eAAe,GAAG,cAAc,CAAC,IAAI,CACzC,QAAQ,CAAC,CAAC,SAAS,EAAE,EAAE,CACrB,IAAI,CAAC,SAAS,CAAC,CAAC,IAAI,CAClB,QAAQ,CAAC,KAAK,EAAE,QAAQ,EAAE,EAAE;QAC1B,OAAO,CAAC,GAAG,CAAC,oBAAoB,EAAE,QAAQ,CAAC,QAAQ,CAAC,MAAM,CAAC,CAAC;QAC5D,MAAM,UAAU,GAAG,MAAM,gBAAgB;aACtC,UAAU,CAAC,QAAQ,CAAC,WAAW,CAAC;aAChC,KAAK,CAAC,CAAC,KAAK,EAAE,EAAE;YACf,OAAO,CAAC,KAAK,CACX,YAAY,KAAK,YAAY,KAAK,CAAC,CAAC,CAAC,KAAK,CAAC,OAAO,CAAC,CAAC,CAAC,eAAe,EAAE,CACvE,CAAC;YACF,OAAO,CAAC,KAAK,CAAC,UAAU,EAAE,QAAQ,CAAC,CAAC;YACpC,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;QAClB,CAAC,CAAC,CAAC;QACL,MAAM,QAAQ,GAAG,EAAE,GAAG,QAAQ,CAAC,QAAQ,EAAE,SAAS,EAAE,UAAU,EAAE,CAAC;QACjE,OAAO,EAAE,GAAG,QAAQ,EAAE,QAAQ,EAAE,CAAC;IACnC,CAAC,CAAC,EACF,OAAO,EAAE,CACV,CACF,CACF,CAAC;IAEF,sBAAsB;IACtB,MAAM,OAAO,GAAG,eAAe,CAAC,IAAI,CAClC,QAAQ,CAAC,KAAK,EAAE,SAAS,EAAE,EAAE;QAC3B,MAAM,kBAAkB,GAAG,SAAS,CAAC,EAAE,CAAC,UAAU,CAAC,QAAQ,EAAE,OAAO,CAAC,oBAAoB,CAAC,CAAC;QAC3F,IAAI,SAAS,CAAC,MAAM,KAAK,CAAC,EAAE,CAAC;YAC3B,OAAO,SAAS,CAAC;QACnB,CAAC;QACD,KAAK,MAAM,QAAQ,IAAI,SAAS,EAAE,CAAC;YACjC,OAAO,CAAC,GAAG,CAAC,iBAAiB,QAAQ,CAAC,EAAE,mBAAmB,EAAE,QAAQ,CAAC,QAAQ,CAAC,MAAM,CAAC,CAAC;QACzF,CAAC;QACD,IAAI,CAAC,OAAO,CAAC,MAAM,EAAE,CAAC;YACpB,mEAAmE;YACnE,IAAI,SAAS,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;gBACzB,MAAM,OAAO,GAAG,SAAS;qBACtB,GAAG,CAAC,CAAC,QAAQ,EAAE,EAAE,CAAC,QAAQ,CAAC,QAAQ,CAAC,MAAM,CAAC;qBAC3C,MAAM,CAAC,CAAC,GAAG,EAAE,MAAM,EAAE,EAAE,CAAC,GAAG,CAAC,GAAG,CAAC,MAAM,CAAC,EAAE,IAAI,GAAG,EAAU,CAAC,CAAC;gBAE/D,MAAM,gBAAgB,GAAG,KAAK,CAAC,IAAI,CAAC,OAAO,CAAC;qBACzC,GAAG,CAAC,CAAC,MAAM,EAAE,EAAE,CAAC,uBAAuB,MAAM,GAAG,CAAC;qBACjD,IAAI,CAAC,MAAM,CAAC,CAAC;gBAEhB,iFAAiF;gBACjF,kBAAkB,CAAC,eAAe,CAAC,EAAE,MAAM,EAAE,EAAE,gBAAgB,EAAE,EAAE,CAAC,CAAC;YACvE,CAAC;YACD,MAAM,kBAAkB,CAAC,YAAY,CAAC,SAAS,CAAC,CAAC;QACnD,CAAC;QACD,OAAO;YACL,MAAM,EAAE,OAAO;YACf,SAAS;SACiB,CAAC;IAC/B,CAAC,CAAC,EACF,MAAM,CAAC,CAAC,MAAM,EAAqC,EAAE,CAAC,OAAO,CAAC,MAAM,CAAC,CAAC,CACvE,CAAC;IAEF,mBAAmB;IACnB,kFAAkF;IAClF,MAAM,eAAe,GAAmE;QACtF,OAAO,EAAE,EAAE;QACX,KAAK,EAAE,EAAE;KACV,CAAC;IAEF,qEAAqE;IACrE,wEAAwE;IACxE,MAAM,CAAC,OAAO,EAAE,OAAO,CAAC,CAAC,SAAS,CAAC;QACjC,IAAI,EAAE,CAAC,MAAM,EAAE,EAAE;YACf,uCAAuC;YACvC,IAAI,MAAM,CAAC,MAAM,KAAK,SAAS,EAAE,CAAC;gBAChC,eAAe,CAAC,OAAO,CAAC,IAAI,CAAC,GAAG,MAAM,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,IAAI,CAAC,YAAY,CAAC,CAAC,CAAC;YACjF,CAAC;YACD,+EAA+E;iBAC1E,IAAI,MAAM,CAAC,MAAM,KAAK,OAAO,EAAE,CAAC;gBACnC,eAAe,CAAC,KAAK,CAAC,IAAI,CACxB,GAAG,MAAM,CAAC,SAAS,CAAC,GAAG,CAAC,CAAC,QAAQ,EAAE,EAAE,CAAC,CAAC;oBACrC,MAAM,EAAE,QAAQ,CAAC,QAAQ,CAAC,MAAM;oBAChC,EAAE,EAAE,QAAQ,CAAC,EAAE;iBAChB,CAAC,CAAC,CACJ,CAAC;YACJ,CAAC;QACH,CAAC;QACD,KAAK,EAAE,CAAC,KAAK,EAAE,EAAE;YACf,OAAO,CAAC,KAAK,CAAC,YAAY,KAAK,YAAY,KAAK,CAAC,CAAC,CAAC,KAAK,CAAC,OAAO,CAAC,CAAC,CAAC,eAAe,EAAE,CAAC,CAAC;YACtF,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;QAClB,CAAC;QACD,QAAQ,EAAE,GAAG,EAAE;YACb,4CAA4C;YAC5C,OAAO,CAAC,GAAG,CAAC,uBAAuB,EAAE,eAAe,CAAC,CAAC;YACtD,OAAO,CAAC,GAAG,CAAC,oCAAoC,CAAC,CAAC;YAClD,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;QAClB,CAAC;KACF,CAAC,CAAC;AACL,CAAC"}

package/dist/esm/bin/execute-pipeline.js

@@ -0,0 +1,40 @@
+import { concat } from 'rxjs';
+/**
+ * Executes the pipeline and tracks results.
+ * @internal
+ */
+export function executePipeline(deleteRemovedFiles$, updateVectorStore$) {
+    // Track indexing results for reporting: deleted file paths and added document IDs
+    const indexingResults = {
+        deleted: [],
+        added: [],
+    };
+    // Execute pipeline: concat ensures deletions happen before additions
+    // This subscription triggers lazy RxJS execution and tracks all results
+    concat(deleteRemovedFiles$, updateVectorStore$).subscribe({
+        next: (result) => {
+            // Track deleted files by relative path
+            if (result.status === 'deleted') {
+                indexingResults.deleted.push(...result.files.map((file) => file.relativePath));
+            }
+            // Track added documents with source and ID (one file can produce multiple IDs)
+            else if (result.status === 'added') {
+                indexingResults.added.push(...result.documents.map((document) => ({
+                    source: document.metadata.source,
+                    id: document.id,
+                })));
+            }
+        },
+        error: (error) => {
+            console.error(`❌ Error: ${error instanceof Error ? error.message : 'Unknown error'}`);
+            process.exit(1);
+        },
+        complete: () => {
+            // Pipeline completed - log results and exit
+            console.log('🗂️ Indexing results:', indexingResults);
+            console.log('✅ Embeddings generation completed!');
+            process.exit(0);
+        },
+    });
+}
+//# sourceMappingURL=execute-pipeline.js.map

package/dist/esm/bin/execute-pipeline.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"execute-pipeline.js","sourceRoot":"","sources":["../../../src/bin/execute-pipeline.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,MAAM,EAAE,MAAM,MAAM,CAAC;AAI9B;;;GAGG;AACH,MAAM,UAAU,eAAe,CAC7B,mBAAyD,EACzD,kBAAuD;IAEvD,kFAAkF;IAClF,MAAM,eAAe,GAAmE;QACtF,OAAO,EAAE,EAAE;QACX,KAAK,EAAE,EAAE;KACV,CAAC;IAEF,qEAAqE;IACrE,wEAAwE;IACxE,MAAM,CAAC,mBAAmB,EAAE,kBAAkB,CAAC,CAAC,SAAS,CAAC;QACxD,IAAI,EAAE,CAAC,MAAM,EAAE,EAAE;YACf,uCAAuC;YACvC,IAAI,MAAM,CAAC,MAAM,KAAK,SAAS,EAAE,CAAC;gBAChC,eAAe,CAAC,OAAO,CAAC,IAAI,CAAC,GAAG,MAAM,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,IAAI,CAAC,YAAY,CAAC,CAAC,CAAC;YACjF,CAAC;YACD,+EAA+E;iBAC1E,IAAI,MAAM,CAAC,MAAM,KAAK,OAAO,EAAE,CAAC;gBACnC,eAAe,CAAC,KAAK,CAAC,IAAI,CACxB,GAAG,MAAM,CAAC,SAAS,CAAC,GAAG,CAAC,CAAC,QAAQ,EAAE,EAAE,CAAC,CAAC;oBACrC,MAAM,EAAE,QAAQ,CAAC,QAAQ,CAAC,MAAM;oBAChC,EAAE,EAAE,QAAQ,CAAC,EAAE;iBAChB,CAAC,CAAC,CACJ,CAAC;YACJ,CAAC;QACH,CAAC;QACD,KAAK,EAAE,CAAC,KAAK,EAAE,EAAE;YACf,OAAO,CAAC,KAAK,CAAC,YAAY,KAAK,YAAY,KAAK,CAAC,CAAC,CAAC,KAAK,CAAC,OAAO,CAAC,CAAC,CAAC,eAAe,EAAE,CAAC,CAAC;YACtF,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;QAClB,CAAC;QACD,QAAQ,EAAE,GAAG,EAAE;YACb,4CAA4C;YAC5C,OAAO,CAAC,GAAG,CAAC,uBAAuB,EAAE,eAAe,CAAC,CAAC;YACtD,OAAO,CAAC,GAAG,CAAC,oCAAoC,CAAC,CAAC;YAClD,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;QAClB,CAAC;KACF,CAAC,CAAC;AACL,CAAC"}

package/dist/esm/bin/file-stream.js

@@ -0,0 +1,22 @@
+import { globbyStream } from 'globby';
+import { from, mergeMap, concatMap, shareReplay } from 'rxjs';
+import { getFileStatus } from '../utils/git/index.js';
+/**
+ * Creates a file stream based on diff mode or glob patterns.
+ * @internal
+ */
+export function createFileStream(options, changedFiles, filePatterns) {
+    if (options.diff) {
+        return from(changedFiles);
+    }
+    return from(globbyStream(filePatterns, {
+        onlyFiles: true,
+        gitignore: true,
+        absolute: true,
+    })).pipe(
+    // Get git status concurrently, then flatten array results
+    mergeMap((path) => getFileStatus(path)), concatMap((files) => from(files)), 
+    // Share stream for multiple subscribers (removedFiles$ and indexFiles$)
+    shareReplay({ refCount: true }));
+}
+//# sourceMappingURL=file-stream.js.map

package/dist/esm/bin/file-stream.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"file-stream.js","sourceRoot":"","sources":["../../../src/bin/file-stream.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,YAAY,EAAE,MAAM,QAAQ,CAAC;AACtC,OAAO,EAAE,IAAI,EAAE,QAAQ,EAAE,SAAS,EAAE,WAAW,EAAE,MAAM,MAAM,CAAC;AAE9D,OAAO,EAAE,aAAa,EAAE,MAAM,uBAAuB,CAAC;AAItD;;;GAGG;AACH,MAAM,UAAU,gBAAgB,CAC9B,OAAuB,EACvB,YAA2B,EAC3B,YAAsB;IAEtB,IAAI,OAAO,CAAC,IAAI,EAAE,CAAC;QACjB,OAAO,IAAI,CAAC,YAAY,CAAC,CAAC;IAC5B,CAAC;IAED,OAAO,IAAI,CACT,YAAY,CAAC,YAAY,EAAE;QACzB,SAAS,EAAE,IAAI;QACf,SAAS,EAAE,IAAI;QACf,QAAQ,EAAE,IAAI;KACf,CAAC,CACH,CAAC,IAAI;IACJ,0DAA0D;IAC1D,QAAQ,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,aAAa,CAAC,IAAI,CAAC,CAAC,EACvC,SAAS,CAAC,CAAC,KAAK,EAAE,EAAE,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC;IACjC,wEAAwE;IACxE,WAAW,CAAC,EAAE,QAAQ,EAAE,IAAI,EAAE,CAAC,CAChC,CAAC;AACJ,CAAC"}

package/dist/esm/bin/get-diff.js

@@ -0,0 +1,29 @@
+import { getChangedFiles, getGitStatus } from '../utils/git/index.js';
+/**
+ * Handles diff-based processing to get changed files from git.
+ * @internal
+ */
+export async function getDiff(options) {
+    try {
+        // Get current git status for informational output
+        const gitStatus = await getGitStatus();
+        console.log(`🔍 Git status: ${gitStatus.branch}@${gitStatus.commit}`);
+        console.log(`📊 Changes: ${gitStatus.stagedFiles} staged, ${gitStatus.unstagedFiles} unstaged`);
+        // Get changed files compared to base reference (default: HEAD~1)
+        const changedFiles = await getChangedFiles({
+            diff: options.diff,
+            baseRef: options.baseRef,
+        });
+        if (changedFiles.length === 0) {
+            console.log('✅ No changed files match the provided patterns. Nothing to process.');
+            process.exit(0);
+        }
+        console.log(`📝 Found ${changedFiles.length} changed files matching patterns`);
+        return changedFiles;
+    }
+    catch (error) {
+        console.error(`❌ Git diff error: ${error instanceof Error ? error.message : 'Unknown error'}`);
+        process.exit(1);
+    }
+}
+//# sourceMappingURL=get-diff.js.map

package/dist/esm/bin/get-diff.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"get-diff.js","sourceRoot":"","sources":["../../../src/bin/get-diff.ts"],"names":[],"mappings":"AACA,OAAO,EAAE,eAAe,EAAE,YAAY,EAAE,MAAM,uBAAuB,CAAC;AAGtE;;;GAGG;AACH,MAAM,CAAC,KAAK,UAAU,OAAO,CAAC,OAAuB;IACnD,IAAI,CAAC;QACH,kDAAkD;QAClD,MAAM,SAAS,GAAG,MAAM,YAAY,EAAE,CAAC;QACvC,OAAO,CAAC,GAAG,CAAC,kBAAkB,SAAS,CAAC,MAAM,IAAI,SAAS,CAAC,MAAM,EAAE,CAAC,CAAC;QACtE,OAAO,CAAC,GAAG,CAAC,eAAe,SAAS,CAAC,WAAW,YAAY,SAAS,CAAC,aAAa,WAAW,CAAC,CAAC;QAEhG,iEAAiE;QACjE,MAAM,YAAY,GAAG,MAAM,eAAe,CAAC;YACzC,IAAI,EAAE,OAAO,CAAC,IAAI;YAClB,OAAO,EAAE,OAAO,CAAC,OAAO;SACzB,CAAC,CAAC;QAEH,IAAI,YAAY,CAAC,MAAM,KAAK,CAAC,EAAE,CAAC;YAC9B,OAAO,CAAC,GAAG,CAAC,qEAAqE,CAAC,CAAC;YACnF,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;QAClB,CAAC;QAED,OAAO,CAAC,GAAG,CAAC,YAAY,YAAY,CAAC,MAAM,kCAAkC,CAAC,CAAC;QAC/E,OAAO,YAAY,CAAC;IACtB,CAAC;IAAC,OAAO,KAAK,EAAE,CAAC;QACf,OAAO,CAAC,KAAK,CAAC,qBAAqB,KAAK,YAAY,KAAK,CAAC,CAAC,CAAC,KAAK,CAAC,OAAO,CAAC,CAAC,CAAC,eAAe,EAAE,CAAC,CAAC;QAC/F,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;IAClB,CAAC;AACH,CAAC"}

package/dist/esm/bin/index.js

@@ -0,0 +1,2 @@
+export { embed } from './embed.js';
+//# sourceMappingURL=index.js.map

package/dist/esm/bin/index.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"index.js","sourceRoot":"","sources":["../../../src/bin/index.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,KAAK,EAAE,MAAM,YAAY,CAAC"}

package/dist/esm/bin/types.js

@@ -0,0 +1,2 @@
+export {};
+//# sourceMappingURL=types.js.map

package/dist/esm/bin/types.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"types.js","sourceRoot":"","sources":["../../../src/bin/types.ts"],"names":[],"mappings":""}