@modular-prompt/extract 0.2.0

package/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2025 otolab
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

package/README.md

@@ -0,0 +1,300 @@
+# @modular-prompt/extract
+
+同一 corpus（文書・対話ログ）に対して、**複数の切り口（cue）で繰り返し情報抽出**するセッション API。
+
+KV キャッシュを活用し、corpus を一度 prefill したあと `cue` と `inputs` だけを差し替えて抽出を繰り返す。RAG に近いが、検索インデックスではなくプロンプトキャッシュを伸ばしながら文書全体をコンテキストに保持するパターン向け。
+
+## インストール
+
+```bash
+npm install @modular-prompt/extract @modular-prompt/driver
+```
+
+ワークスペース内では `@modular-prompt/core` / `@modular-prompt/driver` が依存として解決される。
+
+## 概要
+
+```
+base (+ domain) + corpus (materials / messages) + request (inputs) ← cue
+```
+
+| レイヤ | 指定タイミング | 役割 |
+|--------|--------------|------|
+| **base** | セッション生成 | 抽出タスクの基本方針（省略時は `defaultExtractBaseModule`） |
+| **domain** | セッション生成 | 用語定義・追加指示（`domainModule` で overlay） |
+| **corpus** | セッション生成 | 固定の抽出対象（`materials` / `messages`） |
+| **inputs** | 各 `extract()` | 補強情報（前回結果・フィルタ条件など） |
+| **cue** | 各 `extract()` | 今回の出力切り口 |
+
+### 入力の考え方
+
+呼び出し側は Element を直接組み立てない。**スロットごとの最小入力**を渡すと、フレームワークが `MaterialElement` / `MessageElement` / `ChunkElement` に正規化する。
+
+| スロット | 最小入力 | 例 |
+|---------|---------|-----|
+| `materials` | `{ title, content, id? }` | `{ title: '議事録', content: '...' }` |
+| `messages` | `{ role, content, ... }` | `{ role: 'user', content: '要約して' }` |
+| `inputs` | `string` または `{ content, ... }` | `'補助テキスト'` / `inputChunk(...)` |
+| `cue` | `string` | `'登場人物を列挙'` |
+
+`type`・`cacheHint`・`partOf` は正規化層が付与する。呼び出し側で指定する必要はない。
+
+## クイックスタート（MLX）
+
+### CLI
+
+ビルド後、ワークスペース内では次のように実行できる。
+
+```bash
+pnpm --filter @modular-prompt/extract build
+
+# 1. 入力ファイルからキャッシュ作成（デフォルト: ./.extract-cache）
+node packages/extract/bin/modular-extract.js create -m 'your-mlx-model' docs/*.txt
+
+# 2. 抽出クエリ（cue）を実行 — 結果は stdout
+node packages/extract/bin/modular-extract.js extract -d .extract-cache '登場人物を列挙'
+
+# キャッシュ削除
+rm -rf .extract-cache
+```
+
+| コマンド | 説明 |
+|---------|------|
+| `create [-d <dir>] [-m model] [files...]` | corpus を読み込み KV cache を準備。`manifest.json` を dir に保存 |
+| `extract -d <dir> [query...]` | キャッシュ済み corpus に対して抽出。query が cue になる |
+| `extract --max-tokens <n>` | 最大生成トークン数（デフォルト: 8000） |
+| `--dry-run` | MLX を起動せず、compile 済みプロンプト全文を stdout に出力 |
+
+```bash
+# プロンプト確認（create）
+modular-extract create --dry-run docs/notes.txt
+
+# プロンプト確認（extract — manifest が必要）
+modular-extract extract --dry-run -d .extract-cache '登場人物を列挙'
+```
+
+`-d` 省略時のデフォルトは `./.extract-cache`。`-m` 省略時は `MLX_MODEL` 環境変数、未設定ならパッケージ既定モデル。
+
+**MLX バックエンドは mlx-lm（`backend: 'lm'`）に固定**している。`auto` で VLM が選ばれるとプロンプトキャッシュが無効になるため。
+
+### ライブラリ API
+
+```typescript
+import {
+  createExtractSession,
+  createMlxExtractRuntime,
+} from '@modular-prompt/extract';
+
+const runtime = await createMlxExtractRuntime({
+  model: 'prism-ml/Ternary-Bonsai-1.7B-mlx-2bit',
+});
+
+try {
+  const session = createExtractSession({
+    driver: runtime.driver,
+    cacheController: runtime.cacheController,
+    model: runtime.model,
+    corpus: {
+      materials: [{
+        title: 'Meeting Notes',
+        content: 'Alice met Bob in Paris to discuss the modular-prompt project.',
+      }],
+    },
+  });
+
+  const people = await session.extract({ cue: 'List people mentioned' });
+  const places = await session.extract({ cue: 'List cities mentioned' });
+
+  console.log(people.text);
+  console.log(places.text);
+  // 2 回目以降: places.usage?.cacheReadTokens > 0 が期待できる
+
+  await session.close();
+} finally {
+  await runtime.close();
+}
+```
+
+## キャッシュの意図と制約
+
+### 削除タイミング
+
+| タイミング | 何が起きるか |
+|-----------|-------------|
+| `session.close()`（デフォルト） | handle を `release` マーク → 次の `runtime.close()` で **KV ファイル削除** |
+| `session.close({ releaseCache: false })` | release しない → **KV ファイルは disk に残る**（CLI はこちら） |
+| `runtime.close()`（固定 cacheDir） | `release` 済みエントリの `.safetensors` を削除 |
+| `runtime.close()`（一時 cacheDir） | **ディレクトリごと削除** |
+| `rm -rf <cache-dir>` | manifest + KV キャッシュを手動削除（CLI のクリーン方法） |
+
+`create` 直後に `manifest.json` だけ残って `.safetensors` が無い場合、以前のバージョンでは `session.close()` が release していたのが原因。CLI は `releaseCache: false` で修正済み。
+
+### 意図
+
+- **corpus（materials / messages）** はセッション内で不変 → 1 回 prefill すれば再利用
+- **inputs** は呼び出しごとに増える → incremental prefill でキャッシュを伸ばす
+- **cue** は毎回変わる → output セクションのためキャッシュ対象外
+
+### 制約
+
+| 変更内容 | 対応 |
+|---------|------|
+| `corpus` を変えたい | **新しいセッション**を作る |
+| `baseModule` を変えたい | **新しいセッション**を作る |
+| 前回の抽出結果を参照したい | 次の `extract()` の `inputs` に明示的に渡す（自動累積しない） |
+| driver / cacheController の終了 | 呼び出し側の責務（`runtime.close()` 等） |
+| セッション終了 | `session.close()` — デフォルトで handle `release()`。固定 cacheDir を残す場合は `{ releaseCache: false }` |
+
+`cacheController` と `model` は **必須**。キャッシュ非対応モードは提供しない。
+
+詳細は [プロンプトキャッシュ設計](../../docs/CACHE_DESIGN.md) および [API 仕様](./API.md) を参照。
+
+## サンプル
+
+`examples/` に実行可能なサンプルを同梱している。
+
+| ファイル | 内容 |
+|---------|------|
+| [document-extraction.ts](./examples/document-extraction.ts) | 文書（materials）+ 複数 cue |
+| [dialogue-extraction.ts](./examples/dialogue-extraction.ts) | 対話ログ（messages）+ 資料 |
+| [progressive-deep-dive.ts](./examples/progressive-deep-dive.ts) | inputs 積み上げ + キャッシュ活用 |
+
+### 文書抽出（materials + 複数 cue）
+
+```typescript
+import { createExtractSession, createMlxExtractRuntime } from '@modular-prompt/extract';
+
+const runtime = await createMlxExtractRuntime({ model: 'your-mlx-model' });
+
+const session = createExtractSession({
+  driver: runtime.driver,
+  cacheController: runtime.cacheController,
+  model: runtime.model,
+  corpus: {
+    materials: [
+      { title: '契約書 v3', content: '...' },
+      { title: '別紙 料金表', content: '...' },
+    ],
+  },
+});
+
+await session.extract({ cue: '契約期間と更新条件を抽出' });
+await session.extract({ cue: '料金体系と支払条件を抽出' });
+await session.close();
+await runtime.close();
+```
+
+### 対話ログ抽出（messages + materials）
+
+```typescript
+const session = createExtractSession({
+  driver: runtime.driver,
+  cacheController: runtime.cacheController,
+  model: runtime.model,
+  corpus: {
+    materials: [{ title: '製品仕様', content: '...' }],
+    messages: [
+      { role: 'user', content: 'この機能の制約を教えて' },
+      { role: 'assistant', content: '...' },
+      { role: 'user', content: 'では代替案は？' },
+    ],
+  },
+});
+
+await session.extract({ cue: '議論された制約と合意事項を抽出' });
+```
+
+### 段階的深掘り（inputs + キャッシュ）
+
+```typescript
+import {
+  buildPreviousExtractionsInputs,
+  inputChunksFromJson,
+} from '@modular-prompt/extract';
+
+const overview = await session.extract({ cue: '会議の概要を1段落で' });
+
+const details = await session.extract({
+  cue: '概要を踏まえ、決定事項と未決事項を整理',
+  inputs: buildPreviousExtractionsInputs([overview]),
+});
+
+// JSON 補助情報を渡す場合
+await session.extract({
+  cue: '担当者と期限を表形式で',
+  inputs: inputChunksFromJson({ focus: 'action items' }),
+});
+```
+
+## ドメイン調整と structured output
+
+```typescript
+import { mergeExtractBaseModule } from '@modular-prompt/extract';
+
+const session = createExtractSession({
+  driver: runtime.driver,
+  cacheController: runtime.cacheController,
+  model: runtime.model,
+  domainModule: {
+    terms: ['「PJ」は modular-prompt プロジェクトを指す。'],
+  },
+  corpus: { materials: [{ title: 'Notes', content: '...' }] },
+  schema: {
+    type: 'object',
+    properties: { name: { type: 'string' } },
+    required: ['name'],
+  },
+});
+
+const result = await session.extract({ cue: '人物名を抽出' });
+console.log(result.structured); // schema に沿った JSON
+```
+
+`baseModule` を丸ごと差し替えることも可能。汎用挙動を保ちつつ追記する場合は `mergeExtractBaseModule()` を使う。
+
+## 公開 API（主要）
+
+| シンボル | 説明 |
+|---------|------|
+| `createExtractSession` | 抽出セッションを生成 |
+| `createMlxExtractRuntime` | MLX 用 driver + cacheController バンドル |
+| `defaultExtractBaseModule` | デフォルト base モジュール |
+| `mergeExtractBaseModule` | デフォルト base に overlay を merge |
+| `buildPreviousExtractionsInputs` | 過去抽出結果を inputs に変換 |
+| `inputChunk` / `inputChunksFromJson` | chunk 入力ヘルパ |
+
+型: `ExtractCorpus`, `ExtractRequest`, `ExtractResult`, `ExtractSession`, `MaterialInput`, `MessageInput`, `ChunkInput` など。
+
+完全な API リファレンスは [API.md](./API.md) を参照。
+
+## CLI（`modular-extract`）
+
+`bin/modular-extract.js` 経由で利用できる簡易 CLI。
+
+```bash
+pnpm --filter @modular-prompt/extract build
+
+modular-extract create [-d .extract-cache] [-m model] file1.txt file2.txt
+modular-extract extract -d .extract-cache '抽出したい内容の指示'
+
+# キャッシュ削除
+rm -rf .extract-cache
+```
+
+`create` は入力ファイルを corpus として KV cache を準備し、`manifest.json` を cache ディレクトリに保存する。`extract` は manifest から corpus を復元して cue を実行する。いずれも **mlx-lm バックエンド固定**（キャッシュ互換のため）。
+
+## テスト
+
+```bash
+pnpm --filter @modular-prompt/extract test:run
+```
+
+MLX 統合テストは macOS + MLX 設定がある環境でのみ実行される。
+
+## 関連ドキュメント
+
+- [API 仕様](./API.md)
+- [プロンプトモジュール仕様](../../docs/PROMPT_MODULE_SPEC.md)
+- [プロンプトキャッシュ設計](../../docs/CACHE_DESIGN.md)
+- [ローカルモデルセットアップ](../../docs/LOCAL_MODEL_SETUP.md)
+- 親 Issue: [#330](https://github.com/otolab/modular-prompt/issues/330)

package/bin/modular-extract.js

@@ -0,0 +1,3 @@
+#!/usr/bin/env node
+
+import '../dist/cli.js';

package/dist/build-modules.d.ts

@@ -0,0 +1,5 @@
+import type { PromptModule } from '@modular-prompt/core';
+import type { ExtractCorpus, ExtractRequest } from './types.js';
+export declare function buildCorpusModule(corpus: ExtractCorpus): PromptModule;
+export declare function buildRequestModule(request: ExtractRequest): PromptModule;
+//# sourceMappingURL=build-modules.d.ts.map

package/dist/build-modules.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"build-modules.d.ts","sourceRoot":"","sources":["../src/build-modules.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,EAAE,YAAY,EAA+B,MAAM,sBAAsB,CAAC;AACtF,OAAO,KAAK,EAAE,aAAa,EAAE,cAAc,EAAE,MAAM,YAAY,CAAC;AA0BhE,wBAAgB,iBAAiB,CAAC,MAAM,EAAE,aAAa,GAAG,YAAY,CAarE;AAED,wBAAgB,kBAAkB,CAAC,OAAO,EAAE,cAAc,GAAG,YAAY,CAaxE"}

package/dist/build-modules.js

@@ -0,0 +1,41 @@
+import { normalizeInputs, normalizeMaterials, normalizeMessages, } from './extract-elements.js';
+function withContextualCacheHint(content) {
+    return content.map((item) => {
+        if (typeof item === 'string') {
+            return {
+                type: 'text',
+                content: item,
+                cacheHint: 'contextual',
+            };
+        }
+        if (item && typeof item === 'object' && 'type' in item) {
+            return {
+                ...item,
+                cacheHint: item.cacheHint ?? 'contextual',
+            };
+        }
+        return item;
+    });
+}
+export function buildCorpusModule(corpus) {
+    const module = {};
+    const materials = normalizeMaterials(corpus.materials);
+    const messages = normalizeMessages(corpus.messages);
+    if (materials) {
+        module.materials = [...materials];
+    }
+    if (messages) {
+        module.messages = [...messages];
+    }
+    return module;
+}
+export function buildRequestModule(request) {
+    const cue = withContextualCacheHint(typeof request.cue === 'string' ? [request.cue] : request.cue);
+    const module = { cue };
+    const inputs = normalizeInputs(request.inputs);
+    if (inputs) {
+        module.inputs = [...inputs];
+    }
+    return module;
+}
+//# sourceMappingURL=build-modules.js.map

package/dist/build-modules.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"build-modules.js","sourceRoot":"","sources":["../src/build-modules.ts"],"names":[],"mappings":"AAEA,OAAO,EACL,eAAe,EACf,kBAAkB,EAClB,iBAAiB,GAClB,MAAM,uBAAuB,CAAC;AAE/B,SAAS,uBAAuB,CAAC,OAAuB;IACtD,OAAO,OAAO,CAAC,GAAG,CAAC,CAAC,IAAI,EAAE,EAAE;QAC1B,IAAI,OAAO,IAAI,KAAK,QAAQ,EAAE,CAAC;YAC7B,OAAO;gBACL,IAAI,EAAE,MAAM;gBACZ,OAAO,EAAE,IAAI;gBACb,SAAS,EAAE,YAAY;aACF,CAAC;QAC1B,CAAC;QACD,IAAI,IAAI,IAAI,OAAO,IAAI,KAAK,QAAQ,IAAI,MAAM,IAAI,IAAI,EAAE,CAAC;YACvD,OAAO;gBACL,GAAG,IAAI;gBACP,SAAS,EAAE,IAAI,CAAC,SAAS,IAAI,YAAY;aAC1C,CAAC;QACJ,CAAC;QACD,OAAO,IAAI,CAAC;IACd,CAAC,CAAC,CAAC;AACL,CAAC;AAED,MAAM,UAAU,iBAAiB,CAAC,MAAqB;IACrD,MAAM,MAAM,GAAiB,EAAE,CAAC;IAChC,MAAM,SAAS,GAAG,kBAAkB,CAAC,MAAM,CAAC,SAAS,CAAC,CAAC;IACvD,MAAM,QAAQ,GAAG,iBAAiB,CAAC,MAAM,CAAC,QAAQ,CAAC,CAAC;IAEpD,IAAI,SAAS,EAAE,CAAC;QACd,MAAM,CAAC,SAAS,GAAG,CAAC,GAAG,SAAS,CAAC,CAAC;IACpC,CAAC;IACD,IAAI,QAAQ,EAAE,CAAC;QACb,MAAM,CAAC,QAAQ,GAAG,CAAC,GAAG,QAAQ,CAAC,CAAC;IAClC,CAAC;IAED,OAAO,MAAM,CAAC;AAChB,CAAC;AAED,MAAM,UAAU,kBAAkB,CAAC,OAAuB;IACxD,MAAM,GAAG,GAAG,uBAAuB,CACjC,OAAO,OAAO,CAAC,GAAG,KAAK,QAAQ,CAAC,CAAC,CAAC,CAAC,OAAO,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,OAAO,CAAC,GAAG,CAC9D,CAAC;IAEF,MAAM,MAAM,GAAiB,EAAE,GAAG,EAAE,CAAC;IACrC,MAAM,MAAM,GAAG,eAAe,CAAC,OAAO,CAAC,MAAM,CAAC,CAAC;IAE/C,IAAI,MAAM,EAAE,CAAC;QACX,MAAM,CAAC,MAAM,GAAG,CAAC,GAAG,MAAM,CAAC,CAAC;IAC9B,CAAC;IAED,OAAO,MAAM,CAAC;AAChB,CAAC"}

package/dist/cache-lifecycle.d.ts

@@ -0,0 +1,12 @@
+import type { PromptModule } from '@modular-prompt/core';
+import type { AIDriver, CacheHandle, PromptCacheController } from '@modular-prompt/driver';
+import type { ExtractCorpus, ExtractRequest } from './types.js';
+export interface CacheLifecycleState {
+    handle: CacheHandle | null;
+    controllerReady: boolean;
+}
+export declare function resolveModelName(model: string): string;
+export declare function ensureCacheControllerReady(driver: AIDriver, state: CacheLifecycleState): Promise<void>;
+export declare function prepareSessionCache<TContext>(cacheController: PromptCacheController, model: string, sessionBaseModule: PromptModule<TContext>, corpus: ExtractCorpus, request: ExtractRequest, baseModule: PromptModule<TContext> | undefined, state: CacheLifecycleState): Promise<CacheHandle | null>;
+export declare function releaseSessionCache(cacheController: PromptCacheController, state: CacheLifecycleState): void;
+//# sourceMappingURL=cache-lifecycle.d.ts.map

package/dist/cache-lifecycle.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"cache-lifecycle.d.ts","sourceRoot":"","sources":["../src/cache-lifecycle.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,EAAE,YAAY,EAAE,MAAM,sBAAsB,CAAC;AACzD,OAAO,KAAK,EAAE,QAAQ,EAAE,WAAW,EAAE,qBAAqB,EAAE,MAAM,wBAAwB,CAAC;AAE3F,OAAO,KAAK,EAAE,aAAa,EAAE,cAAc,EAAE,MAAM,YAAY,CAAC;AAGhE,MAAM,WAAW,mBAAmB;IAClC,MAAM,EAAE,WAAW,GAAG,IAAI,CAAC;IAC3B,eAAe,EAAE,OAAO,CAAC;CAC1B;AAED,wBAAgB,gBAAgB,CAAC,KAAK,EAAE,MAAM,GAAG,MAAM,CAKtD;AAED,wBAAsB,0BAA0B,CAC9C,MAAM,EAAE,QAAQ,EAChB,KAAK,EAAE,mBAAmB,GACzB,OAAO,CAAC,IAAI,CAAC,CAUf;AAED,wBAAsB,mBAAmB,CAAC,QAAQ,EAChD,eAAe,EAAE,qBAAqB,EACtC,KAAK,EAAE,MAAM,EACb,iBAAiB,EAAE,YAAY,CAAC,QAAQ,CAAC,EACzC,MAAM,EAAE,aAAa,EACrB,OAAO,EAAE,cAAc,EACvB,UAAU,EAAE,YAAY,CAAC,QAAQ,CAAC,GAAG,SAAS,EAC9C,KAAK,EAAE,mBAAmB,GACzB,OAAO,CAAC,WAAW,GAAG,IAAI,CAAC,CAwB7B;AAED,wBAAgB,mBAAmB,CACjC,eAAe,EAAE,qBAAqB,EACtC,KAAK,EAAE,mBAAmB,GACzB,IAAI,CAKN"}

package/dist/cache-lifecycle.js

@@ -0,0 +1,44 @@
+import { partitionPrompt } from '@modular-prompt/driver';
+import { compileExtractPrompt } from './compile-extract-prompt.js';
+export function resolveModelName(model) {
+    if (!model) {
+        throw new Error('ExtractSessionOptions.model is required');
+    }
+    return model;
+}
+export async function ensureCacheControllerReady(driver, state) {
+    if (state.controllerReady) {
+        return;
+    }
+    if ('getCapabilities' in driver && typeof driver.getCapabilities === 'function') {
+        await driver.getCapabilities();
+    }
+    state.controllerReady = true;
+}
+export async function prepareSessionCache(cacheController, model, sessionBaseModule, corpus, request, baseModule, state) {
+    const compiled = compileExtractPrompt(sessionBaseModule, corpus, request, baseModule);
+    const { cacheable } = partitionPrompt(compiled);
+    const hasCacheableContent = cacheable.instructions.length > 0 || cacheable.data.length > 0;
+    if (!hasCacheableContent) {
+        return state.handle;
+    }
+    const newHandle = await cacheController.prepare({
+        model,
+        instructions: cacheable.instructions,
+        data: cacheable.data,
+        tools: request.options?.tools,
+        reasoningEffort: request.options?.reasoningEffort,
+    });
+    if (state.handle?.ref && newHandle.supersedes === state.handle.ref) {
+        cacheController.release(state.handle.ref);
+    }
+    state.handle = newHandle.ref ? newHandle : null;
+    return state.handle;
+}
+export function releaseSessionCache(cacheController, state) {
+    if (state.handle?.ref) {
+        cacheController.release(state.handle.ref);
+        state.handle = null;
+    }
+}
+//# sourceMappingURL=cache-lifecycle.js.map

package/dist/cache-lifecycle.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"cache-lifecycle.js","sourceRoot":"","sources":["../src/cache-lifecycle.ts"],"names":[],"mappings":"AAEA,OAAO,EAAE,eAAe,EAAE,MAAM,wBAAwB,CAAC;AAEzD,OAAO,EAAE,oBAAoB,EAAE,MAAM,6BAA6B,CAAC;AAOnE,MAAM,UAAU,gBAAgB,CAAC,KAAa;IAC5C,IAAI,CAAC,KAAK,EAAE,CAAC;QACX,MAAM,IAAI,KAAK,CAAC,yCAAyC,CAAC,CAAC;IAC7D,CAAC;IACD,OAAO,KAAK,CAAC;AACf,CAAC;AAED,MAAM,CAAC,KAAK,UAAU,0BAA0B,CAC9C,MAAgB,EAChB,KAA0B;IAE1B,IAAI,KAAK,CAAC,eAAe,EAAE,CAAC;QAC1B,OAAO;IACT,CAAC;IAED,IAAI,iBAAiB,IAAI,MAAM,IAAI,OAAO,MAAM,CAAC,eAAe,KAAK,UAAU,EAAE,CAAC;QAChF,MAAM,MAAM,CAAC,eAAe,EAAE,CAAC;IACjC,CAAC;IAED,KAAK,CAAC,eAAe,GAAG,IAAI,CAAC;AAC/B,CAAC;AAED,MAAM,CAAC,KAAK,UAAU,mBAAmB,CACvC,eAAsC,EACtC,KAAa,EACb,iBAAyC,EACzC,MAAqB,EACrB,OAAuB,EACvB,UAA8C,EAC9C,KAA0B;IAE1B,MAAM,QAAQ,GAAG,oBAAoB,CAAC,iBAAiB,EAAE,MAAM,EAAE,OAAO,EAAE,UAAU,CAAC,CAAC;IACtF,MAAM,EAAE,SAAS,EAAE,GAAG,eAAe,CAAC,QAAQ,CAAC,CAAC;IAChD,MAAM,mBAAmB,GACvB,SAAS,CAAC,YAAY,CAAC,MAAM,GAAG,CAAC,IAAI,SAAS,CAAC,IAAI,CAAC,MAAM,GAAG,CAAC,CAAC;IAEjE,IAAI,CAAC,mBAAmB,EAAE,CAAC;QACzB,OAAO,KAAK,CAAC,MAAM,CAAC;IACtB,CAAC;IAED,MAAM,SAAS,GAAG,MAAM,eAAe,CAAC,OAAO,CAAC;QAC9C,KAAK;QACL,YAAY,EAAE,SAAS,CAAC,YAAY;QACpC,IAAI,EAAE,SAAS,CAAC,IAAI;QACpB,KAAK,EAAE,OAAO,CAAC,OAAO,EAAE,KAAK;QAC7B,eAAe,EAAE,OAAO,CAAC,OAAO,EAAE,eAAe;KAClD,CAAC,CAAC;IAEH,IAAI,KAAK,CAAC,MAAM,EAAE,GAAG,IAAI,SAAS,CAAC,UAAU,KAAK,KAAK,CAAC,MAAM,CAAC,GAAG,EAAE,CAAC;QACnE,eAAe,CAAC,OAAO,CAAC,KAAK,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC;IAC5C,CAAC;IAED,KAAK,CAAC,MAAM,GAAG,SAAS,CAAC,GAAG,CAAC,CAAC,CAAC,SAAS,CAAC,CAAC,CAAC,IAAI,CAAC;IAChD,OAAO,KAAK,CAAC,MAAM,CAAC;AACtB,CAAC;AAED,MAAM,UAAU,mBAAmB,CACjC,eAAsC,EACtC,KAA0B;IAE1B,IAAI,KAAK,CAAC,MAAM,EAAE,GAAG,EAAE,CAAC;QACtB,eAAe,CAAC,OAAO,CAAC,KAAK,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC;QAC1C,KAAK,CAAC,MAAM,GAAG,IAAI,CAAC;IACtB,CAAC;AACH,CAAC"}

package/dist/cli/constants.d.ts

@@ -0,0 +1,11 @@
+/** キャッシュディレクトリ内のメタデータファイル名。 */
+export declare const MANIFEST_FILENAME = "manifest.json";
+/** `create -d` 省略時のデフォルト（カレントディレクトリ直下）。 */
+export declare const DEFAULT_CACHE_DIR = ".extract-cache";
+/** `create -m` 省略時のデフォルト MLX モデル。 */
+export declare const DEFAULT_MODEL: string;
+/** create 時のキャッシュ prefill 用 cue（出力は最小限に抑える）。 */
+export declare const CACHE_PREPARE_CUE = "\uFF08cache prepare\uFF09";
+/** `extract --max-tokens` 省略時のデフォルト。 */
+export declare const DEFAULT_MAX_TOKENS = 8000;
+//# sourceMappingURL=constants.d.ts.map

package/dist/cli/constants.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"constants.d.ts","sourceRoot":"","sources":["../../src/cli/constants.ts"],"names":[],"mappings":"AAAA,+BAA+B;AAC/B,eAAO,MAAM,iBAAiB,kBAAkB,CAAC;AAEjD,2CAA2C;AAC3C,eAAO,MAAM,iBAAiB,mBAAmB,CAAC;AAElD,qCAAqC;AACrC,eAAO,MAAM,aAAa,QACwC,CAAC;AAEnE,gDAAgD;AAChD,eAAO,MAAM,iBAAiB,8BAAoB,CAAC;AAEnD,wCAAwC;AACxC,eAAO,MAAM,kBAAkB,OAAO,CAAC"}

package/dist/cli/constants.js

@@ -0,0 +1,11 @@
+/** キャッシュディレクトリ内のメタデータファイル名。 */
+export const MANIFEST_FILENAME = 'manifest.json';
+/** `create -d` 省略時のデフォルト（カレントディレクトリ直下）。 */
+export const DEFAULT_CACHE_DIR = '.extract-cache';
+/** `create -m` 省略時のデフォルト MLX モデル。 */
+export const DEFAULT_MODEL = process.env.MLX_MODEL ?? 'prism-ml/Ternary-Bonsai-1.7B-mlx-2bit';
+/** create 時のキャッシュ prefill 用 cue（出力は最小限に抑える）。 */
+export const CACHE_PREPARE_CUE = '（cache prepare）';
+/** `extract --max-tokens` 省略時のデフォルト。 */
+export const DEFAULT_MAX_TOKENS = 8000;
+//# sourceMappingURL=constants.js.map

package/dist/cli/constants.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"constants.js","sourceRoot":"","sources":["../../src/cli/constants.ts"],"names":[],"mappings":"AAAA,+BAA+B;AAC/B,MAAM,CAAC,MAAM,iBAAiB,GAAG,eAAe,CAAC;AAEjD,2CAA2C;AAC3C,MAAM,CAAC,MAAM,iBAAiB,GAAG,gBAAgB,CAAC;AAElD,qCAAqC;AACrC,MAAM,CAAC,MAAM,aAAa,GACxB,OAAO,CAAC,GAAG,CAAC,SAAS,IAAI,uCAAuC,CAAC;AAEnE,gDAAgD;AAChD,MAAM,CAAC,MAAM,iBAAiB,GAAG,iBAAiB,CAAC;AAEnD,wCAAwC;AACxC,MAAM,CAAC,MAAM,kBAAkB,GAAG,IAAI,CAAC"}

package/dist/cli/create-command.d.ts

@@ -0,0 +1,8 @@
+export interface CreateCommandOptions {
+    cacheDir: string;
+    model: string;
+    files: string[];
+    dryRun?: boolean;
+}
+export declare function runCreateCommand(options: CreateCommandOptions): Promise<string | void>;
+//# sourceMappingURL=create-command.d.ts.map

package/dist/cli/create-command.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"create-command.d.ts","sourceRoot":"","sources":["../../src/cli/create-command.ts"],"names":[],"mappings":"AASA,MAAM,WAAW,oBAAoB;IACnC,QAAQ,EAAE,MAAM,CAAC;IACjB,KAAK,EAAE,MAAM,CAAC;IACd,KAAK,EAAE,MAAM,EAAE,CAAC;IAChB,MAAM,CAAC,EAAE,OAAO,CAAC;CAClB;AAED,wBAAsB,gBAAgB,CAAC,OAAO,EAAE,oBAAoB,GAAG,OAAO,CAAC,MAAM,GAAG,IAAI,CAAC,CA8C5F"}

package/dist/cli/create-command.js

@@ -0,0 +1,48 @@
+import { mkdir } from 'node:fs/promises';
+import { resolve } from 'node:path';
+import { createExtractSession } from '../create-extract-session.js';
+import { createMlxExtractRuntime } from '../create-mlx-extract-runtime.js';
+import { CACHE_PREPARE_CUE, DEFAULT_MODEL } from './constants.js';
+import { loadMaterialsFromFiles } from './load-materials.js';
+import { manifestExists, writeManifest } from './manifest.js';
+import { renderExtractPrompt } from './render-prompt.js';
+export async function runCreateCommand(options) {
+    const cacheDir = resolve(options.cacheDir);
+    const model = options.model || DEFAULT_MODEL;
+    const materials = await loadMaterialsFromFiles(options.files);
+    const request = { cue: CACHE_PREPARE_CUE };
+    if (options.dryRun) {
+        return renderExtractPrompt({ materials }, request);
+    }
+    if (await manifestExists(cacheDir)) {
+        throw new Error(`Cache directory already exists: ${cacheDir}\n`
+            + 'Remove the directory to clean the cache, then run create again.');
+    }
+    await mkdir(cacheDir, { recursive: true });
+    const runtime = await createMlxExtractRuntime({ model, cacheDir });
+    try {
+        const session = createExtractSession({
+            driver: runtime.driver,
+            cacheController: runtime.cacheController,
+            model: runtime.model,
+            corpus: { materials },
+        });
+        await session.extract({
+            cue: CACHE_PREPARE_CUE,
+            options: { maxTokens: 1, temperature: 0 },
+        });
+        await session.close({ releaseCache: false });
+        await writeManifest(cacheDir, {
+            version: 1,
+            model,
+            materials,
+            createdAt: new Date().toISOString(),
+        });
+    }
+    finally {
+        await runtime.close();
+    }
+    console.error(`Cache prepared: ${cacheDir}`);
+    console.error(`Materials: ${materials.length} file(s), model: ${model}`);
+}
+//# sourceMappingURL=create-command.js.map

package/dist/cli/create-command.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"create-command.js","sourceRoot":"","sources":["../../src/cli/create-command.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,KAAK,EAAE,MAAM,kBAAkB,CAAC;AACzC,OAAO,EAAE,OAAO,EAAE,MAAM,WAAW,CAAC;AACpC,OAAO,EAAE,oBAAoB,EAAE,MAAM,8BAA8B,CAAC;AACpE,OAAO,EAAE,uBAAuB,EAAE,MAAM,kCAAkC,CAAC;AAC3E,OAAO,EAAE,iBAAiB,EAAE,aAAa,EAAE,MAAM,gBAAgB,CAAC;AAClE,OAAO,EAAE,sBAAsB,EAAE,MAAM,qBAAqB,CAAC;AAC7D,OAAO,EAAE,cAAc,EAAE,aAAa,EAAE,MAAM,eAAe,CAAC;AAC9D,OAAO,EAAE,mBAAmB,EAAE,MAAM,oBAAoB,CAAC;AASzD,MAAM,CAAC,KAAK,UAAU,gBAAgB,CAAC,OAA6B;IAClE,MAAM,QAAQ,GAAG,OAAO,CAAC,OAAO,CAAC,QAAQ,CAAC,CAAC;IAC3C,MAAM,KAAK,GAAG,OAAO,CAAC,KAAK,IAAI,aAAa,CAAC;IAC7C,MAAM,SAAS,GAAG,MAAM,sBAAsB,CAAC,OAAO,CAAC,KAAK,CAAC,CAAC;IAC9D,MAAM,OAAO,GAAG,EAAE,GAAG,EAAE,iBAAiB,EAAE,CAAC;IAE3C,IAAI,OAAO,CAAC,MAAM,EAAE,CAAC;QACnB,OAAO,mBAAmB,CAAC,EAAE,SAAS,EAAE,EAAE,OAAO,CAAC,CAAC;IACrD,CAAC;IAED,IAAI,MAAM,cAAc,CAAC,QAAQ,CAAC,EAAE,CAAC;QACnC,MAAM,IAAI,KAAK,CACb,mCAAmC,QAAQ,IAAI;cAC7C,iEAAiE,CACpE,CAAC;IACJ,CAAC;IAED,MAAM,KAAK,CAAC,QAAQ,EAAE,EAAE,SAAS,EAAE,IAAI,EAAE,CAAC,CAAC;IAE3C,MAAM,OAAO,GAAG,MAAM,uBAAuB,CAAC,EAAE,KAAK,EAAE,QAAQ,EAAE,CAAC,CAAC;IACnE,IAAI,CAAC;QACH,MAAM,OAAO,GAAG,oBAAoB,CAAC;YACnC,MAAM,EAAE,OAAO,CAAC,MAAM;YACtB,eAAe,EAAE,OAAO,CAAC,eAAe;YACxC,KAAK,EAAE,OAAO,CAAC,KAAK;YACpB,MAAM,EAAE,EAAE,SAAS,EAAE;SACtB,CAAC,CAAC;QAEH,MAAM,OAAO,CAAC,OAAO,CAAC;YACpB,GAAG,EAAE,iBAAiB;YACtB,OAAO,EAAE,EAAE,SAAS,EAAE,CAAC,EAAE,WAAW,EAAE,CAAC,EAAE;SAC1C,CAAC,CAAC;QACH,MAAM,OAAO,CAAC,KAAK,CAAC,EAAE,YAAY,EAAE,KAAK,EAAE,CAAC,CAAC;QAE7C,MAAM,aAAa,CAAC,QAAQ,EAAE;YAC5B,OAAO,EAAE,CAAC;YACV,KAAK;YACL,SAAS;YACT,SAAS,EAAE,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE;SACpC,CAAC,CAAC;IACL,CAAC;YAAS,CAAC;QACT,MAAM,OAAO,CAAC,KAAK,EAAE,CAAC;IACxB,CAAC;IAED,OAAO,CAAC,KAAK,CAAC,mBAAmB,QAAQ,EAAE,CAAC,CAAC;IAC7C,OAAO,CAAC,KAAK,CAAC,cAAc,SAAS,CAAC,MAAM,oBAAoB,KAAK,EAAE,CAAC,CAAC;AAC3E,CAAC"}

package/dist/cli/extract-command.d.ts

@@ -0,0 +1,8 @@
+export interface ExtractCommandOptions {
+    cacheDir: string;
+    query: string;
+    maxTokens?: number;
+    dryRun?: boolean;
+}
+export declare function runExtractCommand(options: ExtractCommandOptions): Promise<string>;
+//# sourceMappingURL=extract-command.d.ts.map

package/dist/cli/extract-command.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"extract-command.d.ts","sourceRoot":"","sources":["../../src/cli/extract-command.ts"],"names":[],"mappings":"AAOA,MAAM,WAAW,qBAAqB;IACpC,QAAQ,EAAE,MAAM,CAAC;IACjB,KAAK,EAAE,MAAM,CAAC;IACd,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB,MAAM,CAAC,EAAE,OAAO,CAAC;CAClB;AAED,wBAAsB,iBAAiB,CAAC,OAAO,EAAE,qBAAqB,GAAG,OAAO,CAAC,MAAM,CAAC,CAuCvF"}

package/dist/cli/extract-command.js

@@ -0,0 +1,42 @@
+import { resolve } from 'node:path';
+import { createExtractSession } from '../create-extract-session.js';
+import { createMlxExtractRuntime } from '../create-mlx-extract-runtime.js';
+import { DEFAULT_MAX_TOKENS } from './constants.js';
+import { readManifest } from './manifest.js';
+import { renderExtractPrompt } from './render-prompt.js';
+export async function runExtractCommand(options) {
+    const cacheDir = resolve(options.cacheDir);
+    const manifest = await readManifest(cacheDir);
+    if (!options.query.trim()) {
+        throw new Error('Query text is required');
+    }
+    const request = {
+        cue: options.query,
+        options: {
+            maxTokens: options.maxTokens ?? DEFAULT_MAX_TOKENS,
+            temperature: 0,
+        },
+    };
+    if (options.dryRun) {
+        return renderExtractPrompt({ materials: manifest.materials }, request);
+    }
+    const runtime = await createMlxExtractRuntime({
+        model: manifest.model,
+        cacheDir,
+    });
+    try {
+        const session = createExtractSession({
+            driver: runtime.driver,
+            cacheController: runtime.cacheController,
+            model: runtime.model,
+            corpus: { materials: manifest.materials },
+        });
+        const result = await session.extract(request);
+        await session.close({ releaseCache: false });
+        return result.text;
+    }
+    finally {
+        await runtime.close();
+    }
+}
+//# sourceMappingURL=extract-command.js.map

package/dist/cli/extract-command.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"extract-command.js","sourceRoot":"","sources":["../../src/cli/extract-command.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,OAAO,EAAE,MAAM,WAAW,CAAC;AACpC,OAAO,EAAE,oBAAoB,EAAE,MAAM,8BAA8B,CAAC;AACpE,OAAO,EAAE,uBAAuB,EAAE,MAAM,kCAAkC,CAAC;AAC3E,OAAO,EAAE,kBAAkB,EAAE,MAAM,gBAAgB,CAAC;AACpD,OAAO,EAAE,YAAY,EAAE,MAAM,eAAe,CAAC;AAC7C,OAAO,EAAE,mBAAmB,EAAE,MAAM,oBAAoB,CAAC;AASzD,MAAM,CAAC,KAAK,UAAU,iBAAiB,CAAC,OAA8B;IACpE,MAAM,QAAQ,GAAG,OAAO,CAAC,OAAO,CAAC,QAAQ,CAAC,CAAC;IAC3C,MAAM,QAAQ,GAAG,MAAM,YAAY,CAAC,QAAQ,CAAC,CAAC;IAE9C,IAAI,CAAC,OAAO,CAAC,KAAK,CAAC,IAAI,EAAE,EAAE,CAAC;QAC1B,MAAM,IAAI,KAAK,CAAC,wBAAwB,CAAC,CAAC;IAC5C,CAAC;IAED,MAAM,OAAO,GAAG;QACd,GAAG,EAAE,OAAO,CAAC,KAAK;QAClB,OAAO,EAAE;YACP,SAAS,EAAE,OAAO,CAAC,SAAS,IAAI,kBAAkB;YAClD,WAAW,EAAE,CAAU;SACxB;KACF,CAAC;IAEF,IAAI,OAAO,CAAC,MAAM,EAAE,CAAC;QACnB,OAAO,mBAAmB,CAAC,EAAE,SAAS,EAAE,QAAQ,CAAC,SAAS,EAAE,EAAE,OAAO,CAAC,CAAC;IACzE,CAAC;IAED,MAAM,OAAO,GAAG,MAAM,uBAAuB,CAAC;QAC5C,KAAK,EAAE,QAAQ,CAAC,KAAK;QACrB,QAAQ;KACT,CAAC,CAAC;IAEH,IAAI,CAAC;QACH,MAAM,OAAO,GAAG,oBAAoB,CAAC;YACnC,MAAM,EAAE,OAAO,CAAC,MAAM;YACtB,eAAe,EAAE,OAAO,CAAC,eAAe;YACxC,KAAK,EAAE,OAAO,CAAC,KAAK;YACpB,MAAM,EAAE,EAAE,SAAS,EAAE,QAAQ,CAAC,SAAS,EAAE;SAC1C,CAAC,CAAC;QAEH,MAAM,MAAM,GAAG,MAAM,OAAO,CAAC,OAAO,CAAC,OAAO,CAAC,CAAC;QAC9C,MAAM,OAAO,CAAC,KAAK,CAAC,EAAE,YAAY,EAAE,KAAK,EAAE,CAAC,CAAC;QAC7C,OAAO,MAAM,CAAC,IAAI,CAAC;IACrB,CAAC;YAAS,CAAC;QACT,MAAM,OAAO,CAAC,KAAK,EAAE,CAAC;IACxB,CAAC;AACH,CAAC"}

package/dist/cli/load-materials.d.ts

@@ -0,0 +1,3 @@
+import type { MaterialInput } from '../extract-elements.js';
+export declare function loadMaterialsFromFiles(paths: string[]): Promise<MaterialInput[]>;
+//# sourceMappingURL=load-materials.d.ts.map

package/dist/cli/load-materials.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"load-materials.d.ts","sourceRoot":"","sources":["../../src/cli/load-materials.ts"],"names":[],"mappings":"AAEA,OAAO,KAAK,EAAE,aAAa,EAAE,MAAM,wBAAwB,CAAC;AAE5D,wBAAsB,sBAAsB,CAAC,KAAK,EAAE,MAAM,EAAE,GAAG,OAAO,CAAC,aAAa,EAAE,CAAC,CAiBtF"}

package/dist/cli/load-materials.js

@@ -0,0 +1,20 @@
+import { readFile } from 'node:fs/promises';
+import { basename, resolve } from 'node:path';
+export async function loadMaterialsFromFiles(paths) {
+    if (paths.length === 0) {
+        throw new Error('At least one input file is required');
+    }
+    const materials = [];
+    for (const inputPath of paths) {
+        const absolutePath = resolve(inputPath);
+        const content = await readFile(absolutePath, 'utf-8');
+        const title = basename(absolutePath);
+        materials.push({
+            id: absolutePath,
+            title,
+            content,
+        });
+    }
+    return materials;
+}
+//# sourceMappingURL=load-materials.js.map

package/dist/cli/load-materials.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"load-materials.js","sourceRoot":"","sources":["../../src/cli/load-materials.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,QAAQ,EAAE,MAAM,kBAAkB,CAAC;AAC5C,OAAO,EAAE,QAAQ,EAAE,OAAO,EAAE,MAAM,WAAW,CAAC;AAG9C,MAAM,CAAC,KAAK,UAAU,sBAAsB,CAAC,KAAe;IAC1D,IAAI,KAAK,CAAC,MAAM,KAAK,CAAC,EAAE,CAAC;QACvB,MAAM,IAAI,KAAK,CAAC,qCAAqC,CAAC,CAAC;IACzD,CAAC;IAED,MAAM,SAAS,GAAoB,EAAE,CAAC;IACtC,KAAK,MAAM,SAAS,IAAI,KAAK,EAAE,CAAC;QAC9B,MAAM,YAAY,GAAG,OAAO,CAAC,SAAS,CAAC,CAAC;QACxC,MAAM,OAAO,GAAG,MAAM,QAAQ,CAAC,YAAY,EAAE,OAAO,CAAC,CAAC;QACtD,MAAM,KAAK,GAAG,QAAQ,CAAC,YAAY,CAAC,CAAC;QACrC,SAAS,CAAC,IAAI,CAAC;YACb,EAAE,EAAE,YAAY;YAChB,KAAK;YACL,OAAO;SACR,CAAC,CAAC;IACL,CAAC;IACD,OAAO,SAAS,CAAC;AACnB,CAAC"}