toonify-mcp 0.2.2 → 0.3.0

package/README.zh-CN.md

@@ -0,0 +1,270 @@
+# 🎯 Toonify MCP
+
+**[English](README.md) | [繁體中文](README.zh-TW.md) | [简体中文](README.zh-CN.md) | [日本語](README.ja.md) | [Español](README.es.md) | [Tiếng Việt](README.vi.md) | [Bahasa Indonesia](README.id.md)**
+
+MCP 服务器 + Claude Code 插件，提供结构化数据的自动 token 优化。
+通过透明的 TOON 格式转换，**根据数据结构减少 30-65% 的 Claude API token 使用量**，结构化数据的典型节省率为 **50-55%**。
+
+## v0.3.0 新功能
+
+✨ **多语言 Token 优化！**
+- ✅ 精确计算 15+ 种语言的 token（中文、日文、韩文、西班牙文、阿拉伯文等）
+- ✅ 语言感知的 token 倍数（中文 2 倍、日文 2.5 倍、阿拉伯文 3 倍）
+- ✅ 支持混合语言文本的自动检测
+- ✅ 基于真实基准测试改进优化准确性
+- ✅ 数据支持的 token 节省声明（30-65% 范围，通常 50-55%）
+
+## 功能特色
+
+- **30-65% Token 减少**（通常 50-55%）适用于 JSON、CSV、YAML 数据
+- **多语言支持** - 精确计算 15+ 种语言的 token
+- **完全自动** - PostToolUse hook 拦截工具结果
+- **零配置** - 开箱即用，采用合理预设值
+- **双模式** - 作为插件（自动）或 MCP 服务器（手动）
+- **内建指标** - 在本地追踪 token 节省
+- **静默回退** - 永不中断您的工作流程
+
+## 安装
+
+### 选项 A：Claude Code 插件（推荐）⭐
+
+**零手动调用的自动 token 优化：**
+
+```bash
+# 1. 全局安装
+npm install -g toonify-mcp
+
+# 2. 添加为插件（自动模式）
+claude plugin add toonify-mcp
+
+# 3. 验证安装
+claude plugin list
+# 应显示：toonify-mcp ✓
+```
+
+**完成！** PostToolUse hook 现在会自动拦截并优化来自 Read、Grep 和其他文件工具的结构化数据。
+
+### 选项 B：MCP 服务器（手动模式）
+
+**用于明确控制或非 Claude Code MCP 客户端：**
+
+```bash
+# 1. 全局安装
+npm install -g toonify-mcp
+
+# 2. 注册为 MCP 服务器
+claude mcp add toonify -- toonify-mcp
+
+# 3. 验证
+claude mcp list
+# 应显示：toonify: toonify-mcp - ✓ Connected
+```
+
+然后明确调用工具：
+```bash
+claude mcp call toonify optimize_content '{"content": "..."}'
+claude mcp call toonify get_stats '{}'
+```
+
+## 运作原理
+
+### 插件模式（自动）
+
+```
+用户：读取大型 JSON 文件
+  ↓
+Claude Code 调用 Read 工具
+  ↓
+PostToolUse hook 拦截结果
+  ↓
+Hook 检测 JSON，转换为 TOON
+  ↓
+优化后的内容发送到 Claude API
+  ↓
+达成 50-55% 典型 token 减少 ✨
+```
+
+### MCP 服务器模式（手动）
+
+```
+用户：明确调用 mcp__toonify__optimize_content
+  ↓
+内容转换为 TOON 格式
+  ↓
+返回优化结果
+```
+
+## 配置
+
+创建 `~/.claude/toonify-config.json`（可选）：
+
+```json
+{
+  "enabled": true,
+  "minTokensThreshold": 50,
+  "minSavingsThreshold": 30,
+  "skipToolPatterns": ["Bash", "Write", "Edit"]
+}
+```
+
+### 选项
+
+- **enabled**：启用/停用自动优化（预设：`true`）
+- **minTokensThreshold**：优化前的最小 token 数（预设：`50`）
+- **minSavingsThreshold**：所需的最小节省百分比（预设：`30%`）
+- **skipToolPatterns**：永不优化的工具（预设：`["Bash", "Write", "Edit"]`）
+
+### 环境变量
+
+```bash
+export TOONIFY_ENABLED=true
+export TOONIFY_MIN_TOKENS=50
+export TOONIFY_MIN_SAVINGS=30
+export TOONIFY_SKIP_TOOLS="Bash,Write"
+export TOONIFY_SHOW_STATS=true  # 在输出中显示优化统计
+```
+
+## 示例
+
+### 优化前（142 tokens）
+
+```json
+{
+  "products": [
+    {"id": 101, "name": "Laptop Pro", "price": 1299},
+    {"id": 102, "name": "Magic Mouse", "price": 79}
+  ]
+}
+```
+
+### 优化后（57 tokens，-60%）
+
+```
+[TOON-JSON]
+products[2]{id,name,price}:
+  101,Laptop Pro,1299
+  102,Magic Mouse,79
+```
+
+**在插件模式下自动应用 - 无需手动调用！**
+
+## 使用技巧
+
+### 何时触发自动优化？
+
+PostToolUse hook 在以下情况下自动优化：
+- ✅ 内容是有效的 JSON、CSV 或 YAML
+- ✅ 内容大小 ≥ `minTokensThreshold`（预设：50 tokens）
+- ✅ 预估节省 ≥ `minSavingsThreshold`（预设：30%）
+- ✅ 工具不在 `skipToolPatterns` 中（例如，不是 Bash/Write/Edit）
+
+### 查看优化统计
+
+```bash
+# 在插件模式下
+claude mcp call toonify get_stats '{}'
+
+# 或检查 Claude Code 输出的统计（如果 TOONIFY_SHOW_STATS=true）
+```
+
+## 故障排除
+
+### Hook 未触发
+
+```bash
+# 1. 检查插件是否已安装
+claude plugin list | grep toonify
+
+# 2. 检查配置
+cat ~/.claude/toonify-config.json
+
+# 3. 启用统计以查看优化尝试
+export TOONIFY_SHOW_STATS=true
+```
+
+### 未应用优化
+
+- 检查 `minTokensThreshold` - 内容可能太小
+- 检查 `minSavingsThreshold` - 节省可能 < 30%
+- 检查 `skipToolPatterns` - 工具可能在跳过列表中
+- 验证内容是有效的 JSON/CSV/YAML
+
+### 性能问题
+
+- 降低 `minTokensThreshold` 以更积极地优化
+- 提高 `minSavingsThreshold` 以跳过边际优化
+- 如需要，将更多工具添加到 `skipToolPatterns`
+
+## 比较：插件 vs MCP 服务器
+
+| 功能 | 插件模式 | MCP 服务器模式 |
+|------|---------|--------------|
+| **激活** | 自动（PostToolUse） | 手动（调用工具） |
+| **兼容性** | 仅 Claude Code | 任何 MCP 客户端 |
+| **配置** | 插件配置文件 | MCP 工具 |
+| **性能** | 零开销 | 调用开销 |
+| **使用情境** | 日常工作流程 | 明确控制 |
+
+**建议**：使用插件模式进行自动优化。使用 MCP 服务器模式进行明确控制或其他 MCP 客户端。
+
+## 卸载
+
+### 插件模式
+```bash
+claude plugin remove toonify-mcp
+rm ~/.claude/toonify-config.json
+```
+
+### MCP 服务器模式
+```bash
+claude mcp remove toonify
+```
+
+### 包
+```bash
+npm uninstall -g toonify-mcp
+```
+
+## 链接
+
+- **GitHub**：https://github.com/kevintseng/toonify-mcp
+- **Issues**：https://github.com/kevintseng/toonify-mcp/issues
+- **NPM**：https://www.npmjs.com/package/toonify-mcp
+- **MCP 文档**：https://code.claude.com/docs/mcp
+- **TOON 格式**：https://github.com/toon-format/toon
+
+## 贡献
+
+欢迎贡献！请参阅 [CONTRIBUTING.md](CONTRIBUTING.md) 了解指南。
+
+## 授权
+
+MIT 授权 - 请参阅 [LICENSE](LICENSE)
+
+## 更新日志
+
+### v0.3.0（2025-12-26）
+- ✨ **多语言 token 优化** - 精确计算 15+ 种语言
+- ✨ 语言感知的 token 倍数（中文 2 倍、日文 2.5 倍、阿拉伯文 3 倍等）
+- ✨ 混合语言文本检测和优化
+- ✨ 使用真实统计数据进行全面基准测试
+- 📊 数据支持的 token 节省声明（30-65% 范围，通常 50-55%）
+- ✅ 75+ 测试通过，包括多语言边缘情况
+- 📝 多语言 README 版本
+
+### v0.2.0 (2025-12-25)
+- ✨ 添加 Claude Code 插件支持和 PostToolUse hook
+- ✨ 自动 token 优化（无需手动调用）
+- ✨ 插件配置系统
+- ✨ 双模式：插件（自动）+ MCP 服务器（手动）
+- 📝 全面文档更新
+
+### v0.1.1 (2024-12-24)
+- 🐛 错误修复和改进
+- 📝 文档更新
+
+### v0.1.0 (2024-12-24)
+- 🎉 初始发布
+- ✨ MCP 服务器实现
+- ✨ TOON 格式优化
+- ✨ 内建指标追踪

package/README.zh-TW.md

@@ -1,26 +1,28 @@
 # 🎯 Toonify MCP
 
-**[English](README.md) | [繁體中文](README.zh-TW.md)**
+**[English](README.md) | [繁體中文](README.zh-TW.md) | [简体中文](README.zh-CN.md) | [日本語](README.ja.md) | [Español](README.es.md) | [Tiếng Việt](README.vi.md) | [Bahasa Indonesia](README.id.md)**
 
-MCP 伺服器 + Claude Code 插件，提供結構化數據的自動 token 優化。
-透過透明的 TOON 格式轉換，**平均減少 60%+ 的 Claude API token 使用**。
+MCP 伺服器 + Claude Code 外掛程式，提供結構化數據的自動 token 優化。
+透過透明的 TOON 格式轉換，**根據數據結構減少 30-65% 的 Claude API token 使用量**，結構化數據的典型節省率為 **50-55%**。
 
-## v0.2.0 新功能
+## v0.3.0 新功能
 
-✨ **現在是完整的 Claude Code 插件！**
-- ✅ 自動 PostToolUse hook 攔截
-- ✅ 無需手動調用
-- ✅ 透明優化
-- ✅ 仍可作為獨立 MCP 伺服器使用
+✨ **多語言 Token 優化！**
+- ✅ 精確計算 15+ 種語言的 token（中文、日文、韓文、西班牙文、阿拉伯文等）
+- ✅ 語言感知的 token 倍數（中文 2 倍、日文 2.5 倍、阿拉伯文 3 倍）
+- ✅ 支援混合語言文本的自動偵測
+- ✅ 基於真實基準測試改進優化準確性
+- ✅ 數據支持的 token 節省聲明（30-65% 範圍，通常 50-55%）
 
 ## 功能特色
 
-- **60%+ Token 減少** - 針對 JSON、CSV、YAML 數據
-- **完全自動** - PostToolUse hook 自動攔截工具結果
-- **零配置** - 開箱即用，預設值合理
-- **雙模式** - 插件模式（自動）+ MCP 伺服器模式（手動）
-- **內建指標** - 本地追蹤 token 節省
-- **靜默降級** - 永不中斷工作流程
+- **30-65% Token 減少**（通常 50-55%）適用於 JSON、CSV、YAML 數據
+- **多語言支援** - 精確計算 15+ 種語言的 token
+- **完全自動** - PostToolUse hook 攔截工具結果
+- **零配置** - 開箱即用，採用合理預設值
+- **雙模式** - 作為外掛程式（自動）或 MCP 伺服器（手動）
+- **內建指標** - 在本地追蹤 token 節省
+- **靜默回退** - 永不中斷您的工作流程
 
 ## 安裝方式
 
@@ -79,7 +81,7 @@ Hook 偵測 JSON，轉換為 TOON
   ↓
 優化後的內容發送到 Claude API
   ↓
-實現 60% token 減少 ✨
+達成 50-55% 典型 token 減少 ✨
 ```
 
 ### MCP 伺服器模式（手動）
@@ -241,6 +243,15 @@ MIT License - 請參閱 [LICENSE](LICENSE)
 
 ## 更新日誌
 
+### v0.3.0（2025-12-26）
+- ✨ **多語言 token 優化** - 精確計算 15+ 種語言
+- ✨ 語言感知的 token 倍數（中文 2 倍、日文 2.5 倍、阿拉伯文 3 倍等）
+- ✨ 混合語言文本偵測和優化
+- ✨ 使用真實統計數據進行全面基準測試
+- 📊 數據支持的 token 節省聲明（30-65% 範圍，通常 50-55%）
+- ✅ 75+ 測試通過，包括多語言邊緣情況
+- 📝 多語言 README 版本
+
 ### v0.2.0 (2025-12-25)
 - ✨ 新增 Claude Code 插件支援與 PostToolUse hook
 - ✨ 自動 token 優化（無需手動調用）

package/dist/metrics/metrics-collector.d.ts

@@ -12,6 +12,8 @@ export interface OptimizationMetric {
     wasOptimized: boolean;
     format?: string;
     reason?: string;
+    wasCached?: boolean;
+    cacheSavings?: number;
 }
 export declare class MetricsCollector {
     private statsPath;

package/dist/metrics/metrics-collector.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"metrics-collector.d.ts","sourceRoot":"","sources":["../../src/metrics/metrics-collector.ts"],"names":[],"mappings":"AAAA;;GAEG;AAKH,OAAO,KAAK,EAAE,UAAU,EAAE,MAAM,uBAAuB,CAAC;AAExD,MAAM,WAAW,kBAAkB;IACjC,SAAS,EAAE,MAAM,CAAC;IAClB,QAAQ,EAAE,MAAM,CAAC;IACjB,cAAc,EAAE,MAAM,CAAC;IACvB,eAAe,EAAE,MAAM,CAAC;IACxB,OAAO,EAAE,MAAM,CAAC;IAChB,iBAAiB,EAAE,MAAM,CAAC;IAC1B,YAAY,EAAE,OAAO,CAAC;IACtB,MAAM,CAAC,EAAE,MAAM,CAAC;IAChB,MAAM,CAAC,EAAE,MAAM,CAAC;CACjB;AAED,qBAAa,gBAAgB;IAC3B,OAAO,CAAC,SAAS,CAAS;;IAW1B;;OAEG;IACG,MAAM,CAAC,MAAM,EAAE,kBAAkB,GAAG,OAAO,CAAC,IAAI,CAAC;IA2BvD;;OAEG;IACG,QAAQ,IAAI,OAAO,CAAC,UAAU,CAAC;IAIrC;;OAEG;YACW,SAAS;IAoBvB;;OAEG;YACW,SAAS;IAQvB;;OAEG;IACG,eAAe,IAAI,OAAO,CAAC,MAAM,CAAC;CAiBzC"}
+{"version":3,"file":"metrics-collector.d.ts","sourceRoot":"","sources":["../../src/metrics/metrics-collector.ts"],"names":[],"mappings":"AAAA;;GAEG;AAKH,OAAO,KAAK,EAAE,UAAU,EAAE,MAAM,uBAAuB,CAAC;AAExD,MAAM,WAAW,kBAAkB;IACjC,SAAS,EAAE,MAAM,CAAC;IAClB,QAAQ,EAAE,MAAM,CAAC;IACjB,cAAc,EAAE,MAAM,CAAC;IACvB,eAAe,EAAE,MAAM,CAAC;IACxB,OAAO,EAAE,MAAM,CAAC;IAChB,iBAAiB,EAAE,MAAM,CAAC;IAC1B,YAAY,EAAE,OAAO,CAAC;IACtB,MAAM,CAAC,EAAE,MAAM,CAAC;IAChB,MAAM,CAAC,EAAE,MAAM,CAAC;IAEhB,SAAS,CAAC,EAAE,OAAO,CAAC;IACpB,YAAY,CAAC,EAAE,MAAM,CAAC;CACvB;AAED,qBAAa,gBAAgB;IAC3B,OAAO,CAAC,SAAS,CAAS;;IAW1B;;OAEG;IACG,MAAM,CAAC,MAAM,EAAE,kBAAkB,GAAG,OAAO,CAAC,IAAI,CAAC;IAuCvD;;OAEG;IACG,QAAQ,IAAI,OAAO,CAAC,UAAU,CAAC;IAIrC;;OAEG;YACW,SAAS;IAyBvB;;OAEG;YACW,SAAS;IAQvB;;OAEG;IACG,eAAe,IAAI,OAAO,CAAC,MAAM,CAAC;CAyCzC"}

package/dist/metrics/metrics-collector.js

@@ -24,6 +24,17 @@ export class MetricsCollector {
             stats.tokensBeforeOptimization += metric.originalTokens;
             stats.tokensAfterOptimization += metric.optimizedTokens;
             stats.totalSavings += metric.savings;
+            // v0.3.0: Track cache metrics
+            if (metric.wasCached) {
+                stats.cacheHits = (stats.cacheHits || 0) + 1;
+                stats.estimatedCacheSavings = (stats.estimatedCacheSavings || 0) + (metric.cacheSavings || 0);
+            }
+            else if (metric.wasOptimized) {
+                stats.cacheMisses = (stats.cacheMisses || 0) + 1;
+            }
+            // Calculate cache hit rate
+            const totalCacheAttempts = (stats.cacheHits || 0) + (stats.cacheMisses || 0);
+            stats.cacheHitRate = totalCacheAttempts > 0 ? (stats.cacheHits || 0) / totalCacheAttempts : 0;
             // Recalculate average
             stats.averageSavingsPercentage =
                 stats.optimizedRequests > 0
@@ -61,6 +72,11 @@ export class MetricsCollector {
                 tokensAfterOptimization: 0,
                 totalSavings: 0,
                 averageSavingsPercentage: 0,
+                // v0.3.0: Cache stats
+                cacheHits: 0,
+                cacheMisses: 0,
+                cacheHitRate: 0,
+                estimatedCacheSavings: 0,
             };
         }
     }
@@ -75,19 +91,38 @@ export class MetricsCollector {
      */
     async formatDashboard() {
         const stats = await this.getStats();
-        return `
-📊 Token Optimization Stats
-━━━━━━━━━━━━━━━━━━━━━━━━
+        const optimizationRate = stats.totalRequests > 0
+            ? ((stats.optimizedRequests / stats.totalRequests) * 100).toFixed(1)
+            : '0.0';
+        // v0.3.0: Calculate total savings including cache
+        const totalSavingsWithCache = stats.totalSavings + (stats.estimatedCacheSavings || 0);
+        const costSavings = ((totalSavingsWithCache / 1_000_000) * 3).toFixed(2);
+        let dashboard = `
+📊 Token Optimization Stats (v0.3.0)
+━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
 Total Requests: ${stats.totalRequests}
-Optimized: ${stats.optimizedRequests} (${((stats.optimizedRequests / stats.totalRequests) * 100).toFixed(1)}%)
+Optimized: ${stats.optimizedRequests} (${optimizationRate}%)
 
 Tokens Before: ${stats.tokensBeforeOptimization.toLocaleString()}
 Tokens After: ${stats.tokensAfterOptimization.toLocaleString()}
-Total Savings: ${stats.totalSavings.toLocaleString()} (${stats.averageSavingsPercentage.toFixed(1)}%)
+Total Savings: ${stats.totalSavings.toLocaleString()} (${stats.averageSavingsPercentage.toFixed(1)}%)`;
+        // Add cache stats if available
+        if (stats.cacheHits || stats.cacheMisses) {
+            const cacheHitRate = (stats.cacheHitRate * 100).toFixed(1);
+            dashboard += `
+
+🚀 Prompt Caching Stats
+━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
+Cache Hits: ${stats.cacheHits}
+Cache Misses: ${stats.cacheMisses}
+Hit Rate: ${cacheHitRate}%
+Additional Cache Savings: ${(stats.estimatedCacheSavings || 0).toLocaleString()} tokens`;
+        }
+        dashboard += `
 
-💰 Cost Savings (at $3/1M input tokens):
-   $${((stats.totalSavings / 1_000_000) * 3).toFixed(2)} saved
-`.trim();
+💰 Total Cost Savings (at $3/1M input tokens):
+   $${costSavings} saved`;
+        return dashboard.trim();
     }
 }
 //# sourceMappingURL=metrics-collector.js.map

package/dist/metrics/metrics-collector.js.map

@@ -1 +1 @@
-{"version":3,"file":"metrics-collector.js","sourceRoot":"","sources":["../../src/metrics/metrics-collector.ts"],"names":[],"mappings":"AAAA;;GAEG;AAEH,OAAO,EAAE,QAAQ,IAAI,EAAE,EAAE,MAAM,IAAI,CAAC;AACpC,OAAO,IAAI,MAAM,MAAM,CAAC;AACxB,OAAO,EAAE,MAAM,IAAI,CAAC;AAepB,MAAM,OAAO,gBAAgB;IACnB,SAAS,CAAS;IAE1B;QACE,iDAAiD;QACjD,IAAI,CAAC,SAAS,GAAG,IAAI,CAAC,IAAI,CACxB,EAAE,CAAC,OAAO,EAAE,EACZ,SAAS,EACT,kBAAkB,CACnB,CAAC;IACJ,CAAC;IAED;;OAEG;IACH,KAAK,CAAC,MAAM,CAAC,MAA0B;QACrC,IAAI,CAAC;YACH,MAAM,KAAK,GAAG,MAAM,IAAI,CAAC,SAAS,EAAE,CAAC;YAErC,0BAA0B;YAC1B,KAAK,CAAC,aAAa,EAAE,CAAC;YACtB,IAAI,MAAM,CAAC,YAAY,EAAE,CAAC;gBACxB,KAAK,CAAC,iBAAiB,EAAE,CAAC;YAC5B,CAAC;YAED,KAAK,CAAC,wBAAwB,IAAI,MAAM,CAAC,cAAc,CAAC;YACxD,KAAK,CAAC,uBAAuB,IAAI,MAAM,CAAC,eAAe,CAAC;YACxD,KAAK,CAAC,YAAY,IAAI,MAAM,CAAC,OAAO,CAAC;YAErC,sBAAsB;YACtB,KAAK,CAAC,wBAAwB;gBAC5B,KAAK,CAAC,iBAAiB,GAAG,CAAC;oBACzB,CAAC,CAAC,CAAC,KAAK,CAAC,YAAY,GAAG,KAAK,CAAC,wBAAwB,CAAC,GAAG,GAAG;oBAC7D,CAAC,CAAC,CAAC,CAAC;YAER,MAAM,IAAI,CAAC,SAAS,CAAC,KAAK,CAAC,CAAC;QAC9B,CAAC;QAAC,OAAO,KAAK,EAAE,CAAC;YACf,4DAA4D;YAC5D,OAAO,CAAC,KAAK,CAAC,2BAA2B,EAAE,KAAK,CAAC,CAAC;QACpD,CAAC;IACH,CAAC;IAED;;OAEG;IACH,KAAK,CAAC,QAAQ;QACZ,OAAO,MAAM,IAAI,CAAC,SAAS,EAAE,CAAC;IAChC,CAAC;IAED;;OAEG;IACK,KAAK,CAAC,SAAS;QACrB,IAAI,CAAC;YACH,0BAA0B;YAC1B,MAAM,EAAE,CAAC,KAAK,CAAC,IAAI,CAAC,OAAO,CAAC,IAAI,CAAC,SAAS,CAAC,EAAE,EAAE,SAAS,EAAE,IAAI,EAAE,CAAC,CAAC;YAElE,MAAM,IAAI,GAAG,MAAM,EAAE,CAAC,QAAQ,CAAC,IAAI,CAAC,SAAS,EAAE,OAAO,CAAC,CAAC;YACxD,OAAO,IAAI,CAAC,KAAK,CAAC,IAAI,CAAC,CAAC;QAC1B,CAAC;QAAC,MAAM,CAAC;YACP,2CAA2C;YAC3C,OAAO;gBACL,aAAa,EAAE,CAAC;gBAChB,iBAAiB,EAAE,CAAC;gBACpB,wBAAwB,EAAE,CAAC;gBAC3B,uBAAuB,EAAE,CAAC;gBAC1B,YAAY,EAAE,CAAC;gBACf,wBAAwB,EAAE,CAAC;aAC5B,CAAC;QACJ,CAAC;IACH,CAAC;IAED;;OAEG;IACK,KAAK,CAAC,SAAS,CAAC,KAAiB;QACvC,MAAM,EAAE,CAAC,SAAS,CAChB,IAAI,CAAC,SAAS,EACd,IAAI,CAAC,SAAS,CAAC,KAAK,EAAE,IAAI,EAAE,CAAC,CAAC,EAC9B,OAAO,CACR,CAAC;IACJ,CAAC;IAED;;OAEG;IACH,KAAK,CAAC,eAAe;QACnB,MAAM,KAAK,GAAG,MAAM,IAAI,CAAC,QAAQ,EAAE,CAAC;QAEpC,OAAO;;;kBAGO,KAAK,CAAC,aAAa;aACxB,KAAK,CAAC,iBAAiB,KAAK,CAAC,CAAC,KAAK,CAAC,iBAAiB,GAAG,KAAK,CAAC,aAAa,CAAC,GAAG,GAAG,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC;;iBAE1F,KAAK,CAAC,wBAAwB,CAAC,cAAc,EAAE;gBAChD,KAAK,CAAC,uBAAuB,CAAC,cAAc,EAAE;iBAC7C,KAAK,CAAC,YAAY,CAAC,cAAc,EAAE,KAAK,KAAK,CAAC,wBAAwB,CAAC,OAAO,CAAC,CAAC,CAAC;;;MAG5F,CAAC,CAAC,KAAK,CAAC,YAAY,GAAG,SAAS,CAAC,GAAG,CAAC,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC;CACtD,CAAC,IAAI,EAAE,CAAC;IACP,CAAC;CACF"}
+{"version":3,"file":"metrics-collector.js","sourceRoot":"","sources":["../../src/metrics/metrics-collector.ts"],"names":[],"mappings":"AAAA;;GAEG;AAEH,OAAO,EAAE,QAAQ,IAAI,EAAE,EAAE,MAAM,IAAI,CAAC;AACpC,OAAO,IAAI,MAAM,MAAM,CAAC;AACxB,OAAO,EAAE,MAAM,IAAI,CAAC;AAkBpB,MAAM,OAAO,gBAAgB;IACnB,SAAS,CAAS;IAE1B;QACE,iDAAiD;QACjD,IAAI,CAAC,SAAS,GAAG,IAAI,CAAC,IAAI,CACxB,EAAE,CAAC,OAAO,EAAE,EACZ,SAAS,EACT,kBAAkB,CACnB,CAAC;IACJ,CAAC;IAED;;OAEG;IACH,KAAK,CAAC,MAAM,CAAC,MAA0B;QACrC,IAAI,CAAC;YACH,MAAM,KAAK,GAAG,MAAM,IAAI,CAAC,SAAS,EAAE,CAAC;YAErC,0BAA0B;YAC1B,KAAK,CAAC,aAAa,EAAE,CAAC;YACtB,IAAI,MAAM,CAAC,YAAY,EAAE,CAAC;gBACxB,KAAK,CAAC,iBAAiB,EAAE,CAAC;YAC5B,CAAC;YAED,KAAK,CAAC,wBAAwB,IAAI,MAAM,CAAC,cAAc,CAAC;YACxD,KAAK,CAAC,uBAAuB,IAAI,MAAM,CAAC,eAAe,CAAC;YACxD,KAAK,CAAC,YAAY,IAAI,MAAM,CAAC,OAAO,CAAC;YAErC,8BAA8B;YAC9B,IAAI,MAAM,CAAC,SAAS,EAAE,CAAC;gBACrB,KAAK,CAAC,SAAS,GAAG,CAAC,KAAK,CAAC,SAAS,IAAI,CAAC,CAAC,GAAG,CAAC,CAAC;gBAC7C,KAAK,CAAC,qBAAqB,GAAG,CAAC,KAAK,CAAC,qBAAqB,IAAI,CAAC,CAAC,GAAG,CAAC,MAAM,CAAC,YAAY,IAAI,CAAC,CAAC,CAAC;YAChG,CAAC;iBAAM,IAAI,MAAM,CAAC,YAAY,EAAE,CAAC;gBAC/B,KAAK,CAAC,WAAW,GAAG,CAAC,KAAK,CAAC,WAAW,IAAI,CAAC,CAAC,GAAG,CAAC,CAAC;YACnD,CAAC;YAED,2BAA2B;YAC3B,MAAM,kBAAkB,GAAG,CAAC,KAAK,CAAC,SAAS,IAAI,CAAC,CAAC,GAAG,CAAC,KAAK,CAAC,WAAW,IAAI,CAAC,CAAC,CAAC;YAC7E,KAAK,CAAC,YAAY,GAAG,kBAAkB,GAAG,CAAC,CAAC,CAAC,CAAC,CAAC,KAAK,CAAC,SAAS,IAAI,CAAC,CAAC,GAAG,kBAAkB,CAAC,CAAC,CAAC,CAAC,CAAC;YAE9F,sBAAsB;YACtB,KAAK,CAAC,wBAAwB;gBAC5B,KAAK,CAAC,iBAAiB,GAAG,CAAC;oBACzB,CAAC,CAAC,CAAC,KAAK,CAAC,YAAY,GAAG,KAAK,CAAC,wBAAwB,CAAC,GAAG,GAAG;oBAC7D,CAAC,CAAC,CAAC,CAAC;YAER,MAAM,IAAI,CAAC,SAAS,CAAC,KAAK,CAAC,CAAC;QAC9B,CAAC;QAAC,OAAO,KAAK,EAAE,CAAC;YACf,4DAA4D;YAC5D,OAAO,CAAC,KAAK,CAAC,2BAA2B,EAAE,KAAK,CAAC,CAAC;QACpD,CAAC;IACH,CAAC;IAED;;OAEG;IACH,KAAK,CAAC,QAAQ;QACZ,OAAO,MAAM,IAAI,CAAC,SAAS,EAAE,CAAC;IAChC,CAAC;IAED;;OAEG;IACK,KAAK,CAAC,SAAS;QACrB,IAAI,CAAC;YACH,0BAA0B;YAC1B,MAAM,EAAE,CAAC,KAAK,CAAC,IAAI,CAAC,OAAO,CAAC,IAAI,CAAC,SAAS,CAAC,EAAE,EAAE,SAAS,EAAE,IAAI,EAAE,CAAC,CAAC;YAElE,MAAM,IAAI,GAAG,MAAM,EAAE,CAAC,QAAQ,CAAC,IAAI,CAAC,SAAS,EAAE,OAAO,CAAC,CAAC;YACxD,OAAO,IAAI,CAAC,KAAK,CAAC,IAAI,CAAC,CAAC;QAC1B,CAAC;QAAC,MAAM,CAAC;YACP,2CAA2C;YAC3C,OAAO;gBACL,aAAa,EAAE,CAAC;gBAChB,iBAAiB,EAAE,CAAC;gBACpB,wBAAwB,EAAE,CAAC;gBAC3B,uBAAuB,EAAE,CAAC;gBAC1B,YAAY,EAAE,CAAC;gBACf,wBAAwB,EAAE,CAAC;gBAC3B,sBAAsB;gBACtB,SAAS,EAAE,CAAC;gBACZ,WAAW,EAAE,CAAC;gBACd,YAAY,EAAE,CAAC;gBACf,qBAAqB,EAAE,CAAC;aACzB,CAAC;QACJ,CAAC;IACH,CAAC;IAED;;OAEG;IACK,KAAK,CAAC,SAAS,CAAC,KAAiB;QACvC,MAAM,EAAE,CAAC,SAAS,CAChB,IAAI,CAAC,SAAS,EACd,IAAI,CAAC,SAAS,CAAC,KAAK,EAAE,IAAI,EAAE,CAAC,CAAC,EAC9B,OAAO,CACR,CAAC;IACJ,CAAC;IAED;;OAEG;IACH,KAAK,CAAC,eAAe;QACnB,MAAM,KAAK,GAAG,MAAM,IAAI,CAAC,QAAQ,EAAE,CAAC;QAEpC,MAAM,gBAAgB,GAAG,KAAK,CAAC,aAAa,GAAG,CAAC;YAC9C,CAAC,CAAC,CAAC,CAAC,KAAK,CAAC,iBAAiB,GAAG,KAAK,CAAC,aAAa,CAAC,GAAG,GAAG,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC;YACpE,CAAC,CAAC,KAAK,CAAC;QAEV,kDAAkD;QAClD,MAAM,qBAAqB,GAAG,KAAK,CAAC,YAAY,GAAG,CAAC,KAAK,CAAC,qBAAqB,IAAI,CAAC,CAAC,CAAC;QACtF,MAAM,WAAW,GAAG,CAAC,CAAC,qBAAqB,GAAG,SAAS,CAAC,GAAG,CAAC,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC,CAAC;QAEzE,IAAI,SAAS,GAAG;;;kBAGF,KAAK,CAAC,aAAa;aACxB,KAAK,CAAC,iBAAiB,KAAK,gBAAgB;;iBAExC,KAAK,CAAC,wBAAwB,CAAC,cAAc,EAAE;gBAChD,KAAK,CAAC,uBAAuB,CAAC,cAAc,EAAE;iBAC7C,KAAK,CAAC,YAAY,CAAC,cAAc,EAAE,KAAK,KAAK,CAAC,wBAAwB,CAAC,OAAO,CAAC,CAAC,CAAC,IAAI,CAAC;QAEnG,+BAA+B;QAC/B,IAAI,KAAK,CAAC,SAAS,IAAI,KAAK,CAAC,WAAW,EAAE,CAAC;YACzC,MAAM,YAAY,GAAG,CAAC,KAAK,CAAC,YAAa,GAAG,GAAG,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC,CAAC;YAC5D,SAAS,IAAI;;;;cAIL,KAAK,CAAC,SAAS;gBACb,KAAK,CAAC,WAAW;YACrB,YAAY;4BACI,CAAC,KAAK,CAAC,qBAAqB,IAAI,CAAC,CAAC,CAAC,cAAc,EAAE,SAAS,CAAC;QACrF,CAAC;QAED,SAAS,IAAI;;;MAGX,WAAW,QAAQ,CAAC;QAEtB,OAAO,SAAS,CAAC,IAAI,EAAE,CAAC;IAC1B,CAAC;CACF"}

package/dist/optimizer/caching/cache-optimizer.d.ts

@@ -0,0 +1,53 @@
+/**
+ * Cache Optimizer: Structures content for prompt caching
+ */
+import type { CacheConfig, CachedContent, CacheMetrics } from './cache-types.js';
+export declare class CacheOptimizer {
+    private config;
+    private metrics;
+    constructor(config?: Partial<CacheConfig>);
+    /**
+     * Wrap optimized TOON content with cache-friendly structure
+     */
+    wrapWithCaching(toonContent: string, toolName: string, format: 'json' | 'csv' | 'yaml', originalTokens: number, optimizedTokens: number): CachedContent;
+    /**
+     * Create cacheable static prefix with TOON format instructions
+     */
+    private createStaticPrefix;
+    /**
+     * Format TOON output with metadata
+     */
+    private formatTOONOutput;
+    /**
+     * Format for Anthropic cache_control API
+     */
+    formatForAnthropic(cached: CachedContent): any[];
+    /**
+     * Format for OpenAI (structured but no explicit cache control)
+     */
+    formatForOpenAI(cached: CachedContent): {
+        system: string;
+        user: string;
+    };
+    /**
+     * Get current cache metrics
+     */
+    getMetrics(): CacheMetrics;
+    /**
+     * Record a cache hit (when static prefix is reused)
+     */
+    recordCacheHit(savedTokens: number): void;
+    /**
+     * Record a cache miss (when static prefix is not cached)
+     */
+    recordCacheMiss(): void;
+    /**
+     * Update cache hit rate
+     */
+    private updateHitRate;
+    /**
+     * Reset metrics
+     */
+    resetMetrics(): void;
+}
+//# sourceMappingURL=cache-optimizer.d.ts.map

package/dist/optimizer/caching/cache-optimizer.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"cache-optimizer.d.ts","sourceRoot":"","sources":["../../../src/optimizer/caching/cache-optimizer.ts"],"names":[],"mappings":"AAAA;;GAEG;AAEH,OAAO,KAAK,EAAE,WAAW,EAAE,aAAa,EAAiB,YAAY,EAAE,MAAM,kBAAkB,CAAC;AAGhG,qBAAa,cAAc;IACzB,OAAO,CAAC,MAAM,CAAc;IAC5B,OAAO,CAAC,OAAO,CAAe;gBAElB,MAAM,GAAE,OAAO,CAAC,WAAW,CAAM;IAoB7C;;OAEG;IACH,eAAe,CACb,WAAW,EAAE,MAAM,EACnB,QAAQ,EAAE,MAAM,EAChB,MAAM,EAAE,MAAM,GAAG,KAAK,GAAG,MAAM,EAC/B,cAAc,EAAE,MAAM,EACtB,eAAe,EAAE,MAAM,GACtB,aAAa;IAgDhB;;OAEG;IACH,OAAO,CAAC,kBAAkB;IA6B1B;;OAEG;IACH,OAAO,CAAC,gBAAgB;IAIxB;;OAEG;IACH,kBAAkB,CAAC,MAAM,EAAE,aAAa,GAAG,GAAG,EAAE;IAkBhD;;OAEG;IACH,eAAe,CAAC,MAAM,EAAE,aAAa,GAAG;QAAE,MAAM,EAAE,MAAM,CAAC;QAAC,IAAI,EAAE,MAAM,CAAA;KAAE;IAOxE;;OAEG;IACH,UAAU,IAAI,YAAY;IAI1B;;OAEG;IACH,cAAc,CAAC,WAAW,EAAE,MAAM,GAAG,IAAI;IAMzC;;OAEG;IACH,eAAe,IAAI,IAAI;IAKvB;;OAEG;IACH,OAAO,CAAC,aAAa;IAKrB;;OAEG;IACH,YAAY,IAAI,IAAI;CAUrB"}

package/dist/optimizer/caching/cache-optimizer.js

@@ -0,0 +1,176 @@
+/**
+ * Cache Optimizer: Structures content for prompt caching
+ */
+import { getStrategy } from './cache-strategies.js';
+export class CacheOptimizer {
+    config;
+    metrics;
+    constructor(config = {}) {
+        this.config = {
+            enabled: true,
+            provider: 'auto',
+            ttl: '1hour',
+            cacheStaticPrompts: true,
+            minCacheableTokens: 1024,
+            ...config
+        };
+        this.metrics = {
+            cacheHits: 0,
+            cacheMisses: 0,
+            cacheHitRate: 0,
+            estimatedCacheSavings: 0,
+            totalCacheableTokens: 0,
+            averageCacheReuseCount: 0
+        };
+    }
+    /**
+     * Wrap optimized TOON content with cache-friendly structure
+     */
+    wrapWithCaching(toonContent, toolName, format, originalTokens, optimizedTokens) {
+        if (!this.config.enabled || !this.config.cacheStaticPrompts) {
+            // Return non-cached structure
+            return {
+                staticPrefix: '',
+                dynamicContent: this.formatTOONOutput(toonContent, toolName, format),
+                cacheBreakpoint: false
+            };
+        }
+        // Check if content is large enough for caching
+        const strategy = getStrategy(this.config.provider);
+        if (!strategy.shouldCache(toonContent, optimizedTokens)) {
+            return {
+                staticPrefix: '',
+                dynamicContent: this.formatTOONOutput(toonContent, toolName, format),
+                cacheBreakpoint: false
+            };
+        }
+        // Create cacheable static prefix
+        const staticPrefix = this.createStaticPrefix(toolName, format);
+        // Dynamic content (cache breakpoint here)
+        const dynamicContent = `\n[DATA]\n${toonContent}`;
+        // Estimate cache size
+        const estimatedCacheSize = staticPrefix.length / 4; // Rough estimate
+        const metadata = {
+            provider: this.config.provider === 'auto' ?
+                (process.env.ANTHROPIC_API_KEY ? 'anthropic' : 'openai') :
+                this.config.provider,
+            estimatedCacheSize,
+            ttl: this.config.ttl
+        };
+        // Update metrics
+        this.metrics.totalCacheableTokens += estimatedCacheSize;
+        return {
+            staticPrefix,
+            dynamicContent,
+            cacheBreakpoint: true,
+            cacheMetadata: metadata
+        };
+    }
+    /**
+     * Create cacheable static prefix with TOON format instructions
+     */
+    createStaticPrefix(toolName, format) {
+        return `[SYSTEM] Token-Optimized Data from ${toolName}
+
+The following data has been converted to TOON format for token efficiency.
+
+TOON Format Specification:
+- Arrays: name[size]{fields}: value1,value2
+  Example: users[2]{id,name}: 1,Alice 2,Bob
+
+- Objects: key: value
+  Example: config.port: 8080
+
+- Nested structures: parent.child: value
+  Example: server.config.timeout: 30
+
+- Mixed types supported: strings, numbers, booleans, null
+
+Source Format: ${format.toUpperCase()}
+Optimization: ~60-95% token reduction
+
+Instructions:
+1. Parse the TOON-formatted data below
+2. Interpret field names from the schema
+3. Reconstruct the original data structure if needed
+4. Use the data to answer the user's request
+
+---`;
+    }
+    /**
+     * Format TOON output with metadata
+     */
+    formatTOONOutput(toonContent, toolName, format) {
+        return `[TOON-${format.toUpperCase()}]\n${toonContent}`;
+    }
+    /**
+     * Format for Anthropic cache_control API
+     */
+    formatForAnthropic(cached) {
+        if (!cached.cacheBreakpoint) {
+            return [{ type: 'text', text: cached.dynamicContent }];
+        }
+        return [
+            {
+                type: 'text',
+                text: cached.staticPrefix,
+                cache_control: { type: 'ephemeral' }
+            },
+            {
+                type: 'text',
+                text: cached.dynamicContent
+            }
+        ];
+    }
+    /**
+     * Format for OpenAI (structured but no explicit cache control)
+     */
+    formatForOpenAI(cached) {
+        return {
+            system: cached.staticPrefix || 'Process the following TOON-formatted data:',
+            user: cached.dynamicContent
+        };
+    }
+    /**
+     * Get current cache metrics
+     */
+    getMetrics() {
+        return { ...this.metrics };
+    }
+    /**
+     * Record a cache hit (when static prefix is reused)
+     */
+    recordCacheHit(savedTokens) {
+        this.metrics.cacheHits++;
+        this.metrics.estimatedCacheSavings += savedTokens;
+        this.updateHitRate();
+    }
+    /**
+     * Record a cache miss (when static prefix is not cached)
+     */
+    recordCacheMiss() {
+        this.metrics.cacheMisses++;
+        this.updateHitRate();
+    }
+    /**
+     * Update cache hit rate
+     */
+    updateHitRate() {
+        const total = this.metrics.cacheHits + this.metrics.cacheMisses;
+        this.metrics.cacheHitRate = total > 0 ? this.metrics.cacheHits / total : 0;
+    }
+    /**
+     * Reset metrics
+     */
+    resetMetrics() {
+        this.metrics = {
+            cacheHits: 0,
+            cacheMisses: 0,
+            cacheHitRate: 0,
+            estimatedCacheSavings: 0,
+            totalCacheableTokens: 0,
+            averageCacheReuseCount: 0
+        };
+    }
+}
+//# sourceMappingURL=cache-optimizer.js.map