@rely-ai/caliber 1.5.5 → 1.6.0

package/README.md

@@ -8,13 +8,27 @@
   <a href="https://nodejs.org"><img src="https://img.shields.io/node/v/@rely-ai/caliber" alt="node"></a>
 </p>
 
-<p align="center"><strong>Analyze your codebase. Generate optimized AI agent configs. One command.</strong></p>
+<p align="center"><strong>Improve your agentic development experience with one command</strong></p>
 
 ---
 
 Caliber scans your project — languages, frameworks, dependencies, file structure — and generates tailored config files for **Claude Code**, **Cursor**, and **OpenAI Codex**. If configs already exist, it audits them against your actual codebase and suggests targeted improvements.
 
-🔑 **No API key required** — use your existing Claude Code or Cursor subscription. Or bring your own key (Anthropic, OpenAI, Vertex AI, any OpenAI-compatible endpoint).
+🔑 **API Key Optional** — use your existing Claude Code or Cursor subscription. Or bring your own key (Anthropic, OpenAI, Vertex AI, any OpenAI-compatible endpoint).
+
+🧠 **BYOAI** — Caliber works where you do. All LLM processing runs through your own models — no data is sent to third parties.
+
+### Why Caliber?
+
+Caliber **generates, audits, and maintains** your agentic development sessions.
+
+- 🏗️ **Generates, not just score** — builds your CLAUDE.md, Cursor rules, AGENTS.md, skills, and MCP configs from scratch
+- 🔀 **Multi-agent** — one command sets up Claude Code, Cursor, and Codex together
+- 🌍 **Any codebase** — TypeScript, Python, Go, Rust, Terraform, Java, Ruby — detection is fully LLM-driven, not hardcoded
+- 🧩 **Finds and installs skills** — searches community registries and installs relevant skills for your stack
+- 🔗 **Discovers MCP servers** — auto-detects tools your project uses and installs matching MCP servers
+- 🔄 **Keeps configs fresh** — git hooks and session hooks auto-update your docs as your code changes
+- ↩️ **Fully reversible** — automatic backups, score regression guard, and one-command undo
 
 ## 🚀 Quick Start
 
@@ -32,6 +46,7 @@ caliber onboard
 ```
 
 > **Already have an API key?** Skip the interactive setup:
+>
 > ```bash
 > export ANTHROPIC_API_KEY=sk-ant-...
 > npx @rely-ai/caliber onboard
@@ -65,18 +80,18 @@ Caliber works on **any codebase** — TypeScript, Python, Go, Rust, Terraform, J
 
 ### 📦 What It Generates
 
-| File | Platform | Purpose |
-|------|----------|---------|
-| `CLAUDE.md` | Claude Code | Project context — build/test commands, architecture, conventions |
-| `.cursor/rules/*.mdc` | Cursor | Modern rules with frontmatter (description, globs, alwaysApply) |
-| `.cursorrules` | Cursor | Legacy rules file (if no `.cursor/rules/` exists) |
-| `AGENTS.md` | Codex | Project context for OpenAI Codex |
+| File                        | Platform    | Purpose                                                             |
+| --------------------------- | ----------- | ------------------------------------------------------------------- |
+| `CLAUDE.md`                 | Claude Code | Project context — build/test commands, architecture, conventions    |
+| `.cursor/rules/*.mdc`       | Cursor      | Modern rules with frontmatter (description, globs, alwaysApply)     |
+| `.cursorrules`              | Cursor      | Legacy rules file (if no `.cursor/rules/` exists)                   |
+| `AGENTS.md`                 | Codex       | Project context for OpenAI Codex                                    |
 | `.claude/skills/*/SKILL.md` | Claude Code | Reusable skill files following [OpenSkills](https://agentskills.io) |
-| `.cursor/skills/*/SKILL.md` | Cursor | Skills for Cursor |
-| `.agents/skills/*/SKILL.md` | Codex | Skills for Codex |
-| `.mcp.json` | Claude Code | MCP server configurations |
-| `.cursor/mcp.json` | Cursor | MCP server configurations |
-| `.claude/settings.json` | Claude Code | Permissions and hooks |
+| `.cursor/skills/*/SKILL.md` | Cursor      | Skills for Cursor                                                   |
+| `.agents/skills/*/SKILL.md` | Codex       | Skills for Codex                                                    |
+| `.mcp.json`                 | Claude Code | MCP server configurations                                           |
+| `.cursor/mcp.json`          | Cursor      | MCP server configurations                                           |
+| `.claude/settings.json`     | Claude Code | Permissions and hooks                                               |
 
 If these files already exist, Caliber audits them and suggests improvements — keeping what works, fixing what's stale, adding what's missing.
 
@@ -91,17 +106,17 @@ Every change Caliber makes is reversible:
 
 ## 📋 Commands
 
-| Command | Description |
-|---------|-------------|
-| `caliber onboard` | 🏁 Onboard your project — full 6-step wizard |
-| `caliber score` | 📊 Score your config quality (deterministic, no LLM) |
-| `caliber skills` | 🧩 Discover and install community skills |
-| `caliber regenerate` | 🔄 Re-analyze and regenerate your setup |
-| `caliber refresh` | 🔃 Update docs based on recent code changes |
-| `caliber hooks` | 🪝 Manage auto-refresh hooks |
-| `caliber config` | ⚙️ Configure LLM provider, API key, and model |
-| `caliber status` | 📌 Show current setup status |
-| `caliber undo` | ↩️ Revert all changes made by Caliber |
+| Command              | Description                                          |
+| -------------------- | ---------------------------------------------------- |
+| `caliber onboard`    | 🏁 Onboard your project — full 6-step wizard         |
+| `caliber score`      | 📊 Score your config quality (deterministic, no LLM) |
+| `caliber skills`     | 🧩 Discover and install community skills             |
+| `caliber regenerate` | 🔄 Re-analyze and regenerate your setup              |
+| `caliber refresh`    | 🔃 Update docs based on recent code changes          |
+| `caliber hooks`      | 🪝 Manage auto-refresh hooks                         |
+| `caliber config`     | ⚙️ Configure LLM provider, API key, and model        |
+| `caliber status`     | 📌 Show current setup status                         |
+| `caliber undo`       | ↩️ Revert all changes made by Caliber                |
 
 ### Examples
 
@@ -134,7 +149,7 @@ caliber undo                         # Revert everything
 
 ## 📊 Scoring
 
-`caliber score` gives you a deterministic quality score — no LLM calls, no network, instant results.
+`caliber score` gives you a deterministic quality score using industry best practices.
 
 ```
   Config Score: 87/100 (A) ✨
@@ -147,37 +162,33 @@ caliber undo                         # Revert everything
   BONUS               5/5   ████████████████████████
 ```
 
-| Category | Points | What it checks |
-|----------|--------|----------------|
-| **Files & Setup** | 25 | Config files exist, skills present, cross-platform parity |
-| **Quality** | 25 | Has build/test commands, not bloated, no vague text, no duplicates |
-| **Coverage** | 20 | Mentions actual dependencies and services |
-| **Accuracy** | 15 | Documented commands and file paths are valid |
-| **Freshness & Safety** | 10 | Recently updated, no leaked secrets, permissions set |
-| **Bonus** | 5 | Auto-refresh hooks, AGENTS.md, OpenSkills format |
+| Category               | Points | What it checks                                                     |
+| ---------------------- | ------ | ------------------------------------------------------------------ |
+| **Files & Setup**      | 25     | Config files exist, skills present, cross-platform parity          |
+| **Quality**            | 25     | Has build/test commands, not bloated, no vague text, no duplicates |
+| **Coverage**           | 20     | Mentions actual dependencies and services                          |
+| **Accuracy**           | 15     | Documented commands and file paths are valid                       |
+| **Freshness & Safety** | 10     | Recently updated, no leaked secrets, permissions set               |
+| **Bonus**              | 5      | Auto-refresh hooks, AGENTS.md, OpenSkills format                   |
 
 ## 🧩 Skills
 
-Caliber searches three community registries and scores results against your project:
-
-- 🌐 [skills.sh](https://skills.sh) — OpenSkills registry
-- 🔧 [tessl.io](https://tessl.io) — Tessl skill registry
-- 📚 [Awesome Claude Code](https://github.com/hesreallyhim/awesome-claude-code) — Curated list
+Caliber searches three community registries and scores results against your project
 
 ```bash
 caliber skills
 ```
 
-Skills are scored by LLM relevance (0–100) based on your project's actual tech stack, then you pick which ones to install via an interactive selector. Installed skills follow the [OpenSkills](https://agentskills.io) standard with YAML frontmatter.
+Skills are scored by LLM relevance (0–100) based on your project's actual tech stack and development patterns, then you pick which ones to install via an interactive selector. Installed skills follow the [OpenSkills](https://agentskills.io) standard with YAML frontmatter.
 
 ## 🔄 Auto-Refresh
 
 Keep your agent configs in sync with your codebase automatically:
 
-| Hook | Trigger | What it does |
-|------|---------|--------------|
-| 🤖 **Claude Code** | End of each session | Runs `caliber refresh` and updates docs |
-| 📝 **Git pre-commit** | Before each commit | Refreshes docs and stages updated files |
+| Hook                  | Trigger             | What it does                            |
+| --------------------- | ------------------- | --------------------------------------- |
+| 🤖 **Claude Code**    | End of each session | Runs `caliber refresh` and updates docs |
+| 📝 **Git pre-commit** | Before each commit  | Refreshes docs and stages updated files |
 
 Set up hooks interactively with `caliber hooks`, or non-interactively:
 
@@ -190,14 +201,14 @@ The refresh command analyzes your git diff (committed, staged, and unstaged chan
 
 ## 🔌 LLM Providers
 
-| Provider | Setup | Default Model |
-|----------|-------|---------------|
-| 🟣 **Claude Code** (your seat) | `caliber config` → Claude Code | Inherited from Claude Code |
-| 🔵 **Cursor** (your seat) | `caliber config` → Cursor | Inherited from Cursor |
-| 🟠 **Anthropic** | `export ANTHROPIC_API_KEY=sk-ant-...` | `claude-sonnet-4-6` |
-| 🟢 **OpenAI** | `export OPENAI_API_KEY=sk-...` | `gpt-4.1` |
-| 🔴 **Vertex AI** | `export VERTEX_PROJECT_ID=my-project` | `claude-sonnet-4-6` |
-| ⚪ **Custom endpoint** | `OPENAI_API_KEY` + `OPENAI_BASE_URL` | `gpt-4.1` |
+| Provider                       | Setup                                 | Default Model              |
+| ------------------------------ | ------------------------------------- | -------------------------- |
+| 🟣 **Claude Code** (your seat) | `caliber config` → Claude Code        | Inherited from Claude Code |
+| 🔵 **Cursor** (your seat)      | `caliber config` → Cursor             | Inherited from Cursor      |
+| 🟠 **Anthropic**               | `export ANTHROPIC_API_KEY=sk-ant-...` | `claude-sonnet-4-6`        |
+| 🟢 **OpenAI**                  | `export OPENAI_API_KEY=sk-...`        | `gpt-4.1`                  |
+| 🔴 **Vertex AI**               | `export VERTEX_PROJECT_ID=my-project` | `claude-sonnet-4-6`        |
+| ⚪ **Custom endpoint**         | `OPENAI_API_KEY` + `OPENAI_BASE_URL`  | `gpt-4.1`                  |
 
 Override the model for any provider: `export CALIBER_MODEL=<model-name>` or use `caliber config`.
 
@@ -225,18 +236,18 @@ export GOOGLE_APPLICATION_CREDENTIALS=/path/to/service-account.json
 <details>
 <summary>Environment variables reference</summary>
 
-| Variable | Purpose |
-|----------|---------|
-| `ANTHROPIC_API_KEY` | Anthropic API key |
-| `OPENAI_API_KEY` | OpenAI API key |
-| `OPENAI_BASE_URL` | Custom OpenAI-compatible endpoint |
-| `VERTEX_PROJECT_ID` | GCP project ID for Vertex AI |
-| `VERTEX_REGION` | Vertex AI region (default: `us-east5`) |
-| `VERTEX_SA_CREDENTIALS` | Service account JSON (inline) |
-| `GOOGLE_APPLICATION_CREDENTIALS` | Service account JSON file path |
-| `CALIBER_USE_CLAUDE_CLI` | Use Claude Code CLI (`1` to enable) |
-| `CALIBER_USE_CURSOR_SEAT` | Use Cursor subscription (`1` to enable) |
-| `CALIBER_MODEL` | Override model for any provider |
+| Variable                         | Purpose                                 |
+| -------------------------------- | --------------------------------------- |
+| `ANTHROPIC_API_KEY`              | Anthropic API key                       |
+| `OPENAI_API_KEY`                 | OpenAI API key                          |
+| `OPENAI_BASE_URL`                | Custom OpenAI-compatible endpoint       |
+| `VERTEX_PROJECT_ID`              | GCP project ID for Vertex AI            |
+| `VERTEX_REGION`                  | Vertex AI region (default: `us-east5`)  |
+| `VERTEX_SA_CREDENTIALS`          | Service account JSON (inline)           |
+| `GOOGLE_APPLICATION_CREDENTIALS` | Service account JSON file path          |
+| `CALIBER_USE_CLAUDE_CLI`         | Use Claude Code CLI (`1` to enable)     |
+| `CALIBER_USE_CURSOR_SEAT`        | Use Cursor subscription (`1` to enable) |
+| `CALIBER_MODEL`                  | Override model for any provider         |
 
 </details>
 

package/dist/bin.js

@@ -520,6 +520,11 @@ var DEFAULT_MODELS = {
   cursor: "default",
   "claude-cli": "default"
 };
+var DEFAULT_FAST_MODELS = {
+  anthropic: "claude-haiku-4-5-20251001",
+  vertex: "claude-haiku-4-5-20251001",
+  openai: "gpt-4.1-mini"
+};
 function loadConfig() {
   const envConfig = resolveFromEnv();
   if (envConfig) return envConfig;
@@ -591,7 +596,12 @@ function getConfigFilePath() {
   return CONFIG_FILE;
 }
 function getFastModel() {
-  return process.env.CALIBER_FAST_MODEL || process.env.ANTHROPIC_SMALL_FAST_MODEL || void 0;
+  if (process.env.CALIBER_FAST_MODEL) return process.env.CALIBER_FAST_MODEL;
+  if (process.env.ANTHROPIC_SMALL_FAST_MODEL) return process.env.ANTHROPIC_SMALL_FAST_MODEL;
+  const config = loadConfig();
+  if (config?.fastModel) return config.fastModel;
+  if (config?.provider) return DEFAULT_FAST_MODELS[config.provider];
+  return void 0;
 }
 
 // src/llm/anthropic.ts
@@ -4361,6 +4371,7 @@ async function scoreWithLLM(candidates, toolDeps) {
     const vendorTag = c.vendor ? " [VENDOR/OFFICIAL]" : "";
     return `${i}. "${c.name}"${vendorTag} (${c.stars} stars) \u2014 ${c.description.slice(0, 100)}`;
   }).join("\n");
+  const fastModel = getFastModel();
   const scored = await llmJsonCall({
     system: SCORE_MCP_PROMPT,
     prompt: `TOOL DEPENDENCIES IN PROJECT:
@@ -4368,7 +4379,8 @@ ${toolDeps.join(", ")}
 
 MCP SERVER CANDIDATES:
 ${candidateList}`,
-    maxTokens: 4e3
+    maxTokens: 4e3,
+    ...fastModel ? { model: fastModel } : {}
   });
   if (!Array.isArray(scored)) return [];
   return scored.filter((s) => s.score >= 60 && s.index >= 0 && s.index < candidates.length).sort((a, b) => b.score - a.score).slice(0, 5).map((s) => ({
@@ -4401,13 +4413,15 @@ async function fetchReadme(repoFullName) {
 async function extractMcpConfig(readme, serverName) {
   try {
     const truncated = readme.length > 15e3 ? readme.slice(0, 15e3) : readme;
+    const fastModel = getFastModel();
     const result = await llmJsonCall({
       system: EXTRACT_CONFIG_PROMPT,
       prompt: `MCP Server: ${serverName}
 
 README:
 ${truncated}`,
-      maxTokens: 2e3
+      maxTokens: 2e3,
+      ...fastModel ? { model: fastModel } : {}
     });
     if (!result || !result.command) return null;
     return {
@@ -4943,6 +4957,7 @@ async function searchAllProviders(technologies, platform) {
 }
 async function scoreWithLLM2(candidates, projectContext, technologies) {
   const candidateList = candidates.map((c, i) => `${i}. "${c.name}" \u2014 ${c.reason || "no description"}`).join("\n");
+  const fastModel = getFastModel();
   const scored = await llmJsonCall({
     system: `You evaluate whether AI agent skills and tools are relevant to a specific software project.
 Given a project context and a list of candidates, score each one's relevance from 0-100 and provide a brief reason (max 80 chars).
@@ -4970,7 +4985,8 @@ ${technologies.join(", ")}
 
 CANDIDATES:
 ${candidateList}`,
-    maxTokens: 8e3
+    maxTokens: 8e3,
+    ...fastModel ? { model: fastModel } : {}
   });
   if (!Array.isArray(scored)) return [];
   return scored.filter((s) => s.score >= 60 && s.index >= 0 && s.index < candidates.length).sort((a, b) => b.score - a.score).slice(0, 20).map((s) => ({
@@ -6945,10 +6961,12 @@ ${skillsSummary}`);
   const prompt = `${contextParts.length ? contextParts.join("\n\n---\n\n") + "\n\n---\n\n" : ""}## Tool Events from Session (${fittedEvents.length} events)
 
 ${eventsText}`;
+  const fastModel = getFastModel();
   const raw = await llmCall({
     system: LEARN_SYSTEM_PROMPT,
     prompt,
-    maxTokens: 4096
+    maxTokens: 4096,
+    ...fastModel ? { model: fastModel } : {}
   });
   return parseAnalysisResponse(raw);
 }

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@rely-ai/caliber",
-  "version": "1.5.5",
+  "version": "1.6.0",
   "description": "Analyze your codebase and generate optimized AI agent configs (CLAUDE.md, .cursorrules, skills) — no API key needed",
   "type": "module",
   "bin": {