claude-turing 1.5.0 → 2.1.0

package/.claude-plugin/plugin.json

@@ -1,7 +1,7 @@
 {
   "name": "turing",
-  "version": "1.5.0",
-  "description": "Autonomous ML research harness — the autoresearch loop as a formal protocol. 24 commands, 2 specialized agents, performance profiling, smart Pareto-based checkpoint management, experiment intelligence (error analysis, ablation studies, Pareto frontiers), statistical rigor (multi-seed studies, reproducibility verification), tree-search hypothesis exploration (TreeQuest AB-MCTS), cost-performance frontier analysis, model cards, model registry, hypothesis database with novelty guard, anti-cheating guardrails, and the taste-leverage loop. Inspired by Karpathy's autoresearch and the scientific method itself.",
+  "version": "2.1.0",
+  "description": "Autonomous ML research harness — the autoresearch loop as a formal protocol. 27 commands, 2 specialized agents, literature integration + paper section drafting, production model export (6 formats, equivalence, latency), performance profiling, smart Pareto-based checkpoint management, experiment intelligence (error analysis, ablation, Pareto frontiers), statistical rigor (seed studies, reproducibility), tree-search hypothesis exploration (TreeQuest AB-MCTS), cost-performance frontier, model cards, model registry, hypothesis database with novelty guard, anti-cheating guardrails, and the taste-leverage loop. Inspired by Karpathy's autoresearch and the scientific method itself.",
   "author": {
     "name": "pragnition"
   },

package/README.md

@@ -330,6 +330,9 @@ The index (`hypotheses.yaml`) is the lightweight queue. The detail files (`hypot
 | `/turing:frontier [--metrics]` | Pareto frontier — multi-objective tradeoff visualization |
 | `/turing:profile [exp-id]` | Computational profiling — timing, memory, throughput, bottleneck detection |
 | `/turing:checkpoint <action>` | Smart checkpoint management — list, prune (Pareto), average, resume, stats |
+| `/turing:lit <query>` | Literature search — papers, SOTA baselines, related work |
+| `/turing:paper [--sections] [--format]` | Draft paper sections from experiment logs (setup, results, ablation, hyperparams) |
+| `/turing:export [--format]` | Export model to production format with equivalence check + latency benchmark |
 | `/turing:card` | Generate a model card — performance, limitations, intended use, artifact contract |
 | `/turing:logbook` | Generate HTML experiment logbook |
 | `/turing:report` | Generate research report |
@@ -519,11 +522,11 @@ Each project gets independent config, data, experiments, models, and agent memor
 
 ## Architecture of Turing Itself
 
-24 commands, 2 agents, 8 config files, 39 template scripts, model registry, artifact contract, cost-performance frontier, model cards, tree-search exploration, statistical rigor, experiment intelligence, performance profiling + smart checkpoints, 542 tests, 16 ADRs. See [docs/ARCHITECTURE.md](docs/ARCHITECTURE.md) for the full codemap.
+27 commands, 2 agents, 8 config files, 46 template scripts, model registry, artifact contract, cost-performance frontier, model cards, tree-search exploration, statistical rigor, experiment intelligence, performance profiling, smart checkpoints, production model export, literature integration, paper section drafting, 664 tests, 16 ADRs. See [docs/ARCHITECTURE.md](docs/ARCHITECTURE.md) for the full codemap.
 
 ```
 turing/
-├── commands/              23 skill files (core + taste-leverage + reporting + exploration + statistical rigor + experiment intelligence + performance)
+├── commands/              26 skill files (core + taste-leverage + reporting + exploration + statistical rigor + experiment intelligence + performance + deployment + research workflow)
 ├── agents/                2 agents (researcher: read/write, evaluator: read-only)
 ├── config/                8 files (lifecycle, taxonomy, archetypes, novelty aliases)
 ├── templates/             Scaffolded into user projects by /turing:init

package/commands/export.md

@@ -0,0 +1,48 @@
+---
+name: export
+description: Export model to production format with equivalence verification, latency benchmarking, and deployment model card.
+disable-model-invocation: true
+argument-hint: "[exp-id] [--format joblib|xgboost_json|onnx|torchscript|tflite]"
+allowed-tools: Read, Bash(*), Grep, Glob
+---
+
+Export a trained model to a production-ready format.
+
+## Steps
+
+1. **Activate environment:**
+   ```bash
+   source .venv/bin/activate
+   ```
+
+2. **Parse arguments from `$ARGUMENTS`:**
+   - First argument can be an experiment ID (e.g., `exp-042`); defaults to best
+   - `--format joblib|xgboost_json|onnx|torchscript|tflite` specifies export format (auto-detected if omitted)
+   - `--skip-equivalence` skips inference equivalence check
+   - `--skip-latency` skips latency benchmark
+   - `--samples 100` sets test sample count
+
+3. **Run export pipeline:**
+   ```bash
+   python scripts/export_model.py $ARGUMENTS
+   ```
+
+4. **Report results:**
+   - **Export:** format, file size, output path, dependencies
+   - **Equivalence:** verdict (equivalent/approximately_equivalent/divergent), max delta
+   - **Latency:** p50/p95/p99 ms, speedup vs original
+   - **Model Card:** metrics, seed study, equivalence, latency, dependencies
+
+5. **Output:** exported model + model_card.yaml written to `exports/exp-NNN/`
+
+6. **If model file not found:** suggest checking models/best/ directory.
+
+## Examples
+
+```
+/turing:export                                     # Best experiment, default format
+/turing:export exp-042                             # Specific experiment
+/turing:export --format xgboost_json               # Native XGBoost JSON
+/turing:export --format onnx                       # ONNX format
+/turing:export --skip-equivalence --skip-latency   # Fast export
+```

package/commands/lit.md

@@ -0,0 +1,47 @@
+---
+name: lit
+description: Literature search scoped to the current experiment domain — find papers, SOTA baselines, and related work without leaving the terminal.
+disable-model-invocation: true
+argument-hint: "<query> | --baseline | --related <exp-id>"
+allowed-tools: Read, Bash(*), Grep, Glob, WebSearch
+---
+
+Search the literature for papers, baselines, and related work.
+
+## Steps
+
+1. **Activate environment:**
+   ```bash
+   source .venv/bin/activate
+   ```
+
+2. **Parse arguments from `$ARGUMENTS`:**
+   - **Free query:** `"gradient boosting for tabular data"` — searches Semantic Scholar
+   - **Baseline:** `--baseline` — finds SOTA results for the current task, compares against your best
+   - **Related:** `--related exp-042` — finds papers using similar methods to a specific experiment
+   - `--auto-queue` — auto-queues hypotheses from literature with `source: "literature"`
+   - `--limit 10` — max number of results
+
+3. **Run literature search:**
+   ```bash
+   python scripts/literature_search.py $ARGUMENTS
+   ```
+
+4. **Report results:**
+   - **Papers:** title, authors, year, venue, citations, abstract snippet, URL
+   - **Baseline mode:** SOTA comparison with gap analysis against current best
+   - **Related mode:** methodological differences worth investigating
+   - **Hypotheses:** if `--auto-queue`, shows queued experiments from findings
+
+5. **Saved output:** results written to `experiments/literature/query-YYYY-MM-DD-HHMMSS.md`
+
+6. **If API unavailable:** reports error and suggests manual search.
+
+## Examples
+
+```
+/turing:lit "gradient boosting missing values"    # Free query
+/turing:lit --baseline                             # SOTA comparison
+/turing:lit --related exp-042                      # Related work
+/turing:lit --auto-queue "ensemble methods"        # Queue hypotheses
+```

package/commands/paper.md

@@ -0,0 +1,44 @@
+---
+name: paper
+description: Draft mechanical paper sections (setup, results, ablation, hyperparameters) from experiment logs. LaTeX and markdown output.
+disable-model-invocation: true
+argument-hint: "[--sections setup,results,ablation] [--format latex|markdown]"
+allowed-tools: Read, Bash(*), Grep, Glob
+---
+
+Draft paper sections directly from experiment data.
+
+## Steps
+
+1. **Activate environment:**
+   ```bash
+   source .venv/bin/activate
+   ```
+
+2. **Parse arguments from `$ARGUMENTS`:**
+   - `--sections setup,results,ablation,hyperparameters` — which sections to draft (default: all)
+   - `--format latex|markdown` — output format (default: latex)
+
+3. **Run paper drafting:**
+   ```bash
+   python scripts/draft_paper_sections.py $ARGUMENTS
+   ```
+
+4. **Report results:**
+   - **setup:** Experimental setup prose (dataset, metrics, split, seed methodology)
+   - **results:** Comparison table with all model types, best bolded, seed study stats
+   - **ablation:** Ablation table from `/turing:ablate` results
+   - **hyperparameters:** Appendix-style parameter table per model
+
+5. **Output:** Each section saved to `paper/sections/` as `.tex` or `.md`
+
+6. **Numbers are pulled directly from experiment logs** — no manual transcription needed.
+
+## Examples
+
+```
+/turing:paper                                        # All sections, LaTeX
+/turing:paper --format markdown                      # All sections, markdown
+/turing:paper --sections setup,results               # Just setup + results
+/turing:paper --sections ablation --format latex      # Just ablation table
+```

package/commands/turing.md

@@ -31,6 +31,9 @@ You are the Turing ML research router. Detect the user's intent and route to the
 | "diagnose", "error analysis", "failure modes", "where does it fail", "confusion matrix" | `/turing:diagnose` | Analyze |
 | "ablate", "ablation", "remove component", "which features matter", "component impact" | `/turing:ablate` | Analyze |
 | "frontier", "pareto", "tradeoff", "tradeoffs", "multi-objective", "which model is best" | `/turing:frontier` | Analyze |
+| "lit", "literature", "papers", "SOTA", "baseline", "related work", "citations" | `/turing:lit` | Research |
+| "paper", "draft paper", "write paper", "results table", "latex", "experimental setup" | `/turing:paper` | Document |
+| "export", "deploy", "production", "onnx", "torchscript", "tflite", "ship model" | `/turing:export` | Deploy |
 | "profile", "profiling", "bottleneck", "slow training", "why is it slow", "timing" | `/turing:profile` | Check |
 | "checkpoint", "checkpoints", "prune checkpoints", "disk space", "resume training" | `/turing:checkpoint` | Check |
 
@@ -60,6 +63,9 @@ You are the Turing ML research router. Detect the user's intent and route to the
 | `/turing:diagnose [exp-id]` | Error analysis: failure modes, confused pairs, feature-range bias | (inline) |
 | `/turing:ablate [--components]` | Ablation study: remove components, measure impact, flag dead weight | (inline) |
 | `/turing:frontier [--metrics]` | Pareto frontier: multi-objective tradeoff visualization | (inline) |
+| `/turing:lit <query>` | Literature search: papers, SOTA baselines, related work | (inline, uses WebSearch) |
+| `/turing:paper [--sections] [--format]` | Draft paper sections from experiment logs (setup, results, ablation, hyperparams) | (inline) |
+| `/turing:export [exp-id] [--format]` | Export model to production format with equivalence check + latency benchmark | (inline) |
 | `/turing:profile [exp-id]` | Computational profiling: timing, memory, throughput, bottleneck detection | (inline) |
 | `/turing:checkpoint <action>` | Smart checkpoint management: list, prune (Pareto), average, resume, stats | (inline) |
 

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "claude-turing",
-  "version": "1.5.0",
+  "version": "2.1.0",
   "type": "module",
   "description": "Autonomous ML research harness for Claude Code. The autoresearch loop as a formal protocol — iteratively trains, evaluates, and improves ML models with structured experiment tracking, convergence detection, immutable evaluation infrastructure, and safety guardrails.",
   "bin": {

package/src/install.js

@@ -23,7 +23,8 @@ const SUB_COMMANDS = [
   "init", "train", "status", "compare", "sweep", "validate",
   "try", "brief", "suggest", "explore", "design", "logbook", "poster",
   "report", "mode", "preflight", "card", "seed", "reproduce",
-  "diagnose", "ablate", "frontier", "profile", "checkpoint",
+  "diagnose", "ablate", "frontier", "profile", "checkpoint", "export",
+  "lit", "paper",
 ];
 
 export async function install(opts = {}) {

package/src/verify.js

@@ -38,6 +38,9 @@ const EXPECTED_COMMANDS = [
   "frontier/SKILL.md",
   "profile/SKILL.md",
   "checkpoint/SKILL.md",
+  "export/SKILL.md",
+  "lit/SKILL.md",
+  "paper/SKILL.md",
 ];
 
 const EXPECTED_AGENTS = ["ml-researcher.md", "ml-evaluator.md"];