claude-turing 4.0.0 → 4.2.0

package/.claude-plugin/plugin.json

@@ -1,7 +1,7 @@
 {
   "name": "turing",
-  "version": "4.0.0",
-  "description": "Autonomous ML research harness — the autoresearch loop as a formal protocol. 63 commands, 2 specialized agents, research communication (cite + present + changelog), experiment archaeology (trend + flashback + archive + annotate + search + template + replay), model surgery (prune + quantize + merge + surgery), feature & training intelligence, model debugging, pre-training intelligence, meta-intelligence, scaling & efficiency, model composition, deep analysis, experiment orchestration, literature + paper, model export, profiling, checkpoints, experiment intelligence, statistical rigor, tree-search, cost-performance, model cards, hypothesis database, novelty guard, anti-cheating, taste-leverage loop. Inspired by Karpathy's autoresearch and the scientific method itself.",
+  "version": "4.2.0",
+  "description": "Autonomous ML research harness — the autoresearch loop as a formal protocol. 69 commands, 2 specialized agents, what-if analysis (whatif + counterfactual + simulate), collaboration (onboard + share + review), research communication (cite + present + changelog), experiment archaeology (trend + flashback + archive + annotate + search + template + replay), model surgery (prune + quantize + merge + surgery), feature & training intelligence, model debugging, pre-training intelligence, meta-intelligence, scaling & efficiency, model composition, deep analysis, experiment orchestration, literature + paper, model export, profiling, checkpoints, experiment intelligence, statistical rigor, tree-search, cost-performance, model cards, hypothesis database, novelty guard, anti-cheating, taste-leverage loop. Inspired by Karpathy's autoresearch and the scientific method itself.",
   "author": {
     "name": "pragnition"
   },

package/README.md

@@ -374,6 +374,12 @@ The index (`hypotheses.yaml`) is the lightweight queue. The detail files (`hypot
 | `/turing:cite <action>` | Citation & attribution manager — track papers, audit missing citations, generate BibTeX |
 | `/turing:present [--figures]` | Presentation figures — training curves, comparisons, ablation, Pareto, sensitivity |
 | `/turing:changelog [--audience]` | Model changelog — version-grouped improvements for technical or stakeholder audiences |
+| `/turing:onboard [--audience]` | Project onboarding — walkthrough for new collaborators |
+| `/turing:share <exp-ids...>` | Experiment packaging — portable archive with manifest |
+| `/turing:review [--venue]` | Peer review simulation — weaknesses, fix commands, score |
+| `/turing:whatif "<question>"` | What-if analysis — answer hypotheticals from existing experiment data |
+| `/turing:counterfactual <exp-id>` | Counterfactual explanations — minimum input change to flip a prediction |
+| `/turing:simulate [--configs]` | Experiment outcome prediction — pre-filter configs, save budget |
 
 And for fully hands-off operation:
 
@@ -558,11 +564,11 @@ Each project gets independent config, data, experiments, models, and agent memor
 
 ## Architecture of Turing Itself
 
-63 commands, 2 agents, 10 config files, 82 template scripts, model registry, artifact contract, cost-performance frontier, model cards, tree-search exploration, statistical rigor, experiment intelligence, performance profiling, smart checkpoints, production model export, literature integration, paper section drafting, experiment orchestration (queue + retry + fork), deep analysis (diff + watch + regress), model composition (ensemble + stitch + warm), scaling & efficiency (scale + budget + distill), meta-intelligence (transfer + audit), pre-training intelligence (sanity + baseline + leak), model debugging (xray + sensitivity + calibrate), feature & training intelligence (feature + curriculum), model surgery (prune + quantize + merge + surgery), experiment archaeology (trend + flashback + archive + annotate + search + template + replay), research communication (cite + present + changelog), 16 ADRs. See [docs/ARCHITECTURE.md](docs/ARCHITECTURE.md) for the full codemap.
+69 commands, 2 agents, 10 config files, 88 template scripts, model registry, artifact contract, cost-performance frontier, model cards, tree-search exploration, statistical rigor, experiment intelligence, performance profiling, smart checkpoints, production model export, literature integration, paper section drafting, experiment orchestration (queue + retry + fork), deep analysis (diff + watch + regress), model composition (ensemble + stitch + warm), scaling & efficiency (scale + budget + distill), meta-intelligence (transfer + audit), pre-training intelligence (sanity + baseline + leak), model debugging (xray + sensitivity + calibrate), feature & training intelligence (feature + curriculum), model surgery (prune + quantize + merge + surgery), experiment archaeology (trend + flashback + archive + annotate + search + template + replay), research communication (cite + present + changelog), collaboration (onboard + share + review), what-if analysis (whatif + counterfactual + simulate), 16 ADRs. See [docs/ARCHITECTURE.md](docs/ARCHITECTURE.md) for the full codemap.
 
 ```
 turing/
-├── commands/              62 skill files (core + taste-leverage + reporting + exploration + statistical rigor + experiment intelligence + performance + deployment + research workflow + orchestration + deep analysis + model composition + scaling & efficiency + meta-intelligence + pre-training intelligence + model debugging + feature & training intelligence + model surgery + experiment archaeology + research communication)
+├── commands/              65 skill files (core + taste-leverage + reporting + exploration + statistical rigor + experiment intelligence + performance + deployment + research workflow + orchestration + deep analysis + model composition + scaling & efficiency + meta-intelligence + pre-training intelligence + model debugging + feature & training intelligence + model surgery + experiment archaeology + research communication + what-if analysis)
 ├── agents/                2 agents (researcher: read/write, evaluator: read-only)
 ├── config/                8 files (lifecycle, taxonomy, archetypes, novelty aliases)
 ├── templates/             Scaffolded into user projects by /turing:init

package/commands/counterfactual.md

@@ -0,0 +1,27 @@
+---
+name: counterfactual
+description: Input-level counterfactual explanations — find the smallest input change to flip a prediction.
+disable-model-invocation: true
+argument-hint: "<exp-id> --sample <index> [--target <class>]"
+allowed-tools: Read, Bash(*), Grep, Glob
+---
+
+What would need to change to flip this prediction? Minimum-change counterfactual for individual predictions.
+
+## Steps
+1. `source .venv/bin/activate`
+2. `python scripts/counterfactual_explanation.py $ARGUMENTS`
+3. **Saved:** `experiments/counterfactuals/`
+
+## Methods
+- **Greedy perturbation:** change one feature at a time, find minimum flip
+- **Prototype-based:** find nearest training sample from target class
+- Both methods run and the best (smallest distance) is selected
+
+## Examples
+```
+/turing:counterfactual exp-042 --sample 1247
+/turing:counterfactual exp-042 --sample 1247 --target 0
+/turing:counterfactual exp-042 --batch-misclassified
+/turing:counterfactual exp-042 --sample 500 --json
+```

package/commands/onboard.md

@@ -0,0 +1,20 @@
+---
+name: onboard
+description: Project onboarding — generate a walkthrough for new collaborators. Task, history, decisions, next steps.
+disable-model-invocation: true
+argument-hint: "[--audience researcher|engineer|stakeholder] [--depth brief|full]"
+allowed-tools: Read, Bash(*), Grep, Glob
+---
+
+5-minute read that replaces a 1-hour onboarding meeting.
+
+## Steps
+1. `source .venv/bin/activate`
+2. `python scripts/generate_onboarding.py $ARGUMENTS`
+3. **Saved:** `ONBOARDING.md`
+
+## Examples
+```
+/turing:onboard
+/turing:onboard --audience engineer --depth brief
+```

package/commands/review.md

@@ -0,0 +1,20 @@
+---
+name: review
+description: Peer review simulation — generate likely reviewer objections with severity ratings and fix commands.
+disable-model-invocation: true
+argument-hint: "[--venue neurips|icml|general] [--harsh]"
+allowed-tools: Read, Bash(*), Grep, Glob
+---
+
+Simulate a conference reviewer before you submit. Each weakness links to the command that fixes it.
+
+## Steps
+1. `source .venv/bin/activate`
+2. `python scripts/simulate_review.py $ARGUMENTS`
+3. **Saved:** `experiments/reviews/`
+
+## Examples
+```
+/turing:review
+/turing:review --venue neurips --harsh
+```

package/commands/share.md

@@ -0,0 +1,20 @@
+---
+name: share
+description: Experiment packaging — portable archive with config, metrics, seed study, annotations, reproduction instructions.
+disable-model-invocation: true
+argument-hint: "<exp-ids...> [--include model,figures,code]"
+allowed-tools: Read, Bash(*), Grep, Glob
+---
+
+Package experiments for collaborator handoff or paper supplementary material.
+
+## Steps
+1. `source .venv/bin/activate`
+2. `python scripts/package_experiments.py $ARGUMENTS`
+3. **Saved:** `exports/packages/<name>/`
+
+## Examples
+```
+/turing:share exp-089
+/turing:share exp-042 exp-089 --include model,figures
+```

package/commands/simulate.md

@@ -0,0 +1,28 @@
+---
+name: simulate
+description: Experiment outcome prediction — predict which configs will beat the current best before running them.
+disable-model-invocation: true
+argument-hint: "[--configs configs.yaml] [--top-k 5] [--threshold 0.001]"
+allowed-tools: Read, Bash(*), Grep, Glob
+---
+
+Predict outcomes before spending compute. Ranks proposed configs and recommends which to run vs skip.
+
+## Steps
+1. `source .venv/bin/activate`
+2. `python scripts/experiment_simulator.py $ARGUMENTS`
+3. **Saved:** `experiments/simulations/`
+
+## How it works
+- Builds a surrogate model from experiment history (weighted k-NN)
+- Predicts metric for each proposed config
+- Applies novelty penalty for configs far from training distribution
+- Ranks and filters: only recommend configs predicted to improve
+
+## Examples
+```
+/turing:simulate --configs sweep_configs.yaml
+/turing:simulate --configs candidates.yaml --top-k 3
+/turing:simulate --configs proposals.yaml --threshold 0.005
+/turing:simulate --configs sweep.yaml --json
+```

package/commands/turing.md

@@ -65,6 +65,9 @@ You are the Turing ML research router. Detect the user's intent and route to the
 | "cite", "citation", "bibliography", "bibtex", "attribution", "references" | `/turing:cite` | Record |
 | "present", "figures", "slides", "presentation", "charts", "plots" | `/turing:present` | Document |
 | "changelog", "model changelog", "progress summary", "what improved" | `/turing:changelog` | Document |
+| "onboard", "onboarding", "walkthrough", "new collaborator", "project overview" | `/turing:onboard` | Document |
+| "share", "package", "export experiments", "send results", "portable" | `/turing:share` | Share |
+| "review", "peer review", "reviewer", "simulate review", "weakness" | `/turing:review` | Validate |
 | "trend", "trends", "research direction", "improvement rate", "diminishing returns", "what's working" | `/turing:trend` | Analyze |
 | "flashback", "where was I", "context", "resume", "catch up", "what happened" | `/turing:flashback` | Recall |
 | "archive", "cleanup", "compress old", "disk space", "archive experiments" | `/turing:archive` | Manage |
@@ -72,6 +75,9 @@ You are the Turing ML research router. Detect the user's intent and route to the
 | "search", "find experiment", "query experiments", "which experiments" | `/turing:search` | Query |
 | "template", "recipe", "save config", "reusable config", "starting point" | `/turing:template` | Manage |
 | "replay", "re-run", "revisit", "retry old", "would it work now" | `/turing:replay` | Validate |
+| "what if", "what-if", "hypothetical", "estimate impact", "would it help" | `/turing:whatif` | Analyze |
+| "counterfactual", "flip prediction", "why this prediction", "minimum change", "explanation" | `/turing:counterfactual` | Explain |
+| "simulate", "predict outcome", "pre-filter", "which configs will work", "forecast" | `/turing:simulate` | Predict |
 
 ## Sub-commands
 
@@ -140,6 +146,12 @@ You are the Turing ML research router. Detect the user's intent and route to the
 | `/turing:cite <action>` | Citation manager: add/list/check/bib for papers, datasets, methods | (inline) |
 | `/turing:present [--figures]` | Presentation figures: training curves, comparisons, ablation, Pareto, sensitivity | (inline) |
 | `/turing:changelog [--audience]` | Model changelog: version-grouped improvements for technical or stakeholder audiences | (inline) |
+| `/turing:onboard [--audience]` | Project onboarding: full walkthrough for new collaborators | (inline) |
+| `/turing:share <exp-ids...>` | Experiment packaging: portable archive with manifest and README | (inline) |
+| `/turing:review [--venue]` | Peer review simulation: weaknesses, questions, fix commands, score | (inline) |
+| `/turing:whatif "<question>"` | What-if analysis: route hypotheticals to existing estimators (scaling, ablation, sensitivity, ensemble, pruning) | (inline) |
+| `/turing:counterfactual <exp-id> --sample <index>` | Input-level counterfactual explanations: minimum input change to flip a prediction | (inline) |
+| `/turing:simulate [--configs] [--top-k]` | Experiment outcome prediction: pre-filter configs using surrogate model, save budget | (inline) |
 
 ## Proactive Detection
 

package/commands/whatif.md

@@ -0,0 +1,31 @@
+---
+name: whatif
+description: What-if analysis — answer hypotheticals from existing experiment data without running new experiments.
+disable-model-invocation: true
+argument-hint: "\"<question>\" [--json]"
+allowed-tools: Read, Bash(*), Grep, Glob
+---
+
+Answer "what if?" questions using existing experiment data. Routes to the right estimator automatically.
+
+## Steps
+1. `source .venv/bin/activate`
+2. `python scripts/whatif_engine.py $ARGUMENTS`
+3. **Saved:** `experiments/whatif/`
+
+## Supported question types
+- **Data scaling:** "what if I had 2x more data" → scaling law extrapolation
+- **Ablation:** "what if I removed class 3" → ablation study data
+- **Pipeline stitch:** "what if I combined exp-031 with exp-042" → stitch estimation
+- **Hyperparameters:** "what if learning_rate was 0.01" → sensitivity interpolation
+- **Ensemble:** "what if I ensembled the top models" → correlation analysis
+- **Pruning:** "what if I pruned to 50% sparsity" → pruning sweep interpolation
+- **Budget:** "what if I spent my budget on X vs Y" → budget allocation
+
+## Examples
+```
+/turing:whatif "what if I had 2x more data"
+/turing:whatif "what if I removed class 3"
+/turing:whatif "what if I combined exp-031 with exp-042"
+/turing:whatif "what if learning_rate was 0.01" --json
+```

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "claude-turing",
-  "version": "4.0.0",
+  "version": "4.2.0",
   "type": "module",
   "description": "Autonomous ML research harness for Claude Code. The autoresearch loop as a formal protocol — iteratively trains, evaluates, and improves ML models with structured experiment tracking, convergence detection, immutable evaluation infrastructure, and safety guardrails.",
   "bin": {

package/src/install.js

@@ -35,6 +35,8 @@ const SUB_COMMANDS = [
   "prune", "quantize", "merge", "surgery",
   "trend", "flashback", "archive", "annotate", "search", "template", "replay",
   "cite", "present", "changelog",
+  "onboard", "share", "review",
+  "whatif", "counterfactual", "simulate",
 ];
 
 export async function install(opts = {}) {

package/src/verify.js

@@ -77,6 +77,12 @@ const EXPECTED_COMMANDS = [
   "cite/SKILL.md",
   "present/SKILL.md",
   "changelog/SKILL.md",
+  "onboard/SKILL.md",
+  "share/SKILL.md",
+  "review/SKILL.md",
+  "whatif/SKILL.md",
+  "counterfactual/SKILL.md",
+  "simulate/SKILL.md",
 ];
 
 const EXPECTED_AGENTS = ["ml-researcher.md", "ml-evaluator.md"];