@r1z4x/tezgah 1.0.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +738 -0
- package/LICENSE +21 -0
- package/MANIFEST +753 -0
- package/README.de.md +169 -0
- package/README.es.md +168 -0
- package/README.fr.md +166 -0
- package/README.md +161 -0
- package/README.tr.md +163 -0
- package/agents/tezgah-reviewer.md +70 -0
- package/bin/codegen +337 -0
- package/bin/consult +797 -0
- package/bin/tezgah-adhd +50 -0
- package/bin/tezgah-agents +45 -0
- package/bin/tezgah-capture +66 -0
- package/bin/tezgah-context +96 -0
- package/bin/tezgah-decisions +213 -0
- package/bin/tezgah-design +953 -0
- package/bin/tezgah-docs +1199 -0
- package/bin/tezgah-doctor +497 -0
- package/bin/tezgah-dsh +37 -0
- package/bin/tezgah-dsh.cmd +70 -0
- package/bin/tezgah-gate +75 -0
- package/bin/tezgah-import-ai-research +439 -0
- package/bin/tezgah-index +32 -0
- package/bin/tezgah-lessons +148 -0
- package/bin/tezgah-mcp +322 -0
- package/bin/tezgah-migrate +324 -0
- package/bin/tezgah-pony +50 -0
- package/bin/tezgah-research +772 -0
- package/bin/tezgah-rollback +93 -0
- package/bin/tezgah-route +124 -0
- package/bin/tezgah-setup +5798 -0
- package/bin/tezgah-status +383 -0
- package/bin/tezgah-task +607 -0
- package/bin/tezgah-taste +423 -0
- package/bin/tezgah-triage +485 -0
- package/bin/tezgah.js +36 -0
- package/commands/adhd.md +21 -0
- package/commands/ponytail.md +21 -0
- package/docs/README.md +112 -0
- package/docs/architecture.md +226 -0
- package/docs/citations-baseline.json +59 -0
- package/docs/clarity-baseline.json +116 -0
- package/docs/contract.md +416 -0
- package/docs/environment.md +141 -0
- package/docs/evidence.md +831 -0
- package/docs/feature-audit.md +139 -0
- package/docs/gate.md +407 -0
- package/docs/glossary.md +201 -0
- package/docs/hosts.md +400 -0
- package/docs/index.json +471 -0
- package/docs/judge.md +193 -0
- package/docs/layers.md +189 -0
- package/docs/models.md +160 -0
- package/docs/operations.md +666 -0
- package/docs/research.md +809 -0
- package/docs/results/paired-outcome-2026-10.jsonl +254 -0
- package/docs/results/paired-outcome-2026-10.md +204 -0
- package/docs/skills.md +236 -0
- package/docs/status-line.md +315 -0
- package/docs/testing.md +287 -0
- package/docs/vision.md +117 -0
- package/hooks/hooks.json +33 -0
- package/hooks/projects-auto-init.py +98 -0
- package/hooks/projects-posttooluse.py +149 -0
- package/hooks/projects-pretooluse.py +40 -0
- package/hooks/projects-stop.py +60 -0
- package/hooks/tezgah_agents.py +817 -0
- package/hooks/tezgah_apps.py +266 -0
- package/hooks/tezgah_attest.py +255 -0
- package/hooks/tezgah_clarity.py +171 -0
- package/hooks/tezgah_components.py +140 -0
- package/hooks/tezgah_context.py +2953 -0
- package/hooks/tezgah_embed.py +765 -0
- package/hooks/tezgah_gate.py +2736 -0
- package/hooks/tezgah_guard.py +177 -0
- package/hooks/tezgah_index.py +124 -0
- package/hooks/tezgah_integrity.py +5141 -0
- package/hooks/tezgah_judge.py +487 -0
- package/hooks/tezgah_lang.py +230 -0
- package/hooks/tezgah_lessons.py +210 -0
- package/hooks/tezgah_models.py +855 -0
- package/hooks/tezgah_paths.py +1132 -0
- package/hooks/tezgah_policy.py +1039 -0
- package/hooks/tezgah_rank.py +77 -0
- package/hooks/tezgah_replay.py +1109 -0
- package/hooks/tezgah_research.py +5176 -0
- package/hooks/tezgah_shapes.py +305 -0
- package/hooks/tezgah_skill_pick.py +227 -0
- package/hooks/tezgah_snapshot.py +490 -0
- package/hooks/tezgah_stopspec.py +320 -0
- package/hooks/tezgah_task.py +458 -0
- package/hooks/tezgah_taste.py +201 -0
- package/hooks/tezgah_untrusted.py +112 -0
- package/hooks/tezgah_update.py +430 -0
- package/hosts/codex/hook.py +268 -0
- package/hosts/codex/hooks.json +26 -0
- package/hosts/cursor/hook.py +461 -0
- package/hosts/cursor/hooks.json +44 -0
- package/hosts/dsh/hooks.json +21 -0
- package/hosts/dsh/statusline/lib/client.js +138 -0
- package/hosts/dsh/statusline/lib/index.js +104 -0
- package/hosts/dsh/statusline/package.json +28 -0
- package/hosts/omp/hook.py +277 -0
- package/hosts/omp/tezgah-hook.ts.in +701 -0
- package/hosts/opencode/plugins/tezgah.js +2742 -0
- package/hosts/opencode/tui/tezgah-tui.tsx +151 -0
- package/output-styles/tezgah.md +142 -0
- package/package.json +32 -0
- package/packaging/build.sh +342 -0
- package/packaging/install.ps1 +166 -0
- package/packaging/install.sh +56 -0
- package/packaging/upgrade.sh +142 -0
- package/skills/ai-research/0-autoresearch-skill/SKILL.md +411 -0
- package/skills/ai-research/0-autoresearch-skill/references/agent-continuity.md +95 -0
- package/skills/ai-research/0-autoresearch-skill/references/progress-reporting.md +166 -0
- package/skills/ai-research/0-autoresearch-skill/references/skill-routing.md +219 -0
- package/skills/ai-research/0-autoresearch-skill/templates/findings.md +44 -0
- package/skills/ai-research/0-autoresearch-skill/templates/research-log.md +41 -0
- package/skills/ai-research/01-model-architecture/litgpt/SKILL.md +469 -0
- package/skills/ai-research/01-model-architecture/litgpt/references/custom-models.md +569 -0
- package/skills/ai-research/01-model-architecture/litgpt/references/distributed-training.md +452 -0
- package/skills/ai-research/01-model-architecture/litgpt/references/supported-models.md +337 -0
- package/skills/ai-research/01-model-architecture/litgpt/references/training-recipes.md +620 -0
- package/skills/ai-research/01-model-architecture/mamba/SKILL.md +260 -0
- package/skills/ai-research/01-model-architecture/mamba/references/architecture-details.md +207 -0
- package/skills/ai-research/01-model-architecture/mamba/references/benchmarks.md +256 -0
- package/skills/ai-research/01-model-architecture/mamba/references/training-guide.md +389 -0
- package/skills/ai-research/01-model-architecture/nanogpt/SKILL.md +290 -0
- package/skills/ai-research/01-model-architecture/nanogpt/references/architecture.md +383 -0
- package/skills/ai-research/01-model-architecture/nanogpt/references/data.md +477 -0
- package/skills/ai-research/01-model-architecture/nanogpt/references/training.md +565 -0
- package/skills/ai-research/01-model-architecture/rwkv/SKILL.md +260 -0
- package/skills/ai-research/01-model-architecture/rwkv/references/architecture-details.md +345 -0
- package/skills/ai-research/01-model-architecture/rwkv/references/rwkv7.md +387 -0
- package/skills/ai-research/01-model-architecture/rwkv/references/state-management.md +370 -0
- package/skills/ai-research/01-model-architecture/torchtitan/SKILL.md +358 -0
- package/skills/ai-research/01-model-architecture/torchtitan/references/checkpoint.md +182 -0
- package/skills/ai-research/01-model-architecture/torchtitan/references/custom-models.md +259 -0
- package/skills/ai-research/01-model-architecture/torchtitan/references/float8.md +134 -0
- package/skills/ai-research/01-model-architecture/torchtitan/references/fsdp.md +127 -0
- package/skills/ai-research/02-tokenization/huggingface-tokenizers/SKILL.md +516 -0
- package/skills/ai-research/02-tokenization/huggingface-tokenizers/references/algorithms.md +654 -0
- package/skills/ai-research/02-tokenization/huggingface-tokenizers/references/integration.md +638 -0
- package/skills/ai-research/02-tokenization/huggingface-tokenizers/references/pipeline.md +724 -0
- package/skills/ai-research/02-tokenization/huggingface-tokenizers/references/training.md +566 -0
- package/skills/ai-research/02-tokenization/sentencepiece/SKILL.md +235 -0
- package/skills/ai-research/02-tokenization/sentencepiece/references/algorithms.md +201 -0
- package/skills/ai-research/02-tokenization/sentencepiece/references/training.md +305 -0
- package/skills/ai-research/03-fine-tuning/axolotl/SKILL.md +158 -0
- package/skills/ai-research/03-fine-tuning/axolotl/references/api.md +5549 -0
- package/skills/ai-research/03-fine-tuning/axolotl/references/dataset-formats.md +1030 -0
- package/skills/ai-research/03-fine-tuning/axolotl/references/index.md +16 -0
- package/skills/ai-research/03-fine-tuning/axolotl/references/other.md +3564 -0
- package/skills/ai-research/03-fine-tuning/llama-factory/SKILL.md +80 -0
- package/skills/ai-research/03-fine-tuning/llama-factory/references/_images.md +24 -0
- package/skills/ai-research/03-fine-tuning/llama-factory/references/advanced.md +1056 -0
- package/skills/ai-research/03-fine-tuning/llama-factory/references/getting_started.md +350 -0
- package/skills/ai-research/03-fine-tuning/llama-factory/references/index.md +20 -0
- package/skills/ai-research/03-fine-tuning/llama-factory/references/other.md +32 -0
- package/skills/ai-research/03-fine-tuning/peft/SKILL.md +431 -0
- package/skills/ai-research/03-fine-tuning/peft/references/advanced-usage.md +515 -0
- package/skills/ai-research/03-fine-tuning/peft/references/troubleshooting.md +481 -0
- package/skills/ai-research/03-fine-tuning/unsloth/SKILL.md +80 -0
- package/skills/ai-research/03-fine-tuning/unsloth/references/index.md +8 -0
- package/skills/ai-research/03-fine-tuning/unsloth/references/llms.md +83 -0
- package/skills/ai-research/04-mechanistic-interpretability/nnsight/SKILL.md +436 -0
- package/skills/ai-research/04-mechanistic-interpretability/nnsight/references/README.md +79 -0
- package/skills/ai-research/04-mechanistic-interpretability/nnsight/references/api.md +345 -0
- package/skills/ai-research/04-mechanistic-interpretability/nnsight/references/tutorials.md +301 -0
- package/skills/ai-research/04-mechanistic-interpretability/pyvene/SKILL.md +473 -0
- package/skills/ai-research/04-mechanistic-interpretability/pyvene/references/README.md +74 -0
- package/skills/ai-research/04-mechanistic-interpretability/pyvene/references/api.md +384 -0
- package/skills/ai-research/04-mechanistic-interpretability/pyvene/references/tutorials.md +377 -0
- package/skills/ai-research/04-mechanistic-interpretability/saelens/SKILL.md +386 -0
- package/skills/ai-research/04-mechanistic-interpretability/saelens/references/README.md +71 -0
- package/skills/ai-research/04-mechanistic-interpretability/saelens/references/api.md +334 -0
- package/skills/ai-research/04-mechanistic-interpretability/saelens/references/tutorials.md +319 -0
- package/skills/ai-research/04-mechanistic-interpretability/transformer-lens/SKILL.md +346 -0
- package/skills/ai-research/04-mechanistic-interpretability/transformer-lens/references/README.md +55 -0
- package/skills/ai-research/04-mechanistic-interpretability/transformer-lens/references/api.md +363 -0
- package/skills/ai-research/04-mechanistic-interpretability/transformer-lens/references/tutorials.md +340 -0
- package/skills/ai-research/05-data-processing/nemo-curator/SKILL.md +383 -0
- package/skills/ai-research/05-data-processing/nemo-curator/references/deduplication.md +88 -0
- package/skills/ai-research/05-data-processing/nemo-curator/references/filtering.md +103 -0
- package/skills/ai-research/05-data-processing/ray-data/SKILL.md +326 -0
- package/skills/ai-research/05-data-processing/ray-data/references/integration.md +83 -0
- package/skills/ai-research/05-data-processing/ray-data/references/transformations.md +84 -0
- package/skills/ai-research/06-post-training/grpo-rl-training/README.md +98 -0
- package/skills/ai-research/06-post-training/grpo-rl-training/SKILL.md +572 -0
- package/skills/ai-research/06-post-training/miles/SKILL.md +315 -0
- package/skills/ai-research/06-post-training/miles/references/api-reference.md +142 -0
- package/skills/ai-research/06-post-training/miles/references/troubleshooting.md +353 -0
- package/skills/ai-research/06-post-training/openrlhf/SKILL.md +249 -0
- package/skills/ai-research/06-post-training/openrlhf/references/algorithm-comparison.md +405 -0
- package/skills/ai-research/06-post-training/openrlhf/references/custom-rewards.md +531 -0
- package/skills/ai-research/06-post-training/openrlhf/references/hybrid-engine.md +288 -0
- package/skills/ai-research/06-post-training/openrlhf/references/multi-node-training.md +455 -0
- package/skills/ai-research/06-post-training/simpo/SKILL.md +219 -0
- package/skills/ai-research/06-post-training/simpo/references/datasets.md +479 -0
- package/skills/ai-research/06-post-training/simpo/references/hyperparameters.md +453 -0
- package/skills/ai-research/06-post-training/simpo/references/loss-functions.md +351 -0
- package/skills/ai-research/06-post-training/slime/SKILL.md +464 -0
- package/skills/ai-research/06-post-training/slime/references/api-reference.md +393 -0
- package/skills/ai-research/06-post-training/slime/references/troubleshooting.md +387 -0
- package/skills/ai-research/06-post-training/torchforge/SKILL.md +433 -0
- package/skills/ai-research/06-post-training/torchforge/references/api-reference.md +328 -0
- package/skills/ai-research/06-post-training/torchforge/references/troubleshooting.md +410 -0
- package/skills/ai-research/06-post-training/trl-fine-tuning/SKILL.md +455 -0
- package/skills/ai-research/06-post-training/trl-fine-tuning/references/dpo-variants.md +228 -0
- package/skills/ai-research/06-post-training/trl-fine-tuning/references/online-rl.md +83 -0
- package/skills/ai-research/06-post-training/trl-fine-tuning/references/reward-modeling.md +123 -0
- package/skills/ai-research/06-post-training/trl-fine-tuning/references/sft-training.md +169 -0
- package/skills/ai-research/06-post-training/verl/SKILL.md +391 -0
- package/skills/ai-research/06-post-training/verl/references/api-reference.md +302 -0
- package/skills/ai-research/06-post-training/verl/references/troubleshooting.md +392 -0
- package/skills/ai-research/07-safety-alignment/constitutional-ai/SKILL.md +290 -0
- package/skills/ai-research/07-safety-alignment/llamaguard/SKILL.md +337 -0
- package/skills/ai-research/07-safety-alignment/nemo-guardrails/SKILL.md +297 -0
- package/skills/ai-research/07-safety-alignment/prompt-guard/SKILL.md +312 -0
- package/skills/ai-research/08-distributed-training/accelerate/SKILL.md +332 -0
- package/skills/ai-research/08-distributed-training/accelerate/references/custom-plugins.md +454 -0
- package/skills/ai-research/08-distributed-training/accelerate/references/megatron-integration.md +490 -0
- package/skills/ai-research/08-distributed-training/accelerate/references/performance.md +526 -0
- package/skills/ai-research/08-distributed-training/deepspeed/SKILL.md +141 -0
- package/skills/ai-research/08-distributed-training/deepspeed/references/08.md +18 -0
- package/skills/ai-research/08-distributed-training/deepspeed/references/09.md +174 -0
- package/skills/ai-research/08-distributed-training/deepspeed/references/2020.md +379 -0
- package/skills/ai-research/08-distributed-training/deepspeed/references/2023.md +280 -0
- package/skills/ai-research/08-distributed-training/deepspeed/references/assets.md +180 -0
- package/skills/ai-research/08-distributed-training/deepspeed/references/index.md +36 -0
- package/skills/ai-research/08-distributed-training/deepspeed/references/mii.md +119 -0
- package/skills/ai-research/08-distributed-training/deepspeed/references/other.md +1192 -0
- package/skills/ai-research/08-distributed-training/megatron-core/SKILL.md +366 -0
- package/skills/ai-research/08-distributed-training/megatron-core/references/benchmarks.md +250 -0
- package/skills/ai-research/08-distributed-training/megatron-core/references/parallelism-guide.md +405 -0
- package/skills/ai-research/08-distributed-training/megatron-core/references/production-examples.md +474 -0
- package/skills/ai-research/08-distributed-training/megatron-core/references/training-recipes.md +548 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/SKILL.md +231 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_dcp_async_recipe.md +14 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_dcp_overview.md +19 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_dcp_recipe.md +18 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_ddp_notes.md +10 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_device_mesh_tutorial.md +22 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_examples_fsdp2.md +15 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_fsdp1_api.md +9 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_fsdp2_tutorial.md +45 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_fully_shard_api.md +49 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_tp_tutorial.md +22 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/ray_train_fsdp2_example.md +13 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/torchtitan_fsdp_notes.md +14 -0
- package/skills/ai-research/08-distributed-training/pytorch-lightning/SKILL.md +346 -0
- package/skills/ai-research/08-distributed-training/pytorch-lightning/references/callbacks.md +437 -0
- package/skills/ai-research/08-distributed-training/pytorch-lightning/references/distributed.md +491 -0
- package/skills/ai-research/08-distributed-training/pytorch-lightning/references/hyperparameter-tuning.md +557 -0
- package/skills/ai-research/08-distributed-training/ray-train/SKILL.md +406 -0
- package/skills/ai-research/08-distributed-training/ray-train/references/multi-node.md +629 -0
- package/skills/ai-research/09-infrastructure/lambda-labs/SKILL.md +545 -0
- package/skills/ai-research/09-infrastructure/lambda-labs/references/advanced-usage.md +612 -0
- package/skills/ai-research/09-infrastructure/lambda-labs/references/troubleshooting.md +531 -0
- package/skills/ai-research/09-infrastructure/modal/SKILL.md +341 -0
- package/skills/ai-research/09-infrastructure/modal/references/advanced-usage.md +504 -0
- package/skills/ai-research/09-infrastructure/modal/references/troubleshooting.md +495 -0
- package/skills/ai-research/09-infrastructure/skypilot/SKILL.md +509 -0
- package/skills/ai-research/09-infrastructure/skypilot/references/advanced-usage.md +492 -0
- package/skills/ai-research/09-infrastructure/skypilot/references/troubleshooting.md +571 -0
- package/skills/ai-research/10-optimization/awq/SKILL.md +310 -0
- package/skills/ai-research/10-optimization/awq/references/advanced-usage.md +325 -0
- package/skills/ai-research/10-optimization/awq/references/troubleshooting.md +345 -0
- package/skills/ai-research/10-optimization/bitsandbytes/SKILL.md +411 -0
- package/skills/ai-research/10-optimization/bitsandbytes/references/memory-optimization.md +522 -0
- package/skills/ai-research/10-optimization/bitsandbytes/references/qlora-training.md +522 -0
- package/skills/ai-research/10-optimization/bitsandbytes/references/quantization-formats.md +448 -0
- package/skills/ai-research/10-optimization/flash-attention/SKILL.md +367 -0
- package/skills/ai-research/10-optimization/flash-attention/references/benchmarks.md +216 -0
- package/skills/ai-research/10-optimization/flash-attention/references/transformers-integration.md +294 -0
- package/skills/ai-research/10-optimization/gguf/SKILL.md +427 -0
- package/skills/ai-research/10-optimization/gguf/references/advanced-usage.md +505 -0
- package/skills/ai-research/10-optimization/gguf/references/troubleshooting.md +443 -0
- package/skills/ai-research/10-optimization/gptq/SKILL.md +450 -0
- package/skills/ai-research/10-optimization/gptq/references/calibration.md +338 -0
- package/skills/ai-research/10-optimization/gptq/references/integration.md +130 -0
- package/skills/ai-research/10-optimization/gptq/references/troubleshooting.md +96 -0
- package/skills/ai-research/10-optimization/hqq/SKILL.md +445 -0
- package/skills/ai-research/10-optimization/hqq/references/advanced-usage.md +529 -0
- package/skills/ai-research/10-optimization/hqq/references/troubleshooting.md +504 -0
- package/skills/ai-research/10-optimization/ml-training-recipes/SKILL.md +319 -0
- package/skills/ai-research/10-optimization/ml-training-recipes/references/architecture.md +320 -0
- package/skills/ai-research/10-optimization/ml-training-recipes/references/biomedical.md +498 -0
- package/skills/ai-research/10-optimization/ml-training-recipes/references/domain-specific.md +626 -0
- package/skills/ai-research/10-optimization/ml-training-recipes/references/experiment-loop.md +129 -0
- package/skills/ai-research/10-optimization/ml-training-recipes/references/optimizers.md +330 -0
- package/skills/ai-research/10-optimization/ml-training-recipes/references/scaling-and-selection.md +428 -0
- package/skills/ai-research/11-evaluation/bigcode-evaluation-harness/SKILL.md +405 -0
- package/skills/ai-research/11-evaluation/bigcode-evaluation-harness/references/benchmarks.md +394 -0
- package/skills/ai-research/11-evaluation/bigcode-evaluation-harness/references/custom-tasks.md +425 -0
- package/skills/ai-research/11-evaluation/bigcode-evaluation-harness/references/issues.md +395 -0
- package/skills/ai-research/11-evaluation/lm-evaluation-harness/SKILL.md +490 -0
- package/skills/ai-research/11-evaluation/lm-evaluation-harness/references/api-evaluation.md +491 -0
- package/skills/ai-research/11-evaluation/lm-evaluation-harness/references/benchmark-guide.md +489 -0
- package/skills/ai-research/11-evaluation/lm-evaluation-harness/references/custom-tasks.md +603 -0
- package/skills/ai-research/11-evaluation/lm-evaluation-harness/references/distributed-eval.md +520 -0
- package/skills/ai-research/11-evaluation/nemo-evaluator/SKILL.md +494 -0
- package/skills/ai-research/11-evaluation/nemo-evaluator/references/adapter-system.md +341 -0
- package/skills/ai-research/11-evaluation/nemo-evaluator/references/configuration.md +448 -0
- package/skills/ai-research/11-evaluation/nemo-evaluator/references/custom-benchmarks.md +316 -0
- package/skills/ai-research/11-evaluation/nemo-evaluator/references/execution-backends.md +362 -0
- package/skills/ai-research/12-inference-serving/llama-cpp/SKILL.md +258 -0
- package/skills/ai-research/12-inference-serving/llama-cpp/references/optimization.md +90 -0
- package/skills/ai-research/12-inference-serving/llama-cpp/references/quantization.md +214 -0
- package/skills/ai-research/12-inference-serving/llama-cpp/references/server.md +126 -0
- package/skills/ai-research/12-inference-serving/sglang/SKILL.md +442 -0
- package/skills/ai-research/12-inference-serving/sglang/references/deployment.md +491 -0
- package/skills/ai-research/12-inference-serving/sglang/references/radix-attention.md +414 -0
- package/skills/ai-research/12-inference-serving/sglang/references/structured-generation.md +542 -0
- package/skills/ai-research/12-inference-serving/tensorrt-llm/SKILL.md +187 -0
- package/skills/ai-research/12-inference-serving/tensorrt-llm/references/multi-gpu.md +299 -0
- package/skills/ai-research/12-inference-serving/tensorrt-llm/references/optimization.md +243 -0
- package/skills/ai-research/12-inference-serving/tensorrt-llm/references/serving.md +471 -0
- package/skills/ai-research/12-inference-serving/vllm/SKILL.md +364 -0
- package/skills/ai-research/12-inference-serving/vllm/references/optimization.md +227 -0
- package/skills/ai-research/12-inference-serving/vllm/references/quantization.md +285 -0
- package/skills/ai-research/12-inference-serving/vllm/references/server-deployment.md +256 -0
- package/skills/ai-research/12-inference-serving/vllm/references/troubleshooting.md +448 -0
- package/skills/ai-research/13-mlops/mlflow/SKILL.md +704 -0
- package/skills/ai-research/13-mlops/mlflow/references/deployment.md +745 -0
- package/skills/ai-research/13-mlops/mlflow/references/model-registry.md +771 -0
- package/skills/ai-research/13-mlops/mlflow/references/tracking.md +681 -0
- package/skills/ai-research/13-mlops/swanlab/SKILL.md +406 -0
- package/skills/ai-research/13-mlops/swanlab/references/integrations.md +305 -0
- package/skills/ai-research/13-mlops/swanlab/references/visualization.md +234 -0
- package/skills/ai-research/13-mlops/tensorboard/SKILL.md +629 -0
- package/skills/ai-research/13-mlops/tensorboard/references/integrations.md +639 -0
- package/skills/ai-research/13-mlops/tensorboard/references/profiling.md +546 -0
- package/skills/ai-research/13-mlops/tensorboard/references/visualization.md +621 -0
- package/skills/ai-research/13-mlops/weights-and-biases/SKILL.md +590 -0
- package/skills/ai-research/13-mlops/weights-and-biases/references/artifacts.md +585 -0
- package/skills/ai-research/13-mlops/weights-and-biases/references/integrations.md +701 -0
- package/skills/ai-research/13-mlops/weights-and-biases/references/sweeps.md +848 -0
- package/skills/ai-research/14-agents/a-evolve/SKILL.md +383 -0
- package/skills/ai-research/14-agents/a-evolve/references/README.md +831 -0
- package/skills/ai-research/14-agents/a-evolve/references/api.md +594 -0
- package/skills/ai-research/14-agents/a-evolve/references/architecture.md +417 -0
- package/skills/ai-research/14-agents/a-evolve/references/design-patterns.md +462 -0
- package/skills/ai-research/14-agents/a-evolve/references/examples.md +352 -0
- package/skills/ai-research/14-agents/a-evolve/references/issues.md +591 -0
- package/skills/ai-research/14-agents/a-evolve/references/releases.md +112 -0
- package/skills/ai-research/14-agents/a-evolve/references/tutorials.md +819 -0
- package/skills/ai-research/14-agents/autogpt/SKILL.md +403 -0
- package/skills/ai-research/14-agents/autogpt/references/advanced-usage.md +536 -0
- package/skills/ai-research/14-agents/autogpt/references/troubleshooting.md +421 -0
- package/skills/ai-research/14-agents/crewai/SKILL.md +498 -0
- package/skills/ai-research/14-agents/crewai/references/flows.md +439 -0
- package/skills/ai-research/14-agents/crewai/references/tools.md +430 -0
- package/skills/ai-research/14-agents/crewai/references/troubleshooting.md +481 -0
- package/skills/ai-research/14-agents/langchain/SKILL.md +480 -0
- package/skills/ai-research/14-agents/langchain/references/agents.md +500 -0
- package/skills/ai-research/14-agents/langchain/references/integration.md +563 -0
- package/skills/ai-research/14-agents/langchain/references/rag.md +601 -0
- package/skills/ai-research/14-agents/llamaindex/SKILL.md +569 -0
- package/skills/ai-research/14-agents/llamaindex/references/agents.md +84 -0
- package/skills/ai-research/14-agents/llamaindex/references/data_connectors.md +109 -0
- package/skills/ai-research/14-agents/llamaindex/references/query_engines.md +407 -0
- package/skills/ai-research/15-rag/chroma/SKILL.md +406 -0
- package/skills/ai-research/15-rag/chroma/references/integration.md +39 -0
- package/skills/ai-research/15-rag/faiss/SKILL.md +221 -0
- package/skills/ai-research/15-rag/faiss/references/index_types.md +281 -0
- package/skills/ai-research/15-rag/pinecone/SKILL.md +358 -0
- package/skills/ai-research/15-rag/pinecone/references/deployment.md +182 -0
- package/skills/ai-research/15-rag/qdrant/SKILL.md +493 -0
- package/skills/ai-research/15-rag/qdrant/references/advanced-usage.md +649 -0
- package/skills/ai-research/15-rag/qdrant/references/troubleshooting.md +632 -0
- package/skills/ai-research/15-rag/sentence-transformers/SKILL.md +255 -0
- package/skills/ai-research/15-rag/sentence-transformers/references/models.md +124 -0
- package/skills/ai-research/16-prompt-engineering/dspy/SKILL.md +590 -0
- package/skills/ai-research/16-prompt-engineering/dspy/references/examples.md +664 -0
- package/skills/ai-research/16-prompt-engineering/dspy/references/modules.md +476 -0
- package/skills/ai-research/16-prompt-engineering/dspy/references/optimizers.md +567 -0
- package/skills/ai-research/16-prompt-engineering/guidance/SKILL.md +572 -0
- package/skills/ai-research/16-prompt-engineering/guidance/references/backends.md +555 -0
- package/skills/ai-research/16-prompt-engineering/guidance/references/constraints.md +675 -0
- package/skills/ai-research/16-prompt-engineering/guidance/references/examples.md +768 -0
- package/skills/ai-research/16-prompt-engineering/instructor/SKILL.md +740 -0
- package/skills/ai-research/16-prompt-engineering/instructor/references/examples.md +108 -0
- package/skills/ai-research/16-prompt-engineering/instructor/references/providers.md +71 -0
- package/skills/ai-research/16-prompt-engineering/instructor/references/validation.md +607 -0
- package/skills/ai-research/16-prompt-engineering/outlines/SKILL.md +652 -0
- package/skills/ai-research/16-prompt-engineering/outlines/references/backends.md +616 -0
- package/skills/ai-research/16-prompt-engineering/outlines/references/examples.md +774 -0
- package/skills/ai-research/16-prompt-engineering/outlines/references/json_generation.md +653 -0
- package/skills/ai-research/17-observability/langsmith/SKILL.md +422 -0
- package/skills/ai-research/17-observability/langsmith/references/advanced-usage.md +549 -0
- package/skills/ai-research/17-observability/langsmith/references/troubleshooting.md +538 -0
- package/skills/ai-research/17-observability/phoenix/SKILL.md +475 -0
- package/skills/ai-research/17-observability/phoenix/references/advanced-usage.md +620 -0
- package/skills/ai-research/17-observability/phoenix/references/troubleshooting.md +539 -0
- package/skills/ai-research/18-multimodal/audiocraft/SKILL.md +564 -0
- package/skills/ai-research/18-multimodal/audiocraft/references/advanced-usage.md +667 -0
- package/skills/ai-research/18-multimodal/audiocraft/references/troubleshooting.md +505 -0
- package/skills/ai-research/18-multimodal/blip-2/SKILL.md +564 -0
- package/skills/ai-research/18-multimodal/blip-2/references/advanced-usage.md +681 -0
- package/skills/ai-research/18-multimodal/blip-2/references/troubleshooting.md +527 -0
- package/skills/ai-research/18-multimodal/clip/SKILL.md +253 -0
- package/skills/ai-research/18-multimodal/clip/references/applications.md +208 -0
- package/skills/ai-research/18-multimodal/cosmos-policy/SKILL.md +402 -0
- package/skills/ai-research/18-multimodal/cosmos-policy/references/libero-commands.md +175 -0
- package/skills/ai-research/18-multimodal/cosmos-policy/references/robocasa-commands.md +147 -0
- package/skills/ai-research/18-multimodal/llava/SKILL.md +304 -0
- package/skills/ai-research/18-multimodal/llava/references/training.md +198 -0
- package/skills/ai-research/18-multimodal/openpi/SKILL.md +480 -0
- package/skills/ai-research/18-multimodal/openpi/references/checkpoints-and-env-map.md +86 -0
- package/skills/ai-research/18-multimodal/openpi/references/config-recipes.md +50 -0
- package/skills/ai-research/18-multimodal/openpi/references/pytorch-gotchas.md +49 -0
- package/skills/ai-research/18-multimodal/openpi/references/remote-client-pattern.md +48 -0
- package/skills/ai-research/18-multimodal/openpi/references/training-debugging.md +46 -0
- package/skills/ai-research/18-multimodal/openvla-oft/SKILL.md +441 -0
- package/skills/ai-research/18-multimodal/openvla-oft/references/aloha-workflow.md +141 -0
- package/skills/ai-research/18-multimodal/openvla-oft/references/config-troubleshooting.md +97 -0
- package/skills/ai-research/18-multimodal/openvla-oft/references/libero-workflow.md +115 -0
- package/skills/ai-research/18-multimodal/openvla-oft/references/paper-and-checkpoints.md +84 -0
- package/skills/ai-research/18-multimodal/segment-anything/SKILL.md +500 -0
- package/skills/ai-research/18-multimodal/segment-anything/references/advanced-usage.md +590 -0
- package/skills/ai-research/18-multimodal/segment-anything/references/troubleshooting.md +485 -0
- package/skills/ai-research/18-multimodal/stable-diffusion/SKILL.md +519 -0
- package/skills/ai-research/18-multimodal/stable-diffusion/references/advanced-usage.md +717 -0
- package/skills/ai-research/18-multimodal/stable-diffusion/references/troubleshooting.md +556 -0
- package/skills/ai-research/18-multimodal/whisper/SKILL.md +317 -0
- package/skills/ai-research/18-multimodal/whisper/references/languages.md +190 -0
- package/skills/ai-research/19-emerging-techniques/knowledge-distillation/SKILL.md +458 -0
- package/skills/ai-research/19-emerging-techniques/knowledge-distillation/references/minillm.md +335 -0
- package/skills/ai-research/19-emerging-techniques/long-context/SKILL.md +536 -0
- package/skills/ai-research/19-emerging-techniques/long-context/references/extension_methods.md +469 -0
- package/skills/ai-research/19-emerging-techniques/long-context/references/fine_tuning.md +612 -0
- package/skills/ai-research/19-emerging-techniques/long-context/references/rope.md +403 -0
- package/skills/ai-research/19-emerging-techniques/model-merging/SKILL.md +497 -0
- package/skills/ai-research/19-emerging-techniques/model-merging/references/coefficient-tuning.md +415 -0
- package/skills/ai-research/19-emerging-techniques/model-merging/references/evaluation.md +463 -0
- package/skills/ai-research/19-emerging-techniques/model-merging/references/examples.md +429 -0
- package/skills/ai-research/19-emerging-techniques/model-merging/references/methods.md +353 -0
- package/skills/ai-research/19-emerging-techniques/model-pruning/SKILL.md +495 -0
- package/skills/ai-research/19-emerging-techniques/model-pruning/references/wanda.md +348 -0
- package/skills/ai-research/19-emerging-techniques/moe-training/SKILL.md +526 -0
- package/skills/ai-research/19-emerging-techniques/moe-training/references/architectures.md +433 -0
- package/skills/ai-research/19-emerging-techniques/moe-training/references/inference.md +349 -0
- package/skills/ai-research/19-emerging-techniques/moe-training/references/training.md +426 -0
- package/skills/ai-research/19-emerging-techniques/speculative-decoding/SKILL.md +467 -0
- package/skills/ai-research/19-emerging-techniques/speculative-decoding/references/lookahead.md +310 -0
- package/skills/ai-research/19-emerging-techniques/speculative-decoding/references/medusa.md +351 -0
- package/skills/ai-research/20-ml-paper-writing/academic-plotting/SKILL.md +479 -0
- package/skills/ai-research/20-ml-paper-writing/academic-plotting/references/data-visualization.md +509 -0
- package/skills/ai-research/20-ml-paper-writing/academic-plotting/references/diagram-generation.md +395 -0
- package/skills/ai-research/20-ml-paper-writing/academic-plotting/references/style-guide.md +305 -0
- package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/SKILL.md +982 -0
- package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/checklists.md +348 -0
- package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/citation-workflow.md +563 -0
- package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/reviewer-guidelines.md +349 -0
- package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/sources.md +165 -0
- package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/writing-guide.md +477 -0
- package/skills/ai-research/20-ml-paper-writing/presenting-conference-talks/SKILL.md +298 -0
- package/skills/ai-research/20-ml-paper-writing/presenting-conference-talks/references/slide-templates.md +505 -0
- package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/SKILL.md +270 -0
- package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/checklist.md +279 -0
- package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/reviewer-guidelines.md +116 -0
- package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/section-blueprints.md +400 -0
- package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/systems-conferences.md +261 -0
- package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/writing-patterns.md +231 -0
- package/skills/ai-research/21-research-ideation/brainstorming-research-ideas/SKILL.md +384 -0
- package/skills/ai-research/21-research-ideation/creative-thinking-for-research/SKILL.md +366 -0
- package/skills/ai-research/22-agent-native-research-artifact/compiler/SKILL.md +245 -0
- package/skills/ai-research/22-agent-native-research-artifact/compiler/references/ara-schema.md +439 -0
- package/skills/ai-research/22-agent-native-research-artifact/compiler/references/exploration-tree-spec.md +125 -0
- package/skills/ai-research/22-agent-native-research-artifact/compiler/references/validation-checklist.md +149 -0
- package/skills/ai-research/22-agent-native-research-artifact/research-manager/SKILL.md +324 -0
- package/skills/ai-research/22-agent-native-research-artifact/research-manager/references/event-taxonomy.md +124 -0
- package/skills/ai-research/22-agent-native-research-artifact/research-manager/references/provenance-tags.md +190 -0
- package/skills/ai-research/22-agent-native-research-artifact/research-manager/references/session-protocol.md +162 -0
- package/skills/ai-research/22-agent-native-research-artifact/rigor-reviewer/SKILL.md +322 -0
- package/skills/ai-research/22-agent-native-research-artifact/rigor-reviewer/references/review-dimensions.md +182 -0
- package/skills/ai-research/SKILL.md +101 -0
- package/skills/ai-research/SOURCE +38 -0
- package/skills/ai-research/index/1-frame.md +18 -0
- package/skills/ai-research/index/2-data.md +21 -0
- package/skills/ai-research/index/3-train.md +48 -0
- package/skills/ai-research/index/4-measure.md +25 -0
- package/skills/ai-research/index/5-run.md +23 -0
- package/skills/ai-research/index/6-write.md +35 -0
- package/skills/ai-research/library.json +3456 -0
- package/skills/analyze-app/EVALS.md +82 -0
- package/skills/analyze-app/SKILL.md +188 -0
- package/skills/design-contract/EVALS.md +80 -0
- package/skills/design-contract/SKILL.md +171 -0
- package/skills/design-library/EVALS.md +85 -0
- package/skills/design-library/INDEX.md +59 -0
- package/skills/design-library/SKILL.md +58 -0
- package/skills/design-library/SOURCE +131 -0
- package/skills/design-library/adaptive-interfaces/skills/colour-independence/SKILL.md +90 -0
- package/skills/design-library/adaptive-interfaces/skills/flexible-typography/SKILL.md +83 -0
- package/skills/design-library/adaptive-interfaces/skills/information-density/SKILL.md +87 -0
- package/skills/design-library/adaptive-interfaces/skills/preference-audit/SKILL.md +70 -0
- package/skills/design-library/adaptive-interfaces/skills/responsive-accessibility/SKILL.md +86 -0
- package/skills/design-library/adaptive-interfaces/skills/responsive-review/SKILL.md +76 -0
- package/skills/design-library/adaptive-interfaces/skills/simplified-views/SKILL.md +97 -0
- package/skills/design-library/adaptive-interfaces/skills/specify/SKILL.md +63 -0
- package/skills/design-library/adaptive-interfaces/skills/user-preference-respect/SKILL.md +100 -0
- package/skills/design-library/cognitive-accessibility/skills/adaptive-personalisation/SKILL.md +61 -0
- package/skills/design-library/cognitive-accessibility/skills/assess-load/SKILL.md +48 -0
- package/skills/design-library/cognitive-accessibility/skills/cognitive-load-assessment/SKILL.md +60 -0
- package/skills/design-library/cognitive-accessibility/skills/contextual-help-design/SKILL.md +61 -0
- package/skills/design-library/cognitive-accessibility/skills/error-prevention-recovery/SKILL.md +71 -0
- package/skills/design-library/cognitive-accessibility/skills/focus-attention-design/SKILL.md +67 -0
- package/skills/design-library/cognitive-accessibility/skills/memory-load-reduction/SKILL.md +60 -0
- package/skills/design-library/cognitive-accessibility/skills/plain-language-design/SKILL.md +78 -0
- package/skills/design-library/cognitive-accessibility/skills/review/SKILL.md +56 -0
- package/skills/design-library/cognitive-accessibility/skills/simplify/SKILL.md +39 -0
- package/skills/design-library/cognitive-accessibility/skills/wayfinding-navigation/SKILL.md +64 -0
- package/skills/design-library/design-research/skills/behavioural-analytics/SKILL.md +33 -0
- package/skills/design-library/design-research/skills/qual-quant-triangulation/SKILL.md +33 -0
- package/skills/design-library/inclusive-interaction/skills/audit/SKILL.md +50 -0
- package/skills/design-library/inclusive-interaction/skills/design-flow/SKILL.md +58 -0
- package/skills/design-library/inclusive-interaction/skills/feedback-and-status/SKILL.md +76 -0
- package/skills/design-library/inclusive-interaction/skills/gesture-alternatives/SKILL.md +70 -0
- package/skills/design-library/inclusive-interaction/skills/keyboard-navigation/SKILL.md +99 -0
- package/skills/design-library/inclusive-interaction/skills/keyboard-review/SKILL.md +54 -0
- package/skills/design-library/inclusive-interaction/skills/motion-sensitivity/SKILL.md +79 -0
- package/skills/design-library/inclusive-interaction/skills/multi-modal-input/SKILL.md +70 -0
- package/skills/design-library/inclusive-interaction/skills/touch-target-design/SKILL.md +71 -0
- package/skills/design-library/inclusive-interaction/skills/voice-interaction/SKILL.md +68 -0
- package/skills/design-library/visual-critique/skills/critique-affordance/SKILL.md +45 -0
- package/skills/design-library/visual-critique/skills/critique-brand-consistency/SKILL.md +42 -0
- package/skills/design-library/visual-critique/skills/critique-color/SKILL.md +44 -0
- package/skills/design-library/visual-critique/skills/critique-composition/SKILL.md +46 -0
- package/skills/design-library/visual-critique/skills/critique-information-density/SKILL.md +45 -0
- package/skills/design-library/visual-critique/skills/critique-typography/SKILL.md +45 -0
- package/skills/design-library/visual-critique/skills/critique-visual-hierarchy/SKILL.md +40 -0
- package/skills/feature-audit/EVALS.md +83 -0
- package/skills/feature-audit/SKILL.md +326 -0
- package/skills/harness/EVALS.md +81 -0
- package/skills/harness/SKILL.md +88 -0
- package/skills/i-have-adhd/EVALS.md +80 -0
- package/skills/i-have-adhd/SKILL.md +183 -0
- package/skills/no-ai-slop/EVALS.md +89 -0
- package/skills/no-ai-slop/SKILL.md +209 -0
- package/skills/no-ai-slop/eval.md +52 -0
- package/skills/plan-add/EVALS.md +79 -0
- package/skills/plan-add/SKILL.md +179 -0
- package/skills/plan-add/render_table.py +72 -0
- package/skills/plan-status/EVALS.md +78 -0
- package/skills/plan-status/SKILL.md +52 -0
- package/skills/plan-sync/EVALS.md +80 -0
- package/skills/plan-sync/SKILL.md +69 -0
- package/skills/pm-frameworks/SKILL.md +33 -0
- package/skills/pm-frameworks/SOURCE +39 -0
- package/skills/pm-frameworks/intended-vs-implemented/SKILL.md +42 -0
- package/skills/pm-frameworks/opportunity-solution-tree/SKILL.md +64 -0
- package/skills/ponytail/EVALS.md +80 -0
- package/skills/ponytail/SKILL.md +124 -0
- package/skills/product-analysis/EVALS.md +103 -0
- package/skills/product-analysis/SKILL.md +361 -0
- package/skills/research/EVALS.md +104 -0
- package/skills/research/SKILL.md +570 -0
- package/skills/rl-env/SKILL.md +53 -0
- package/skills/rl-env/SOURCE +41 -0
- package/skills/rl-env/generate-nemo-gym-env/SKILL.md +169 -0
- package/skills/rl-env/generate-nemo-gym-env/references/architecture.md +114 -0
- package/skills/rl-env/generate-openenv-env/SKILL.md +183 -0
- package/skills/rl-env/generate-openenv-env/references/architecture.md +82 -0
- package/skills/rl-env/generate-ors-env/SKILL.md +209 -0
- package/skills/rl-env/generate-ors-env/references/architecture.md +113 -0
- package/skills/rl-env/generate-verifiers-env/SKILL.md +188 -0
- package/skills/rl-env/generate-verifiers-env/references/architecture.md +119 -0
- package/skills/rl-env/rl-env-from-description/SKILL.md +124 -0
- package/skills/rl-env/rl-env-from-description/references/interview.md +75 -0
- package/skills/rl-env/rl-env-from-description/references/nemo_gym.md +41 -0
- package/skills/rl-env/rl-env-from-description/references/openenv.md +35 -0
- package/skills/rl-env/rl-env-from-description/references/ors.md +50 -0
- package/skills/rl-env/rl-env-from-description/references/verifiers.md +39 -0
- package/skills/tezgah-contract/EVALS.md +78 -0
- package/skills/tezgah-contract/SKILL.md +792 -0
- package/statusline.py +129 -0
- package/workflows/graph-impact.js +153 -0
- package/workflows/graph-map.js +158 -0
- package/workflows/graph-review.js +170 -0
|
@@ -0,0 +1,366 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: creative-thinking-for-research
|
|
3
|
+
description: Applies cognitive science frameworks for creative thinking to CS and AI research ideation. Use when seeking genuinely novel research directions by leveraging combinatorial creativity, analogical reasoning, constraint manipulation, and other empirically grounded creative strategies.
|
|
4
|
+
version: 1.0.0
|
|
5
|
+
author: Orchestra Research
|
|
6
|
+
license: MIT
|
|
7
|
+
tags: [Creative Thinking, Research Ideation, Analogical Reasoning, Problem Reformulation, Cognitive Science]
|
|
8
|
+
dependencies: []
|
|
9
|
+
---
|
|
10
|
+
|
|
11
|
+
# Creative Thinking for Research
|
|
12
|
+
|
|
13
|
+
Eight empirically grounded frameworks from cognitive science, applied to computer science and AI research. Unlike ad-hoc brainstorming, each framework here is backed by decades of creativity research — from Koestler's bisociation to Kauffman's adjacent possible. They target distinct cognitive operations: combining, reformulating, analogizing, constraining, inverting, abstracting, exploring boundaries, and holding contradictions.
|
|
14
|
+
|
|
15
|
+
## When to Use This Skill
|
|
16
|
+
|
|
17
|
+
- Generating genuinely novel ideas, not incremental extensions of prior work
|
|
18
|
+
- Feeling trapped in a local optimum of thinking within a single subfield
|
|
19
|
+
- Wanting to systematically apply creativity heuristics rather than waiting for inspiration
|
|
20
|
+
- Preparing for a research retreat or PhD-level ideation session
|
|
21
|
+
- Bridging between fields and seeking structural (not superficial) connections
|
|
22
|
+
|
|
23
|
+
**Do NOT use this skill when**:
|
|
24
|
+
- You need structured project-level brainstorming workflows (use `brainstorming-research-ideas`)
|
|
25
|
+
- You have a well-defined problem and need execution help (use domain-specific skills)
|
|
26
|
+
- You need a literature survey (use `scientific-skills:literature-review`)
|
|
27
|
+
|
|
28
|
+
**Relationship to Brainstorm skill**: The brainstorm skill provides operational workflows (diverge → converge → refine) and practical filters. This skill provides the deeper cognitive engines that power creative leaps. Use them together: creative-thinking to generate raw insight, brainstorm to structure and evaluate it.
|
|
29
|
+
|
|
30
|
+
---
|
|
31
|
+
|
|
32
|
+
## Framework 1: Combinatorial Creativity (Bisociation)
|
|
33
|
+
|
|
34
|
+
Novel ideas arise from combining existing concepts in unexpected ways. Arthur Koestler called this **bisociation** — connecting two previously unrelated frames of reference, as distinct from routine association within a single frame.
|
|
35
|
+
|
|
36
|
+
**Why it works**: Meta-research consistently shows that breadth of knowledge is a precursor to creative output. People who read across disciplines produce more novel work. The combination itself is the creative act.
|
|
37
|
+
|
|
38
|
+
**In CS Research**:
|
|
39
|
+
- Biological evolution → optimization (genetic algorithms)
|
|
40
|
+
- Game theory → networking (mechanism design for routing)
|
|
41
|
+
- Statistical physics → machine learning (Boltzmann machines, energy-based models)
|
|
42
|
+
- Linguistics → programming (type theory, formal grammars)
|
|
43
|
+
|
|
44
|
+
**Systematic Bisociation Workflow**:
|
|
45
|
+
|
|
46
|
+
1. **Select two domains** you have at least passing familiarity with
|
|
47
|
+
2. **List core primitives** in each domain (5-10 fundamental concepts per domain)
|
|
48
|
+
3. **Create a cross-product matrix**: row = concepts from Domain A, column = concepts from Domain B
|
|
49
|
+
4. **For each cell**, ask: "What would it mean to apply A's concept to B's problem?"
|
|
50
|
+
5. **Filter**: Which combinations produce a non-trivial, testable research question?
|
|
51
|
+
6. **Validate structural depth**: Is the connection mechanistic or merely metaphorical?
|
|
52
|
+
|
|
53
|
+
**Cross-Product Example**:
|
|
54
|
+
|
|
55
|
+
| | Caching | Load Balancing | Fault Tolerance |
|
|
56
|
+
|---|---------|---------------|-----------------|
|
|
57
|
+
| **Natural Selection** | Evict least-fit entries | Adaptive allocation via fitness | Population-level redundancy |
|
|
58
|
+
| **Immune Memory** | Learned threat signatures | Distributed detection | Self/non-self discrimination |
|
|
59
|
+
| **Symbiosis** | Cooperative prefetching | Mutualistic resource sharing | Co-dependent resilience |
|
|
60
|
+
|
|
61
|
+
**Quality Test**: A strong bisociation is not a surface metaphor ("the network is like a brain") but a structural mapping where the mechanism transfers ("attention mechanisms implement a form of selective gating analogous to cognitive attention filtering").
|
|
62
|
+
|
|
63
|
+
**Self-Check**:
|
|
64
|
+
- [ ] Is the connection structural (mechanisms map) or merely verbal (labels map)?
|
|
65
|
+
- [ ] Does the combination generate testable predictions?
|
|
66
|
+
- [ ] Would an expert in both fields find the connection non-obvious but sound?
|
|
67
|
+
|
|
68
|
+
---
|
|
69
|
+
|
|
70
|
+
## Framework 2: Problem Reformulation (Representational Change)
|
|
71
|
+
|
|
72
|
+
Gestalt psychologists identified that breakthroughs often come not from solving the problem as stated, but from **re-representing the problem itself**. Kaplan and Simon's work on insight shows that changing the problem space — the constraints, the abstraction level, the formalism — is often where creativity lives.
|
|
73
|
+
|
|
74
|
+
**The Key Shift**: From "How do I solve this problem?" to "Am I even thinking about this problem correctly?"
|
|
75
|
+
|
|
76
|
+
**Reformulation Strategies**:
|
|
77
|
+
|
|
78
|
+
| Strategy | Example |
|
|
79
|
+
|----------|---------|
|
|
80
|
+
| **Change the objective** | "Make the algorithm faster" → "Eliminate the need for this computation" |
|
|
81
|
+
| **Change the formalism** | Graph problem → linear algebra problem (spectral methods) |
|
|
82
|
+
| **Change the granularity** | Per-token prediction → per-span prediction |
|
|
83
|
+
| **Change the agent** | "How should the model learn?" → "How should the data teach?" (curriculum learning) |
|
|
84
|
+
| **Change the timescale** | Real-time optimization → amortized inference |
|
|
85
|
+
| **Invert the direction** | Forward simulation → inverse problem (learning from observations) |
|
|
86
|
+
|
|
87
|
+
**Workflow**:
|
|
88
|
+
|
|
89
|
+
1. State your current problem in one sentence
|
|
90
|
+
2. Identify the **hidden assumptions** in that statement:
|
|
91
|
+
- What formalism are you using? (Could you use a different one?)
|
|
92
|
+
- What is the objective? (Is it the right objective?)
|
|
93
|
+
- What level of granularity? (Could you go coarser or finer?)
|
|
94
|
+
- Who is the agent? (Could you shift perspective?)
|
|
95
|
+
3. For each assumption, **generate the alternative**: "What if [opposite assumption]?"
|
|
96
|
+
4. For each alternative, ask: "Does this reformulation make the problem easier, harder, or different in a useful way?"
|
|
97
|
+
5. A reformulation that makes a hard problem easy is often a publishable insight on its own
|
|
98
|
+
|
|
99
|
+
**Classic CS Examples**:
|
|
100
|
+
- **PageRank**: Reformulated "find important web pages" from content analysis to graph eigenvalue problem
|
|
101
|
+
- **Dropout**: Reformulated "prevent overfitting" from regularization to approximate ensemble
|
|
102
|
+
- **Attention**: Reformulated "handle long sequences" from remembering everything to selectively querying
|
|
103
|
+
|
|
104
|
+
---
|
|
105
|
+
|
|
106
|
+
## Framework 3: Analogical Reasoning (Structure-Mapping)
|
|
107
|
+
|
|
108
|
+
Dedre Gentner's **structure-mapping theory** and Kevin Dunbar's studies of real scientists show that analogy is the core engine of scientific creativity. The critical finding: surface-level analogies are common but weak; **structural or relational analogies** — where the deep causal/relational structure maps across domains — produce the most powerful insights.
|
|
109
|
+
|
|
110
|
+
**Dunbar's Finding**: In the most successful labs, analogies from distant domains drove the most important discoveries. Nearby analogies refined ideas; distant analogies generated them.
|
|
111
|
+
|
|
112
|
+
**Levels of Analogical Depth**:
|
|
113
|
+
|
|
114
|
+
| Level | Description | Value | Example |
|
|
115
|
+
|-------|-------------|-------|---------|
|
|
116
|
+
| **Surface** | Things look similar | Low | "A neural network is like a brain" |
|
|
117
|
+
| **Relational** | Relationships between entities match | Medium | "Attention allocation in models parallels resource allocation in economics" |
|
|
118
|
+
| **Structural** | Deep causal mechanisms map | High | "Diffusion models reverse a thermodynamic process; the math of non-equilibrium stat-mech directly applies" |
|
|
119
|
+
|
|
120
|
+
**Structure-Mapping Workflow**:
|
|
121
|
+
|
|
122
|
+
1. **Describe your problem** using only relational/causal language (strip domain-specific nouns)
|
|
123
|
+
- Bad: "We need to improve transformer attention efficiency"
|
|
124
|
+
- Good: "We have a system that must selectively aggregate information from a large set, where relevance is context-dependent and the cost scales quadratically with set size"
|
|
125
|
+
2. **Search for structural matches**: What other systems selectively aggregate from large sets?
|
|
126
|
+
- Database query optimization, visual attention in neuroscience, information retrieval, resource allocation
|
|
127
|
+
3. **Pick the most distant match** with genuine structural fidelity
|
|
128
|
+
4. **Map the solution mechanism**: How does the source domain solve this?
|
|
129
|
+
5. **Transfer and adapt**: What changes when you bring that mechanism into your domain?
|
|
130
|
+
6. **Generate predictions**: The analogy should tell you something you didn't already know
|
|
131
|
+
|
|
132
|
+
**Validation Checklist**:
|
|
133
|
+
- [ ] Does the mapping preserve causal/relational structure (not just labels)?
|
|
134
|
+
- [ ] Can I identify at least one prediction the analogy makes in my domain?
|
|
135
|
+
- [ ] Would an expert in the source domain confirm the mechanism is correctly understood?
|
|
136
|
+
- [ ] Is the analogy non-obvious to my target audience?
|
|
137
|
+
|
|
138
|
+
---
|
|
139
|
+
|
|
140
|
+
## Framework 4: Constraint Manipulation (Boden's Framework)
|
|
141
|
+
|
|
142
|
+
Margaret Boden's framework distinguishes three forms of creativity based on how they interact with constraints:
|
|
143
|
+
|
|
144
|
+
| Type | Operation | CS Example |
|
|
145
|
+
|------|-----------|------------|
|
|
146
|
+
| **Exploratory** | Search within the existing conceptual space | Hyperparameter tuning, architecture search within a fixed paradigm |
|
|
147
|
+
| **Combinational** | Combine elements from different spaces | Multi-task learning, neuro-symbolic methods |
|
|
148
|
+
| **Transformational** | Change the rules of the space itself | Dropping the assumption that training requires labels (self-supervised learning) |
|
|
149
|
+
|
|
150
|
+
**Transformational creativity is the rarest and highest-impact.** It happens when you change what is even considered a valid solution.
|
|
151
|
+
|
|
152
|
+
**Constraint Analysis Workflow**:
|
|
153
|
+
|
|
154
|
+
1. **List the constraints** of your current approach (5-10 constraints):
|
|
155
|
+
- Computational: "Must fit in GPU memory"
|
|
156
|
+
- Methodological: "Requires labeled data"
|
|
157
|
+
- Architectural: "Uses fixed-length context"
|
|
158
|
+
- Evaluative: "Measured by accuracy on benchmark X"
|
|
159
|
+
2. **Classify each constraint**:
|
|
160
|
+
- **Hard**: Physically or logically necessary (cannot violate)
|
|
161
|
+
- **Soft**: Convention or historical accident (can question)
|
|
162
|
+
- **Hidden**: Not stated but implicitly assumed (most fertile for innovation)
|
|
163
|
+
3. **For each soft/hidden constraint**, ask:
|
|
164
|
+
- What if we relaxed it? (streaming algorithms from relaxing "fits in memory")
|
|
165
|
+
- What if we tightened it? (efficiency research from tightening compute budgets)
|
|
166
|
+
- What if we replaced it with a different constraint entirely?
|
|
167
|
+
4. **The most productive move** is often exposing and dropping a hidden constraint
|
|
168
|
+
|
|
169
|
+
**Classic Examples of Constraint Transformation**:
|
|
170
|
+
- "Data must fit in memory" → dropped → streaming algorithms, external memory
|
|
171
|
+
- "Training requires human labels" → dropped → self-supervised learning
|
|
172
|
+
- "Models must be deterministic" → dropped → variational methods, diffusion
|
|
173
|
+
- "Inference must happen in one pass" → dropped → iterative refinement, chain-of-thought
|
|
174
|
+
|
|
175
|
+
---
|
|
176
|
+
|
|
177
|
+
## Framework 5: Negation and Inversion
|
|
178
|
+
|
|
179
|
+
Take a core assumption in your field and negate it. This is formalized in De Bono's lateral thinking and the **TRIZ methodology** from engineering.
|
|
180
|
+
|
|
181
|
+
**The Pattern**: "What if [widely held assumption] is wrong, unnecessary, or invertible?"
|
|
182
|
+
|
|
183
|
+
**Systematic Negation Workflow**:
|
|
184
|
+
|
|
185
|
+
1. **List 5-10 core assumptions** in your subfield (the things "everyone knows")
|
|
186
|
+
2. **Negate each one** and ask: What system would you build?
|
|
187
|
+
3. **Evaluate each negation**:
|
|
188
|
+
- Incoherent → discard
|
|
189
|
+
- Already explored → check if conditions have changed (see brainstorm skill, Framework 5)
|
|
190
|
+
- Unexplored and coherent → potential research direction
|
|
191
|
+
|
|
192
|
+
**Negation Hall of Fame in CS**:
|
|
193
|
+
|
|
194
|
+
| Assumption | Negation | Result |
|
|
195
|
+
|-----------|----------|--------|
|
|
196
|
+
| "We need strong consistency" | What if we don't? | Eventual consistency, CRDTs |
|
|
197
|
+
| "We need exact answers" | What if approximate is fine? | Sketches, LSH, approximate nearest neighbors |
|
|
198
|
+
| "Labels are necessary" | What if we learn without them? | Self-supervised learning, contrastive methods |
|
|
199
|
+
| "More parameters = more compute" | What if we don't use all parameters? | Mixture of Experts, sparse models |
|
|
200
|
+
| "Training and inference are separate" | What if the model keeps learning? | Online learning, test-time training |
|
|
201
|
+
| "Errors must be prevented" | What if we embrace and correct them? | Speculative decoding, self-correction |
|
|
202
|
+
|
|
203
|
+
**TRIZ-Inspired Principles for CS**:
|
|
204
|
+
|
|
205
|
+
| TRIZ Principle | CS Application |
|
|
206
|
+
|---------------|----------------|
|
|
207
|
+
| **Inversion** | Reverse the process (generative vs. discriminative) |
|
|
208
|
+
| **Segmentation** | Break monolithic into modular (microservices, mixture of experts) |
|
|
209
|
+
| **Merging** | Combine separate steps (end-to-end learning) |
|
|
210
|
+
| **Universality** | One component serves multiple functions (multi-task models) |
|
|
211
|
+
| **Nesting** | Place one system inside another (meta-learning) |
|
|
212
|
+
| **Dynamization** | Make static things adaptive (dynamic architectures, adaptive computation) |
|
|
213
|
+
|
|
214
|
+
---
|
|
215
|
+
|
|
216
|
+
## Framework 6: Abstraction and Generalization Laddering
|
|
217
|
+
|
|
218
|
+
Moving up and down the abstraction ladder is a fundamental creative act. Polya's heuristics formalize this: *"Can you solve a more general problem? A more specific one? An analogous one?"*
|
|
219
|
+
|
|
220
|
+
**Three Moves**:
|
|
221
|
+
|
|
222
|
+
| Move | Question | Outcome |
|
|
223
|
+
|------|----------|---------|
|
|
224
|
+
| **Generalize** | "Is my solution a special case of something broader?" | Framework papers, unifying theories |
|
|
225
|
+
| **Specialize** | "What happens when I add extreme constraints?" | Niche applications, surprising edge cases |
|
|
226
|
+
| **Analogize** | "Where else does this abstract pattern appear?" | Cross-domain transfer (see Framework 3) |
|
|
227
|
+
|
|
228
|
+
**Generalization Workflow**:
|
|
229
|
+
1. State your specific result
|
|
230
|
+
2. Replace each specific element with a variable: "ResNet works for ImageNet" → "Architecture X works for distribution Y"
|
|
231
|
+
3. Ask: Under what conditions does this hold? What is the general principle?
|
|
232
|
+
4. If the general principle is novel → that is the contribution
|
|
233
|
+
|
|
234
|
+
**Specialization Workflow**:
|
|
235
|
+
1. Take a general method
|
|
236
|
+
2. Add extreme constraints: tiny data, huge dimensionality, adversarial inputs, real-time requirements
|
|
237
|
+
3. Ask: Does the method still work? If not, why not?
|
|
238
|
+
4. The failure case often reveals the method's true assumptions
|
|
239
|
+
|
|
240
|
+
**When to Generalize vs. Specialize**:
|
|
241
|
+
- Generalize when you have results but no explanation
|
|
242
|
+
- Specialize when you have theory but no grounding
|
|
243
|
+
- Analogize when you are stuck in either direction
|
|
244
|
+
|
|
245
|
+
---
|
|
246
|
+
|
|
247
|
+
## Framework 7: The Adjacent Possible (Kauffman / Johnson)
|
|
248
|
+
|
|
249
|
+
Stuart Kauffman's concept, popularized by Steven Johnson: innovation happens at the boundary of what is currently reachable — the **adjacent possible**. New ideas become thinkable once their prerequisites exist. This explains why simultaneous independent discovery is so common — multiple people reach the same boundary.
|
|
250
|
+
|
|
251
|
+
**Practical Implication**: Map what has recently become possible and explore the space those enablers open.
|
|
252
|
+
|
|
253
|
+
**Adjacent Possible Mapping Workflow**:
|
|
254
|
+
|
|
255
|
+
1. **List recent enablers** (last 1-3 years):
|
|
256
|
+
- New hardware capabilities (longer context, faster inference, new accelerators)
|
|
257
|
+
- New datasets or benchmarks
|
|
258
|
+
- New open-source tools or frameworks
|
|
259
|
+
- New theoretical results
|
|
260
|
+
- New regulatory or social conditions
|
|
261
|
+
2. **For each enabler, ask**: "What was previously impossible or impractical that this now permits?"
|
|
262
|
+
3. **Combine enablers**: The most powerful adjacent possibles arise from the intersection of multiple new enablers
|
|
263
|
+
4. **Check for competition**: If many people can see the same adjacent possible, speed or a unique angle matters
|
|
264
|
+
|
|
265
|
+
**Current Adjacent Possibles (2025-2026)**:
|
|
266
|
+
|
|
267
|
+
| Enabler | Newly Possible |
|
|
268
|
+
|---------|---------------|
|
|
269
|
+
| 1M+ token context windows | Full-codebase reasoning, book-length analysis |
|
|
270
|
+
| Inference cost drops (100x in 2 years) | Real-time agentic loops, always-on AI assistants |
|
|
271
|
+
| Open-weight models at GPT-4 level | Reproducible research on frontier capabilities |
|
|
272
|
+
| Multimodal models (vision + language + audio) | Unified perception-reasoning systems |
|
|
273
|
+
| Synthetic data at scale | Training data for domains with no natural data |
|
|
274
|
+
| Tool-using models | Research automation, self-improving systems |
|
|
275
|
+
|
|
276
|
+
**Timing Signal**: If your idea requires technology that doesn't exist yet, it's beyond the adjacent possible — park it. If your idea could have been done 5 years ago, someone probably did — check the literature. The sweet spot is ideas that became feasible in the last 6-18 months.
|
|
277
|
+
|
|
278
|
+
---
|
|
279
|
+
|
|
280
|
+
## Framework 8: Janusian and Dialectical Thinking
|
|
281
|
+
|
|
282
|
+
Albert Rothenberg's studies of eminent creators found that **holding two contradictory ideas simultaneously** is a hallmark of creative thinking. Named after Janus, the two-faced Roman god, this mode of thinking doesn't resolve contradictions by choosing a side — it generates new frameworks that transcend the opposition.
|
|
283
|
+
|
|
284
|
+
**In CS**: The most influential results often emerge from tensions previously thought irreconcilable.
|
|
285
|
+
|
|
286
|
+
| Contradiction | Resolution | Impact |
|
|
287
|
+
|--------------|------------|--------|
|
|
288
|
+
| Consistency AND Availability (distributed systems) | CAP theorem: formalized the trade-off, then Raft/CRDTs found practical middle grounds | Foundation of distributed systems theory |
|
|
289
|
+
| Security AND Usability | Zero-knowledge proofs: prove knowledge without revealing it | Enabled private computation |
|
|
290
|
+
| Expressiveness AND Tractability | Probabilistic programming: express complex models, automate inference | New programming paradigm |
|
|
291
|
+
| Memorization AND Generalization | Grokking: models memorize first, then generalize with more training | New understanding of learning dynamics |
|
|
292
|
+
| Compression AND Quality | Neural codecs that compress beyond information-theoretic limits via learned priors | Redefined compression research |
|
|
293
|
+
|
|
294
|
+
**Dialectical Thinking Workflow**:
|
|
295
|
+
|
|
296
|
+
1. **Identify a binary** in your field: A vs. B (two approaches, goals, or paradigms treated as opposites)
|
|
297
|
+
2. **Resist choosing a side**. Instead ask:
|
|
298
|
+
- "What would a system look like that achieves both A and B?"
|
|
299
|
+
- "Under what conditions is the A-B trade-off not fundamental?"
|
|
300
|
+
- "Is the opposition an artifact of how we formalized the problem?"
|
|
301
|
+
3. **Seek synthesis**: The resolution often requires a new abstraction that reframes the relationship
|
|
302
|
+
4. **Test the synthesis**: Can you demonstrate empirically that both goals are achievable?
|
|
303
|
+
|
|
304
|
+
**Self-Check**:
|
|
305
|
+
- [ ] Am I holding the contradiction genuinely (not prematurely resolving it)?
|
|
306
|
+
- [ ] Is the synthesis a new idea, not just a compromise (splitting the difference)?
|
|
307
|
+
- [ ] Does the resolution change how people think about the problem, not just the solution?
|
|
308
|
+
|
|
309
|
+
---
|
|
310
|
+
|
|
311
|
+
## Combining Frameworks: A Creative Thinking Protocol
|
|
312
|
+
|
|
313
|
+
These frameworks are most powerful in combination. Here is a systematic protocol for a deep creative thinking session:
|
|
314
|
+
|
|
315
|
+
### Phase 1: Map the Space (15 min)
|
|
316
|
+
1. **Constraint Manipulation** (F4): List all constraints of the current paradigm. Mark which are hard, soft, hidden.
|
|
317
|
+
2. **Adjacent Possible** (F7): List recent enablers that change the feasibility landscape.
|
|
318
|
+
|
|
319
|
+
### Phase 2: Generate Disruptions (30 min)
|
|
320
|
+
3. **Negation** (F5): Negate 3 soft/hidden constraints. What systems emerge?
|
|
321
|
+
4. **Bisociation** (F1): Pick a distant field and create a cross-product matrix with your domain.
|
|
322
|
+
5. **Problem Reformulation** (F2): Restate your problem 3 different ways (change objective, formalism, agent).
|
|
323
|
+
|
|
324
|
+
### Phase 3: Deepen Promising Leads (30 min)
|
|
325
|
+
6. **Analogical Reasoning** (F3): For each promising idea, find a structural analogy and extract predictions.
|
|
326
|
+
7. **Abstraction Laddering** (F6): Move each idea up (generalize) and down (specialize).
|
|
327
|
+
8. **Janusian Thinking** (F8): Identify any tensions. Can you synthesize rather than choose?
|
|
328
|
+
|
|
329
|
+
### Phase 4: Evaluate (15 min)
|
|
330
|
+
Apply the two-sentence test (from the brainstorm skill):
|
|
331
|
+
> "**[Domain] currently struggles with [problem] because [reason].** We [approach] by [mechanism], which works because [insight]."
|
|
332
|
+
|
|
333
|
+
Any idea that survives all four phases and passes the two-sentence test is worth pursuing.
|
|
334
|
+
|
|
335
|
+
---
|
|
336
|
+
|
|
337
|
+
## Common Creative Blocks and Unblocking Strategies
|
|
338
|
+
|
|
339
|
+
| Block | Symptom | Framework to Apply |
|
|
340
|
+
|-------|---------|-------------------|
|
|
341
|
+
| **Fixation** | Cannot stop thinking about the problem one way | Problem Reformulation (F2) — force a different representation |
|
|
342
|
+
| **Tunnel vision** | All ideas come from the same subfield | Bisociation (F1) or Analogical Reasoning (F3) — import from elsewhere |
|
|
343
|
+
| **Self-censoring** | Dismissing ideas as "too weird" before exploring | Negation (F5) — weird is the point; evaluate after generating |
|
|
344
|
+
| **Incrementalism** | Every idea is "+2% on benchmark X" | Constraint Manipulation (F4) — change the rules, not the parameters |
|
|
345
|
+
| **Analysis paralysis** | Too many options, cannot commit | Adjacent Possible (F7) — what is feasible right now? |
|
|
346
|
+
| **False dichotomy** | Stuck choosing between two approaches | Janusian Thinking (F8) — seek synthesis, not selection |
|
|
347
|
+
|
|
348
|
+
---
|
|
349
|
+
|
|
350
|
+
## Usage Instructions for Agents
|
|
351
|
+
|
|
352
|
+
When a researcher asks for help with creative thinking or novel ideation:
|
|
353
|
+
|
|
354
|
+
1. **Assess the block**: What kind of thinking are they stuck in? (See Common Creative Blocks table)
|
|
355
|
+
2. **Select 2-3 frameworks** based on the block type
|
|
356
|
+
3. **Walk through each framework interactively**, asking the researcher to supply domain-specific content
|
|
357
|
+
4. **Push for structural depth**: If an analogy or combination is surface-level, probe deeper
|
|
358
|
+
5. **Maintain a running list** of all generated ideas, even unusual ones
|
|
359
|
+
6. **Apply the two-sentence test** to candidates that survive exploration
|
|
360
|
+
7. **Hand off to the brainstorm skill** for systematic evaluation (diverge → converge → refine)
|
|
361
|
+
|
|
362
|
+
**Key Principles**:
|
|
363
|
+
- Generative mode first, evaluative mode second — do not filter prematurely
|
|
364
|
+
- Distant analogies are more valuable than nearby ones, but require more validation
|
|
365
|
+
- The researcher's domain expertise is essential — the agent provides the cognitive scaffolding, not the domain knowledge
|
|
366
|
+
- Encourage the researcher to sit with contradictions rather than resolve them quickly
|
|
@@ -0,0 +1,245 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: ara-compiler
|
|
3
|
+
description: Compiles any research input — PDF papers, GitHub repositories, experiment logs, code directories, or raw notes — into a complete Agent-Native Research Artifact (ARA) with cognitive layer (claims, concepts, heuristics), physical layer (configs, code stubs), exploration graph, and grounded evidence. Use when ingesting a paper or codebase into a structured, machine-executable knowledge package, building an ARA from scratch, or converting research outputs into a falsifiable, agent-traversable form.
|
|
4
|
+
version: 1.0.0
|
|
5
|
+
author: Orchestra Research
|
|
6
|
+
license: MIT
|
|
7
|
+
tags: [ARA, Research Artifacts, Knowledge Extraction, Paper Ingestion, Exploration Graph, Provenance, Research Tooling, Epistemic Compilation]
|
|
8
|
+
dependencies: []
|
|
9
|
+
---
|
|
10
|
+
|
|
11
|
+
# Universal ARA Compiler
|
|
12
|
+
|
|
13
|
+
You are the ARA Universal Compiler. Your job: take ANY research input and produce a complete,
|
|
14
|
+
validated ARA artifact. You operate as a first-class Claude Code agent — use your native tools
|
|
15
|
+
(Read, Write, Edit, Bash, Glob, Grep) directly. No API wrapper needed.
|
|
16
|
+
|
|
17
|
+
## Input Philosophy
|
|
18
|
+
|
|
19
|
+
The compiler is **open-ended**. It accepts anything that contains research knowledge — there is
|
|
20
|
+
no fixed input schema. Your job is to figure out what you've been given and extract maximum
|
|
21
|
+
structured knowledge from it.
|
|
22
|
+
|
|
23
|
+
Possible inputs include (but are NOT limited to):
|
|
24
|
+
- PDF papers, arXiv links
|
|
25
|
+
- GitHub repositories (URLs or local paths)
|
|
26
|
+
- Code files, scripts, notebooks (`.py`, `.ipynb`, `.rs`, `.cpp`, etc.)
|
|
27
|
+
- Experiment logs, training outputs, evaluation results
|
|
28
|
+
- Configuration files, hyperparameter sweeps
|
|
29
|
+
- Raw research notes, brainstorm transcripts, meeting notes
|
|
30
|
+
- Data directories with results, checkpoints, figures
|
|
31
|
+
- Slack/email threads describing research decisions
|
|
32
|
+
- Combinations of the above
|
|
33
|
+
- A verbal description or conversation with the user about their research
|
|
34
|
+
- Nothing at all — the user may want to build an ARA interactively through dialogue
|
|
35
|
+
|
|
36
|
+
When arguments are provided (`$ARGUMENTS`), interpret them flexibly:
|
|
37
|
+
- File/directory paths → read them
|
|
38
|
+
- URLs → fetch or clone them
|
|
39
|
+
- `--output <dir>` → where to write the ARA (default: `./ara-output/`)
|
|
40
|
+
- `--rubric <path>` → PaperBench rubric for coverage mapping
|
|
41
|
+
- Anything else → treat as context or ask the user for clarification
|
|
42
|
+
|
|
43
|
+
### Input Reading Strategy
|
|
44
|
+
|
|
45
|
+
Adapt to whatever you receive:
|
|
46
|
+
1. **Identify what you have.** Glob, read, and explore the provided paths. Understand the nature
|
|
47
|
+
of the input before committing to a generation plan.
|
|
48
|
+
2. **Maximize coverage.** Cross-reference all available sources. A PDF gives narrative + claims;
|
|
49
|
+
code gives ground-truth implementation; experiment logs give the exploration trajectory;
|
|
50
|
+
notes give decisions and dead ends that never made it to paper.
|
|
51
|
+
3. **Ask when stuck.** If the input is ambiguous or incomplete, ask the user to fill gaps rather
|
|
52
|
+
than hallucinating. The user is a collaborator, not a passive consumer.
|
|
53
|
+
4. **Handle partial inputs gracefully.** Not every ARA field will be fillable from every input.
|
|
54
|
+
Populate what you can with high confidence, mark gaps explicitly with "Not available from
|
|
55
|
+
provided input", and tell the user what's missing so they can supplement later.
|
|
56
|
+
|
|
57
|
+
## Workflow
|
|
58
|
+
|
|
59
|
+
```text
|
|
60
|
+
1. READ all inputs
|
|
61
|
+
2. REASON through the 4-stage epistemic protocol (see below)
|
|
62
|
+
3. GENERATE all ARA files using Write tool
|
|
63
|
+
4. COVERAGE CHECK loop (max 3 rounds): re-read source → diff against ARA → patch gaps
|
|
64
|
+
5. VALIDATE by running Seal Level 1
|
|
65
|
+
6. FIX any failures, re-validate
|
|
66
|
+
7. REPORT summary to user
|
|
67
|
+
```
|
|
68
|
+
|
|
69
|
+
### Step 1: Read Inputs
|
|
70
|
+
|
|
71
|
+
Read ALL provided inputs thoroughly before generating anything. For PDFs, read every page,
|
|
72
|
+
**including appendices** — appendices often carry reproduction-critical content and should
|
|
73
|
+
be treated with the same priority as main-text pages.
|
|
74
|
+
|
|
75
|
+
For repos, prioritize: README → core algorithm files → configs → environment files.
|
|
76
|
+
|
|
77
|
+
### Step 2: 4-Stage Epistemic Chain-of-Thought
|
|
78
|
+
|
|
79
|
+
Before writing any files, reason through these 4 stages. Think carefully about each stage.
|
|
80
|
+
|
|
81
|
+
**Stage 1 — Semantic Deconstruction**
|
|
82
|
+
Strip narrative framing. Extract the raw knowledge atoms:
|
|
83
|
+
- Mathematical formulations and equations
|
|
84
|
+
- Architectural specifications and component descriptions
|
|
85
|
+
- Experimental configurations (hyperparameters, hardware, datasets, seeds)
|
|
86
|
+
- ALL numerical results and benchmarks (exact values, never rounded)
|
|
87
|
+
- Citation dependencies and their roles (imports, extends, bounds, refutes)
|
|
88
|
+
- Negative results, ablation findings, rejected alternatives
|
|
89
|
+
- Implementation tricks, convergence hacks, sensitivity observations
|
|
90
|
+
|
|
91
|
+
Before moving on, perform an **evidence capture pass**:
|
|
92
|
+
- For every source table or figure you plan to cite, first capture the original source identifier and caption exactly (`Table 2`, `Figure 4`, etc.)
|
|
93
|
+
- Transcribe the raw table/figure content before making any claim-specific summary
|
|
94
|
+
- If you create a filtered view for one claim, store it as a **derived subset**, not as the original table itself
|
|
95
|
+
- Never label a subset or merged summary as `Table N` unless it reproduces the original source table faithfully
|
|
96
|
+
- If PDF extraction is ambiguous, re-read the page with layout preserved or inspect the page manually before writing evidence files
|
|
97
|
+
|
|
98
|
+
**Stage 2 — Cognitive Mapping**
|
|
99
|
+
Map extracted atoms to `/logic/`:
|
|
100
|
+
- **problem.md**: observations (with numbers) → gaps → key insight → assumptions
|
|
101
|
+
- **claims.md**: falsifiable claims with proof pointers to experiment IDs (E01, E02...), plus a separation between direct evidence basis and higher-level interpretation
|
|
102
|
+
- **concepts.md**: ≥5 formal definitions with notation and boundary conditions
|
|
103
|
+
- **experiments.md**: ≥3 declarative verification plans (NO exact numbers — directional only)
|
|
104
|
+
- **solution/**: architecture (component graph), algorithm (math + pseudocode), constraints, heuristics
|
|
105
|
+
- **related_work.md**: typed dependency graph (imports/extends/bounds/baseline/refutes)
|
|
106
|
+
|
|
107
|
+
Appendix content (worked examples, prompt templates, enumerated taxonomies, annotation
|
|
108
|
+
schemas, extended analyses, prescriptive content) should be routed into the ARA layers
|
|
109
|
+
where it fits best, preserving the granularity the source uses. Never silently drop an
|
|
110
|
+
appendix section.
|
|
111
|
+
|
|
112
|
+
When writing claims:
|
|
113
|
+
- Phrase the main `Statement` at the strongest level directly supported by the cited evidence
|
|
114
|
+
- Put raw support in `Evidence basis`
|
|
115
|
+
- Put any broader synthesis in `Interpretation`
|
|
116
|
+
- If the evidence only shows validation metrics, do not upgrade the claim to training dynamics or optimization quality unless training-side evidence is also captured
|
|
117
|
+
|
|
118
|
+
`related_work.md` should reflect the paper's full citation footprint, not only the
|
|
119
|
+
closest predecessors. Works with a specific technical delta get full `RW` blocks; remaining
|
|
120
|
+
citations from the paper's References list should still be captured (more briefly) so the
|
|
121
|
+
intellectual neighborhood is preserved.
|
|
122
|
+
|
|
123
|
+
**Stage 3 — Physical Stubbing**
|
|
124
|
+
Generate `/src/`:
|
|
125
|
+
- **configs/**: exact hyperparameter values with rationale and sensitivity
|
|
126
|
+
- **execution/**: ≥1 Python code stub implementing the NOVEL contribution (typed signatures, no boilerplate)
|
|
127
|
+
- **environment.md**: Python version, framework, hardware, dependencies, seeds
|
|
128
|
+
- If repo available: use actual code to improve stub precision
|
|
129
|
+
- If rubric provided: produce `rubric/requirements.md` mapping every leaf node
|
|
130
|
+
|
|
131
|
+
**Stage 4 — Exploration Graph Extraction**
|
|
132
|
+
Reconstruct the research DAG for `/trace/exploration_tree.yaml`:
|
|
133
|
+
- Root nodes = central research questions
|
|
134
|
+
- Experiments and decisions nest as children
|
|
135
|
+
- Dead ends from ablations/rejected alternatives = typed leaf nodes
|
|
136
|
+
- ≥8 nodes, must include dead_end and decision types
|
|
137
|
+
- Use `also_depends_on` for DAG convergence points
|
|
138
|
+
- Every node must declare whether it is `explicit` from source material or `inferred` from reconstruction
|
|
139
|
+
- Explicit nodes should carry source references (table/figure/section labels)
|
|
140
|
+
- Inferred nodes are allowed only when they help reconstruct the paper's logic without pretending to be literal session logs
|
|
141
|
+
|
|
142
|
+
### Step 3: Generate Files
|
|
143
|
+
|
|
144
|
+
Write ALL mandatory files. See [references/ara-schema.md](references/ara-schema.md) for the complete
|
|
145
|
+
directory structure and field-level requirements for every file.
|
|
146
|
+
|
|
147
|
+
**Mandatory files** (all must exist and be non-trivial):
|
|
148
|
+
- `PAPER.md` — YAML frontmatter (title, authors, year, venue, doi, ara_version, domain, keywords, claims_summary, abstract) + Layer Index
|
|
149
|
+
- `logic/problem.md` — Observations (O1, O2...), Gaps (G1, G2...), Key Insight, Assumptions
|
|
150
|
+
- `logic/claims.md` — Claims (C01, C02...) each with Statement, Status, Falsification criteria, Proof, Evidence basis, Interpretation, Dependencies, Tags
|
|
151
|
+
- `logic/concepts.md` — ≥5 concepts each with Notation, Definition, Boundary conditions, Related concepts
|
|
152
|
+
- `logic/experiments.md` — ≥3 experiments (E01, E02...) each with Verifies, Setup, Procedure, Metrics, Expected outcome (directional only!), Baselines, Dependencies
|
|
153
|
+
- `logic/solution/architecture.md` — Component graph with inputs/outputs
|
|
154
|
+
- `logic/solution/algorithm.md` — Math formulation + pseudocode + complexity
|
|
155
|
+
- `logic/solution/constraints.md` — Boundary conditions and limitations
|
|
156
|
+
- `logic/solution/heuristics.md` — Heuristics (H01, H02...) each with Rationale, Sensitivity, Bounds, Code ref, Source
|
|
157
|
+
- `logic/related_work.md` — Related work (RW01, RW02...) each with DOI, Type, Delta, Claims affected
|
|
158
|
+
- `src/configs/training.md` — Hyperparameters with Value, Rationale, Search range, Sensitivity, Source
|
|
159
|
+
- `src/configs/model.md` — Model/architecture configs
|
|
160
|
+
- `src/execution/{module}.py` — ≥1 code stub with typed signatures
|
|
161
|
+
- `src/environment.md` — Python version, framework, hardware, dependencies, seeds
|
|
162
|
+
- `trace/exploration_tree.yaml` — Research DAG (≥8 nodes, nested YAML)
|
|
163
|
+
- `evidence/README.md` — Index table mapping every evidence file to claims
|
|
164
|
+
- `evidence/tables/*.md` — ALL result tables (exact cell values, never rounded)
|
|
165
|
+
- `evidence/figures/*.md` — ALL quantitative figures (extracted data points)
|
|
166
|
+
|
|
167
|
+
Evidence-generation rules:
|
|
168
|
+
- Preserve **raw source tables** separately from any **derived subset** views
|
|
169
|
+
- A file named after a source object (for example `table3_...`) must match that source object's caption and contents
|
|
170
|
+
- If only a subset is included, the filename must say `derived_`, `subset_`, or equivalent, and the file must state what it was derived from
|
|
171
|
+
- Do not merge rows from different source tables into one evidence file unless the file is explicitly labeled as a derived comparison
|
|
172
|
+
|
|
173
|
+
### Step 4: Coverage Check Loop (max 3 rounds)
|
|
174
|
+
|
|
175
|
+
Before running Seal validation, verify that the ARA faithfully covers the source material.
|
|
176
|
+
Repeat up to **3 rounds**; stop early if a round produces no patches.
|
|
177
|
+
|
|
178
|
+
**Each round:** re-read the source, identify anything not yet captured or only shallowly
|
|
179
|
+
captured in the ARA, patch those gaps, then note how many fixes were made. If zero, exit
|
|
180
|
+
early. Pay particular attention to appendix content and to citations from the paper's
|
|
181
|
+
References list, which are easy to miss on the first pass.
|
|
182
|
+
|
|
183
|
+
The coverage loop does not replace validation — it ensures the ARA is semantically complete
|
|
184
|
+
before structural checks run.
|
|
185
|
+
|
|
186
|
+
### Step 5: Validate
|
|
187
|
+
|
|
188
|
+
Run ARA Seal Level 1 validation. Perform these checks:
|
|
189
|
+
- All mandatory dirs exist: `logic/`, `logic/solution/`, `src/`, `src/configs/`, `trace/`, `evidence/`
|
|
190
|
+
- All mandatory files exist and are non-empty
|
|
191
|
+
- PAPER.md has YAML frontmatter with title, authors, year
|
|
192
|
+
- PAPER.md has Layer Index section
|
|
193
|
+
- claims.md has C01+ blocks with Statement, Status, Falsification criteria, Proof fields
|
|
194
|
+
- experiments.md has E01+ blocks with Verifies, Setup, Procedure, Expected outcome fields
|
|
195
|
+
- heuristics.md has H01+ blocks with Rationale, Sensitivity, Bounds fields
|
|
196
|
+
- concepts.md has ≥5 concept sections
|
|
197
|
+
- experiments.md has ≥3 experiment plans
|
|
198
|
+
- exploration_tree.yaml parses as valid YAML with ≥8 nodes, has dead_end and decision types
|
|
199
|
+
- Claim Proof references (E01, E02...) resolve to experiments.md
|
|
200
|
+
- Experiment Verifies references (C01, C02...) resolve to claims.md
|
|
201
|
+
- Heuristic Code ref paths resolve to actual files in src/execution/
|
|
202
|
+
- Evidence files contain Markdown tables with **Source** fields
|
|
203
|
+
- Evidence file names, source labels, and captions agree on the original table/figure identifier
|
|
204
|
+
- Any file named like a raw source table is a faithful transcription rather than a filtered subset
|
|
205
|
+
- Claims only cite experiments whose evidence actually contains the compared rows or measurements
|
|
206
|
+
- Claim wording does not outrun the evidence type (for example, validation tables alone should not be used to claim training-dynamics improvements)
|
|
207
|
+
- Trace nodes declare `support_level: explicit|inferred`
|
|
208
|
+
- Trace nodes with `support_level: explicit` include source references
|
|
209
|
+
|
|
210
|
+
### Step 6: Fix & Iterate
|
|
211
|
+
|
|
212
|
+
For each validation failure:
|
|
213
|
+
1. Read the failing file
|
|
214
|
+
2. Apply targeted edits (prefer Edit over full rewrite to preserve correct content)
|
|
215
|
+
3. Re-validate after all fixes
|
|
216
|
+
|
|
217
|
+
Typically converges in 2-3 rounds.
|
|
218
|
+
|
|
219
|
+
### Step 7: Report
|
|
220
|
+
|
|
221
|
+
Print a summary:
|
|
222
|
+
- Artifact location
|
|
223
|
+
- File count and total size
|
|
224
|
+
- Validation result (pass/fail with details)
|
|
225
|
+
- Key statistics: number of claims, experiments, heuristics, concepts, tree nodes, evidence files
|
|
226
|
+
|
|
227
|
+
## Critical Rules
|
|
228
|
+
|
|
229
|
+
1. **Exact numbers**: All numerical values copied EXACTLY from source — never round or approximate
|
|
230
|
+
2. **No hallucination**: Never invent claims, results, or heuristics not in the source material
|
|
231
|
+
3. **Experiments have NO exact numbers**: `experiments.md` contains only directional/relative expected outcomes. Exact numbers go in `evidence/`
|
|
232
|
+
4. **Every claim has proof**: Proof field references experiment IDs (E01, E02), not file paths
|
|
233
|
+
5. **Cross-layer binding**: Claims ↔ Experiments ↔ Evidence ↔ Code refs must all resolve
|
|
234
|
+
6. **Dead ends matter**: Include failed approaches, rejected alternatives, ablation findings
|
|
235
|
+
7. **"Not specified"**: If information is genuinely unavailable, write "Not specified in paper" — never guess
|
|
236
|
+
8. **No fake source labels**: Never call a derived subset `Table N` or `Figure N` unless it faithfully reproduces the original source object
|
|
237
|
+
9. **No synthetic trace history**: Do not invent decisions, dead ends, or experiments that are not explicit in the provided inputs; if a trajectory is inferred, mark it as inferred or omit it
|
|
238
|
+
10. **Evidence-limited wording**: Do not use stronger language than the evidence supports; separate direct observations from interpretation
|
|
239
|
+
|
|
240
|
+
## Reference Files
|
|
241
|
+
|
|
242
|
+
For detailed schema specifications, load these on demand:
|
|
243
|
+
- [references/ara-schema.md](references/ara-schema.md) — Complete ARA directory schema with field-level format for every file
|
|
244
|
+
- [references/exploration-tree-spec.md](references/exploration-tree-spec.md) — Detailed exploration tree YAML specification with examples
|
|
245
|
+
- [references/validation-checklist.md](references/validation-checklist.md) — All Seal Level 1 checks (what the validator looks for)
|