@r1z4x/tezgah 1.0.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (582) hide show
  1. package/CHANGELOG.md +738 -0
  2. package/LICENSE +21 -0
  3. package/MANIFEST +753 -0
  4. package/README.de.md +169 -0
  5. package/README.es.md +168 -0
  6. package/README.fr.md +166 -0
  7. package/README.md +161 -0
  8. package/README.tr.md +163 -0
  9. package/agents/tezgah-reviewer.md +70 -0
  10. package/bin/codegen +337 -0
  11. package/bin/consult +797 -0
  12. package/bin/tezgah-adhd +50 -0
  13. package/bin/tezgah-agents +45 -0
  14. package/bin/tezgah-capture +66 -0
  15. package/bin/tezgah-context +96 -0
  16. package/bin/tezgah-decisions +213 -0
  17. package/bin/tezgah-design +953 -0
  18. package/bin/tezgah-docs +1199 -0
  19. package/bin/tezgah-doctor +497 -0
  20. package/bin/tezgah-dsh +37 -0
  21. package/bin/tezgah-dsh.cmd +70 -0
  22. package/bin/tezgah-gate +75 -0
  23. package/bin/tezgah-import-ai-research +439 -0
  24. package/bin/tezgah-index +32 -0
  25. package/bin/tezgah-lessons +148 -0
  26. package/bin/tezgah-mcp +322 -0
  27. package/bin/tezgah-migrate +324 -0
  28. package/bin/tezgah-pony +50 -0
  29. package/bin/tezgah-research +772 -0
  30. package/bin/tezgah-rollback +93 -0
  31. package/bin/tezgah-route +124 -0
  32. package/bin/tezgah-setup +5798 -0
  33. package/bin/tezgah-status +383 -0
  34. package/bin/tezgah-task +607 -0
  35. package/bin/tezgah-taste +423 -0
  36. package/bin/tezgah-triage +485 -0
  37. package/bin/tezgah.js +36 -0
  38. package/commands/adhd.md +21 -0
  39. package/commands/ponytail.md +21 -0
  40. package/docs/README.md +112 -0
  41. package/docs/architecture.md +226 -0
  42. package/docs/citations-baseline.json +59 -0
  43. package/docs/clarity-baseline.json +116 -0
  44. package/docs/contract.md +416 -0
  45. package/docs/environment.md +141 -0
  46. package/docs/evidence.md +831 -0
  47. package/docs/feature-audit.md +139 -0
  48. package/docs/gate.md +407 -0
  49. package/docs/glossary.md +201 -0
  50. package/docs/hosts.md +400 -0
  51. package/docs/index.json +471 -0
  52. package/docs/judge.md +193 -0
  53. package/docs/layers.md +189 -0
  54. package/docs/models.md +160 -0
  55. package/docs/operations.md +666 -0
  56. package/docs/research.md +809 -0
  57. package/docs/results/paired-outcome-2026-10.jsonl +254 -0
  58. package/docs/results/paired-outcome-2026-10.md +204 -0
  59. package/docs/skills.md +236 -0
  60. package/docs/status-line.md +315 -0
  61. package/docs/testing.md +287 -0
  62. package/docs/vision.md +117 -0
  63. package/hooks/hooks.json +33 -0
  64. package/hooks/projects-auto-init.py +98 -0
  65. package/hooks/projects-posttooluse.py +149 -0
  66. package/hooks/projects-pretooluse.py +40 -0
  67. package/hooks/projects-stop.py +60 -0
  68. package/hooks/tezgah_agents.py +817 -0
  69. package/hooks/tezgah_apps.py +266 -0
  70. package/hooks/tezgah_attest.py +255 -0
  71. package/hooks/tezgah_clarity.py +171 -0
  72. package/hooks/tezgah_components.py +140 -0
  73. package/hooks/tezgah_context.py +2953 -0
  74. package/hooks/tezgah_embed.py +765 -0
  75. package/hooks/tezgah_gate.py +2736 -0
  76. package/hooks/tezgah_guard.py +177 -0
  77. package/hooks/tezgah_index.py +124 -0
  78. package/hooks/tezgah_integrity.py +5141 -0
  79. package/hooks/tezgah_judge.py +487 -0
  80. package/hooks/tezgah_lang.py +230 -0
  81. package/hooks/tezgah_lessons.py +210 -0
  82. package/hooks/tezgah_models.py +855 -0
  83. package/hooks/tezgah_paths.py +1132 -0
  84. package/hooks/tezgah_policy.py +1039 -0
  85. package/hooks/tezgah_rank.py +77 -0
  86. package/hooks/tezgah_replay.py +1109 -0
  87. package/hooks/tezgah_research.py +5176 -0
  88. package/hooks/tezgah_shapes.py +305 -0
  89. package/hooks/tezgah_skill_pick.py +227 -0
  90. package/hooks/tezgah_snapshot.py +490 -0
  91. package/hooks/tezgah_stopspec.py +320 -0
  92. package/hooks/tezgah_task.py +458 -0
  93. package/hooks/tezgah_taste.py +201 -0
  94. package/hooks/tezgah_untrusted.py +112 -0
  95. package/hooks/tezgah_update.py +430 -0
  96. package/hosts/codex/hook.py +268 -0
  97. package/hosts/codex/hooks.json +26 -0
  98. package/hosts/cursor/hook.py +461 -0
  99. package/hosts/cursor/hooks.json +44 -0
  100. package/hosts/dsh/hooks.json +21 -0
  101. package/hosts/dsh/statusline/lib/client.js +138 -0
  102. package/hosts/dsh/statusline/lib/index.js +104 -0
  103. package/hosts/dsh/statusline/package.json +28 -0
  104. package/hosts/omp/hook.py +277 -0
  105. package/hosts/omp/tezgah-hook.ts.in +701 -0
  106. package/hosts/opencode/plugins/tezgah.js +2742 -0
  107. package/hosts/opencode/tui/tezgah-tui.tsx +151 -0
  108. package/output-styles/tezgah.md +142 -0
  109. package/package.json +32 -0
  110. package/packaging/build.sh +342 -0
  111. package/packaging/install.ps1 +166 -0
  112. package/packaging/install.sh +56 -0
  113. package/packaging/upgrade.sh +142 -0
  114. package/skills/ai-research/0-autoresearch-skill/SKILL.md +411 -0
  115. package/skills/ai-research/0-autoresearch-skill/references/agent-continuity.md +95 -0
  116. package/skills/ai-research/0-autoresearch-skill/references/progress-reporting.md +166 -0
  117. package/skills/ai-research/0-autoresearch-skill/references/skill-routing.md +219 -0
  118. package/skills/ai-research/0-autoresearch-skill/templates/findings.md +44 -0
  119. package/skills/ai-research/0-autoresearch-skill/templates/research-log.md +41 -0
  120. package/skills/ai-research/01-model-architecture/litgpt/SKILL.md +469 -0
  121. package/skills/ai-research/01-model-architecture/litgpt/references/custom-models.md +569 -0
  122. package/skills/ai-research/01-model-architecture/litgpt/references/distributed-training.md +452 -0
  123. package/skills/ai-research/01-model-architecture/litgpt/references/supported-models.md +337 -0
  124. package/skills/ai-research/01-model-architecture/litgpt/references/training-recipes.md +620 -0
  125. package/skills/ai-research/01-model-architecture/mamba/SKILL.md +260 -0
  126. package/skills/ai-research/01-model-architecture/mamba/references/architecture-details.md +207 -0
  127. package/skills/ai-research/01-model-architecture/mamba/references/benchmarks.md +256 -0
  128. package/skills/ai-research/01-model-architecture/mamba/references/training-guide.md +389 -0
  129. package/skills/ai-research/01-model-architecture/nanogpt/SKILL.md +290 -0
  130. package/skills/ai-research/01-model-architecture/nanogpt/references/architecture.md +383 -0
  131. package/skills/ai-research/01-model-architecture/nanogpt/references/data.md +477 -0
  132. package/skills/ai-research/01-model-architecture/nanogpt/references/training.md +565 -0
  133. package/skills/ai-research/01-model-architecture/rwkv/SKILL.md +260 -0
  134. package/skills/ai-research/01-model-architecture/rwkv/references/architecture-details.md +345 -0
  135. package/skills/ai-research/01-model-architecture/rwkv/references/rwkv7.md +387 -0
  136. package/skills/ai-research/01-model-architecture/rwkv/references/state-management.md +370 -0
  137. package/skills/ai-research/01-model-architecture/torchtitan/SKILL.md +358 -0
  138. package/skills/ai-research/01-model-architecture/torchtitan/references/checkpoint.md +182 -0
  139. package/skills/ai-research/01-model-architecture/torchtitan/references/custom-models.md +259 -0
  140. package/skills/ai-research/01-model-architecture/torchtitan/references/float8.md +134 -0
  141. package/skills/ai-research/01-model-architecture/torchtitan/references/fsdp.md +127 -0
  142. package/skills/ai-research/02-tokenization/huggingface-tokenizers/SKILL.md +516 -0
  143. package/skills/ai-research/02-tokenization/huggingface-tokenizers/references/algorithms.md +654 -0
  144. package/skills/ai-research/02-tokenization/huggingface-tokenizers/references/integration.md +638 -0
  145. package/skills/ai-research/02-tokenization/huggingface-tokenizers/references/pipeline.md +724 -0
  146. package/skills/ai-research/02-tokenization/huggingface-tokenizers/references/training.md +566 -0
  147. package/skills/ai-research/02-tokenization/sentencepiece/SKILL.md +235 -0
  148. package/skills/ai-research/02-tokenization/sentencepiece/references/algorithms.md +201 -0
  149. package/skills/ai-research/02-tokenization/sentencepiece/references/training.md +305 -0
  150. package/skills/ai-research/03-fine-tuning/axolotl/SKILL.md +158 -0
  151. package/skills/ai-research/03-fine-tuning/axolotl/references/api.md +5549 -0
  152. package/skills/ai-research/03-fine-tuning/axolotl/references/dataset-formats.md +1030 -0
  153. package/skills/ai-research/03-fine-tuning/axolotl/references/index.md +16 -0
  154. package/skills/ai-research/03-fine-tuning/axolotl/references/other.md +3564 -0
  155. package/skills/ai-research/03-fine-tuning/llama-factory/SKILL.md +80 -0
  156. package/skills/ai-research/03-fine-tuning/llama-factory/references/_images.md +24 -0
  157. package/skills/ai-research/03-fine-tuning/llama-factory/references/advanced.md +1056 -0
  158. package/skills/ai-research/03-fine-tuning/llama-factory/references/getting_started.md +350 -0
  159. package/skills/ai-research/03-fine-tuning/llama-factory/references/index.md +20 -0
  160. package/skills/ai-research/03-fine-tuning/llama-factory/references/other.md +32 -0
  161. package/skills/ai-research/03-fine-tuning/peft/SKILL.md +431 -0
  162. package/skills/ai-research/03-fine-tuning/peft/references/advanced-usage.md +515 -0
  163. package/skills/ai-research/03-fine-tuning/peft/references/troubleshooting.md +481 -0
  164. package/skills/ai-research/03-fine-tuning/unsloth/SKILL.md +80 -0
  165. package/skills/ai-research/03-fine-tuning/unsloth/references/index.md +8 -0
  166. package/skills/ai-research/03-fine-tuning/unsloth/references/llms.md +83 -0
  167. package/skills/ai-research/04-mechanistic-interpretability/nnsight/SKILL.md +436 -0
  168. package/skills/ai-research/04-mechanistic-interpretability/nnsight/references/README.md +79 -0
  169. package/skills/ai-research/04-mechanistic-interpretability/nnsight/references/api.md +345 -0
  170. package/skills/ai-research/04-mechanistic-interpretability/nnsight/references/tutorials.md +301 -0
  171. package/skills/ai-research/04-mechanistic-interpretability/pyvene/SKILL.md +473 -0
  172. package/skills/ai-research/04-mechanistic-interpretability/pyvene/references/README.md +74 -0
  173. package/skills/ai-research/04-mechanistic-interpretability/pyvene/references/api.md +384 -0
  174. package/skills/ai-research/04-mechanistic-interpretability/pyvene/references/tutorials.md +377 -0
  175. package/skills/ai-research/04-mechanistic-interpretability/saelens/SKILL.md +386 -0
  176. package/skills/ai-research/04-mechanistic-interpretability/saelens/references/README.md +71 -0
  177. package/skills/ai-research/04-mechanistic-interpretability/saelens/references/api.md +334 -0
  178. package/skills/ai-research/04-mechanistic-interpretability/saelens/references/tutorials.md +319 -0
  179. package/skills/ai-research/04-mechanistic-interpretability/transformer-lens/SKILL.md +346 -0
  180. package/skills/ai-research/04-mechanistic-interpretability/transformer-lens/references/README.md +55 -0
  181. package/skills/ai-research/04-mechanistic-interpretability/transformer-lens/references/api.md +363 -0
  182. package/skills/ai-research/04-mechanistic-interpretability/transformer-lens/references/tutorials.md +340 -0
  183. package/skills/ai-research/05-data-processing/nemo-curator/SKILL.md +383 -0
  184. package/skills/ai-research/05-data-processing/nemo-curator/references/deduplication.md +88 -0
  185. package/skills/ai-research/05-data-processing/nemo-curator/references/filtering.md +103 -0
  186. package/skills/ai-research/05-data-processing/ray-data/SKILL.md +326 -0
  187. package/skills/ai-research/05-data-processing/ray-data/references/integration.md +83 -0
  188. package/skills/ai-research/05-data-processing/ray-data/references/transformations.md +84 -0
  189. package/skills/ai-research/06-post-training/grpo-rl-training/README.md +98 -0
  190. package/skills/ai-research/06-post-training/grpo-rl-training/SKILL.md +572 -0
  191. package/skills/ai-research/06-post-training/miles/SKILL.md +315 -0
  192. package/skills/ai-research/06-post-training/miles/references/api-reference.md +142 -0
  193. package/skills/ai-research/06-post-training/miles/references/troubleshooting.md +353 -0
  194. package/skills/ai-research/06-post-training/openrlhf/SKILL.md +249 -0
  195. package/skills/ai-research/06-post-training/openrlhf/references/algorithm-comparison.md +405 -0
  196. package/skills/ai-research/06-post-training/openrlhf/references/custom-rewards.md +531 -0
  197. package/skills/ai-research/06-post-training/openrlhf/references/hybrid-engine.md +288 -0
  198. package/skills/ai-research/06-post-training/openrlhf/references/multi-node-training.md +455 -0
  199. package/skills/ai-research/06-post-training/simpo/SKILL.md +219 -0
  200. package/skills/ai-research/06-post-training/simpo/references/datasets.md +479 -0
  201. package/skills/ai-research/06-post-training/simpo/references/hyperparameters.md +453 -0
  202. package/skills/ai-research/06-post-training/simpo/references/loss-functions.md +351 -0
  203. package/skills/ai-research/06-post-training/slime/SKILL.md +464 -0
  204. package/skills/ai-research/06-post-training/slime/references/api-reference.md +393 -0
  205. package/skills/ai-research/06-post-training/slime/references/troubleshooting.md +387 -0
  206. package/skills/ai-research/06-post-training/torchforge/SKILL.md +433 -0
  207. package/skills/ai-research/06-post-training/torchforge/references/api-reference.md +328 -0
  208. package/skills/ai-research/06-post-training/torchforge/references/troubleshooting.md +410 -0
  209. package/skills/ai-research/06-post-training/trl-fine-tuning/SKILL.md +455 -0
  210. package/skills/ai-research/06-post-training/trl-fine-tuning/references/dpo-variants.md +228 -0
  211. package/skills/ai-research/06-post-training/trl-fine-tuning/references/online-rl.md +83 -0
  212. package/skills/ai-research/06-post-training/trl-fine-tuning/references/reward-modeling.md +123 -0
  213. package/skills/ai-research/06-post-training/trl-fine-tuning/references/sft-training.md +169 -0
  214. package/skills/ai-research/06-post-training/verl/SKILL.md +391 -0
  215. package/skills/ai-research/06-post-training/verl/references/api-reference.md +302 -0
  216. package/skills/ai-research/06-post-training/verl/references/troubleshooting.md +392 -0
  217. package/skills/ai-research/07-safety-alignment/constitutional-ai/SKILL.md +290 -0
  218. package/skills/ai-research/07-safety-alignment/llamaguard/SKILL.md +337 -0
  219. package/skills/ai-research/07-safety-alignment/nemo-guardrails/SKILL.md +297 -0
  220. package/skills/ai-research/07-safety-alignment/prompt-guard/SKILL.md +312 -0
  221. package/skills/ai-research/08-distributed-training/accelerate/SKILL.md +332 -0
  222. package/skills/ai-research/08-distributed-training/accelerate/references/custom-plugins.md +454 -0
  223. package/skills/ai-research/08-distributed-training/accelerate/references/megatron-integration.md +490 -0
  224. package/skills/ai-research/08-distributed-training/accelerate/references/performance.md +526 -0
  225. package/skills/ai-research/08-distributed-training/deepspeed/SKILL.md +141 -0
  226. package/skills/ai-research/08-distributed-training/deepspeed/references/08.md +18 -0
  227. package/skills/ai-research/08-distributed-training/deepspeed/references/09.md +174 -0
  228. package/skills/ai-research/08-distributed-training/deepspeed/references/2020.md +379 -0
  229. package/skills/ai-research/08-distributed-training/deepspeed/references/2023.md +280 -0
  230. package/skills/ai-research/08-distributed-training/deepspeed/references/assets.md +180 -0
  231. package/skills/ai-research/08-distributed-training/deepspeed/references/index.md +36 -0
  232. package/skills/ai-research/08-distributed-training/deepspeed/references/mii.md +119 -0
  233. package/skills/ai-research/08-distributed-training/deepspeed/references/other.md +1192 -0
  234. package/skills/ai-research/08-distributed-training/megatron-core/SKILL.md +366 -0
  235. package/skills/ai-research/08-distributed-training/megatron-core/references/benchmarks.md +250 -0
  236. package/skills/ai-research/08-distributed-training/megatron-core/references/parallelism-guide.md +405 -0
  237. package/skills/ai-research/08-distributed-training/megatron-core/references/production-examples.md +474 -0
  238. package/skills/ai-research/08-distributed-training/megatron-core/references/training-recipes.md +548 -0
  239. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/SKILL.md +231 -0
  240. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_dcp_async_recipe.md +14 -0
  241. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_dcp_overview.md +19 -0
  242. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_dcp_recipe.md +18 -0
  243. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_ddp_notes.md +10 -0
  244. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_device_mesh_tutorial.md +22 -0
  245. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_examples_fsdp2.md +15 -0
  246. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_fsdp1_api.md +9 -0
  247. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_fsdp2_tutorial.md +45 -0
  248. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_fully_shard_api.md +49 -0
  249. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_tp_tutorial.md +22 -0
  250. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/ray_train_fsdp2_example.md +13 -0
  251. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/torchtitan_fsdp_notes.md +14 -0
  252. package/skills/ai-research/08-distributed-training/pytorch-lightning/SKILL.md +346 -0
  253. package/skills/ai-research/08-distributed-training/pytorch-lightning/references/callbacks.md +437 -0
  254. package/skills/ai-research/08-distributed-training/pytorch-lightning/references/distributed.md +491 -0
  255. package/skills/ai-research/08-distributed-training/pytorch-lightning/references/hyperparameter-tuning.md +557 -0
  256. package/skills/ai-research/08-distributed-training/ray-train/SKILL.md +406 -0
  257. package/skills/ai-research/08-distributed-training/ray-train/references/multi-node.md +629 -0
  258. package/skills/ai-research/09-infrastructure/lambda-labs/SKILL.md +545 -0
  259. package/skills/ai-research/09-infrastructure/lambda-labs/references/advanced-usage.md +612 -0
  260. package/skills/ai-research/09-infrastructure/lambda-labs/references/troubleshooting.md +531 -0
  261. package/skills/ai-research/09-infrastructure/modal/SKILL.md +341 -0
  262. package/skills/ai-research/09-infrastructure/modal/references/advanced-usage.md +504 -0
  263. package/skills/ai-research/09-infrastructure/modal/references/troubleshooting.md +495 -0
  264. package/skills/ai-research/09-infrastructure/skypilot/SKILL.md +509 -0
  265. package/skills/ai-research/09-infrastructure/skypilot/references/advanced-usage.md +492 -0
  266. package/skills/ai-research/09-infrastructure/skypilot/references/troubleshooting.md +571 -0
  267. package/skills/ai-research/10-optimization/awq/SKILL.md +310 -0
  268. package/skills/ai-research/10-optimization/awq/references/advanced-usage.md +325 -0
  269. package/skills/ai-research/10-optimization/awq/references/troubleshooting.md +345 -0
  270. package/skills/ai-research/10-optimization/bitsandbytes/SKILL.md +411 -0
  271. package/skills/ai-research/10-optimization/bitsandbytes/references/memory-optimization.md +522 -0
  272. package/skills/ai-research/10-optimization/bitsandbytes/references/qlora-training.md +522 -0
  273. package/skills/ai-research/10-optimization/bitsandbytes/references/quantization-formats.md +448 -0
  274. package/skills/ai-research/10-optimization/flash-attention/SKILL.md +367 -0
  275. package/skills/ai-research/10-optimization/flash-attention/references/benchmarks.md +216 -0
  276. package/skills/ai-research/10-optimization/flash-attention/references/transformers-integration.md +294 -0
  277. package/skills/ai-research/10-optimization/gguf/SKILL.md +427 -0
  278. package/skills/ai-research/10-optimization/gguf/references/advanced-usage.md +505 -0
  279. package/skills/ai-research/10-optimization/gguf/references/troubleshooting.md +443 -0
  280. package/skills/ai-research/10-optimization/gptq/SKILL.md +450 -0
  281. package/skills/ai-research/10-optimization/gptq/references/calibration.md +338 -0
  282. package/skills/ai-research/10-optimization/gptq/references/integration.md +130 -0
  283. package/skills/ai-research/10-optimization/gptq/references/troubleshooting.md +96 -0
  284. package/skills/ai-research/10-optimization/hqq/SKILL.md +445 -0
  285. package/skills/ai-research/10-optimization/hqq/references/advanced-usage.md +529 -0
  286. package/skills/ai-research/10-optimization/hqq/references/troubleshooting.md +504 -0
  287. package/skills/ai-research/10-optimization/ml-training-recipes/SKILL.md +319 -0
  288. package/skills/ai-research/10-optimization/ml-training-recipes/references/architecture.md +320 -0
  289. package/skills/ai-research/10-optimization/ml-training-recipes/references/biomedical.md +498 -0
  290. package/skills/ai-research/10-optimization/ml-training-recipes/references/domain-specific.md +626 -0
  291. package/skills/ai-research/10-optimization/ml-training-recipes/references/experiment-loop.md +129 -0
  292. package/skills/ai-research/10-optimization/ml-training-recipes/references/optimizers.md +330 -0
  293. package/skills/ai-research/10-optimization/ml-training-recipes/references/scaling-and-selection.md +428 -0
  294. package/skills/ai-research/11-evaluation/bigcode-evaluation-harness/SKILL.md +405 -0
  295. package/skills/ai-research/11-evaluation/bigcode-evaluation-harness/references/benchmarks.md +394 -0
  296. package/skills/ai-research/11-evaluation/bigcode-evaluation-harness/references/custom-tasks.md +425 -0
  297. package/skills/ai-research/11-evaluation/bigcode-evaluation-harness/references/issues.md +395 -0
  298. package/skills/ai-research/11-evaluation/lm-evaluation-harness/SKILL.md +490 -0
  299. package/skills/ai-research/11-evaluation/lm-evaluation-harness/references/api-evaluation.md +491 -0
  300. package/skills/ai-research/11-evaluation/lm-evaluation-harness/references/benchmark-guide.md +489 -0
  301. package/skills/ai-research/11-evaluation/lm-evaluation-harness/references/custom-tasks.md +603 -0
  302. package/skills/ai-research/11-evaluation/lm-evaluation-harness/references/distributed-eval.md +520 -0
  303. package/skills/ai-research/11-evaluation/nemo-evaluator/SKILL.md +494 -0
  304. package/skills/ai-research/11-evaluation/nemo-evaluator/references/adapter-system.md +341 -0
  305. package/skills/ai-research/11-evaluation/nemo-evaluator/references/configuration.md +448 -0
  306. package/skills/ai-research/11-evaluation/nemo-evaluator/references/custom-benchmarks.md +316 -0
  307. package/skills/ai-research/11-evaluation/nemo-evaluator/references/execution-backends.md +362 -0
  308. package/skills/ai-research/12-inference-serving/llama-cpp/SKILL.md +258 -0
  309. package/skills/ai-research/12-inference-serving/llama-cpp/references/optimization.md +90 -0
  310. package/skills/ai-research/12-inference-serving/llama-cpp/references/quantization.md +214 -0
  311. package/skills/ai-research/12-inference-serving/llama-cpp/references/server.md +126 -0
  312. package/skills/ai-research/12-inference-serving/sglang/SKILL.md +442 -0
  313. package/skills/ai-research/12-inference-serving/sglang/references/deployment.md +491 -0
  314. package/skills/ai-research/12-inference-serving/sglang/references/radix-attention.md +414 -0
  315. package/skills/ai-research/12-inference-serving/sglang/references/structured-generation.md +542 -0
  316. package/skills/ai-research/12-inference-serving/tensorrt-llm/SKILL.md +187 -0
  317. package/skills/ai-research/12-inference-serving/tensorrt-llm/references/multi-gpu.md +299 -0
  318. package/skills/ai-research/12-inference-serving/tensorrt-llm/references/optimization.md +243 -0
  319. package/skills/ai-research/12-inference-serving/tensorrt-llm/references/serving.md +471 -0
  320. package/skills/ai-research/12-inference-serving/vllm/SKILL.md +364 -0
  321. package/skills/ai-research/12-inference-serving/vllm/references/optimization.md +227 -0
  322. package/skills/ai-research/12-inference-serving/vllm/references/quantization.md +285 -0
  323. package/skills/ai-research/12-inference-serving/vllm/references/server-deployment.md +256 -0
  324. package/skills/ai-research/12-inference-serving/vllm/references/troubleshooting.md +448 -0
  325. package/skills/ai-research/13-mlops/mlflow/SKILL.md +704 -0
  326. package/skills/ai-research/13-mlops/mlflow/references/deployment.md +745 -0
  327. package/skills/ai-research/13-mlops/mlflow/references/model-registry.md +771 -0
  328. package/skills/ai-research/13-mlops/mlflow/references/tracking.md +681 -0
  329. package/skills/ai-research/13-mlops/swanlab/SKILL.md +406 -0
  330. package/skills/ai-research/13-mlops/swanlab/references/integrations.md +305 -0
  331. package/skills/ai-research/13-mlops/swanlab/references/visualization.md +234 -0
  332. package/skills/ai-research/13-mlops/tensorboard/SKILL.md +629 -0
  333. package/skills/ai-research/13-mlops/tensorboard/references/integrations.md +639 -0
  334. package/skills/ai-research/13-mlops/tensorboard/references/profiling.md +546 -0
  335. package/skills/ai-research/13-mlops/tensorboard/references/visualization.md +621 -0
  336. package/skills/ai-research/13-mlops/weights-and-biases/SKILL.md +590 -0
  337. package/skills/ai-research/13-mlops/weights-and-biases/references/artifacts.md +585 -0
  338. package/skills/ai-research/13-mlops/weights-and-biases/references/integrations.md +701 -0
  339. package/skills/ai-research/13-mlops/weights-and-biases/references/sweeps.md +848 -0
  340. package/skills/ai-research/14-agents/a-evolve/SKILL.md +383 -0
  341. package/skills/ai-research/14-agents/a-evolve/references/README.md +831 -0
  342. package/skills/ai-research/14-agents/a-evolve/references/api.md +594 -0
  343. package/skills/ai-research/14-agents/a-evolve/references/architecture.md +417 -0
  344. package/skills/ai-research/14-agents/a-evolve/references/design-patterns.md +462 -0
  345. package/skills/ai-research/14-agents/a-evolve/references/examples.md +352 -0
  346. package/skills/ai-research/14-agents/a-evolve/references/issues.md +591 -0
  347. package/skills/ai-research/14-agents/a-evolve/references/releases.md +112 -0
  348. package/skills/ai-research/14-agents/a-evolve/references/tutorials.md +819 -0
  349. package/skills/ai-research/14-agents/autogpt/SKILL.md +403 -0
  350. package/skills/ai-research/14-agents/autogpt/references/advanced-usage.md +536 -0
  351. package/skills/ai-research/14-agents/autogpt/references/troubleshooting.md +421 -0
  352. package/skills/ai-research/14-agents/crewai/SKILL.md +498 -0
  353. package/skills/ai-research/14-agents/crewai/references/flows.md +439 -0
  354. package/skills/ai-research/14-agents/crewai/references/tools.md +430 -0
  355. package/skills/ai-research/14-agents/crewai/references/troubleshooting.md +481 -0
  356. package/skills/ai-research/14-agents/langchain/SKILL.md +480 -0
  357. package/skills/ai-research/14-agents/langchain/references/agents.md +500 -0
  358. package/skills/ai-research/14-agents/langchain/references/integration.md +563 -0
  359. package/skills/ai-research/14-agents/langchain/references/rag.md +601 -0
  360. package/skills/ai-research/14-agents/llamaindex/SKILL.md +569 -0
  361. package/skills/ai-research/14-agents/llamaindex/references/agents.md +84 -0
  362. package/skills/ai-research/14-agents/llamaindex/references/data_connectors.md +109 -0
  363. package/skills/ai-research/14-agents/llamaindex/references/query_engines.md +407 -0
  364. package/skills/ai-research/15-rag/chroma/SKILL.md +406 -0
  365. package/skills/ai-research/15-rag/chroma/references/integration.md +39 -0
  366. package/skills/ai-research/15-rag/faiss/SKILL.md +221 -0
  367. package/skills/ai-research/15-rag/faiss/references/index_types.md +281 -0
  368. package/skills/ai-research/15-rag/pinecone/SKILL.md +358 -0
  369. package/skills/ai-research/15-rag/pinecone/references/deployment.md +182 -0
  370. package/skills/ai-research/15-rag/qdrant/SKILL.md +493 -0
  371. package/skills/ai-research/15-rag/qdrant/references/advanced-usage.md +649 -0
  372. package/skills/ai-research/15-rag/qdrant/references/troubleshooting.md +632 -0
  373. package/skills/ai-research/15-rag/sentence-transformers/SKILL.md +255 -0
  374. package/skills/ai-research/15-rag/sentence-transformers/references/models.md +124 -0
  375. package/skills/ai-research/16-prompt-engineering/dspy/SKILL.md +590 -0
  376. package/skills/ai-research/16-prompt-engineering/dspy/references/examples.md +664 -0
  377. package/skills/ai-research/16-prompt-engineering/dspy/references/modules.md +476 -0
  378. package/skills/ai-research/16-prompt-engineering/dspy/references/optimizers.md +567 -0
  379. package/skills/ai-research/16-prompt-engineering/guidance/SKILL.md +572 -0
  380. package/skills/ai-research/16-prompt-engineering/guidance/references/backends.md +555 -0
  381. package/skills/ai-research/16-prompt-engineering/guidance/references/constraints.md +675 -0
  382. package/skills/ai-research/16-prompt-engineering/guidance/references/examples.md +768 -0
  383. package/skills/ai-research/16-prompt-engineering/instructor/SKILL.md +740 -0
  384. package/skills/ai-research/16-prompt-engineering/instructor/references/examples.md +108 -0
  385. package/skills/ai-research/16-prompt-engineering/instructor/references/providers.md +71 -0
  386. package/skills/ai-research/16-prompt-engineering/instructor/references/validation.md +607 -0
  387. package/skills/ai-research/16-prompt-engineering/outlines/SKILL.md +652 -0
  388. package/skills/ai-research/16-prompt-engineering/outlines/references/backends.md +616 -0
  389. package/skills/ai-research/16-prompt-engineering/outlines/references/examples.md +774 -0
  390. package/skills/ai-research/16-prompt-engineering/outlines/references/json_generation.md +653 -0
  391. package/skills/ai-research/17-observability/langsmith/SKILL.md +422 -0
  392. package/skills/ai-research/17-observability/langsmith/references/advanced-usage.md +549 -0
  393. package/skills/ai-research/17-observability/langsmith/references/troubleshooting.md +538 -0
  394. package/skills/ai-research/17-observability/phoenix/SKILL.md +475 -0
  395. package/skills/ai-research/17-observability/phoenix/references/advanced-usage.md +620 -0
  396. package/skills/ai-research/17-observability/phoenix/references/troubleshooting.md +539 -0
  397. package/skills/ai-research/18-multimodal/audiocraft/SKILL.md +564 -0
  398. package/skills/ai-research/18-multimodal/audiocraft/references/advanced-usage.md +667 -0
  399. package/skills/ai-research/18-multimodal/audiocraft/references/troubleshooting.md +505 -0
  400. package/skills/ai-research/18-multimodal/blip-2/SKILL.md +564 -0
  401. package/skills/ai-research/18-multimodal/blip-2/references/advanced-usage.md +681 -0
  402. package/skills/ai-research/18-multimodal/blip-2/references/troubleshooting.md +527 -0
  403. package/skills/ai-research/18-multimodal/clip/SKILL.md +253 -0
  404. package/skills/ai-research/18-multimodal/clip/references/applications.md +208 -0
  405. package/skills/ai-research/18-multimodal/cosmos-policy/SKILL.md +402 -0
  406. package/skills/ai-research/18-multimodal/cosmos-policy/references/libero-commands.md +175 -0
  407. package/skills/ai-research/18-multimodal/cosmos-policy/references/robocasa-commands.md +147 -0
  408. package/skills/ai-research/18-multimodal/llava/SKILL.md +304 -0
  409. package/skills/ai-research/18-multimodal/llava/references/training.md +198 -0
  410. package/skills/ai-research/18-multimodal/openpi/SKILL.md +480 -0
  411. package/skills/ai-research/18-multimodal/openpi/references/checkpoints-and-env-map.md +86 -0
  412. package/skills/ai-research/18-multimodal/openpi/references/config-recipes.md +50 -0
  413. package/skills/ai-research/18-multimodal/openpi/references/pytorch-gotchas.md +49 -0
  414. package/skills/ai-research/18-multimodal/openpi/references/remote-client-pattern.md +48 -0
  415. package/skills/ai-research/18-multimodal/openpi/references/training-debugging.md +46 -0
  416. package/skills/ai-research/18-multimodal/openvla-oft/SKILL.md +441 -0
  417. package/skills/ai-research/18-multimodal/openvla-oft/references/aloha-workflow.md +141 -0
  418. package/skills/ai-research/18-multimodal/openvla-oft/references/config-troubleshooting.md +97 -0
  419. package/skills/ai-research/18-multimodal/openvla-oft/references/libero-workflow.md +115 -0
  420. package/skills/ai-research/18-multimodal/openvla-oft/references/paper-and-checkpoints.md +84 -0
  421. package/skills/ai-research/18-multimodal/segment-anything/SKILL.md +500 -0
  422. package/skills/ai-research/18-multimodal/segment-anything/references/advanced-usage.md +590 -0
  423. package/skills/ai-research/18-multimodal/segment-anything/references/troubleshooting.md +485 -0
  424. package/skills/ai-research/18-multimodal/stable-diffusion/SKILL.md +519 -0
  425. package/skills/ai-research/18-multimodal/stable-diffusion/references/advanced-usage.md +717 -0
  426. package/skills/ai-research/18-multimodal/stable-diffusion/references/troubleshooting.md +556 -0
  427. package/skills/ai-research/18-multimodal/whisper/SKILL.md +317 -0
  428. package/skills/ai-research/18-multimodal/whisper/references/languages.md +190 -0
  429. package/skills/ai-research/19-emerging-techniques/knowledge-distillation/SKILL.md +458 -0
  430. package/skills/ai-research/19-emerging-techniques/knowledge-distillation/references/minillm.md +335 -0
  431. package/skills/ai-research/19-emerging-techniques/long-context/SKILL.md +536 -0
  432. package/skills/ai-research/19-emerging-techniques/long-context/references/extension_methods.md +469 -0
  433. package/skills/ai-research/19-emerging-techniques/long-context/references/fine_tuning.md +612 -0
  434. package/skills/ai-research/19-emerging-techniques/long-context/references/rope.md +403 -0
  435. package/skills/ai-research/19-emerging-techniques/model-merging/SKILL.md +497 -0
  436. package/skills/ai-research/19-emerging-techniques/model-merging/references/coefficient-tuning.md +415 -0
  437. package/skills/ai-research/19-emerging-techniques/model-merging/references/evaluation.md +463 -0
  438. package/skills/ai-research/19-emerging-techniques/model-merging/references/examples.md +429 -0
  439. package/skills/ai-research/19-emerging-techniques/model-merging/references/methods.md +353 -0
  440. package/skills/ai-research/19-emerging-techniques/model-pruning/SKILL.md +495 -0
  441. package/skills/ai-research/19-emerging-techniques/model-pruning/references/wanda.md +348 -0
  442. package/skills/ai-research/19-emerging-techniques/moe-training/SKILL.md +526 -0
  443. package/skills/ai-research/19-emerging-techniques/moe-training/references/architectures.md +433 -0
  444. package/skills/ai-research/19-emerging-techniques/moe-training/references/inference.md +349 -0
  445. package/skills/ai-research/19-emerging-techniques/moe-training/references/training.md +426 -0
  446. package/skills/ai-research/19-emerging-techniques/speculative-decoding/SKILL.md +467 -0
  447. package/skills/ai-research/19-emerging-techniques/speculative-decoding/references/lookahead.md +310 -0
  448. package/skills/ai-research/19-emerging-techniques/speculative-decoding/references/medusa.md +351 -0
  449. package/skills/ai-research/20-ml-paper-writing/academic-plotting/SKILL.md +479 -0
  450. package/skills/ai-research/20-ml-paper-writing/academic-plotting/references/data-visualization.md +509 -0
  451. package/skills/ai-research/20-ml-paper-writing/academic-plotting/references/diagram-generation.md +395 -0
  452. package/skills/ai-research/20-ml-paper-writing/academic-plotting/references/style-guide.md +305 -0
  453. package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/SKILL.md +982 -0
  454. package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/checklists.md +348 -0
  455. package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/citation-workflow.md +563 -0
  456. package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/reviewer-guidelines.md +349 -0
  457. package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/sources.md +165 -0
  458. package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/writing-guide.md +477 -0
  459. package/skills/ai-research/20-ml-paper-writing/presenting-conference-talks/SKILL.md +298 -0
  460. package/skills/ai-research/20-ml-paper-writing/presenting-conference-talks/references/slide-templates.md +505 -0
  461. package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/SKILL.md +270 -0
  462. package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/checklist.md +279 -0
  463. package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/reviewer-guidelines.md +116 -0
  464. package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/section-blueprints.md +400 -0
  465. package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/systems-conferences.md +261 -0
  466. package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/writing-patterns.md +231 -0
  467. package/skills/ai-research/21-research-ideation/brainstorming-research-ideas/SKILL.md +384 -0
  468. package/skills/ai-research/21-research-ideation/creative-thinking-for-research/SKILL.md +366 -0
  469. package/skills/ai-research/22-agent-native-research-artifact/compiler/SKILL.md +245 -0
  470. package/skills/ai-research/22-agent-native-research-artifact/compiler/references/ara-schema.md +439 -0
  471. package/skills/ai-research/22-agent-native-research-artifact/compiler/references/exploration-tree-spec.md +125 -0
  472. package/skills/ai-research/22-agent-native-research-artifact/compiler/references/validation-checklist.md +149 -0
  473. package/skills/ai-research/22-agent-native-research-artifact/research-manager/SKILL.md +324 -0
  474. package/skills/ai-research/22-agent-native-research-artifact/research-manager/references/event-taxonomy.md +124 -0
  475. package/skills/ai-research/22-agent-native-research-artifact/research-manager/references/provenance-tags.md +190 -0
  476. package/skills/ai-research/22-agent-native-research-artifact/research-manager/references/session-protocol.md +162 -0
  477. package/skills/ai-research/22-agent-native-research-artifact/rigor-reviewer/SKILL.md +322 -0
  478. package/skills/ai-research/22-agent-native-research-artifact/rigor-reviewer/references/review-dimensions.md +182 -0
  479. package/skills/ai-research/SKILL.md +101 -0
  480. package/skills/ai-research/SOURCE +38 -0
  481. package/skills/ai-research/index/1-frame.md +18 -0
  482. package/skills/ai-research/index/2-data.md +21 -0
  483. package/skills/ai-research/index/3-train.md +48 -0
  484. package/skills/ai-research/index/4-measure.md +25 -0
  485. package/skills/ai-research/index/5-run.md +23 -0
  486. package/skills/ai-research/index/6-write.md +35 -0
  487. package/skills/ai-research/library.json +3456 -0
  488. package/skills/analyze-app/EVALS.md +82 -0
  489. package/skills/analyze-app/SKILL.md +188 -0
  490. package/skills/design-contract/EVALS.md +80 -0
  491. package/skills/design-contract/SKILL.md +171 -0
  492. package/skills/design-library/EVALS.md +85 -0
  493. package/skills/design-library/INDEX.md +59 -0
  494. package/skills/design-library/SKILL.md +58 -0
  495. package/skills/design-library/SOURCE +131 -0
  496. package/skills/design-library/adaptive-interfaces/skills/colour-independence/SKILL.md +90 -0
  497. package/skills/design-library/adaptive-interfaces/skills/flexible-typography/SKILL.md +83 -0
  498. package/skills/design-library/adaptive-interfaces/skills/information-density/SKILL.md +87 -0
  499. package/skills/design-library/adaptive-interfaces/skills/preference-audit/SKILL.md +70 -0
  500. package/skills/design-library/adaptive-interfaces/skills/responsive-accessibility/SKILL.md +86 -0
  501. package/skills/design-library/adaptive-interfaces/skills/responsive-review/SKILL.md +76 -0
  502. package/skills/design-library/adaptive-interfaces/skills/simplified-views/SKILL.md +97 -0
  503. package/skills/design-library/adaptive-interfaces/skills/specify/SKILL.md +63 -0
  504. package/skills/design-library/adaptive-interfaces/skills/user-preference-respect/SKILL.md +100 -0
  505. package/skills/design-library/cognitive-accessibility/skills/adaptive-personalisation/SKILL.md +61 -0
  506. package/skills/design-library/cognitive-accessibility/skills/assess-load/SKILL.md +48 -0
  507. package/skills/design-library/cognitive-accessibility/skills/cognitive-load-assessment/SKILL.md +60 -0
  508. package/skills/design-library/cognitive-accessibility/skills/contextual-help-design/SKILL.md +61 -0
  509. package/skills/design-library/cognitive-accessibility/skills/error-prevention-recovery/SKILL.md +71 -0
  510. package/skills/design-library/cognitive-accessibility/skills/focus-attention-design/SKILL.md +67 -0
  511. package/skills/design-library/cognitive-accessibility/skills/memory-load-reduction/SKILL.md +60 -0
  512. package/skills/design-library/cognitive-accessibility/skills/plain-language-design/SKILL.md +78 -0
  513. package/skills/design-library/cognitive-accessibility/skills/review/SKILL.md +56 -0
  514. package/skills/design-library/cognitive-accessibility/skills/simplify/SKILL.md +39 -0
  515. package/skills/design-library/cognitive-accessibility/skills/wayfinding-navigation/SKILL.md +64 -0
  516. package/skills/design-library/design-research/skills/behavioural-analytics/SKILL.md +33 -0
  517. package/skills/design-library/design-research/skills/qual-quant-triangulation/SKILL.md +33 -0
  518. package/skills/design-library/inclusive-interaction/skills/audit/SKILL.md +50 -0
  519. package/skills/design-library/inclusive-interaction/skills/design-flow/SKILL.md +58 -0
  520. package/skills/design-library/inclusive-interaction/skills/feedback-and-status/SKILL.md +76 -0
  521. package/skills/design-library/inclusive-interaction/skills/gesture-alternatives/SKILL.md +70 -0
  522. package/skills/design-library/inclusive-interaction/skills/keyboard-navigation/SKILL.md +99 -0
  523. package/skills/design-library/inclusive-interaction/skills/keyboard-review/SKILL.md +54 -0
  524. package/skills/design-library/inclusive-interaction/skills/motion-sensitivity/SKILL.md +79 -0
  525. package/skills/design-library/inclusive-interaction/skills/multi-modal-input/SKILL.md +70 -0
  526. package/skills/design-library/inclusive-interaction/skills/touch-target-design/SKILL.md +71 -0
  527. package/skills/design-library/inclusive-interaction/skills/voice-interaction/SKILL.md +68 -0
  528. package/skills/design-library/visual-critique/skills/critique-affordance/SKILL.md +45 -0
  529. package/skills/design-library/visual-critique/skills/critique-brand-consistency/SKILL.md +42 -0
  530. package/skills/design-library/visual-critique/skills/critique-color/SKILL.md +44 -0
  531. package/skills/design-library/visual-critique/skills/critique-composition/SKILL.md +46 -0
  532. package/skills/design-library/visual-critique/skills/critique-information-density/SKILL.md +45 -0
  533. package/skills/design-library/visual-critique/skills/critique-typography/SKILL.md +45 -0
  534. package/skills/design-library/visual-critique/skills/critique-visual-hierarchy/SKILL.md +40 -0
  535. package/skills/feature-audit/EVALS.md +83 -0
  536. package/skills/feature-audit/SKILL.md +326 -0
  537. package/skills/harness/EVALS.md +81 -0
  538. package/skills/harness/SKILL.md +88 -0
  539. package/skills/i-have-adhd/EVALS.md +80 -0
  540. package/skills/i-have-adhd/SKILL.md +183 -0
  541. package/skills/no-ai-slop/EVALS.md +89 -0
  542. package/skills/no-ai-slop/SKILL.md +209 -0
  543. package/skills/no-ai-slop/eval.md +52 -0
  544. package/skills/plan-add/EVALS.md +79 -0
  545. package/skills/plan-add/SKILL.md +179 -0
  546. package/skills/plan-add/render_table.py +72 -0
  547. package/skills/plan-status/EVALS.md +78 -0
  548. package/skills/plan-status/SKILL.md +52 -0
  549. package/skills/plan-sync/EVALS.md +80 -0
  550. package/skills/plan-sync/SKILL.md +69 -0
  551. package/skills/pm-frameworks/SKILL.md +33 -0
  552. package/skills/pm-frameworks/SOURCE +39 -0
  553. package/skills/pm-frameworks/intended-vs-implemented/SKILL.md +42 -0
  554. package/skills/pm-frameworks/opportunity-solution-tree/SKILL.md +64 -0
  555. package/skills/ponytail/EVALS.md +80 -0
  556. package/skills/ponytail/SKILL.md +124 -0
  557. package/skills/product-analysis/EVALS.md +103 -0
  558. package/skills/product-analysis/SKILL.md +361 -0
  559. package/skills/research/EVALS.md +104 -0
  560. package/skills/research/SKILL.md +570 -0
  561. package/skills/rl-env/SKILL.md +53 -0
  562. package/skills/rl-env/SOURCE +41 -0
  563. package/skills/rl-env/generate-nemo-gym-env/SKILL.md +169 -0
  564. package/skills/rl-env/generate-nemo-gym-env/references/architecture.md +114 -0
  565. package/skills/rl-env/generate-openenv-env/SKILL.md +183 -0
  566. package/skills/rl-env/generate-openenv-env/references/architecture.md +82 -0
  567. package/skills/rl-env/generate-ors-env/SKILL.md +209 -0
  568. package/skills/rl-env/generate-ors-env/references/architecture.md +113 -0
  569. package/skills/rl-env/generate-verifiers-env/SKILL.md +188 -0
  570. package/skills/rl-env/generate-verifiers-env/references/architecture.md +119 -0
  571. package/skills/rl-env/rl-env-from-description/SKILL.md +124 -0
  572. package/skills/rl-env/rl-env-from-description/references/interview.md +75 -0
  573. package/skills/rl-env/rl-env-from-description/references/nemo_gym.md +41 -0
  574. package/skills/rl-env/rl-env-from-description/references/openenv.md +35 -0
  575. package/skills/rl-env/rl-env-from-description/references/ors.md +50 -0
  576. package/skills/rl-env/rl-env-from-description/references/verifiers.md +39 -0
  577. package/skills/tezgah-contract/EVALS.md +78 -0
  578. package/skills/tezgah-contract/SKILL.md +792 -0
  579. package/statusline.py +129 -0
  580. package/workflows/graph-impact.js +153 -0
  581. package/workflows/graph-map.js +158 -0
  582. package/workflows/graph-review.js +170 -0
@@ -0,0 +1,982 @@
1
+ ---
2
+ name: ml-paper-writing
3
+ description: Write publication-ready ML/AI papers for NeurIPS, ICML, ICLR, ACL, AAAI, COLM. Use when drafting papers from research repos, structuring arguments, verifying citations, or preparing camera-ready submissions. For systems venues (OSDI, NSDI, ASPLOS, SOSP), use systems-paper-writing instead.
4
+ version: 1.2.0
5
+ author: Orchestra Research
6
+ license: MIT
7
+ tags: [Academic Writing, NeurIPS, ICML, ICLR, ACL, AAAI, COLM, LaTeX, Paper Writing, Citations, Research]
8
+ dependencies: [semanticscholar, arxiv, habanero, requests]
9
+ ---
10
+
11
+ # ML Paper Writing for Top AI Conferences
12
+
13
+ Expert-level guidance for writing publication-ready papers targeting **NeurIPS, ICML, ICLR, ACL, AAAI, COLM**. This skill combines writing philosophy from top researchers (Nanda, Farquhar, Karpathy, Lipton, Steinhardt) with practical tools: LaTeX templates, citation verification APIs, and conference checklists.
14
+
15
+ **For systems venues (OSDI, NSDI, ASPLOS, SOSP)**, use the [systems-paper-writing](../systems-paper-writing/) skill, which provides paragraph-level structural blueprints, writing patterns, venue-specific checklists, and LaTeX templates for systems conferences.
16
+
17
+ ## Core Philosophy: Collaborative Writing
18
+
19
+ **Paper writing is collaborative, but Claude should be proactive in delivering drafts.**
20
+
21
+ The typical workflow starts with a research repository containing code, results, and experimental artifacts. Claude's role is to:
22
+
23
+ 1. **Understand the project** by exploring the repo, results, and existing documentation
24
+ 2. **Deliver a complete first draft** when confident about the contribution
25
+ 3. **Search literature** using web search and APIs to find relevant citations
26
+ 4. **Refine through feedback cycles** when the scientist provides input
27
+ 5. **Ask for clarification** only when genuinely uncertain about key decisions
28
+
29
+ **Key Principle**: Be proactive. If the repo and results are clear, deliver a full draft. Don't block waiting for feedback on every section—scientists are busy. Produce something concrete they can react to, then iterate based on their response.
30
+
31
+ ---
32
+
33
+ ## ⚠️ CRITICAL: Never Hallucinate Citations
34
+
35
+ **This is the most important rule in academic writing with AI assistance.**
36
+
37
+ ### The Problem
38
+ AI-generated citations have a **~40% error rate**. Hallucinated references—papers that don't exist, wrong authors, incorrect years, fabricated DOIs—are a serious form of academic misconduct that can result in desk rejection or retraction.
39
+
40
+ ### The Rule
41
+ **NEVER generate BibTeX entries from memory. ALWAYS fetch programmatically.**
42
+
43
+ | Action | ✅ Correct | ❌ Wrong |
44
+ |--------|-----------|----------|
45
+ | Adding a citation | Search API → verify → fetch BibTeX | Write BibTeX from memory |
46
+ | Uncertain about a paper | Mark as `[CITATION NEEDED]` | Guess the reference |
47
+ | Can't find exact paper | Note: "placeholder - verify" | Invent similar-sounding paper |
48
+
49
+ ### When You Can't Verify a Citation
50
+
51
+ If you cannot programmatically verify a citation, you MUST:
52
+
53
+ ```latex
54
+ % EXPLICIT PLACEHOLDER - requires human verification
55
+ \cite{PLACEHOLDER_author2024_verify_this} % TODO: Verify this citation exists
56
+ ```
57
+
58
+ **Always tell the scientist**: "I've marked [X] citations as placeholders that need verification. I could not confirm these papers exist."
59
+
60
+ ### Recommended: Install Exa MCP for Paper Search
61
+
62
+ For the best paper search experience, install **Exa MCP** which provides real-time academic search:
63
+
64
+ **Claude Code:**
65
+ ```bash
66
+ claude mcp add exa -- npx -y mcp-remote "https://mcp.exa.ai/mcp"
67
+ ```
68
+
69
+ **Cursor / VS Code** (add to MCP settings):
70
+ ```json
71
+ {
72
+ "mcpServers": {
73
+ "exa": {
74
+ "type": "http",
75
+ "url": "https://mcp.exa.ai/mcp"
76
+ }
77
+ }
78
+ }
79
+ ```
80
+
81
+ Exa MCP enables searches like:
82
+ - "Find papers on RLHF for language models published after 2023"
83
+ - "Search for transformer architecture papers by Vaswani"
84
+ - "Get recent work on sparse autoencoders for interpretability"
85
+
86
+ Then verify results with Semantic Scholar API and fetch BibTeX via DOI.
87
+
88
+ ---
89
+
90
+ ## Workflow 0: Starting from a Research Repository
91
+
92
+ When beginning paper writing, start by understanding the project:
93
+
94
+ ```
95
+ Project Understanding:
96
+ - [ ] Step 1: Explore the repository structure
97
+ - [ ] Step 2: Read README, existing docs, and key results
98
+ - [ ] Step 3: Identify the main contribution with the scientist
99
+ - [ ] Step 4: Find papers already cited in the codebase
100
+ - [ ] Step 5: Search for additional relevant literature
101
+ - [ ] Step 6: Outline the paper structure together
102
+ - [ ] Step 7: Draft sections iteratively with feedback
103
+ ```
104
+
105
+ **Step 1: Explore the Repository**
106
+
107
+ ```bash
108
+ # Understand project structure
109
+ ls -la
110
+ find . -name "*.py" | head -20
111
+ find . -name "*.md" -o -name "*.txt" | xargs grep -l -i "result\|conclusion\|finding"
112
+ ```
113
+
114
+ Look for:
115
+ - `README.md` - Project overview and claims
116
+ - `results/`, `outputs/`, `experiments/` - Key findings
117
+ - `configs/` - Experimental settings
118
+ - Existing `.bib` files or citation references
119
+ - Any draft documents or notes
120
+
121
+ **Step 2: Identify Existing Citations**
122
+
123
+ Check for papers already referenced in the codebase:
124
+
125
+ ```bash
126
+ # Find existing citations
127
+ grep -r "arxiv\|doi\|cite" --include="*.md" --include="*.bib" --include="*.py"
128
+ find . -name "*.bib"
129
+ ```
130
+
131
+ These are high-signal starting points for Related Work—the scientist has already deemed them relevant.
132
+
133
+ **Step 3: Clarify the Contribution**
134
+
135
+ Before writing, explicitly confirm with the scientist:
136
+
137
+ > "Based on my understanding of the repo, the main contribution appears to be [X].
138
+ > The key results show [Y]. Is this the framing you want for the paper,
139
+ > or should we emphasize different aspects?"
140
+
141
+ **Never assume the narrative—always verify with the human.**
142
+
143
+ **Step 4: Search for Additional Literature**
144
+
145
+ Use web search to find relevant papers:
146
+
147
+ ```
148
+ Search queries to try:
149
+ - "[main technique] + [application domain]"
150
+ - "[baseline method] comparison"
151
+ - "[problem name] state-of-the-art"
152
+ - Author names from existing citations
153
+ ```
154
+
155
+ Then verify and retrieve BibTeX using the citation workflow below.
156
+
157
+ **Step 5: Deliver a First Draft**
158
+
159
+ **Be proactive—deliver a complete draft rather than asking permission for each section.**
160
+
161
+ If the repo provides clear results and the contribution is apparent:
162
+ 1. Write the full first draft end-to-end
163
+ 2. Present the complete draft for feedback
164
+ 3. Iterate based on scientist's response
165
+
166
+ If genuinely uncertain about framing or major claims:
167
+ 1. Draft what you can confidently
168
+ 2. Flag specific uncertainties: "I framed X as the main contribution—let me know if you'd prefer to emphasize Y instead"
169
+ 3. Continue with the draft rather than blocking
170
+
171
+ **Questions to include with the draft** (not before):
172
+ - "I emphasized X as the main contribution—adjust if needed"
173
+ - "I highlighted results A, B, C—let me know if others are more important"
174
+ - "Related work section includes [papers]—add any I missed"
175
+
176
+ ---
177
+
178
+ ## When to Use This Skill
179
+
180
+ Use this skill when:
181
+ - **Starting from a research repo** to write a paper
182
+ - **Drafting or revising** specific sections
183
+ - **Finding and verifying citations** for related work
184
+ - **Formatting** for conference submission
185
+ - **Resubmitting** to a different venue (format conversion)
186
+ - **Iterating** on drafts with scientist feedback
187
+
188
+ **Always remember**: First drafts are starting points for discussion, not final outputs.
189
+
190
+ ---
191
+
192
+ ## Balancing Proactivity and Collaboration
193
+
194
+ **Default: Be proactive. Deliver drafts, then iterate.**
195
+
196
+ | Confidence Level | Action |
197
+ |-----------------|--------|
198
+ | **High** (clear repo, obvious contribution) | Write full draft, deliver, iterate on feedback |
199
+ | **Medium** (some ambiguity) | Write draft with flagged uncertainties, continue |
200
+ | **Low** (major unknowns) | Ask 1-2 targeted questions, then draft |
201
+
202
+ **Draft first, ask with the draft** (not before):
203
+
204
+ | Section | Draft Autonomously | Flag With Draft |
205
+ |---------|-------------------|-----------------|
206
+ | Abstract | Yes | "Framed contribution as X—adjust if needed" |
207
+ | Introduction | Yes | "Emphasized problem Y—correct if wrong" |
208
+ | Methods | Yes | "Included details A, B, C—add missing pieces" |
209
+ | Experiments | Yes | "Highlighted results 1, 2, 3—reorder if needed" |
210
+ | Related Work | Yes | "Cited papers X, Y, Z—add any I missed" |
211
+
212
+ **Only block for input when:**
213
+ - Target venue is unclear (affects page limits, framing)
214
+ - Multiple contradictory framings seem equally valid
215
+ - Results seem incomplete or inconsistent
216
+ - Explicit request to review before continuing
217
+
218
+ **Don't block for:**
219
+ - Word choice decisions
220
+ - Section ordering
221
+ - Which specific results to show (make a choice, flag it)
222
+ - Citation completeness (draft with what you find, note gaps)
223
+
224
+ ---
225
+
226
+ ## The Narrative Principle
227
+
228
+ **The single most critical insight**: Your paper is not a collection of experiments—it's a story with one clear contribution supported by evidence.
229
+
230
+ Every successful ML paper centers on what Neel Nanda calls "the narrative": a short, rigorous, evidence-based technical story with a takeaway readers care about.
231
+
232
+ **Three Pillars (must be crystal clear by end of introduction):**
233
+
234
+ | Pillar | Description | Example |
235
+ |--------|-------------|---------|
236
+ | **The What** | 1-3 specific novel claims within cohesive theme | "We prove that X achieves Y under condition Z" |
237
+ | **The Why** | Rigorous empirical evidence supporting claims | Strong baselines, experiments distinguishing hypotheses |
238
+ | **The So What** | Why readers should care | Connection to recognized community problems |
239
+
240
+ **If you cannot state your contribution in one sentence, you don't yet have a paper.**
241
+
242
+ ---
243
+
244
+ ## Paper Structure Workflow
245
+
246
+ ### Workflow 1: Writing a Complete Paper (Iterative)
247
+
248
+ Copy this checklist and track progress. **Each step involves drafting → feedback → revision:**
249
+
250
+ ```
251
+ Paper Writing Progress:
252
+ - [ ] Step 1: Define the one-sentence contribution (with scientist)
253
+ - [ ] Step 2: Draft Figure 1 → get feedback → revise
254
+ - [ ] Step 3: Draft abstract → get feedback → revise
255
+ - [ ] Step 4: Draft introduction → get feedback → revise
256
+ - [ ] Step 5: Draft methods → get feedback → revise
257
+ - [ ] Step 6: Draft experiments → get feedback → revise
258
+ - [ ] Step 7: Draft related work → get feedback → revise
259
+ - [ ] Step 8: Draft limitations → get feedback → revise
260
+ - [ ] Step 9: Complete paper checklist (required)
261
+ - [ ] Step 10: Final review cycle and submission
262
+ ```
263
+
264
+ **Step 1: Define the One-Sentence Contribution**
265
+
266
+ **This step requires explicit confirmation from the scientist.**
267
+
268
+ Before writing anything, articulate and verify:
269
+ - What is the single thing your paper contributes?
270
+ - What was not obvious or present before your work?
271
+
272
+ > "I propose framing the contribution as: '[one sentence]'. Does this capture
273
+ > what you see as the main takeaway? Should we adjust the emphasis?"
274
+
275
+ **Step 2: Draft Figure 1**
276
+
277
+ Figure 1 deserves special attention—many readers skip directly to it.
278
+ - Convey core idea, approach, or most compelling result
279
+ - Use vector graphics (PDF/EPS for plots)
280
+ - Write captions that stand alone without main text
281
+ - Ensure readability in black-and-white (8% of men have color vision deficiency)
282
+
283
+ **Step 3: Write Abstract (5-Sentence Formula)**
284
+
285
+ From Sebastian Farquhar (DeepMind):
286
+
287
+ ```
288
+ 1. What you achieved: "We introduce...", "We prove...", "We demonstrate..."
289
+ 2. Why this is hard and important
290
+ 3. How you do it (with specialist keywords for discoverability)
291
+ 4. What evidence you have
292
+ 5. Your most remarkable number/result
293
+ ```
294
+
295
+ **Delete** generic openings like "Large language models have achieved remarkable success..."
296
+
297
+ **Step 4: Write Introduction (1-1.5 pages max)**
298
+
299
+ Must include:
300
+ - 2-4 bullet contribution list (max 1-2 lines each in two-column format)
301
+ - Clear problem statement
302
+ - Brief approach overview
303
+ - Methods should start by page 2-3 maximum
304
+
305
+ **Step 5: Methods Section**
306
+
307
+ Enable reimplementation:
308
+ - Conceptual outline or pseudocode
309
+ - All hyperparameters listed
310
+ - Architectural details sufficient for reproduction
311
+ - Present final design decisions; ablations go in experiments
312
+
313
+ **Step 6: Experiments Section**
314
+
315
+ For each experiment, explicitly state:
316
+ - What claim it supports
317
+ - How it connects to main contribution
318
+ - Experimental setting (details in appendix)
319
+ - What to observe: "the blue line shows X, which demonstrates Y"
320
+
321
+ Requirements:
322
+ - Error bars with methodology (standard deviation vs standard error)
323
+ - Hyperparameter search ranges
324
+ - Compute infrastructure (GPU type, total hours)
325
+ - Seed-setting methods
326
+
327
+ **Step 7: Related Work**
328
+
329
+ Organize methodologically, not paper-by-paper:
330
+
331
+ **Good:** "One line of work uses Floogledoodle's assumption [refs] whereas we use Doobersnoddle's assumption because..."
332
+
333
+ **Bad:** "Snap et al. introduced X while Crackle et al. introduced Y."
334
+
335
+ Cite generously—reviewers likely authored relevant papers.
336
+
337
+ **Step 8: Limitations Section (REQUIRED)**
338
+
339
+ All major conferences require this. Counter-intuitively, honesty helps:
340
+ - Reviewers are instructed not to penalize honest limitation acknowledgment
341
+ - Pre-empt criticisms by identifying weaknesses first
342
+ - Explain why limitations don't undermine core claims
343
+
344
+ **Step 9: Paper Checklist**
345
+
346
+ NeurIPS, ICML, and ICLR all require paper checklists. See [references/checklists.md](references/checklists.md).
347
+
348
+ ---
349
+
350
+ ## Writing Philosophy for Top ML Conferences
351
+
352
+ **This section distills the most important writing principles from leading ML researchers.** These aren't optional style suggestions—they're what separates accepted papers from rejected ones.
353
+
354
+ > "A paper is a short, rigorous, evidence-based technical story with a takeaway readers care about." — Neel Nanda
355
+
356
+ ### The Sources Behind This Guidance
357
+
358
+ This skill synthesizes writing philosophy from researchers who have published extensively at top venues:
359
+
360
+ | Source | Key Contribution | Link |
361
+ |--------|-----------------|------|
362
+ | **Neel Nanda** (Google DeepMind) | The Narrative Principle, What/Why/So What framework | [How to Write ML Papers](https://www.alignmentforum.org/posts/eJGptPbbFPZGLpjsp/highly-opinionated-advice-on-how-to-write-ml-papers) |
363
+ | **Sebastian Farquhar** (DeepMind) | 5-sentence abstract formula | [How to Write ML Papers](https://sebastianfarquhar.com/on-research/2024/11/04/how_to_write_ml_papers/) |
364
+ | **Gopen & Swan** | 7 principles of reader expectations | [Science of Scientific Writing](https://cseweb.ucsd.edu/~swanson/papers/science-of-writing.pdf) |
365
+ | **Zachary Lipton** | Word choice, eliminating hedging | [Heuristics for Scientific Writing](https://www.approximatelycorrect.com/2018/01/29/heuristics-technical-scientific-writing-machine-learning-perspective/) |
366
+ | **Jacob Steinhardt** (UC Berkeley) | Precision, consistent terminology | [Writing Tips](https://bounded-regret.ghost.io/) |
367
+ | **Ethan Perez** (Anthropic) | Micro-level clarity tips | [Easy Paper Writing Tips](https://ethanperez.net/easy-paper-writing-tips/) |
368
+ | **Andrej Karpathy** | Single contribution focus | Various lectures |
369
+
370
+ **For deeper dives into any of these, see:**
371
+ - [references/writing-guide.md](references/writing-guide.md) - Full explanations with examples
372
+ - [references/sources.md](references/sources.md) - Complete bibliography
373
+
374
+ ### Time Allocation (From Neel Nanda)
375
+
376
+ Spend approximately **equal time** on each of:
377
+ 1. The abstract
378
+ 2. The introduction
379
+ 3. The figures
380
+ 4. Everything else combined
381
+
382
+ **Why?** Most reviewers form judgments before reaching your methods. Readers encounter your paper as: **title → abstract → introduction → figures → maybe the rest.**
383
+
384
+ ### Writing Style Guidelines
385
+
386
+ #### Sentence-Level Clarity (Gopen & Swan's 7 Principles)
387
+
388
+ These principles are based on how readers actually process prose. Violating them forces readers to spend cognitive effort on structure rather than content.
389
+
390
+ | Principle | Rule | Example |
391
+ |-----------|------|---------|
392
+ | **Subject-verb proximity** | Keep subject and verb close | ❌ "The model, which was trained on..., achieves" → ✅ "The model achieves... after training on..." |
393
+ | **Stress position** | Place emphasis at sentence ends | ❌ "Accuracy improves by 15% when using attention" → ✅ "When using attention, accuracy improves by **15%**" |
394
+ | **Topic position** | Put context first, new info after | ✅ "Given these constraints, we propose..." |
395
+ | **Old before new** | Familiar info → unfamiliar info | Link backward, then introduce new |
396
+ | **One unit, one function** | Each paragraph makes one point | Split multi-point paragraphs |
397
+ | **Action in verb** | Use verbs, not nominalizations | ❌ "We performed an analysis" → ✅ "We analyzed" |
398
+ | **Context before new** | Set stage before presenting | Explain before showing equation |
399
+
400
+ **Full 7 principles with detailed examples:** See [references/writing-guide.md](references/writing-guide.md#the-7-principles-of-reader-expectations)
401
+
402
+ #### Micro-Level Tips (Ethan Perez)
403
+
404
+ These small changes accumulate into significantly clearer prose:
405
+
406
+ - **Minimize pronouns**: ❌ "This shows..." → ✅ "This result shows..."
407
+ - **Verbs early**: Position verbs near sentence start
408
+ - **Unfold apostrophes**: ❌ "X's Y" → ✅ "The Y of X" (when awkward)
409
+ - **Delete filler words**: "actually," "a bit," "very," "really," "basically," "quite," "essentially"
410
+
411
+ **Full micro-tips with examples:** See [references/writing-guide.md](references/writing-guide.md#micro-level-writing-tips)
412
+
413
+ #### Word Choice (Zachary Lipton)
414
+
415
+ - **Be specific**: ❌ "performance" → ✅ "accuracy" or "latency" (say what you mean)
416
+ - **Eliminate hedging**: Drop "may" and "can" unless genuinely uncertain
417
+ - **Avoid incremental vocabulary**: ❌ "combine," "modify," "expand" → ✅ "develop," "propose," "introduce"
418
+ - **Delete intensifiers**: ❌ "provides *very* tight approximation" → ✅ "provides tight approximation"
419
+
420
+ #### Precision Over Brevity (Jacob Steinhardt)
421
+
422
+ - **Consistent terminology**: Different terms for same concept creates confusion. Pick one and stick with it.
423
+ - **State assumptions formally**: Before theorems, list all assumptions explicitly
424
+ - **Intuition + rigor**: Provide intuitive explanations alongside formal proofs
425
+
426
+ ### What Reviewers Actually Read
427
+
428
+ Understanding reviewer behavior helps prioritize your effort:
429
+
430
+ | Paper Section | % Reviewers Who Read | Implication |
431
+ |---------------|---------------------|-------------|
432
+ | Abstract | 100% | Must be perfect |
433
+ | Introduction | 90%+ (skimmed) | Front-load contribution |
434
+ | Figures | Examined before methods | Figure 1 is critical |
435
+ | Methods | Only if interested | Don't bury the lede |
436
+ | Appendix | Rarely | Put only supplementary details |
437
+
438
+ **Bottom line**: If your abstract and intro don't hook reviewers, they may never read your brilliant methods section.
439
+
440
+ ---
441
+
442
+ ## Conference Requirements Quick Reference
443
+
444
+ ### ML/AI Conferences
445
+
446
+ | Conference | Page Limit | Extra for Camera-Ready | Key Requirement |
447
+ |------------|------------|------------------------|------------------|
448
+ | **NeurIPS 2025** | 9 pages | +0 | Mandatory checklist, lay summary for accepted |
449
+ | **ICML 2026** | 8 pages | +1 | Broader Impact Statement required |
450
+ | **ICLR 2026** | 9 pages | +1 | LLM disclosure required, reciprocal reviewing |
451
+ | **ACL 2025** | 8 pages (long) | varies | Limitations section mandatory |
452
+ | **AAAI 2026** | 7 pages | +1 | Strict style file adherence |
453
+ | **COLM 2025** | 9 pages | +1 | Focus on language models |
454
+
455
+ **Systems Conferences (OSDI, NSDI, ASPLOS, SOSP)**: See the [systems-paper-writing](../systems-paper-writing/) skill for page limits, templates, deadlines, and submission rules.
456
+
457
+ **Universal Requirements:**
458
+ - Double-blind review (anonymize submissions)
459
+ - References don't count toward page limit
460
+ - Appendices unlimited but reviewers not required to read
461
+ - LaTeX required for all venues
462
+
463
+ **LaTeX Templates:** See [templates/](templates/) directory for all conference templates.
464
+
465
+ ---
466
+
467
+ ## Using LaTeX Templates Properly
468
+
469
+ ### Workflow 4: Starting a New Paper from Template
470
+
471
+ **Always copy the entire template directory first, then write within it.**
472
+
473
+ ```
474
+ Template Setup Checklist:
475
+ - [ ] Step 1: Copy entire template directory to new project
476
+ - [ ] Step 2: Verify template compiles as-is (before any changes)
477
+ - [ ] Step 3: Read the template's example content to understand structure
478
+ - [ ] Step 4: Replace example content section by section
479
+ - [ ] Step 5: Keep template comments/examples as reference until done
480
+ - [ ] Step 6: Clean up template artifacts only at the end
481
+ ```
482
+
483
+ **Step 1: Copy the Full Template**
484
+
485
+ ```bash
486
+ # Create your paper directory with the complete template
487
+ cp -r templates/neurips2025/ ~/papers/my-new-paper/
488
+ cd ~/papers/my-new-paper/
489
+
490
+ # Verify structure is complete
491
+ ls -la
492
+ # Should see: main.tex, neurips.sty, Makefile, etc.
493
+ ```
494
+
495
+ **⚠️ IMPORTANT**: Copy the ENTIRE directory, not just `main.tex`. Templates include:
496
+ - Style files (`.sty`) - required for compilation
497
+ - Bibliography styles (`.bst`) - required for references
498
+ - Example content - useful as reference
499
+ - Makefiles - for easy compilation
500
+
501
+ **Step 2: Verify Template Compiles First**
502
+
503
+ Before making ANY changes, compile the template as-is:
504
+
505
+ ```bash
506
+ # Using latexmk (recommended)
507
+ latexmk -pdf main.tex
508
+
509
+ # Or manual compilation
510
+ pdflatex main.tex
511
+ bibtex main
512
+ pdflatex main.tex
513
+ pdflatex main.tex
514
+ ```
515
+
516
+ If the unmodified template doesn't compile, fix that first. Common issues:
517
+ - Missing TeX packages → install via `tlmgr install <package>`
518
+ - Wrong TeX distribution → use TeX Live (recommended)
519
+
520
+ **Step 3: Keep Template Content as Reference**
521
+
522
+ Don't immediately delete all example content. Instead:
523
+
524
+ ```latex
525
+ % KEEP template examples commented out as you write
526
+ % This shows you the expected format
527
+
528
+ % Template example (keep for reference):
529
+ % \begin{figure}[t]
530
+ % \centering
531
+ % \includegraphics[width=0.8\linewidth]{example-image}
532
+ % \caption{Template shows caption style}
533
+ % \end{figure}
534
+
535
+ % Your actual figure:
536
+ \begin{figure}[t]
537
+ \centering
538
+ \includegraphics[width=0.8\linewidth]{your-figure.pdf}
539
+ \caption{Your caption following the same style.}
540
+ \end{figure}
541
+ ```
542
+
543
+ **Step 4: Replace Content Section by Section**
544
+
545
+ Work through the paper systematically:
546
+
547
+ ```
548
+ Replacement Order:
549
+ 1. Title and authors (anonymize for submission)
550
+ 2. Abstract
551
+ 3. Introduction
552
+ 4. Methods
553
+ 5. Experiments
554
+ 6. Related Work
555
+ 7. Conclusion
556
+ 8. References (your .bib file)
557
+ 9. Appendix
558
+ ```
559
+
560
+ For each section:
561
+ 1. Read the template's example content
562
+ 2. Note any special formatting or macros used
563
+ 3. Replace with your content following the same patterns
564
+ 4. Compile frequently to catch errors early
565
+
566
+ **Step 5: Use Template Macros**
567
+
568
+ Templates often define useful macros. Check the preamble for:
569
+
570
+ ```latex
571
+ % Common template macros to use:
572
+ \newcommand{\method}{YourMethodName} % Consistent method naming
573
+ \newcommand{\eg}{e.g.,\xspace} % Proper abbreviations
574
+ \newcommand{\ie}{i.e.,\xspace}
575
+ \newcommand{\etal}{\textit{et al.}\xspace}
576
+ ```
577
+
578
+ **Step 6: Clean Up Only at the End**
579
+
580
+ Only remove template artifacts when paper is nearly complete:
581
+
582
+ ```latex
583
+ % BEFORE SUBMISSION - remove these:
584
+ % - Commented-out template examples
585
+ % - Unused packages
586
+ % - Template's example figures/tables
587
+ % - Lorem ipsum or placeholder text
588
+
589
+ % KEEP these:
590
+ % - All style files (.sty)
591
+ % - Bibliography style (.bst)
592
+ % - Required packages from template
593
+ % - Any custom macros you're using
594
+ ```
595
+
596
+ ### Template Pitfalls to Avoid
597
+
598
+ | Pitfall | Problem | Solution |
599
+ |---------|---------|----------|
600
+ | Copying only `main.tex` | Missing `.sty`, won't compile | Copy entire directory |
601
+ | Modifying `.sty` files | Breaks conference formatting | Never edit style files |
602
+ | Adding random packages | Conflicts, breaks template | Only add if necessary |
603
+ | Deleting template content too early | Lose formatting reference | Keep as comments until done |
604
+ | Not compiling frequently | Errors accumulate | Compile after each section |
605
+
606
+ ### Quick Template Reference
607
+
608
+ #### ML/AI Conferences
609
+
610
+ | Conference | Main File | Key Style File | Notes |
611
+ |------------|-----------|----------------|-------|
612
+ | NeurIPS 2025 | `main.tex` | `neurips.sty` | Has Makefile |
613
+ | ICML 2026 | `example_paper.tex` | `icml2026.sty` | Includes algorithm packages |
614
+ | ICLR 2026 | `iclr2026_conference.tex` | `iclr2026_conference.sty` | Has math_commands.tex |
615
+ | ACL | `acl_latex.tex` | `acl.sty` | Strict formatting |
616
+ | AAAI 2026 | `aaai2026-unified-template.tex` | `aaai2026.sty` | Very strict compliance |
617
+ | COLM 2025 | `colm2025_conference.tex` | `colm2025_conference.sty` | Similar to ICLR |
618
+
619
+ **Systems Conference Templates** (OSDI, NSDI, ASPLOS, SOSP): See the [systems-paper-writing](../systems-paper-writing/) skill.
620
+
621
+ ---
622
+
623
+ ## Conference Resubmission & Format Conversion
624
+
625
+ When a paper is rejected or withdrawn from one venue and resubmitted to another, format conversion is required. This is a common workflow in ML research.
626
+
627
+ ### Workflow 3: Converting Between Conference Formats
628
+
629
+ ```
630
+ Format Conversion Checklist:
631
+ - [ ] Step 1: Identify source and target template differences
632
+ - [ ] Step 2: Create new project with target template
633
+ - [ ] Step 3: Copy content sections (not preamble)
634
+ - [ ] Step 4: Adjust page limits and content
635
+ - [ ] Step 5: Update conference-specific requirements
636
+ - [ ] Step 6: Verify compilation and formatting
637
+ ```
638
+
639
+ **Step 1: Key Template Differences**
640
+
641
+ #### ML/AI Conversions
642
+
643
+ | From → To | Page Change | Key Adjustments |
644
+ |-----------|-------------|------------------|
645
+ | NeurIPS → ICML | 9 → 8 pages | Cut 1 page, add Broader Impact if missing |
646
+ | ICML → ICLR | 8 → 9 pages | Can expand experiments, add LLM disclosure |
647
+ | NeurIPS → ACL | 9 → 8 pages | Restructure for NLP conventions, add Limitations |
648
+ | ICLR → AAAI | 9 → 7 pages | Significant cuts needed, strict style adherence |
649
+ | Any → COLM | varies → 9 | Reframe for language model focus |
650
+
651
+ **ML → Systems Conversion**: When converting to OSDI, NSDI, ASPLOS, or SOSP, see the [systems-paper-writing](../systems-paper-writing/) skill for format conversion guidance, templates, and structural differences.
652
+
653
+ **Step 2: Content Migration (NOT Template Merge)**
654
+
655
+ **Never copy LaTeX preambles between templates.** Instead:
656
+
657
+ ```bash
658
+ # 1. Start fresh with target template
659
+ cp -r templates/icml2026/ new_submission/
660
+
661
+ # 2. Copy ONLY content sections from old paper
662
+ # - Abstract text
663
+ # - Section content (between \section{} commands)
664
+ # - Figures and tables
665
+ # - Bibliography entries
666
+
667
+ # 3. Paste into target template structure
668
+ ```
669
+
670
+ **Step 3: Adjusting for Page Limits**
671
+
672
+ When cutting pages (e.g., NeurIPS 9 → AAAI 7):
673
+ - Move detailed proofs to appendix
674
+ - Condense related work (cite surveys instead of individual papers)
675
+ - Combine similar experiments into unified tables
676
+ - Use smaller figure sizes with subfigures
677
+ - Tighten writing: eliminate redundancy, use active voice
678
+
679
+ When expanding (e.g., ICML 8 → ICLR 9):
680
+ - Add ablation studies reviewers requested
681
+ - Expand limitations discussion
682
+ - Include additional baselines
683
+ - Add qualitative examples
684
+
685
+ **Step 4: Conference-Specific Adjustments**
686
+
687
+ #### ML/AI Venues
688
+
689
+ | Target Venue | Required Additions |
690
+ |--------------|-------------------|
691
+ | **ICML** | Broader Impact Statement (after conclusion) |
692
+ | **ICLR** | LLM usage disclosure, reciprocal reviewing agreement |
693
+ | **ACL/EMNLP** | Limitations section (mandatory), Ethics Statement |
694
+ | **AAAI** | Strict adherence to style file (no modifications) |
695
+ | **NeurIPS** | Paper checklist (appendix), lay summary if accepted |
696
+
697
+ **Systems Venues** (OSDI, NSDI, ASPLOS, SOSP): See the [systems-paper-writing](../systems-paper-writing/) skill for venue-specific requirements, checklists, and reviewer guidelines.
698
+
699
+ **Step 5: Update References**
700
+
701
+ ```latex
702
+ % Remove self-citations that reveal identity (for blind review)
703
+ % Update any "under review" citations to published versions
704
+ % Add new relevant work published since last submission
705
+ ```
706
+
707
+ **Step 6: Addressing Previous Reviews**
708
+
709
+ When resubmitting after rejection:
710
+ - **Do** address reviewer concerns in the new version
711
+ - **Do** add experiments/clarifications reviewers requested
712
+ - **Don't** include a "changes from previous submission" section (blind review)
713
+ - **Don't** reference the previous submission or reviews
714
+
715
+ **Common Conversion Pitfalls:**
716
+ - ❌ Copying `\usepackage` commands (causes conflicts)
717
+ - ❌ Keeping old conference header/footer commands
718
+ - ❌ Forgetting to update `\bibliography{}` path
719
+ - ❌ Missing conference-specific required sections
720
+ - ❌ Exceeding page limit after format change
721
+
722
+ ---
723
+
724
+ ## Citation Workflow (Hallucination Prevention)
725
+
726
+ **⚠️ CRITICAL**: AI-generated citations have ~40% error rate. **Never write BibTeX from memory.**
727
+
728
+ ### The Golden Rule
729
+
730
+ ```
731
+ IF you cannot programmatically fetch a citation:
732
+ → Mark it as [CITATION NEEDED] or [PLACEHOLDER - VERIFY]
733
+ → Tell the scientist explicitly
734
+ → NEVER invent a plausible-sounding reference
735
+ ```
736
+
737
+ ### Workflow 2: Adding Citations
738
+
739
+ ```
740
+ Citation Verification (MANDATORY for every citation):
741
+ - [ ] Step 1: Search using Exa MCP or Semantic Scholar API
742
+ - [ ] Step 2: Verify paper exists in 2+ sources (Semantic Scholar + arXiv/CrossRef)
743
+ - [ ] Step 3: Retrieve BibTeX via DOI (programmatically, not from memory)
744
+ - [ ] Step 4: Verify the claim you're citing actually appears in the paper
745
+ - [ ] Step 5: Add verified BibTeX to bibliography
746
+ - [ ] Step 6: If ANY step fails → mark as placeholder, inform scientist
747
+ ```
748
+
749
+ **Step 0: Use Exa MCP for Initial Search (Recommended)**
750
+
751
+ If Exa MCP is installed, use it to find relevant papers:
752
+ ```
753
+ Search: "RLHF language model alignment 2023"
754
+ Search: "sparse autoencoders interpretability"
755
+ Search: "attention mechanism transformers Vaswani"
756
+ ```
757
+
758
+ Then verify each result with Semantic Scholar and fetch BibTeX via DOI.
759
+
760
+ **Step 1: Search Semantic Scholar**
761
+
762
+ ```python
763
+ from semanticscholar import SemanticScholar
764
+
765
+ sch = SemanticScholar()
766
+ results = sch.search_paper("attention mechanism transformers", limit=5)
767
+ for paper in results:
768
+ print(f"{paper.title} - {paper.paperId}")
769
+ print(f" DOI: {paper.externalIds.get('DOI', 'N/A')}")
770
+ ```
771
+
772
+ **Step 2: Verify Existence**
773
+
774
+ Confirm paper appears in at least two sources (Semantic Scholar + CrossRef/arXiv).
775
+
776
+ **Step 3: Retrieve BibTeX via DOI**
777
+
778
+ ```python
779
+ import requests
780
+
781
+ def doi_to_bibtex(doi: str) -> str:
782
+ """Get verified BibTeX from DOI via CrossRef."""
783
+ response = requests.get(
784
+ f"https://doi.org/{doi}",
785
+ headers={"Accept": "application/x-bibtex"}
786
+ )
787
+ response.raise_for_status()
788
+ return response.text
789
+
790
+ # Example
791
+ bibtex = doi_to_bibtex("10.48550/arXiv.1706.03762")
792
+ print(bibtex)
793
+ ```
794
+
795
+ **Step 4: Verify Claims**
796
+
797
+ Before citing for a specific claim, access the paper and confirm the attributed claim actually appears.
798
+
799
+ **Step 5: Handle Failures Explicitly**
800
+
801
+ If you cannot verify a citation at ANY step:
802
+
803
+ ```latex
804
+ % Option 1: Explicit placeholder
805
+ \cite{PLACEHOLDER_smith2023_verify} % TODO: Could not verify - scientist must confirm
806
+
807
+ % Option 2: Note in text
808
+ ... as shown in prior work [CITATION NEEDED - could not verify Smith et al. 2023].
809
+ ```
810
+
811
+ **Always inform the scientist:**
812
+ > "I could not verify the following citations and have marked them as placeholders:
813
+ > - Smith et al. 2023 on reward hacking - could not find in Semantic Scholar
814
+ > - Jones 2022 on scaling laws - found similar paper but different authors
815
+ > Please verify these before submission."
816
+
817
+ ### Summary: Citation Rules
818
+
819
+ | Situation | Action |
820
+ |-----------|--------|
821
+ | Found paper, got DOI, fetched BibTeX | ✅ Use the citation |
822
+ | Found paper, no DOI | ✅ Use arXiv BibTeX or manual entry from paper |
823
+ | Paper exists but can't fetch BibTeX | ⚠️ Mark placeholder, inform scientist |
824
+ | Uncertain if paper exists | ❌ Mark `[CITATION NEEDED]`, inform scientist |
825
+ | "I think there's a paper about X" | ❌ **NEVER cite** - search first or mark placeholder |
826
+
827
+ **🚨 NEVER generate BibTeX from memory—always fetch programmatically. 🚨**
828
+
829
+ See [references/citation-workflow.md](references/citation-workflow.md) for complete API documentation.
830
+
831
+ ---
832
+
833
+ ## Common Issues and Solutions
834
+
835
+ **Issue: Abstract too generic**
836
+
837
+ Delete first sentence if it could be prepended to any ML paper. Start with your specific contribution.
838
+
839
+ **Issue: Introduction exceeds 1.5 pages**
840
+
841
+ Split background into Related Work. Front-load contribution bullets. Methods should start by page 2-3.
842
+
843
+ **Issue: Experiments lack explicit claims**
844
+
845
+ Add sentence before each experiment: "This experiment tests whether [specific claim]..."
846
+
847
+ **Issue: Reviewers find paper hard to follow**
848
+
849
+ - Add explicit signposting: "In this section, we show X"
850
+ - Use consistent terminology throughout
851
+ - Include figure captions that stand alone
852
+
853
+ **Issue: Missing statistical significance**
854
+
855
+ Always include:
856
+ - Error bars (specify: std dev or std error)
857
+ - Number of runs
858
+ - Statistical tests if comparing methods
859
+
860
+ ---
861
+
862
+ ## Reviewer Evaluation Criteria
863
+
864
+ Reviewers assess papers on four dimensions:
865
+
866
+ | Criterion | What Reviewers Look For |
867
+ |-----------|------------------------|
868
+ | **Quality** | Technical soundness, well-supported claims |
869
+ | **Clarity** | Clear writing, reproducible by experts |
870
+ | **Significance** | Community impact, advances understanding |
871
+ | **Originality** | New insights (doesn't require new method) |
872
+
873
+ **Scoring (NeurIPS 6-point scale):**
874
+ - 6: Strong Accept - Groundbreaking, flawless
875
+ - 5: Accept - Technically solid, high impact
876
+ - 4: Borderline Accept - Solid, limited evaluation
877
+ - 3: Borderline Reject - Solid but weaknesses outweigh
878
+ - 2: Reject - Technical flaws
879
+ - 1: Strong Reject - Known results or ethics issues
880
+
881
+ See [references/reviewer-guidelines.md](references/reviewer-guidelines.md) for detailed reviewer instructions.
882
+
883
+ ---
884
+
885
+ ## Tables and Figures
886
+
887
+ ### Tables
888
+
889
+ Use `booktabs` LaTeX package for professional tables:
890
+
891
+ ```latex
892
+ \usepackage{booktabs}
893
+ \begin{tabular}{lcc}
894
+ \toprule
895
+ Method & Accuracy ↑ & Latency ↓ \\
896
+ \midrule
897
+ Baseline & 85.2 & 45ms \\
898
+ \textbf{Ours} & \textbf{92.1} & 38ms \\
899
+ \bottomrule
900
+ \end{tabular}
901
+ ```
902
+
903
+ **Rules:**
904
+ - Bold best value per metric
905
+ - Include direction symbols (↑ higher is better, ↓ lower is better)
906
+ - Right-align numerical columns
907
+ - Consistent decimal precision
908
+
909
+ ### Figures
910
+
911
+ - **Vector graphics** (PDF, EPS) for all plots and diagrams
912
+ - **Raster** (PNG 600 DPI) only for photographs
913
+ - Use **colorblind-safe palettes** (Okabe-Ito or Paul Tol)
914
+ - Verify **grayscale readability** (8% of men have color vision deficiency)
915
+ - **No title inside figure**—the caption serves this function
916
+ - **Self-contained captions**—reader should understand without main text
917
+
918
+ ---
919
+
920
+ ## Citing AI Research Skills
921
+
922
+ If this library helped with your research — whether for training pipelines, evaluation, paper writing, or any other skill — please consider citing it in your acknowledgments or references:
923
+
924
+ ```bibtex
925
+ @software{ai_research_skills,
926
+ title = {AI Research Skills Library},
927
+ author = {{Orchestra Research}},
928
+ year = {2025},
929
+ url = {https://github.com/orchestra-research/AI-research-SKILLs},
930
+ note = {Open-source skills library enabling AI agents to autonomously conduct AI research}
931
+ }
932
+ ```
933
+
934
+ A brief mention in your **Acknowledgments** section is also welcome:
935
+
936
+ ```latex
937
+ \section*{Acknowledgments}
938
+ We used the AI Research Skills Library~\cite{ai_research_skills} for [experiment orchestration / evaluation / ...].
939
+ ```
940
+
941
+ ---
942
+
943
+ ## References & Resources
944
+
945
+ ### Reference Documents (Deep Dives)
946
+
947
+ | Document | Contents |
948
+ |----------|----------|
949
+ | [writing-guide.md](references/writing-guide.md) | Gopen & Swan 7 principles, Ethan Perez micro-tips, word choice |
950
+ | [citation-workflow.md](references/citation-workflow.md) | Citation APIs, Python code, BibTeX management |
951
+ | [checklists.md](references/checklists.md) | NeurIPS 16-item, ICML, ICLR, ACL requirements |
952
+ | [reviewer-guidelines.md](references/reviewer-guidelines.md) | Evaluation criteria, scoring, rebuttals |
953
+ | [sources.md](references/sources.md) | Complete bibliography of all sources |
954
+
955
+ ### LaTeX Templates
956
+
957
+ Templates in `templates/` directory:
958
+ - **ML/AI**: ICML 2026, ICLR 2026, NeurIPS 2025, ACL/EMNLP, AAAI 2026, COLM 2025
959
+ - **Systems** (OSDI, NSDI, ASPLOS, SOSP): See [systems-paper-writing](../systems-paper-writing/) skill
960
+
961
+ **Compiling to PDF:**
962
+ - **VS Code/Cursor**: Install LaTeX Workshop extension + TeX Live → Save to auto-compile
963
+ - **Command line**: `latexmk -pdf main.tex` or `pdflatex` + `bibtex` workflow
964
+ - **Online**: Upload to [Overleaf](https://overleaf.com)
965
+
966
+ See [templates/README.md](templates/README.md) for detailed setup instructions.
967
+
968
+ ### Key External Sources
969
+
970
+ **Writing Philosophy:**
971
+ - [Neel Nanda: How to Write ML Papers](https://www.alignmentforum.org/posts/eJGptPbbFPZGLpjsp/highly-opinionated-advice-on-how-to-write-ml-papers) - Narrative, "What/Why/So What"
972
+ - [Farquhar: How to Write ML Papers](https://sebastianfarquhar.com/on-research/2024/11/04/how_to_write_ml_papers/) - 5-sentence abstract
973
+ - [Gopen & Swan: Science of Scientific Writing](https://cseweb.ucsd.edu/~swanson/papers/science-of-writing.pdf) - 7 reader expectation principles
974
+ - [Lipton: Heuristics for Scientific Writing](https://www.approximatelycorrect.com/2018/01/29/heuristics-technical-scientific-writing-machine-learning-perspective/) - Word choice
975
+ - [Perez: Easy Paper Writing Tips](https://ethanperez.net/easy-paper-writing-tips/) - Micro-level clarity
976
+
977
+ **APIs:** [Semantic Scholar](https://api.semanticscholar.org/api-docs/) | [CrossRef](https://www.crossref.org/documentation/retrieve-metadata/rest-api/) | [arXiv](https://info.arxiv.org/help/api/basics.html)
978
+
979
+ **ML/AI Venues:** [NeurIPS](https://neurips.cc/Conferences/2025/PaperInformation/StyleFiles) | [ICML](https://icml.cc/Conferences/2025/AuthorInstructions) | [ICLR](https://iclr.cc/Conferences/2026/AuthorGuide) | [ACL](https://github.com/acl-org/acl-style-files)
980
+
981
+ **Systems Venues:** See the [systems-paper-writing](../systems-paper-writing/) skill for OSDI, NSDI, ASPLOS, SOSP links and guides
982
+