@r1z4x/tezgah 1.0.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (582) hide show
  1. package/CHANGELOG.md +738 -0
  2. package/LICENSE +21 -0
  3. package/MANIFEST +753 -0
  4. package/README.de.md +169 -0
  5. package/README.es.md +168 -0
  6. package/README.fr.md +166 -0
  7. package/README.md +161 -0
  8. package/README.tr.md +163 -0
  9. package/agents/tezgah-reviewer.md +70 -0
  10. package/bin/codegen +337 -0
  11. package/bin/consult +797 -0
  12. package/bin/tezgah-adhd +50 -0
  13. package/bin/tezgah-agents +45 -0
  14. package/bin/tezgah-capture +66 -0
  15. package/bin/tezgah-context +96 -0
  16. package/bin/tezgah-decisions +213 -0
  17. package/bin/tezgah-design +953 -0
  18. package/bin/tezgah-docs +1199 -0
  19. package/bin/tezgah-doctor +497 -0
  20. package/bin/tezgah-dsh +37 -0
  21. package/bin/tezgah-dsh.cmd +70 -0
  22. package/bin/tezgah-gate +75 -0
  23. package/bin/tezgah-import-ai-research +439 -0
  24. package/bin/tezgah-index +32 -0
  25. package/bin/tezgah-lessons +148 -0
  26. package/bin/tezgah-mcp +322 -0
  27. package/bin/tezgah-migrate +324 -0
  28. package/bin/tezgah-pony +50 -0
  29. package/bin/tezgah-research +772 -0
  30. package/bin/tezgah-rollback +93 -0
  31. package/bin/tezgah-route +124 -0
  32. package/bin/tezgah-setup +5798 -0
  33. package/bin/tezgah-status +383 -0
  34. package/bin/tezgah-task +607 -0
  35. package/bin/tezgah-taste +423 -0
  36. package/bin/tezgah-triage +485 -0
  37. package/bin/tezgah.js +36 -0
  38. package/commands/adhd.md +21 -0
  39. package/commands/ponytail.md +21 -0
  40. package/docs/README.md +112 -0
  41. package/docs/architecture.md +226 -0
  42. package/docs/citations-baseline.json +59 -0
  43. package/docs/clarity-baseline.json +116 -0
  44. package/docs/contract.md +416 -0
  45. package/docs/environment.md +141 -0
  46. package/docs/evidence.md +831 -0
  47. package/docs/feature-audit.md +139 -0
  48. package/docs/gate.md +407 -0
  49. package/docs/glossary.md +201 -0
  50. package/docs/hosts.md +400 -0
  51. package/docs/index.json +471 -0
  52. package/docs/judge.md +193 -0
  53. package/docs/layers.md +189 -0
  54. package/docs/models.md +160 -0
  55. package/docs/operations.md +666 -0
  56. package/docs/research.md +809 -0
  57. package/docs/results/paired-outcome-2026-10.jsonl +254 -0
  58. package/docs/results/paired-outcome-2026-10.md +204 -0
  59. package/docs/skills.md +236 -0
  60. package/docs/status-line.md +315 -0
  61. package/docs/testing.md +287 -0
  62. package/docs/vision.md +117 -0
  63. package/hooks/hooks.json +33 -0
  64. package/hooks/projects-auto-init.py +98 -0
  65. package/hooks/projects-posttooluse.py +149 -0
  66. package/hooks/projects-pretooluse.py +40 -0
  67. package/hooks/projects-stop.py +60 -0
  68. package/hooks/tezgah_agents.py +817 -0
  69. package/hooks/tezgah_apps.py +266 -0
  70. package/hooks/tezgah_attest.py +255 -0
  71. package/hooks/tezgah_clarity.py +171 -0
  72. package/hooks/tezgah_components.py +140 -0
  73. package/hooks/tezgah_context.py +2953 -0
  74. package/hooks/tezgah_embed.py +765 -0
  75. package/hooks/tezgah_gate.py +2736 -0
  76. package/hooks/tezgah_guard.py +177 -0
  77. package/hooks/tezgah_index.py +124 -0
  78. package/hooks/tezgah_integrity.py +5141 -0
  79. package/hooks/tezgah_judge.py +487 -0
  80. package/hooks/tezgah_lang.py +230 -0
  81. package/hooks/tezgah_lessons.py +210 -0
  82. package/hooks/tezgah_models.py +855 -0
  83. package/hooks/tezgah_paths.py +1132 -0
  84. package/hooks/tezgah_policy.py +1039 -0
  85. package/hooks/tezgah_rank.py +77 -0
  86. package/hooks/tezgah_replay.py +1109 -0
  87. package/hooks/tezgah_research.py +5176 -0
  88. package/hooks/tezgah_shapes.py +305 -0
  89. package/hooks/tezgah_skill_pick.py +227 -0
  90. package/hooks/tezgah_snapshot.py +490 -0
  91. package/hooks/tezgah_stopspec.py +320 -0
  92. package/hooks/tezgah_task.py +458 -0
  93. package/hooks/tezgah_taste.py +201 -0
  94. package/hooks/tezgah_untrusted.py +112 -0
  95. package/hooks/tezgah_update.py +430 -0
  96. package/hosts/codex/hook.py +268 -0
  97. package/hosts/codex/hooks.json +26 -0
  98. package/hosts/cursor/hook.py +461 -0
  99. package/hosts/cursor/hooks.json +44 -0
  100. package/hosts/dsh/hooks.json +21 -0
  101. package/hosts/dsh/statusline/lib/client.js +138 -0
  102. package/hosts/dsh/statusline/lib/index.js +104 -0
  103. package/hosts/dsh/statusline/package.json +28 -0
  104. package/hosts/omp/hook.py +277 -0
  105. package/hosts/omp/tezgah-hook.ts.in +701 -0
  106. package/hosts/opencode/plugins/tezgah.js +2742 -0
  107. package/hosts/opencode/tui/tezgah-tui.tsx +151 -0
  108. package/output-styles/tezgah.md +142 -0
  109. package/package.json +32 -0
  110. package/packaging/build.sh +342 -0
  111. package/packaging/install.ps1 +166 -0
  112. package/packaging/install.sh +56 -0
  113. package/packaging/upgrade.sh +142 -0
  114. package/skills/ai-research/0-autoresearch-skill/SKILL.md +411 -0
  115. package/skills/ai-research/0-autoresearch-skill/references/agent-continuity.md +95 -0
  116. package/skills/ai-research/0-autoresearch-skill/references/progress-reporting.md +166 -0
  117. package/skills/ai-research/0-autoresearch-skill/references/skill-routing.md +219 -0
  118. package/skills/ai-research/0-autoresearch-skill/templates/findings.md +44 -0
  119. package/skills/ai-research/0-autoresearch-skill/templates/research-log.md +41 -0
  120. package/skills/ai-research/01-model-architecture/litgpt/SKILL.md +469 -0
  121. package/skills/ai-research/01-model-architecture/litgpt/references/custom-models.md +569 -0
  122. package/skills/ai-research/01-model-architecture/litgpt/references/distributed-training.md +452 -0
  123. package/skills/ai-research/01-model-architecture/litgpt/references/supported-models.md +337 -0
  124. package/skills/ai-research/01-model-architecture/litgpt/references/training-recipes.md +620 -0
  125. package/skills/ai-research/01-model-architecture/mamba/SKILL.md +260 -0
  126. package/skills/ai-research/01-model-architecture/mamba/references/architecture-details.md +207 -0
  127. package/skills/ai-research/01-model-architecture/mamba/references/benchmarks.md +256 -0
  128. package/skills/ai-research/01-model-architecture/mamba/references/training-guide.md +389 -0
  129. package/skills/ai-research/01-model-architecture/nanogpt/SKILL.md +290 -0
  130. package/skills/ai-research/01-model-architecture/nanogpt/references/architecture.md +383 -0
  131. package/skills/ai-research/01-model-architecture/nanogpt/references/data.md +477 -0
  132. package/skills/ai-research/01-model-architecture/nanogpt/references/training.md +565 -0
  133. package/skills/ai-research/01-model-architecture/rwkv/SKILL.md +260 -0
  134. package/skills/ai-research/01-model-architecture/rwkv/references/architecture-details.md +345 -0
  135. package/skills/ai-research/01-model-architecture/rwkv/references/rwkv7.md +387 -0
  136. package/skills/ai-research/01-model-architecture/rwkv/references/state-management.md +370 -0
  137. package/skills/ai-research/01-model-architecture/torchtitan/SKILL.md +358 -0
  138. package/skills/ai-research/01-model-architecture/torchtitan/references/checkpoint.md +182 -0
  139. package/skills/ai-research/01-model-architecture/torchtitan/references/custom-models.md +259 -0
  140. package/skills/ai-research/01-model-architecture/torchtitan/references/float8.md +134 -0
  141. package/skills/ai-research/01-model-architecture/torchtitan/references/fsdp.md +127 -0
  142. package/skills/ai-research/02-tokenization/huggingface-tokenizers/SKILL.md +516 -0
  143. package/skills/ai-research/02-tokenization/huggingface-tokenizers/references/algorithms.md +654 -0
  144. package/skills/ai-research/02-tokenization/huggingface-tokenizers/references/integration.md +638 -0
  145. package/skills/ai-research/02-tokenization/huggingface-tokenizers/references/pipeline.md +724 -0
  146. package/skills/ai-research/02-tokenization/huggingface-tokenizers/references/training.md +566 -0
  147. package/skills/ai-research/02-tokenization/sentencepiece/SKILL.md +235 -0
  148. package/skills/ai-research/02-tokenization/sentencepiece/references/algorithms.md +201 -0
  149. package/skills/ai-research/02-tokenization/sentencepiece/references/training.md +305 -0
  150. package/skills/ai-research/03-fine-tuning/axolotl/SKILL.md +158 -0
  151. package/skills/ai-research/03-fine-tuning/axolotl/references/api.md +5549 -0
  152. package/skills/ai-research/03-fine-tuning/axolotl/references/dataset-formats.md +1030 -0
  153. package/skills/ai-research/03-fine-tuning/axolotl/references/index.md +16 -0
  154. package/skills/ai-research/03-fine-tuning/axolotl/references/other.md +3564 -0
  155. package/skills/ai-research/03-fine-tuning/llama-factory/SKILL.md +80 -0
  156. package/skills/ai-research/03-fine-tuning/llama-factory/references/_images.md +24 -0
  157. package/skills/ai-research/03-fine-tuning/llama-factory/references/advanced.md +1056 -0
  158. package/skills/ai-research/03-fine-tuning/llama-factory/references/getting_started.md +350 -0
  159. package/skills/ai-research/03-fine-tuning/llama-factory/references/index.md +20 -0
  160. package/skills/ai-research/03-fine-tuning/llama-factory/references/other.md +32 -0
  161. package/skills/ai-research/03-fine-tuning/peft/SKILL.md +431 -0
  162. package/skills/ai-research/03-fine-tuning/peft/references/advanced-usage.md +515 -0
  163. package/skills/ai-research/03-fine-tuning/peft/references/troubleshooting.md +481 -0
  164. package/skills/ai-research/03-fine-tuning/unsloth/SKILL.md +80 -0
  165. package/skills/ai-research/03-fine-tuning/unsloth/references/index.md +8 -0
  166. package/skills/ai-research/03-fine-tuning/unsloth/references/llms.md +83 -0
  167. package/skills/ai-research/04-mechanistic-interpretability/nnsight/SKILL.md +436 -0
  168. package/skills/ai-research/04-mechanistic-interpretability/nnsight/references/README.md +79 -0
  169. package/skills/ai-research/04-mechanistic-interpretability/nnsight/references/api.md +345 -0
  170. package/skills/ai-research/04-mechanistic-interpretability/nnsight/references/tutorials.md +301 -0
  171. package/skills/ai-research/04-mechanistic-interpretability/pyvene/SKILL.md +473 -0
  172. package/skills/ai-research/04-mechanistic-interpretability/pyvene/references/README.md +74 -0
  173. package/skills/ai-research/04-mechanistic-interpretability/pyvene/references/api.md +384 -0
  174. package/skills/ai-research/04-mechanistic-interpretability/pyvene/references/tutorials.md +377 -0
  175. package/skills/ai-research/04-mechanistic-interpretability/saelens/SKILL.md +386 -0
  176. package/skills/ai-research/04-mechanistic-interpretability/saelens/references/README.md +71 -0
  177. package/skills/ai-research/04-mechanistic-interpretability/saelens/references/api.md +334 -0
  178. package/skills/ai-research/04-mechanistic-interpretability/saelens/references/tutorials.md +319 -0
  179. package/skills/ai-research/04-mechanistic-interpretability/transformer-lens/SKILL.md +346 -0
  180. package/skills/ai-research/04-mechanistic-interpretability/transformer-lens/references/README.md +55 -0
  181. package/skills/ai-research/04-mechanistic-interpretability/transformer-lens/references/api.md +363 -0
  182. package/skills/ai-research/04-mechanistic-interpretability/transformer-lens/references/tutorials.md +340 -0
  183. package/skills/ai-research/05-data-processing/nemo-curator/SKILL.md +383 -0
  184. package/skills/ai-research/05-data-processing/nemo-curator/references/deduplication.md +88 -0
  185. package/skills/ai-research/05-data-processing/nemo-curator/references/filtering.md +103 -0
  186. package/skills/ai-research/05-data-processing/ray-data/SKILL.md +326 -0
  187. package/skills/ai-research/05-data-processing/ray-data/references/integration.md +83 -0
  188. package/skills/ai-research/05-data-processing/ray-data/references/transformations.md +84 -0
  189. package/skills/ai-research/06-post-training/grpo-rl-training/README.md +98 -0
  190. package/skills/ai-research/06-post-training/grpo-rl-training/SKILL.md +572 -0
  191. package/skills/ai-research/06-post-training/miles/SKILL.md +315 -0
  192. package/skills/ai-research/06-post-training/miles/references/api-reference.md +142 -0
  193. package/skills/ai-research/06-post-training/miles/references/troubleshooting.md +353 -0
  194. package/skills/ai-research/06-post-training/openrlhf/SKILL.md +249 -0
  195. package/skills/ai-research/06-post-training/openrlhf/references/algorithm-comparison.md +405 -0
  196. package/skills/ai-research/06-post-training/openrlhf/references/custom-rewards.md +531 -0
  197. package/skills/ai-research/06-post-training/openrlhf/references/hybrid-engine.md +288 -0
  198. package/skills/ai-research/06-post-training/openrlhf/references/multi-node-training.md +455 -0
  199. package/skills/ai-research/06-post-training/simpo/SKILL.md +219 -0
  200. package/skills/ai-research/06-post-training/simpo/references/datasets.md +479 -0
  201. package/skills/ai-research/06-post-training/simpo/references/hyperparameters.md +453 -0
  202. package/skills/ai-research/06-post-training/simpo/references/loss-functions.md +351 -0
  203. package/skills/ai-research/06-post-training/slime/SKILL.md +464 -0
  204. package/skills/ai-research/06-post-training/slime/references/api-reference.md +393 -0
  205. package/skills/ai-research/06-post-training/slime/references/troubleshooting.md +387 -0
  206. package/skills/ai-research/06-post-training/torchforge/SKILL.md +433 -0
  207. package/skills/ai-research/06-post-training/torchforge/references/api-reference.md +328 -0
  208. package/skills/ai-research/06-post-training/torchforge/references/troubleshooting.md +410 -0
  209. package/skills/ai-research/06-post-training/trl-fine-tuning/SKILL.md +455 -0
  210. package/skills/ai-research/06-post-training/trl-fine-tuning/references/dpo-variants.md +228 -0
  211. package/skills/ai-research/06-post-training/trl-fine-tuning/references/online-rl.md +83 -0
  212. package/skills/ai-research/06-post-training/trl-fine-tuning/references/reward-modeling.md +123 -0
  213. package/skills/ai-research/06-post-training/trl-fine-tuning/references/sft-training.md +169 -0
  214. package/skills/ai-research/06-post-training/verl/SKILL.md +391 -0
  215. package/skills/ai-research/06-post-training/verl/references/api-reference.md +302 -0
  216. package/skills/ai-research/06-post-training/verl/references/troubleshooting.md +392 -0
  217. package/skills/ai-research/07-safety-alignment/constitutional-ai/SKILL.md +290 -0
  218. package/skills/ai-research/07-safety-alignment/llamaguard/SKILL.md +337 -0
  219. package/skills/ai-research/07-safety-alignment/nemo-guardrails/SKILL.md +297 -0
  220. package/skills/ai-research/07-safety-alignment/prompt-guard/SKILL.md +312 -0
  221. package/skills/ai-research/08-distributed-training/accelerate/SKILL.md +332 -0
  222. package/skills/ai-research/08-distributed-training/accelerate/references/custom-plugins.md +454 -0
  223. package/skills/ai-research/08-distributed-training/accelerate/references/megatron-integration.md +490 -0
  224. package/skills/ai-research/08-distributed-training/accelerate/references/performance.md +526 -0
  225. package/skills/ai-research/08-distributed-training/deepspeed/SKILL.md +141 -0
  226. package/skills/ai-research/08-distributed-training/deepspeed/references/08.md +18 -0
  227. package/skills/ai-research/08-distributed-training/deepspeed/references/09.md +174 -0
  228. package/skills/ai-research/08-distributed-training/deepspeed/references/2020.md +379 -0
  229. package/skills/ai-research/08-distributed-training/deepspeed/references/2023.md +280 -0
  230. package/skills/ai-research/08-distributed-training/deepspeed/references/assets.md +180 -0
  231. package/skills/ai-research/08-distributed-training/deepspeed/references/index.md +36 -0
  232. package/skills/ai-research/08-distributed-training/deepspeed/references/mii.md +119 -0
  233. package/skills/ai-research/08-distributed-training/deepspeed/references/other.md +1192 -0
  234. package/skills/ai-research/08-distributed-training/megatron-core/SKILL.md +366 -0
  235. package/skills/ai-research/08-distributed-training/megatron-core/references/benchmarks.md +250 -0
  236. package/skills/ai-research/08-distributed-training/megatron-core/references/parallelism-guide.md +405 -0
  237. package/skills/ai-research/08-distributed-training/megatron-core/references/production-examples.md +474 -0
  238. package/skills/ai-research/08-distributed-training/megatron-core/references/training-recipes.md +548 -0
  239. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/SKILL.md +231 -0
  240. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_dcp_async_recipe.md +14 -0
  241. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_dcp_overview.md +19 -0
  242. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_dcp_recipe.md +18 -0
  243. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_ddp_notes.md +10 -0
  244. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_device_mesh_tutorial.md +22 -0
  245. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_examples_fsdp2.md +15 -0
  246. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_fsdp1_api.md +9 -0
  247. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_fsdp2_tutorial.md +45 -0
  248. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_fully_shard_api.md +49 -0
  249. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_tp_tutorial.md +22 -0
  250. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/ray_train_fsdp2_example.md +13 -0
  251. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/torchtitan_fsdp_notes.md +14 -0
  252. package/skills/ai-research/08-distributed-training/pytorch-lightning/SKILL.md +346 -0
  253. package/skills/ai-research/08-distributed-training/pytorch-lightning/references/callbacks.md +437 -0
  254. package/skills/ai-research/08-distributed-training/pytorch-lightning/references/distributed.md +491 -0
  255. package/skills/ai-research/08-distributed-training/pytorch-lightning/references/hyperparameter-tuning.md +557 -0
  256. package/skills/ai-research/08-distributed-training/ray-train/SKILL.md +406 -0
  257. package/skills/ai-research/08-distributed-training/ray-train/references/multi-node.md +629 -0
  258. package/skills/ai-research/09-infrastructure/lambda-labs/SKILL.md +545 -0
  259. package/skills/ai-research/09-infrastructure/lambda-labs/references/advanced-usage.md +612 -0
  260. package/skills/ai-research/09-infrastructure/lambda-labs/references/troubleshooting.md +531 -0
  261. package/skills/ai-research/09-infrastructure/modal/SKILL.md +341 -0
  262. package/skills/ai-research/09-infrastructure/modal/references/advanced-usage.md +504 -0
  263. package/skills/ai-research/09-infrastructure/modal/references/troubleshooting.md +495 -0
  264. package/skills/ai-research/09-infrastructure/skypilot/SKILL.md +509 -0
  265. package/skills/ai-research/09-infrastructure/skypilot/references/advanced-usage.md +492 -0
  266. package/skills/ai-research/09-infrastructure/skypilot/references/troubleshooting.md +571 -0
  267. package/skills/ai-research/10-optimization/awq/SKILL.md +310 -0
  268. package/skills/ai-research/10-optimization/awq/references/advanced-usage.md +325 -0
  269. package/skills/ai-research/10-optimization/awq/references/troubleshooting.md +345 -0
  270. package/skills/ai-research/10-optimization/bitsandbytes/SKILL.md +411 -0
  271. package/skills/ai-research/10-optimization/bitsandbytes/references/memory-optimization.md +522 -0
  272. package/skills/ai-research/10-optimization/bitsandbytes/references/qlora-training.md +522 -0
  273. package/skills/ai-research/10-optimization/bitsandbytes/references/quantization-formats.md +448 -0
  274. package/skills/ai-research/10-optimization/flash-attention/SKILL.md +367 -0
  275. package/skills/ai-research/10-optimization/flash-attention/references/benchmarks.md +216 -0
  276. package/skills/ai-research/10-optimization/flash-attention/references/transformers-integration.md +294 -0
  277. package/skills/ai-research/10-optimization/gguf/SKILL.md +427 -0
  278. package/skills/ai-research/10-optimization/gguf/references/advanced-usage.md +505 -0
  279. package/skills/ai-research/10-optimization/gguf/references/troubleshooting.md +443 -0
  280. package/skills/ai-research/10-optimization/gptq/SKILL.md +450 -0
  281. package/skills/ai-research/10-optimization/gptq/references/calibration.md +338 -0
  282. package/skills/ai-research/10-optimization/gptq/references/integration.md +130 -0
  283. package/skills/ai-research/10-optimization/gptq/references/troubleshooting.md +96 -0
  284. package/skills/ai-research/10-optimization/hqq/SKILL.md +445 -0
  285. package/skills/ai-research/10-optimization/hqq/references/advanced-usage.md +529 -0
  286. package/skills/ai-research/10-optimization/hqq/references/troubleshooting.md +504 -0
  287. package/skills/ai-research/10-optimization/ml-training-recipes/SKILL.md +319 -0
  288. package/skills/ai-research/10-optimization/ml-training-recipes/references/architecture.md +320 -0
  289. package/skills/ai-research/10-optimization/ml-training-recipes/references/biomedical.md +498 -0
  290. package/skills/ai-research/10-optimization/ml-training-recipes/references/domain-specific.md +626 -0
  291. package/skills/ai-research/10-optimization/ml-training-recipes/references/experiment-loop.md +129 -0
  292. package/skills/ai-research/10-optimization/ml-training-recipes/references/optimizers.md +330 -0
  293. package/skills/ai-research/10-optimization/ml-training-recipes/references/scaling-and-selection.md +428 -0
  294. package/skills/ai-research/11-evaluation/bigcode-evaluation-harness/SKILL.md +405 -0
  295. package/skills/ai-research/11-evaluation/bigcode-evaluation-harness/references/benchmarks.md +394 -0
  296. package/skills/ai-research/11-evaluation/bigcode-evaluation-harness/references/custom-tasks.md +425 -0
  297. package/skills/ai-research/11-evaluation/bigcode-evaluation-harness/references/issues.md +395 -0
  298. package/skills/ai-research/11-evaluation/lm-evaluation-harness/SKILL.md +490 -0
  299. package/skills/ai-research/11-evaluation/lm-evaluation-harness/references/api-evaluation.md +491 -0
  300. package/skills/ai-research/11-evaluation/lm-evaluation-harness/references/benchmark-guide.md +489 -0
  301. package/skills/ai-research/11-evaluation/lm-evaluation-harness/references/custom-tasks.md +603 -0
  302. package/skills/ai-research/11-evaluation/lm-evaluation-harness/references/distributed-eval.md +520 -0
  303. package/skills/ai-research/11-evaluation/nemo-evaluator/SKILL.md +494 -0
  304. package/skills/ai-research/11-evaluation/nemo-evaluator/references/adapter-system.md +341 -0
  305. package/skills/ai-research/11-evaluation/nemo-evaluator/references/configuration.md +448 -0
  306. package/skills/ai-research/11-evaluation/nemo-evaluator/references/custom-benchmarks.md +316 -0
  307. package/skills/ai-research/11-evaluation/nemo-evaluator/references/execution-backends.md +362 -0
  308. package/skills/ai-research/12-inference-serving/llama-cpp/SKILL.md +258 -0
  309. package/skills/ai-research/12-inference-serving/llama-cpp/references/optimization.md +90 -0
  310. package/skills/ai-research/12-inference-serving/llama-cpp/references/quantization.md +214 -0
  311. package/skills/ai-research/12-inference-serving/llama-cpp/references/server.md +126 -0
  312. package/skills/ai-research/12-inference-serving/sglang/SKILL.md +442 -0
  313. package/skills/ai-research/12-inference-serving/sglang/references/deployment.md +491 -0
  314. package/skills/ai-research/12-inference-serving/sglang/references/radix-attention.md +414 -0
  315. package/skills/ai-research/12-inference-serving/sglang/references/structured-generation.md +542 -0
  316. package/skills/ai-research/12-inference-serving/tensorrt-llm/SKILL.md +187 -0
  317. package/skills/ai-research/12-inference-serving/tensorrt-llm/references/multi-gpu.md +299 -0
  318. package/skills/ai-research/12-inference-serving/tensorrt-llm/references/optimization.md +243 -0
  319. package/skills/ai-research/12-inference-serving/tensorrt-llm/references/serving.md +471 -0
  320. package/skills/ai-research/12-inference-serving/vllm/SKILL.md +364 -0
  321. package/skills/ai-research/12-inference-serving/vllm/references/optimization.md +227 -0
  322. package/skills/ai-research/12-inference-serving/vllm/references/quantization.md +285 -0
  323. package/skills/ai-research/12-inference-serving/vllm/references/server-deployment.md +256 -0
  324. package/skills/ai-research/12-inference-serving/vllm/references/troubleshooting.md +448 -0
  325. package/skills/ai-research/13-mlops/mlflow/SKILL.md +704 -0
  326. package/skills/ai-research/13-mlops/mlflow/references/deployment.md +745 -0
  327. package/skills/ai-research/13-mlops/mlflow/references/model-registry.md +771 -0
  328. package/skills/ai-research/13-mlops/mlflow/references/tracking.md +681 -0
  329. package/skills/ai-research/13-mlops/swanlab/SKILL.md +406 -0
  330. package/skills/ai-research/13-mlops/swanlab/references/integrations.md +305 -0
  331. package/skills/ai-research/13-mlops/swanlab/references/visualization.md +234 -0
  332. package/skills/ai-research/13-mlops/tensorboard/SKILL.md +629 -0
  333. package/skills/ai-research/13-mlops/tensorboard/references/integrations.md +639 -0
  334. package/skills/ai-research/13-mlops/tensorboard/references/profiling.md +546 -0
  335. package/skills/ai-research/13-mlops/tensorboard/references/visualization.md +621 -0
  336. package/skills/ai-research/13-mlops/weights-and-biases/SKILL.md +590 -0
  337. package/skills/ai-research/13-mlops/weights-and-biases/references/artifacts.md +585 -0
  338. package/skills/ai-research/13-mlops/weights-and-biases/references/integrations.md +701 -0
  339. package/skills/ai-research/13-mlops/weights-and-biases/references/sweeps.md +848 -0
  340. package/skills/ai-research/14-agents/a-evolve/SKILL.md +383 -0
  341. package/skills/ai-research/14-agents/a-evolve/references/README.md +831 -0
  342. package/skills/ai-research/14-agents/a-evolve/references/api.md +594 -0
  343. package/skills/ai-research/14-agents/a-evolve/references/architecture.md +417 -0
  344. package/skills/ai-research/14-agents/a-evolve/references/design-patterns.md +462 -0
  345. package/skills/ai-research/14-agents/a-evolve/references/examples.md +352 -0
  346. package/skills/ai-research/14-agents/a-evolve/references/issues.md +591 -0
  347. package/skills/ai-research/14-agents/a-evolve/references/releases.md +112 -0
  348. package/skills/ai-research/14-agents/a-evolve/references/tutorials.md +819 -0
  349. package/skills/ai-research/14-agents/autogpt/SKILL.md +403 -0
  350. package/skills/ai-research/14-agents/autogpt/references/advanced-usage.md +536 -0
  351. package/skills/ai-research/14-agents/autogpt/references/troubleshooting.md +421 -0
  352. package/skills/ai-research/14-agents/crewai/SKILL.md +498 -0
  353. package/skills/ai-research/14-agents/crewai/references/flows.md +439 -0
  354. package/skills/ai-research/14-agents/crewai/references/tools.md +430 -0
  355. package/skills/ai-research/14-agents/crewai/references/troubleshooting.md +481 -0
  356. package/skills/ai-research/14-agents/langchain/SKILL.md +480 -0
  357. package/skills/ai-research/14-agents/langchain/references/agents.md +500 -0
  358. package/skills/ai-research/14-agents/langchain/references/integration.md +563 -0
  359. package/skills/ai-research/14-agents/langchain/references/rag.md +601 -0
  360. package/skills/ai-research/14-agents/llamaindex/SKILL.md +569 -0
  361. package/skills/ai-research/14-agents/llamaindex/references/agents.md +84 -0
  362. package/skills/ai-research/14-agents/llamaindex/references/data_connectors.md +109 -0
  363. package/skills/ai-research/14-agents/llamaindex/references/query_engines.md +407 -0
  364. package/skills/ai-research/15-rag/chroma/SKILL.md +406 -0
  365. package/skills/ai-research/15-rag/chroma/references/integration.md +39 -0
  366. package/skills/ai-research/15-rag/faiss/SKILL.md +221 -0
  367. package/skills/ai-research/15-rag/faiss/references/index_types.md +281 -0
  368. package/skills/ai-research/15-rag/pinecone/SKILL.md +358 -0
  369. package/skills/ai-research/15-rag/pinecone/references/deployment.md +182 -0
  370. package/skills/ai-research/15-rag/qdrant/SKILL.md +493 -0
  371. package/skills/ai-research/15-rag/qdrant/references/advanced-usage.md +649 -0
  372. package/skills/ai-research/15-rag/qdrant/references/troubleshooting.md +632 -0
  373. package/skills/ai-research/15-rag/sentence-transformers/SKILL.md +255 -0
  374. package/skills/ai-research/15-rag/sentence-transformers/references/models.md +124 -0
  375. package/skills/ai-research/16-prompt-engineering/dspy/SKILL.md +590 -0
  376. package/skills/ai-research/16-prompt-engineering/dspy/references/examples.md +664 -0
  377. package/skills/ai-research/16-prompt-engineering/dspy/references/modules.md +476 -0
  378. package/skills/ai-research/16-prompt-engineering/dspy/references/optimizers.md +567 -0
  379. package/skills/ai-research/16-prompt-engineering/guidance/SKILL.md +572 -0
  380. package/skills/ai-research/16-prompt-engineering/guidance/references/backends.md +555 -0
  381. package/skills/ai-research/16-prompt-engineering/guidance/references/constraints.md +675 -0
  382. package/skills/ai-research/16-prompt-engineering/guidance/references/examples.md +768 -0
  383. package/skills/ai-research/16-prompt-engineering/instructor/SKILL.md +740 -0
  384. package/skills/ai-research/16-prompt-engineering/instructor/references/examples.md +108 -0
  385. package/skills/ai-research/16-prompt-engineering/instructor/references/providers.md +71 -0
  386. package/skills/ai-research/16-prompt-engineering/instructor/references/validation.md +607 -0
  387. package/skills/ai-research/16-prompt-engineering/outlines/SKILL.md +652 -0
  388. package/skills/ai-research/16-prompt-engineering/outlines/references/backends.md +616 -0
  389. package/skills/ai-research/16-prompt-engineering/outlines/references/examples.md +774 -0
  390. package/skills/ai-research/16-prompt-engineering/outlines/references/json_generation.md +653 -0
  391. package/skills/ai-research/17-observability/langsmith/SKILL.md +422 -0
  392. package/skills/ai-research/17-observability/langsmith/references/advanced-usage.md +549 -0
  393. package/skills/ai-research/17-observability/langsmith/references/troubleshooting.md +538 -0
  394. package/skills/ai-research/17-observability/phoenix/SKILL.md +475 -0
  395. package/skills/ai-research/17-observability/phoenix/references/advanced-usage.md +620 -0
  396. package/skills/ai-research/17-observability/phoenix/references/troubleshooting.md +539 -0
  397. package/skills/ai-research/18-multimodal/audiocraft/SKILL.md +564 -0
  398. package/skills/ai-research/18-multimodal/audiocraft/references/advanced-usage.md +667 -0
  399. package/skills/ai-research/18-multimodal/audiocraft/references/troubleshooting.md +505 -0
  400. package/skills/ai-research/18-multimodal/blip-2/SKILL.md +564 -0
  401. package/skills/ai-research/18-multimodal/blip-2/references/advanced-usage.md +681 -0
  402. package/skills/ai-research/18-multimodal/blip-2/references/troubleshooting.md +527 -0
  403. package/skills/ai-research/18-multimodal/clip/SKILL.md +253 -0
  404. package/skills/ai-research/18-multimodal/clip/references/applications.md +208 -0
  405. package/skills/ai-research/18-multimodal/cosmos-policy/SKILL.md +402 -0
  406. package/skills/ai-research/18-multimodal/cosmos-policy/references/libero-commands.md +175 -0
  407. package/skills/ai-research/18-multimodal/cosmos-policy/references/robocasa-commands.md +147 -0
  408. package/skills/ai-research/18-multimodal/llava/SKILL.md +304 -0
  409. package/skills/ai-research/18-multimodal/llava/references/training.md +198 -0
  410. package/skills/ai-research/18-multimodal/openpi/SKILL.md +480 -0
  411. package/skills/ai-research/18-multimodal/openpi/references/checkpoints-and-env-map.md +86 -0
  412. package/skills/ai-research/18-multimodal/openpi/references/config-recipes.md +50 -0
  413. package/skills/ai-research/18-multimodal/openpi/references/pytorch-gotchas.md +49 -0
  414. package/skills/ai-research/18-multimodal/openpi/references/remote-client-pattern.md +48 -0
  415. package/skills/ai-research/18-multimodal/openpi/references/training-debugging.md +46 -0
  416. package/skills/ai-research/18-multimodal/openvla-oft/SKILL.md +441 -0
  417. package/skills/ai-research/18-multimodal/openvla-oft/references/aloha-workflow.md +141 -0
  418. package/skills/ai-research/18-multimodal/openvla-oft/references/config-troubleshooting.md +97 -0
  419. package/skills/ai-research/18-multimodal/openvla-oft/references/libero-workflow.md +115 -0
  420. package/skills/ai-research/18-multimodal/openvla-oft/references/paper-and-checkpoints.md +84 -0
  421. package/skills/ai-research/18-multimodal/segment-anything/SKILL.md +500 -0
  422. package/skills/ai-research/18-multimodal/segment-anything/references/advanced-usage.md +590 -0
  423. package/skills/ai-research/18-multimodal/segment-anything/references/troubleshooting.md +485 -0
  424. package/skills/ai-research/18-multimodal/stable-diffusion/SKILL.md +519 -0
  425. package/skills/ai-research/18-multimodal/stable-diffusion/references/advanced-usage.md +717 -0
  426. package/skills/ai-research/18-multimodal/stable-diffusion/references/troubleshooting.md +556 -0
  427. package/skills/ai-research/18-multimodal/whisper/SKILL.md +317 -0
  428. package/skills/ai-research/18-multimodal/whisper/references/languages.md +190 -0
  429. package/skills/ai-research/19-emerging-techniques/knowledge-distillation/SKILL.md +458 -0
  430. package/skills/ai-research/19-emerging-techniques/knowledge-distillation/references/minillm.md +335 -0
  431. package/skills/ai-research/19-emerging-techniques/long-context/SKILL.md +536 -0
  432. package/skills/ai-research/19-emerging-techniques/long-context/references/extension_methods.md +469 -0
  433. package/skills/ai-research/19-emerging-techniques/long-context/references/fine_tuning.md +612 -0
  434. package/skills/ai-research/19-emerging-techniques/long-context/references/rope.md +403 -0
  435. package/skills/ai-research/19-emerging-techniques/model-merging/SKILL.md +497 -0
  436. package/skills/ai-research/19-emerging-techniques/model-merging/references/coefficient-tuning.md +415 -0
  437. package/skills/ai-research/19-emerging-techniques/model-merging/references/evaluation.md +463 -0
  438. package/skills/ai-research/19-emerging-techniques/model-merging/references/examples.md +429 -0
  439. package/skills/ai-research/19-emerging-techniques/model-merging/references/methods.md +353 -0
  440. package/skills/ai-research/19-emerging-techniques/model-pruning/SKILL.md +495 -0
  441. package/skills/ai-research/19-emerging-techniques/model-pruning/references/wanda.md +348 -0
  442. package/skills/ai-research/19-emerging-techniques/moe-training/SKILL.md +526 -0
  443. package/skills/ai-research/19-emerging-techniques/moe-training/references/architectures.md +433 -0
  444. package/skills/ai-research/19-emerging-techniques/moe-training/references/inference.md +349 -0
  445. package/skills/ai-research/19-emerging-techniques/moe-training/references/training.md +426 -0
  446. package/skills/ai-research/19-emerging-techniques/speculative-decoding/SKILL.md +467 -0
  447. package/skills/ai-research/19-emerging-techniques/speculative-decoding/references/lookahead.md +310 -0
  448. package/skills/ai-research/19-emerging-techniques/speculative-decoding/references/medusa.md +351 -0
  449. package/skills/ai-research/20-ml-paper-writing/academic-plotting/SKILL.md +479 -0
  450. package/skills/ai-research/20-ml-paper-writing/academic-plotting/references/data-visualization.md +509 -0
  451. package/skills/ai-research/20-ml-paper-writing/academic-plotting/references/diagram-generation.md +395 -0
  452. package/skills/ai-research/20-ml-paper-writing/academic-plotting/references/style-guide.md +305 -0
  453. package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/SKILL.md +982 -0
  454. package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/checklists.md +348 -0
  455. package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/citation-workflow.md +563 -0
  456. package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/reviewer-guidelines.md +349 -0
  457. package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/sources.md +165 -0
  458. package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/writing-guide.md +477 -0
  459. package/skills/ai-research/20-ml-paper-writing/presenting-conference-talks/SKILL.md +298 -0
  460. package/skills/ai-research/20-ml-paper-writing/presenting-conference-talks/references/slide-templates.md +505 -0
  461. package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/SKILL.md +270 -0
  462. package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/checklist.md +279 -0
  463. package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/reviewer-guidelines.md +116 -0
  464. package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/section-blueprints.md +400 -0
  465. package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/systems-conferences.md +261 -0
  466. package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/writing-patterns.md +231 -0
  467. package/skills/ai-research/21-research-ideation/brainstorming-research-ideas/SKILL.md +384 -0
  468. package/skills/ai-research/21-research-ideation/creative-thinking-for-research/SKILL.md +366 -0
  469. package/skills/ai-research/22-agent-native-research-artifact/compiler/SKILL.md +245 -0
  470. package/skills/ai-research/22-agent-native-research-artifact/compiler/references/ara-schema.md +439 -0
  471. package/skills/ai-research/22-agent-native-research-artifact/compiler/references/exploration-tree-spec.md +125 -0
  472. package/skills/ai-research/22-agent-native-research-artifact/compiler/references/validation-checklist.md +149 -0
  473. package/skills/ai-research/22-agent-native-research-artifact/research-manager/SKILL.md +324 -0
  474. package/skills/ai-research/22-agent-native-research-artifact/research-manager/references/event-taxonomy.md +124 -0
  475. package/skills/ai-research/22-agent-native-research-artifact/research-manager/references/provenance-tags.md +190 -0
  476. package/skills/ai-research/22-agent-native-research-artifact/research-manager/references/session-protocol.md +162 -0
  477. package/skills/ai-research/22-agent-native-research-artifact/rigor-reviewer/SKILL.md +322 -0
  478. package/skills/ai-research/22-agent-native-research-artifact/rigor-reviewer/references/review-dimensions.md +182 -0
  479. package/skills/ai-research/SKILL.md +101 -0
  480. package/skills/ai-research/SOURCE +38 -0
  481. package/skills/ai-research/index/1-frame.md +18 -0
  482. package/skills/ai-research/index/2-data.md +21 -0
  483. package/skills/ai-research/index/3-train.md +48 -0
  484. package/skills/ai-research/index/4-measure.md +25 -0
  485. package/skills/ai-research/index/5-run.md +23 -0
  486. package/skills/ai-research/index/6-write.md +35 -0
  487. package/skills/ai-research/library.json +3456 -0
  488. package/skills/analyze-app/EVALS.md +82 -0
  489. package/skills/analyze-app/SKILL.md +188 -0
  490. package/skills/design-contract/EVALS.md +80 -0
  491. package/skills/design-contract/SKILL.md +171 -0
  492. package/skills/design-library/EVALS.md +85 -0
  493. package/skills/design-library/INDEX.md +59 -0
  494. package/skills/design-library/SKILL.md +58 -0
  495. package/skills/design-library/SOURCE +131 -0
  496. package/skills/design-library/adaptive-interfaces/skills/colour-independence/SKILL.md +90 -0
  497. package/skills/design-library/adaptive-interfaces/skills/flexible-typography/SKILL.md +83 -0
  498. package/skills/design-library/adaptive-interfaces/skills/information-density/SKILL.md +87 -0
  499. package/skills/design-library/adaptive-interfaces/skills/preference-audit/SKILL.md +70 -0
  500. package/skills/design-library/adaptive-interfaces/skills/responsive-accessibility/SKILL.md +86 -0
  501. package/skills/design-library/adaptive-interfaces/skills/responsive-review/SKILL.md +76 -0
  502. package/skills/design-library/adaptive-interfaces/skills/simplified-views/SKILL.md +97 -0
  503. package/skills/design-library/adaptive-interfaces/skills/specify/SKILL.md +63 -0
  504. package/skills/design-library/adaptive-interfaces/skills/user-preference-respect/SKILL.md +100 -0
  505. package/skills/design-library/cognitive-accessibility/skills/adaptive-personalisation/SKILL.md +61 -0
  506. package/skills/design-library/cognitive-accessibility/skills/assess-load/SKILL.md +48 -0
  507. package/skills/design-library/cognitive-accessibility/skills/cognitive-load-assessment/SKILL.md +60 -0
  508. package/skills/design-library/cognitive-accessibility/skills/contextual-help-design/SKILL.md +61 -0
  509. package/skills/design-library/cognitive-accessibility/skills/error-prevention-recovery/SKILL.md +71 -0
  510. package/skills/design-library/cognitive-accessibility/skills/focus-attention-design/SKILL.md +67 -0
  511. package/skills/design-library/cognitive-accessibility/skills/memory-load-reduction/SKILL.md +60 -0
  512. package/skills/design-library/cognitive-accessibility/skills/plain-language-design/SKILL.md +78 -0
  513. package/skills/design-library/cognitive-accessibility/skills/review/SKILL.md +56 -0
  514. package/skills/design-library/cognitive-accessibility/skills/simplify/SKILL.md +39 -0
  515. package/skills/design-library/cognitive-accessibility/skills/wayfinding-navigation/SKILL.md +64 -0
  516. package/skills/design-library/design-research/skills/behavioural-analytics/SKILL.md +33 -0
  517. package/skills/design-library/design-research/skills/qual-quant-triangulation/SKILL.md +33 -0
  518. package/skills/design-library/inclusive-interaction/skills/audit/SKILL.md +50 -0
  519. package/skills/design-library/inclusive-interaction/skills/design-flow/SKILL.md +58 -0
  520. package/skills/design-library/inclusive-interaction/skills/feedback-and-status/SKILL.md +76 -0
  521. package/skills/design-library/inclusive-interaction/skills/gesture-alternatives/SKILL.md +70 -0
  522. package/skills/design-library/inclusive-interaction/skills/keyboard-navigation/SKILL.md +99 -0
  523. package/skills/design-library/inclusive-interaction/skills/keyboard-review/SKILL.md +54 -0
  524. package/skills/design-library/inclusive-interaction/skills/motion-sensitivity/SKILL.md +79 -0
  525. package/skills/design-library/inclusive-interaction/skills/multi-modal-input/SKILL.md +70 -0
  526. package/skills/design-library/inclusive-interaction/skills/touch-target-design/SKILL.md +71 -0
  527. package/skills/design-library/inclusive-interaction/skills/voice-interaction/SKILL.md +68 -0
  528. package/skills/design-library/visual-critique/skills/critique-affordance/SKILL.md +45 -0
  529. package/skills/design-library/visual-critique/skills/critique-brand-consistency/SKILL.md +42 -0
  530. package/skills/design-library/visual-critique/skills/critique-color/SKILL.md +44 -0
  531. package/skills/design-library/visual-critique/skills/critique-composition/SKILL.md +46 -0
  532. package/skills/design-library/visual-critique/skills/critique-information-density/SKILL.md +45 -0
  533. package/skills/design-library/visual-critique/skills/critique-typography/SKILL.md +45 -0
  534. package/skills/design-library/visual-critique/skills/critique-visual-hierarchy/SKILL.md +40 -0
  535. package/skills/feature-audit/EVALS.md +83 -0
  536. package/skills/feature-audit/SKILL.md +326 -0
  537. package/skills/harness/EVALS.md +81 -0
  538. package/skills/harness/SKILL.md +88 -0
  539. package/skills/i-have-adhd/EVALS.md +80 -0
  540. package/skills/i-have-adhd/SKILL.md +183 -0
  541. package/skills/no-ai-slop/EVALS.md +89 -0
  542. package/skills/no-ai-slop/SKILL.md +209 -0
  543. package/skills/no-ai-slop/eval.md +52 -0
  544. package/skills/plan-add/EVALS.md +79 -0
  545. package/skills/plan-add/SKILL.md +179 -0
  546. package/skills/plan-add/render_table.py +72 -0
  547. package/skills/plan-status/EVALS.md +78 -0
  548. package/skills/plan-status/SKILL.md +52 -0
  549. package/skills/plan-sync/EVALS.md +80 -0
  550. package/skills/plan-sync/SKILL.md +69 -0
  551. package/skills/pm-frameworks/SKILL.md +33 -0
  552. package/skills/pm-frameworks/SOURCE +39 -0
  553. package/skills/pm-frameworks/intended-vs-implemented/SKILL.md +42 -0
  554. package/skills/pm-frameworks/opportunity-solution-tree/SKILL.md +64 -0
  555. package/skills/ponytail/EVALS.md +80 -0
  556. package/skills/ponytail/SKILL.md +124 -0
  557. package/skills/product-analysis/EVALS.md +103 -0
  558. package/skills/product-analysis/SKILL.md +361 -0
  559. package/skills/research/EVALS.md +104 -0
  560. package/skills/research/SKILL.md +570 -0
  561. package/skills/rl-env/SKILL.md +53 -0
  562. package/skills/rl-env/SOURCE +41 -0
  563. package/skills/rl-env/generate-nemo-gym-env/SKILL.md +169 -0
  564. package/skills/rl-env/generate-nemo-gym-env/references/architecture.md +114 -0
  565. package/skills/rl-env/generate-openenv-env/SKILL.md +183 -0
  566. package/skills/rl-env/generate-openenv-env/references/architecture.md +82 -0
  567. package/skills/rl-env/generate-ors-env/SKILL.md +209 -0
  568. package/skills/rl-env/generate-ors-env/references/architecture.md +113 -0
  569. package/skills/rl-env/generate-verifiers-env/SKILL.md +188 -0
  570. package/skills/rl-env/generate-verifiers-env/references/architecture.md +119 -0
  571. package/skills/rl-env/rl-env-from-description/SKILL.md +124 -0
  572. package/skills/rl-env/rl-env-from-description/references/interview.md +75 -0
  573. package/skills/rl-env/rl-env-from-description/references/nemo_gym.md +41 -0
  574. package/skills/rl-env/rl-env-from-description/references/openenv.md +35 -0
  575. package/skills/rl-env/rl-env-from-description/references/ors.md +50 -0
  576. package/skills/rl-env/rl-env-from-description/references/verifiers.md +39 -0
  577. package/skills/tezgah-contract/EVALS.md +78 -0
  578. package/skills/tezgah-contract/SKILL.md +792 -0
  579. package/statusline.py +129 -0
  580. package/workflows/graph-impact.js +153 -0
  581. package/workflows/graph-map.js +158 -0
  582. package/workflows/graph-review.js +170 -0
@@ -0,0 +1,270 @@
1
+ ---
2
+ name: systems-paper-writing
3
+ description: Comprehensive guide for writing systems papers targeting OSDI, SOSP, ASPLOS, NSDI, and EuroSys. Provides paragraph-level structural blueprints, writing patterns, venue-specific checklists, reviewer guidelines, LaTeX templates, and conference deadlines. Use this skill for all systems conference paper writing.
4
+ version: 1.1.0
5
+ author: Orchestra Research
6
+ license: MIT
7
+ tags: [Systems Paper Writing, OSDI, SOSP, ASPLOS, NSDI, EuroSys, Structural Blueprint, Academic Writing, LaTeX]
8
+ ---
9
+
10
+ # Systems Paper Writing: Paragraph-Level Structural Blueprint
11
+
12
+ Fine-grained structural guidance for writing **10–12 page systems papers** targeting top systems venues: OSDI, SOSP, ASPLOS, NSDI, and EuroSys. This skill provides page allocation per section, paragraph-level blueprints, and writing patterns distilled from authoritative guides and best-paper analysis.
13
+
14
+ ## When to Use This Skill
15
+
16
+ | Scenario | Use This Skill | Use ml-paper-writing Instead |
17
+ |----------|---------------|------------------------------|
18
+ | Structuring a 12-page OSDI/SOSP paper | ✅ | |
19
+ | Page budget and paragraph planning | ✅ | |
20
+ | Systems-specific evaluation structure | ✅ | |
21
+ | General ML paper writing philosophy | | ✅ |
22
+ | Citation verification workflow | | ✅ |
23
+ | LaTeX templates and formatting | | ✅ |
24
+ | NeurIPS/ICML/ICLR paper structure | | ✅ |
25
+
26
+ **Boundary**: ml-paper-writing provides general writing philosophy, multi-venue templates, and citation verification. This skill focuses exclusively on **paragraph-level structural blueprints** for systems conferences.
27
+
28
+ ---
29
+
30
+ ## Authoritative Sources
31
+
32
+ This blueprint synthesizes guidance from established systems researchers:
33
+
34
+ 1. **Levin & Redell** — "How (and How Not) to Write a Good Systems Paper" (SOSP'83 PC Chairs, USENIX/ACM SIGOPS)
35
+ 2. **Irene Zhang** (MSR/UW) — "Hints on how to write an SOSP paper" (SOSP/OSDI PC)
36
+ 3. **Gernot Heiser** (UNSW, seL4) — Style Guide + Paper Writing Talk
37
+ 4. **Timothy Roscoe** (ETH Zürich) — "Writing reviews for systems conferences"
38
+ 5. **Mike Dahlin** (UT Austin/Google) — "Giving a Conference Talk"
39
+ 6. **Yi Ding** — "How to write good systems papers?"
40
+ 7. **hzwer & DingXiaoH** — WritingAIPaper (GitHub 1.3k+ stars)
41
+
42
+ Full citations and URLs: see [references/section-blueprints.md](references/section-blueprints.md).
43
+
44
+ ---
45
+
46
+ ## 12-Page Systems Paper Blueprint
47
+
48
+ ### Overview: Page Allocation
49
+
50
+ | Section | Pages | Purpose |
51
+ |---------|-------|---------|
52
+ | Abstract | ~0.25 | 150–250 words, 5-sentence structure |
53
+ | S1 Introduction | 1.5–2 | Problem → Gap → Insight → Contributions |
54
+ | S2 Background & Motivation | 1–1.5 | Terms + Production observations |
55
+ | S3 Design | 3–4 | Architecture + Module details + Alternatives |
56
+ | S4 Implementation | 0.5–1 | Prototype details, LOC, key engineering |
57
+ | S5 Evaluation | 3–4 | Setup + End-to-end + Microbenchmarks + Scalability |
58
+ | S6 Related Work | 1 | Grouped by methodology, explicit comparison |
59
+ | S7 Conclusion | 0.5 | 3-sentence summary |
60
+ | **Total** | **~12** | Submission: 12 pages strict (USENIX) / 11 pages (ACM ASPLOS). Camera-ready: up to 14 pages (USENIX) / 13 pages (ACM). Ranges above span submission through camera-ready. Target 12 pages for initial submission. References unlimited. |
61
+
62
+ ### Abstract (150–250 words, 5 sentences)
63
+
64
+ ```text
65
+ Sentence 1: Problem context and importance
66
+ Sentence 2: Gap in existing approaches
67
+ Sentence 3: Key insight or thesis ("X is better for Y in environment Z")
68
+ Sentence 4: Summary of approach and key results
69
+ Sentence 5: Broader impact or availability
70
+ ```
71
+
72
+ **Source**: Levin & Redell — "Can you state the new idea concisely? Use them in the abstract." Irene Zhang — "The abstract is harder to write because you cannot use terms or concepts you introduced in the paper."
73
+
74
+ ### S1 Introduction (1.5–2 pages)
75
+
76
+ **Paragraph structure**:
77
+
78
+ 1. **Problem statement** (~0.5 page) — Establish the domain and why it matters. Use concrete numbers (cluster sizes, workload statistics, latency requirements).
79
+ 2. **Gap analysis** (~0.5 page) — Enumerate specific gaps G1–Gn in existing systems. Each gap is one sentence with evidence.
80
+ 3. **Key insight** (1 paragraph) — The thesis statement: "X is better for applications Y running in environment Z." (Irene Zhang formula)
81
+ 4. **Contributions** (~0.5 page) — Numbered list of 3–5 concrete contributions. Each contribution is testable and maps to a section.
82
+
83
+ **Writing pattern**: hzwer Move 1 (Establish territory) → Move 2 (Find niche) → Move 3 (Occupy niche).
84
+
85
+ **Source**: Irene Zhang — "clearly state your target environment (Z) and application (Y)" + "clearly state why previous systems do not meet the needs"; Levin & Redell — "What exactly is the problem being solved?"
86
+
87
+ ### S2 Background & Motivation (1–1.5 pages)
88
+
89
+ **Paragraph structure**:
90
+
91
+ 1. **Technical background** (~0.5 page) — Define terms and systems the reader needs. Follow Gernot Heiser's "define-before-use" principle.
92
+ 2. **Production observations** (~0.5–1 page) — Present Observation 1, 2, 3 from real data or measurements. Each observation leads to a design insight.
93
+
94
+ **Source**: Irene Zhang — "clearly motivate Y and Z. Why is application Y important?"; Gernot Heiser — "define-before-use."
95
+
96
+ ### S3 Design (3–4 pages)
97
+
98
+ **Paragraph structure**:
99
+
100
+ 1. **System architecture overview** (~0.5 page) — Architecture diagram first (Yi Ding: "draw a picture first"). One-paragraph walkthrough of major components and data flow.
101
+ 2. **Module-by-module design** (~2–2.5 pages) — Each subsection: what the module does, the design choice made, alternatives considered, and why this choice wins.
102
+ 3. **Design alternatives and trade-offs** (~0.5–1 page) — For each major decision, explicitly discuss what was not chosen and why.
103
+
104
+ **Source**: Irene Zhang — "Every design choice made in X should be discussed with alternatives and the reasons for the choice"; Levin & Redell — "What were the alternatives considered at various points, and why were the choices made?"
105
+
106
+ ### S4 Implementation (0.5–1 page)
107
+
108
+ 1. **Prototype description** — Language, framework, LOC, integration with existing systems.
109
+ 2. **Key engineering decisions** — Non-obvious implementation choices worth documenting.
110
+
111
+ **Source**: Levin & Redell — "Does the paper describe something that has actually been implemented?"; Irene Zhang — "explain how you constructed a prototype to test your hypothesis."
112
+
113
+ ### S5 Evaluation (3–4 pages)
114
+
115
+ **Paragraph structure**:
116
+
117
+ 1. **Experimental setup** (~0.5 page) — Hardware, baselines, workloads, metrics. Enough detail to reproduce.
118
+ 2. **End-to-end comparison** (~1–1.5 pages) — X vs baselines for application Y on environment Z. Main performance results.
119
+ 3. **Microbenchmarks / Ablation** (~1–1.5 pages) — Isolate each design decision's contribution. Ablation experiments decompose the gains.
120
+ 4. **Scalability** (~0.5 page) — Show behavior as problem size, cluster size, or load increases.
121
+
122
+ **Critical rule** (Irene Zhang): State every experimental conclusion **three times**:
123
+ - Section opening: hypothesis ("We expect X to outperform Y because...")
124
+ - Section closing: conclusion ("Results show X outperforms Y by Z%")
125
+ - Figure caption: evidence ("Figure N shows X achieves Z% better throughput than Y")
126
+
127
+ **Two experiment types**:
128
+ - Type 1: X vs baselines for Y on Z (end-to-end comparison)
129
+ - Type 2: Ablation — remove each design component to measure its individual impact
130
+
131
+ ### S6 Related Work (1 page)
132
+
133
+ - Group by **methodology or approach**, not by individual papers.
134
+ - For each group: what they do, what limitation remains, how your work differs.
135
+ - Use a comparison table when comparing 4+ systems on specific dimensions.
136
+
137
+ **Source**: Levin & Redell — "Are comparisons with previous work clear and explicit?"; Irene Zhang — use comparison tables.
138
+
139
+ ### S7 Conclusion (0.5 page)
140
+
141
+ Three sentences (Irene Zhang formula):
142
+ 1. The hypothesis / problem addressed
143
+ 2. The solution approach
144
+ 3. The key result
145
+
146
+ ---
147
+
148
+ ## Writing Patterns
149
+
150
+ Four reusable patterns for structuring systems papers. See [references/writing-patterns.md](references/writing-patterns.md) for detailed examples.
151
+
152
+ ### Pattern 1: Gap Analysis (Lucid, ASPLOS'23)
153
+ Enumerate gaps G1–Gn in Introduction → map to answers A1–An in Design. Creates a clear contract with the reader.
154
+
155
+ ### Pattern 2: Observation-Driven (GFS, arXiv 2025)
156
+ Present production observations (O1–O3) in Motivation → derive design insights → build system around insights. Effective when you have real workload data.
157
+
158
+ ### Pattern 3: Contribution List (Blox, EuroSys'24; Sia, SOSP'23)
159
+ Numbered contributions in Introduction, each mapping to a section. Readers (and reviewers) can track claims through the paper.
160
+
161
+ ### Pattern 4: Thesis Formula (Irene Zhang)
162
+ Structure the entire paper around: "X is better for applications Y running in environment Z." Introduction states it, Design explains how, Evaluation proves it.
163
+
164
+ ---
165
+
166
+ ## Conference Differences
167
+
168
+ > **Warning**: Venue rules change yearly. Always verify against the **current year's CFP** before submission.
169
+
170
+ | Venue | Format | Submission Limit | Camera-Ready | References |
171
+ |-------|--------|-----------------|--------------|------------|
172
+ | OSDI | USENIX | 12 pages | 14 pages | Unlimited |
173
+ | NSDI | USENIX | 12 pages | 14 pages | Unlimited |
174
+ | SOSP | ACM SIGOPS | 12 pages (tech content) | — | Unlimited |
175
+ | ASPLOS | ACM SIGPLAN | 11 pages | 13 pages | Unlimited |
176
+ | EuroSys | ACM | 12 pages | — | Unlimited |
177
+
178
+ Based on 2025/2026 CFPs. Verify current limits before submission.
179
+
180
+ ---
181
+
182
+ ## Writing Philosophy
183
+
184
+ ### Manage Reader State (Gernot Heiser)
185
+ Treat the reader's cognitive load like an OS managing process state. Never introduce a concept without context. Never reference something defined later without a forward pointer.
186
+
187
+ ### Six-Dimensional Quality (Levin & Redell)
188
+ Self-check against: **Original Ideas**, **Reality** (is it built?), **Lessons** (what did you learn?), **Choices** (alternatives discussed?), **Context** (related work fair?), **Presentation** (clear writing?).
189
+
190
+ ### Page-One Figure (hzwer)
191
+ Include a figure on the first page that captures the core idea. Reviewers form first impressions from the title, abstract, and page-one figure.
192
+
193
+ ---
194
+
195
+ ## Academic Integrity Requirements
196
+
197
+ ### Citation Discipline
198
+ - **Never generate citations from memory.** Use ml-paper-writing's citation verification workflow (Semantic Scholar / DBLP / CrossRef APIs).
199
+ - Mark unverified references as `[CITATION NEEDED]`.
200
+
201
+ ### Prohibition of Fabrication
202
+ - Do NOT fabricate production observations, traces, deployment experiences, or experimental results.
203
+ - Do NOT generate fake venue rules, paper metadata, or best-paper claims.
204
+ - Do NOT copy paragraph-level text from reference papers. This blueprint provides **structural guidance**, not copy-paste templates.
205
+
206
+ ### LLM Disclosure
207
+ - Some venues require disclosure of substantial LLM use in writing or ideation. Check each venue's AI policy in the current CFP.
208
+
209
+ ### Attribution
210
+ - When structures are inspired by specific papers (e.g., Lucid's gap-analysis pattern), cite the inspiration.
211
+ - Cross-repository references (e.g., ARIS paper-slides structure) are attributed, not copied.
212
+
213
+ ### Temporal Validity
214
+ - Venue rules (page limits, format, AI policies) change annually. All venue information in this skill is based on 2025/2026 CFPs. **Always verify against the current year's CFP.**
215
+
216
+ ---
217
+
218
+ ## Workflow: Structuring a New Systems Paper
219
+
220
+ ```text
221
+ Step 1: Read this SKILL.md for page allocation overview
222
+ Step 2: Read references/section-blueprints.md for per-section paragraph templates
223
+ Step 3: Choose a writing pattern from references/writing-patterns.md
224
+ Step 4: Draft section by section following the blueprint
225
+ Step 5: Run the checklist from references/checklist.md before submission
226
+ Step 6: Use ml-paper-writing for citation verification and LaTeX formatting
227
+ ```
228
+
229
+ ### Quick Checklist
230
+
231
+ - [ ] Thesis statement follows "X is better for Y in Z" formula
232
+ - [ ] Introduction has numbered contributions (3–5)
233
+ - [ ] Each contribution maps to a paper section
234
+ - [ ] Design discusses alternatives for every major choice
235
+ - [ ] Every eval conclusion stated 3 times (hypothesis, result, caption)
236
+ - [ ] Related work grouped by methodology, not individual papers
237
+ - [ ] Page budget within venue limits
238
+ - [ ] All citations verified programmatically (no hallucinated references)
239
+
240
+ ---
241
+
242
+ ## Common Issues and Solutions
243
+
244
+ | Issue | Solution |
245
+ |-------|----------|
246
+ | Paper feels like a "feature list" | Restructure around thesis formula: X better for Y in Z |
247
+ | Evaluation lacks depth | Add ablation experiments isolating each design decision |
248
+ | Reviewers say "incremental" | Strengthen gap analysis: make G1–Gn crisper with evidence |
249
+ | Design section too long | Move implementation details to S4, keep S3 at design level |
250
+ | Motivation feels weak | Add production observations with concrete numbers |
251
+ | Related work reads like a bibliography | Group by approach, add explicit differentiation |
252
+
253
+ ---
254
+
255
+ ## References
256
+
257
+ ### Writing Guidance
258
+ - [references/section-blueprints.md](references/section-blueprints.md) — Detailed per-section paragraph templates with authoritative source quotes and best-paper structural examples
259
+ - [references/writing-patterns.md](references/writing-patterns.md) — Four writing patterns with concrete paper examples
260
+
261
+ ### Venue-Specific
262
+ - [references/checklist.md](references/checklist.md) — 7-stage pre-submission checklist covering structure, writing quality, evaluation rigor, design quality, academic integrity, venue-specific requirements (OSDI/NSDI/ASPLOS/SOSP/EuroSys), and final pass
263
+ - [references/systems-conferences.md](references/systems-conferences.md) — Conference overview, deadlines, track descriptions, formatting requirements, submission rules, and format conversion guides
264
+ - [references/reviewer-guidelines.md](references/reviewer-guidelines.md) — How systems conference reviewers evaluate papers, with venue-specific criteria and common concerns
265
+
266
+ ### LaTeX Templates
267
+ - [templates/osdi2026/](templates/osdi2026/) — OSDI 2026 (USENIX format)
268
+ - [templates/nsdi2027/](templates/nsdi2027/) — NSDI 2027 (USENIX format)
269
+ - [templates/asplos2027/](templates/asplos2027/) — ASPLOS 2027 (ACM SIGPLAN format)
270
+ - [templates/sosp2026/](templates/sosp2026/) — SOSP 2026 (ACM SIGPLAN format)
@@ -0,0 +1,279 @@
1
+ <!-- vendored from orchestra-research/AI-research-SKILLs@773a52944ba4747a18bd4ae9ade53fff041adcbc 20-ml-paper-writing/systems-paper-writing/references/checklist.md; MIT (c) Orchestra Research -->
2
+ # Pre-Submission Checklist for Systems Papers
3
+
4
+ Comprehensive self-check before submitting to OSDI, SOSP, ASPLOS, NSDI, and EuroSys. Combines community best practices (MLNLP-World/Paper-Writing-Tips, RU-System/Paper_Writing_Tips) with systems-specific and academic integrity checks.
5
+
6
+ ---
7
+
8
+ ## Stage 1: Structural Completeness
9
+
10
+ ### Thesis & Contributions
11
+ - [ ] Paper has a clear thesis statement: "X is better for Y in Z"
12
+ - [ ] Thesis appears in Abstract (sentence 3), Introduction, and Conclusion
13
+ - [ ] Introduction lists 3–5 numbered, testable contributions
14
+ - [ ] Each contribution cross-references a paper section (§N)
15
+ - [ ] Each contribution is verified by an experiment in §5
16
+
17
+ ### Section Presence
18
+ - [ ] Abstract: 150–250 words, self-contained (no undefined terms)
19
+ - [ ] Introduction: Problem → Gap → Insight → Contributions
20
+ - [ ] Background/Motivation: Technical terms defined before use
21
+ - [ ] Design: Architecture figure + module details + alternatives
22
+ - [ ] Implementation: Language, LOC, framework, key decisions
23
+ - [ ] Evaluation: Setup + end-to-end + ablation + scalability
24
+ - [ ] Related Work: Grouped by approach, explicit differentiation
25
+ - [ ] Conclusion: 3-sentence summary (problem, solution, result)
26
+
27
+ ### Page Budget
28
+ - [ ] Total pages within venue limit (see venue table below)
29
+ - [ ] Design section: 3–4 pages (not overlong)
30
+ - [ ] Evaluation section: 3–4 pages (not underweight)
31
+ - [ ] Related Work: ~1 page (not a bibliography dump)
32
+ - [ ] Implementation: 0.5–1 page (concise)
33
+
34
+ ---
35
+
36
+ ## Stage 2: Writing Quality
37
+
38
+ ### Clarity (Gernot Heiser)
39
+ - [ ] No forward references without explicit pointers ("as we show in §N")
40
+ - [ ] Every acronym defined on first use
41
+ - [ ] No orphan terminology — every technical term defined before use
42
+ - [ ] Consistent naming: system name capitalized uniformly throughout
43
+ - [ ] Active voice preferred over passive where possible
44
+
45
+ ### Figures & Tables (MLNLP-World/Paper-Writing-Tips)
46
+ - [ ] Every figure/table referenced in text before it appears
47
+ - [ ] Figure captions are self-contained (readable without text)
48
+ - [ ] Evaluation figure captions include the key finding
49
+ - [ ] Architecture figure appears within first 3 pages
50
+ - [ ] Fonts in figures ≥ 8pt (readable when printed)
51
+ - [ ] Colors distinguishable in grayscale (for B&W printing)
52
+ - [ ] Consistent plot styles across all evaluation figures
53
+
54
+ ### LaTeX Quality
55
+ - [ ] All code blocks have language tags (```python, ```bash, etc.)
56
+ - [ ] Non-breaking spaces before references: `Section~\ref{...}`
57
+ - [ ] Consistent citation format: `\cite{...}` not mixed with `[N]`
58
+ - [ ] No overfull hbox warnings in LaTeX log
59
+ - [ ] Bibliography entries have complete metadata (authors, title, venue, year)
60
+
61
+ ### Prose Quality (RU-System/Paper_Writing_Tips)
62
+ - [ ] No hedging without evidence ("we believe", "it seems")
63
+ - [ ] Quantitative claims have numbers ("significantly better" → "37% better")
64
+ - [ ] No first-person unless venue style requires it
65
+ - [ ] Contributions are specific, not vague ("novel" without explanation)
66
+ - [ ] Related work comparisons are fair and accurate
67
+
68
+ ---
69
+
70
+ ## Stage 3: Evaluation Rigor
71
+
72
+ ### Experimental Methodology
73
+ - [ ] Baselines are state-of-the-art (not straw men)
74
+ - [ ] Baselines configured optimally (not default/untuned)
75
+ - [ ] Hardware, software versions, and configurations fully specified
76
+ - [ ] Workloads described in sufficient detail to reproduce
77
+ - [ ] Statistical significance: error bars, multiple runs, or confidence intervals
78
+ - [ ] Warmup runs excluded from measurements
79
+
80
+ ### Result Presentation
81
+ - [ ] Every conclusion stated 3 times: hypothesis (§ opening), result (§ closing), caption (figure)
82
+ - [ ] Ablation study isolates each design component
83
+ - [ ] Scalability experiments show behavior at increasing scale
84
+ - [ ] Both favorable and unfavorable results discussed honestly
85
+ - [ ] Performance numbers are absolute (not only relative percentages)
86
+
87
+ ### Reproducibility
88
+ - [ ] Source code availability stated (or planned)
89
+ - [ ] Key hyperparameters and configuration values listed
90
+ - [ ] Workload generation described or traces cited
91
+ - [ ] Enough detail for an independent team to reproduce within ~2 weeks
92
+
93
+ ---
94
+
95
+ ## Stage 4: Design Quality
96
+
97
+ ### Alternatives Discussion (Irene Zhang)
98
+ - [ ] Every major design decision discusses at least one alternative
99
+ - [ ] Alternatives are genuinely considered (not straw men)
100
+ - [ ] Trade-offs for each alternative explicitly stated
101
+ - [ ] Reasons for rejection are technical (not "it was harder to implement")
102
+
103
+ ### Correctness Arguments
104
+ - [ ] System handles failure cases (discussed or evaluated)
105
+ - [ ] Edge cases acknowledged (even if not fully solved)
106
+ - [ ] Threat model or assumptions section present (if applicable)
107
+ - [ ] Limitations stated honestly (not hidden)
108
+
109
+ ---
110
+
111
+ ## Stage 5: Academic Integrity
112
+
113
+ ### Citation Discipline
114
+ - [ ] **Every citation verified programmatically** (Semantic Scholar / DBLP / CrossRef)
115
+ - [ ] No citations generated from memory or LLM output
116
+ - [ ] Unverified citations marked as `[CITATION NEEDED]`
117
+ - [ ] All BibTeX entries have: authors, title, venue, year, pages/DOI
118
+ - [ ] No fabricated paper titles, authors, or venues
119
+ - [ ] Self-citations are relevant (not padding)
120
+
121
+ ### Data Integrity
122
+ - [ ] Production observations are from real data (not fabricated)
123
+ - [ ] Experimental results are from actual runs (not interpolated/extrapolated)
124
+ - [ ] Traces cited with source (public dataset or anonymized description)
125
+ - [ ] No results cherry-picked without disclosing selection criteria
126
+
127
+ ### LLM Disclosure
128
+ - [ ] Check venue's AI/LLM use policy in current CFP
129
+ - [ ] If LLM used for substantial writing: disclose as required
130
+ - [ ] If LLM used for code generation: disclose as required
131
+ - [ ] Confirm all LLM-assisted content reviewed by human authors
132
+
133
+ ### Originality
134
+ - [ ] No paragraph-level text copied from other papers
135
+ - [ ] Structural patterns inspired by other papers are attributed
136
+ - [ ] Cross-repository content (if any) is attributed, not copied
137
+ - [ ] Related work descriptions are original paraphrases, not copy-paste
138
+
139
+ ---
140
+
141
+ ## Stage 6: Venue-Specific Requirements
142
+
143
+ > **Verify against the current year's CFP** — rules change annually.
144
+
145
+ ### All Systems Venues
146
+
147
+ - [ ] **System design and implementation** — not just algorithms
148
+ - [ ] **Real workloads and evaluation** — microbenchmarks are insufficient
149
+ - [ ] **Practical benefits demonstrated** — latency, throughput, cost, energy
150
+ - [ ] **Comparison with state-of-the-art systems**
151
+ - [ ] **No simultaneous submission to other venues**
152
+ - [ ] **Prior arXiv/tech reports permitted**
153
+
154
+ ### Page Limits Quick Reference
155
+
156
+ | Conference | Main Content | Camera-Ready | References | Format |
157
+ |------------|-------------|--------------|------------|--------|
158
+ | OSDI 2026 | 12 pages | 14 pages | Unlimited | USENIX |
159
+ | NSDI 2027 | 12 pages | varies | Unlimited | USENIX |
160
+ | ASPLOS 2027 | 12 pages | varies | Unlimited | ACM SIGPLAN |
161
+ | SOSP 2026 | 12 pages | varies | Unlimited | ACM SIGPLAN |
162
+ | EuroSys | 12 pages | varies | Unlimited | ACM |
163
+
164
+ ### OSDI 2026
165
+
166
+ OSDI focuses on innovative research and quantified/insightful experiences in systems design and implementation.
167
+
168
+ **Tracks:**
169
+ - **Research Track**: Novel systems research
170
+ - **Operational Systems Track** (New in 2026): Design, implementation, analysis, and experience of operational systems
171
+
172
+ **Checklist:**
173
+ - [ ] ≤12 pages (excluding references)
174
+ - [ ] 8.5" x 11" pages, 10pt on 12pt leading, two-column, Times Roman
175
+ - [ ] 7" wide x 9" deep text block
176
+ - [ ] Pages are numbered
177
+ - [ ] Figures and tables legible in black and white
178
+ - [ ] Paper is the right length (not padded; <6pp unlikely to receive full consideration)
179
+ - [ ] Double-blind: no author names, affiliations
180
+ - [ ] Anonymized project/system name (different from arXiv/talks)
181
+ - [ ] Track indicated on title page and submission form
182
+ - [ ] Operational Systems papers: title ends with "(Operational Systems)"
183
+ - [ ] Max 8 submissions per author
184
+ - [ ] Work NOT wholly or largely generated by AI (AI editing tools are acceptable)
185
+
186
+ ### NSDI 2027
187
+
188
+ NSDI focuses on design principles, implementation, and practical evaluation of networked and distributed systems.
189
+
190
+ **Tracks:**
191
+ - **Traditional Research Track**: Novel ideas with thorough evaluations
192
+ - **Frontiers Track** (New): Bold ideas without necessarily complete evaluation
193
+ - **Operational Systems Track**: Deployed systems with lessons learned
194
+
195
+ **Prescreening:** Reviewers read only the Introduction to check:
196
+ - [ ] Subject falls within NSDI scope
197
+ - [ ] Exposition understandable by NSDI PC member
198
+ - [ ] Track-specific criteria articulated in Introduction
199
+
200
+ **Checklist:**
201
+ - [ ] ≤12 pages (excluding references), USENIX format
202
+ - [ ] Two-column, 10pt, Times Roman
203
+ - [ ] Double-blind anonymized
204
+ - [ ] Contributions to networked systems design
205
+ - [ ] NOT out-of-scope topics (hardware architecture, physical layer, sensing, UI)
206
+ - [ ] Track indicated on title page and submission form
207
+ - [ ] Not rejected from previous NSDI deadline without one-shot revision option
208
+
209
+ ### ASPLOS 2027
210
+
211
+ ASPLOS focuses on the intersection of computer architecture, programming languages, and operating systems.
212
+
213
+ **Rapid Review Round** (unique to ASPLOS):
214
+ - Reviewers only read the **first 2 pages**
215
+ - Evaluates how work advances Architecture/PL/OS research
216
+ - Majority of submissions may not advance past this stage
217
+
218
+ **Checklist:**
219
+ - [ ] First 2 pages self-contained: clearly states problem, approach, and contribution
220
+ - [ ] Advances Architecture, PL, and/or OS research
221
+ - [ ] Not just advances in another domain using arch/PL/OS
222
+ - [ ] ACM SIGPLAN format (`\documentclass[sigplan,10pt]{acmart}`)
223
+ - [ ] ≤12 pages (excluding references)
224
+ - [ ] Double-blind anonymized
225
+ - [ ] Max 4 submissions per author per cycle
226
+ - [ ] Resubmission note describing changes (if applicable)
227
+ - [ ] Not resubmitted from immediate previous ASPLOS cycle
228
+
229
+ ### SOSP 2026
230
+
231
+ SOSP seeks innovative research related to design, implementation, analysis, evaluation, and deployment of computer systems software.
232
+
233
+ **Checklist:**
234
+ - [ ] ACM SIGPLAN format (`\documentclass[sigplan,10pt]{acmart}`)
235
+ - [ ] ≤12 pages technical content (excluding references)
236
+ - [ ] A4 or US letter, 178×229mm (7×9") text block
237
+ - [ ] Two-column, 8mm separation, 10pt on 12pt leading
238
+ - [ ] Pages numbered, references hyperlinked
239
+ - [ ] Figures/tables readable without magnification, encouraged in color but grayscale-readable
240
+ - [ ] Double-blind: paper ID instead of author names
241
+ - [ ] Anonymized system/project name
242
+ - [ ] Own work cited in third person
243
+ - [ ] No acknowledgments or grant numbers
244
+ - [ ] Artifact evaluation materials prepared (optional but recommended)
245
+ - [ ] Author response ≤500 words, no new experiments
246
+
247
+ ### EuroSys
248
+
249
+ - [ ] ACM template used
250
+ - [ ] Page limit: 12 pages
251
+ - [ ] Double-blind formatting
252
+ - [ ] Artifact evaluation encouraged
253
+
254
+ ---
255
+
256
+ ## Stage 7: Final Pass
257
+
258
+ ### Before Clicking Submit
259
+ - [ ] PDF renders correctly (no missing fonts, broken figures)
260
+ - [ ] All TODO/FIXME comments removed from source
261
+ - [ ] `[CITATION NEEDED]` markers resolved or removed
262
+ - [ ] Author names correct (camera-ready) or removed (blind)
263
+ - [ ] Acknowledgements removed for blind submission
264
+ - [ ] Supplementary material properly anonymized
265
+ - [ ] File size within submission system limits
266
+ - [ ] Paper title matches submission system entry
267
+ - [ ] Abstract in submission system matches paper abstract
268
+ - [ ] Correct track/topic area selected in submission system
269
+
270
+ ### One-Sentence Self-Test (Levin & Redell Six Dimensions)
271
+ For each dimension, answer in one sentence:
272
+ 1. **Original Ideas**: What is genuinely new?
273
+ 2. **Reality**: Is the system built and tested?
274
+ 3. **Lessons**: What did we learn that others can use?
275
+ 4. **Choices**: Did we discuss alternatives for every major decision?
276
+ 5. **Context**: Is the related work fair and complete?
277
+ 6. **Presentation**: Would a non-expert in this subfield understand the paper?
278
+
279
+ If any answer is weak, revise that aspect before submitting.
@@ -0,0 +1,116 @@
1
+ <!-- vendored from orchestra-research/AI-research-SKILLs@773a52944ba4747a18bd4ae9ade53fff041adcbc 20-ml-paper-writing/systems-paper-writing/references/reviewer-guidelines.md; MIT (c) Orchestra Research -->
2
+ # Systems Conference Reviewer Guidelines
3
+
4
+ Systems conferences (OSDI, NSDI, ASPLOS, SOSP) evaluate papers differently from ML/AI venues. Understanding these differences is critical for cross-venue submissions.
5
+
6
+ ---
7
+
8
+ ## Core Evaluation Criteria for Systems
9
+
10
+ | Criterion | What Reviewers Look For |
11
+ |-----------|------------------------|
12
+ | **Novelty** | New system design, not just incremental improvement |
13
+ | **Significance** | Solves important practical problem |
14
+ | **System Design** | Sound architecture, clear design decisions |
15
+ | **Implementation** | Working prototype, not just simulation |
16
+ | **Evaluation** | Real workloads, end-to-end performance |
17
+ | **Clarity** | Clear writing, reproducible |
18
+
19
+ ## OSDI 2026 Reviewer Perspective
20
+
21
+ **What reviewers evaluate:**
22
+ - Topic relevance to computer systems
23
+ - Potential to impact future systems research and practices
24
+ - Interest to substantial portion of OSDI attendees
25
+ - Papers with little PC overlap are less likely accepted
26
+
27
+ **Research Track criteria:**
28
+ - Novelty, significance, clarity, relevance, correctness
29
+ - Quantified or insightful experiences in systems
30
+
31
+ **Operational Systems Track criteria:**
32
+ - Real-world deployment at meaningful scale
33
+ - Lessons that deepen understanding of existing problems
34
+ - Disproves or strengthens existing assumptions
35
+ - Novel research ideas NOT required
36
+
37
+ **New in 2026:**
38
+ - No author response period
39
+ - Conditional accept replaces revise-and-resubmit
40
+ - Target acceptance rate ≥20%
41
+ - Reviewers encouraged to down-rank padded papers
42
+
43
+ ## NSDI 2027 Reviewer Perspective
44
+
45
+ **Prescreening (Introduction only):**
46
+
47
+ Reviewers check three criteria in the prescreening phase:
48
+ 1. **Scope**: Subject within NSDI topics
49
+ 2. **Accessibility**: Understandable by PC member
50
+ 3. **Track alignment**: Meets track-specific criteria
51
+
52
+ **Track-specific review:**
53
+
54
+ | Track | Key Criterion |
55
+ |-------|---------------|
56
+ | Research | Novel idea + compelling evaluation evidence |
57
+ | Frontiers | Bold non-incremental idea (complete evaluation not required) |
58
+ | Operational | Deployment context, scale, lessons for community |
59
+
60
+ **One-shot revision:**
61
+ - Rejected papers may receive a list of issues to address
62
+ - Authors can resubmit revision at next deadline
63
+ - Same reviewers review the revision (to extent possible)
64
+
65
+ ## ASPLOS 2027 Reviewer Perspective
66
+
67
+ **Rapid Review Round:**
68
+ - Reviewers read ONLY first 2 pages
69
+ - Evaluates: Does this advance Architecture, PL, or OS research?
70
+ - Majority of submissions may not advance past this stage
71
+ - Similar to Nature/Science early screening model
72
+
73
+ **Full Review criteria:**
74
+ - Advances in core ASPLOS disciplines (not just using them)
75
+ - Quality of system design and implementation
76
+ - Major Revision decision available
77
+
78
+ ## SOSP 2026 Reviewer Perspective
79
+
80
+ **Core evaluation:**
81
+ - Novelty, significance, interest, clarity, relevance, correctness
82
+ - Encourages groundbreaking work in significant new directions
83
+ - Different evaluation criteria for new problems vs established areas
84
+
85
+ **Author Response:**
86
+ - Limited to: correcting factual errors + addressing reviewer questions
87
+ - NO new experiments or additional work
88
+ - Keep under 500 words
89
+
90
+ **Artifact Evaluation:**
91
+ - Optional but encouraged
92
+ - Cooperative process: authors can fix issues during evaluation
93
+ - Register within days of acceptance notification
94
+
95
+ ## ML vs Systems: Key Review Differences
96
+
97
+ | Aspect | ML/AI Venues | Systems Venues |
98
+ |--------|-------------|---------------|
99
+ | **Page limit** | 7-9 pages | 12 pages |
100
+ | **Evaluation focus** | Benchmarks, ablations, metrics | End-to-end system performance, real workloads |
101
+ | **Implementation** | Code often optional | Working system expected |
102
+ | **Novelty** | New methods/insights | New system designs/approaches |
103
+ | **Reproducibility** | Checklist-based | Artifact evaluation (optional) |
104
+ | **Template** | Venue-specific `.sty` | USENIX `.sty` or ACM `acmart.cls` |
105
+ | **Review process** | Single deadline | Often dual deadlines |
106
+
107
+ ## Systems-Specific Common Concerns
108
+
109
+ | Concern | How to Pre-empt |
110
+ |---------|-----------------|
111
+ | "Just an ML paper, not systems" | Emphasize system design, architecture decisions, deployment challenges |
112
+ | "Evaluation only on microbenchmarks" | Include end-to-end evaluation with real workloads |
113
+ | "No working prototype" | Build and evaluate a real system, not just simulate |
114
+ | "Deployment not realistic" | Show real-world applicability, discuss practical constraints |
115
+ | "Not relevant to systems community" | Frame contributions in systems terms, cite systems papers |
116
+ | "ASPLOS: Not advancing arch/PL/OS" | Explicitly state how work advances core disciplines |