@r1z4x/tezgah 1.0.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (582) hide show
  1. package/CHANGELOG.md +738 -0
  2. package/LICENSE +21 -0
  3. package/MANIFEST +753 -0
  4. package/README.de.md +169 -0
  5. package/README.es.md +168 -0
  6. package/README.fr.md +166 -0
  7. package/README.md +161 -0
  8. package/README.tr.md +163 -0
  9. package/agents/tezgah-reviewer.md +70 -0
  10. package/bin/codegen +337 -0
  11. package/bin/consult +797 -0
  12. package/bin/tezgah-adhd +50 -0
  13. package/bin/tezgah-agents +45 -0
  14. package/bin/tezgah-capture +66 -0
  15. package/bin/tezgah-context +96 -0
  16. package/bin/tezgah-decisions +213 -0
  17. package/bin/tezgah-design +953 -0
  18. package/bin/tezgah-docs +1199 -0
  19. package/bin/tezgah-doctor +497 -0
  20. package/bin/tezgah-dsh +37 -0
  21. package/bin/tezgah-dsh.cmd +70 -0
  22. package/bin/tezgah-gate +75 -0
  23. package/bin/tezgah-import-ai-research +439 -0
  24. package/bin/tezgah-index +32 -0
  25. package/bin/tezgah-lessons +148 -0
  26. package/bin/tezgah-mcp +322 -0
  27. package/bin/tezgah-migrate +324 -0
  28. package/bin/tezgah-pony +50 -0
  29. package/bin/tezgah-research +772 -0
  30. package/bin/tezgah-rollback +93 -0
  31. package/bin/tezgah-route +124 -0
  32. package/bin/tezgah-setup +5798 -0
  33. package/bin/tezgah-status +383 -0
  34. package/bin/tezgah-task +607 -0
  35. package/bin/tezgah-taste +423 -0
  36. package/bin/tezgah-triage +485 -0
  37. package/bin/tezgah.js +36 -0
  38. package/commands/adhd.md +21 -0
  39. package/commands/ponytail.md +21 -0
  40. package/docs/README.md +112 -0
  41. package/docs/architecture.md +226 -0
  42. package/docs/citations-baseline.json +59 -0
  43. package/docs/clarity-baseline.json +116 -0
  44. package/docs/contract.md +416 -0
  45. package/docs/environment.md +141 -0
  46. package/docs/evidence.md +831 -0
  47. package/docs/feature-audit.md +139 -0
  48. package/docs/gate.md +407 -0
  49. package/docs/glossary.md +201 -0
  50. package/docs/hosts.md +400 -0
  51. package/docs/index.json +471 -0
  52. package/docs/judge.md +193 -0
  53. package/docs/layers.md +189 -0
  54. package/docs/models.md +160 -0
  55. package/docs/operations.md +666 -0
  56. package/docs/research.md +809 -0
  57. package/docs/results/paired-outcome-2026-10.jsonl +254 -0
  58. package/docs/results/paired-outcome-2026-10.md +204 -0
  59. package/docs/skills.md +236 -0
  60. package/docs/status-line.md +315 -0
  61. package/docs/testing.md +287 -0
  62. package/docs/vision.md +117 -0
  63. package/hooks/hooks.json +33 -0
  64. package/hooks/projects-auto-init.py +98 -0
  65. package/hooks/projects-posttooluse.py +149 -0
  66. package/hooks/projects-pretooluse.py +40 -0
  67. package/hooks/projects-stop.py +60 -0
  68. package/hooks/tezgah_agents.py +817 -0
  69. package/hooks/tezgah_apps.py +266 -0
  70. package/hooks/tezgah_attest.py +255 -0
  71. package/hooks/tezgah_clarity.py +171 -0
  72. package/hooks/tezgah_components.py +140 -0
  73. package/hooks/tezgah_context.py +2953 -0
  74. package/hooks/tezgah_embed.py +765 -0
  75. package/hooks/tezgah_gate.py +2736 -0
  76. package/hooks/tezgah_guard.py +177 -0
  77. package/hooks/tezgah_index.py +124 -0
  78. package/hooks/tezgah_integrity.py +5141 -0
  79. package/hooks/tezgah_judge.py +487 -0
  80. package/hooks/tezgah_lang.py +230 -0
  81. package/hooks/tezgah_lessons.py +210 -0
  82. package/hooks/tezgah_models.py +855 -0
  83. package/hooks/tezgah_paths.py +1132 -0
  84. package/hooks/tezgah_policy.py +1039 -0
  85. package/hooks/tezgah_rank.py +77 -0
  86. package/hooks/tezgah_replay.py +1109 -0
  87. package/hooks/tezgah_research.py +5176 -0
  88. package/hooks/tezgah_shapes.py +305 -0
  89. package/hooks/tezgah_skill_pick.py +227 -0
  90. package/hooks/tezgah_snapshot.py +490 -0
  91. package/hooks/tezgah_stopspec.py +320 -0
  92. package/hooks/tezgah_task.py +458 -0
  93. package/hooks/tezgah_taste.py +201 -0
  94. package/hooks/tezgah_untrusted.py +112 -0
  95. package/hooks/tezgah_update.py +430 -0
  96. package/hosts/codex/hook.py +268 -0
  97. package/hosts/codex/hooks.json +26 -0
  98. package/hosts/cursor/hook.py +461 -0
  99. package/hosts/cursor/hooks.json +44 -0
  100. package/hosts/dsh/hooks.json +21 -0
  101. package/hosts/dsh/statusline/lib/client.js +138 -0
  102. package/hosts/dsh/statusline/lib/index.js +104 -0
  103. package/hosts/dsh/statusline/package.json +28 -0
  104. package/hosts/omp/hook.py +277 -0
  105. package/hosts/omp/tezgah-hook.ts.in +701 -0
  106. package/hosts/opencode/plugins/tezgah.js +2742 -0
  107. package/hosts/opencode/tui/tezgah-tui.tsx +151 -0
  108. package/output-styles/tezgah.md +142 -0
  109. package/package.json +32 -0
  110. package/packaging/build.sh +342 -0
  111. package/packaging/install.ps1 +166 -0
  112. package/packaging/install.sh +56 -0
  113. package/packaging/upgrade.sh +142 -0
  114. package/skills/ai-research/0-autoresearch-skill/SKILL.md +411 -0
  115. package/skills/ai-research/0-autoresearch-skill/references/agent-continuity.md +95 -0
  116. package/skills/ai-research/0-autoresearch-skill/references/progress-reporting.md +166 -0
  117. package/skills/ai-research/0-autoresearch-skill/references/skill-routing.md +219 -0
  118. package/skills/ai-research/0-autoresearch-skill/templates/findings.md +44 -0
  119. package/skills/ai-research/0-autoresearch-skill/templates/research-log.md +41 -0
  120. package/skills/ai-research/01-model-architecture/litgpt/SKILL.md +469 -0
  121. package/skills/ai-research/01-model-architecture/litgpt/references/custom-models.md +569 -0
  122. package/skills/ai-research/01-model-architecture/litgpt/references/distributed-training.md +452 -0
  123. package/skills/ai-research/01-model-architecture/litgpt/references/supported-models.md +337 -0
  124. package/skills/ai-research/01-model-architecture/litgpt/references/training-recipes.md +620 -0
  125. package/skills/ai-research/01-model-architecture/mamba/SKILL.md +260 -0
  126. package/skills/ai-research/01-model-architecture/mamba/references/architecture-details.md +207 -0
  127. package/skills/ai-research/01-model-architecture/mamba/references/benchmarks.md +256 -0
  128. package/skills/ai-research/01-model-architecture/mamba/references/training-guide.md +389 -0
  129. package/skills/ai-research/01-model-architecture/nanogpt/SKILL.md +290 -0
  130. package/skills/ai-research/01-model-architecture/nanogpt/references/architecture.md +383 -0
  131. package/skills/ai-research/01-model-architecture/nanogpt/references/data.md +477 -0
  132. package/skills/ai-research/01-model-architecture/nanogpt/references/training.md +565 -0
  133. package/skills/ai-research/01-model-architecture/rwkv/SKILL.md +260 -0
  134. package/skills/ai-research/01-model-architecture/rwkv/references/architecture-details.md +345 -0
  135. package/skills/ai-research/01-model-architecture/rwkv/references/rwkv7.md +387 -0
  136. package/skills/ai-research/01-model-architecture/rwkv/references/state-management.md +370 -0
  137. package/skills/ai-research/01-model-architecture/torchtitan/SKILL.md +358 -0
  138. package/skills/ai-research/01-model-architecture/torchtitan/references/checkpoint.md +182 -0
  139. package/skills/ai-research/01-model-architecture/torchtitan/references/custom-models.md +259 -0
  140. package/skills/ai-research/01-model-architecture/torchtitan/references/float8.md +134 -0
  141. package/skills/ai-research/01-model-architecture/torchtitan/references/fsdp.md +127 -0
  142. package/skills/ai-research/02-tokenization/huggingface-tokenizers/SKILL.md +516 -0
  143. package/skills/ai-research/02-tokenization/huggingface-tokenizers/references/algorithms.md +654 -0
  144. package/skills/ai-research/02-tokenization/huggingface-tokenizers/references/integration.md +638 -0
  145. package/skills/ai-research/02-tokenization/huggingface-tokenizers/references/pipeline.md +724 -0
  146. package/skills/ai-research/02-tokenization/huggingface-tokenizers/references/training.md +566 -0
  147. package/skills/ai-research/02-tokenization/sentencepiece/SKILL.md +235 -0
  148. package/skills/ai-research/02-tokenization/sentencepiece/references/algorithms.md +201 -0
  149. package/skills/ai-research/02-tokenization/sentencepiece/references/training.md +305 -0
  150. package/skills/ai-research/03-fine-tuning/axolotl/SKILL.md +158 -0
  151. package/skills/ai-research/03-fine-tuning/axolotl/references/api.md +5549 -0
  152. package/skills/ai-research/03-fine-tuning/axolotl/references/dataset-formats.md +1030 -0
  153. package/skills/ai-research/03-fine-tuning/axolotl/references/index.md +16 -0
  154. package/skills/ai-research/03-fine-tuning/axolotl/references/other.md +3564 -0
  155. package/skills/ai-research/03-fine-tuning/llama-factory/SKILL.md +80 -0
  156. package/skills/ai-research/03-fine-tuning/llama-factory/references/_images.md +24 -0
  157. package/skills/ai-research/03-fine-tuning/llama-factory/references/advanced.md +1056 -0
  158. package/skills/ai-research/03-fine-tuning/llama-factory/references/getting_started.md +350 -0
  159. package/skills/ai-research/03-fine-tuning/llama-factory/references/index.md +20 -0
  160. package/skills/ai-research/03-fine-tuning/llama-factory/references/other.md +32 -0
  161. package/skills/ai-research/03-fine-tuning/peft/SKILL.md +431 -0
  162. package/skills/ai-research/03-fine-tuning/peft/references/advanced-usage.md +515 -0
  163. package/skills/ai-research/03-fine-tuning/peft/references/troubleshooting.md +481 -0
  164. package/skills/ai-research/03-fine-tuning/unsloth/SKILL.md +80 -0
  165. package/skills/ai-research/03-fine-tuning/unsloth/references/index.md +8 -0
  166. package/skills/ai-research/03-fine-tuning/unsloth/references/llms.md +83 -0
  167. package/skills/ai-research/04-mechanistic-interpretability/nnsight/SKILL.md +436 -0
  168. package/skills/ai-research/04-mechanistic-interpretability/nnsight/references/README.md +79 -0
  169. package/skills/ai-research/04-mechanistic-interpretability/nnsight/references/api.md +345 -0
  170. package/skills/ai-research/04-mechanistic-interpretability/nnsight/references/tutorials.md +301 -0
  171. package/skills/ai-research/04-mechanistic-interpretability/pyvene/SKILL.md +473 -0
  172. package/skills/ai-research/04-mechanistic-interpretability/pyvene/references/README.md +74 -0
  173. package/skills/ai-research/04-mechanistic-interpretability/pyvene/references/api.md +384 -0
  174. package/skills/ai-research/04-mechanistic-interpretability/pyvene/references/tutorials.md +377 -0
  175. package/skills/ai-research/04-mechanistic-interpretability/saelens/SKILL.md +386 -0
  176. package/skills/ai-research/04-mechanistic-interpretability/saelens/references/README.md +71 -0
  177. package/skills/ai-research/04-mechanistic-interpretability/saelens/references/api.md +334 -0
  178. package/skills/ai-research/04-mechanistic-interpretability/saelens/references/tutorials.md +319 -0
  179. package/skills/ai-research/04-mechanistic-interpretability/transformer-lens/SKILL.md +346 -0
  180. package/skills/ai-research/04-mechanistic-interpretability/transformer-lens/references/README.md +55 -0
  181. package/skills/ai-research/04-mechanistic-interpretability/transformer-lens/references/api.md +363 -0
  182. package/skills/ai-research/04-mechanistic-interpretability/transformer-lens/references/tutorials.md +340 -0
  183. package/skills/ai-research/05-data-processing/nemo-curator/SKILL.md +383 -0
  184. package/skills/ai-research/05-data-processing/nemo-curator/references/deduplication.md +88 -0
  185. package/skills/ai-research/05-data-processing/nemo-curator/references/filtering.md +103 -0
  186. package/skills/ai-research/05-data-processing/ray-data/SKILL.md +326 -0
  187. package/skills/ai-research/05-data-processing/ray-data/references/integration.md +83 -0
  188. package/skills/ai-research/05-data-processing/ray-data/references/transformations.md +84 -0
  189. package/skills/ai-research/06-post-training/grpo-rl-training/README.md +98 -0
  190. package/skills/ai-research/06-post-training/grpo-rl-training/SKILL.md +572 -0
  191. package/skills/ai-research/06-post-training/miles/SKILL.md +315 -0
  192. package/skills/ai-research/06-post-training/miles/references/api-reference.md +142 -0
  193. package/skills/ai-research/06-post-training/miles/references/troubleshooting.md +353 -0
  194. package/skills/ai-research/06-post-training/openrlhf/SKILL.md +249 -0
  195. package/skills/ai-research/06-post-training/openrlhf/references/algorithm-comparison.md +405 -0
  196. package/skills/ai-research/06-post-training/openrlhf/references/custom-rewards.md +531 -0
  197. package/skills/ai-research/06-post-training/openrlhf/references/hybrid-engine.md +288 -0
  198. package/skills/ai-research/06-post-training/openrlhf/references/multi-node-training.md +455 -0
  199. package/skills/ai-research/06-post-training/simpo/SKILL.md +219 -0
  200. package/skills/ai-research/06-post-training/simpo/references/datasets.md +479 -0
  201. package/skills/ai-research/06-post-training/simpo/references/hyperparameters.md +453 -0
  202. package/skills/ai-research/06-post-training/simpo/references/loss-functions.md +351 -0
  203. package/skills/ai-research/06-post-training/slime/SKILL.md +464 -0
  204. package/skills/ai-research/06-post-training/slime/references/api-reference.md +393 -0
  205. package/skills/ai-research/06-post-training/slime/references/troubleshooting.md +387 -0
  206. package/skills/ai-research/06-post-training/torchforge/SKILL.md +433 -0
  207. package/skills/ai-research/06-post-training/torchforge/references/api-reference.md +328 -0
  208. package/skills/ai-research/06-post-training/torchforge/references/troubleshooting.md +410 -0
  209. package/skills/ai-research/06-post-training/trl-fine-tuning/SKILL.md +455 -0
  210. package/skills/ai-research/06-post-training/trl-fine-tuning/references/dpo-variants.md +228 -0
  211. package/skills/ai-research/06-post-training/trl-fine-tuning/references/online-rl.md +83 -0
  212. package/skills/ai-research/06-post-training/trl-fine-tuning/references/reward-modeling.md +123 -0
  213. package/skills/ai-research/06-post-training/trl-fine-tuning/references/sft-training.md +169 -0
  214. package/skills/ai-research/06-post-training/verl/SKILL.md +391 -0
  215. package/skills/ai-research/06-post-training/verl/references/api-reference.md +302 -0
  216. package/skills/ai-research/06-post-training/verl/references/troubleshooting.md +392 -0
  217. package/skills/ai-research/07-safety-alignment/constitutional-ai/SKILL.md +290 -0
  218. package/skills/ai-research/07-safety-alignment/llamaguard/SKILL.md +337 -0
  219. package/skills/ai-research/07-safety-alignment/nemo-guardrails/SKILL.md +297 -0
  220. package/skills/ai-research/07-safety-alignment/prompt-guard/SKILL.md +312 -0
  221. package/skills/ai-research/08-distributed-training/accelerate/SKILL.md +332 -0
  222. package/skills/ai-research/08-distributed-training/accelerate/references/custom-plugins.md +454 -0
  223. package/skills/ai-research/08-distributed-training/accelerate/references/megatron-integration.md +490 -0
  224. package/skills/ai-research/08-distributed-training/accelerate/references/performance.md +526 -0
  225. package/skills/ai-research/08-distributed-training/deepspeed/SKILL.md +141 -0
  226. package/skills/ai-research/08-distributed-training/deepspeed/references/08.md +18 -0
  227. package/skills/ai-research/08-distributed-training/deepspeed/references/09.md +174 -0
  228. package/skills/ai-research/08-distributed-training/deepspeed/references/2020.md +379 -0
  229. package/skills/ai-research/08-distributed-training/deepspeed/references/2023.md +280 -0
  230. package/skills/ai-research/08-distributed-training/deepspeed/references/assets.md +180 -0
  231. package/skills/ai-research/08-distributed-training/deepspeed/references/index.md +36 -0
  232. package/skills/ai-research/08-distributed-training/deepspeed/references/mii.md +119 -0
  233. package/skills/ai-research/08-distributed-training/deepspeed/references/other.md +1192 -0
  234. package/skills/ai-research/08-distributed-training/megatron-core/SKILL.md +366 -0
  235. package/skills/ai-research/08-distributed-training/megatron-core/references/benchmarks.md +250 -0
  236. package/skills/ai-research/08-distributed-training/megatron-core/references/parallelism-guide.md +405 -0
  237. package/skills/ai-research/08-distributed-training/megatron-core/references/production-examples.md +474 -0
  238. package/skills/ai-research/08-distributed-training/megatron-core/references/training-recipes.md +548 -0
  239. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/SKILL.md +231 -0
  240. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_dcp_async_recipe.md +14 -0
  241. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_dcp_overview.md +19 -0
  242. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_dcp_recipe.md +18 -0
  243. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_ddp_notes.md +10 -0
  244. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_device_mesh_tutorial.md +22 -0
  245. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_examples_fsdp2.md +15 -0
  246. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_fsdp1_api.md +9 -0
  247. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_fsdp2_tutorial.md +45 -0
  248. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_fully_shard_api.md +49 -0
  249. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_tp_tutorial.md +22 -0
  250. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/ray_train_fsdp2_example.md +13 -0
  251. package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/torchtitan_fsdp_notes.md +14 -0
  252. package/skills/ai-research/08-distributed-training/pytorch-lightning/SKILL.md +346 -0
  253. package/skills/ai-research/08-distributed-training/pytorch-lightning/references/callbacks.md +437 -0
  254. package/skills/ai-research/08-distributed-training/pytorch-lightning/references/distributed.md +491 -0
  255. package/skills/ai-research/08-distributed-training/pytorch-lightning/references/hyperparameter-tuning.md +557 -0
  256. package/skills/ai-research/08-distributed-training/ray-train/SKILL.md +406 -0
  257. package/skills/ai-research/08-distributed-training/ray-train/references/multi-node.md +629 -0
  258. package/skills/ai-research/09-infrastructure/lambda-labs/SKILL.md +545 -0
  259. package/skills/ai-research/09-infrastructure/lambda-labs/references/advanced-usage.md +612 -0
  260. package/skills/ai-research/09-infrastructure/lambda-labs/references/troubleshooting.md +531 -0
  261. package/skills/ai-research/09-infrastructure/modal/SKILL.md +341 -0
  262. package/skills/ai-research/09-infrastructure/modal/references/advanced-usage.md +504 -0
  263. package/skills/ai-research/09-infrastructure/modal/references/troubleshooting.md +495 -0
  264. package/skills/ai-research/09-infrastructure/skypilot/SKILL.md +509 -0
  265. package/skills/ai-research/09-infrastructure/skypilot/references/advanced-usage.md +492 -0
  266. package/skills/ai-research/09-infrastructure/skypilot/references/troubleshooting.md +571 -0
  267. package/skills/ai-research/10-optimization/awq/SKILL.md +310 -0
  268. package/skills/ai-research/10-optimization/awq/references/advanced-usage.md +325 -0
  269. package/skills/ai-research/10-optimization/awq/references/troubleshooting.md +345 -0
  270. package/skills/ai-research/10-optimization/bitsandbytes/SKILL.md +411 -0
  271. package/skills/ai-research/10-optimization/bitsandbytes/references/memory-optimization.md +522 -0
  272. package/skills/ai-research/10-optimization/bitsandbytes/references/qlora-training.md +522 -0
  273. package/skills/ai-research/10-optimization/bitsandbytes/references/quantization-formats.md +448 -0
  274. package/skills/ai-research/10-optimization/flash-attention/SKILL.md +367 -0
  275. package/skills/ai-research/10-optimization/flash-attention/references/benchmarks.md +216 -0
  276. package/skills/ai-research/10-optimization/flash-attention/references/transformers-integration.md +294 -0
  277. package/skills/ai-research/10-optimization/gguf/SKILL.md +427 -0
  278. package/skills/ai-research/10-optimization/gguf/references/advanced-usage.md +505 -0
  279. package/skills/ai-research/10-optimization/gguf/references/troubleshooting.md +443 -0
  280. package/skills/ai-research/10-optimization/gptq/SKILL.md +450 -0
  281. package/skills/ai-research/10-optimization/gptq/references/calibration.md +338 -0
  282. package/skills/ai-research/10-optimization/gptq/references/integration.md +130 -0
  283. package/skills/ai-research/10-optimization/gptq/references/troubleshooting.md +96 -0
  284. package/skills/ai-research/10-optimization/hqq/SKILL.md +445 -0
  285. package/skills/ai-research/10-optimization/hqq/references/advanced-usage.md +529 -0
  286. package/skills/ai-research/10-optimization/hqq/references/troubleshooting.md +504 -0
  287. package/skills/ai-research/10-optimization/ml-training-recipes/SKILL.md +319 -0
  288. package/skills/ai-research/10-optimization/ml-training-recipes/references/architecture.md +320 -0
  289. package/skills/ai-research/10-optimization/ml-training-recipes/references/biomedical.md +498 -0
  290. package/skills/ai-research/10-optimization/ml-training-recipes/references/domain-specific.md +626 -0
  291. package/skills/ai-research/10-optimization/ml-training-recipes/references/experiment-loop.md +129 -0
  292. package/skills/ai-research/10-optimization/ml-training-recipes/references/optimizers.md +330 -0
  293. package/skills/ai-research/10-optimization/ml-training-recipes/references/scaling-and-selection.md +428 -0
  294. package/skills/ai-research/11-evaluation/bigcode-evaluation-harness/SKILL.md +405 -0
  295. package/skills/ai-research/11-evaluation/bigcode-evaluation-harness/references/benchmarks.md +394 -0
  296. package/skills/ai-research/11-evaluation/bigcode-evaluation-harness/references/custom-tasks.md +425 -0
  297. package/skills/ai-research/11-evaluation/bigcode-evaluation-harness/references/issues.md +395 -0
  298. package/skills/ai-research/11-evaluation/lm-evaluation-harness/SKILL.md +490 -0
  299. package/skills/ai-research/11-evaluation/lm-evaluation-harness/references/api-evaluation.md +491 -0
  300. package/skills/ai-research/11-evaluation/lm-evaluation-harness/references/benchmark-guide.md +489 -0
  301. package/skills/ai-research/11-evaluation/lm-evaluation-harness/references/custom-tasks.md +603 -0
  302. package/skills/ai-research/11-evaluation/lm-evaluation-harness/references/distributed-eval.md +520 -0
  303. package/skills/ai-research/11-evaluation/nemo-evaluator/SKILL.md +494 -0
  304. package/skills/ai-research/11-evaluation/nemo-evaluator/references/adapter-system.md +341 -0
  305. package/skills/ai-research/11-evaluation/nemo-evaluator/references/configuration.md +448 -0
  306. package/skills/ai-research/11-evaluation/nemo-evaluator/references/custom-benchmarks.md +316 -0
  307. package/skills/ai-research/11-evaluation/nemo-evaluator/references/execution-backends.md +362 -0
  308. package/skills/ai-research/12-inference-serving/llama-cpp/SKILL.md +258 -0
  309. package/skills/ai-research/12-inference-serving/llama-cpp/references/optimization.md +90 -0
  310. package/skills/ai-research/12-inference-serving/llama-cpp/references/quantization.md +214 -0
  311. package/skills/ai-research/12-inference-serving/llama-cpp/references/server.md +126 -0
  312. package/skills/ai-research/12-inference-serving/sglang/SKILL.md +442 -0
  313. package/skills/ai-research/12-inference-serving/sglang/references/deployment.md +491 -0
  314. package/skills/ai-research/12-inference-serving/sglang/references/radix-attention.md +414 -0
  315. package/skills/ai-research/12-inference-serving/sglang/references/structured-generation.md +542 -0
  316. package/skills/ai-research/12-inference-serving/tensorrt-llm/SKILL.md +187 -0
  317. package/skills/ai-research/12-inference-serving/tensorrt-llm/references/multi-gpu.md +299 -0
  318. package/skills/ai-research/12-inference-serving/tensorrt-llm/references/optimization.md +243 -0
  319. package/skills/ai-research/12-inference-serving/tensorrt-llm/references/serving.md +471 -0
  320. package/skills/ai-research/12-inference-serving/vllm/SKILL.md +364 -0
  321. package/skills/ai-research/12-inference-serving/vllm/references/optimization.md +227 -0
  322. package/skills/ai-research/12-inference-serving/vllm/references/quantization.md +285 -0
  323. package/skills/ai-research/12-inference-serving/vllm/references/server-deployment.md +256 -0
  324. package/skills/ai-research/12-inference-serving/vllm/references/troubleshooting.md +448 -0
  325. package/skills/ai-research/13-mlops/mlflow/SKILL.md +704 -0
  326. package/skills/ai-research/13-mlops/mlflow/references/deployment.md +745 -0
  327. package/skills/ai-research/13-mlops/mlflow/references/model-registry.md +771 -0
  328. package/skills/ai-research/13-mlops/mlflow/references/tracking.md +681 -0
  329. package/skills/ai-research/13-mlops/swanlab/SKILL.md +406 -0
  330. package/skills/ai-research/13-mlops/swanlab/references/integrations.md +305 -0
  331. package/skills/ai-research/13-mlops/swanlab/references/visualization.md +234 -0
  332. package/skills/ai-research/13-mlops/tensorboard/SKILL.md +629 -0
  333. package/skills/ai-research/13-mlops/tensorboard/references/integrations.md +639 -0
  334. package/skills/ai-research/13-mlops/tensorboard/references/profiling.md +546 -0
  335. package/skills/ai-research/13-mlops/tensorboard/references/visualization.md +621 -0
  336. package/skills/ai-research/13-mlops/weights-and-biases/SKILL.md +590 -0
  337. package/skills/ai-research/13-mlops/weights-and-biases/references/artifacts.md +585 -0
  338. package/skills/ai-research/13-mlops/weights-and-biases/references/integrations.md +701 -0
  339. package/skills/ai-research/13-mlops/weights-and-biases/references/sweeps.md +848 -0
  340. package/skills/ai-research/14-agents/a-evolve/SKILL.md +383 -0
  341. package/skills/ai-research/14-agents/a-evolve/references/README.md +831 -0
  342. package/skills/ai-research/14-agents/a-evolve/references/api.md +594 -0
  343. package/skills/ai-research/14-agents/a-evolve/references/architecture.md +417 -0
  344. package/skills/ai-research/14-agents/a-evolve/references/design-patterns.md +462 -0
  345. package/skills/ai-research/14-agents/a-evolve/references/examples.md +352 -0
  346. package/skills/ai-research/14-agents/a-evolve/references/issues.md +591 -0
  347. package/skills/ai-research/14-agents/a-evolve/references/releases.md +112 -0
  348. package/skills/ai-research/14-agents/a-evolve/references/tutorials.md +819 -0
  349. package/skills/ai-research/14-agents/autogpt/SKILL.md +403 -0
  350. package/skills/ai-research/14-agents/autogpt/references/advanced-usage.md +536 -0
  351. package/skills/ai-research/14-agents/autogpt/references/troubleshooting.md +421 -0
  352. package/skills/ai-research/14-agents/crewai/SKILL.md +498 -0
  353. package/skills/ai-research/14-agents/crewai/references/flows.md +439 -0
  354. package/skills/ai-research/14-agents/crewai/references/tools.md +430 -0
  355. package/skills/ai-research/14-agents/crewai/references/troubleshooting.md +481 -0
  356. package/skills/ai-research/14-agents/langchain/SKILL.md +480 -0
  357. package/skills/ai-research/14-agents/langchain/references/agents.md +500 -0
  358. package/skills/ai-research/14-agents/langchain/references/integration.md +563 -0
  359. package/skills/ai-research/14-agents/langchain/references/rag.md +601 -0
  360. package/skills/ai-research/14-agents/llamaindex/SKILL.md +569 -0
  361. package/skills/ai-research/14-agents/llamaindex/references/agents.md +84 -0
  362. package/skills/ai-research/14-agents/llamaindex/references/data_connectors.md +109 -0
  363. package/skills/ai-research/14-agents/llamaindex/references/query_engines.md +407 -0
  364. package/skills/ai-research/15-rag/chroma/SKILL.md +406 -0
  365. package/skills/ai-research/15-rag/chroma/references/integration.md +39 -0
  366. package/skills/ai-research/15-rag/faiss/SKILL.md +221 -0
  367. package/skills/ai-research/15-rag/faiss/references/index_types.md +281 -0
  368. package/skills/ai-research/15-rag/pinecone/SKILL.md +358 -0
  369. package/skills/ai-research/15-rag/pinecone/references/deployment.md +182 -0
  370. package/skills/ai-research/15-rag/qdrant/SKILL.md +493 -0
  371. package/skills/ai-research/15-rag/qdrant/references/advanced-usage.md +649 -0
  372. package/skills/ai-research/15-rag/qdrant/references/troubleshooting.md +632 -0
  373. package/skills/ai-research/15-rag/sentence-transformers/SKILL.md +255 -0
  374. package/skills/ai-research/15-rag/sentence-transformers/references/models.md +124 -0
  375. package/skills/ai-research/16-prompt-engineering/dspy/SKILL.md +590 -0
  376. package/skills/ai-research/16-prompt-engineering/dspy/references/examples.md +664 -0
  377. package/skills/ai-research/16-prompt-engineering/dspy/references/modules.md +476 -0
  378. package/skills/ai-research/16-prompt-engineering/dspy/references/optimizers.md +567 -0
  379. package/skills/ai-research/16-prompt-engineering/guidance/SKILL.md +572 -0
  380. package/skills/ai-research/16-prompt-engineering/guidance/references/backends.md +555 -0
  381. package/skills/ai-research/16-prompt-engineering/guidance/references/constraints.md +675 -0
  382. package/skills/ai-research/16-prompt-engineering/guidance/references/examples.md +768 -0
  383. package/skills/ai-research/16-prompt-engineering/instructor/SKILL.md +740 -0
  384. package/skills/ai-research/16-prompt-engineering/instructor/references/examples.md +108 -0
  385. package/skills/ai-research/16-prompt-engineering/instructor/references/providers.md +71 -0
  386. package/skills/ai-research/16-prompt-engineering/instructor/references/validation.md +607 -0
  387. package/skills/ai-research/16-prompt-engineering/outlines/SKILL.md +652 -0
  388. package/skills/ai-research/16-prompt-engineering/outlines/references/backends.md +616 -0
  389. package/skills/ai-research/16-prompt-engineering/outlines/references/examples.md +774 -0
  390. package/skills/ai-research/16-prompt-engineering/outlines/references/json_generation.md +653 -0
  391. package/skills/ai-research/17-observability/langsmith/SKILL.md +422 -0
  392. package/skills/ai-research/17-observability/langsmith/references/advanced-usage.md +549 -0
  393. package/skills/ai-research/17-observability/langsmith/references/troubleshooting.md +538 -0
  394. package/skills/ai-research/17-observability/phoenix/SKILL.md +475 -0
  395. package/skills/ai-research/17-observability/phoenix/references/advanced-usage.md +620 -0
  396. package/skills/ai-research/17-observability/phoenix/references/troubleshooting.md +539 -0
  397. package/skills/ai-research/18-multimodal/audiocraft/SKILL.md +564 -0
  398. package/skills/ai-research/18-multimodal/audiocraft/references/advanced-usage.md +667 -0
  399. package/skills/ai-research/18-multimodal/audiocraft/references/troubleshooting.md +505 -0
  400. package/skills/ai-research/18-multimodal/blip-2/SKILL.md +564 -0
  401. package/skills/ai-research/18-multimodal/blip-2/references/advanced-usage.md +681 -0
  402. package/skills/ai-research/18-multimodal/blip-2/references/troubleshooting.md +527 -0
  403. package/skills/ai-research/18-multimodal/clip/SKILL.md +253 -0
  404. package/skills/ai-research/18-multimodal/clip/references/applications.md +208 -0
  405. package/skills/ai-research/18-multimodal/cosmos-policy/SKILL.md +402 -0
  406. package/skills/ai-research/18-multimodal/cosmos-policy/references/libero-commands.md +175 -0
  407. package/skills/ai-research/18-multimodal/cosmos-policy/references/robocasa-commands.md +147 -0
  408. package/skills/ai-research/18-multimodal/llava/SKILL.md +304 -0
  409. package/skills/ai-research/18-multimodal/llava/references/training.md +198 -0
  410. package/skills/ai-research/18-multimodal/openpi/SKILL.md +480 -0
  411. package/skills/ai-research/18-multimodal/openpi/references/checkpoints-and-env-map.md +86 -0
  412. package/skills/ai-research/18-multimodal/openpi/references/config-recipes.md +50 -0
  413. package/skills/ai-research/18-multimodal/openpi/references/pytorch-gotchas.md +49 -0
  414. package/skills/ai-research/18-multimodal/openpi/references/remote-client-pattern.md +48 -0
  415. package/skills/ai-research/18-multimodal/openpi/references/training-debugging.md +46 -0
  416. package/skills/ai-research/18-multimodal/openvla-oft/SKILL.md +441 -0
  417. package/skills/ai-research/18-multimodal/openvla-oft/references/aloha-workflow.md +141 -0
  418. package/skills/ai-research/18-multimodal/openvla-oft/references/config-troubleshooting.md +97 -0
  419. package/skills/ai-research/18-multimodal/openvla-oft/references/libero-workflow.md +115 -0
  420. package/skills/ai-research/18-multimodal/openvla-oft/references/paper-and-checkpoints.md +84 -0
  421. package/skills/ai-research/18-multimodal/segment-anything/SKILL.md +500 -0
  422. package/skills/ai-research/18-multimodal/segment-anything/references/advanced-usage.md +590 -0
  423. package/skills/ai-research/18-multimodal/segment-anything/references/troubleshooting.md +485 -0
  424. package/skills/ai-research/18-multimodal/stable-diffusion/SKILL.md +519 -0
  425. package/skills/ai-research/18-multimodal/stable-diffusion/references/advanced-usage.md +717 -0
  426. package/skills/ai-research/18-multimodal/stable-diffusion/references/troubleshooting.md +556 -0
  427. package/skills/ai-research/18-multimodal/whisper/SKILL.md +317 -0
  428. package/skills/ai-research/18-multimodal/whisper/references/languages.md +190 -0
  429. package/skills/ai-research/19-emerging-techniques/knowledge-distillation/SKILL.md +458 -0
  430. package/skills/ai-research/19-emerging-techniques/knowledge-distillation/references/minillm.md +335 -0
  431. package/skills/ai-research/19-emerging-techniques/long-context/SKILL.md +536 -0
  432. package/skills/ai-research/19-emerging-techniques/long-context/references/extension_methods.md +469 -0
  433. package/skills/ai-research/19-emerging-techniques/long-context/references/fine_tuning.md +612 -0
  434. package/skills/ai-research/19-emerging-techniques/long-context/references/rope.md +403 -0
  435. package/skills/ai-research/19-emerging-techniques/model-merging/SKILL.md +497 -0
  436. package/skills/ai-research/19-emerging-techniques/model-merging/references/coefficient-tuning.md +415 -0
  437. package/skills/ai-research/19-emerging-techniques/model-merging/references/evaluation.md +463 -0
  438. package/skills/ai-research/19-emerging-techniques/model-merging/references/examples.md +429 -0
  439. package/skills/ai-research/19-emerging-techniques/model-merging/references/methods.md +353 -0
  440. package/skills/ai-research/19-emerging-techniques/model-pruning/SKILL.md +495 -0
  441. package/skills/ai-research/19-emerging-techniques/model-pruning/references/wanda.md +348 -0
  442. package/skills/ai-research/19-emerging-techniques/moe-training/SKILL.md +526 -0
  443. package/skills/ai-research/19-emerging-techniques/moe-training/references/architectures.md +433 -0
  444. package/skills/ai-research/19-emerging-techniques/moe-training/references/inference.md +349 -0
  445. package/skills/ai-research/19-emerging-techniques/moe-training/references/training.md +426 -0
  446. package/skills/ai-research/19-emerging-techniques/speculative-decoding/SKILL.md +467 -0
  447. package/skills/ai-research/19-emerging-techniques/speculative-decoding/references/lookahead.md +310 -0
  448. package/skills/ai-research/19-emerging-techniques/speculative-decoding/references/medusa.md +351 -0
  449. package/skills/ai-research/20-ml-paper-writing/academic-plotting/SKILL.md +479 -0
  450. package/skills/ai-research/20-ml-paper-writing/academic-plotting/references/data-visualization.md +509 -0
  451. package/skills/ai-research/20-ml-paper-writing/academic-plotting/references/diagram-generation.md +395 -0
  452. package/skills/ai-research/20-ml-paper-writing/academic-plotting/references/style-guide.md +305 -0
  453. package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/SKILL.md +982 -0
  454. package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/checklists.md +348 -0
  455. package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/citation-workflow.md +563 -0
  456. package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/reviewer-guidelines.md +349 -0
  457. package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/sources.md +165 -0
  458. package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/writing-guide.md +477 -0
  459. package/skills/ai-research/20-ml-paper-writing/presenting-conference-talks/SKILL.md +298 -0
  460. package/skills/ai-research/20-ml-paper-writing/presenting-conference-talks/references/slide-templates.md +505 -0
  461. package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/SKILL.md +270 -0
  462. package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/checklist.md +279 -0
  463. package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/reviewer-guidelines.md +116 -0
  464. package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/section-blueprints.md +400 -0
  465. package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/systems-conferences.md +261 -0
  466. package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/writing-patterns.md +231 -0
  467. package/skills/ai-research/21-research-ideation/brainstorming-research-ideas/SKILL.md +384 -0
  468. package/skills/ai-research/21-research-ideation/creative-thinking-for-research/SKILL.md +366 -0
  469. package/skills/ai-research/22-agent-native-research-artifact/compiler/SKILL.md +245 -0
  470. package/skills/ai-research/22-agent-native-research-artifact/compiler/references/ara-schema.md +439 -0
  471. package/skills/ai-research/22-agent-native-research-artifact/compiler/references/exploration-tree-spec.md +125 -0
  472. package/skills/ai-research/22-agent-native-research-artifact/compiler/references/validation-checklist.md +149 -0
  473. package/skills/ai-research/22-agent-native-research-artifact/research-manager/SKILL.md +324 -0
  474. package/skills/ai-research/22-agent-native-research-artifact/research-manager/references/event-taxonomy.md +124 -0
  475. package/skills/ai-research/22-agent-native-research-artifact/research-manager/references/provenance-tags.md +190 -0
  476. package/skills/ai-research/22-agent-native-research-artifact/research-manager/references/session-protocol.md +162 -0
  477. package/skills/ai-research/22-agent-native-research-artifact/rigor-reviewer/SKILL.md +322 -0
  478. package/skills/ai-research/22-agent-native-research-artifact/rigor-reviewer/references/review-dimensions.md +182 -0
  479. package/skills/ai-research/SKILL.md +101 -0
  480. package/skills/ai-research/SOURCE +38 -0
  481. package/skills/ai-research/index/1-frame.md +18 -0
  482. package/skills/ai-research/index/2-data.md +21 -0
  483. package/skills/ai-research/index/3-train.md +48 -0
  484. package/skills/ai-research/index/4-measure.md +25 -0
  485. package/skills/ai-research/index/5-run.md +23 -0
  486. package/skills/ai-research/index/6-write.md +35 -0
  487. package/skills/ai-research/library.json +3456 -0
  488. package/skills/analyze-app/EVALS.md +82 -0
  489. package/skills/analyze-app/SKILL.md +188 -0
  490. package/skills/design-contract/EVALS.md +80 -0
  491. package/skills/design-contract/SKILL.md +171 -0
  492. package/skills/design-library/EVALS.md +85 -0
  493. package/skills/design-library/INDEX.md +59 -0
  494. package/skills/design-library/SKILL.md +58 -0
  495. package/skills/design-library/SOURCE +131 -0
  496. package/skills/design-library/adaptive-interfaces/skills/colour-independence/SKILL.md +90 -0
  497. package/skills/design-library/adaptive-interfaces/skills/flexible-typography/SKILL.md +83 -0
  498. package/skills/design-library/adaptive-interfaces/skills/information-density/SKILL.md +87 -0
  499. package/skills/design-library/adaptive-interfaces/skills/preference-audit/SKILL.md +70 -0
  500. package/skills/design-library/adaptive-interfaces/skills/responsive-accessibility/SKILL.md +86 -0
  501. package/skills/design-library/adaptive-interfaces/skills/responsive-review/SKILL.md +76 -0
  502. package/skills/design-library/adaptive-interfaces/skills/simplified-views/SKILL.md +97 -0
  503. package/skills/design-library/adaptive-interfaces/skills/specify/SKILL.md +63 -0
  504. package/skills/design-library/adaptive-interfaces/skills/user-preference-respect/SKILL.md +100 -0
  505. package/skills/design-library/cognitive-accessibility/skills/adaptive-personalisation/SKILL.md +61 -0
  506. package/skills/design-library/cognitive-accessibility/skills/assess-load/SKILL.md +48 -0
  507. package/skills/design-library/cognitive-accessibility/skills/cognitive-load-assessment/SKILL.md +60 -0
  508. package/skills/design-library/cognitive-accessibility/skills/contextual-help-design/SKILL.md +61 -0
  509. package/skills/design-library/cognitive-accessibility/skills/error-prevention-recovery/SKILL.md +71 -0
  510. package/skills/design-library/cognitive-accessibility/skills/focus-attention-design/SKILL.md +67 -0
  511. package/skills/design-library/cognitive-accessibility/skills/memory-load-reduction/SKILL.md +60 -0
  512. package/skills/design-library/cognitive-accessibility/skills/plain-language-design/SKILL.md +78 -0
  513. package/skills/design-library/cognitive-accessibility/skills/review/SKILL.md +56 -0
  514. package/skills/design-library/cognitive-accessibility/skills/simplify/SKILL.md +39 -0
  515. package/skills/design-library/cognitive-accessibility/skills/wayfinding-navigation/SKILL.md +64 -0
  516. package/skills/design-library/design-research/skills/behavioural-analytics/SKILL.md +33 -0
  517. package/skills/design-library/design-research/skills/qual-quant-triangulation/SKILL.md +33 -0
  518. package/skills/design-library/inclusive-interaction/skills/audit/SKILL.md +50 -0
  519. package/skills/design-library/inclusive-interaction/skills/design-flow/SKILL.md +58 -0
  520. package/skills/design-library/inclusive-interaction/skills/feedback-and-status/SKILL.md +76 -0
  521. package/skills/design-library/inclusive-interaction/skills/gesture-alternatives/SKILL.md +70 -0
  522. package/skills/design-library/inclusive-interaction/skills/keyboard-navigation/SKILL.md +99 -0
  523. package/skills/design-library/inclusive-interaction/skills/keyboard-review/SKILL.md +54 -0
  524. package/skills/design-library/inclusive-interaction/skills/motion-sensitivity/SKILL.md +79 -0
  525. package/skills/design-library/inclusive-interaction/skills/multi-modal-input/SKILL.md +70 -0
  526. package/skills/design-library/inclusive-interaction/skills/touch-target-design/SKILL.md +71 -0
  527. package/skills/design-library/inclusive-interaction/skills/voice-interaction/SKILL.md +68 -0
  528. package/skills/design-library/visual-critique/skills/critique-affordance/SKILL.md +45 -0
  529. package/skills/design-library/visual-critique/skills/critique-brand-consistency/SKILL.md +42 -0
  530. package/skills/design-library/visual-critique/skills/critique-color/SKILL.md +44 -0
  531. package/skills/design-library/visual-critique/skills/critique-composition/SKILL.md +46 -0
  532. package/skills/design-library/visual-critique/skills/critique-information-density/SKILL.md +45 -0
  533. package/skills/design-library/visual-critique/skills/critique-typography/SKILL.md +45 -0
  534. package/skills/design-library/visual-critique/skills/critique-visual-hierarchy/SKILL.md +40 -0
  535. package/skills/feature-audit/EVALS.md +83 -0
  536. package/skills/feature-audit/SKILL.md +326 -0
  537. package/skills/harness/EVALS.md +81 -0
  538. package/skills/harness/SKILL.md +88 -0
  539. package/skills/i-have-adhd/EVALS.md +80 -0
  540. package/skills/i-have-adhd/SKILL.md +183 -0
  541. package/skills/no-ai-slop/EVALS.md +89 -0
  542. package/skills/no-ai-slop/SKILL.md +209 -0
  543. package/skills/no-ai-slop/eval.md +52 -0
  544. package/skills/plan-add/EVALS.md +79 -0
  545. package/skills/plan-add/SKILL.md +179 -0
  546. package/skills/plan-add/render_table.py +72 -0
  547. package/skills/plan-status/EVALS.md +78 -0
  548. package/skills/plan-status/SKILL.md +52 -0
  549. package/skills/plan-sync/EVALS.md +80 -0
  550. package/skills/plan-sync/SKILL.md +69 -0
  551. package/skills/pm-frameworks/SKILL.md +33 -0
  552. package/skills/pm-frameworks/SOURCE +39 -0
  553. package/skills/pm-frameworks/intended-vs-implemented/SKILL.md +42 -0
  554. package/skills/pm-frameworks/opportunity-solution-tree/SKILL.md +64 -0
  555. package/skills/ponytail/EVALS.md +80 -0
  556. package/skills/ponytail/SKILL.md +124 -0
  557. package/skills/product-analysis/EVALS.md +103 -0
  558. package/skills/product-analysis/SKILL.md +361 -0
  559. package/skills/research/EVALS.md +104 -0
  560. package/skills/research/SKILL.md +570 -0
  561. package/skills/rl-env/SKILL.md +53 -0
  562. package/skills/rl-env/SOURCE +41 -0
  563. package/skills/rl-env/generate-nemo-gym-env/SKILL.md +169 -0
  564. package/skills/rl-env/generate-nemo-gym-env/references/architecture.md +114 -0
  565. package/skills/rl-env/generate-openenv-env/SKILL.md +183 -0
  566. package/skills/rl-env/generate-openenv-env/references/architecture.md +82 -0
  567. package/skills/rl-env/generate-ors-env/SKILL.md +209 -0
  568. package/skills/rl-env/generate-ors-env/references/architecture.md +113 -0
  569. package/skills/rl-env/generate-verifiers-env/SKILL.md +188 -0
  570. package/skills/rl-env/generate-verifiers-env/references/architecture.md +119 -0
  571. package/skills/rl-env/rl-env-from-description/SKILL.md +124 -0
  572. package/skills/rl-env/rl-env-from-description/references/interview.md +75 -0
  573. package/skills/rl-env/rl-env-from-description/references/nemo_gym.md +41 -0
  574. package/skills/rl-env/rl-env-from-description/references/openenv.md +35 -0
  575. package/skills/rl-env/rl-env-from-description/references/ors.md +50 -0
  576. package/skills/rl-env/rl-env-from-description/references/verifiers.md +39 -0
  577. package/skills/tezgah-contract/EVALS.md +78 -0
  578. package/skills/tezgah-contract/SKILL.md +792 -0
  579. package/statusline.py +129 -0
  580. package/workflows/graph-impact.js +153 -0
  581. package/workflows/graph-map.js +158 -0
  582. package/workflows/graph-review.js +170 -0
@@ -0,0 +1,400 @@
1
+ <!-- vendored from orchestra-research/AI-research-SKILLs@773a52944ba4747a18bd4ae9ade53fff041adcbc 20-ml-paper-writing/systems-paper-writing/references/section-blueprints.md; MIT (c) Orchestra Research -->
2
+ # Section-by-Section Blueprints for Systems Papers
3
+
4
+ Detailed paragraph-level templates for each section of a 10–12 page systems paper. Each subsection includes authoritative source quotes and structural examples from best papers.
5
+
6
+ ---
7
+
8
+ ## Authoritative Source References
9
+
10
+ | # | Author(s) | Title | Affiliation / Context | URL |
11
+ |---|-----------|-------|----------------------|-----|
12
+ | 1 | Roy Levin & David D. Redell | "How (and How Not) to Write a Good Systems Paper" | SOSP'83 PC Chairs, USENIX/ACM SIGOPS | https://www.usenix.org/conferences/author-resources/how-and-how-not-write-good-systems-paper |
13
+ | 2 | Irene Zhang | "Hints on how to write an SOSP paper" | MSR/UW, SOSP/OSDI PC | https://irenezhang.net/blog/2021/06/05/hints.html |
14
+ | 3 | Gernot Heiser | Style Guide + Paper Writing Talk | UNSW, seL4 author | https://gernot-heiser.org/style-guide.html |
15
+ | 4 | Timothy Roscoe | "Writing reviews for systems conferences" | ETH Zürich | https://people.inf.ethz.ch/troscoe/pubs/review-writing.pdf |
16
+ | 5 | Yi Ding | "How to write good systems papers?" | — | https://counterfac.medium.com/how-to-write-good-systems-papers-b6ef3b7043ff |
17
+ | 6 | hzwer & DingXiaoH | WritingAIPaper | GitHub (1.3k+ stars) | https://github.com/hzwer/WritingAIPaper |
18
+ | 7 | MLNLP-World | Paper-Writing-Tips | GitHub (4.4k stars) | https://github.com/MLNLP-World/Paper-Writing-Tips |
19
+ | 8 | RU-System-Software-and-Security | Paper_Writing_Tips | GitHub | https://github.com/RU-System-Software-and-Security/Paper_Writing_Tips |
20
+
21
+ ---
22
+
23
+ ## Abstract Blueprint (150–250 words)
24
+
25
+ ### Structure: 5 Sentences
26
+
27
+ ```text
28
+ S1 — Context: What broad problem area is this work in? Why does it matter?
29
+ (e.g., "Large-scale ML training clusters waste 30–50% of GPU cycles due to...")
30
+ S2 — Gap: What specific limitation of current approaches does this work address?
31
+ (e.g., "Existing schedulers cannot adapt to ... because ...")
32
+ S3 — Thesis: What is your key insight/approach?
33
+ (e.g., "We present X, which uses [technique] to achieve [property] for [workload] in [environment]")
34
+ S4 — Results: What are the headline numbers?
35
+ (e.g., "Evaluation on [N]-GPU cluster shows X improves [metric] by [Y]% over [baselines]")
36
+ S5 — Impact: Broader significance or availability.
37
+ (e.g., "X is open-sourced at [URL] and has been deployed at [organization]")
38
+ ```
39
+
40
+ ### Guidance from Sources
41
+
42
+ - **Levin & Redell**: "Can you state the new idea concisely? [...] Use them in the abstract and introduction."
43
+ - **Irene Zhang**: "The abstract is probably the hardest section to write because you cannot use any terms or concepts that you introduced in the paper."
44
+ - **Gernot Heiser**: The abstract must be self-contained — no forward references, no undefined jargon.
45
+
46
+ ### Structural Examples
47
+
48
+ **Blox (EuroSys'24)**: Abstract states 7 scheduling abstractions, names the system, lists concrete metrics.
49
+
50
+ **Sia (SOSP'23)**: Abstract follows problem → insight → approach → results structure in exactly 5 sentences.
51
+
52
+ ---
53
+
54
+ ## S1 Introduction Blueprint (1.5–2 pages)
55
+
56
+ ### Paragraph-by-Paragraph Structure
57
+
58
+ #### Para 1–2: Problem Statement (~0.5 page)
59
+
60
+ **Purpose**: Establish the domain and its importance with concrete, quantitative evidence.
61
+
62
+ **Template**:
63
+ ```text
64
+ [Domain] is critical for [reason]. [Concrete statistic about scale/impact].
65
+ However, [specific challenge] leads to [quantified inefficiency].
66
+ For example, [real-world scenario with numbers].
67
+ ```
68
+
69
+ **Guidance**:
70
+ - Levin & Redell: "What exactly is the problem being solved? Is it a real problem?"
71
+ - Irene Zhang: "clearly state your target environment (Z) and application (Y)"
72
+ - Use production numbers when available (cluster size, throughput, cost)
73
+
74
+ #### Para 3–4: Gap Analysis (~0.5 page)
75
+
76
+ **Purpose**: Show that existing approaches fall short. Each gap is specific and evidence-backed.
77
+
78
+ **Template**:
79
+ ```text
80
+ Existing systems address [aspect] through [approaches], but they fall short in [N] ways:
81
+
82
+ G1: [First gap] — [existing system] assumes [assumption], which breaks when [condition]. [Evidence].
83
+ G2: [Second gap] — [existing approach] cannot handle [scenario] because [reason]. [Evidence].
84
+ G3: [Third gap] — ...
85
+ ```
86
+
87
+ **Guidance**:
88
+ - Irene Zhang: "clearly state why previous systems do not meet the needs of applications Y in environment Z"
89
+ - Each gap should be falsifiable — a reviewer can verify the claim
90
+ - Lucid (ASPLOS'23) exemplifies this: G1–G5 mapped precisely to A1–A5
91
+
92
+ #### Para 5: Key Insight (1 paragraph)
93
+
94
+ **Purpose**: The core thesis statement — the one sentence that captures your contribution.
95
+
96
+ **Template**:
97
+ ```text
98
+ Our key insight is that [observation about the problem] enables [new approach].
99
+ Based on this insight, we present [System Name], a [one-line description]
100
+ that [key differentiator] for [target applications] in [target environment].
101
+ ```
102
+
103
+ **Guidance**:
104
+ - Irene Zhang's thesis formula: "X is better for applications Y running in environment Z"
105
+ - Levin & Redell: "What are the key ideas? Can you state them concisely?"
106
+ - This paragraph should be quotable by reviewers in their recommendation
107
+
108
+ #### Para 6–7: Contributions (~0.5 page)
109
+
110
+ **Purpose**: Numbered list of 3–5 testable claims, each linked to a paper section.
111
+
112
+ **Template**:
113
+ ```text
114
+ This paper makes the following contributions:
115
+ 1. [Insight/Analysis] — We identify [N observations] about [domain] (§2).
116
+ 2. [Design] — We design [component], which [key property] (§3).
117
+ 3. [System] — We implement [System Name] in [LOC] lines of [language] (§4).
118
+ 4. [Evaluation] — We evaluate [System Name] on [workload], showing [headline result] (§5).
119
+ ```
120
+
121
+ **Structural Examples**:
122
+ - **Blox (EuroSys'24)**: 7 contributions covering abstractions + simulator + case studies
123
+ - **Sia (SOSP'23)**: 5 primary contributions with section cross-references
124
+ - **Lucid (ASPLOS'23)**: Contributions mirror the G1–G5 gap structure
125
+
126
+ ---
127
+
128
+ ## S2 Background & Motivation Blueprint (1–1.5 pages)
129
+
130
+ ### Para 1–3: Technical Background (~0.5 page)
131
+
132
+ **Purpose**: Define terms and describe the system environment the reader needs to understand.
133
+
134
+ **Template**:
135
+ ```text
136
+ [Brief description of the domain/system being studied].
137
+ [Key Term 1] refers to [definition]. [Key Term 2] refers to [definition].
138
+ Figure [N] shows the [architecture/workflow] of [system being studied].
139
+ ```
140
+
141
+ **Guidance**:
142
+ - Gernot Heiser: "define-before-use" — every term must be defined before first substantive use
143
+ - Only include background necessary for understanding this paper's contribution
144
+ - If background exceeds 0.5 page, the reader may not be in your target audience
145
+
146
+ ### Para 4–6: Production Observations (~0.5–1 page)
147
+
148
+ **Purpose**: Present data-driven observations that motivate the design.
149
+
150
+ **Template**:
151
+ ```text
152
+ To understand [aspect], we analyze [data source] from [environment].
153
+
154
+ Observation 1: [Finding]. Figure [N] shows that [evidence]. This implies [design insight].
155
+ Observation 2: [Finding]. Table [N] shows that [evidence]. This suggests [design direction].
156
+ Observation 3: [Finding]. [Evidence]. Combined with O1 and O2, this motivates [approach].
157
+ ```
158
+
159
+ **Guidance**:
160
+ - Irene Zhang: "clearly motivate Y and Z. Why is application Y important?"
161
+ - Each observation should logically lead to a design decision in §3
162
+ - Use figures/tables to present data — reviewers trust visualizations over prose claims
163
+
164
+ **Structural Examples**:
165
+ - **GFS (arXiv 2025)**: 3 production observations → 3 design insights → 3 system components
166
+ - **Lucid (ASPLOS'23)**: 5 cluster characteristic analyses from Azure/Alibaba traces
167
+
168
+ ---
169
+
170
+ ## S3 Design Blueprint (3–4 pages)
171
+
172
+ ### Para 1–2: System Architecture Overview (~0.5 page)
173
+
174
+ **Purpose**: Architecture diagram + walkthrough. This is the "page-one figure" equivalent for the design section.
175
+
176
+ **Template**:
177
+ ```text
178
+ Figure [N] shows the architecture of [System Name]. [System Name] consists of [N] components:
179
+ (1) [Component A], which [function];
180
+ (2) [Component B], which [function];
181
+ (3) [Component C], which [function].
182
+
183
+ A typical request flows as follows: [step-by-step walkthrough of data/control flow].
184
+ ```
185
+
186
+ **Guidance**:
187
+ - Yi Ding: "Draw a picture first" — the architecture diagram anchors the entire design section
188
+ - Gernot Heiser: "Maintaining user state" — the reader should hold the architecture in mind while reading subsections
189
+
190
+ ### Subsections: Module-by-Module Design (~2–2.5 pages)
191
+
192
+ **For each module/subsection**:
193
+
194
+ ```text
195
+ §3.X [Module Name]
196
+
197
+ [What problem this module solves — 1 sentence].
198
+
199
+ [Design choice]: We use [approach] because [reason].
200
+ [Alternative 1]: [description] was considered but rejected because [trade-off].
201
+ [Alternative 2]: [description] does not work because [limitation].
202
+
203
+ [Detailed mechanism — 1–3 paragraphs explaining how it works].
204
+ [Pseudocode or algorithm if applicable — Algorithm [N]].
205
+ ```
206
+
207
+ **Guidance**:
208
+ - Irene Zhang: "Every design choice made in X should be discussed with alternatives and the reasons for the choice"
209
+ - Levin & Redell: "What were the alternatives considered at various points, and why were the choices made?"
210
+ - Reviewers use alternatives discussion to judge design maturity
211
+
212
+ ### Design Alternatives Summary (~0.5–1 page)
213
+
214
+ For complex systems, a summary table of design decisions is highly effective:
215
+
216
+ ```text
217
+ | Decision | Our Choice | Alternative | Why Not |
218
+ |----------|-----------|-------------|---------|
219
+ | Scheduling policy | [X] | [Y] | [reason] |
220
+ | Communication | [X] | [Y] | [reason] |
221
+ | Fault tolerance | [X] | [Y] | [reason] |
222
+ ```
223
+
224
+ **Structural Examples**:
225
+ - **Blox (EuroSys'24)**: 7 abstraction modules each with dedicated subsection
226
+ - **Sia (SOSP'23)**: 3-phase scheduling design with alternatives per phase
227
+
228
+ ---
229
+
230
+ ## S4 Implementation Blueprint (0.5–1 page)
231
+
232
+ ### Structure
233
+
234
+ ```text
235
+ Para 1: System overview — [Language], [LOC], built on top of [framework/library].
236
+ We implement [System Name] as [deployment model: library/service/kernel module].
237
+
238
+ Para 2: Key engineering decisions — [Non-obvious choices]:
239
+ - [Decision 1]: We chose [X] over [Y] because [reason].
240
+ - [Decision 2]: [Integration detail with existing system].
241
+ - [Decision 3]: [Performance-critical optimization].
242
+
243
+ Para 3 (optional): Deployment experience — [If applicable, brief deployment notes].
244
+ ```
245
+
246
+ **Guidance**:
247
+ - Levin & Redell: "Does the paper describe something that has actually been implemented, or is it merely a proposal? Are the lessons drawn from experience or from thought experiment?"
248
+ - Keep this section concise — reviewers care about design and evaluation, not engineering diaries
249
+
250
+ ---
251
+
252
+ ## S5 Evaluation Blueprint (3–4 pages)
253
+
254
+ ### Para 1–2: Experimental Setup (~0.5 page)
255
+
256
+ ```text
257
+ **Testbed**: [Hardware description — GPUs, CPUs, network, storage].
258
+ **Baselines**: [System A] ([citation]), [System B] ([citation]), [System C] ([citation]).
259
+ **Workloads**: [Workload 1 — description], [Workload 2 — description].
260
+ **Metrics**: [Primary metric] (higher is better), [Secondary metric].
261
+ **Configuration**: [Key parameter settings for all systems].
262
+ ```
263
+
264
+ ### Subsection: End-to-End Comparison (~1–1.5 pages)
265
+
266
+ **Per experiment block**:
267
+ ```text
268
+ §5.X [Experiment Name]
269
+
270
+ Hypothesis: We expect [System Name] to [outperform/match] [baseline] on [metric]
271
+ because [design rationale linking back to §3].
272
+
273
+ [Results description with figure/table references].
274
+ Figure [N] shows [key finding]. [System Name] achieves [X]% improvement over [baseline]
275
+ on [workload] because [explanation linking to design].
276
+
277
+ Conclusion: [System Name] [outperforms/matches] [baseline] by [X]% on [metric],
278
+ confirming that [design choice from §3] is effective for [workload].
279
+ ```
280
+
281
+ **Critical**: Irene Zhang's three-statement rule:
282
+ 1. **Hypothesis** at subsection start
283
+ 2. **Conclusion** at subsection end
284
+ 3. **Caption** on the figure/table
285
+
286
+ ### Subsection: Microbenchmarks / Ablation (~1–1.5 pages)
287
+
288
+ ```text
289
+ §5.Y Ablation Study
290
+
291
+ To understand the contribution of each component, we disable them individually:
292
+ - [System Name] w/o [Component A]: [result] — [Component A] contributes [X]%.
293
+ - [System Name] w/o [Component B]: [result] — [Component B] contributes [Y]%.
294
+ - [System Name] w/o [Component C]: [result] — [Component C] contributes [Z]%.
295
+
296
+ Table [N] summarizes the ablation results. [Key takeaway about which components matter most].
297
+ ```
298
+
299
+ ### Subsection: Scalability (~0.5 page)
300
+
301
+ ```text
302
+ §5.Z Scalability
303
+
304
+ Figure [N] shows [metric] as [scale dimension] increases from [min] to [max].
305
+ [System Name] scales [linearly/sub-linearly] because [reason].
306
+ At [max scale], [System Name] achieves [result], compared to [baseline] at [result].
307
+ ```
308
+
309
+ **Structural Examples**:
310
+ - **Sia (SOSP'23)**: Evaluation on 4 workload mixes × 3 cluster sizes, ablation of 3 components
311
+ - **Blox (EuroSys'24)**: 7 case studies each with dedicated evaluation subsection
312
+
313
+ ---
314
+
315
+ ## S6 Related Work Blueprint (1 page)
316
+
317
+ ### Structure: Group by Methodology
318
+
319
+ ```text
320
+ **[Category 1: e.g., Heuristic Schedulers].**
321
+ [System A] [citation] uses [approach] for [goal].
322
+ [System B] [citation] extends this with [technique].
323
+ Unlike these systems, [our system] [key difference].
324
+
325
+ **[Category 2: e.g., Learning-Based Schedulers].**
326
+ [System C] [citation] applies [ML technique] to [problem].
327
+ [System D] [citation] uses [approach] but requires [limitation].
328
+ [Our system] differs by [key distinction].
329
+
330
+ **[Category 3: e.g., Cluster Management].**
331
+ ...
332
+ ```
333
+
334
+ **Guidance**:
335
+ - Levin & Redell: "Are comparisons with previous work clear and explicit?"
336
+ - Never just list papers — always state how your work differs
337
+ - Irene Zhang: Use a comparison table when comparing 4+ systems
338
+
339
+ ### Optional: Comparison Table
340
+
341
+ ```text
342
+ | System | [Dim 1] | [Dim 2] | [Dim 3] | [Dim 4] |
343
+ |--------|---------|---------|---------|---------|
344
+ | [A] | ✓ | ✗ | ✓ | ✗ |
345
+ | [B] | ✗ | ✓ | ✗ | ✓ |
346
+ | Ours | ✓ | ✓ | ✓ | ✓ |
347
+ ```
348
+
349
+ ---
350
+
351
+ ## S7 Conclusion Blueprint (0.5 page)
352
+
353
+ ### Structure: 3 Sentences + Optional Future Work
354
+
355
+ ```text
356
+ Para 1 (3 sentences):
357
+ S1: [Problem restated — what challenge this paper addressed].
358
+ S2: [Solution — what [System Name] does and how].
359
+ S3: [Key result — headline evaluation numbers].
360
+
361
+ Para 2 (optional, 2–3 sentences):
362
+ [Future directions — what extensions or open problems remain].
363
+ ```
364
+
365
+ **Guidance**:
366
+ - Irene Zhang: "summarize your paper in 3 sentences: hypothesis, solution, result"
367
+ - Do not introduce new information in the conclusion
368
+ - Keep it under half a page
369
+
370
+ ---
371
+
372
+ ## Structural Exemplar Analysis
373
+
374
+ > **Note**: Papers below are selected as structural exemplars for their writing quality and organization. Those verified as official best paper award winners are marked with (Best Paper Award). Venue and year information has been verified against official conference websites. Papers without the award marker are included for their exemplary structure, not as best-paper claims.
375
+
376
+ ### OSDI/NSDI (USENIX Format)
377
+
378
+ | Year | Paper | Structural Pattern | Key Takeaway |
379
+ |------|-------|--------------------|--------------|
380
+ | 2025 | Basilisk (OSDI) (Best Paper Award) | Formal verification | Theorem-proof structure in design section |
381
+ | 2024 | Anvil (OSDI) (Best Paper Award) | Cluster management verification | Liveness property decomposition |
382
+ | 2024 | ChameleonAPI (OSDI) (Best Paper Award) | ML systems | API customization pipeline as workflow |
383
+ | 2025 | NDD (NSDI) (Best Paper Award) | Network verification | Decision diagram formalization |
384
+
385
+ ### ASPLOS/SOSP (ACM Format)
386
+
387
+ | Year | Paper | Structural Pattern | Key Takeaway |
388
+ |------|-------|--------------------|--------------|
389
+ | 2025 | CXLfork (ASPLOS) (Best Paper Award) | Hardware+systems | Hardware mechanism + software design dual sections |
390
+ | 2024 | Centauri (ASPLOS) (Best Paper Award) | ML training scheduling | Overlap analysis → scheduler design |
391
+ | 2023 | TreeSLS (SOSP) (Best Paper Award) | Persistent microkernel | NVM observations → tree-structured design |
392
+ | 2023 | Sia (SOSP) | GPU scheduling | 5 contributions + 3-phase design |
393
+
394
+ ### Common Structural Traits in Exemplar Papers
395
+
396
+ 1. **Clear thesis in abstract sentence 3** — every best paper has a quotable thesis
397
+ 2. **Numbered contributions with section maps** — reviewers can trace claims
398
+ 3. **Architecture figure within first 3 pages** — visual anchor for the design
399
+ 4. **Alternatives discussed for every major decision** — shows design maturity
400
+ 5. **Ablation experiments present** — isolate each component's contribution
@@ -0,0 +1,261 @@
1
+ <!-- vendored from orchestra-research/AI-research-SKILLs@773a52944ba4747a18bd4ae9ade53fff041adcbc 20-ml-paper-writing/systems-paper-writing/references/systems-conferences.md; MIT (c) Orchestra Research -->
2
+ # Systems Conference Guide: OSDI, NSDI, ASPLOS, SOSP
3
+
4
+ This reference provides comprehensive details for top systems conferences, including deadlines, formatting requirements, track descriptions, and submission strategies.
5
+
6
+ ---
7
+
8
+ ## Conference Overview
9
+
10
+ | Conference | Full Name | Page Limit | Template | Tracks |
11
+ |------------|-----------|------------|----------|--------|
12
+ | **OSDI 2026** | 20th USENIX Symposium on Operating Systems Design and Implementation | 12 pages (+2 camera-ready) | USENIX `usenix-2020-09.sty` | Research + Operational Systems |
13
+ | **NSDI 2027** | 24th USENIX Symposium on Networked Systems Design and Implementation | 12 pages | USENIX `usenix-2020-09.sty` | Research / Frontiers / Operational |
14
+ | **ASPLOS 2027** | ACM International Conference on Architectural Support for Programming Languages and Operating Systems | 12 pages (ACM) | ACM SIGPLAN `acmart.cls` | Single track, dual review cycles |
15
+ | **SOSP 2026** | 32nd ACM Symposium on Operating Systems Principles | 12 pages | ACM SIGPLAN `acmart.cls` | Single track |
16
+
17
+ > **OSDI 2026**: New "Operational Systems" track. Max 8 papers per author. Encourages appropriate paper length (don't pad to 12 pages). Target acceptance rate ≥20%. No author response period; uses "conditional accept" instead of major revision.
18
+ >
19
+ > **NSDI 2027**: Two deadlines (Spring/Fall). New "Frontiers Track" for ambitious, forward-looking ideas. All papers undergo Introduction prescreening. Rejected papers may receive one-shot revision opportunity.
20
+ >
21
+ > **ASPLOS 2027**: Two cycles (April/September). New rapid review round (only first 2 pages reviewed). Evaluates contributions to architecture/PL/OS core areas. Max 4 papers per author per cycle.
22
+ >
23
+ > **SOSP 2026**: ACM SIGPLAN format. Optional Artifact Evaluation. Double-blind review. Encourages breakthrough research directions.
24
+
25
+ ---
26
+
27
+ ## Deadlines & Key Dates
28
+
29
+ ### OSDI 2026 (Seattle, WA, USA | July 13–15, 2026)
30
+
31
+ | Milestone | Date |
32
+ |-----------|------|
33
+ | Abstract registration | December 4, 2025, 5:59 PM EST |
34
+ | Full paper submission | December 11, 2025, 5:59 PM EST |
35
+ | Notification | March 26, 2026 |
36
+ | Camera-ready | June 9, 2026 |
37
+
38
+ ### NSDI 2027 (Providence, RI, USA | May 11–13, 2027)
39
+
40
+ **Spring Deadline:**
41
+
42
+ | Milestone | Date |
43
+ |-----------|------|
44
+ | Titles and abstracts | April 16, 2026, 11:59 PM EDT |
45
+ | Full paper | April 23, 2026, 11:59 PM EDT |
46
+ | Notification | July 23, 2026 |
47
+ | Camera-ready | October 20, 2026 |
48
+
49
+ **Fall Deadline:**
50
+
51
+ | Milestone | Date |
52
+ |-----------|------|
53
+ | Titles and abstracts | September 10, 2026, 11:59 PM EDT |
54
+ | Full paper | September 17, 2026, 11:59 PM EDT |
55
+ | Notification | December 8, 2026 |
56
+ | Camera-ready | March 4, 2027 |
57
+
58
+ ### ASPLOS 2027
59
+
60
+ **April Cycle:**
61
+
62
+ | Milestone | Date |
63
+ |-----------|------|
64
+ | Full paper submission | April 15, 2026 (AoE) |
65
+ | Author response | July 6–9, 2026 |
66
+ | Notification | July 27, 2026 |
67
+
68
+ **September Cycle:**
69
+
70
+ | Milestone | Date |
71
+ |-----------|------|
72
+ | Full paper submission | September 9, 2026 (AoE) |
73
+ | Author response | December 1–4, 2026 |
74
+ | Notification | December 21, 2026 |
75
+
76
+ ### SOSP 2026 (September 30, 2026)
77
+
78
+ | Milestone | Date |
79
+ |-----------|------|
80
+ | Abstract registration | March 26, 2026 (AoE) |
81
+ | Full paper submission | April 1, 2026 (AoE) |
82
+ | Notification | July 3, 2026 |
83
+ | Camera-ready | August 28, 2026 |
84
+ | Workshops | September 29, 2026 |
85
+ | Conference | September 30, 2026 |
86
+
87
+ ---
88
+
89
+ ## Track Descriptions
90
+
91
+ ### OSDI 2026 Tracks
92
+
93
+ **Research Track**: Broad interest in operating systems design, implementation, analysis, evaluation, and deployment. Topics include:
94
+ - Operating systems, their interaction with hardware/software, and their role as building blocks for other systems
95
+ - Virtualization, including virtual machine monitors, hypervisors, and OS-level virtualization
96
+ - File and storage systems, distributed systems, cloud computing
97
+ - Systems for machine learning/AI, security and privacy, embedded/real-time systems
98
+
99
+ **Operational Systems Track** (NEW):
100
+ - Papers describing deployed and operational systems with valuable lessons
101
+ - Title must end with "(Operational Systems)"
102
+ - Evaluation criteria focus on deployment insights rather than novelty
103
+
104
+ ### NSDI 2027 Tracks
105
+
106
+ **Research Track**: Original research on networked systems design and implementation.
107
+
108
+ **Frontiers Track** (NEW):
109
+ - For ambitious, forward-looking ideas in networked systems
110
+ - May have less complete evaluation but must present compelling vision
111
+
112
+ **Operational Track**: Systems deployed at scale with operational insights.
113
+
114
+ ### ASPLOS 2027 Review Process
115
+
116
+ **Rapid Review Round** (NEW):
117
+ - Reviewers read ONLY the first 2 pages to decide if paper merits full review
118
+ - First 2 pages must be self-contained: problem, approach, key results, contribution
119
+ - Papers failing rapid review receive brief feedback and are rejected
120
+
121
+ **Full Review Round**:
122
+ - Standard double-blind review process
123
+ - Author response period
124
+ - Major revision available (not just accept/reject)
125
+
126
+ ### SOSP 2026 Features
127
+
128
+ - **Artifact Evaluation** (optional but encouraged): Submit artifacts for reproducibility
129
+ - **Author Response**: 500-word limit, no new experiments allowed
130
+
131
+ ---
132
+
133
+ ## Formatting Requirements
134
+
135
+ ### USENIX Format (OSDI, NSDI)
136
+
137
+ ```latex
138
+ % USENIX format setup
139
+ \documentclass[letterpaper,twocolumn,10pt]{article}
140
+ \usepackage{usenix-2020-09}
141
+
142
+ % Key specifications:
143
+ % - Paper size: US Letter (8.5" x 11")
144
+ % - Font: Times Roman, 10pt on 12pt leading
145
+ % - Text block: 7" x 9"
146
+ % - Two columns, 0.33" column separation
147
+ % - Page limit: 12 pages (excluding references)
148
+ ```
149
+
150
+ ### ACM SIGPLAN Format (ASPLOS, SOSP)
151
+
152
+ ```latex
153
+ % ACM SIGPLAN format setup
154
+ \documentclass[sigplan,10pt]{acmart}
155
+
156
+ % For submission (hide copyright block):
157
+ \setcopyright{none}
158
+ \settopmatter{printfolios=true, printccs=false, printacmref=false}
159
+ \renewcommand\footnotetextcopyrightpermission[1]{}
160
+
161
+ % Key specifications:
162
+ % - Paper size: US Letter
163
+ % - Font: 10pt
164
+ % - Text block: 178mm x 229mm
165
+ % - Two columns
166
+ % - Page limit: 12 pages (excluding references)
167
+ ```
168
+
169
+ ---
170
+
171
+ ## Submission Rules
172
+
173
+ ### OSDI 2026
174
+
175
+ - **Max submissions per author**: 8 papers
176
+ - **No author response period**
177
+ - **Conditional accept** replaces major revision
178
+ - **Anonymization**: System name must differ from arXiv/talks
179
+ - **Paper length**: Encouraged to be as short as needed (don't pad to 12 pages)
180
+ - **AI policy**: Generative AI tools allowed if disclosed; AI cannot be listed as author
181
+
182
+ ### NSDI 2027
183
+
184
+ - **Prescreening via Introduction**: All papers first evaluated based on Introduction quality
185
+ - **One-shot revision**: Rejected papers may receive revision opportunity
186
+ - **Dual deadlines**: Spring (April 2026) + Fall (September 2026)
187
+ - **Track selection**: Must choose Research, Frontiers, or Operational at submission
188
+
189
+ ### ASPLOS 2027
190
+
191
+ - **Max submissions per author per cycle**: 4 papers
192
+ - **Rapid review**: Only first 2 pages reviewed initially
193
+ - **Dual cycles**: April + September
194
+ - **Resubmission note**: Required if previously submitted to ASPLOS
195
+ - **Must advance**: Architecture, Programming Languages, or Operating Systems research
196
+
197
+ ### SOSP 2026
198
+
199
+ - **Artifact Evaluation**: Optional but recommended
200
+ - **Author response**: 500-word limit, no new experiments
201
+ - **Anonymous system name**: Required, different from public versions
202
+ - **Double-blind**: Authors must not be identifiable
203
+
204
+ ---
205
+
206
+ ## Format Conversion: ML Venue → Systems Venue
207
+
208
+ When converting a paper from an ML venue to a systems venue, the changes go beyond template swapping:
209
+
210
+ | Aspect | ML Venue | Systems Venue | Action |
211
+ |-------|----------|---------------|--------|
212
+ | **Page limit** | 7-9 pages | 12 pages | Expand with system design details |
213
+ | **Evaluation** | Benchmarks, ablations | End-to-end + microbenchmarks | Add system-level evaluation |
214
+ | **Contribution framing** | Algorithmic novelty | System design + implementation | Reframe as systems contribution |
215
+ | **Implementation** | Often secondary | Core contribution | Detail architecture, optimizations |
216
+ | **Deployment** | Rarely discussed | Highly valued (especially OSDI/NSDI) | Add deployment experience |
217
+
218
+ ### Specific Conversion Paths
219
+
220
+ | From → To | Key Adjustments |
221
+ |-----------|------------------|
222
+ | ML → OSDI | USENIX template; reframe for systems; add design/implementation; emphasize deployment |
223
+ | ML → NSDI | USENIX format; emphasize networked systems; choose track |
224
+ | ML → ASPLOS | ACM SIGPLAN; self-contained first 2 pages (rapid review); frame for arch/PL/OS |
225
+ | ML → SOSP | ACM SIGPLAN; emphasize OS principles; system design/evaluation |
226
+ | OSDI ↔ SOSP | USENIX ↔ ACM SIGPLAN template; similar page limits |
227
+ | OSDI ↔ NSDI | Same USENIX format; adjust scope (general vs networked) |
228
+
229
+ ---
230
+
231
+ ## Systems Paper Structure
232
+
233
+ A typical systems paper follows this structure (differs from ML papers):
234
+
235
+ ```text
236
+ 1. Introduction - Problem, approach, key results (CRITICAL for NSDI prescreening / ASPLOS rapid review)
237
+ 2. Background/Motivation - System context, why existing solutions fail
238
+ 3. Design - System architecture, key design decisions
239
+ 4. Implementation - Implementation details, optimizations, engineering challenges
240
+ 5. Evaluation - End-to-end performance + microbenchmarks + scalability
241
+ 6. Discussion - Limitations, deployment lessons (optional but valued at SOSP)
242
+ 7. Related Work - Organized by approach, not chronologically
243
+ 8. Conclusion - Summary of contributions and impact
244
+ ```
245
+
246
+ **Key differences from ML papers**:
247
+ - **Design section** replaces Methods: Focus on architecture and trade-offs
248
+ - **Implementation section** is a core contribution, not an afterthought
249
+ - **Evaluation** includes both macro (end-to-end) and micro benchmarks
250
+ - **Discussion** section is common (especially SOSP)
251
+
252
+ ---
253
+
254
+ ## Official CFP Links
255
+
256
+ - **OSDI 2026**: <https://www.usenix.org/conference/osdi26/call-for-papers>
257
+ - **NSDI 2027**: <https://www.usenix.org/conference/nsdi27/call-for-papers>
258
+ - **ASPLOS 2027**: <https://www.asplos-conference.org/asplos2026/call-for-papers-asplos27/>
259
+ - **SOSP 2026**: <https://sigops.org/s/conferences/sosp/2026/cfp.html>
260
+ - **USENIX LaTeX Template**: <https://www.usenix.org/conferences/author-resources/paper-templates>
261
+ - **ACM SIGPLAN Template**: <https://www.acm.org/publications/proceedings-template>