@r1z4x/tezgah 1.0.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +738 -0
- package/LICENSE +21 -0
- package/MANIFEST +753 -0
- package/README.de.md +169 -0
- package/README.es.md +168 -0
- package/README.fr.md +166 -0
- package/README.md +161 -0
- package/README.tr.md +163 -0
- package/agents/tezgah-reviewer.md +70 -0
- package/bin/codegen +337 -0
- package/bin/consult +797 -0
- package/bin/tezgah-adhd +50 -0
- package/bin/tezgah-agents +45 -0
- package/bin/tezgah-capture +66 -0
- package/bin/tezgah-context +96 -0
- package/bin/tezgah-decisions +213 -0
- package/bin/tezgah-design +953 -0
- package/bin/tezgah-docs +1199 -0
- package/bin/tezgah-doctor +497 -0
- package/bin/tezgah-dsh +37 -0
- package/bin/tezgah-dsh.cmd +70 -0
- package/bin/tezgah-gate +75 -0
- package/bin/tezgah-import-ai-research +439 -0
- package/bin/tezgah-index +32 -0
- package/bin/tezgah-lessons +148 -0
- package/bin/tezgah-mcp +322 -0
- package/bin/tezgah-migrate +324 -0
- package/bin/tezgah-pony +50 -0
- package/bin/tezgah-research +772 -0
- package/bin/tezgah-rollback +93 -0
- package/bin/tezgah-route +124 -0
- package/bin/tezgah-setup +5798 -0
- package/bin/tezgah-status +383 -0
- package/bin/tezgah-task +607 -0
- package/bin/tezgah-taste +423 -0
- package/bin/tezgah-triage +485 -0
- package/bin/tezgah.js +36 -0
- package/commands/adhd.md +21 -0
- package/commands/ponytail.md +21 -0
- package/docs/README.md +112 -0
- package/docs/architecture.md +226 -0
- package/docs/citations-baseline.json +59 -0
- package/docs/clarity-baseline.json +116 -0
- package/docs/contract.md +416 -0
- package/docs/environment.md +141 -0
- package/docs/evidence.md +831 -0
- package/docs/feature-audit.md +139 -0
- package/docs/gate.md +407 -0
- package/docs/glossary.md +201 -0
- package/docs/hosts.md +400 -0
- package/docs/index.json +471 -0
- package/docs/judge.md +193 -0
- package/docs/layers.md +189 -0
- package/docs/models.md +160 -0
- package/docs/operations.md +666 -0
- package/docs/research.md +809 -0
- package/docs/results/paired-outcome-2026-10.jsonl +254 -0
- package/docs/results/paired-outcome-2026-10.md +204 -0
- package/docs/skills.md +236 -0
- package/docs/status-line.md +315 -0
- package/docs/testing.md +287 -0
- package/docs/vision.md +117 -0
- package/hooks/hooks.json +33 -0
- package/hooks/projects-auto-init.py +98 -0
- package/hooks/projects-posttooluse.py +149 -0
- package/hooks/projects-pretooluse.py +40 -0
- package/hooks/projects-stop.py +60 -0
- package/hooks/tezgah_agents.py +817 -0
- package/hooks/tezgah_apps.py +266 -0
- package/hooks/tezgah_attest.py +255 -0
- package/hooks/tezgah_clarity.py +171 -0
- package/hooks/tezgah_components.py +140 -0
- package/hooks/tezgah_context.py +2953 -0
- package/hooks/tezgah_embed.py +765 -0
- package/hooks/tezgah_gate.py +2736 -0
- package/hooks/tezgah_guard.py +177 -0
- package/hooks/tezgah_index.py +124 -0
- package/hooks/tezgah_integrity.py +5141 -0
- package/hooks/tezgah_judge.py +487 -0
- package/hooks/tezgah_lang.py +230 -0
- package/hooks/tezgah_lessons.py +210 -0
- package/hooks/tezgah_models.py +855 -0
- package/hooks/tezgah_paths.py +1132 -0
- package/hooks/tezgah_policy.py +1039 -0
- package/hooks/tezgah_rank.py +77 -0
- package/hooks/tezgah_replay.py +1109 -0
- package/hooks/tezgah_research.py +5176 -0
- package/hooks/tezgah_shapes.py +305 -0
- package/hooks/tezgah_skill_pick.py +227 -0
- package/hooks/tezgah_snapshot.py +490 -0
- package/hooks/tezgah_stopspec.py +320 -0
- package/hooks/tezgah_task.py +458 -0
- package/hooks/tezgah_taste.py +201 -0
- package/hooks/tezgah_untrusted.py +112 -0
- package/hooks/tezgah_update.py +430 -0
- package/hosts/codex/hook.py +268 -0
- package/hosts/codex/hooks.json +26 -0
- package/hosts/cursor/hook.py +461 -0
- package/hosts/cursor/hooks.json +44 -0
- package/hosts/dsh/hooks.json +21 -0
- package/hosts/dsh/statusline/lib/client.js +138 -0
- package/hosts/dsh/statusline/lib/index.js +104 -0
- package/hosts/dsh/statusline/package.json +28 -0
- package/hosts/omp/hook.py +277 -0
- package/hosts/omp/tezgah-hook.ts.in +701 -0
- package/hosts/opencode/plugins/tezgah.js +2742 -0
- package/hosts/opencode/tui/tezgah-tui.tsx +151 -0
- package/output-styles/tezgah.md +142 -0
- package/package.json +32 -0
- package/packaging/build.sh +342 -0
- package/packaging/install.ps1 +166 -0
- package/packaging/install.sh +56 -0
- package/packaging/upgrade.sh +142 -0
- package/skills/ai-research/0-autoresearch-skill/SKILL.md +411 -0
- package/skills/ai-research/0-autoresearch-skill/references/agent-continuity.md +95 -0
- package/skills/ai-research/0-autoresearch-skill/references/progress-reporting.md +166 -0
- package/skills/ai-research/0-autoresearch-skill/references/skill-routing.md +219 -0
- package/skills/ai-research/0-autoresearch-skill/templates/findings.md +44 -0
- package/skills/ai-research/0-autoresearch-skill/templates/research-log.md +41 -0
- package/skills/ai-research/01-model-architecture/litgpt/SKILL.md +469 -0
- package/skills/ai-research/01-model-architecture/litgpt/references/custom-models.md +569 -0
- package/skills/ai-research/01-model-architecture/litgpt/references/distributed-training.md +452 -0
- package/skills/ai-research/01-model-architecture/litgpt/references/supported-models.md +337 -0
- package/skills/ai-research/01-model-architecture/litgpt/references/training-recipes.md +620 -0
- package/skills/ai-research/01-model-architecture/mamba/SKILL.md +260 -0
- package/skills/ai-research/01-model-architecture/mamba/references/architecture-details.md +207 -0
- package/skills/ai-research/01-model-architecture/mamba/references/benchmarks.md +256 -0
- package/skills/ai-research/01-model-architecture/mamba/references/training-guide.md +389 -0
- package/skills/ai-research/01-model-architecture/nanogpt/SKILL.md +290 -0
- package/skills/ai-research/01-model-architecture/nanogpt/references/architecture.md +383 -0
- package/skills/ai-research/01-model-architecture/nanogpt/references/data.md +477 -0
- package/skills/ai-research/01-model-architecture/nanogpt/references/training.md +565 -0
- package/skills/ai-research/01-model-architecture/rwkv/SKILL.md +260 -0
- package/skills/ai-research/01-model-architecture/rwkv/references/architecture-details.md +345 -0
- package/skills/ai-research/01-model-architecture/rwkv/references/rwkv7.md +387 -0
- package/skills/ai-research/01-model-architecture/rwkv/references/state-management.md +370 -0
- package/skills/ai-research/01-model-architecture/torchtitan/SKILL.md +358 -0
- package/skills/ai-research/01-model-architecture/torchtitan/references/checkpoint.md +182 -0
- package/skills/ai-research/01-model-architecture/torchtitan/references/custom-models.md +259 -0
- package/skills/ai-research/01-model-architecture/torchtitan/references/float8.md +134 -0
- package/skills/ai-research/01-model-architecture/torchtitan/references/fsdp.md +127 -0
- package/skills/ai-research/02-tokenization/huggingface-tokenizers/SKILL.md +516 -0
- package/skills/ai-research/02-tokenization/huggingface-tokenizers/references/algorithms.md +654 -0
- package/skills/ai-research/02-tokenization/huggingface-tokenizers/references/integration.md +638 -0
- package/skills/ai-research/02-tokenization/huggingface-tokenizers/references/pipeline.md +724 -0
- package/skills/ai-research/02-tokenization/huggingface-tokenizers/references/training.md +566 -0
- package/skills/ai-research/02-tokenization/sentencepiece/SKILL.md +235 -0
- package/skills/ai-research/02-tokenization/sentencepiece/references/algorithms.md +201 -0
- package/skills/ai-research/02-tokenization/sentencepiece/references/training.md +305 -0
- package/skills/ai-research/03-fine-tuning/axolotl/SKILL.md +158 -0
- package/skills/ai-research/03-fine-tuning/axolotl/references/api.md +5549 -0
- package/skills/ai-research/03-fine-tuning/axolotl/references/dataset-formats.md +1030 -0
- package/skills/ai-research/03-fine-tuning/axolotl/references/index.md +16 -0
- package/skills/ai-research/03-fine-tuning/axolotl/references/other.md +3564 -0
- package/skills/ai-research/03-fine-tuning/llama-factory/SKILL.md +80 -0
- package/skills/ai-research/03-fine-tuning/llama-factory/references/_images.md +24 -0
- package/skills/ai-research/03-fine-tuning/llama-factory/references/advanced.md +1056 -0
- package/skills/ai-research/03-fine-tuning/llama-factory/references/getting_started.md +350 -0
- package/skills/ai-research/03-fine-tuning/llama-factory/references/index.md +20 -0
- package/skills/ai-research/03-fine-tuning/llama-factory/references/other.md +32 -0
- package/skills/ai-research/03-fine-tuning/peft/SKILL.md +431 -0
- package/skills/ai-research/03-fine-tuning/peft/references/advanced-usage.md +515 -0
- package/skills/ai-research/03-fine-tuning/peft/references/troubleshooting.md +481 -0
- package/skills/ai-research/03-fine-tuning/unsloth/SKILL.md +80 -0
- package/skills/ai-research/03-fine-tuning/unsloth/references/index.md +8 -0
- package/skills/ai-research/03-fine-tuning/unsloth/references/llms.md +83 -0
- package/skills/ai-research/04-mechanistic-interpretability/nnsight/SKILL.md +436 -0
- package/skills/ai-research/04-mechanistic-interpretability/nnsight/references/README.md +79 -0
- package/skills/ai-research/04-mechanistic-interpretability/nnsight/references/api.md +345 -0
- package/skills/ai-research/04-mechanistic-interpretability/nnsight/references/tutorials.md +301 -0
- package/skills/ai-research/04-mechanistic-interpretability/pyvene/SKILL.md +473 -0
- package/skills/ai-research/04-mechanistic-interpretability/pyvene/references/README.md +74 -0
- package/skills/ai-research/04-mechanistic-interpretability/pyvene/references/api.md +384 -0
- package/skills/ai-research/04-mechanistic-interpretability/pyvene/references/tutorials.md +377 -0
- package/skills/ai-research/04-mechanistic-interpretability/saelens/SKILL.md +386 -0
- package/skills/ai-research/04-mechanistic-interpretability/saelens/references/README.md +71 -0
- package/skills/ai-research/04-mechanistic-interpretability/saelens/references/api.md +334 -0
- package/skills/ai-research/04-mechanistic-interpretability/saelens/references/tutorials.md +319 -0
- package/skills/ai-research/04-mechanistic-interpretability/transformer-lens/SKILL.md +346 -0
- package/skills/ai-research/04-mechanistic-interpretability/transformer-lens/references/README.md +55 -0
- package/skills/ai-research/04-mechanistic-interpretability/transformer-lens/references/api.md +363 -0
- package/skills/ai-research/04-mechanistic-interpretability/transformer-lens/references/tutorials.md +340 -0
- package/skills/ai-research/05-data-processing/nemo-curator/SKILL.md +383 -0
- package/skills/ai-research/05-data-processing/nemo-curator/references/deduplication.md +88 -0
- package/skills/ai-research/05-data-processing/nemo-curator/references/filtering.md +103 -0
- package/skills/ai-research/05-data-processing/ray-data/SKILL.md +326 -0
- package/skills/ai-research/05-data-processing/ray-data/references/integration.md +83 -0
- package/skills/ai-research/05-data-processing/ray-data/references/transformations.md +84 -0
- package/skills/ai-research/06-post-training/grpo-rl-training/README.md +98 -0
- package/skills/ai-research/06-post-training/grpo-rl-training/SKILL.md +572 -0
- package/skills/ai-research/06-post-training/miles/SKILL.md +315 -0
- package/skills/ai-research/06-post-training/miles/references/api-reference.md +142 -0
- package/skills/ai-research/06-post-training/miles/references/troubleshooting.md +353 -0
- package/skills/ai-research/06-post-training/openrlhf/SKILL.md +249 -0
- package/skills/ai-research/06-post-training/openrlhf/references/algorithm-comparison.md +405 -0
- package/skills/ai-research/06-post-training/openrlhf/references/custom-rewards.md +531 -0
- package/skills/ai-research/06-post-training/openrlhf/references/hybrid-engine.md +288 -0
- package/skills/ai-research/06-post-training/openrlhf/references/multi-node-training.md +455 -0
- package/skills/ai-research/06-post-training/simpo/SKILL.md +219 -0
- package/skills/ai-research/06-post-training/simpo/references/datasets.md +479 -0
- package/skills/ai-research/06-post-training/simpo/references/hyperparameters.md +453 -0
- package/skills/ai-research/06-post-training/simpo/references/loss-functions.md +351 -0
- package/skills/ai-research/06-post-training/slime/SKILL.md +464 -0
- package/skills/ai-research/06-post-training/slime/references/api-reference.md +393 -0
- package/skills/ai-research/06-post-training/slime/references/troubleshooting.md +387 -0
- package/skills/ai-research/06-post-training/torchforge/SKILL.md +433 -0
- package/skills/ai-research/06-post-training/torchforge/references/api-reference.md +328 -0
- package/skills/ai-research/06-post-training/torchforge/references/troubleshooting.md +410 -0
- package/skills/ai-research/06-post-training/trl-fine-tuning/SKILL.md +455 -0
- package/skills/ai-research/06-post-training/trl-fine-tuning/references/dpo-variants.md +228 -0
- package/skills/ai-research/06-post-training/trl-fine-tuning/references/online-rl.md +83 -0
- package/skills/ai-research/06-post-training/trl-fine-tuning/references/reward-modeling.md +123 -0
- package/skills/ai-research/06-post-training/trl-fine-tuning/references/sft-training.md +169 -0
- package/skills/ai-research/06-post-training/verl/SKILL.md +391 -0
- package/skills/ai-research/06-post-training/verl/references/api-reference.md +302 -0
- package/skills/ai-research/06-post-training/verl/references/troubleshooting.md +392 -0
- package/skills/ai-research/07-safety-alignment/constitutional-ai/SKILL.md +290 -0
- package/skills/ai-research/07-safety-alignment/llamaguard/SKILL.md +337 -0
- package/skills/ai-research/07-safety-alignment/nemo-guardrails/SKILL.md +297 -0
- package/skills/ai-research/07-safety-alignment/prompt-guard/SKILL.md +312 -0
- package/skills/ai-research/08-distributed-training/accelerate/SKILL.md +332 -0
- package/skills/ai-research/08-distributed-training/accelerate/references/custom-plugins.md +454 -0
- package/skills/ai-research/08-distributed-training/accelerate/references/megatron-integration.md +490 -0
- package/skills/ai-research/08-distributed-training/accelerate/references/performance.md +526 -0
- package/skills/ai-research/08-distributed-training/deepspeed/SKILL.md +141 -0
- package/skills/ai-research/08-distributed-training/deepspeed/references/08.md +18 -0
- package/skills/ai-research/08-distributed-training/deepspeed/references/09.md +174 -0
- package/skills/ai-research/08-distributed-training/deepspeed/references/2020.md +379 -0
- package/skills/ai-research/08-distributed-training/deepspeed/references/2023.md +280 -0
- package/skills/ai-research/08-distributed-training/deepspeed/references/assets.md +180 -0
- package/skills/ai-research/08-distributed-training/deepspeed/references/index.md +36 -0
- package/skills/ai-research/08-distributed-training/deepspeed/references/mii.md +119 -0
- package/skills/ai-research/08-distributed-training/deepspeed/references/other.md +1192 -0
- package/skills/ai-research/08-distributed-training/megatron-core/SKILL.md +366 -0
- package/skills/ai-research/08-distributed-training/megatron-core/references/benchmarks.md +250 -0
- package/skills/ai-research/08-distributed-training/megatron-core/references/parallelism-guide.md +405 -0
- package/skills/ai-research/08-distributed-training/megatron-core/references/production-examples.md +474 -0
- package/skills/ai-research/08-distributed-training/megatron-core/references/training-recipes.md +548 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/SKILL.md +231 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_dcp_async_recipe.md +14 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_dcp_overview.md +19 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_dcp_recipe.md +18 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_ddp_notes.md +10 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_device_mesh_tutorial.md +22 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_examples_fsdp2.md +15 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_fsdp1_api.md +9 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_fsdp2_tutorial.md +45 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_fully_shard_api.md +49 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/pytorch_tp_tutorial.md +22 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/ray_train_fsdp2_example.md +13 -0
- package/skills/ai-research/08-distributed-training/pytorch-fsdp2/references/torchtitan_fsdp_notes.md +14 -0
- package/skills/ai-research/08-distributed-training/pytorch-lightning/SKILL.md +346 -0
- package/skills/ai-research/08-distributed-training/pytorch-lightning/references/callbacks.md +437 -0
- package/skills/ai-research/08-distributed-training/pytorch-lightning/references/distributed.md +491 -0
- package/skills/ai-research/08-distributed-training/pytorch-lightning/references/hyperparameter-tuning.md +557 -0
- package/skills/ai-research/08-distributed-training/ray-train/SKILL.md +406 -0
- package/skills/ai-research/08-distributed-training/ray-train/references/multi-node.md +629 -0
- package/skills/ai-research/09-infrastructure/lambda-labs/SKILL.md +545 -0
- package/skills/ai-research/09-infrastructure/lambda-labs/references/advanced-usage.md +612 -0
- package/skills/ai-research/09-infrastructure/lambda-labs/references/troubleshooting.md +531 -0
- package/skills/ai-research/09-infrastructure/modal/SKILL.md +341 -0
- package/skills/ai-research/09-infrastructure/modal/references/advanced-usage.md +504 -0
- package/skills/ai-research/09-infrastructure/modal/references/troubleshooting.md +495 -0
- package/skills/ai-research/09-infrastructure/skypilot/SKILL.md +509 -0
- package/skills/ai-research/09-infrastructure/skypilot/references/advanced-usage.md +492 -0
- package/skills/ai-research/09-infrastructure/skypilot/references/troubleshooting.md +571 -0
- package/skills/ai-research/10-optimization/awq/SKILL.md +310 -0
- package/skills/ai-research/10-optimization/awq/references/advanced-usage.md +325 -0
- package/skills/ai-research/10-optimization/awq/references/troubleshooting.md +345 -0
- package/skills/ai-research/10-optimization/bitsandbytes/SKILL.md +411 -0
- package/skills/ai-research/10-optimization/bitsandbytes/references/memory-optimization.md +522 -0
- package/skills/ai-research/10-optimization/bitsandbytes/references/qlora-training.md +522 -0
- package/skills/ai-research/10-optimization/bitsandbytes/references/quantization-formats.md +448 -0
- package/skills/ai-research/10-optimization/flash-attention/SKILL.md +367 -0
- package/skills/ai-research/10-optimization/flash-attention/references/benchmarks.md +216 -0
- package/skills/ai-research/10-optimization/flash-attention/references/transformers-integration.md +294 -0
- package/skills/ai-research/10-optimization/gguf/SKILL.md +427 -0
- package/skills/ai-research/10-optimization/gguf/references/advanced-usage.md +505 -0
- package/skills/ai-research/10-optimization/gguf/references/troubleshooting.md +443 -0
- package/skills/ai-research/10-optimization/gptq/SKILL.md +450 -0
- package/skills/ai-research/10-optimization/gptq/references/calibration.md +338 -0
- package/skills/ai-research/10-optimization/gptq/references/integration.md +130 -0
- package/skills/ai-research/10-optimization/gptq/references/troubleshooting.md +96 -0
- package/skills/ai-research/10-optimization/hqq/SKILL.md +445 -0
- package/skills/ai-research/10-optimization/hqq/references/advanced-usage.md +529 -0
- package/skills/ai-research/10-optimization/hqq/references/troubleshooting.md +504 -0
- package/skills/ai-research/10-optimization/ml-training-recipes/SKILL.md +319 -0
- package/skills/ai-research/10-optimization/ml-training-recipes/references/architecture.md +320 -0
- package/skills/ai-research/10-optimization/ml-training-recipes/references/biomedical.md +498 -0
- package/skills/ai-research/10-optimization/ml-training-recipes/references/domain-specific.md +626 -0
- package/skills/ai-research/10-optimization/ml-training-recipes/references/experiment-loop.md +129 -0
- package/skills/ai-research/10-optimization/ml-training-recipes/references/optimizers.md +330 -0
- package/skills/ai-research/10-optimization/ml-training-recipes/references/scaling-and-selection.md +428 -0
- package/skills/ai-research/11-evaluation/bigcode-evaluation-harness/SKILL.md +405 -0
- package/skills/ai-research/11-evaluation/bigcode-evaluation-harness/references/benchmarks.md +394 -0
- package/skills/ai-research/11-evaluation/bigcode-evaluation-harness/references/custom-tasks.md +425 -0
- package/skills/ai-research/11-evaluation/bigcode-evaluation-harness/references/issues.md +395 -0
- package/skills/ai-research/11-evaluation/lm-evaluation-harness/SKILL.md +490 -0
- package/skills/ai-research/11-evaluation/lm-evaluation-harness/references/api-evaluation.md +491 -0
- package/skills/ai-research/11-evaluation/lm-evaluation-harness/references/benchmark-guide.md +489 -0
- package/skills/ai-research/11-evaluation/lm-evaluation-harness/references/custom-tasks.md +603 -0
- package/skills/ai-research/11-evaluation/lm-evaluation-harness/references/distributed-eval.md +520 -0
- package/skills/ai-research/11-evaluation/nemo-evaluator/SKILL.md +494 -0
- package/skills/ai-research/11-evaluation/nemo-evaluator/references/adapter-system.md +341 -0
- package/skills/ai-research/11-evaluation/nemo-evaluator/references/configuration.md +448 -0
- package/skills/ai-research/11-evaluation/nemo-evaluator/references/custom-benchmarks.md +316 -0
- package/skills/ai-research/11-evaluation/nemo-evaluator/references/execution-backends.md +362 -0
- package/skills/ai-research/12-inference-serving/llama-cpp/SKILL.md +258 -0
- package/skills/ai-research/12-inference-serving/llama-cpp/references/optimization.md +90 -0
- package/skills/ai-research/12-inference-serving/llama-cpp/references/quantization.md +214 -0
- package/skills/ai-research/12-inference-serving/llama-cpp/references/server.md +126 -0
- package/skills/ai-research/12-inference-serving/sglang/SKILL.md +442 -0
- package/skills/ai-research/12-inference-serving/sglang/references/deployment.md +491 -0
- package/skills/ai-research/12-inference-serving/sglang/references/radix-attention.md +414 -0
- package/skills/ai-research/12-inference-serving/sglang/references/structured-generation.md +542 -0
- package/skills/ai-research/12-inference-serving/tensorrt-llm/SKILL.md +187 -0
- package/skills/ai-research/12-inference-serving/tensorrt-llm/references/multi-gpu.md +299 -0
- package/skills/ai-research/12-inference-serving/tensorrt-llm/references/optimization.md +243 -0
- package/skills/ai-research/12-inference-serving/tensorrt-llm/references/serving.md +471 -0
- package/skills/ai-research/12-inference-serving/vllm/SKILL.md +364 -0
- package/skills/ai-research/12-inference-serving/vllm/references/optimization.md +227 -0
- package/skills/ai-research/12-inference-serving/vllm/references/quantization.md +285 -0
- package/skills/ai-research/12-inference-serving/vllm/references/server-deployment.md +256 -0
- package/skills/ai-research/12-inference-serving/vllm/references/troubleshooting.md +448 -0
- package/skills/ai-research/13-mlops/mlflow/SKILL.md +704 -0
- package/skills/ai-research/13-mlops/mlflow/references/deployment.md +745 -0
- package/skills/ai-research/13-mlops/mlflow/references/model-registry.md +771 -0
- package/skills/ai-research/13-mlops/mlflow/references/tracking.md +681 -0
- package/skills/ai-research/13-mlops/swanlab/SKILL.md +406 -0
- package/skills/ai-research/13-mlops/swanlab/references/integrations.md +305 -0
- package/skills/ai-research/13-mlops/swanlab/references/visualization.md +234 -0
- package/skills/ai-research/13-mlops/tensorboard/SKILL.md +629 -0
- package/skills/ai-research/13-mlops/tensorboard/references/integrations.md +639 -0
- package/skills/ai-research/13-mlops/tensorboard/references/profiling.md +546 -0
- package/skills/ai-research/13-mlops/tensorboard/references/visualization.md +621 -0
- package/skills/ai-research/13-mlops/weights-and-biases/SKILL.md +590 -0
- package/skills/ai-research/13-mlops/weights-and-biases/references/artifacts.md +585 -0
- package/skills/ai-research/13-mlops/weights-and-biases/references/integrations.md +701 -0
- package/skills/ai-research/13-mlops/weights-and-biases/references/sweeps.md +848 -0
- package/skills/ai-research/14-agents/a-evolve/SKILL.md +383 -0
- package/skills/ai-research/14-agents/a-evolve/references/README.md +831 -0
- package/skills/ai-research/14-agents/a-evolve/references/api.md +594 -0
- package/skills/ai-research/14-agents/a-evolve/references/architecture.md +417 -0
- package/skills/ai-research/14-agents/a-evolve/references/design-patterns.md +462 -0
- package/skills/ai-research/14-agents/a-evolve/references/examples.md +352 -0
- package/skills/ai-research/14-agents/a-evolve/references/issues.md +591 -0
- package/skills/ai-research/14-agents/a-evolve/references/releases.md +112 -0
- package/skills/ai-research/14-agents/a-evolve/references/tutorials.md +819 -0
- package/skills/ai-research/14-agents/autogpt/SKILL.md +403 -0
- package/skills/ai-research/14-agents/autogpt/references/advanced-usage.md +536 -0
- package/skills/ai-research/14-agents/autogpt/references/troubleshooting.md +421 -0
- package/skills/ai-research/14-agents/crewai/SKILL.md +498 -0
- package/skills/ai-research/14-agents/crewai/references/flows.md +439 -0
- package/skills/ai-research/14-agents/crewai/references/tools.md +430 -0
- package/skills/ai-research/14-agents/crewai/references/troubleshooting.md +481 -0
- package/skills/ai-research/14-agents/langchain/SKILL.md +480 -0
- package/skills/ai-research/14-agents/langchain/references/agents.md +500 -0
- package/skills/ai-research/14-agents/langchain/references/integration.md +563 -0
- package/skills/ai-research/14-agents/langchain/references/rag.md +601 -0
- package/skills/ai-research/14-agents/llamaindex/SKILL.md +569 -0
- package/skills/ai-research/14-agents/llamaindex/references/agents.md +84 -0
- package/skills/ai-research/14-agents/llamaindex/references/data_connectors.md +109 -0
- package/skills/ai-research/14-agents/llamaindex/references/query_engines.md +407 -0
- package/skills/ai-research/15-rag/chroma/SKILL.md +406 -0
- package/skills/ai-research/15-rag/chroma/references/integration.md +39 -0
- package/skills/ai-research/15-rag/faiss/SKILL.md +221 -0
- package/skills/ai-research/15-rag/faiss/references/index_types.md +281 -0
- package/skills/ai-research/15-rag/pinecone/SKILL.md +358 -0
- package/skills/ai-research/15-rag/pinecone/references/deployment.md +182 -0
- package/skills/ai-research/15-rag/qdrant/SKILL.md +493 -0
- package/skills/ai-research/15-rag/qdrant/references/advanced-usage.md +649 -0
- package/skills/ai-research/15-rag/qdrant/references/troubleshooting.md +632 -0
- package/skills/ai-research/15-rag/sentence-transformers/SKILL.md +255 -0
- package/skills/ai-research/15-rag/sentence-transformers/references/models.md +124 -0
- package/skills/ai-research/16-prompt-engineering/dspy/SKILL.md +590 -0
- package/skills/ai-research/16-prompt-engineering/dspy/references/examples.md +664 -0
- package/skills/ai-research/16-prompt-engineering/dspy/references/modules.md +476 -0
- package/skills/ai-research/16-prompt-engineering/dspy/references/optimizers.md +567 -0
- package/skills/ai-research/16-prompt-engineering/guidance/SKILL.md +572 -0
- package/skills/ai-research/16-prompt-engineering/guidance/references/backends.md +555 -0
- package/skills/ai-research/16-prompt-engineering/guidance/references/constraints.md +675 -0
- package/skills/ai-research/16-prompt-engineering/guidance/references/examples.md +768 -0
- package/skills/ai-research/16-prompt-engineering/instructor/SKILL.md +740 -0
- package/skills/ai-research/16-prompt-engineering/instructor/references/examples.md +108 -0
- package/skills/ai-research/16-prompt-engineering/instructor/references/providers.md +71 -0
- package/skills/ai-research/16-prompt-engineering/instructor/references/validation.md +607 -0
- package/skills/ai-research/16-prompt-engineering/outlines/SKILL.md +652 -0
- package/skills/ai-research/16-prompt-engineering/outlines/references/backends.md +616 -0
- package/skills/ai-research/16-prompt-engineering/outlines/references/examples.md +774 -0
- package/skills/ai-research/16-prompt-engineering/outlines/references/json_generation.md +653 -0
- package/skills/ai-research/17-observability/langsmith/SKILL.md +422 -0
- package/skills/ai-research/17-observability/langsmith/references/advanced-usage.md +549 -0
- package/skills/ai-research/17-observability/langsmith/references/troubleshooting.md +538 -0
- package/skills/ai-research/17-observability/phoenix/SKILL.md +475 -0
- package/skills/ai-research/17-observability/phoenix/references/advanced-usage.md +620 -0
- package/skills/ai-research/17-observability/phoenix/references/troubleshooting.md +539 -0
- package/skills/ai-research/18-multimodal/audiocraft/SKILL.md +564 -0
- package/skills/ai-research/18-multimodal/audiocraft/references/advanced-usage.md +667 -0
- package/skills/ai-research/18-multimodal/audiocraft/references/troubleshooting.md +505 -0
- package/skills/ai-research/18-multimodal/blip-2/SKILL.md +564 -0
- package/skills/ai-research/18-multimodal/blip-2/references/advanced-usage.md +681 -0
- package/skills/ai-research/18-multimodal/blip-2/references/troubleshooting.md +527 -0
- package/skills/ai-research/18-multimodal/clip/SKILL.md +253 -0
- package/skills/ai-research/18-multimodal/clip/references/applications.md +208 -0
- package/skills/ai-research/18-multimodal/cosmos-policy/SKILL.md +402 -0
- package/skills/ai-research/18-multimodal/cosmos-policy/references/libero-commands.md +175 -0
- package/skills/ai-research/18-multimodal/cosmos-policy/references/robocasa-commands.md +147 -0
- package/skills/ai-research/18-multimodal/llava/SKILL.md +304 -0
- package/skills/ai-research/18-multimodal/llava/references/training.md +198 -0
- package/skills/ai-research/18-multimodal/openpi/SKILL.md +480 -0
- package/skills/ai-research/18-multimodal/openpi/references/checkpoints-and-env-map.md +86 -0
- package/skills/ai-research/18-multimodal/openpi/references/config-recipes.md +50 -0
- package/skills/ai-research/18-multimodal/openpi/references/pytorch-gotchas.md +49 -0
- package/skills/ai-research/18-multimodal/openpi/references/remote-client-pattern.md +48 -0
- package/skills/ai-research/18-multimodal/openpi/references/training-debugging.md +46 -0
- package/skills/ai-research/18-multimodal/openvla-oft/SKILL.md +441 -0
- package/skills/ai-research/18-multimodal/openvla-oft/references/aloha-workflow.md +141 -0
- package/skills/ai-research/18-multimodal/openvla-oft/references/config-troubleshooting.md +97 -0
- package/skills/ai-research/18-multimodal/openvla-oft/references/libero-workflow.md +115 -0
- package/skills/ai-research/18-multimodal/openvla-oft/references/paper-and-checkpoints.md +84 -0
- package/skills/ai-research/18-multimodal/segment-anything/SKILL.md +500 -0
- package/skills/ai-research/18-multimodal/segment-anything/references/advanced-usage.md +590 -0
- package/skills/ai-research/18-multimodal/segment-anything/references/troubleshooting.md +485 -0
- package/skills/ai-research/18-multimodal/stable-diffusion/SKILL.md +519 -0
- package/skills/ai-research/18-multimodal/stable-diffusion/references/advanced-usage.md +717 -0
- package/skills/ai-research/18-multimodal/stable-diffusion/references/troubleshooting.md +556 -0
- package/skills/ai-research/18-multimodal/whisper/SKILL.md +317 -0
- package/skills/ai-research/18-multimodal/whisper/references/languages.md +190 -0
- package/skills/ai-research/19-emerging-techniques/knowledge-distillation/SKILL.md +458 -0
- package/skills/ai-research/19-emerging-techniques/knowledge-distillation/references/minillm.md +335 -0
- package/skills/ai-research/19-emerging-techniques/long-context/SKILL.md +536 -0
- package/skills/ai-research/19-emerging-techniques/long-context/references/extension_methods.md +469 -0
- package/skills/ai-research/19-emerging-techniques/long-context/references/fine_tuning.md +612 -0
- package/skills/ai-research/19-emerging-techniques/long-context/references/rope.md +403 -0
- package/skills/ai-research/19-emerging-techniques/model-merging/SKILL.md +497 -0
- package/skills/ai-research/19-emerging-techniques/model-merging/references/coefficient-tuning.md +415 -0
- package/skills/ai-research/19-emerging-techniques/model-merging/references/evaluation.md +463 -0
- package/skills/ai-research/19-emerging-techniques/model-merging/references/examples.md +429 -0
- package/skills/ai-research/19-emerging-techniques/model-merging/references/methods.md +353 -0
- package/skills/ai-research/19-emerging-techniques/model-pruning/SKILL.md +495 -0
- package/skills/ai-research/19-emerging-techniques/model-pruning/references/wanda.md +348 -0
- package/skills/ai-research/19-emerging-techniques/moe-training/SKILL.md +526 -0
- package/skills/ai-research/19-emerging-techniques/moe-training/references/architectures.md +433 -0
- package/skills/ai-research/19-emerging-techniques/moe-training/references/inference.md +349 -0
- package/skills/ai-research/19-emerging-techniques/moe-training/references/training.md +426 -0
- package/skills/ai-research/19-emerging-techniques/speculative-decoding/SKILL.md +467 -0
- package/skills/ai-research/19-emerging-techniques/speculative-decoding/references/lookahead.md +310 -0
- package/skills/ai-research/19-emerging-techniques/speculative-decoding/references/medusa.md +351 -0
- package/skills/ai-research/20-ml-paper-writing/academic-plotting/SKILL.md +479 -0
- package/skills/ai-research/20-ml-paper-writing/academic-plotting/references/data-visualization.md +509 -0
- package/skills/ai-research/20-ml-paper-writing/academic-plotting/references/diagram-generation.md +395 -0
- package/skills/ai-research/20-ml-paper-writing/academic-plotting/references/style-guide.md +305 -0
- package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/SKILL.md +982 -0
- package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/checklists.md +348 -0
- package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/citation-workflow.md +563 -0
- package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/reviewer-guidelines.md +349 -0
- package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/sources.md +165 -0
- package/skills/ai-research/20-ml-paper-writing/ml-paper-writing/references/writing-guide.md +477 -0
- package/skills/ai-research/20-ml-paper-writing/presenting-conference-talks/SKILL.md +298 -0
- package/skills/ai-research/20-ml-paper-writing/presenting-conference-talks/references/slide-templates.md +505 -0
- package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/SKILL.md +270 -0
- package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/checklist.md +279 -0
- package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/reviewer-guidelines.md +116 -0
- package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/section-blueprints.md +400 -0
- package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/systems-conferences.md +261 -0
- package/skills/ai-research/20-ml-paper-writing/systems-paper-writing/references/writing-patterns.md +231 -0
- package/skills/ai-research/21-research-ideation/brainstorming-research-ideas/SKILL.md +384 -0
- package/skills/ai-research/21-research-ideation/creative-thinking-for-research/SKILL.md +366 -0
- package/skills/ai-research/22-agent-native-research-artifact/compiler/SKILL.md +245 -0
- package/skills/ai-research/22-agent-native-research-artifact/compiler/references/ara-schema.md +439 -0
- package/skills/ai-research/22-agent-native-research-artifact/compiler/references/exploration-tree-spec.md +125 -0
- package/skills/ai-research/22-agent-native-research-artifact/compiler/references/validation-checklist.md +149 -0
- package/skills/ai-research/22-agent-native-research-artifact/research-manager/SKILL.md +324 -0
- package/skills/ai-research/22-agent-native-research-artifact/research-manager/references/event-taxonomy.md +124 -0
- package/skills/ai-research/22-agent-native-research-artifact/research-manager/references/provenance-tags.md +190 -0
- package/skills/ai-research/22-agent-native-research-artifact/research-manager/references/session-protocol.md +162 -0
- package/skills/ai-research/22-agent-native-research-artifact/rigor-reviewer/SKILL.md +322 -0
- package/skills/ai-research/22-agent-native-research-artifact/rigor-reviewer/references/review-dimensions.md +182 -0
- package/skills/ai-research/SKILL.md +101 -0
- package/skills/ai-research/SOURCE +38 -0
- package/skills/ai-research/index/1-frame.md +18 -0
- package/skills/ai-research/index/2-data.md +21 -0
- package/skills/ai-research/index/3-train.md +48 -0
- package/skills/ai-research/index/4-measure.md +25 -0
- package/skills/ai-research/index/5-run.md +23 -0
- package/skills/ai-research/index/6-write.md +35 -0
- package/skills/ai-research/library.json +3456 -0
- package/skills/analyze-app/EVALS.md +82 -0
- package/skills/analyze-app/SKILL.md +188 -0
- package/skills/design-contract/EVALS.md +80 -0
- package/skills/design-contract/SKILL.md +171 -0
- package/skills/design-library/EVALS.md +85 -0
- package/skills/design-library/INDEX.md +59 -0
- package/skills/design-library/SKILL.md +58 -0
- package/skills/design-library/SOURCE +131 -0
- package/skills/design-library/adaptive-interfaces/skills/colour-independence/SKILL.md +90 -0
- package/skills/design-library/adaptive-interfaces/skills/flexible-typography/SKILL.md +83 -0
- package/skills/design-library/adaptive-interfaces/skills/information-density/SKILL.md +87 -0
- package/skills/design-library/adaptive-interfaces/skills/preference-audit/SKILL.md +70 -0
- package/skills/design-library/adaptive-interfaces/skills/responsive-accessibility/SKILL.md +86 -0
- package/skills/design-library/adaptive-interfaces/skills/responsive-review/SKILL.md +76 -0
- package/skills/design-library/adaptive-interfaces/skills/simplified-views/SKILL.md +97 -0
- package/skills/design-library/adaptive-interfaces/skills/specify/SKILL.md +63 -0
- package/skills/design-library/adaptive-interfaces/skills/user-preference-respect/SKILL.md +100 -0
- package/skills/design-library/cognitive-accessibility/skills/adaptive-personalisation/SKILL.md +61 -0
- package/skills/design-library/cognitive-accessibility/skills/assess-load/SKILL.md +48 -0
- package/skills/design-library/cognitive-accessibility/skills/cognitive-load-assessment/SKILL.md +60 -0
- package/skills/design-library/cognitive-accessibility/skills/contextual-help-design/SKILL.md +61 -0
- package/skills/design-library/cognitive-accessibility/skills/error-prevention-recovery/SKILL.md +71 -0
- package/skills/design-library/cognitive-accessibility/skills/focus-attention-design/SKILL.md +67 -0
- package/skills/design-library/cognitive-accessibility/skills/memory-load-reduction/SKILL.md +60 -0
- package/skills/design-library/cognitive-accessibility/skills/plain-language-design/SKILL.md +78 -0
- package/skills/design-library/cognitive-accessibility/skills/review/SKILL.md +56 -0
- package/skills/design-library/cognitive-accessibility/skills/simplify/SKILL.md +39 -0
- package/skills/design-library/cognitive-accessibility/skills/wayfinding-navigation/SKILL.md +64 -0
- package/skills/design-library/design-research/skills/behavioural-analytics/SKILL.md +33 -0
- package/skills/design-library/design-research/skills/qual-quant-triangulation/SKILL.md +33 -0
- package/skills/design-library/inclusive-interaction/skills/audit/SKILL.md +50 -0
- package/skills/design-library/inclusive-interaction/skills/design-flow/SKILL.md +58 -0
- package/skills/design-library/inclusive-interaction/skills/feedback-and-status/SKILL.md +76 -0
- package/skills/design-library/inclusive-interaction/skills/gesture-alternatives/SKILL.md +70 -0
- package/skills/design-library/inclusive-interaction/skills/keyboard-navigation/SKILL.md +99 -0
- package/skills/design-library/inclusive-interaction/skills/keyboard-review/SKILL.md +54 -0
- package/skills/design-library/inclusive-interaction/skills/motion-sensitivity/SKILL.md +79 -0
- package/skills/design-library/inclusive-interaction/skills/multi-modal-input/SKILL.md +70 -0
- package/skills/design-library/inclusive-interaction/skills/touch-target-design/SKILL.md +71 -0
- package/skills/design-library/inclusive-interaction/skills/voice-interaction/SKILL.md +68 -0
- package/skills/design-library/visual-critique/skills/critique-affordance/SKILL.md +45 -0
- package/skills/design-library/visual-critique/skills/critique-brand-consistency/SKILL.md +42 -0
- package/skills/design-library/visual-critique/skills/critique-color/SKILL.md +44 -0
- package/skills/design-library/visual-critique/skills/critique-composition/SKILL.md +46 -0
- package/skills/design-library/visual-critique/skills/critique-information-density/SKILL.md +45 -0
- package/skills/design-library/visual-critique/skills/critique-typography/SKILL.md +45 -0
- package/skills/design-library/visual-critique/skills/critique-visual-hierarchy/SKILL.md +40 -0
- package/skills/feature-audit/EVALS.md +83 -0
- package/skills/feature-audit/SKILL.md +326 -0
- package/skills/harness/EVALS.md +81 -0
- package/skills/harness/SKILL.md +88 -0
- package/skills/i-have-adhd/EVALS.md +80 -0
- package/skills/i-have-adhd/SKILL.md +183 -0
- package/skills/no-ai-slop/EVALS.md +89 -0
- package/skills/no-ai-slop/SKILL.md +209 -0
- package/skills/no-ai-slop/eval.md +52 -0
- package/skills/plan-add/EVALS.md +79 -0
- package/skills/plan-add/SKILL.md +179 -0
- package/skills/plan-add/render_table.py +72 -0
- package/skills/plan-status/EVALS.md +78 -0
- package/skills/plan-status/SKILL.md +52 -0
- package/skills/plan-sync/EVALS.md +80 -0
- package/skills/plan-sync/SKILL.md +69 -0
- package/skills/pm-frameworks/SKILL.md +33 -0
- package/skills/pm-frameworks/SOURCE +39 -0
- package/skills/pm-frameworks/intended-vs-implemented/SKILL.md +42 -0
- package/skills/pm-frameworks/opportunity-solution-tree/SKILL.md +64 -0
- package/skills/ponytail/EVALS.md +80 -0
- package/skills/ponytail/SKILL.md +124 -0
- package/skills/product-analysis/EVALS.md +103 -0
- package/skills/product-analysis/SKILL.md +361 -0
- package/skills/research/EVALS.md +104 -0
- package/skills/research/SKILL.md +570 -0
- package/skills/rl-env/SKILL.md +53 -0
- package/skills/rl-env/SOURCE +41 -0
- package/skills/rl-env/generate-nemo-gym-env/SKILL.md +169 -0
- package/skills/rl-env/generate-nemo-gym-env/references/architecture.md +114 -0
- package/skills/rl-env/generate-openenv-env/SKILL.md +183 -0
- package/skills/rl-env/generate-openenv-env/references/architecture.md +82 -0
- package/skills/rl-env/generate-ors-env/SKILL.md +209 -0
- package/skills/rl-env/generate-ors-env/references/architecture.md +113 -0
- package/skills/rl-env/generate-verifiers-env/SKILL.md +188 -0
- package/skills/rl-env/generate-verifiers-env/references/architecture.md +119 -0
- package/skills/rl-env/rl-env-from-description/SKILL.md +124 -0
- package/skills/rl-env/rl-env-from-description/references/interview.md +75 -0
- package/skills/rl-env/rl-env-from-description/references/nemo_gym.md +41 -0
- package/skills/rl-env/rl-env-from-description/references/openenv.md +35 -0
- package/skills/rl-env/rl-env-from-description/references/ors.md +50 -0
- package/skills/rl-env/rl-env-from-description/references/verifiers.md +39 -0
- package/skills/tezgah-contract/EVALS.md +78 -0
- package/skills/tezgah-contract/SKILL.md +792 -0
- package/statusline.py +129 -0
- package/workflows/graph-impact.js +153 -0
- package/workflows/graph-map.js +158 -0
- package/workflows/graph-review.js +170 -0
|
@@ -0,0 +1,270 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: systems-paper-writing
|
|
3
|
+
description: Comprehensive guide for writing systems papers targeting OSDI, SOSP, ASPLOS, NSDI, and EuroSys. Provides paragraph-level structural blueprints, writing patterns, venue-specific checklists, reviewer guidelines, LaTeX templates, and conference deadlines. Use this skill for all systems conference paper writing.
|
|
4
|
+
version: 1.1.0
|
|
5
|
+
author: Orchestra Research
|
|
6
|
+
license: MIT
|
|
7
|
+
tags: [Systems Paper Writing, OSDI, SOSP, ASPLOS, NSDI, EuroSys, Structural Blueprint, Academic Writing, LaTeX]
|
|
8
|
+
---
|
|
9
|
+
|
|
10
|
+
# Systems Paper Writing: Paragraph-Level Structural Blueprint
|
|
11
|
+
|
|
12
|
+
Fine-grained structural guidance for writing **10–12 page systems papers** targeting top systems venues: OSDI, SOSP, ASPLOS, NSDI, and EuroSys. This skill provides page allocation per section, paragraph-level blueprints, and writing patterns distilled from authoritative guides and best-paper analysis.
|
|
13
|
+
|
|
14
|
+
## When to Use This Skill
|
|
15
|
+
|
|
16
|
+
| Scenario | Use This Skill | Use ml-paper-writing Instead |
|
|
17
|
+
|----------|---------------|------------------------------|
|
|
18
|
+
| Structuring a 12-page OSDI/SOSP paper | ✅ | |
|
|
19
|
+
| Page budget and paragraph planning | ✅ | |
|
|
20
|
+
| Systems-specific evaluation structure | ✅ | |
|
|
21
|
+
| General ML paper writing philosophy | | ✅ |
|
|
22
|
+
| Citation verification workflow | | ✅ |
|
|
23
|
+
| LaTeX templates and formatting | | ✅ |
|
|
24
|
+
| NeurIPS/ICML/ICLR paper structure | | ✅ |
|
|
25
|
+
|
|
26
|
+
**Boundary**: ml-paper-writing provides general writing philosophy, multi-venue templates, and citation verification. This skill focuses exclusively on **paragraph-level structural blueprints** for systems conferences.
|
|
27
|
+
|
|
28
|
+
---
|
|
29
|
+
|
|
30
|
+
## Authoritative Sources
|
|
31
|
+
|
|
32
|
+
This blueprint synthesizes guidance from established systems researchers:
|
|
33
|
+
|
|
34
|
+
1. **Levin & Redell** — "How (and How Not) to Write a Good Systems Paper" (SOSP'83 PC Chairs, USENIX/ACM SIGOPS)
|
|
35
|
+
2. **Irene Zhang** (MSR/UW) — "Hints on how to write an SOSP paper" (SOSP/OSDI PC)
|
|
36
|
+
3. **Gernot Heiser** (UNSW, seL4) — Style Guide + Paper Writing Talk
|
|
37
|
+
4. **Timothy Roscoe** (ETH Zürich) — "Writing reviews for systems conferences"
|
|
38
|
+
5. **Mike Dahlin** (UT Austin/Google) — "Giving a Conference Talk"
|
|
39
|
+
6. **Yi Ding** — "How to write good systems papers?"
|
|
40
|
+
7. **hzwer & DingXiaoH** — WritingAIPaper (GitHub 1.3k+ stars)
|
|
41
|
+
|
|
42
|
+
Full citations and URLs: see [references/section-blueprints.md](references/section-blueprints.md).
|
|
43
|
+
|
|
44
|
+
---
|
|
45
|
+
|
|
46
|
+
## 12-Page Systems Paper Blueprint
|
|
47
|
+
|
|
48
|
+
### Overview: Page Allocation
|
|
49
|
+
|
|
50
|
+
| Section | Pages | Purpose |
|
|
51
|
+
|---------|-------|---------|
|
|
52
|
+
| Abstract | ~0.25 | 150–250 words, 5-sentence structure |
|
|
53
|
+
| S1 Introduction | 1.5–2 | Problem → Gap → Insight → Contributions |
|
|
54
|
+
| S2 Background & Motivation | 1–1.5 | Terms + Production observations |
|
|
55
|
+
| S3 Design | 3–4 | Architecture + Module details + Alternatives |
|
|
56
|
+
| S4 Implementation | 0.5–1 | Prototype details, LOC, key engineering |
|
|
57
|
+
| S5 Evaluation | 3–4 | Setup + End-to-end + Microbenchmarks + Scalability |
|
|
58
|
+
| S6 Related Work | 1 | Grouped by methodology, explicit comparison |
|
|
59
|
+
| S7 Conclusion | 0.5 | 3-sentence summary |
|
|
60
|
+
| **Total** | **~12** | Submission: 12 pages strict (USENIX) / 11 pages (ACM ASPLOS). Camera-ready: up to 14 pages (USENIX) / 13 pages (ACM). Ranges above span submission through camera-ready. Target 12 pages for initial submission. References unlimited. |
|
|
61
|
+
|
|
62
|
+
### Abstract (150–250 words, 5 sentences)
|
|
63
|
+
|
|
64
|
+
```text
|
|
65
|
+
Sentence 1: Problem context and importance
|
|
66
|
+
Sentence 2: Gap in existing approaches
|
|
67
|
+
Sentence 3: Key insight or thesis ("X is better for Y in environment Z")
|
|
68
|
+
Sentence 4: Summary of approach and key results
|
|
69
|
+
Sentence 5: Broader impact or availability
|
|
70
|
+
```
|
|
71
|
+
|
|
72
|
+
**Source**: Levin & Redell — "Can you state the new idea concisely? Use them in the abstract." Irene Zhang — "The abstract is harder to write because you cannot use terms or concepts you introduced in the paper."
|
|
73
|
+
|
|
74
|
+
### S1 Introduction (1.5–2 pages)
|
|
75
|
+
|
|
76
|
+
**Paragraph structure**:
|
|
77
|
+
|
|
78
|
+
1. **Problem statement** (~0.5 page) — Establish the domain and why it matters. Use concrete numbers (cluster sizes, workload statistics, latency requirements).
|
|
79
|
+
2. **Gap analysis** (~0.5 page) — Enumerate specific gaps G1–Gn in existing systems. Each gap is one sentence with evidence.
|
|
80
|
+
3. **Key insight** (1 paragraph) — The thesis statement: "X is better for applications Y running in environment Z." (Irene Zhang formula)
|
|
81
|
+
4. **Contributions** (~0.5 page) — Numbered list of 3–5 concrete contributions. Each contribution is testable and maps to a section.
|
|
82
|
+
|
|
83
|
+
**Writing pattern**: hzwer Move 1 (Establish territory) → Move 2 (Find niche) → Move 3 (Occupy niche).
|
|
84
|
+
|
|
85
|
+
**Source**: Irene Zhang — "clearly state your target environment (Z) and application (Y)" + "clearly state why previous systems do not meet the needs"; Levin & Redell — "What exactly is the problem being solved?"
|
|
86
|
+
|
|
87
|
+
### S2 Background & Motivation (1–1.5 pages)
|
|
88
|
+
|
|
89
|
+
**Paragraph structure**:
|
|
90
|
+
|
|
91
|
+
1. **Technical background** (~0.5 page) — Define terms and systems the reader needs. Follow Gernot Heiser's "define-before-use" principle.
|
|
92
|
+
2. **Production observations** (~0.5–1 page) — Present Observation 1, 2, 3 from real data or measurements. Each observation leads to a design insight.
|
|
93
|
+
|
|
94
|
+
**Source**: Irene Zhang — "clearly motivate Y and Z. Why is application Y important?"; Gernot Heiser — "define-before-use."
|
|
95
|
+
|
|
96
|
+
### S3 Design (3–4 pages)
|
|
97
|
+
|
|
98
|
+
**Paragraph structure**:
|
|
99
|
+
|
|
100
|
+
1. **System architecture overview** (~0.5 page) — Architecture diagram first (Yi Ding: "draw a picture first"). One-paragraph walkthrough of major components and data flow.
|
|
101
|
+
2. **Module-by-module design** (~2–2.5 pages) — Each subsection: what the module does, the design choice made, alternatives considered, and why this choice wins.
|
|
102
|
+
3. **Design alternatives and trade-offs** (~0.5–1 page) — For each major decision, explicitly discuss what was not chosen and why.
|
|
103
|
+
|
|
104
|
+
**Source**: Irene Zhang — "Every design choice made in X should be discussed with alternatives and the reasons for the choice"; Levin & Redell — "What were the alternatives considered at various points, and why were the choices made?"
|
|
105
|
+
|
|
106
|
+
### S4 Implementation (0.5–1 page)
|
|
107
|
+
|
|
108
|
+
1. **Prototype description** — Language, framework, LOC, integration with existing systems.
|
|
109
|
+
2. **Key engineering decisions** — Non-obvious implementation choices worth documenting.
|
|
110
|
+
|
|
111
|
+
**Source**: Levin & Redell — "Does the paper describe something that has actually been implemented?"; Irene Zhang — "explain how you constructed a prototype to test your hypothesis."
|
|
112
|
+
|
|
113
|
+
### S5 Evaluation (3–4 pages)
|
|
114
|
+
|
|
115
|
+
**Paragraph structure**:
|
|
116
|
+
|
|
117
|
+
1. **Experimental setup** (~0.5 page) — Hardware, baselines, workloads, metrics. Enough detail to reproduce.
|
|
118
|
+
2. **End-to-end comparison** (~1–1.5 pages) — X vs baselines for application Y on environment Z. Main performance results.
|
|
119
|
+
3. **Microbenchmarks / Ablation** (~1–1.5 pages) — Isolate each design decision's contribution. Ablation experiments decompose the gains.
|
|
120
|
+
4. **Scalability** (~0.5 page) — Show behavior as problem size, cluster size, or load increases.
|
|
121
|
+
|
|
122
|
+
**Critical rule** (Irene Zhang): State every experimental conclusion **three times**:
|
|
123
|
+
- Section opening: hypothesis ("We expect X to outperform Y because...")
|
|
124
|
+
- Section closing: conclusion ("Results show X outperforms Y by Z%")
|
|
125
|
+
- Figure caption: evidence ("Figure N shows X achieves Z% better throughput than Y")
|
|
126
|
+
|
|
127
|
+
**Two experiment types**:
|
|
128
|
+
- Type 1: X vs baselines for Y on Z (end-to-end comparison)
|
|
129
|
+
- Type 2: Ablation — remove each design component to measure its individual impact
|
|
130
|
+
|
|
131
|
+
### S6 Related Work (1 page)
|
|
132
|
+
|
|
133
|
+
- Group by **methodology or approach**, not by individual papers.
|
|
134
|
+
- For each group: what they do, what limitation remains, how your work differs.
|
|
135
|
+
- Use a comparison table when comparing 4+ systems on specific dimensions.
|
|
136
|
+
|
|
137
|
+
**Source**: Levin & Redell — "Are comparisons with previous work clear and explicit?"; Irene Zhang — use comparison tables.
|
|
138
|
+
|
|
139
|
+
### S7 Conclusion (0.5 page)
|
|
140
|
+
|
|
141
|
+
Three sentences (Irene Zhang formula):
|
|
142
|
+
1. The hypothesis / problem addressed
|
|
143
|
+
2. The solution approach
|
|
144
|
+
3. The key result
|
|
145
|
+
|
|
146
|
+
---
|
|
147
|
+
|
|
148
|
+
## Writing Patterns
|
|
149
|
+
|
|
150
|
+
Four reusable patterns for structuring systems papers. See [references/writing-patterns.md](references/writing-patterns.md) for detailed examples.
|
|
151
|
+
|
|
152
|
+
### Pattern 1: Gap Analysis (Lucid, ASPLOS'23)
|
|
153
|
+
Enumerate gaps G1–Gn in Introduction → map to answers A1–An in Design. Creates a clear contract with the reader.
|
|
154
|
+
|
|
155
|
+
### Pattern 2: Observation-Driven (GFS, arXiv 2025)
|
|
156
|
+
Present production observations (O1–O3) in Motivation → derive design insights → build system around insights. Effective when you have real workload data.
|
|
157
|
+
|
|
158
|
+
### Pattern 3: Contribution List (Blox, EuroSys'24; Sia, SOSP'23)
|
|
159
|
+
Numbered contributions in Introduction, each mapping to a section. Readers (and reviewers) can track claims through the paper.
|
|
160
|
+
|
|
161
|
+
### Pattern 4: Thesis Formula (Irene Zhang)
|
|
162
|
+
Structure the entire paper around: "X is better for applications Y running in environment Z." Introduction states it, Design explains how, Evaluation proves it.
|
|
163
|
+
|
|
164
|
+
---
|
|
165
|
+
|
|
166
|
+
## Conference Differences
|
|
167
|
+
|
|
168
|
+
> **Warning**: Venue rules change yearly. Always verify against the **current year's CFP** before submission.
|
|
169
|
+
|
|
170
|
+
| Venue | Format | Submission Limit | Camera-Ready | References |
|
|
171
|
+
|-------|--------|-----------------|--------------|------------|
|
|
172
|
+
| OSDI | USENIX | 12 pages | 14 pages | Unlimited |
|
|
173
|
+
| NSDI | USENIX | 12 pages | 14 pages | Unlimited |
|
|
174
|
+
| SOSP | ACM SIGOPS | 12 pages (tech content) | — | Unlimited |
|
|
175
|
+
| ASPLOS | ACM SIGPLAN | 11 pages | 13 pages | Unlimited |
|
|
176
|
+
| EuroSys | ACM | 12 pages | — | Unlimited |
|
|
177
|
+
|
|
178
|
+
Based on 2025/2026 CFPs. Verify current limits before submission.
|
|
179
|
+
|
|
180
|
+
---
|
|
181
|
+
|
|
182
|
+
## Writing Philosophy
|
|
183
|
+
|
|
184
|
+
### Manage Reader State (Gernot Heiser)
|
|
185
|
+
Treat the reader's cognitive load like an OS managing process state. Never introduce a concept without context. Never reference something defined later without a forward pointer.
|
|
186
|
+
|
|
187
|
+
### Six-Dimensional Quality (Levin & Redell)
|
|
188
|
+
Self-check against: **Original Ideas**, **Reality** (is it built?), **Lessons** (what did you learn?), **Choices** (alternatives discussed?), **Context** (related work fair?), **Presentation** (clear writing?).
|
|
189
|
+
|
|
190
|
+
### Page-One Figure (hzwer)
|
|
191
|
+
Include a figure on the first page that captures the core idea. Reviewers form first impressions from the title, abstract, and page-one figure.
|
|
192
|
+
|
|
193
|
+
---
|
|
194
|
+
|
|
195
|
+
## Academic Integrity Requirements
|
|
196
|
+
|
|
197
|
+
### Citation Discipline
|
|
198
|
+
- **Never generate citations from memory.** Use ml-paper-writing's citation verification workflow (Semantic Scholar / DBLP / CrossRef APIs).
|
|
199
|
+
- Mark unverified references as `[CITATION NEEDED]`.
|
|
200
|
+
|
|
201
|
+
### Prohibition of Fabrication
|
|
202
|
+
- Do NOT fabricate production observations, traces, deployment experiences, or experimental results.
|
|
203
|
+
- Do NOT generate fake venue rules, paper metadata, or best-paper claims.
|
|
204
|
+
- Do NOT copy paragraph-level text from reference papers. This blueprint provides **structural guidance**, not copy-paste templates.
|
|
205
|
+
|
|
206
|
+
### LLM Disclosure
|
|
207
|
+
- Some venues require disclosure of substantial LLM use in writing or ideation. Check each venue's AI policy in the current CFP.
|
|
208
|
+
|
|
209
|
+
### Attribution
|
|
210
|
+
- When structures are inspired by specific papers (e.g., Lucid's gap-analysis pattern), cite the inspiration.
|
|
211
|
+
- Cross-repository references (e.g., ARIS paper-slides structure) are attributed, not copied.
|
|
212
|
+
|
|
213
|
+
### Temporal Validity
|
|
214
|
+
- Venue rules (page limits, format, AI policies) change annually. All venue information in this skill is based on 2025/2026 CFPs. **Always verify against the current year's CFP.**
|
|
215
|
+
|
|
216
|
+
---
|
|
217
|
+
|
|
218
|
+
## Workflow: Structuring a New Systems Paper
|
|
219
|
+
|
|
220
|
+
```text
|
|
221
|
+
Step 1: Read this SKILL.md for page allocation overview
|
|
222
|
+
Step 2: Read references/section-blueprints.md for per-section paragraph templates
|
|
223
|
+
Step 3: Choose a writing pattern from references/writing-patterns.md
|
|
224
|
+
Step 4: Draft section by section following the blueprint
|
|
225
|
+
Step 5: Run the checklist from references/checklist.md before submission
|
|
226
|
+
Step 6: Use ml-paper-writing for citation verification and LaTeX formatting
|
|
227
|
+
```
|
|
228
|
+
|
|
229
|
+
### Quick Checklist
|
|
230
|
+
|
|
231
|
+
- [ ] Thesis statement follows "X is better for Y in Z" formula
|
|
232
|
+
- [ ] Introduction has numbered contributions (3–5)
|
|
233
|
+
- [ ] Each contribution maps to a paper section
|
|
234
|
+
- [ ] Design discusses alternatives for every major choice
|
|
235
|
+
- [ ] Every eval conclusion stated 3 times (hypothesis, result, caption)
|
|
236
|
+
- [ ] Related work grouped by methodology, not individual papers
|
|
237
|
+
- [ ] Page budget within venue limits
|
|
238
|
+
- [ ] All citations verified programmatically (no hallucinated references)
|
|
239
|
+
|
|
240
|
+
---
|
|
241
|
+
|
|
242
|
+
## Common Issues and Solutions
|
|
243
|
+
|
|
244
|
+
| Issue | Solution |
|
|
245
|
+
|-------|----------|
|
|
246
|
+
| Paper feels like a "feature list" | Restructure around thesis formula: X better for Y in Z |
|
|
247
|
+
| Evaluation lacks depth | Add ablation experiments isolating each design decision |
|
|
248
|
+
| Reviewers say "incremental" | Strengthen gap analysis: make G1–Gn crisper with evidence |
|
|
249
|
+
| Design section too long | Move implementation details to S4, keep S3 at design level |
|
|
250
|
+
| Motivation feels weak | Add production observations with concrete numbers |
|
|
251
|
+
| Related work reads like a bibliography | Group by approach, add explicit differentiation |
|
|
252
|
+
|
|
253
|
+
---
|
|
254
|
+
|
|
255
|
+
## References
|
|
256
|
+
|
|
257
|
+
### Writing Guidance
|
|
258
|
+
- [references/section-blueprints.md](references/section-blueprints.md) — Detailed per-section paragraph templates with authoritative source quotes and best-paper structural examples
|
|
259
|
+
- [references/writing-patterns.md](references/writing-patterns.md) — Four writing patterns with concrete paper examples
|
|
260
|
+
|
|
261
|
+
### Venue-Specific
|
|
262
|
+
- [references/checklist.md](references/checklist.md) — 7-stage pre-submission checklist covering structure, writing quality, evaluation rigor, design quality, academic integrity, venue-specific requirements (OSDI/NSDI/ASPLOS/SOSP/EuroSys), and final pass
|
|
263
|
+
- [references/systems-conferences.md](references/systems-conferences.md) — Conference overview, deadlines, track descriptions, formatting requirements, submission rules, and format conversion guides
|
|
264
|
+
- [references/reviewer-guidelines.md](references/reviewer-guidelines.md) — How systems conference reviewers evaluate papers, with venue-specific criteria and common concerns
|
|
265
|
+
|
|
266
|
+
### LaTeX Templates
|
|
267
|
+
- [templates/osdi2026/](templates/osdi2026/) — OSDI 2026 (USENIX format)
|
|
268
|
+
- [templates/nsdi2027/](templates/nsdi2027/) — NSDI 2027 (USENIX format)
|
|
269
|
+
- [templates/asplos2027/](templates/asplos2027/) — ASPLOS 2027 (ACM SIGPLAN format)
|
|
270
|
+
- [templates/sosp2026/](templates/sosp2026/) — SOSP 2026 (ACM SIGPLAN format)
|
|
@@ -0,0 +1,279 @@
|
|
|
1
|
+
<!-- vendored from orchestra-research/AI-research-SKILLs@773a52944ba4747a18bd4ae9ade53fff041adcbc 20-ml-paper-writing/systems-paper-writing/references/checklist.md; MIT (c) Orchestra Research -->
|
|
2
|
+
# Pre-Submission Checklist for Systems Papers
|
|
3
|
+
|
|
4
|
+
Comprehensive self-check before submitting to OSDI, SOSP, ASPLOS, NSDI, and EuroSys. Combines community best practices (MLNLP-World/Paper-Writing-Tips, RU-System/Paper_Writing_Tips) with systems-specific and academic integrity checks.
|
|
5
|
+
|
|
6
|
+
---
|
|
7
|
+
|
|
8
|
+
## Stage 1: Structural Completeness
|
|
9
|
+
|
|
10
|
+
### Thesis & Contributions
|
|
11
|
+
- [ ] Paper has a clear thesis statement: "X is better for Y in Z"
|
|
12
|
+
- [ ] Thesis appears in Abstract (sentence 3), Introduction, and Conclusion
|
|
13
|
+
- [ ] Introduction lists 3–5 numbered, testable contributions
|
|
14
|
+
- [ ] Each contribution cross-references a paper section (§N)
|
|
15
|
+
- [ ] Each contribution is verified by an experiment in §5
|
|
16
|
+
|
|
17
|
+
### Section Presence
|
|
18
|
+
- [ ] Abstract: 150–250 words, self-contained (no undefined terms)
|
|
19
|
+
- [ ] Introduction: Problem → Gap → Insight → Contributions
|
|
20
|
+
- [ ] Background/Motivation: Technical terms defined before use
|
|
21
|
+
- [ ] Design: Architecture figure + module details + alternatives
|
|
22
|
+
- [ ] Implementation: Language, LOC, framework, key decisions
|
|
23
|
+
- [ ] Evaluation: Setup + end-to-end + ablation + scalability
|
|
24
|
+
- [ ] Related Work: Grouped by approach, explicit differentiation
|
|
25
|
+
- [ ] Conclusion: 3-sentence summary (problem, solution, result)
|
|
26
|
+
|
|
27
|
+
### Page Budget
|
|
28
|
+
- [ ] Total pages within venue limit (see venue table below)
|
|
29
|
+
- [ ] Design section: 3–4 pages (not overlong)
|
|
30
|
+
- [ ] Evaluation section: 3–4 pages (not underweight)
|
|
31
|
+
- [ ] Related Work: ~1 page (not a bibliography dump)
|
|
32
|
+
- [ ] Implementation: 0.5–1 page (concise)
|
|
33
|
+
|
|
34
|
+
---
|
|
35
|
+
|
|
36
|
+
## Stage 2: Writing Quality
|
|
37
|
+
|
|
38
|
+
### Clarity (Gernot Heiser)
|
|
39
|
+
- [ ] No forward references without explicit pointers ("as we show in §N")
|
|
40
|
+
- [ ] Every acronym defined on first use
|
|
41
|
+
- [ ] No orphan terminology — every technical term defined before use
|
|
42
|
+
- [ ] Consistent naming: system name capitalized uniformly throughout
|
|
43
|
+
- [ ] Active voice preferred over passive where possible
|
|
44
|
+
|
|
45
|
+
### Figures & Tables (MLNLP-World/Paper-Writing-Tips)
|
|
46
|
+
- [ ] Every figure/table referenced in text before it appears
|
|
47
|
+
- [ ] Figure captions are self-contained (readable without text)
|
|
48
|
+
- [ ] Evaluation figure captions include the key finding
|
|
49
|
+
- [ ] Architecture figure appears within first 3 pages
|
|
50
|
+
- [ ] Fonts in figures ≥ 8pt (readable when printed)
|
|
51
|
+
- [ ] Colors distinguishable in grayscale (for B&W printing)
|
|
52
|
+
- [ ] Consistent plot styles across all evaluation figures
|
|
53
|
+
|
|
54
|
+
### LaTeX Quality
|
|
55
|
+
- [ ] All code blocks have language tags (```python, ```bash, etc.)
|
|
56
|
+
- [ ] Non-breaking spaces before references: `Section~\ref{...}`
|
|
57
|
+
- [ ] Consistent citation format: `\cite{...}` not mixed with `[N]`
|
|
58
|
+
- [ ] No overfull hbox warnings in LaTeX log
|
|
59
|
+
- [ ] Bibliography entries have complete metadata (authors, title, venue, year)
|
|
60
|
+
|
|
61
|
+
### Prose Quality (RU-System/Paper_Writing_Tips)
|
|
62
|
+
- [ ] No hedging without evidence ("we believe", "it seems")
|
|
63
|
+
- [ ] Quantitative claims have numbers ("significantly better" → "37% better")
|
|
64
|
+
- [ ] No first-person unless venue style requires it
|
|
65
|
+
- [ ] Contributions are specific, not vague ("novel" without explanation)
|
|
66
|
+
- [ ] Related work comparisons are fair and accurate
|
|
67
|
+
|
|
68
|
+
---
|
|
69
|
+
|
|
70
|
+
## Stage 3: Evaluation Rigor
|
|
71
|
+
|
|
72
|
+
### Experimental Methodology
|
|
73
|
+
- [ ] Baselines are state-of-the-art (not straw men)
|
|
74
|
+
- [ ] Baselines configured optimally (not default/untuned)
|
|
75
|
+
- [ ] Hardware, software versions, and configurations fully specified
|
|
76
|
+
- [ ] Workloads described in sufficient detail to reproduce
|
|
77
|
+
- [ ] Statistical significance: error bars, multiple runs, or confidence intervals
|
|
78
|
+
- [ ] Warmup runs excluded from measurements
|
|
79
|
+
|
|
80
|
+
### Result Presentation
|
|
81
|
+
- [ ] Every conclusion stated 3 times: hypothesis (§ opening), result (§ closing), caption (figure)
|
|
82
|
+
- [ ] Ablation study isolates each design component
|
|
83
|
+
- [ ] Scalability experiments show behavior at increasing scale
|
|
84
|
+
- [ ] Both favorable and unfavorable results discussed honestly
|
|
85
|
+
- [ ] Performance numbers are absolute (not only relative percentages)
|
|
86
|
+
|
|
87
|
+
### Reproducibility
|
|
88
|
+
- [ ] Source code availability stated (or planned)
|
|
89
|
+
- [ ] Key hyperparameters and configuration values listed
|
|
90
|
+
- [ ] Workload generation described or traces cited
|
|
91
|
+
- [ ] Enough detail for an independent team to reproduce within ~2 weeks
|
|
92
|
+
|
|
93
|
+
---
|
|
94
|
+
|
|
95
|
+
## Stage 4: Design Quality
|
|
96
|
+
|
|
97
|
+
### Alternatives Discussion (Irene Zhang)
|
|
98
|
+
- [ ] Every major design decision discusses at least one alternative
|
|
99
|
+
- [ ] Alternatives are genuinely considered (not straw men)
|
|
100
|
+
- [ ] Trade-offs for each alternative explicitly stated
|
|
101
|
+
- [ ] Reasons for rejection are technical (not "it was harder to implement")
|
|
102
|
+
|
|
103
|
+
### Correctness Arguments
|
|
104
|
+
- [ ] System handles failure cases (discussed or evaluated)
|
|
105
|
+
- [ ] Edge cases acknowledged (even if not fully solved)
|
|
106
|
+
- [ ] Threat model or assumptions section present (if applicable)
|
|
107
|
+
- [ ] Limitations stated honestly (not hidden)
|
|
108
|
+
|
|
109
|
+
---
|
|
110
|
+
|
|
111
|
+
## Stage 5: Academic Integrity
|
|
112
|
+
|
|
113
|
+
### Citation Discipline
|
|
114
|
+
- [ ] **Every citation verified programmatically** (Semantic Scholar / DBLP / CrossRef)
|
|
115
|
+
- [ ] No citations generated from memory or LLM output
|
|
116
|
+
- [ ] Unverified citations marked as `[CITATION NEEDED]`
|
|
117
|
+
- [ ] All BibTeX entries have: authors, title, venue, year, pages/DOI
|
|
118
|
+
- [ ] No fabricated paper titles, authors, or venues
|
|
119
|
+
- [ ] Self-citations are relevant (not padding)
|
|
120
|
+
|
|
121
|
+
### Data Integrity
|
|
122
|
+
- [ ] Production observations are from real data (not fabricated)
|
|
123
|
+
- [ ] Experimental results are from actual runs (not interpolated/extrapolated)
|
|
124
|
+
- [ ] Traces cited with source (public dataset or anonymized description)
|
|
125
|
+
- [ ] No results cherry-picked without disclosing selection criteria
|
|
126
|
+
|
|
127
|
+
### LLM Disclosure
|
|
128
|
+
- [ ] Check venue's AI/LLM use policy in current CFP
|
|
129
|
+
- [ ] If LLM used for substantial writing: disclose as required
|
|
130
|
+
- [ ] If LLM used for code generation: disclose as required
|
|
131
|
+
- [ ] Confirm all LLM-assisted content reviewed by human authors
|
|
132
|
+
|
|
133
|
+
### Originality
|
|
134
|
+
- [ ] No paragraph-level text copied from other papers
|
|
135
|
+
- [ ] Structural patterns inspired by other papers are attributed
|
|
136
|
+
- [ ] Cross-repository content (if any) is attributed, not copied
|
|
137
|
+
- [ ] Related work descriptions are original paraphrases, not copy-paste
|
|
138
|
+
|
|
139
|
+
---
|
|
140
|
+
|
|
141
|
+
## Stage 6: Venue-Specific Requirements
|
|
142
|
+
|
|
143
|
+
> **Verify against the current year's CFP** — rules change annually.
|
|
144
|
+
|
|
145
|
+
### All Systems Venues
|
|
146
|
+
|
|
147
|
+
- [ ] **System design and implementation** — not just algorithms
|
|
148
|
+
- [ ] **Real workloads and evaluation** — microbenchmarks are insufficient
|
|
149
|
+
- [ ] **Practical benefits demonstrated** — latency, throughput, cost, energy
|
|
150
|
+
- [ ] **Comparison with state-of-the-art systems**
|
|
151
|
+
- [ ] **No simultaneous submission to other venues**
|
|
152
|
+
- [ ] **Prior arXiv/tech reports permitted**
|
|
153
|
+
|
|
154
|
+
### Page Limits Quick Reference
|
|
155
|
+
|
|
156
|
+
| Conference | Main Content | Camera-Ready | References | Format |
|
|
157
|
+
|------------|-------------|--------------|------------|--------|
|
|
158
|
+
| OSDI 2026 | 12 pages | 14 pages | Unlimited | USENIX |
|
|
159
|
+
| NSDI 2027 | 12 pages | varies | Unlimited | USENIX |
|
|
160
|
+
| ASPLOS 2027 | 12 pages | varies | Unlimited | ACM SIGPLAN |
|
|
161
|
+
| SOSP 2026 | 12 pages | varies | Unlimited | ACM SIGPLAN |
|
|
162
|
+
| EuroSys | 12 pages | varies | Unlimited | ACM |
|
|
163
|
+
|
|
164
|
+
### OSDI 2026
|
|
165
|
+
|
|
166
|
+
OSDI focuses on innovative research and quantified/insightful experiences in systems design and implementation.
|
|
167
|
+
|
|
168
|
+
**Tracks:**
|
|
169
|
+
- **Research Track**: Novel systems research
|
|
170
|
+
- **Operational Systems Track** (New in 2026): Design, implementation, analysis, and experience of operational systems
|
|
171
|
+
|
|
172
|
+
**Checklist:**
|
|
173
|
+
- [ ] ≤12 pages (excluding references)
|
|
174
|
+
- [ ] 8.5" x 11" pages, 10pt on 12pt leading, two-column, Times Roman
|
|
175
|
+
- [ ] 7" wide x 9" deep text block
|
|
176
|
+
- [ ] Pages are numbered
|
|
177
|
+
- [ ] Figures and tables legible in black and white
|
|
178
|
+
- [ ] Paper is the right length (not padded; <6pp unlikely to receive full consideration)
|
|
179
|
+
- [ ] Double-blind: no author names, affiliations
|
|
180
|
+
- [ ] Anonymized project/system name (different from arXiv/talks)
|
|
181
|
+
- [ ] Track indicated on title page and submission form
|
|
182
|
+
- [ ] Operational Systems papers: title ends with "(Operational Systems)"
|
|
183
|
+
- [ ] Max 8 submissions per author
|
|
184
|
+
- [ ] Work NOT wholly or largely generated by AI (AI editing tools are acceptable)
|
|
185
|
+
|
|
186
|
+
### NSDI 2027
|
|
187
|
+
|
|
188
|
+
NSDI focuses on design principles, implementation, and practical evaluation of networked and distributed systems.
|
|
189
|
+
|
|
190
|
+
**Tracks:**
|
|
191
|
+
- **Traditional Research Track**: Novel ideas with thorough evaluations
|
|
192
|
+
- **Frontiers Track** (New): Bold ideas without necessarily complete evaluation
|
|
193
|
+
- **Operational Systems Track**: Deployed systems with lessons learned
|
|
194
|
+
|
|
195
|
+
**Prescreening:** Reviewers read only the Introduction to check:
|
|
196
|
+
- [ ] Subject falls within NSDI scope
|
|
197
|
+
- [ ] Exposition understandable by NSDI PC member
|
|
198
|
+
- [ ] Track-specific criteria articulated in Introduction
|
|
199
|
+
|
|
200
|
+
**Checklist:**
|
|
201
|
+
- [ ] ≤12 pages (excluding references), USENIX format
|
|
202
|
+
- [ ] Two-column, 10pt, Times Roman
|
|
203
|
+
- [ ] Double-blind anonymized
|
|
204
|
+
- [ ] Contributions to networked systems design
|
|
205
|
+
- [ ] NOT out-of-scope topics (hardware architecture, physical layer, sensing, UI)
|
|
206
|
+
- [ ] Track indicated on title page and submission form
|
|
207
|
+
- [ ] Not rejected from previous NSDI deadline without one-shot revision option
|
|
208
|
+
|
|
209
|
+
### ASPLOS 2027
|
|
210
|
+
|
|
211
|
+
ASPLOS focuses on the intersection of computer architecture, programming languages, and operating systems.
|
|
212
|
+
|
|
213
|
+
**Rapid Review Round** (unique to ASPLOS):
|
|
214
|
+
- Reviewers only read the **first 2 pages**
|
|
215
|
+
- Evaluates how work advances Architecture/PL/OS research
|
|
216
|
+
- Majority of submissions may not advance past this stage
|
|
217
|
+
|
|
218
|
+
**Checklist:**
|
|
219
|
+
- [ ] First 2 pages self-contained: clearly states problem, approach, and contribution
|
|
220
|
+
- [ ] Advances Architecture, PL, and/or OS research
|
|
221
|
+
- [ ] Not just advances in another domain using arch/PL/OS
|
|
222
|
+
- [ ] ACM SIGPLAN format (`\documentclass[sigplan,10pt]{acmart}`)
|
|
223
|
+
- [ ] ≤12 pages (excluding references)
|
|
224
|
+
- [ ] Double-blind anonymized
|
|
225
|
+
- [ ] Max 4 submissions per author per cycle
|
|
226
|
+
- [ ] Resubmission note describing changes (if applicable)
|
|
227
|
+
- [ ] Not resubmitted from immediate previous ASPLOS cycle
|
|
228
|
+
|
|
229
|
+
### SOSP 2026
|
|
230
|
+
|
|
231
|
+
SOSP seeks innovative research related to design, implementation, analysis, evaluation, and deployment of computer systems software.
|
|
232
|
+
|
|
233
|
+
**Checklist:**
|
|
234
|
+
- [ ] ACM SIGPLAN format (`\documentclass[sigplan,10pt]{acmart}`)
|
|
235
|
+
- [ ] ≤12 pages technical content (excluding references)
|
|
236
|
+
- [ ] A4 or US letter, 178×229mm (7×9") text block
|
|
237
|
+
- [ ] Two-column, 8mm separation, 10pt on 12pt leading
|
|
238
|
+
- [ ] Pages numbered, references hyperlinked
|
|
239
|
+
- [ ] Figures/tables readable without magnification, encouraged in color but grayscale-readable
|
|
240
|
+
- [ ] Double-blind: paper ID instead of author names
|
|
241
|
+
- [ ] Anonymized system/project name
|
|
242
|
+
- [ ] Own work cited in third person
|
|
243
|
+
- [ ] No acknowledgments or grant numbers
|
|
244
|
+
- [ ] Artifact evaluation materials prepared (optional but recommended)
|
|
245
|
+
- [ ] Author response ≤500 words, no new experiments
|
|
246
|
+
|
|
247
|
+
### EuroSys
|
|
248
|
+
|
|
249
|
+
- [ ] ACM template used
|
|
250
|
+
- [ ] Page limit: 12 pages
|
|
251
|
+
- [ ] Double-blind formatting
|
|
252
|
+
- [ ] Artifact evaluation encouraged
|
|
253
|
+
|
|
254
|
+
---
|
|
255
|
+
|
|
256
|
+
## Stage 7: Final Pass
|
|
257
|
+
|
|
258
|
+
### Before Clicking Submit
|
|
259
|
+
- [ ] PDF renders correctly (no missing fonts, broken figures)
|
|
260
|
+
- [ ] All TODO/FIXME comments removed from source
|
|
261
|
+
- [ ] `[CITATION NEEDED]` markers resolved or removed
|
|
262
|
+
- [ ] Author names correct (camera-ready) or removed (blind)
|
|
263
|
+
- [ ] Acknowledgements removed for blind submission
|
|
264
|
+
- [ ] Supplementary material properly anonymized
|
|
265
|
+
- [ ] File size within submission system limits
|
|
266
|
+
- [ ] Paper title matches submission system entry
|
|
267
|
+
- [ ] Abstract in submission system matches paper abstract
|
|
268
|
+
- [ ] Correct track/topic area selected in submission system
|
|
269
|
+
|
|
270
|
+
### One-Sentence Self-Test (Levin & Redell Six Dimensions)
|
|
271
|
+
For each dimension, answer in one sentence:
|
|
272
|
+
1. **Original Ideas**: What is genuinely new?
|
|
273
|
+
2. **Reality**: Is the system built and tested?
|
|
274
|
+
3. **Lessons**: What did we learn that others can use?
|
|
275
|
+
4. **Choices**: Did we discuss alternatives for every major decision?
|
|
276
|
+
5. **Context**: Is the related work fair and complete?
|
|
277
|
+
6. **Presentation**: Would a non-expert in this subfield understand the paper?
|
|
278
|
+
|
|
279
|
+
If any answer is weak, revise that aspect before submitting.
|
|
@@ -0,0 +1,116 @@
|
|
|
1
|
+
<!-- vendored from orchestra-research/AI-research-SKILLs@773a52944ba4747a18bd4ae9ade53fff041adcbc 20-ml-paper-writing/systems-paper-writing/references/reviewer-guidelines.md; MIT (c) Orchestra Research -->
|
|
2
|
+
# Systems Conference Reviewer Guidelines
|
|
3
|
+
|
|
4
|
+
Systems conferences (OSDI, NSDI, ASPLOS, SOSP) evaluate papers differently from ML/AI venues. Understanding these differences is critical for cross-venue submissions.
|
|
5
|
+
|
|
6
|
+
---
|
|
7
|
+
|
|
8
|
+
## Core Evaluation Criteria for Systems
|
|
9
|
+
|
|
10
|
+
| Criterion | What Reviewers Look For |
|
|
11
|
+
|-----------|------------------------|
|
|
12
|
+
| **Novelty** | New system design, not just incremental improvement |
|
|
13
|
+
| **Significance** | Solves important practical problem |
|
|
14
|
+
| **System Design** | Sound architecture, clear design decisions |
|
|
15
|
+
| **Implementation** | Working prototype, not just simulation |
|
|
16
|
+
| **Evaluation** | Real workloads, end-to-end performance |
|
|
17
|
+
| **Clarity** | Clear writing, reproducible |
|
|
18
|
+
|
|
19
|
+
## OSDI 2026 Reviewer Perspective
|
|
20
|
+
|
|
21
|
+
**What reviewers evaluate:**
|
|
22
|
+
- Topic relevance to computer systems
|
|
23
|
+
- Potential to impact future systems research and practices
|
|
24
|
+
- Interest to substantial portion of OSDI attendees
|
|
25
|
+
- Papers with little PC overlap are less likely accepted
|
|
26
|
+
|
|
27
|
+
**Research Track criteria:**
|
|
28
|
+
- Novelty, significance, clarity, relevance, correctness
|
|
29
|
+
- Quantified or insightful experiences in systems
|
|
30
|
+
|
|
31
|
+
**Operational Systems Track criteria:**
|
|
32
|
+
- Real-world deployment at meaningful scale
|
|
33
|
+
- Lessons that deepen understanding of existing problems
|
|
34
|
+
- Disproves or strengthens existing assumptions
|
|
35
|
+
- Novel research ideas NOT required
|
|
36
|
+
|
|
37
|
+
**New in 2026:**
|
|
38
|
+
- No author response period
|
|
39
|
+
- Conditional accept replaces revise-and-resubmit
|
|
40
|
+
- Target acceptance rate ≥20%
|
|
41
|
+
- Reviewers encouraged to down-rank padded papers
|
|
42
|
+
|
|
43
|
+
## NSDI 2027 Reviewer Perspective
|
|
44
|
+
|
|
45
|
+
**Prescreening (Introduction only):**
|
|
46
|
+
|
|
47
|
+
Reviewers check three criteria in the prescreening phase:
|
|
48
|
+
1. **Scope**: Subject within NSDI topics
|
|
49
|
+
2. **Accessibility**: Understandable by PC member
|
|
50
|
+
3. **Track alignment**: Meets track-specific criteria
|
|
51
|
+
|
|
52
|
+
**Track-specific review:**
|
|
53
|
+
|
|
54
|
+
| Track | Key Criterion |
|
|
55
|
+
|-------|---------------|
|
|
56
|
+
| Research | Novel idea + compelling evaluation evidence |
|
|
57
|
+
| Frontiers | Bold non-incremental idea (complete evaluation not required) |
|
|
58
|
+
| Operational | Deployment context, scale, lessons for community |
|
|
59
|
+
|
|
60
|
+
**One-shot revision:**
|
|
61
|
+
- Rejected papers may receive a list of issues to address
|
|
62
|
+
- Authors can resubmit revision at next deadline
|
|
63
|
+
- Same reviewers review the revision (to extent possible)
|
|
64
|
+
|
|
65
|
+
## ASPLOS 2027 Reviewer Perspective
|
|
66
|
+
|
|
67
|
+
**Rapid Review Round:**
|
|
68
|
+
- Reviewers read ONLY first 2 pages
|
|
69
|
+
- Evaluates: Does this advance Architecture, PL, or OS research?
|
|
70
|
+
- Majority of submissions may not advance past this stage
|
|
71
|
+
- Similar to Nature/Science early screening model
|
|
72
|
+
|
|
73
|
+
**Full Review criteria:**
|
|
74
|
+
- Advances in core ASPLOS disciplines (not just using them)
|
|
75
|
+
- Quality of system design and implementation
|
|
76
|
+
- Major Revision decision available
|
|
77
|
+
|
|
78
|
+
## SOSP 2026 Reviewer Perspective
|
|
79
|
+
|
|
80
|
+
**Core evaluation:**
|
|
81
|
+
- Novelty, significance, interest, clarity, relevance, correctness
|
|
82
|
+
- Encourages groundbreaking work in significant new directions
|
|
83
|
+
- Different evaluation criteria for new problems vs established areas
|
|
84
|
+
|
|
85
|
+
**Author Response:**
|
|
86
|
+
- Limited to: correcting factual errors + addressing reviewer questions
|
|
87
|
+
- NO new experiments or additional work
|
|
88
|
+
- Keep under 500 words
|
|
89
|
+
|
|
90
|
+
**Artifact Evaluation:**
|
|
91
|
+
- Optional but encouraged
|
|
92
|
+
- Cooperative process: authors can fix issues during evaluation
|
|
93
|
+
- Register within days of acceptance notification
|
|
94
|
+
|
|
95
|
+
## ML vs Systems: Key Review Differences
|
|
96
|
+
|
|
97
|
+
| Aspect | ML/AI Venues | Systems Venues |
|
|
98
|
+
|--------|-------------|---------------|
|
|
99
|
+
| **Page limit** | 7-9 pages | 12 pages |
|
|
100
|
+
| **Evaluation focus** | Benchmarks, ablations, metrics | End-to-end system performance, real workloads |
|
|
101
|
+
| **Implementation** | Code often optional | Working system expected |
|
|
102
|
+
| **Novelty** | New methods/insights | New system designs/approaches |
|
|
103
|
+
| **Reproducibility** | Checklist-based | Artifact evaluation (optional) |
|
|
104
|
+
| **Template** | Venue-specific `.sty` | USENIX `.sty` or ACM `acmart.cls` |
|
|
105
|
+
| **Review process** | Single deadline | Often dual deadlines |
|
|
106
|
+
|
|
107
|
+
## Systems-Specific Common Concerns
|
|
108
|
+
|
|
109
|
+
| Concern | How to Pre-empt |
|
|
110
|
+
|---------|-----------------|
|
|
111
|
+
| "Just an ML paper, not systems" | Emphasize system design, architecture decisions, deployment challenges |
|
|
112
|
+
| "Evaluation only on microbenchmarks" | Include end-to-end evaluation with real workloads |
|
|
113
|
+
| "No working prototype" | Build and evaluate a real system, not just simulate |
|
|
114
|
+
| "Deployment not realistic" | Show real-world applicability, discuss practical constraints |
|
|
115
|
+
| "Not relevant to systems community" | Frame contributions in systems terms, cite systems papers |
|
|
116
|
+
| "ASPLOS: Not advancing arch/PL/OS" | Explicitly state how work advances core disciplines |
|