dsh-aris-panel 0.1.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/LICENSE +21 -0
- package/README.md +98 -0
- package/README_CN.md +87 -0
- package/dsh/checkout.patch.yml +38 -0
- package/dsh/client.js +634 -0
- package/dsh/cordis.patch.yml +44 -0
- package/dsh/index.mjs +76 -0
- package/dsh/run-status.mjs +182 -0
- package/dsh/scope-limits.mjs +50 -0
- package/dsh/workbench.mjs +291 -0
- package/mcp-servers/claude-review/README.md +93 -0
- package/mcp-servers/claude-review/run_with_claude_aws.sh +49 -0
- package/mcp-servers/claude-review/server.py +718 -0
- package/mcp-servers/codex-image2/README.md +65 -0
- package/mcp-servers/codex-image2/server.py +893 -0
- package/mcp-servers/feishu-bridge/requirements.txt +1 -0
- package/mcp-servers/feishu-bridge/server.py +240 -0
- package/mcp-servers/gemini-review/README.md +171 -0
- package/mcp-servers/gemini-review/server.py +1856 -0
- package/mcp-servers/llm-chat/requirements.txt +1 -0
- package/mcp-servers/llm-chat/server.py +664 -0
- package/mcp-servers/manual-review/README.md +133 -0
- package/mcp-servers/manual-review/server.py +910 -0
- package/mcp-servers/manual-review/ui.html +279 -0
- package/mcp-servers/minimax-chat/requirements.txt +1 -0
- package/mcp-servers/minimax-chat/server.py +381 -0
- package/package.json +51 -0
- package/skills/ablation-planner/SKILL.md +123 -0
- package/skills/alphaxiv/SKILL.md +196 -0
- package/skills/analyze-results/SKILL.md +46 -0
- package/skills/arxiv/SKILL.md +248 -0
- package/skills/auto-paper-improvement-loop/SKILL.md +651 -0
- package/skills/auto-review-loop/SKILL.md +1137 -0
- package/skills/auto-review-loop-llm/SKILL.md +259 -0
- package/skills/auto-review-loop-minimax/SKILL.md +302 -0
- package/skills/citation-audit/SKILL.md +502 -0
- package/skills/claims-drafting/SKILL.md +227 -0
- package/skills/comm-lit-review/SKILL.md +297 -0
- package/skills/deepxiv/SKILL.md +263 -0
- package/skills/dse-loop/SKILL.md +296 -0
- package/skills/embodiment-description/SKILL.md +129 -0
- package/skills/exa-search/SKILL.md +205 -0
- package/skills/experiment-audit/SKILL.md +311 -0
- package/skills/experiment-bridge/SKILL.md +376 -0
- package/skills/experiment-plan/SKILL.md +249 -0
- package/skills/experiment-queue/SKILL.md +431 -0
- package/skills/experiment-queue/scripts/build_manifest.py +142 -0
- package/skills/experiment-queue/scripts/queue_manager.py +433 -0
- package/skills/feishu-notify/SKILL.md +156 -0
- package/skills/figure-description/SKILL.md +138 -0
- package/skills/figure-spec/SKILL.md +262 -0
- package/skills/figure-spec/scripts/figure_renderer.py +799 -0
- package/skills/formula-derivation/SKILL.md +280 -0
- package/skills/gemini-search/SKILL.md +231 -0
- package/skills/grant-proposal/SKILL.md +698 -0
- package/skills/idea-creator/SKILL.md +542 -0
- package/skills/idea-discovery/SKILL.md +521 -0
- package/skills/idea-discovery-robot/SKILL.md +363 -0
- package/skills/integrity-forensics/SKILL.md +284 -0
- package/skills/interview-cheatsheet/SKILL.md +245 -0
- package/skills/invention-structuring/SKILL.md +188 -0
- package/skills/jurisdiction-format/SKILL.md +192 -0
- package/skills/kill-argument/SKILL.md +437 -0
- package/skills/mermaid-diagram/SKILL.md +419 -0
- package/skills/meta-apply/SKILL.md +141 -0
- package/skills/meta-optimize/SKILL.md +437 -0
- package/skills/monitor-experiment/SKILL.md +140 -0
- package/skills/novelty-check/SKILL.md +101 -0
- package/skills/openalex/SKILL.md +237 -0
- package/skills/overleaf-sync/SKILL.md +220 -0
- package/skills/paper-claim-audit/SKILL.md +348 -0
- package/skills/paper-compile/SKILL.md +266 -0
- package/skills/paper-figure/SKILL.md +312 -0
- package/skills/paper-illustration/SKILL.md +736 -0
- package/skills/paper-illustration-image2/SKILL.md +391 -0
- package/skills/paper-illustration-image2/scripts/paper_illustration_image2.py +255 -0
- package/skills/paper-plan/SKILL.md +386 -0
- package/skills/paper-poster/SKILL.md +19 -0
- package/skills/paper-poster-html/DESIGN_FINAL.md +176 -0
- package/skills/paper-poster-html/IMPLEMENTATION_CONVENTIONS.md +161 -0
- package/skills/paper-poster-html/LICENSES/posterly-MIT.txt +21 -0
- package/skills/paper-poster-html/NOTICE.md +57 -0
- package/skills/paper-poster-html/SKILL.md +323 -0
- package/skills/paper-poster-html/scripts/_posterly/__init__.py +0 -0
- package/skills/paper-poster-html/scripts/_posterly/canvas.py +200 -0
- package/skills/paper-poster-html/scripts/_posterly/measure.py +588 -0
- package/skills/paper-poster-html/scripts/_posterly/polish.py +498 -0
- package/skills/paper-poster-html/scripts/_posterly/preflight.py +489 -0
- package/skills/paper-poster-html/scripts/_posterly/render.py +215 -0
- package/skills/paper-poster-html/scripts/_posterly/textutil.py +16 -0
- package/skills/paper-poster-html/scripts/_posterly/verify_final.py +171 -0
- package/skills/paper-poster-html/scripts/asset_check.py +897 -0
- package/skills/paper-poster-html/scripts/extract_pdf_figures.py +666 -0
- package/skills/paper-poster-html/scripts/poster_check.py +251 -0
- package/skills/paper-poster-html/scripts/preprocess_figures.py +238 -0
- package/skills/paper-poster-html/scripts/render_preview.py +217 -0
- package/skills/paper-poster-html/scripts/run_gates.py +556 -0
- package/skills/paper-poster-html/scripts/style_check.py +1324 -0
- package/skills/paper-poster-html/templates/COMPONENTS.md +462 -0
- package/skills/paper-poster-html/templates/README.md +170 -0
- package/skills/paper-poster-html/templates/landscape_4col.html +1032 -0
- package/skills/paper-poster-html/templates/landscape_hero.html +1046 -0
- package/skills/paper-poster-html/templates/portrait_2col.html +947 -0
- package/skills/paper-poster-html/templates/tokens/acl.json +9 -0
- package/skills/paper-poster-html/templates/tokens/cvpr.json +9 -0
- package/skills/paper-poster-html/templates/tokens/generic.json +9 -0
- package/skills/paper-poster-html/templates/tokens/iclr.json +9 -0
- package/skills/paper-poster-html/templates/tokens/icml.json +9 -0
- package/skills/paper-poster-html/templates/tokens/neurips.json +9 -0
- package/skills/paper-slides/SKILL.md +635 -0
- package/skills/paper-talk/SKILL.md +381 -0
- package/skills/paper-write/SKILL.md +604 -0
- package/skills/paper-write/templates/IEEEtran.bst +2409 -0
- package/skills/paper-write/templates/IEEEtran.cls +6347 -0
- package/skills/paper-write/templates/iclr2026.tex +84 -0
- package/skills/paper-write/templates/icml2025.tex +87 -0
- package/skills/paper-write/templates/ieee_conference.tex +89 -0
- package/skills/paper-write/templates/ieee_journal.tex +93 -0
- package/skills/paper-write/templates/math_commands.tex +48 -0
- package/skills/paper-write/templates/neurips2025.tex +80 -0
- package/skills/paper-writing/SKILL.md +916 -0
- package/skills/patent-novelty-check/SKILL.md +153 -0
- package/skills/patent-pipeline/SKILL.md +344 -0
- package/skills/patent-review/SKILL.md +203 -0
- package/skills/pixel-art/SKILL.md +137 -0
- package/skills/prior-art-search/SKILL.md +146 -0
- package/skills/proof-checker/SKILL.md +866 -0
- package/skills/proof-orchestrator/NOTICE.md +24 -0
- package/skills/proof-orchestrator/SKILL.md +254 -0
- package/skills/proof-orchestrator/references/audit-output-contract.md +126 -0
- package/skills/proof-orchestrator/references/deepseek-routing.md +74 -0
- package/skills/proof-orchestrator/references/dispatch-prompts.md +227 -0
- package/skills/proof-orchestrator/references/notation-audit.md +135 -0
- package/skills/proof-orchestrator/references/proof-audit-rubric.md +70 -0
- package/skills/proof-orchestrator/references/stress-tests.md +38 -0
- package/skills/proof-writer/SKILL.md +223 -0
- package/skills/qzcli/SKILL.md +324 -0
- package/skills/rebuttal/SKILL.md +376 -0
- package/skills/render-html/SKILL.md +316 -0
- package/skills/render-html/scripts/render_html.py +1006 -0
- package/skills/render-html/scripts/templates/academic.html +703 -0
- package/skills/render-html/scripts/templates/dashboard.html +333 -0
- package/skills/research-lit/SKILL.md +756 -0
- package/skills/research-pipeline/SKILL.md +384 -0
- package/skills/research-refine/SKILL.md +770 -0
- package/skills/research-refine-pipeline/SKILL.md +186 -0
- package/skills/research-review/SKILL.md +198 -0
- package/skills/research-wiki/SKILL.md +461 -0
- package/skills/resubmit-pipeline/SKILL.md +447 -0
- package/skills/result-to-claim/SKILL.md +311 -0
- package/skills/run-experiment/SKILL.md +313 -0
- package/skills/semantic-scholar/SKILL.md +236 -0
- package/skills/serverless-modal/SKILL.md +335 -0
- package/skills/shared-references/acceptance-gate.md +324 -0
- package/skills/shared-references/assurance-contract.md +248 -0
- package/skills/shared-references/capture-antipatterns.md +78 -0
- package/skills/shared-references/citation-discipline.md +583 -0
- package/skills/shared-references/compute-env-contract.md +163 -0
- package/skills/shared-references/effort-contract.md +183 -0
- package/skills/shared-references/evidence-precheck.md +65 -0
- package/skills/shared-references/experiment-integrity.md +49 -0
- package/skills/shared-references/external-cadence.md +326 -0
- package/skills/shared-references/fan-out-pattern.md +366 -0
- package/skills/shared-references/injection-hygiene.md +127 -0
- package/skills/shared-references/integration-contract.md +461 -0
- package/skills/shared-references/output-composition.md +93 -0
- package/skills/shared-references/output-language.md +45 -0
- package/skills/shared-references/output-manifest.md +49 -0
- package/skills/shared-references/output-versioning.md +111 -0
- package/skills/shared-references/patent-format-cn.md +199 -0
- package/skills/shared-references/patent-format-ep.md +173 -0
- package/skills/shared-references/patent-format-us.md +161 -0
- package/skills/shared-references/patent-writing-principles.md +197 -0
- package/skills/shared-references/prior-art-databases.md +141 -0
- package/skills/shared-references/resumable-runs.md +109 -0
- package/skills/shared-references/review-scope-limits.md +81 -0
- package/skills/shared-references/review-tracing.md +391 -0
- package/skills/shared-references/reviewer-independence.md +79 -0
- package/skills/shared-references/reviewer-routing.md +852 -0
- package/skills/shared-references/skill-governance.md +104 -0
- package/skills/shared-references/taste-calibration.md +85 -0
- package/skills/shared-references/venue-checklists.md +114 -0
- package/skills/shared-references/wiki-helper-resolution.md +134 -0
- package/skills/shared-references/writing-principles.md +525 -0
- package/skills/skills-codex/README.md +102 -0
- package/skills/skills-codex/README_CN.md +100 -0
- package/skills/skills-codex/ablation-planner/SKILL.md +126 -0
- package/skills/skills-codex/alphaxiv/SKILL.md +186 -0
- package/skills/skills-codex/analyze-results/SKILL.md +45 -0
- package/skills/skills-codex/arxiv/SKILL.md +210 -0
- package/skills/skills-codex/auto-paper-improvement-loop/SKILL.md +574 -0
- package/skills/skills-codex/auto-review-loop/SKILL.md +500 -0
- package/skills/skills-codex/auto-review-loop-llm/SKILL.md +247 -0
- package/skills/skills-codex/auto-review-loop-minimax/SKILL.md +290 -0
- package/skills/skills-codex/citation-audit/SKILL.md +504 -0
- package/skills/skills-codex/claims-drafting/SKILL.md +239 -0
- package/skills/skills-codex/comm-lit-review/SKILL.md +299 -0
- package/skills/skills-codex/comm-lit-review/references/domain-taxonomy.md +57 -0
- package/skills/skills-codex/comm-lit-review/references/output-template.md +37 -0
- package/skills/skills-codex/comm-lit-review/references/source-policy.md +99 -0
- package/skills/skills-codex/comm-lit-review/references/venue-tiering.md +112 -0
- package/skills/skills-codex/deepxiv/SKILL.md +142 -0
- package/skills/skills-codex/dse-loop/SKILL.md +285 -0
- package/skills/skills-codex/embodiment-description/SKILL.md +129 -0
- package/skills/skills-codex/exa-search/SKILL.md +192 -0
- package/skills/skills-codex/experiment-audit/SKILL.md +286 -0
- package/skills/skills-codex/experiment-bridge/SKILL.md +356 -0
- package/skills/skills-codex/experiment-plan/SKILL.md +249 -0
- package/skills/skills-codex/experiment-queue/SKILL.md +401 -0
- package/skills/skills-codex/feishu-notify/SKILL.md +155 -0
- package/skills/skills-codex/figure-description/SKILL.md +138 -0
- package/skills/skills-codex/figure-spec/SKILL.md +252 -0
- package/skills/skills-codex/formula-derivation/SKILL.md +280 -0
- package/skills/skills-codex/gemini-search/SKILL.md +205 -0
- package/skills/skills-codex/grant-proposal/SKILL.md +626 -0
- package/skills/skills-codex/idea-creator/SKILL.md +405 -0
- package/skills/skills-codex/idea-discovery/SKILL.md +475 -0
- package/skills/skills-codex/idea-discovery-robot/SKILL.md +362 -0
- package/skills/skills-codex/integrity-forensics/SKILL.md +106 -0
- package/skills/skills-codex/interview-cheatsheet/SKILL.md +245 -0
- package/skills/skills-codex/invention-structuring/SKILL.md +188 -0
- package/skills/skills-codex/jurisdiction-format/SKILL.md +192 -0
- package/skills/skills-codex/kill-argument/SKILL.md +403 -0
- package/skills/skills-codex/mermaid-diagram/SKILL.md +379 -0
- package/skills/skills-codex/meta-apply/SKILL.md +154 -0
- package/skills/skills-codex/meta-optimize/SKILL.md +348 -0
- package/skills/skills-codex/monitor-experiment/SKILL.md +98 -0
- package/skills/skills-codex/novelty-check/SKILL.md +89 -0
- package/skills/skills-codex/openalex/SKILL.md +228 -0
- package/skills/skills-codex/overleaf-sync/SKILL.md +220 -0
- package/skills/skills-codex/paper-claim-audit/SKILL.md +350 -0
- package/skills/skills-codex/paper-compile/SKILL.md +253 -0
- package/skills/skills-codex/paper-figure/SKILL.md +311 -0
- package/skills/skills-codex/paper-illustration/SKILL.md +690 -0
- package/skills/skills-codex/paper-illustration-image2/SKILL.md +383 -0
- package/skills/skills-codex/paper-illustration-image2/scripts/paper_illustration_image2.py +255 -0
- package/skills/skills-codex/paper-plan/SKILL.md +278 -0
- package/skills/skills-codex/paper-poster/SKILL.md +19 -0
- package/skills/skills-codex/paper-poster-html/SKILL.md +377 -0
- package/skills/skills-codex/paper-slides/SKILL.md +571 -0
- package/skills/skills-codex/paper-talk/SKILL.md +381 -0
- package/skills/skills-codex/paper-write/SKILL.md +411 -0
- package/skills/skills-codex/paper-write/templates/IEEEtran.bst +2409 -0
- package/skills/skills-codex/paper-write/templates/IEEEtran.cls +6347 -0
- package/skills/skills-codex/paper-write/templates/aaai2026.bst +1493 -0
- package/skills/skills-codex/paper-write/templates/aaai2026.sty +315 -0
- package/skills/skills-codex/paper-write/templates/aaai2026.tex +952 -0
- package/skills/skills-codex/paper-write/templates/acl.sty +312 -0
- package/skills/skills-codex/paper-write/templates/acl2026.tex +377 -0
- package/skills/skills-codex/paper-write/templates/acl_natbib.bst +1940 -0
- package/skills/skills-codex/paper-write/templates/acm.bst +3081 -0
- package/skills/skills-codex/paper-write/templates/acm_mm2026.tex +204 -0
- package/skills/skills-codex/paper-write/templates/acmart.cls +3520 -0
- package/skills/skills-codex/paper-write/templates/cvpr.bst +1448 -0
- package/skills/skills-codex/paper-write/templates/cvpr.sty +508 -0
- package/skills/skills-codex/paper-write/templates/cvpr2026.tex +63 -0
- package/skills/skills-codex/paper-write/templates/iclr2026.tex +84 -0
- package/skills/skills-codex/paper-write/templates/iclr2026_conference.bst +1440 -0
- package/skills/skills-codex/paper-write/templates/iclr2026_conference.sty +246 -0
- package/skills/skills-codex/paper-write/templates/icml2026.sty +767 -0
- package/skills/skills-codex/paper-write/templates/icml2026.tex +662 -0
- package/skills/skills-codex/paper-write/templates/ieee_conference.tex +89 -0
- package/skills/skills-codex/paper-write/templates/ieee_journal.tex +93 -0
- package/skills/skills-codex/paper-write/templates/math_commands.tex +48 -0
- package/skills/skills-codex/paper-write/templates/neurips2026.tex +493 -0
- package/skills/skills-codex/paper-write/templates/neurips_2026.sty +437 -0
- package/skills/skills-codex/paper-writing/SKILL.md +731 -0
- package/skills/skills-codex/patent-novelty-check/SKILL.md +153 -0
- package/skills/skills-codex/patent-pipeline/SKILL.md +344 -0
- package/skills/skills-codex/patent-review/SKILL.md +202 -0
- package/skills/skills-codex/pixel-art/SKILL.md +139 -0
- package/skills/skills-codex/prior-art-search/SKILL.md +146 -0
- package/skills/skills-codex/proof-checker/SKILL.md +554 -0
- package/skills/skills-codex/proof-orchestrator/SKILL.md +260 -0
- package/skills/skills-codex/proof-orchestrator/references/audit-output-contract.md +126 -0
- package/skills/skills-codex/proof-orchestrator/references/deepseek-routing.md +76 -0
- package/skills/skills-codex/proof-orchestrator/references/dispatch-prompts.md +227 -0
- package/skills/skills-codex/proof-orchestrator/references/notation-audit.md +135 -0
- package/skills/skills-codex/proof-orchestrator/references/proof-audit-rubric.md +70 -0
- package/skills/skills-codex/proof-orchestrator/references/stress-tests.md +38 -0
- package/skills/skills-codex/proof-writer/SKILL.md +222 -0
- package/skills/skills-codex/qzcli/SKILL.md +324 -0
- package/skills/skills-codex/rebuttal/SKILL.md +305 -0
- package/skills/skills-codex/render-html/SKILL.md +305 -0
- package/skills/skills-codex/render-html/scripts/__pycache__/render_html.cpython-314.pyc +0 -0
- package/skills/skills-codex/render-html/scripts/render_html.py +909 -0
- package/skills/skills-codex/render-html/scripts/templates/academic.html +342 -0
- package/skills/skills-codex/render-html/scripts/templates/dashboard.html +333 -0
- package/skills/skills-codex/research-lit/SKILL.md +464 -0
- package/skills/skills-codex/research-pipeline/SKILL.md +340 -0
- package/skills/skills-codex/research-refine/SKILL.md +721 -0
- package/skills/skills-codex/research-refine-pipeline/SKILL.md +186 -0
- package/skills/skills-codex/research-review/SKILL.md +135 -0
- package/skills/skills-codex/research-wiki/SKILL.md +421 -0
- package/skills/skills-codex/resubmit-pipeline/SKILL.md +444 -0
- package/skills/skills-codex/result-to-claim/SKILL.md +246 -0
- package/skills/skills-codex/run-experiment/SKILL.md +236 -0
- package/skills/skills-codex/semantic-scholar/SKILL.md +219 -0
- package/skills/skills-codex/serverless-modal/SKILL.md +335 -0
- package/skills/skills-codex/shared-references/acceptance-gate.md +336 -0
- package/skills/skills-codex/shared-references/assurance-contract.md +139 -0
- package/skills/skills-codex/shared-references/capture-antipatterns.md +84 -0
- package/skills/skills-codex/shared-references/citation-discipline.md +452 -0
- package/skills/skills-codex/shared-references/compute-env-contract.md +163 -0
- package/skills/skills-codex/shared-references/effort-contract.md +143 -0
- package/skills/skills-codex/shared-references/evidence-precheck.md +73 -0
- package/skills/skills-codex/shared-references/experiment-integrity.md +49 -0
- package/skills/skills-codex/shared-references/external-cadence.md +334 -0
- package/skills/skills-codex/shared-references/fan-out-pattern.md +375 -0
- package/skills/skills-codex/shared-references/injection-hygiene.md +132 -0
- package/skills/skills-codex/shared-references/integration-contract.md +372 -0
- package/skills/skills-codex/shared-references/output-composition.md +98 -0
- package/skills/skills-codex/shared-references/output-language.md +45 -0
- package/skills/skills-codex/shared-references/output-manifest.md +40 -0
- package/skills/skills-codex/shared-references/output-versioning.md +111 -0
- package/skills/skills-codex/shared-references/patent-format-cn.md +199 -0
- package/skills/skills-codex/shared-references/patent-format-ep.md +173 -0
- package/skills/skills-codex/shared-references/patent-format-us.md +161 -0
- package/skills/skills-codex/shared-references/patent-writing-principles.md +197 -0
- package/skills/skills-codex/shared-references/prior-art-databases.md +141 -0
- package/skills/skills-codex/shared-references/resumable-runs.md +125 -0
- package/skills/skills-codex/shared-references/review-scope-limits.md +81 -0
- package/skills/skills-codex/shared-references/review-tracing.md +144 -0
- package/skills/skills-codex/shared-references/reviewer-independence.md +66 -0
- package/skills/skills-codex/shared-references/reviewer-routing.md +128 -0
- package/skills/skills-codex/shared-references/skill-governance.md +119 -0
- package/skills/skills-codex/shared-references/taste-calibration.md +90 -0
- package/skills/skills-codex/shared-references/venue-checklists.md +73 -0
- package/skills/skills-codex/shared-references/wiki-helper-resolution.md +69 -0
- package/skills/skills-codex/shared-references/writing-principles.md +525 -0
- package/skills/skills-codex/slides-polish/SKILL.md +563 -0
- package/skills/skills-codex/specification-writing/SKILL.md +211 -0
- package/skills/skills-codex/system-profile/SKILL.md +103 -0
- package/skills/skills-codex/training-check/SKILL.md +83 -0
- package/skills/skills-codex/vast-gpu/SKILL.md +394 -0
- package/skills/skills-codex/web-debug-search/SKILL.md +334 -0
- package/skills/skills-codex/wiki-enrich/SKILL.md +255 -0
- package/skills/skills-codex/writing-systems-papers/SKILL.md +184 -0
- package/skills/skills-codex-claude-review/README.md +79 -0
- package/skills/skills-codex-claude-review/README_CN.md +78 -0
- package/skills/skills-codex-claude-review/auto-paper-improvement-loop/SKILL.md +581 -0
- package/skills/skills-codex-claude-review/auto-review-loop/SKILL.md +510 -0
- package/skills/skills-codex-claude-review/novelty-check/SKILL.md +102 -0
- package/skills/skills-codex-claude-review/paper-figure/SKILL.md +319 -0
- package/skills/skills-codex-claude-review/paper-plan/SKILL.md +287 -0
- package/skills/skills-codex-claude-review/paper-write/SKILL.md +420 -0
- package/skills/skills-codex-claude-review/research-refine/SKILL.md +732 -0
- package/skills/skills-codex-claude-review/research-review/SKILL.md +149 -0
- package/skills/skills-codex-gemini-review/README.md +176 -0
- package/skills/skills-codex-gemini-review/README_CN.md +175 -0
- package/skills/skills-codex-gemini-review/auto-paper-improvement-loop/SKILL.md +331 -0
- package/skills/skills-codex-gemini-review/auto-review-loop/SKILL.md +304 -0
- package/skills/skills-codex-gemini-review/grant-proposal/SKILL.md +630 -0
- package/skills/skills-codex-gemini-review/idea-creator/SKILL.md +263 -0
- package/skills/skills-codex-gemini-review/idea-discovery/SKILL.md +275 -0
- package/skills/skills-codex-gemini-review/idea-discovery-robot/SKILL.md +365 -0
- package/skills/skills-codex-gemini-review/novelty-check/SKILL.md +92 -0
- package/skills/skills-codex-gemini-review/paper-figure/SKILL.md +289 -0
- package/skills/skills-codex-gemini-review/paper-plan/SKILL.md +265 -0
- package/skills/skills-codex-gemini-review/paper-poster-html/SKILL.md +102 -0
- package/skills/skills-codex-gemini-review/paper-slides/SKILL.md +582 -0
- package/skills/skills-codex-gemini-review/paper-write/SKILL.md +346 -0
- package/skills/skills-codex-gemini-review/paper-writing/SKILL.md +312 -0
- package/skills/skills-codex-gemini-review/research-refine/SKILL.md +674 -0
- package/skills/skills-codex-gemini-review/research-review/SKILL.md +112 -0
- package/skills/slides-polish/SKILL.md +565 -0
- package/skills/specification-writing/SKILL.md +211 -0
- package/skills/system-profile/SKILL.md +103 -0
- package/skills/training-check/SKILL.md +132 -0
- package/skills/vast-gpu/SKILL.md +394 -0
- package/skills/web-debug-search/SKILL.md +334 -0
- package/skills/wiki-enrich/SKILL.md +257 -0
- package/skills/writing-systems-papers/SKILL.md +184 -0
- package/templates/CLAUDE_MD_TEMPLATE.md +29 -0
- package/templates/EXPERIMENT_LOG_TEMPLATE.md +47 -0
- package/templates/EXPERIMENT_PLAN_TEMPLATE.md +51 -0
- package/templates/EXPERIMENT_PLAN_TEMPLATE_CN.md +53 -0
- package/templates/FINDINGS_TEMPLATE.md +52 -0
- package/templates/IDEA_CANDIDATES_TEMPLATE.md +47 -0
- package/templates/IDEA_CANDIDATES_TEMPLATE_CN.md +47 -0
- package/templates/INVENTION_BRIEF_TEMPLATE.md +87 -0
- package/templates/MANIFEST_TEMPLATE.md +7 -0
- package/templates/NARRATIVE_REPORT_TEMPLATE.md +49 -0
- package/templates/PAPER_PLAN_TEMPLATE.md +47 -0
- package/templates/PATENT_CLAIMS_TEMPLATE.md +78 -0
- package/templates/PATENT_SPECIFICATION_TEMPLATE.md +68 -0
- package/templates/README.md +57 -0
- package/templates/RESEARCH_BRIEF_TEMPLATE.md +35 -0
- package/templates/RESEARCH_BRIEF_TEMPLATE_CN.md +41 -0
- package/templates/RESEARCH_CONTRACT_TEMPLATE.md +60 -0
- package/templates/claude-hooks/corpus_write_guard.json +16 -0
- package/templates/claude-hooks/corpus_write_guard.py +85 -0
- package/templates/claude-hooks/meta_logging.json +74 -0
- package/templates/gitignore-trace.txt +3 -0
- package/tools/__pycache__/check_skills_inventory.cpython-314.pyc +0 -0
- package/tools/arxiv_fetch.py +311 -0
- package/tools/capture_filter.py +126 -0
- package/tools/check_skills_inventory.py +273 -0
- package/tools/convert_skills_to_llm_chat.py +282 -0
- package/tools/copilot_native_evidence.py +818 -0
- package/tools/deepxiv_fetch.py +213 -0
- package/tools/evidence_check.py +212 -0
- package/tools/exa_search.py +425 -0
- package/tools/experiment_queue/README.md +118 -0
- package/tools/experiment_queue/build_manifest.py +44 -0
- package/tools/experiment_queue/queue_manager.py +44 -0
- package/tools/extract_paper_style.py +560 -0
- package/tools/figure_renderer.py +69 -0
- package/tools/forensics_gate.py +669 -0
- package/tools/generate_codex_claude_review_overrides.py +299 -0
- package/tools/idea_discovery_gate.py +256 -0
- package/tools/install_aris.ps1 +1372 -0
- package/tools/install_aris.sh +1370 -0
- package/tools/install_aris_codex.sh +1023 -0
- package/tools/install_aris_copilot.sh +1052 -0
- package/tools/iteration_log.py +143 -0
- package/tools/lint_skills_helpers.sh +84 -0
- package/tools/meta_opt/check_ready.sh +80 -0
- package/tools/meta_opt/log_event.sh +91 -0
- package/tools/meta_opt/trigger_eval.py +280 -0
- package/tools/meta_opt/trigger_evals.sample.json +28 -0
- package/tools/openalex_fetch.py +326 -0
- package/tools/overleaf_audit.sh +104 -0
- package/tools/overleaf_setup.sh +150 -0
- package/tools/paper_illustration_image2.py +62 -0
- package/tools/provenance.py +294 -0
- package/tools/research_wiki.py +1720 -0
- package/tools/review_gate.py +502 -0
- package/tools/run_state.py +399 -0
- package/tools/save_trace.sh +477 -0
- package/tools/semantic_scholar_fetch.py +438 -0
- package/tools/skill-groups.tsv +116 -0
- package/tools/skill_picker.py +238 -0
- package/tools/smart_update.ps1 +521 -0
- package/tools/smart_update.sh +591 -0
- package/tools/smart_update_codex.sh +419 -0
- package/tools/smart_update_copilot.sh +605 -0
- package/tools/threat_scan.py +222 -0
- package/tools/verify_paper_audits.sh +487 -0
- package/tools/verify_papers.py +613 -0
- package/tools/verify_wiki_coverage.sh +176 -0
- package/tools/watchdog.py +485 -0
|
@@ -0,0 +1,348 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: meta-optimize
|
|
3
|
+
description: "Analyze ARIS usage logs and propose optimizations to SKILL.md files, reviewer prompts, and workflow defaults. Outer-loop harness optimization inspired by Meta-Harness (Lee et al., 2026). Use when user says \"优化技能\", \"meta optimize\", \"improve skills\", \"分析使用记录\", or wants to optimize ARIS's own harness components based on accumulated experience."
|
|
4
|
+
argument-hint: "[target-skill-or-all]"
|
|
5
|
+
allowed-tools: Bash(*), Read, Write, Edit, Grep, Glob
|
|
6
|
+
---
|
|
7
|
+
|
|
8
|
+
# Meta-Optimize: Outer-Loop Harness Optimization for ARIS
|
|
9
|
+
|
|
10
|
+
Analyze accumulated usage logs and propose optimizations for: **$ARGUMENTS**
|
|
11
|
+
|
|
12
|
+
## Context
|
|
13
|
+
|
|
14
|
+
ARIS is a **research harness** — a system of skills, bridges, workflows, and artifact contracts that wraps around LLMs to orchestrate research. This skill implements a prototype **outer loop** that observes how the harness is used and proposes improvements to the harness itself (not to the research artifacts it produces).
|
|
15
|
+
|
|
16
|
+
Inspired by Meta-Harness (Lee et al., 2026): the key insight is that harness design matters as much as model weights, and harness engineering can be partially automated by logging execution traces and using them to guide improvements.
|
|
17
|
+
|
|
18
|
+
## What This Skill Optimizes (Harness Components)
|
|
19
|
+
|
|
20
|
+
| Component | Example | Optimizable? |
|
|
21
|
+
|-----------|---------|:---:|
|
|
22
|
+
| SKILL.md prompts | Reviewer instructions, quality gates, step descriptions | Yes |
|
|
23
|
+
| Default parameters | `difficulty: medium`, `MAX_ROUNDS: 4`, `threshold: 6/10` | Yes |
|
|
24
|
+
| Convergence rules | When to stop the review loop, retry counts | Yes |
|
|
25
|
+
| Workflow ordering | Skill chain sequence within a workflow | Yes |
|
|
26
|
+
| Artifact schemas | What fields go in EXPERIMENT_LOG.md, idea-stage/IDEA_REPORT.md | Cautious |
|
|
27
|
+
| MCP bridge config | Which reviewer model, routing rules | No (infra) |
|
|
28
|
+
|
|
29
|
+
**Not optimized**: The research artifacts themselves (papers, code, experiments). That's what the regular workflows do.
|
|
30
|
+
|
|
31
|
+
## Prerequisites
|
|
32
|
+
|
|
33
|
+
1. **Logging must be active.** Codex mirror installs do not create Claude Code hooks. Provide `.aris/meta/events.jsonl` from a Codex-compatible event logger, an external wrapper, or a manually exported trace log before running this skill.
|
|
34
|
+
2. **Sufficient data.** At least 5 complete workflow runs logged in `.aris/meta/events.jsonl`. The skill will check and warn if insufficient.
|
|
35
|
+
|
|
36
|
+
## Workflow
|
|
37
|
+
|
|
38
|
+
### Step 0: Check Data Availability
|
|
39
|
+
|
|
40
|
+
```bash
|
|
41
|
+
EVENTS_FILE=".aris/meta/events.jsonl"
|
|
42
|
+
if [ ! -f "$EVENTS_FILE" ]; then
|
|
43
|
+
echo "ERROR: No event log found at $EVENTS_FILE"
|
|
44
|
+
echo "Enable Codex-compatible logging first: create .aris/meta/events.jsonl from your Codex wrapper, external event logger, or exported trace log."
|
|
45
|
+
exit 1
|
|
46
|
+
fi
|
|
47
|
+
|
|
48
|
+
EVENT_COUNT=$(wc -l < "$EVENTS_FILE")
|
|
49
|
+
SKILL_INVOCATIONS=$(grep -c '"skill_invoke"' "$EVENTS_FILE" || echo 0)
|
|
50
|
+
SESSIONS=$(grep -c '"session_start"' "$EVENTS_FILE" || echo 0)
|
|
51
|
+
|
|
52
|
+
echo "📊 Event log: $EVENT_COUNT events, $SKILL_INVOCATIONS skill invocations, $SESSIONS sessions"
|
|
53
|
+
|
|
54
|
+
if [ "$SKILL_INVOCATIONS" -lt 5 ]; then
|
|
55
|
+
echo "⚠️ Insufficient data (<5 skill invocations). Continue using ARIS normally and re-run later."
|
|
56
|
+
exit 0
|
|
57
|
+
fi
|
|
58
|
+
```
|
|
59
|
+
|
|
60
|
+
### Step 1: Analyze Usage Patterns
|
|
61
|
+
|
|
62
|
+
Read `.aris/meta/events.jsonl` and compute:
|
|
63
|
+
|
|
64
|
+
**Frequency analysis:**
|
|
65
|
+
- Which skills are invoked most often?
|
|
66
|
+
- Which slash commands do users type most?
|
|
67
|
+
- What parameter overrides are most common? (These suggest bad defaults.)
|
|
68
|
+
|
|
69
|
+
**Failure analysis:**
|
|
70
|
+
- Which tools fail most often? In which skills?
|
|
71
|
+
- What error patterns repeat? (OOM, import, compilation, timeout)
|
|
72
|
+
- How many auto-debug retries per workflow run?
|
|
73
|
+
|
|
74
|
+
**Convergence analysis (for auto-review-loop):**
|
|
75
|
+
- Average rounds to reach threshold
|
|
76
|
+
- Score trajectory shape (fast improvement? plateau? oscillation?)
|
|
77
|
+
- Which review round catches the most critical issues?
|
|
78
|
+
- Do users override difficulty mid-run?
|
|
79
|
+
|
|
80
|
+
**Human intervention analysis:**
|
|
81
|
+
- Where do users interrupt with manual prompts during workflows?
|
|
82
|
+
- What manual corrections do users make most? (These indicate skill gaps.)
|
|
83
|
+
|
|
84
|
+
**Model-delta analysis (harness diet):**
|
|
85
|
+
- Has the session model or the pinned reviewer model changed since a skill's
|
|
86
|
+
SKILL.md was last touched? A model bump is a **trigger to re-read, not
|
|
87
|
+
evidence by itself**: a deletion proposal must cite TARGET-SPECIFIC evidence
|
|
88
|
+
(a capability-specific release note, or repeated post-bump event-log behavior
|
|
89
|
+
showing the scaffold is unused). **Never deletion candidates**: privilege
|
|
90
|
+
boundaries, acceptance/review gates, corpus/provenance rules, output
|
|
91
|
+
contracts, safety checks. The diet targets model-compensation scaffolding
|
|
92
|
+
only — a capability the new model has natively is pure overhead. A harness
|
|
93
|
+
that only ever grows is a harness nobody is re-reading.
|
|
94
|
+
|
|
95
|
+
**Trigger-rate analysis (measured, not from the event log):** the log shows
|
|
96
|
+
which skills were USED, not which were WANTED-but-omitted. Mainline ships
|
|
97
|
+
`tools/meta_opt/trigger_eval.py`, which measures Claude Code's skill triggering
|
|
98
|
+
via `claude -p` probes (trigger / confusion / miss). It is Claude-Code-specific
|
|
99
|
+
— there is no equivalent `codex` skill-selection probe yet, so for a Codex
|
|
100
|
+
executor treat trigger-rate as a mainline signal, not a step you run here.
|
|
101
|
+
Measure-only regardless: a low rate is INPUT to a proposal, never a self-applied
|
|
102
|
+
rewrite; the confusion matrix (which sibling a query lands on) points at
|
|
103
|
+
disambiguation, not "make it pushier".
|
|
104
|
+
|
|
105
|
+
Present findings as a structured summary table.
|
|
106
|
+
|
|
107
|
+
### Step 1.5: Name the Current Bottleneck
|
|
108
|
+
|
|
109
|
+
Synthesize the Step-1 analyses into **one sentence naming the single
|
|
110
|
+
most-limiting pipeline stage right now** — e.g. "planning", "verification
|
|
111
|
+
quality", "experiment execution reliability", "writing polish" — with evidence.
|
|
112
|
+
The bottleneck always moves: coding → planning → verification → taste. Step 2's
|
|
113
|
+
ranked table should read as sub-fixes for this one named constraint.
|
|
114
|
+
|
|
115
|
+
Append the verdict to the append-only ledger `.aris/meta/bottleneck_log.jsonl`
|
|
116
|
+
(never edit or delete prior lines — succession history is the point):
|
|
117
|
+
|
|
118
|
+
```bash
|
|
119
|
+
mkdir -p .aris/meta
|
|
120
|
+
# json.dumps, NOT hand-interpolated shell strings: bottleneck/evidence are
|
|
121
|
+
# natural language — a stray quote must not break the JSONL (or the shell).
|
|
122
|
+
python3 - <<'PY'
|
|
123
|
+
import json, datetime
|
|
124
|
+
entry = {
|
|
125
|
+
"ts": datetime.datetime.now().astimezone().isoformat(timespec="seconds"),
|
|
126
|
+
"cycle": 3,
|
|
127
|
+
"bottleneck": "verification quality",
|
|
128
|
+
"evidence": "review rounds plateau at 6/10 while tool failures are rare",
|
|
129
|
+
"top_patch_ids": ["P1", "P2"],
|
|
130
|
+
}
|
|
131
|
+
with open(".aris/meta/bottleneck_log.jsonl", "a", encoding="utf-8") as fh:
|
|
132
|
+
fh.write(json.dumps(entry, ensure_ascii=False) + "\n")
|
|
133
|
+
PY
|
|
134
|
+
```
|
|
135
|
+
|
|
136
|
+
On the next run, read the last line first and open the report by stating
|
|
137
|
+
whether that bottleneck was resolved and what it has moved to.
|
|
138
|
+
|
|
139
|
+
### Step 2: Identify Optimization Targets
|
|
140
|
+
|
|
141
|
+
Based on Step 1, rank optimization opportunities by expected impact:
|
|
142
|
+
|
|
143
|
+
```markdown
|
|
144
|
+
## Optimization Opportunities (ranked)
|
|
145
|
+
|
|
146
|
+
| # | Target | Signal | Proposed Change | Expected Impact |
|
|
147
|
+
|---|--------|--------|-----------------|-----------------|
|
|
148
|
+
| 1 | auto-review-loop default threshold | Users override to 7/10 in 60% of runs | Change default from 6/10 to 7/10 | Fewer manual overrides |
|
|
149
|
+
| 2 | experiment-bridge retry count | 40% of runs hit max retries on OOM | Add OOM-specific recovery (reduce batch size) | Fewer failed experiments |
|
|
150
|
+
| 3 | paper-write de-AI patterns | Users manually fix "delve" in 80% of runs | Add "delve" to default watchword list | Fewer manual edits |
|
|
151
|
+
| 4 | experiment-bridge Phase-2 hand-holding steps | Model bump; scaffold untouched for 2 generations; zero failures in the guarded steps | **DELETE steps N–M — the new model does this unprompted** | Smaller harness, less drift surface |
|
|
152
|
+
```
|
|
153
|
+
|
|
154
|
+
The Proposed-Change column is explicitly allowed to be a **deletion** — "DELETE
|
|
155
|
+
step N, new model does this for free" is a first-class optimization.
|
|
156
|
+
|
|
157
|
+
If `$ARGUMENTS` specifies a target skill, focus analysis on that skill only.
|
|
158
|
+
If `$ARGUMENTS` is empty or "all", analyze all skills with sufficient data.
|
|
159
|
+
|
|
160
|
+
### Step 3: Generate Patch Proposals
|
|
161
|
+
|
|
162
|
+
For each optimization target, generate a concrete diff:
|
|
163
|
+
|
|
164
|
+
```diff
|
|
165
|
+
--- a/skills/auto-review-loop/SKILL.md
|
|
166
|
+
+++ b/skills/auto-review-loop/SKILL.md
|
|
167
|
+
@@ -15,7 +15,7 @@
|
|
168
|
+
## Constants
|
|
169
|
+
|
|
170
|
+
-- **SCORE_THRESHOLD = 6** — Minimum review score to accept.
|
|
171
|
+
+- **SCORE_THRESHOLD = 7** — Minimum review score to accept. (Raised based on usage data: 60% of users overrode to 7+.)
|
|
172
|
+
```
|
|
173
|
+
|
|
174
|
+
**Rules for patch generation:**
|
|
175
|
+
- One patch per optimization target
|
|
176
|
+
- Each patch must include a comment explaining WHY (with data from the log)
|
|
177
|
+
- Patches must be minimal — change only what the data supports
|
|
178
|
+
- Never change artifact schemas or MCP bridge config in v1
|
|
179
|
+
- Never change behavior that would break existing user workflows
|
|
180
|
+
- **Anti-self-poisoning screen:** resolve `$ARIS_REPO` from
|
|
181
|
+
`.aris/installed-skills-codex.txt`, then run
|
|
182
|
+
`$ARIS_REPO/tools/capture_filter.py` (or project-local
|
|
183
|
+
`tools/capture_filter.py`) against each proposed patch rationale. If it flags
|
|
184
|
+
an environment failure, transient error, negative tool-capability claim, or
|
|
185
|
+
one-off narrative, rewrite the proposal to the fix/config/workaround or drop
|
|
186
|
+
it. Warn-and-skip only when the helper cannot be resolved. See
|
|
187
|
+
[`capture-antipatterns.md`](../shared-references/capture-antipatterns.md).
|
|
188
|
+
|
|
189
|
+
### Step 4: Fresh-Agent Review of Patches (same-family provisional)
|
|
190
|
+
|
|
191
|
+
Send each patch to GPT-5.6-Sol xhigh for adversarial review:
|
|
192
|
+
|
|
193
|
+
```text
|
|
194
|
+
spawn_agent:
|
|
195
|
+
model: gpt-5.6-sol
|
|
196
|
+
reasoning_effort: xhigh
|
|
197
|
+
message: |
|
|
198
|
+
You are reviewing a proposed optimization to an ARIS SKILL.md file.
|
|
199
|
+
|
|
200
|
+
## Original Skill (relevant section)
|
|
201
|
+
[paste original]
|
|
202
|
+
|
|
203
|
+
## Proposed Patch
|
|
204
|
+
[paste diff]
|
|
205
|
+
|
|
206
|
+
## Evidence from Usage Log
|
|
207
|
+
[paste summary stats]
|
|
208
|
+
|
|
209
|
+
Review this patch:
|
|
210
|
+
1. Does the evidence support the change?
|
|
211
|
+
2. Could this change hurt other use cases?
|
|
212
|
+
3. Is the change minimal and safe?
|
|
213
|
+
4. Score 1-10: should this be applied?
|
|
214
|
+
|
|
215
|
+
If score < 7, explain what additional evidence would be needed.
|
|
216
|
+
|
|
217
|
+
=== SCOPE LIMITS (these bound what you PROPOSE, never what you look for) ===
|
|
218
|
+
Report anything that is actually wrong here — including a rare-looking case, if
|
|
219
|
+
this repo actually produces it. Then keep the fix in scope:
|
|
220
|
+
1. This is a RESEARCH-WORKFLOW tool, not a security paper. Verification is
|
|
221
|
+
welcome; over-defense is not. Assume a cooperating operator on their own
|
|
222
|
+
machine — a malicious local user is NOT in the threat model.
|
|
223
|
+
2. Do NOT propose SHA / hash / content-fingerprint / digest-binding schemes.
|
|
224
|
+
Reporting a real defect in hashing code that already exists is fine.
|
|
225
|
+
3. NO speculative machinery: do not add feature flags, migration frameworks,
|
|
226
|
+
compat layers, wrappers, pins, or similar mechanisms unless evidence shows
|
|
227
|
+
a current repo defect they fix or an explicit existing invariant they must
|
|
228
|
+
preserve. "Load-bearing", "compatibility", and "not scaffolding" are labels,
|
|
229
|
+
not evidence. Point to the failing path/artifact or invariant, and check the
|
|
230
|
+
proposal's factual premises, such as whether a named package version exists.
|
|
231
|
+
4. NO corner-case obsession: exotic encodings, symlink races, RTL text and
|
|
232
|
+
millisecond races are out of scope unless you can show the case arises here.
|
|
233
|
+
5. Where a rubric or checklist is genuinely needed, do not over-mechanize
|
|
234
|
+
judgement. A clear sentence a human reads beats a scored table nobody
|
|
235
|
+
maintains.
|
|
236
|
+
Exception: code that runs remote commands, starts a network service, or installs
|
|
237
|
+
an MCP server runs on the user's machine with their credentials — trust-boundary
|
|
238
|
+
findings there are in scope and the default is strict.
|
|
239
|
+
Say plainly when something is correct. Do not manufacture findings.
|
|
240
|
+
```
|
|
241
|
+
|
|
242
|
+
### Step 5: Present Results
|
|
243
|
+
|
|
244
|
+
Output a structured report:
|
|
245
|
+
|
|
246
|
+
```markdown
|
|
247
|
+
# ARIS Meta-Optimization Report
|
|
248
|
+
|
|
249
|
+
**Date**: [today]
|
|
250
|
+
**Data**: [N] events, [M] skill invocations, [K] sessions
|
|
251
|
+
**Target**: [skill name or "all"]
|
|
252
|
+
|
|
253
|
+
## Current Bottleneck
|
|
254
|
+
|
|
255
|
+
**[one-phrase name]** — [one-line evidence]. Prior cycle's bottleneck: [name —
|
|
256
|
+
resolved by <patch ids> / unresolved / first recorded cycle]. (Ledger:
|
|
257
|
+
`.aris/meta/bottleneck_log.jsonl`)
|
|
258
|
+
|
|
259
|
+
## Proposed Changes
|
|
260
|
+
|
|
261
|
+
### Change 1: [title]
|
|
262
|
+
- **Target**: [skill/file:line]
|
|
263
|
+
- **Signal**: [what the data shows]
|
|
264
|
+
- **Patch**: [diff]
|
|
265
|
+
- **Reviewer Score**: [X/10]
|
|
266
|
+
- **Reviewer Notes**: [summary]
|
|
267
|
+
- **Status**: ✅ Recommended / ⚠️ Needs more data / ❌ Rejected
|
|
268
|
+
|
|
269
|
+
### Change 2: ...
|
|
270
|
+
|
|
271
|
+
## Changes NOT Made (insufficient evidence)
|
|
272
|
+
- [pattern observed but too few samples]
|
|
273
|
+
|
|
274
|
+
## Recommendations
|
|
275
|
+
- [ ] Apply Change 1 (reviewer approved)
|
|
276
|
+
- [ ] Collect more data for Change 3 (need N more runs)
|
|
277
|
+
- [ ] Consider manual review of Change 2
|
|
278
|
+
|
|
279
|
+
## Next Steps
|
|
280
|
+
Run `/meta-optimize apply 1` to apply a specific change, or
|
|
281
|
+
`/meta-optimize apply all` to apply all recommended changes.
|
|
282
|
+
```
|
|
283
|
+
|
|
284
|
+
### Step 6: Apply Changes (if user approves)
|
|
285
|
+
|
|
286
|
+
If user runs `/meta-optimize apply [N]`:
|
|
287
|
+
1. Back up original SKILL.md to `.aris/meta/backups/`
|
|
288
|
+
2. Apply the patch
|
|
289
|
+
3. Log the change to `.aris/meta/optimizations.jsonl`
|
|
290
|
+
4. Remind user to test the changed skill on their next run
|
|
291
|
+
|
|
292
|
+
**Never auto-apply without user approval.**
|
|
293
|
+
|
|
294
|
+
## Key Rules
|
|
295
|
+
|
|
296
|
+
- **Log-driven, not speculative.** Every proposed change must cite specific data from the event log. No "I think this would be better."
|
|
297
|
+
- **Minimal patches.** Change one thing at a time. Don't rewrite entire skills — the one sanctioned large edit is a scaffolding **deletion** backed by TARGET-SPECIFIC model-delta evidence (capability-specific release note, or repeated post-bump event-log behavior; a model-name change alone is never sufficient). Privilege boundaries, acceptance gates, corpus/provenance rules, output contracts, and safety checks are never deletion candidates. Deletions go through the same review + approval gates.
|
|
298
|
+
- **Reviewer-gated.** Every patch goes through fresh-agent same-family provisional review before recommendation.
|
|
299
|
+
- **Reversible.** Always back up before applying. Always log what changed.
|
|
300
|
+
- **User-approved.** Never auto-apply. Present, explain, let the user decide.
|
|
301
|
+
- **Honest about uncertainty.** If the data is insufficient, say so. Don't optimize on noise.
|
|
302
|
+
- **Portable.** Optimizations should improve the skill for all users, not just one user's style. If a change seems user-specific, flag it.
|
|
303
|
+
|
|
304
|
+
## Event Schema Reference
|
|
305
|
+
|
|
306
|
+
The log at `.aris/meta/events.jsonl` contains JSONL records with these shapes:
|
|
307
|
+
|
|
308
|
+
```jsonl
|
|
309
|
+
{"ts":"...","session":"...","event":"skill_invoke","skill":"auto-review-loop","args":"difficulty: hard"}
|
|
310
|
+
{"ts":"...","session":"...","event":"PostToolUse","tool":"Bash","input_summary":"pdflatex main.tex"}
|
|
311
|
+
{"ts":"...","session":"...","event":"spawn_agent","tool":"spawn_agent","input_summary":"review..."}
|
|
312
|
+
{"ts":"...","session":"...","event":"tool_failure","tool":"Bash","input_summary":"python train.py"}
|
|
313
|
+
{"ts":"...","session":"...","event":"slash_command","command":"/auto-review-loop","args":""}
|
|
314
|
+
{"ts":"...","session":"...","event":"user_prompt","prompt_preview":"change difficulty to hard"}
|
|
315
|
+
{"ts":"...","session":"...","event":"session_start","source":"startup","model":"claude-opus-4-6"}
|
|
316
|
+
{"ts":"...","session":"...","event":"session_end"}
|
|
317
|
+
```
|
|
318
|
+
|
|
319
|
+
## Triggering
|
|
320
|
+
|
|
321
|
+
This skill is NOT part of the standard W1→W1.5→W2→W3→W4 pipeline. It is a **maintenance workflow** with three trigger mechanisms:
|
|
322
|
+
|
|
323
|
+
1. **Passive logging** (always on): Claude Code hooks record events to `.aris/meta/events.jsonl` automatically during normal usage. Zero user effort.
|
|
324
|
+
|
|
325
|
+
2. **Automatic readiness check** (SessionEnd hook): When a Claude Code session ends, `check_ready.sh` counts skill invocations since the last `/meta-optimize` run. If ≥5 new invocations have accumulated, it prints a reminder:
|
|
326
|
+
```
|
|
327
|
+
📊 ARIS has logged 8 skill runs since last optimization. Run /meta-optimize to check for improvement opportunities.
|
|
328
|
+
```
|
|
329
|
+
This is a **suggestion only** — it does not auto-run optimization.
|
|
330
|
+
|
|
331
|
+
3. **Manual trigger**: User runs `/meta-optimize` when they see the reminder or whenever they want.
|
|
332
|
+
|
|
333
|
+
**After each `/meta-optimize` run**, the skill writes the current timestamp to `.aris/meta/.last_optimize` so the readiness check only counts new invocations.
|
|
334
|
+
|
|
335
|
+
## Acknowledgements
|
|
336
|
+
|
|
337
|
+
Inspired by [Meta-Harness](https://arxiv.org/abs/2603.28052) (Lee et al., 2026) — end-to-end optimization of model harnesses via filesystem-based experience access and agentic code search.
|
|
338
|
+
|
|
339
|
+
## Output Protocols
|
|
340
|
+
|
|
341
|
+
> Follow these shared protocols for all output files:
|
|
342
|
+
> - **[Output Versioning Protocol](../shared-references/output-versioning.md)** — write timestamped file first, then copy to fixed name
|
|
343
|
+
> - **[Output Manifest Protocol](../shared-references/output-manifest.md)** — log every output to MANIFEST.md
|
|
344
|
+
> - **[Output Language Protocol](../shared-references/output-language.md)** — respect the project's language setting
|
|
345
|
+
|
|
346
|
+
## Review Tracing
|
|
347
|
+
|
|
348
|
+
After each reviewer agent call, save the trace following `shared-references/review-tracing.md` (Policy C — forensic; never silently skip). Use `save_trace.sh` (resolved per the chain in `shared-references/integration-contract.md` §2) or write files directly to `.aris/traces/<skill>/<date>_run<NN>/`. Respect the `--- trace:` parameter (default: `full`).
|
|
@@ -0,0 +1,98 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: "monitor-experiment"
|
|
3
|
+
description: "Monitor running experiments, check progress, collect results. Use when user says \"check results\", \"is it done\", \"monitor\", or wants experiment output."
|
|
4
|
+
---
|
|
5
|
+
|
|
6
|
+
# Monitor Experiment Results
|
|
7
|
+
|
|
8
|
+
Monitor: $ARGUMENTS
|
|
9
|
+
|
|
10
|
+
## Workflow
|
|
11
|
+
|
|
12
|
+
### Step 1: Check What's Running
|
|
13
|
+
|
|
14
|
+
First identify the backend from `AGENTS.md`, run notes, or launch summary: local, SSH, Vast.ai, or Modal. Monitor the backend that was actually used; do not assume a plain SSH screen session when the run was launched through Vast.ai or Modal.
|
|
15
|
+
|
|
16
|
+
```bash
|
|
17
|
+
ssh <server> "screen -ls"
|
|
18
|
+
```
|
|
19
|
+
|
|
20
|
+
For Vast.ai, also check instance state, SSH reachability, hourly cost, and whether `auto_destroy` is pending. For Modal, check the Modal run/app logs, function status, timeout, volume outputs, and cloud cost exposure.
|
|
21
|
+
|
|
22
|
+
### Step 2: Collect Output from Each Screen
|
|
23
|
+
For each screen session, capture the last N lines:
|
|
24
|
+
```bash
|
|
25
|
+
ssh <server> "screen -S <name> -X hardcopy /tmp/screen_<name>.txt && tail -50 /tmp/screen_<name>.txt"
|
|
26
|
+
```
|
|
27
|
+
|
|
28
|
+
If hardcopy fails, check for log files or tee output.
|
|
29
|
+
|
|
30
|
+
### Step 3: Check for JSON Result Files
|
|
31
|
+
```bash
|
|
32
|
+
ssh <server> "ls -lt <results_dir>/*.json 2>/dev/null | head -20"
|
|
33
|
+
```
|
|
34
|
+
|
|
35
|
+
If JSON results exist, fetch and parse them:
|
|
36
|
+
```bash
|
|
37
|
+
ssh <server> "cat <results_dir>/<latest>.json"
|
|
38
|
+
```
|
|
39
|
+
|
|
40
|
+
### Step 3.5: Pull W&B Metrics (when `wandb: true` in AGENTS.md)
|
|
41
|
+
|
|
42
|
+
If the project enables W&B, pull metrics before interpreting results. Prefer W&B as the source of training curves and recent eval state, while still checking logs for crashes.
|
|
43
|
+
|
|
44
|
+
List recent runs:
|
|
45
|
+
|
|
46
|
+
```bash
|
|
47
|
+
python3 - <<'PY'
|
|
48
|
+
import wandb
|
|
49
|
+
api = wandb.Api()
|
|
50
|
+
for run in api.runs("<entity>/<project>", per_page=20):
|
|
51
|
+
print(run.name, run.state, run.url)
|
|
52
|
+
PY
|
|
53
|
+
```
|
|
54
|
+
|
|
55
|
+
Pull recent history for a specific run:
|
|
56
|
+
|
|
57
|
+
```bash
|
|
58
|
+
python3 - <<'PY'
|
|
59
|
+
import wandb
|
|
60
|
+
api = wandb.Api()
|
|
61
|
+
run = api.run("<entity>/<project>/<run_id>")
|
|
62
|
+
for row in run.history(samples=50, keys=["train/loss", "eval/loss", "eval/accuracy", "train/lr"]):
|
|
63
|
+
print(row)
|
|
64
|
+
print("summary:", dict(run.summary))
|
|
65
|
+
PY
|
|
66
|
+
```
|
|
67
|
+
|
|
68
|
+
If W&B is configured but unavailable, report the connectivity problem and fall back to screen/log/json evidence. Do not interpret missing W&B data as experiment failure by itself.
|
|
69
|
+
|
|
70
|
+
Always include W&B dashboard links (`run.url`) when available so later review and paper-writing agents can inspect the exact training curves.
|
|
71
|
+
|
|
72
|
+
### Step 4: Summarize Results
|
|
73
|
+
|
|
74
|
+
Present results in a comparison table:
|
|
75
|
+
```
|
|
76
|
+
| Experiment | Metric | Delta vs Baseline | Status |
|
|
77
|
+
|-----------|--------|-------------------|--------|
|
|
78
|
+
| Baseline | X.XX | — | done |
|
|
79
|
+
| Method A | X.XX | +Y.Y | done |
|
|
80
|
+
```
|
|
81
|
+
|
|
82
|
+
### Step 5: Interpret
|
|
83
|
+
- Compare against known baselines
|
|
84
|
+
- Flag unexpected results (negative delta, NaN, divergence)
|
|
85
|
+
- Suggest next steps based on findings
|
|
86
|
+
|
|
87
|
+
### Step 6: Feishu Notification (if configured)
|
|
88
|
+
|
|
89
|
+
After results are collected, check `~/.codex/feishu.json`:
|
|
90
|
+
- Send `experiment_done` notification: results summary table, delta vs baseline
|
|
91
|
+
- If config absent or mode `"off"`: skip entirely (no-op)
|
|
92
|
+
|
|
93
|
+
## Key Rules
|
|
94
|
+
- Always show raw numbers before interpretation
|
|
95
|
+
- Compare against the correct baseline (same config)
|
|
96
|
+
- Note if experiments are still running (check progress bars, iteration counts)
|
|
97
|
+
- If results look wrong, check training logs for errors before concluding
|
|
98
|
+
- Include backend cost/risk notes for long-running Vast.ai or Modal jobs
|
|
@@ -0,0 +1,89 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: "novelty-check"
|
|
3
|
+
description: "Verify research idea novelty against recent literature. Use when user says \"\u67e5\u65b0\", \"novelty check\", \"\u6709\u6ca1\u6709\u4eba\u505a\u8fc7\", \"check novelty\", or wants to verify a research idea is novel before implementing."
|
|
4
|
+
---
|
|
5
|
+
|
|
6
|
+
# Novelty Check Skill
|
|
7
|
+
|
|
8
|
+
Check whether a proposed method/idea has already been done in the literature: **$ARGUMENTS**
|
|
9
|
+
|
|
10
|
+
## Constants
|
|
11
|
+
|
|
12
|
+
- REVIEWER_MODEL = `gpt-5.6-sol` — Model used via a secondary Codex agent. Must be an OpenAI model (e.g., `gpt-5.6-sol`, `o3`, `gpt-4o`)
|
|
13
|
+
- **REVIEWER_BACKEND = `codex`** — Default: Codex xhigh reviewer. Use `--reviewer: oracle-pro` only when explicitly requested; if Oracle is unavailable, warn and fall back to Codex xhigh.
|
|
14
|
+
|
|
15
|
+
## Instructions
|
|
16
|
+
|
|
17
|
+
Given a method description, systematically verify its novelty:
|
|
18
|
+
|
|
19
|
+
### Phase A: Extract Key Claims
|
|
20
|
+
1. Read the user's method description
|
|
21
|
+
2. Identify 3-5 core technical claims that would need to be novel:
|
|
22
|
+
- What is the method?
|
|
23
|
+
- What problem does it solve?
|
|
24
|
+
- What is the mechanism?
|
|
25
|
+
- What makes it different from obvious baselines?
|
|
26
|
+
|
|
27
|
+
### Phase B: Multi-Source Literature Search
|
|
28
|
+
For EACH core claim, search using ALL available sources:
|
|
29
|
+
|
|
30
|
+
1. **Web Search** (via `WebSearch`):
|
|
31
|
+
- Search arXiv, Google Scholar, Semantic Scholar
|
|
32
|
+
- Use specific technical terms from the claim
|
|
33
|
+
- Try at least 3 different query formulations per claim
|
|
34
|
+
- Include year filters for 2024-2026
|
|
35
|
+
|
|
36
|
+
2. **Known paper databases**: Check against:
|
|
37
|
+
- ICLR 2025/2026, NeurIPS 2025, ICML 2025/2026
|
|
38
|
+
- Recent arXiv preprints (2025-2026)
|
|
39
|
+
|
|
40
|
+
3. **Read abstracts**: For each potentially overlapping paper, WebFetch its abstract and related work section
|
|
41
|
+
|
|
42
|
+
### Phase C: Fresh-Agent Verification (same-family provisional by default)
|
|
43
|
+
Call REVIEWER_MODEL via `spawn_agent` (`spawn_agent`) with xhigh reasoning:
|
|
44
|
+
```
|
|
45
|
+
reasoning_effort: xhigh
|
|
46
|
+
```
|
|
47
|
+
Prompt should include:
|
|
48
|
+
- The proposed method description
|
|
49
|
+
- All papers found in Phase B
|
|
50
|
+
- Ask: "Is this method novel? What is the closest prior work? What is the delta?"
|
|
51
|
+
|
|
52
|
+
### Phase D: Novelty Report
|
|
53
|
+
Output a structured report:
|
|
54
|
+
|
|
55
|
+
```markdown
|
|
56
|
+
## Novelty Check Report
|
|
57
|
+
|
|
58
|
+
### Proposed Method
|
|
59
|
+
[1-2 sentence description]
|
|
60
|
+
|
|
61
|
+
### Core Claims
|
|
62
|
+
1. [Claim 1] — Novelty: HIGH/MEDIUM/LOW — Closest: [paper]
|
|
63
|
+
2. [Claim 2] — Novelty: HIGH/MEDIUM/LOW — Closest: [paper]
|
|
64
|
+
...
|
|
65
|
+
|
|
66
|
+
### Closest Prior Work
|
|
67
|
+
| Paper | Year | Venue | Overlap | Key Difference |
|
|
68
|
+
|-------|------|-------|---------|----------------|
|
|
69
|
+
|
|
70
|
+
### Overall Novelty Assessment
|
|
71
|
+
- Score: X/10
|
|
72
|
+
- Recommendation: PROCEED / PROCEED WITH CAUTION / ABANDON
|
|
73
|
+
- Key differentiator: [what makes this unique, if anything]
|
|
74
|
+
- Risk: [what a reviewer would cite as prior work]
|
|
75
|
+
|
|
76
|
+
### Suggested Positioning
|
|
77
|
+
[How to frame the contribution to maximize novelty perception]
|
|
78
|
+
```
|
|
79
|
+
|
|
80
|
+
### Important Rules
|
|
81
|
+
- Be BRUTALLY honest — false novelty claims waste months of research time
|
|
82
|
+
- "Applying X to Y" is NOT novel unless the application reveals surprising insights
|
|
83
|
+
- Check both the method AND the experimental setting for novelty
|
|
84
|
+
- If the method is not novel but the FINDING would be, say so explicitly
|
|
85
|
+
- Always check the most recent 6 months of arXiv — the field moves fast
|
|
86
|
+
|
|
87
|
+
## Review Tracing
|
|
88
|
+
|
|
89
|
+
After each `spawn_agent` or optional `oracle-pro` reviewer call, save the trace following `../shared-references/review-tracing.md`. Write files directly to `.aris/traces/novelty-check/<date>_run<NN>/` and record searched claims, closest papers, reviewer route, raw response, and final novelty decision. Respect the `--- trace:` parameter when present (default: `full`).
|