paperlint 9.0.0 → 10.0.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.github/CLAUDE.md +22 -0
- package/.github/CLAUDE.md.spec.ts +20 -0
- package/CLAUDE.md +59 -515
- package/CONTRIBUTING.md +2 -2
- package/README.md +68 -128
- package/dist/CLAUDE.md.spec.d.ts +3 -0
- package/dist/CLAUDE.md.spec.d.ts.map +1 -0
- package/dist/CLAUDE.md.spec.js +62 -0
- package/dist/CLAUDE.md.spec.js.map +1 -0
- package/dist/build.d.ts +1 -1
- package/dist/build.js +2 -2
- package/dist/cli.d.ts +5 -1
- package/dist/cli.d.ts.map +1 -1
- package/dist/cli.js +52 -6
- package/dist/cli.js.map +1 -1
- package/dist/domain/layout-tree.d.ts +19 -0
- package/dist/domain/layout-tree.d.ts.map +1 -0
- package/dist/domain/layout-tree.js +32 -0
- package/dist/domain/layout-tree.js.map +1 -0
- package/dist/domain/lookup-cache.d.ts +2 -2
- package/dist/domain/lookup-cache.js +2 -2
- package/dist/domain/paper-layout.d.ts +81 -0
- package/dist/domain/paper-layout.d.ts.map +1 -0
- package/dist/domain/paper-layout.js +259 -0
- package/dist/domain/paper-layout.js.map +1 -0
- package/dist/domain/repro-layout.d.ts +80 -0
- package/dist/domain/repro-layout.d.ts.map +1 -0
- package/dist/domain/repro-layout.js +247 -0
- package/dist/domain/repro-layout.js.map +1 -0
- package/dist/domain/scaffold-layout.d.ts +28 -0
- package/dist/domain/scaffold-layout.d.ts.map +1 -0
- package/dist/domain/scaffold-layout.js +81 -0
- package/dist/domain/scaffold-layout.js.map +1 -0
- package/dist/eslint-rules/CLAUDE.md.spec.d.ts +3 -0
- package/dist/eslint-rules/CLAUDE.md.spec.d.ts.map +1 -0
- package/dist/eslint-rules/CLAUDE.md.spec.js +39 -0
- package/dist/eslint-rules/CLAUDE.md.spec.js.map +1 -0
- package/dist/eslint-rules/install-path-literals.d.ts +1 -1
- package/dist/eslint-rules/install-path-literals.js +4 -4
- package/dist/eslint-rules/install-path-literals.js.map +1 -1
- package/dist/eslint-rules/pdf-last-page-balance.js +1 -1
- package/dist/eslint-rules/prereg-coverage.d.ts +98 -0
- package/dist/eslint-rules/prereg-coverage.d.ts.map +1 -0
- package/dist/eslint-rules/prereg-coverage.js +274 -0
- package/dist/eslint-rules/prereg-coverage.js.map +1 -0
- package/dist/folder-layout-hook.d.ts +21 -0
- package/dist/folder-layout-hook.d.ts.map +1 -0
- package/dist/folder-layout-hook.js +117 -0
- package/dist/folder-layout-hook.js.map +1 -0
- package/dist/folder-layout-rule.d.ts +22 -0
- package/dist/folder-layout-rule.d.ts.map +1 -0
- package/dist/folder-layout-rule.js +107 -0
- package/dist/folder-layout-rule.js.map +1 -0
- package/dist/init.js +1 -1
- package/dist/init.js.map +1 -1
- package/dist/lib/agent-cli-version.js +1 -1
- package/dist/lib/agent-cli-version.js.map +1 -1
- package/dist/new-paper.d.ts +4 -1
- package/dist/new-paper.d.ts.map +1 -1
- package/dist/new-paper.js +40 -6
- package/dist/new-paper.js.map +1 -1
- package/dist/references.d.ts +1 -1
- package/dist/references.d.ts.map +1 -1
- package/dist/references.js +2 -2
- package/dist/references.js.map +1 -1
- package/dist/repro-layout-rule.d.ts +16 -0
- package/dist/repro-layout-rule.d.ts.map +1 -0
- package/dist/repro-layout-rule.js +81 -0
- package/dist/repro-layout-rule.js.map +1 -0
- package/dist/tex-requirements.js +1 -1
- package/dist/toolchain.js +1 -1
- package/docs/ci.md +60 -0
- package/docs/configuration.md +2 -0
- package/docs/e2e.md +3 -3
- package/docs/incidents.md +5 -5
- package/docs/install.md +20 -16
- package/docs/layout.md +154 -0
- package/docs/optional-rules.md +5 -4
- package/docs/references.md +5 -2
- package/docs/rules/paper/allowed-files-only.md +192 -0
- package/docs/rules/repro/allowed-files-only.md +128 -0
- package/docs/rules/study/declare-sample.md +146 -0
- package/docs/rules.md +53 -50
- package/docs/skills.md +6 -3
- package/docs/venues.md +94 -0
- package/eslint-rules/CLAUDE.md +44 -0
- package/eslint-rules/CLAUDE.md.spec.ts +43 -0
- package/eslint-rules/install-path-literals.harness.mjs +1 -1
- package/eslint-rules/install-path-literals.ts +4 -4
- package/eslint-rules/pdf-last-page-balance.ts +1 -1
- package/eslint-rules/prereg-coverage.test.ts +448 -0
- package/eslint-rules/prereg-coverage.ts +419 -0
- package/eslint.config.mjs +6 -3
- package/hooks/CLAUDE.md +34 -0
- package/hooks/CLAUDE.md.spec.ts +30 -0
- package/lib/agent-cli-version.ts +1 -1
- package/lib/skill-trigger-cases.harness.mjs +51 -5
- package/lib/skill-trigger-cases.mjs +53 -15
- package/package.json +2 -2
- package/plugin/CLAUDE.md +22 -0
- package/plugin/CLAUDE.md.spec.ts +22 -0
- package/plugin/hooks/hooks.json +9 -0
- package/scripts/coverage-config.test.ts +2 -1
- package/skills/CLAUDE.md +19 -0
- package/skills/CLAUDE.md.spec.ts +18 -0
- package/skills/analyze-sibling-paper/SKILL.md +2 -2
- package/skills/analyze-sibling-paper/SKILL.md.spec.ts +1 -1
- package/skills/build-benchmark/SKILL.md +14 -1
- package/skills/build-benchmark/SKILL.md.spec.ts +13 -0
- package/skills/build-label-page/SKILL.md +118 -0
- package/skills/build-label-page/SKILL.md.spec.ts +129 -0
- package/skills/build-label-page/build-label-page.eval.mjs +15 -0
- package/skills/build-label-page/build-label-page.test.ts +959 -0
- package/skills/build-label-page/references/checklist.md +148 -0
- package/skills/build-label-page/references/example-generator.py +803 -0
- package/skills/find-venue/SKILL.md +5 -3
- package/skills/find-venue/SKILL.md.spec.ts +4 -2
- package/skills/grade-paper-writing/SKILL.md +7 -7
- package/skills/grade-paper-writing/SKILL.md.spec.ts +6 -6
- package/skills/map-prior-work/SKILL.md +2 -2
- package/skills/map-prior-work/SKILL.md.spec.ts +1 -1
- package/skills/paper-pipeline/SKILL.md +8 -6
- package/skills/paper-pipeline/SKILL.md.spec.ts +7 -5
- package/skills/paper-pipeline/grade-paper-writing-ablation.eval.mjs +19 -9
- package/skills/paper-pipeline/references/acceptance-gate.md +19 -19
- package/skills/paper-pipeline/references/artifact-checklist.md +5 -0
- package/skills/paper-pipeline/references/pipeline-status-template.md +30 -1
- package/skills/paper-pipeline/repro/2026-08-07-fork-check.log +1 -1
- package/skills/paper-pipeline/repro/2026-08-07-fork-check2.log +1 -1
- package/skills/paper-pipeline/repro/2026-08-07-language-eval-pilot.log +1 -1
- package/skills/paper-pipeline/repro/2026-08-07-language-eval-raw.log +1 -1
- package/skills/paper-pipeline/repro/2026-08-08-framing-vs-vocabulary-oracle.log +48 -48
- package/skills/paper-pipeline/repro/2026-08-08-grade-paper-writing-ablation-A6-oracle.log +8 -8
- package/skills/paper-pipeline/repro/2026-08-08-grade-paper-writing-ablation-oracle.log +48 -48
- package/skills/paper-pipeline/repro/2026-08-08-parent-replication-gpw.log +2 -2
- package/skills/paper-pipeline/repro/2026-08-08-parent-replication.mjs +3 -3
- package/skills/paper-pipeline/repro/2026-10-13-grade-paper-writing-ablation-preflight-after.log +81 -0
- package/skills/paper-pipeline/repro/2026-10-13-grade-paper-writing-ablation-preflight-before.log +81 -0
- package/skills/paper-pipeline/repro/2026-10-13-grade-paper-writing-ablation-setupdiff.log +59 -0
- package/skills/paper-pipeline/repro/2026-10-13-grade-paper-writing-trigger.jsonl +1 -0
- package/skills/paper-pipeline/repro/2026-10-13-grade-paper-writing-trigger.log +22 -0
- package/skills/paper-pipeline/repro/README.md +4 -0
- package/skills/paper-pipeline/scripts/extract-ref-facts.harness.mjs +2 -2
- package/skills/paper-pipeline/scripts/extract-ref-facts.mjs +2 -2
- package/skills/paper-pipeline/scripts/extract-ref-facts.test.mjs +4 -2
- package/skills/paper-pipeline/scripts/generated-code.harness.mjs +7 -2
- package/skills/paper-pipeline/scripts/generated-code.mjs +8 -4
- package/skills/paper-pipeline/scripts/generated-code.test.ts +15 -1
- package/skills/paper-status/SKILL.md +2 -2
- package/skills/paper-status/SKILL.md.spec.ts +1 -1
- package/skills/plan-paper-timeline/plan-paper-timeline.effects.harness.mjs +21 -102
- package/skills/study-accepted-papers/SKILL.md +163 -161
- package/skills/study-accepted-papers/SKILL.md.spec.ts +167 -165
- package/skills/study-accepted-papers/references/base-rates.md +69 -0
- package/skills/study-accepted-papers/references/mechanisms.md +181 -0
- package/skills/verify-citations/SKILL.md +2 -2
- package/skills/verify-citations/SKILL.md.spec.ts +1 -1
- package/src/CLAUDE.md +23 -1
- package/src/CLAUDE.md.spec.ts +72 -0
- package/src/build.ts +2 -2
- package/src/cli.harness.mjs +42 -0
- package/src/cli.test.ts +90 -6
- package/src/cli.ts +78 -5
- package/src/domain/layout-tree.test.ts +32 -0
- package/src/domain/layout-tree.ts +47 -0
- package/src/domain/lookup-cache.ts +2 -2
- package/src/domain/paper-layout.test.ts +264 -0
- package/src/domain/paper-layout.ts +336 -0
- package/src/domain/repro-layout.test.ts +222 -0
- package/src/domain/repro-layout.ts +311 -0
- package/src/domain/scaffold-layout.ts +104 -0
- package/src/folder-layout-hook.test.ts +214 -0
- package/src/folder-layout-hook.ts +141 -0
- package/src/folder-layout-rule.test.ts +235 -0
- package/src/folder-layout-rule.ts +151 -0
- package/src/hooks-settings.harness.ts +9 -8
- package/src/init.ts +1 -1
- package/src/layout-docs.test.ts +52 -0
- package/src/new-paper.harness.mjs +23 -1
- package/src/new-paper.test.ts +299 -6
- package/src/new-paper.ts +51 -5
- package/src/paper-files.test.ts +9 -6
- package/src/references.test.ts +5 -5
- package/src/references.ts +2 -2
- package/src/repro-layout-rule.test.ts +114 -0
- package/src/repro-layout-rule.ts +121 -0
- package/src/rule-cases.test.ts +98 -0
- package/src/tex-requirements.ts +1 -1
- package/src/toolchain.ts +1 -1
- package/templates/paper/PIPELINE-STATUS.md +41 -7
|
@@ -9,101 +9,101 @@ argument-arc 0.86 0.00 0.69 0.00 +0.77
|
|
|
9
9
|
|
|
10
10
|
oracle: 48 closed-book picks over 37 descriptions
|
|
11
11
|
|
|
12
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
12
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
13
13
|
AH HIT tighten-paper produce a cut and fold plan for this draft — which sections do
|
|
14
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
14
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
15
15
|
AH HIT tighten-paper tell me which parts are TMI and belong in the appendix instead
|
|
16
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
16
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
17
17
|
AH HIT tighten-paper reorder and merge whatever is needed so it is not too long for
|
|
18
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
18
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
19
19
|
AH HIT tighten-paper give me a structural verdict on this drafted paper, cover to c
|
|
20
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
20
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
21
21
|
AL HIT tighten-paper decide what gets deleted from this manuscript and list it back
|
|
22
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
22
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
23
23
|
AL HIT tighten-paper tell me which two chapters should be welded into one, and whic
|
|
24
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
24
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
25
25
|
AL HIT tighten-paper I want a shortlist of paragraphs to delete so it fits on fewer
|
|
26
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
26
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
27
27
|
AL HIT tighten-paper rank the chapters by how little they matter, worst first, so I
|
|
28
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
28
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
29
29
|
SH HIT tighten-paper this feels long and overly complex, and the middle drags
|
|
30
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
30
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
31
31
|
SH HIT tighten-paper after three review rounds it has collected a lot of hedge-mass
|
|
32
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
32
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
33
33
|
SH HIT tighten-paper it does not deliver its point and nobody could skim it
|
|
34
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
34
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
35
35
|
SH HIT tighten-paper it is too long for its contribution and hard to read cover to
|
|
36
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
36
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
37
37
|
SL miss NONE people keep bailing out partway through and I cannot tell why
|
|
38
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
38
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
39
39
|
SL HIT tighten-paper there is a nine page ceiling and I am well over it
|
|
40
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
40
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
41
41
|
SL HIT tighten-paper my co-author says the whole thing sprawls and he lost the thre
|
|
42
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
42
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
43
43
|
SL miss cold-read-diff every paragraph seems necessary to me and yet the whole is exh
|
|
44
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
44
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
45
45
|
AH HIT grade-paper-writing grade the writing craft in this draft and name the offending s
|
|
46
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
46
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
47
47
|
AH HIT grade-paper-writing run the blind multi-grader panel over the prose clarity and ja
|
|
48
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
48
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
49
49
|
AH HIT grade-paper-writing score the title, the abstract and the intro architecture one t
|
|
50
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
50
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
51
51
|
AH HIT grade-paper-writing grade how well this reads, hedge stacking included, and give m
|
|
52
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
52
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
53
53
|
AL HIT grade-paper-writing mark this manuscript out of five on how it is put together at
|
|
54
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
54
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
55
55
|
AL HIT grade-paper-writing give me a scored report card on the language, with the worst e
|
|
56
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
56
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
57
57
|
AL miss NONE rate how professional the phrasing sounds against papers peopl
|
|
58
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
58
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
59
59
|
AL miss NONE assign a number to the quality of the English here and point a
|
|
60
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
60
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
61
61
|
SH HIT grade-paper-writing the abstract reads like a wall of jargon
|
|
62
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
62
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
63
63
|
SH HIT grade-paper-writing the intro architecture is fine but the prose clarity is not
|
|
64
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
64
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
65
65
|
SH HIT grade-paper-writing there is hedge stacking everywhere and the point never lands
|
|
66
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
66
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
67
67
|
SH HIT grade-paper-writing the writing does not read well even though the draft is finish
|
|
68
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
68
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
69
69
|
SL miss NONE something about the way this is worded makes me wince and I ca
|
|
70
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
70
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
71
71
|
SL miss NONE my supervisor said the English gets in the way of the science
|
|
72
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
72
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
73
73
|
SL miss cold-read-diff the sentences are correct but they feel like wet cardboard
|
|
74
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
74
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
75
75
|
SL miss NONE I went through my own opening twice and still had to start ove
|
|
76
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
76
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
77
77
|
AH HIT argument-arc build the one-sentence-per-section outline before the large re
|
|
78
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
78
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
79
79
|
AH HIT argument-arc run the bottom-up inevitability pass over the argument archite
|
|
80
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
80
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
81
81
|
AH HIT argument-arc repair the argument architecture — the same structural objecti
|
|
82
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
82
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
83
83
|
AH HIT argument-arc check the name and number budget, the reader has too much to c
|
|
84
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
84
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
85
85
|
AL HIT argument-arc give me a single line for each part of the manuscript, working
|
|
86
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
86
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
87
87
|
AL HIT argument-arc make the ending feel unavoidable given everything before it, a
|
|
88
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
88
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
89
89
|
AL miss tighten-paper count how many invented labels and figures the audience must m
|
|
90
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
90
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
91
91
|
AL miss NONE lay out the chain of reasoning as a list so I can see where a
|
|
92
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
92
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
93
93
|
SH HIT argument-arc the reader says we throw ideas at them
|
|
94
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
94
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
95
95
|
SH HIT argument-arc the same structural objection repeats in every round
|
|
96
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
96
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
97
97
|
SH HIT argument-arc there is no argument architecture here, just a sequence
|
|
98
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
98
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
99
99
|
SH HIT argument-arc we blew the name and number budget somewhere in the middle
|
|
100
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
100
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
101
101
|
SL miss tighten-paper each part is fine alone but together they do not add up to any
|
|
102
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
102
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
103
103
|
SL HIT argument-arc my advisor cannot tell what the conclusion depends on
|
|
104
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
104
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
105
105
|
SL miss NONE the ending arrives without having been earned
|
|
106
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
106
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
107
107
|
SL miss NONE someone asked me what the point was and I gave three answers
|
|
108
108
|
|
|
109
109
|
ORACLE ACCURACY BY CELL (closed book, 37 descriptions in context, 1 pick each)
|
|
@@ -19,21 +19,21 @@ A6 persona-only (A1's mirror) 225 22 72 0 0.19 0.35
|
|
|
19
19
|
oracle: 1 arm(s) x 8 closed-book picks over 37 descriptions
|
|
20
20
|
|
|
21
21
|
=== A6 persona-only (A1's mirror)
|
|
22
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
22
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
23
23
|
AH HIT grade-paper-writing grade the writing craft in this draft and name the offendi
|
|
24
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
24
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
25
25
|
AH HIT grade-paper-writing run the blind multi-grader panel over the prose clarity an
|
|
26
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
26
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
27
27
|
AH HIT grade-paper-writing score the title, the abstract and the intro architecture o
|
|
28
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
28
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
29
29
|
AH HIT grade-paper-writing grade how well this reads, hedge stacking included, and gi
|
|
30
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
30
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
31
31
|
SH HIT grade-paper-writing the abstract reads like a wall of jargon
|
|
32
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
32
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
33
33
|
SH HIT grade-paper-writing the intro architecture is fine but the prose clarity is no
|
|
34
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
34
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
35
35
|
SH HIT grade-paper-writing there is hedge stacking everywhere and the point never lan
|
|
36
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
36
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
37
37
|
SH HIT grade-paper-writing the writing does not read well even though the draft is fi
|
|
38
38
|
|
|
39
39
|
ORACLE ACCURACY BY ARM (closed book, 37 descriptions in context, 1 pick each)
|
|
@@ -18,106 +18,106 @@ A5 renamed (description identical) 1174 94 0 0 0.85 0.78
|
|
|
18
18
|
oracle: 6 arms x 8 closed-book picks over 37 descriptions
|
|
19
19
|
|
|
20
20
|
=== A0 baseline (verbatim)
|
|
21
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
21
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
22
22
|
AH HIT grade-paper-writing grade the writing craft in this draft and name the offendi
|
|
23
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
23
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
24
24
|
AH HIT grade-paper-writing run the blind multi-grader panel over the prose clarity an
|
|
25
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
25
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
26
26
|
AH HIT grade-paper-writing score the title, the abstract and the intro architecture o
|
|
27
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
27
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
28
28
|
AH HIT grade-paper-writing grade how well this reads, hedge stacking included, and gi
|
|
29
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
29
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
30
30
|
SH HIT grade-paper-writing the abstract reads like a wall of jargon
|
|
31
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
31
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
32
32
|
SH HIT grade-paper-writing the intro architecture is fine but the prose clarity is no
|
|
33
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
33
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
34
34
|
SH miss tighten-paper there is hedge stacking everywhere and the point never lan
|
|
35
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
35
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
36
36
|
SH HIT grade-paper-writing the writing does not read well even though the draft is fi
|
|
37
37
|
=== A1 short (sentences 1-2 only)
|
|
38
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
38
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
39
39
|
AH HIT grade-paper-writing grade the writing craft in this draft and name the offendi
|
|
40
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
40
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
41
41
|
AH HIT grade-paper-writing run the blind multi-grader panel over the prose clarity an
|
|
42
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
42
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
43
43
|
AH HIT grade-paper-writing score the title, the abstract and the intro architecture o
|
|
44
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
44
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
45
45
|
AH HIT grade-paper-writing grade how well this reads, hedge stacking included, and gi
|
|
46
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
46
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
47
47
|
SH HIT grade-paper-writing the abstract reads like a wall of jargon
|
|
48
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
48
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
49
49
|
SH HIT grade-paper-writing the intro architecture is fine but the prose clarity is no
|
|
50
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
50
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
51
51
|
SH miss tighten-paper there is hedge stacking everywhere and the point never lan
|
|
52
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
52
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
53
53
|
SH HIT grade-paper-writing the writing does not read well even though the draft is fi
|
|
54
54
|
=== A2 no-subordination
|
|
55
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
55
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
56
56
|
AH HIT grade-paper-writing grade the writing craft in this draft and name the offendi
|
|
57
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
57
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
58
58
|
AH HIT grade-paper-writing run the blind multi-grader panel over the prose clarity an
|
|
59
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
59
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
60
60
|
AH HIT grade-paper-writing score the title, the abstract and the intro architecture o
|
|
61
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
61
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
62
62
|
AH HIT grade-paper-writing grade how well this reads, hedge stacking included, and gi
|
|
63
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
63
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
64
64
|
SH HIT grade-paper-writing the abstract reads like a wall of jargon
|
|
65
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
65
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
66
66
|
SH HIT grade-paper-writing the intro architecture is fine but the prose clarity is no
|
|
67
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
67
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
68
68
|
SH HIT grade-paper-writing there is hedge stacking everywhere and the point never lan
|
|
69
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
69
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
70
70
|
SH HIT grade-paper-writing the writing does not read well even though the draft is fi
|
|
71
71
|
=== A3 no-negation
|
|
72
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
72
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
73
73
|
AH HIT grade-paper-writing grade the writing craft in this draft and name the offendi
|
|
74
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
74
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
75
75
|
AH HIT grade-paper-writing run the blind multi-grader panel over the prose clarity an
|
|
76
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
76
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
77
77
|
AH HIT grade-paper-writing score the title, the abstract and the intro architecture o
|
|
78
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
78
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
79
79
|
AH HIT grade-paper-writing grade how well this reads, hedge stacking included, and gi
|
|
80
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
80
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
81
81
|
SH HIT grade-paper-writing the abstract reads like a wall of jargon
|
|
82
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
82
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
83
83
|
SH HIT grade-paper-writing the intro architecture is fine but the prose clarity is no
|
|
84
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
84
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
85
85
|
SH miss cold-read-diff there is hedge stacking everywhere and the point never lan
|
|
86
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
86
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
87
87
|
SH HIT grade-paper-writing the writing does not read well even though the draft is fi
|
|
88
88
|
=== A4 no-machinery
|
|
89
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
89
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
90
90
|
AH HIT grade-paper-writing grade the writing craft in this draft and name the offendi
|
|
91
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
91
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
92
92
|
AH HIT grade-paper-writing run the blind multi-grader panel over the prose clarity an
|
|
93
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
93
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
94
94
|
AH HIT grade-paper-writing score the title, the abstract and the intro architecture o
|
|
95
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
95
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
96
96
|
AH HIT grade-paper-writing grade how well this reads, hedge stacking included, and gi
|
|
97
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
97
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
98
98
|
SH HIT grade-paper-writing the abstract reads like a wall of jargon
|
|
99
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
99
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
100
100
|
SH HIT grade-paper-writing the intro architecture is fine but the prose clarity is no
|
|
101
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
101
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
102
102
|
SH HIT grade-paper-writing there is hedge stacking everywhere and the point never lan
|
|
103
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
103
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
104
104
|
SH HIT grade-paper-writing the writing does not read well even though the draft is fi
|
|
105
105
|
=== A5 renamed (description identical)
|
|
106
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
106
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
107
107
|
AH miss ?grade-paper-writing grade the writing craft in this draft and name the offendi
|
|
108
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
108
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
109
109
|
AH miss ?grade-paper-writing run the blind multi-grader panel over the prose clarity an
|
|
110
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
110
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
111
111
|
AH miss ?grade-paper-writing score the title, the abstract and the intro architecture o
|
|
112
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
112
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
113
113
|
AH miss ?grade-paper-writing grade how well this reads, hedge stacking included, and gi
|
|
114
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
114
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
115
115
|
SH miss ?grade-paper-writing the abstract reads like a wall of jargon
|
|
116
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
116
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
117
117
|
SH miss ?grade-paper-writing the intro architecture is fine but the prose clarity is no
|
|
118
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
118
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
119
119
|
SH miss tighten-paper there is hedge stacking everywhere and the point never lan
|
|
120
|
-
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["
|
|
120
|
+
Ignoring 24 permissions.allow entries from .claude/settings.json and .claude/settings.local.json: this workspace has not been trusted. Run Claude Code interactively here once and accept the trust dialog, or set projects["<project>"].hasTrustDialogAccepted: true in /root/.claude.json.
|
|
121
121
|
SH miss ?grade-paper-writing the writing does not read well even though the draft is fi
|
|
122
122
|
|
|
123
123
|
ORACLE ACCURACY BY ARM (closed book, 37 descriptions in context, 1 pick each)
|
|
@@ -2,8 +2,8 @@ patched: filter the MAIN LOOP to grade-paper-writing, cells AH+SH (guards untouc
|
|
|
2
2
|
patched: redirect the JSON output so the parent's own result file survives
|
|
3
3
|
|
|
4
4
|
running the PARENT'S code, grade-paper-writing AH+SH only, 3 trials = 24 runs
|
|
5
|
-
parent :
|
|
6
|
-
patched:
|
|
5
|
+
parent : <project>/.claude/skills/paper-pipeline/framing-vs-vocabulary.eval.mjs
|
|
6
|
+
patched: <scratch>/parent-repl/replication.mjs
|
|
7
7
|
|
|
8
8
|
|
|
9
9
|
37 skills installed → 36 competitors per run
|
|
@@ -38,13 +38,13 @@
|
|
|
38
38
|
|
|
39
39
|
import { readFileSync, writeFileSync, mkdirSync, symlinkSync, existsSync, rmSync } from "node:fs";
|
|
40
40
|
import { join } from "node:path";
|
|
41
|
+
import { tmpdir } from "node:os";
|
|
41
42
|
import { spawnSync } from "node:child_process";
|
|
42
43
|
|
|
43
|
-
const ROOT = process.env.CLAUDE_PROJECT_DIR ??
|
|
44
|
+
const ROOT = process.env.CLAUDE_PROJECT_DIR ?? process.cwd();
|
|
44
45
|
const PARENT = join(ROOT, ".claude", "skills", "paper-pipeline", "framing-vs-vocabulary.eval.mjs");
|
|
45
46
|
const SCRATCH =
|
|
46
|
-
process.env.ABLATION_SCRATCH ??
|
|
47
|
-
"/tmp/claude-0/-home-user-mine/8268acb1-66a2-55ac-858e-2b9e3c81f84e/scratchpad/parent-repl";
|
|
47
|
+
process.env.ABLATION_SCRATCH ?? join(tmpdir(), "parent-repl");
|
|
48
48
|
|
|
49
49
|
const src = readFileSync(PARENT, "utf-8");
|
|
50
50
|
|
package/skills/paper-pipeline/repro/2026-10-13-grade-paper-writing-ablation-preflight-after.log
ADDED
|
@@ -0,0 +1,81 @@
|
|
|
1
|
+
|
|
2
|
+
26 skills installed → 25 competitors per run
|
|
3
|
+
|
|
4
|
+
ARMS — description length, word-set delta vs A0, mean prompt overlap
|
|
5
|
+
arm label chars words − + ovAH ovSH
|
|
6
|
+
A0 baseline (verbatim) 1371 103 0 0 0.85 0.78
|
|
7
|
+
A1 short (sentences 1-2 only) 618 51 52 0 0.71 0.78
|
|
8
|
+
A2 no-subordination 1189 94 9 0 0.85 0.78
|
|
9
|
+
A3 no-negation 1141 92 11 0 0.85 0.78
|
|
10
|
+
A4 no-machinery 670 45 58 0 0.44 0.35
|
|
11
|
+
A5 renamed (description identical) 1371 103 0 0 0.85 0.78
|
|
12
|
+
A6 persona-only (A1's mirror) 298 28 75 0 0.23 0.42
|
|
13
|
+
|
|
14
|
+
⚠ ovAH/ovSH FALL AS TEXT IS DELETED — caveat 2 in the header, quantified. The deletion arms carry
|
|
15
|
+
a vocabulary handicap against the parent's dominant factor. A rising deletion arm rose DESPITE it;
|
|
16
|
+
a flat one may be a real gain cancelled by it, and this design cannot tell. A5 is the only arm
|
|
17
|
+
with zero handicap (identical word set).
|
|
18
|
+
|
|
19
|
+
WORD-SET DELTAS (stemmed content words removed from A0 — none may be added)
|
|
20
|
+
|
|
21
|
+
A0 baseline (verbatim)
|
|
22
|
+
removed (0): —
|
|
23
|
+
added (0): —
|
|
24
|
+
|
|
25
|
+
A1 short (sentences 1-2 only)
|
|
26
|
+
removed (52): run cold stall pas committ persona non academic engineer per section workshop reviewer skimm introduction conclusion inventory rubric number readability gate skill consume panel review adversarial harden default blind multi grader mandate claim preservation diff row content defect structural cut plan tighten first bloat strength reward study compose call generative counterpart render
|
|
27
|
+
added (0): —
|
|
28
|
+
|
|
29
|
+
A2 no-subordination
|
|
30
|
+
removed (9): inventory rubric number readability gate skill consume harden call
|
|
31
|
+
added (0): —
|
|
32
|
+
|
|
33
|
+
A3 no-negation
|
|
34
|
+
removed (11): content defect structural cut plan tighten first bloat strength reward study
|
|
35
|
+
added (0): —
|
|
36
|
+
|
|
37
|
+
A4 no-machinery
|
|
38
|
+
removed (58): title abstract intro architecture structure prose clarity discipline land point figure economy honesty without hedge stack register distance peyton jone mcenerney gopen swan exemplar trust carlini greshake cold stall pas committ persona non academic engineer per section workshop reviewer skimm introduction conclusion inventory rubric number readability gate skill consume default blind multi grader mandate claim preservation diff row
|
|
39
|
+
added (0): —
|
|
40
|
+
|
|
41
|
+
A5 renamed (description identical)
|
|
42
|
+
removed (0): —
|
|
43
|
+
added (0): —
|
|
44
|
+
|
|
45
|
+
A6 persona-only (A1's mirror)
|
|
46
|
+
removed (75): grade craft ten dimension title intro architecture structure prose clarity discipline land point figure economy honesty without hedge stack register distance target venue best written peyton jone mcenerney gopen swan exemplar trust carlini greshake accept nam offend sentence fix inventory rubric number readability gate skill consume panel review adversarial harden default blind multi grader mandate claim preservation diff row content defect structural cut plan tighten first bloat strength reward study compose call generative counterpart render
|
|
47
|
+
added (0): —
|
|
48
|
+
|
|
49
|
+
RESULTING DESCRIPTIONS
|
|
50
|
+
|
|
51
|
+
── A0 (grade-paper-writing, 1371 chars)
|
|
52
|
+
Use when asking "does this paper read well?" / "is the writing any good?" / "it reads like a wall of text and jargon" / "grade the writing" on a draft. Grades WRITING CRAFT only — ten dimensions 1–5 (Title, Abstract, Intro architecture, Structure, Prose clarity, Jargon discipline, Landing-the-point, Figure economy, Honesty-without-hedge-stacking, Register distance to the target venue) against how the best-written papers read (Peyton Jones, McEnerney, Gopen & Swan; exemplars Trusting Trust, Carlini, Greshake) AND against 2–3 accepted papers of the target venue, naming the offending sentence and the fix for each. Runs the cold-read stall pass with TWO committed personas (a non-academic engineer per section, and a workshop reviewer skimming abstract, introduction and conclusion) whose stall inventory — not the rubric number — is the readability gate other skills consume (pc-panel-review, paper-adversarial-review, harden-paper). Defaults to a blind multi-grader panel; after fixes, mandates the claims-preservation diff (row `claims`). NOT a content/defect review (paper-adversarial-review / pc-panel-review), NOT a structural cut plan (tighten-paper — run that first on a bloated draft), NOT content strength against what the venue rewards (study-accepted-papers). Compose with harden-paper (which calls it), draft-paper (generative counterpart), render-paper.
|
|
53
|
+
|
|
54
|
+
── A1 (grade-paper-writing, 618 chars)
|
|
55
|
+
Use when asking "does this paper read well?" / "is the writing any good?" / "it reads like a wall of text and jargon" / "grade the writing" on a draft. Grades WRITING CRAFT only — ten dimensions 1–5 (Title, Abstract, Intro architecture, Structure, Prose clarity, Jargon discipline, Landing-the-point, Figure economy, Honesty-without-hedge-stacking, Register distance to the target venue) against how the best-written papers read (Peyton Jones, McEnerney, Gopen & Swan; exemplars Trusting Trust, Carlini, Greshake) AND against 2–3 accepted papers of the target venue, naming the offending sentence and the fix for each.
|
|
56
|
+
|
|
57
|
+
── A2 (grade-paper-writing, 1189 chars)
|
|
58
|
+
Use when asking "does this paper read well?" / "is the writing any good?" / "it reads like a wall of text and jargon" / "grade the writing" on a draft. Grades WRITING CRAFT only — ten dimensions 1–5 (Title, Abstract, Intro architecture, Structure, Prose clarity, Jargon discipline, Landing-the-point, Figure economy, Honesty-without-hedge-stacking, Register distance to the target venue) against how the best-written papers read (Peyton Jones, McEnerney, Gopen & Swan; exemplars Trusting Trust, Carlini, Greshake) AND against 2–3 accepted papers of the target venue, naming the offending sentence and the fix for each. Runs the cold-read stall pass with TWO committed personas (a non-academic engineer per section, and a workshop reviewer skimming abstract, introduction and conclusion). Defaults to a blind multi-grader panel; after fixes, mandates the claims-preservation diff (row `claims`). NOT a content/defect review (paper-adversarial-review / pc-panel-review), NOT a structural cut plan (tighten-paper — run that first on a bloated draft), NOT content strength against what the venue rewards (study-accepted-papers). Compose with draft-paper (generative counterpart), render-paper.
|
|
59
|
+
|
|
60
|
+
── A3 (grade-paper-writing, 1141 chars)
|
|
61
|
+
Use when asking "does this paper read well?" / "is the writing any good?" / "it reads like a wall of text and jargon" / "grade the writing" on a draft. Grades WRITING CRAFT only — ten dimensions 1–5 (Title, Abstract, Intro architecture, Structure, Prose clarity, Jargon discipline, Landing-the-point, Figure economy, Honesty-without-hedge-stacking, Register distance to the target venue) against how the best-written papers read (Peyton Jones, McEnerney, Gopen & Swan; exemplars Trusting Trust, Carlini, Greshake) AND against 2–3 accepted papers of the target venue, naming the offending sentence and the fix for each. Runs the cold-read stall pass with TWO committed personas (a non-academic engineer per section, and a workshop reviewer skimming abstract, introduction and conclusion) whose stall inventory — not the rubric number — is the readability gate other skills consume (pc-panel-review, paper-adversarial-review, harden-paper). Defaults to a blind multi-grader panel; after fixes, mandates the claims-preservation diff (row `claims`). Compose with harden-paper (which calls it), draft-paper (generative counterpart), render-paper.
|
|
62
|
+
|
|
63
|
+
── A4 (grade-paper-writing, 670 chars)
|
|
64
|
+
Use when asking "does this paper read well?" / "is the writing any good?" / "it reads like a wall of text and jargon" / "grade the writing" on a draft. Grades WRITING CRAFT only — ten dimensions 1–5 against how the best-written papers read AND against 2–3 accepted papers of the target venue, naming the offending sentence and the fix for each. NOT a content/defect review (paper-adversarial-review / pc-panel-review), NOT a structural cut plan (tighten-paper — run that first on a bloated draft), NOT content strength against what the venue rewards (study-accepted-papers). Compose with harden-paper (which calls it), draft-paper (generative counterpart), render-paper.
|
|
65
|
+
|
|
66
|
+
── A5 (paper-readability-review, 1371 chars)
|
|
67
|
+
Use when asking "does this paper read well?" / "is the writing any good?" / "it reads like a wall of text and jargon" / "grade the writing" on a draft. Grades WRITING CRAFT only — ten dimensions 1–5 (Title, Abstract, Intro architecture, Structure, Prose clarity, Jargon discipline, Landing-the-point, Figure economy, Honesty-without-hedge-stacking, Register distance to the target venue) against how the best-written papers read (Peyton Jones, McEnerney, Gopen & Swan; exemplars Trusting Trust, Carlini, Greshake) AND against 2–3 accepted papers of the target venue, naming the offending sentence and the fix for each. Runs the cold-read stall pass with TWO committed personas (a non-academic engineer per section, and a workshop reviewer skimming abstract, introduction and conclusion) whose stall inventory — not the rubric number — is the readability gate other skills consume (pc-panel-review, paper-adversarial-review, harden-paper). Defaults to a blind multi-grader panel; after fixes, mandates the claims-preservation diff (row `claims`). NOT a content/defect review (paper-adversarial-review / pc-panel-review), NOT a structural cut plan (tighten-paper — run that first on a bloated draft), NOT content strength against what the venue rewards (study-accepted-papers). Compose with harden-paper (which calls it), draft-paper (generative counterpart), render-paper.
|
|
68
|
+
|
|
69
|
+
── A6 (grade-paper-writing, 298 chars)
|
|
70
|
+
Use when asking "does this paper read well?" / "is the writing any good?" / "it reads like a wall of text and jargon" on a draft. Runs the cold-read stall pass with TWO committed personas (a non-academic engineer per section, and a workshop reviewer skimming abstract, introduction and conclusion).
|
|
71
|
+
|
|
72
|
+
building each arm's skills dir under <scratch>/gpw-ablation (no real file is written) …
|
|
73
|
+
A0 → <scratch>/gpw-ablation/arm-A0
|
|
74
|
+
A1 → <scratch>/gpw-ablation/arm-A1
|
|
75
|
+
A2 → <scratch>/gpw-ablation/arm-A2
|
|
76
|
+
A3 → <scratch>/gpw-ablation/arm-A3
|
|
77
|
+
A4 → <scratch>/gpw-ablation/arm-A4
|
|
78
|
+
A5 → <scratch>/gpw-ablation/arm-A5
|
|
79
|
+
A6 → <scratch>/gpw-ablation/arm-A6
|
|
80
|
+
|
|
81
|
+
ALL PREFLIGHT GUARDS PASSED. No tokens spent. Run --mode main next.
|