plainproof 0.1.0__tar.gz

plainproof-0.1.0/.gitignore

@@ -0,0 +1,10 @@
+data/*
+!data/edm-v2-e0/
+data/edm-v2-e0/*
+!data/edm-v2-e0/study/
+__pycache__/
+*.pyc
+dist/
+build/
+*.egg-info/
+.venv/

plainproof-0.1.0/CITATION.cff

@@ -0,0 +1,7 @@
+cff-version: 1.2.0
+message: "If you use this code or these results, please cite the paper (citation to be added on acceptance)."
+title: "How many follow-up questions distinguish genuine understanding from apparent mastery? Reproduction package"
+authors:
+  - family-names: Vettrivel
+    given-names: Vishnu
+license: MIT

plainproof-0.1.0/LICENSE

@@ -0,0 +1,16 @@
+MIT License
+
+Copyright (c) 2026 Vishnu Vettrivel
+
+Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated
+documentation files (the "Software"), to deal in the Software without restriction, including without limitation the
+rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit
+persons to whom the Software is furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all copies or substantial portions of the
+Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE
+WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR
+COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR
+OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

plainproof-0.1.0/LICENSE-docs.md

@@ -0,0 +1,9 @@
+# Documentation, figures and tables licence
+
+Everything under `docs/` and `reports/` (protocols, pre-registration log, freeze files, receipts, figures and tables) is
+licensed under the Creative Commons Attribution 4.0 International licence (CC BY 4.0):
+https://creativecommons.org/licenses/by/4.0/ . Code is under the MIT licence in `LICENSE`.
+
+Not covered by either licence, and not in this repository: the ASSISTments 2009-2010 data (its own terms forbid passing
+it on; `scripts/bobcat/fetch_bobcat.sh` fetches it from its source), BOBCAT (MIT, fetched from its own repository), and
+catIrt (GPL, installed from CRAN; this repo only calls it).

plainproof-0.1.0/MANIFEST.in

@@ -0,0 +1,6 @@
+include README.md LICENSE LICENSE-docs.md CITATION.cff requirements.txt substitutions.json .gitignore
+recursive-include scripts *.py *.R *.sh
+recursive-include reports *
+recursive-include docs *.md
+recursive-include tests *.py *.csv
+recursive-include data/edm-v2-e0/study *.json

plainproof-0.1.0/PKG-INFO

@@ -0,0 +1,95 @@
+Metadata-Version: 2.4
+Name: plainproof
+Version: 0.1.0
+Summary: Reproduction tool for the paper 'How many follow-up questions distinguish genuine understanding from apparent mastery?'. Not a general library. Its sealed checks can stop a run on purpose.
+Author: Vishnu Vettrivel
+License-Expression: MIT
+Requires-Python: >=3.11
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: numpy>=2.0
+Requires-Dist: scipy>=1.13
+Provides-Extra: run
+Requires-Dist: scikit-learn>=1.5; extra == "run"
+Requires-Dist: torch>=2.4; extra == "run"
+Provides-Extra: test
+Requires-Dist: pytest>=8; extra == "test"
+Requires-Dist: pytest-xdist>=3.5; extra == "test"
+Dynamic: license-file
+
+# plainproof
+
+Reproduction package for **"How many follow-up questions distinguish genuine understanding from apparent mastery?"** (EDM 2027 submission, simulation study). It asks how many adaptive follow-up questions a classification test needs to tell genuine understanding from apparent mastery at a calibrated confidence target, and how that changes as a learner outsources a share *d* of the follow-ups to an AI. A second, sealed study (E0b) tests whether planted hard probe items separate outsourcing learners from honest ones.
+
+Everything here is CPU-only and needs no paid service. Code: MIT (`LICENSE`). Docs, figures and tables: CC BY 4.0 (`LICENSE-docs.md`).
+
+## From clone to the figure (about 10 minutes)
+
+The `plainproof` command runs each step (`plainproof --help`); the raw script calls below are what it runs. The local path inside the sealed `scripts/edm_v2_e0/r_env.sh` is part of the frozen record; use the `scripts/rscript.sh` wrapper, which `plainproof figures` calls.
+
+```sh
+git clone <this repository> && cd plainproof
+python3.11 -m venv .venv && . .venv/bin/activate && pip install -e '.[test,run]'   # or: pip install -r requirements.txt
+
+# 1. Tests (43): SPRT against catIrt 0.5.1's saved steps, exact stopping time, simulator, signatures, planted probes
+python -m pytest -n auto -q tests
+
+# 2. Check that the code here is the sealed code (undoes the documented path substitutions, then compares sha256)
+plainproof verify
+
+# 3. Fetch the sealed held-out outputs from Zenodo (DOI: to be assigned) and check their hashes
+ZENODO_URL=<record file URL> plainproof fetch heldout
+
+# 4. Rebuild the tables and figures from the held-out summaries (needs R 4.x for the plots; base graphics only)
+python scripts/edm_v2_e0/report.py data/edm-v2-e0/heldout/summary.json
+scripts/rscript.sh scripts/edm_v2_e0/plot_error_vs_d.R reports/edm-v2-e0/error-vs-d.csv reports/edm-v2-e0/figures/error-vs-d.png aff9a8c49d48821c0e9343cd058c4e0e2f1659ffabcaa719824412f3b14abc90
+python scripts/edm_v2_e0b/report.py data/edm-v2-e0b/heldout/summary.json
+scripts/rscript.sh scripts/edm_v2_e0b/plot_probe_auc.R reports/edm-v2-e0b/probe-auc-vs-d.csv reports/edm-v2-e0b/figures/probe-auc-vs-d.png 617be427feac24df2e342da00d34e91c78d5de91592cee390ef3516ae9e2ff3f
+```
+
+The figures land in `reports/edm-v2-e0/figures/` and `reports/edm-v2-e0b/figures/`; the committed copies are the same files.
+
+## Full rerun (about 4 hours of CPU)
+
+Only if you want to regenerate everything, including the held-out outputs.
+
+```sh
+# a. BOBCAT (MIT) at the pinned commit, with the preprocessed ASSISTments 2009-2010 file; the data's own terms forbid
+#    passing it on, so you fetch it from its source and accept them yourself
+scripts/bobcat/fetch_bobcat.sh
+# b. Item fit on the development half of ASSISTments learners (the output is checked against the receipt's hash)
+python scripts/edm_v2_e0/fit_assist2009.py data/edm-v2-e0/item-fit
+# c. Retrain the BOBCAT checkpoint (about 2 hours; author defaults, fold 1, seed 221), then compare it with the original
+python scripts/bobcat/retrain.py && python scripts/bobcat/check_checkpoint.py
+# d. catIrt fixture, development stages, held-out runs (each refuses to overwrite an existing cell)
+scripts/rscript.sh scripts/edm_v2_e0/catirt_sprt_steps.R tests/fixtures/edm_v2_catirt_sprt
+python scripts/edm_v2_e0/heldout.py run data/edm-v2-e0/heldout && python scripts/edm_v2_e0/heldout.py summarize data/edm-v2-e0/heldout
+python scripts/edm_v2_e0b/run.py run data/edm-v2-e0b/heldout && python scripts/edm_v2_e0b/run.py summarize data/edm-v2-e0b/heldout
+```
+
+Two caveats, stated plainly. The sealed code checks the item fit's sha256, so a different numpy can stop step b; and it asserts that the BOBCAT checkpoint's best epoch is 105, so a retrain that is not bit-identical can stop step d. In either case, use the Zenodo outputs. The development stages (`study.py tune|calibrate|calibrate_sprt_full|pilot`) are included for the record; their outputs (synthetic learners only) are in `data/edm-v2-e0/study/`.
+
+## Fingerprints (sha256)
+
+| What | sha256 |
+|---|---|
+| E0 sealed freeze `reports/edm-v2-e0/freeze.json` | `a0f8ce404f2b5f7e671e2503a33b4554040e80714f6053553507e0972acdbcdc` |
+| E0b sealed freeze `reports/edm-v2-e0b/freeze.json` | `3fa0b8d457d813f59abd5255f9303e44deb2119ee79d6a9b92439a6c1cbf58ed` |
+| E0 held-out summary (Zenodo, `e0-heldout.tar` → `heldout/summary.json`) | `aff9a8c49d48821c0e9343cd058c4e0e2f1659ffabcaa719824412f3b14abc90` |
+| E0b held-out summary (Zenodo, `e0b-heldout.tar` → `heldout/summary.json`) | `617be427feac24df2e342da00d34e91c78d5de91592cee390ef3516ae9e2ff3f` |
+| Zenodo `e0-heldout.tar` | `bd06a11eb7163da102cad6ea0df12ea79e52ff94aab1dc35d28ec3910af2be22` |
+| Zenodo `e0b-heldout.tar` | `68219f228c41da972fe4c8f92c218e01f85f08eed864185f237cecda05314bbf` |
+| ASSISTments 2009 file at BOBCAT e6b6245e | `c07ca9fa0f08207b06488cec527725938fe96e81e3c1762839e1ad0b84f974cc` |
+| 2PL item fit (regenerated in step b) | `12a3b167cd9c9b78b3c3c7faf71b2e464b0943a454f6418faf0f99b1114cb7fc` |
+| catIrt 0.5.1 CRAN binary used for the fixture | `f5418f447e91d184791e668bd2a135ea5da40c981d4a76826018295b6ea9f079` |
+
+## What is in here
+
+- `src/plainproof/`: item model, SPRT arm, exact stopping time, simulator (uniform and uncertainty-triggered outsourcing), item fit, signatures, planted probes (with the give-up model), matched-coverage scoring.
+- `scripts/edm_v2_e0/`, `scripts/edm_v2_e0b/`: the runners, report builders and R plots. `scripts/published_cat_reference_v1/`: the BOBCAT loading code the runners call.
+- `reports/`: both sealed freezes, receipts, figures and tables. `docs/`: the E0 protocol and the pre-registration log (verbatim extract).
+- `substitutions.json`: the only differences between this code and the sealed originals (package name, file locations, data paths). `scripts/verify_frozen.py` undoes them and checks every hash. `scripts/edm_v2_e0/r_env.sh` is kept verbatim as the record of the original R runtime; use `scripts/rscript.sh` instead.
+
+## Recorded departures
+
+All are in `docs/PREREG_EDM_V2.md`: the SPRT tuning rule was revised after its first development pass (labelled post hoc); SPRT's calibration map was refitted once on full paths before the freeze; the E0 held-out run exceeded its 2 GiB memory cap (no result depends on it; the runner now enforces the cap); E0b was sealed before its pilot table had been reviewed (no result affected).

plainproof-0.1.0/README.md

@@ -0,0 +1,76 @@
+# plainproof
+
+Reproduction package for **"How many follow-up questions distinguish genuine understanding from apparent mastery?"** (EDM 2027 submission, simulation study). It asks how many adaptive follow-up questions a classification test needs to tell genuine understanding from apparent mastery at a calibrated confidence target, and how that changes as a learner outsources a share *d* of the follow-ups to an AI. A second, sealed study (E0b) tests whether planted hard probe items separate outsourcing learners from honest ones.
+
+Everything here is CPU-only and needs no paid service. Code: MIT (`LICENSE`). Docs, figures and tables: CC BY 4.0 (`LICENSE-docs.md`).
+
+## From clone to the figure (about 10 minutes)
+
+The `plainproof` command runs each step (`plainproof --help`); the raw script calls below are what it runs. The local path inside the sealed `scripts/edm_v2_e0/r_env.sh` is part of the frozen record; use the `scripts/rscript.sh` wrapper, which `plainproof figures` calls.
+
+```sh
+git clone <this repository> && cd plainproof
+python3.11 -m venv .venv && . .venv/bin/activate && pip install -e '.[test,run]'   # or: pip install -r requirements.txt
+
+# 1. Tests (43): SPRT against catIrt 0.5.1's saved steps, exact stopping time, simulator, signatures, planted probes
+python -m pytest -n auto -q tests
+
+# 2. Check that the code here is the sealed code (undoes the documented path substitutions, then compares sha256)
+plainproof verify
+
+# 3. Fetch the sealed held-out outputs from Zenodo (DOI: to be assigned) and check their hashes
+ZENODO_URL=<record file URL> plainproof fetch heldout
+
+# 4. Rebuild the tables and figures from the held-out summaries (needs R 4.x for the plots; base graphics only)
+python scripts/edm_v2_e0/report.py data/edm-v2-e0/heldout/summary.json
+scripts/rscript.sh scripts/edm_v2_e0/plot_error_vs_d.R reports/edm-v2-e0/error-vs-d.csv reports/edm-v2-e0/figures/error-vs-d.png aff9a8c49d48821c0e9343cd058c4e0e2f1659ffabcaa719824412f3b14abc90
+python scripts/edm_v2_e0b/report.py data/edm-v2-e0b/heldout/summary.json
+scripts/rscript.sh scripts/edm_v2_e0b/plot_probe_auc.R reports/edm-v2-e0b/probe-auc-vs-d.csv reports/edm-v2-e0b/figures/probe-auc-vs-d.png 617be427feac24df2e342da00d34e91c78d5de91592cee390ef3516ae9e2ff3f
+```
+
+The figures land in `reports/edm-v2-e0/figures/` and `reports/edm-v2-e0b/figures/`; the committed copies are the same files.
+
+## Full rerun (about 4 hours of CPU)
+
+Only if you want to regenerate everything, including the held-out outputs.
+
+```sh
+# a. BOBCAT (MIT) at the pinned commit, with the preprocessed ASSISTments 2009-2010 file; the data's own terms forbid
+#    passing it on, so you fetch it from its source and accept them yourself
+scripts/bobcat/fetch_bobcat.sh
+# b. Item fit on the development half of ASSISTments learners (the output is checked against the receipt's hash)
+python scripts/edm_v2_e0/fit_assist2009.py data/edm-v2-e0/item-fit
+# c. Retrain the BOBCAT checkpoint (about 2 hours; author defaults, fold 1, seed 221), then compare it with the original
+python scripts/bobcat/retrain.py && python scripts/bobcat/check_checkpoint.py
+# d. catIrt fixture, development stages, held-out runs (each refuses to overwrite an existing cell)
+scripts/rscript.sh scripts/edm_v2_e0/catirt_sprt_steps.R tests/fixtures/edm_v2_catirt_sprt
+python scripts/edm_v2_e0/heldout.py run data/edm-v2-e0/heldout && python scripts/edm_v2_e0/heldout.py summarize data/edm-v2-e0/heldout
+python scripts/edm_v2_e0b/run.py run data/edm-v2-e0b/heldout && python scripts/edm_v2_e0b/run.py summarize data/edm-v2-e0b/heldout
+```
+
+Two caveats, stated plainly. The sealed code checks the item fit's sha256, so a different numpy can stop step b; and it asserts that the BOBCAT checkpoint's best epoch is 105, so a retrain that is not bit-identical can stop step d. In either case, use the Zenodo outputs. The development stages (`study.py tune|calibrate|calibrate_sprt_full|pilot`) are included for the record; their outputs (synthetic learners only) are in `data/edm-v2-e0/study/`.
+
+## Fingerprints (sha256)
+
+| What | sha256 |
+|---|---|
+| E0 sealed freeze `reports/edm-v2-e0/freeze.json` | `a0f8ce404f2b5f7e671e2503a33b4554040e80714f6053553507e0972acdbcdc` |
+| E0b sealed freeze `reports/edm-v2-e0b/freeze.json` | `3fa0b8d457d813f59abd5255f9303e44deb2119ee79d6a9b92439a6c1cbf58ed` |
+| E0 held-out summary (Zenodo, `e0-heldout.tar` → `heldout/summary.json`) | `aff9a8c49d48821c0e9343cd058c4e0e2f1659ffabcaa719824412f3b14abc90` |
+| E0b held-out summary (Zenodo, `e0b-heldout.tar` → `heldout/summary.json`) | `617be427feac24df2e342da00d34e91c78d5de91592cee390ef3516ae9e2ff3f` |
+| Zenodo `e0-heldout.tar` | `bd06a11eb7163da102cad6ea0df12ea79e52ff94aab1dc35d28ec3910af2be22` |
+| Zenodo `e0b-heldout.tar` | `68219f228c41da972fe4c8f92c218e01f85f08eed864185f237cecda05314bbf` |
+| ASSISTments 2009 file at BOBCAT e6b6245e | `c07ca9fa0f08207b06488cec527725938fe96e81e3c1762839e1ad0b84f974cc` |
+| 2PL item fit (regenerated in step b) | `12a3b167cd9c9b78b3c3c7faf71b2e464b0943a454f6418faf0f99b1114cb7fc` |
+| catIrt 0.5.1 CRAN binary used for the fixture | `f5418f447e91d184791e668bd2a135ea5da40c981d4a76826018295b6ea9f079` |
+
+## What is in here
+
+- `src/plainproof/`: item model, SPRT arm, exact stopping time, simulator (uniform and uncertainty-triggered outsourcing), item fit, signatures, planted probes (with the give-up model), matched-coverage scoring.
+- `scripts/edm_v2_e0/`, `scripts/edm_v2_e0b/`: the runners, report builders and R plots. `scripts/published_cat_reference_v1/`: the BOBCAT loading code the runners call.
+- `reports/`: both sealed freezes, receipts, figures and tables. `docs/`: the E0 protocol and the pre-registration log (verbatim extract).
+- `substitutions.json`: the only differences between this code and the sealed originals (package name, file locations, data paths). `scripts/verify_frozen.py` undoes them and checks every hash. `scripts/edm_v2_e0/r_env.sh` is kept verbatim as the record of the original R runtime; use `scripts/rscript.sh` instead.
+
+## Recorded departures
+
+All are in `docs/PREREG_EDM_V2.md`: the SPRT tuning rule was revised after its first development pass (labelled post hoc); SPRT's calibration map was refitted once on full paths before the freeze; the E0 held-out run exceeded its 2 GiB memory cap (no result depends on it; the runner now enforces the cap); E0b was sealed before its pilot table had been reviewed (no result affected).

plainproof-0.1.0/data/edm-v2-e0/study/calibration-v2.json

@@ -0,0 +1 @@
+{"bobcat": {"points": 16200, "x": [-2.428029775619507, -0.8106327652931213, -0.8085384368896484, -0.685897171497345, -0.684127926826477, -0.6265246868133545, -0.6253790855407715, -0.4592517614364624, -0.45882540941238403, -0.2761606276035309, -0.27600911259651184, -0.07393736392259598, -0.07349324226379395, 0.17572836577892303, 0.17674320936203003, 0.3941620886325836, 0.3961845636367798, 0.5716667771339417, 0.5750813484191895, 0.6119649410247803, 0.6125683188438416, 0.716677725315094, 0.7396292090415955, 0.7741888761520386, 0.7784877419471741, 0.8830729722976685, 0.8874343037605286, 0.9185559153556824, 0.9190362095832825, 0.9993603825569153, 1.0236331224441528, 1.0809051990509033, 1.112189531326294, 1.2480703592300415, 1.248070478439331, 1.2483887672424316, 1.2503210306167603, 1.324808955192566, 1.325721025466919, 1.3564985990524292, 1.3674060106277466, 1.4654712677001953, 1.4719035625457764, 1.5915871858596802, 1.5921642780303955, 1.6623791456222534, 1.6969033479690552, 1.7262288331985474, 1.7264482975006104, 1.8746452331542969, 1.87465500831604, 1.9417369365692139, 1.9433324337005615, 2.0057008266448975, 2.0337908267974854, 2.1056318283081055, 2.3043129444122314], "y": [0.0, 0.0, 0.01937984496124031, 0.01937984496124031, 0.02727272727272727, 0.02727272727272727, 0.04817275747508306, 0.04817275747508306, 0.08876811594202899, 0.08876811594202899, 0.16597510373443983, 0.16597510373443983, 0.3622476813966176, 0.3622476813966176, 0.39481865284974094, 0.39481865284974094, 0.4752553024351924, 0.4752553024351924, 0.5027027027027027, 0.5027027027027027, 0.5768229166666666, 0.5768229166666666, 0.5787139689578713, 0.5787139689578713, 0.6686478454680534, 0.6686478454680534, 0.6734693877551019, 0.6734693877551019, 0.729064039408867, 0.729064039408867, 0.7322515212981744, 0.7322515212981744, 0.8095238095238095, 0.8095238095238095, 0.8571428571428571, 0.8571428571428571, 0.8686274509803922, 0.8686274509803922, 0.8909090909090909, 0.8909090909090909, 0.9001751313485113, 0.9001751313485113, 0.9329501915708812, 0.9329501915708812, 0.9344827586206896, 0.9344827586206896, 0.9347826086956522, 0.9347826086956522, 0.962882096069869, 0.962882096069869, 0.9696969696969697, 0.9696969696969697, 0.9767441860465116, 0.9767441860465116, 0.9807692307692307, 1.0, 1.0]}, "fixed": {"points": 162000, "x": [1.7483340336446322e-08, 0.007640029814132136, 0.007650208666977356, 0.016114323591787664, 0.016114749123049235, 0.019868547419449812, 0.01987536832004303, 0.02098661100997832, 0.021002242545181134, 0.0310513338154014, 0.031055875404092586, 0.037399889134799524, 0.037403383161604166, 0.040414867647763024, 0.040428067893640694, 0.06154379212742015, 0.061565921512636075, 0.08909706966250007, 0.08910056564465096, 0.0906975558471098, 0.0907541942230159, 0.09164740013054089, 0.09166716494047443, 0.10159939541197786, 0.10165417531112801, 0.11534761654499294, 0.1153548278838932, 0.125205123052372, 0.12520711304662088, 0.12583102367788268, 0.12584358866237272, 0.12844387703092913, 0.12845201636684966, 0.12961476051610032, 0.12965024991059826, 0.1622692312380253, 0.16227746172824345, 0.16951162249747373, 0.1695161351934701, 0.1842629258634201, 0.18429410657322876, 0.19364821733202692, 0.19368015162842608, 0.20134782687154115, 0.20135065676245512, 0.23049364202523098, 0.23049455084444112, 0.2346367646902869, 0.23464386315141766, 0.23681927402248776, 0.2368269291158736, 0.28654439595578246, 0.286545595886068, 0.2923110818716492, 0.2923235848123044, 0.30238120231877874, 0.3024100498513358, 0.3222363893836948, 0.3222410250900289, 0.37776006758915875, 0.3777666681982707, 0.3820474923333407, 0.382090480451617, 0.40816965846473763, 0.40817398506700586, 0.4138540279312506, 0.4139210083336511, 0.4372700094227901, 0.4373209746683865, 0.4412286940418767, 0.4412377835178231, 0.48390705711815074, 0.48399377537817706, 0.5076127338351537, 0.5076196142419837, 0.5094291051012118, 0.5094420027515285, 0.5096178500352839, 0.509633523488869, 0.5208248863973005, 0.5208743470272855, 0.5551772591239691, 0.5551990371993066, 0.5706132528265758, 0.5706601665854015, 0.5725997526643201, 0.5726166895217614, 0.6269523473301319, 0.6269814496491252, 0.6271236524536721, 0.6271239106390661, 0.6733240699832905, 0.6733400674225054, 0.6914170232796688, 0.6914409016008717, 0.6914523229641447, 0.6915412187847506, 0.7568332680027249, 0.7568428021137324, 0.7688628854859333, 0.7688669646491025, 0.8087977886748922, 0.8088293793899337, 0.8509056881803386, 0.850919930311858, 0.8807200403498305, 0.8807223358546322, 0.8818906476552725, 0.8818937748900283, 0.8934379613369038, 0.8934478768592907, 0.8936963697881122, 0.893707028468826, 0.9086283397232376, 0.9086354291051426, 0.910957103727982, 0.9109577390409159, 0.9229577008740889, 0.9229624603199592, 0.9278082430214105, 0.9278187568686612, 0.9290473387990914, 0.9290485873442126, 0.9372954567439641, 0.9373056355324901, 0.947085226535576, 0.9470928162595115, 0.9549602117720227, 0.9549614132745092, 0.9570619776910164, 0.9570685167217678, 0.9625012043353568, 0.9625039156509426, 0.9651822136309588, 0.9651834185860572, 0.9667513681746209, 0.9667535474639013, 0.9684062707565264, 0.9684069656642738, 0.970093965330352, 0.970106164211627, 0.9702492379410704, 0.9702519395005371, 0.972163818060994, 0.9721642901830081, 0.9782259838585043, 0.9782274029794481, 0.9818567354157313, 0.9818643528151296, 0.9855083350823707, 0.9855161656251311, 0.9877398741484656, 0.9877405964245011, 0.9891098841254188, 0.9891140979806403, 0.9920622830319005, 0.992063440138397, 0.9932919729625201, 0.9932943868975274, 0.9934598447368105, 0.9934614024781321, 0.9958125142738112, 0.9958132379532577, 0.9959791862686237, 0.9959793867703404, 0.9976901926779793, 0.9976910771115719, 0.9984118342890421, 0.9984125271405384, 0.9987166389853465, 0.9987181353401232, 0.9993434343221741, 0.9993457586756254, 0.9993897018699933, 0.9993901884509608, 0.9994055326751452, 0.9994065971393357, 0.9995950705216745, 0.9995955702754689, 0.9997145567984567, 0.9997174749830542, 0.9997490632731514, 0.9997492456413898, 0.9997604282808, 0.9997620918261534, 0.9998574316916427, 0.9998579204638796, 0.9998722166282341, 0.9998730660020823, 0.9999322522162656, 0.9999340902863177, 0.9999700352136044, 0.9999725503444884, 0.9999934338642712], "y": [0.0, 0.0, 0.0021431633090441492, 0.0021431633090441492, 0.004314994606256742, 0.004314994606256742, 0.005681818181818182, 0.005681818181818182, 0.0076103500761035, 0.0076103500761035, 0.010817307692307692, 0.010817307692307692, 0.011214953271028037, 0.011214953271028037, 0.017097264437689972, 0.017097264437689972, 0.02488608482299334, 0.02488608482299334, 0.028368794326241134, 0.028368794326241134, 0.03076923076923077, 0.03076923076923077, 0.031958762886597936, 0.031958762886597936, 0.03636363636363636, 0.03636363636363636, 0.04113110539845758, 0.04113110539845758, 0.041666666666666664, 0.041666666666666664, 0.049019607843137254, 0.049019607843137254, 0.05333333333333334, 0.05333333333333334, 0.057340382269215125, 0.057340382269215125, 0.06165703275529865, 0.06165703275529865, 0.07048092868988391, 0.07048092868988391, 0.07723577235772357, 0.07723577235772357, 0.08905380333951762, 0.08905380333951762, 0.09760348583877998, 0.09760348583877998, 0.10512129380053908, 0.10512129380053908, 0.12234042553191488, 0.12234042553191488, 0.13910904618748293, 0.13910904618748293, 0.15272727272727274, 0.15272727272727274, 0.17616033755274263, 0.17616033755274263, 0.18421052631578946, 0.18421052631578946, 0.21249999999999994, 0.21249999999999994, 0.2132701421800948, 0.2132701421800948, 0.2209944751381215, 0.2209944751381215, 0.22796352583586627, 0.22796352583586627, 0.2342857142857143, 0.2342857142857143, 0.23754789272030652, 0.23754789272030652, 0.2820670562903722, 0.2820670562903722, 0.30871491875923196, 0.30871491875923196, 0.31952662721893493, 0.31952662721893493, 0.3333333333333333, 0.3333333333333333, 0.3394683026584867, 0.3394683026584867, 0.3486299108616705, 0.3486299108616705, 0.3801916932907349, 0.3801916932907349, 0.3941368078175896, 0.3941368078175896, 0.41954123621082123, 0.41954123621082123, 0.45454545454545453, 0.45454545454545453, 0.4672353625436216, 0.4672353625436216, 0.4797608095676172, 0.4797608095676172, 0.5, 0.5, 0.53923520167627, 0.53923520167627, 0.5547169811320758, 0.5547169811320758, 0.5840336134453782, 0.5840336134453782, 0.6317602480192904, 0.6317602480192904, 0.642692239389096, 0.642692239389096, 0.6518987341772152, 0.6518987341772152, 0.6631205673758866, 0.6631205673758866, 0.6666666666666666, 0.6666666666666666, 0.69394261424017, 0.69394261424017, 0.7001862197392923, 0.7001862197392923, 0.7049016338779591, 0.7049016338779591, 0.7107501933488012, 0.7107501933488012, 0.7246835443037974, 0.7246835443037974, 0.7256598874945911, 0.7256598874945911, 0.7439065108514192, 0.7439065108514192, 0.7764842840512225, 0.7764842840512225, 0.7789115646258503, 0.7789115646258503, 0.7858963466440099, 0.7858963466440099, 0.7913385826771654, 0.7913385826771654, 0.7961165048543689, 0.7961165048543689, 0.8032786885245902, 0.8032786885245902, 0.8118393234672305, 0.8118393234672305, 0.8155339805825242, 0.8155339805825242, 0.8269005847953217, 0.8269005847953217, 0.8307149727476756, 0.8307149727476756, 0.8425196850393699, 0.8425196850393699, 0.8495934959349594, 0.8495934959349594, 0.8632629107981221, 0.8632629107981221, 0.8726953467954346, 0.8726953467954346, 0.88822913028292, 0.88822913028292, 0.8975945017182131, 0.8975945017182131, 0.8986486486486487, 0.8986486486486487, 0.9184866195016917, 0.9184866195016917, 0.9285714285714286, 0.9285714285714286, 0.93216, 0.93216, 0.9462424574876577, 0.9462424574876577, 0.9508357915437562, 0.9508357915437562, 0.9619666048237476, 0.9619666048237476, 0.9666666666666667, 0.9666666666666667, 0.9747899159663865, 0.9747899159663865, 0.9795081967213115, 0.9795081967213115, 0.9830769230769231, 0.9830769230769231, 0.985207100591716, 0.985207100591716, 0.9857142857142858, 0.9857142857142858, 0.9906687402799378, 0.9906687402799378, 0.9941860465116279, 0.9941860465116279, 0.9961538461538462, 0.9961538461538462, 0.9976851851851852, 0.9976851851851852, 1.0, 1.0]}, "random": {"points": 16200, "x": [1.702705617709983e-07, 0.01486392881674933, 0.014865098351489395, 0.02520252328947964, 0.02525810642863964, 0.04241407889026103, 0.04244333984936829, 0.06754087452179133, 0.06757953696104485, 0.11205533343683378, 0.11214708109688135, 0.11486494114512971, 0.11491713586337561, 0.1658177748059501, 0.16590076869033757, 0.16892072921861492, 0.16895670515470124, 0.1850985595009382, 0.18521572260748348, 0.187093892721438, 0.18746221845397204, 0.2370927792654925, 0.23720867328742237, 0.29223454752736233, 0.2923235848123044, 0.3154910772304463, 0.31579816310857645, 0.3250931514675609, 0.32515861221443326, 0.3303789891433202, 0.33038954420392397, 0.3330796541596303, 0.33337721025902445, 0.42020933270949007, 0.42024545606070834, 0.44232982263124887, 0.4425019067180407, 0.5147050496244641, 0.5148034189586748, 0.5553159818835172, 0.5553417961700988, 0.56358200927443, 0.5636031525899297, 0.5667599192339917, 0.5670733877952293, 0.5722657850867603, 0.5724074464829099, 0.6433346645876016, 0.6434472531079493, 0.6540085789195638, 0.6540191317970108, 0.6551242297304658, 0.655141832619804, 0.6654785602748982, 0.6654795437233963, 0.6921419286429981, 0.6922100604826484, 0.7382434874372009, 0.7382507792711808, 0.7502736686619051, 0.750283357256136, 0.7522840972322238, 0.7523398701960584, 0.776248234882893, 0.7762511475012769, 0.7884385579043673, 0.7884515435389441, 0.8342974969030247, 0.8344109981764207, 0.8521988946205478, 0.8522004231547298, 0.8544045771180578, 0.854585036336982, 0.8589146090807289, 0.8589275220835594, 0.8935318621705161, 0.8935435755419905, 0.9300910529777136, 0.9302274808674217, 0.9328941281027887, 0.9329084920103105, 0.9337153881480811, 0.933745896824762, 0.9341203623699317, 0.9341251317368469, 0.9561823935502944, 0.9562196021175401, 0.958616140618286, 0.9586174411559695, 0.9615884673294325, 0.961597300797378, 0.9692951254005925, 0.9693157520863821, 0.9760078317398998, 0.9760165361154648, 0.9763114213562313, 0.9763407077211878, 0.9804146480125058, 0.9804770787019438, 0.9887225807740085, 0.9887332441192123, 0.9917886681325808, 0.9918232374231511, 0.9922980005916557, 0.9922995718249841, 0.9942241467739695, 0.994224246635393, 0.9965138760842995, 0.9965219135196729, 0.9968343041583646, 0.996838957928801, 0.9970309191096411, 0.9970339643321807, 0.9972352158045301, 0.9972466416674032, 0.9980893514097717, 0.99809227031196, 0.9988346761577271, 0.998837191308765, 0.9995763912403405, 0.9995781370435617, 0.9996204423306626, 0.9996216497969123, 0.9999973728458371], "y": [0.0, 0.0, 0.004761904761904762, 0.004761904761904762, 0.01090909090909091, 0.01090909090909091, 0.01818181818181818, 0.01818181818181818, 0.02412280701754386, 0.02412280701754386, 0.041666666666666664, 0.041666666666666664, 0.04608294930875576, 0.04608294930875576, 0.047619047619047616, 0.047619047619047616, 0.07518796992481203, 0.07518796992481203, 0.1111111111111111, 0.1111111111111111, 0.12698412698412698, 0.12698412698412698, 0.16736401673640167, 0.16736401673640167, 0.17647058823529413, 0.17647058823529413, 0.1875, 0.1875, 0.19148936170212766, 0.19148936170212766, 0.19230769230769232, 0.19230769230769232, 0.22809457579972184, 0.22809457579972184, 0.27011494252873564, 0.27011494252873564, 0.3037974683544304, 0.3037974683544304, 0.3174061433447099, 0.3174061433447099, 0.32894736842105265, 0.32894736842105265, 0.34375, 0.34375, 0.37142857142857144, 0.37142857142857144, 0.39215686274509803, 0.39215686274509803, 0.4251968503937008, 0.4251968503937008, 0.47368421052631576, 0.47368421052631576, 0.4774774774774775, 0.4774774774774775, 0.47750865051903124, 0.47750865051903124, 0.5344000000000002, 0.5344000000000002, 0.53757225433526, 0.53757225433526, 0.5483870967741935, 0.5483870967741935, 0.5566037735849056, 0.5566037735849056, 0.563953488372093, 0.563953488372093, 0.6170520231213873, 0.6170520231213873, 0.6547231270358306, 0.6547231270358306, 0.65625, 0.65625, 0.6707317073170731, 0.6707317073170731, 0.6829268292682927, 0.6829268292682927, 0.710059171597633, 0.710059171597633, 0.7466666666666667, 0.7466666666666667, 0.75, 0.75, 0.7692307692307693, 0.7692307692307693, 0.7699115044247787, 0.7699115044247787, 0.7717391304347826, 0.7717391304347826, 0.7924528301886793, 0.7924528301886793, 0.819078947368421, 0.819078947368421, 0.8379204892966361, 0.8379204892966361, 0.8421052631578947, 0.8421052631578947, 0.851528384279476, 0.851528384279476, 0.8611570247933884, 0.8611570247933884, 0.8884892086330936, 0.8884892086330936, 0.8928571428571429, 0.8928571428571429, 0.8955223880597015, 0.8955223880597015, 0.9041095890410958, 0.9041095890410958, 0.918918918918919, 0.918918918918919, 0.925, 0.925, 0.9583333333333334, 0.9583333333333334, 0.9590909090909091, 0.9590909090909091, 0.9681274900398407, 0.9681274900398407, 0.9701897018970189, 0.9701897018970189, 0.9767441860465116, 0.9767441860465116, 1.0, 1.0]}, "sprt": {"points": 16200, "x": [4.0627509574261666e-12, 8.683675365150633e-05, 8.698260181248387e-05, 0.00025274162363545487, 0.0002530430308696578, 0.002504442152921496, 0.002506689884063225, 0.003960624382170714, 0.003971245214437532, 0.005631837357026653, 0.005640098525848615, 0.006515339146429361, 0.006536425296842196, 0.009508797448550554, 0.009530728093394614, 0.016540591399353766, 0.016740403604325143, 0.021075085636118242, 0.021124788649472412, 0.021171034770820312, 0.03366565312645257, 0.03388103547517479, 0.05987940607588907, 0.06019170856759579, 0.07324486178556007, 0.07335969986020019, 0.12250157839634439, 0.12375739524424251, 0.17921486457537814, 0.17997961329774056, 0.18503730909126373, 0.18534834095099179, 0.24693315326791299, 0.24746135833590552, 0.2951578552188382, 0.297287139874578, 0.3488487047995621, 0.34946547924085075, 0.5072574138313318, 0.5088296893076756, 0.5870830153202328, 0.5872873816626997, 0.602351576762069, 0.6023991550082053, 0.6050394388864366, 0.6050532225157222, 0.7305550647630131, 0.7307942779691813, 0.7417094595425688, 0.741863963213456, 0.8172961150904463, 0.8185052205716742, 0.8527960456452224, 0.8531674830140237, 0.9330161191284287, 0.9331741198496348, 0.9750264847780453, 0.9751584350932473, 0.976484424768829, 0.9765781551167155, 0.9914122269127184, 0.9914324965345466, 0.9975578206110033, 0.9975605830608074, 0.9988483302745854, 0.9988502102657284, 0.9995756065447668, 0.9995769528312777, 0.9995860520852542, 0.9995901392452547, 0.999851009175479, 0.9998513747929951, 0.9998722338910657, 0.999872483707924, 0.9999546382001471, 0.9999548360763691, 0.9999814658591675, 0.9999814893531023, 0.9999901332152162, 0.9999901804843242, 0.9999919907874197, 0.9999920325662275, 0.9999995319918861, 0.9999995320753892, 0.9999997771876491, 0.9999997831490548, 0.9999999926946415], "y": [0.0, 0.0, 0.00425531914893617, 0.00425531914893617, 0.00857843137254902, 0.00857843137254902, 0.012422360248447204, 0.012422360248447204, 0.0125, 0.0125, 0.018518518518518517, 0.018518518518518517, 0.039735099337748346, 0.039735099337748346, 0.04040404040404041, 0.04040404040404041, 0.0528169014084507, 0.0528169014084507, 0.06666666666666667, 0.08287292817679558, 0.08287292817679558, 0.08455882352941177, 0.08455882352941177, 0.08771929824561403, 0.08771929824561403, 0.109717868338558, 0.109717868338558, 0.11377245508982035, 0.11377245508982035, 0.14363143631436318, 0.14363143631436318, 0.16062176165803108, 0.16062176165803108, 0.17391304347826086, 0.17391304347826086, 0.2, 0.2, 0.22109533468559842, 0.22109533468559842, 0.23333333333333334, 0.23333333333333334, 0.25, 0.25, 0.29411764705882354, 0.29411764705882354, 0.2972972972972973, 0.2972972972972973, 0.30303030303030304, 0.30303030303030304, 0.35365853658536583, 0.35365853658536583, 0.41509433962264153, 0.41509433962264153, 0.6007067137809187, 0.6007067137809187, 0.6476510067114094, 0.6476510067114094, 0.6825396825396826, 0.6825396825396826, 0.7026378896882496, 0.7026378896882496, 0.7288329519450801, 0.7288329519450801, 0.813588850174216, 0.813588850174216, 0.8289855072463768, 0.8289855072463768, 0.875, 0.875, 0.8887303851640513, 0.8887303851640513, 0.8958333333333334, 0.8958333333333334, 0.9079754601226994, 0.9079754601226994, 0.9385593220338984, 0.9385593220338984, 0.959493670886076, 0.959493670886076, 0.9649122807017544, 0.9649122807017544, 0.976068376068376, 0.976068376068376, 0.9947368421052631, 0.9947368421052631, 1.0, 1.0]}}

plainproof-0.1.0/data/edm-v2-e0/study/calibration-v2.receipt.json

@@ -0,0 +1,27 @@
+{
+ "sha256": "6f97e661035e688c8f079cbf5b70c104e717939029e69ba824c257257ef2c40c",
+ "replaces": "calibration.json for SPRT only",
+ "previous_sha256": "7b3151ea834b753b85efef01a9810cf69aec9a7954f0bd9dc6dda618001f2bd7",
+ "reason": "a map is fitted on the kind of path it scores; SPRT now scores full 20-question paths",
+ "seeds": [
+  2026102540,
+  2026102541,
+  2026102542,
+  2026102543
+ ],
+ "learners_per_cell": 250,
+ "unchanged": [
+  "fixed",
+  "random",
+  "bobcat"
+ ],
+ "sprt_points": 16200,
+ "sprt_y_range": [
+  0.0,
+  1.0
+ ],
+ "sprt_x_range": [
+  4.0627509574261666e-12,
+  0.9999999926946415
+ ]
+}

plainproof-0.1.0/data/edm-v2-e0/study/calibration.json

@@ -0,0 +1 @@
+{"bobcat": {"points": 16200, "x": [-2.428029775619507, -0.8106327652931213, -0.8085384368896484, -0.685897171497345, -0.684127926826477, -0.6265246868133545, -0.6253790855407715, -0.4592517614364624, -0.45882540941238403, -0.2761606276035309, -0.27600911259651184, -0.07393736392259598, -0.07349324226379395, 0.17572836577892303, 0.17674320936203003, 0.3941620886325836, 0.3961845636367798, 0.5716667771339417, 0.5750813484191895, 0.6119649410247803, 0.6125683188438416, 0.716677725315094, 0.7396292090415955, 0.7741888761520386, 0.7784877419471741, 0.8830729722976685, 0.8874343037605286, 0.9185559153556824, 0.9190362095832825, 0.9993603825569153, 1.0236331224441528, 1.0809051990509033, 1.112189531326294, 1.2480703592300415, 1.248070478439331, 1.2483887672424316, 1.2503210306167603, 1.324808955192566, 1.325721025466919, 1.3564985990524292, 1.3674060106277466, 1.4654712677001953, 1.4719035625457764, 1.5915871858596802, 1.5921642780303955, 1.6623791456222534, 1.6969033479690552, 1.7262288331985474, 1.7264482975006104, 1.8746452331542969, 1.87465500831604, 1.9417369365692139, 1.9433324337005615, 2.0057008266448975, 2.0337908267974854, 2.1056318283081055, 2.3043129444122314], "y": [0.0, 0.0, 0.01937984496124031, 0.01937984496124031, 0.02727272727272727, 0.02727272727272727, 0.04817275747508306, 0.04817275747508306, 0.08876811594202899, 0.08876811594202899, 0.16597510373443983, 0.16597510373443983, 0.3622476813966176, 0.3622476813966176, 0.39481865284974094, 0.39481865284974094, 0.4752553024351924, 0.4752553024351924, 0.5027027027027027, 0.5027027027027027, 0.5768229166666666, 0.5768229166666666, 0.5787139689578713, 0.5787139689578713, 0.6686478454680534, 0.6686478454680534, 0.6734693877551019, 0.6734693877551019, 0.729064039408867, 0.729064039408867, 0.7322515212981744, 0.7322515212981744, 0.8095238095238095, 0.8095238095238095, 0.8571428571428571, 0.8571428571428571, 0.8686274509803922, 0.8686274509803922, 0.8909090909090909, 0.8909090909090909, 0.9001751313485113, 0.9001751313485113, 0.9329501915708812, 0.9329501915708812, 0.9344827586206896, 0.9344827586206896, 0.9347826086956522, 0.9347826086956522, 0.962882096069869, 0.962882096069869, 0.9696969696969697, 0.9696969696969697, 0.9767441860465116, 0.9767441860465116, 0.9807692307692307, 1.0, 1.0]}, "fixed": {"points": 162000, "x": [1.7483340336446322e-08, 0.007640029814132136, 0.007650208666977356, 0.016114323591787664, 0.016114749123049235, 0.019868547419449812, 0.01987536832004303, 0.02098661100997832, 0.021002242545181134, 0.0310513338154014, 0.031055875404092586, 0.037399889134799524, 0.037403383161604166, 0.040414867647763024, 0.040428067893640694, 0.06154379212742015, 0.061565921512636075, 0.08909706966250007, 0.08910056564465096, 0.0906975558471098, 0.0907541942230159, 0.09164740013054089, 0.09166716494047443, 0.10159939541197786, 0.10165417531112801, 0.11534761654499294, 0.1153548278838932, 0.125205123052372, 0.12520711304662088, 0.12583102367788268, 0.12584358866237272, 0.12844387703092913, 0.12845201636684966, 0.12961476051610032, 0.12965024991059826, 0.1622692312380253, 0.16227746172824345, 0.16951162249747373, 0.1695161351934701, 0.1842629258634201, 0.18429410657322876, 0.19364821733202692, 0.19368015162842608, 0.20134782687154115, 0.20135065676245512, 0.23049364202523098, 0.23049455084444112, 0.2346367646902869, 0.23464386315141766, 0.23681927402248776, 0.2368269291158736, 0.28654439595578246, 0.286545595886068, 0.2923110818716492, 0.2923235848123044, 0.30238120231877874, 0.3024100498513358, 0.3222363893836948, 0.3222410250900289, 0.37776006758915875, 0.3777666681982707, 0.3820474923333407, 0.382090480451617, 0.40816965846473763, 0.40817398506700586, 0.4138540279312506, 0.4139210083336511, 0.4372700094227901, 0.4373209746683865, 0.4412286940418767, 0.4412377835178231, 0.48390705711815074, 0.48399377537817706, 0.5076127338351537, 0.5076196142419837, 0.5094291051012118, 0.5094420027515285, 0.5096178500352839, 0.509633523488869, 0.5208248863973005, 0.5208743470272855, 0.5551772591239691, 0.5551990371993066, 0.5706132528265758, 0.5706601665854015, 0.5725997526643201, 0.5726166895217614, 0.6269523473301319, 0.6269814496491252, 0.6271236524536721, 0.6271239106390661, 0.6733240699832905, 0.6733400674225054, 0.6914170232796688, 0.6914409016008717, 0.6914523229641447, 0.6915412187847506, 0.7568332680027249, 0.7568428021137324, 0.7688628854859333, 0.7688669646491025, 0.8087977886748922, 0.8088293793899337, 0.8509056881803386, 0.850919930311858, 0.8807200403498305, 0.8807223358546322, 0.8818906476552725, 0.8818937748900283, 0.8934379613369038, 0.8934478768592907, 0.8936963697881122, 0.893707028468826, 0.9086283397232376, 0.9086354291051426, 0.910957103727982, 0.9109577390409159, 0.9229577008740889, 0.9229624603199592, 0.9278082430214105, 0.9278187568686612, 0.9290473387990914, 0.9290485873442126, 0.9372954567439641, 0.9373056355324901, 0.947085226535576, 0.9470928162595115, 0.9549602117720227, 0.9549614132745092, 0.9570619776910164, 0.9570685167217678, 0.9625012043353568, 0.9625039156509426, 0.9651822136309588, 0.9651834185860572, 0.9667513681746209, 0.9667535474639013, 0.9684062707565264, 0.9684069656642738, 0.970093965330352, 0.970106164211627, 0.9702492379410704, 0.9702519395005371, 0.972163818060994, 0.9721642901830081, 0.9782259838585043, 0.9782274029794481, 0.9818567354157313, 0.9818643528151296, 0.9855083350823707, 0.9855161656251311, 0.9877398741484656, 0.9877405964245011, 0.9891098841254188, 0.9891140979806403, 0.9920622830319005, 0.992063440138397, 0.9932919729625201, 0.9932943868975274, 0.9934598447368105, 0.9934614024781321, 0.9958125142738112, 0.9958132379532577, 0.9959791862686237, 0.9959793867703404, 0.9976901926779793, 0.9976910771115719, 0.9984118342890421, 0.9984125271405384, 0.9987166389853465, 0.9987181353401232, 0.9993434343221741, 0.9993457586756254, 0.9993897018699933, 0.9993901884509608, 0.9994055326751452, 0.9994065971393357, 0.9995950705216745, 0.9995955702754689, 0.9997145567984567, 0.9997174749830542, 0.9997490632731514, 0.9997492456413898, 0.9997604282808, 0.9997620918261534, 0.9998574316916427, 0.9998579204638796, 0.9998722166282341, 0.9998730660020823, 0.9999322522162656, 0.9999340902863177, 0.9999700352136044, 0.9999725503444884, 0.9999934338642712], "y": [0.0, 0.0, 0.0021431633090441492, 0.0021431633090441492, 0.004314994606256742, 0.004314994606256742, 0.005681818181818182, 0.005681818181818182, 0.0076103500761035, 0.0076103500761035, 0.010817307692307692, 0.010817307692307692, 0.011214953271028037, 0.011214953271028037, 0.017097264437689972, 0.017097264437689972, 0.02488608482299334, 0.02488608482299334, 0.028368794326241134, 0.028368794326241134, 0.03076923076923077, 0.03076923076923077, 0.031958762886597936, 0.031958762886597936, 0.03636363636363636, 0.03636363636363636, 0.04113110539845758, 0.04113110539845758, 0.041666666666666664, 0.041666666666666664, 0.049019607843137254, 0.049019607843137254, 0.05333333333333334, 0.05333333333333334, 0.057340382269215125, 0.057340382269215125, 0.06165703275529865, 0.06165703275529865, 0.07048092868988391, 0.07048092868988391, 0.07723577235772357, 0.07723577235772357, 0.08905380333951762, 0.08905380333951762, 0.09760348583877998, 0.09760348583877998, 0.10512129380053908, 0.10512129380053908, 0.12234042553191488, 0.12234042553191488, 0.13910904618748293, 0.13910904618748293, 0.15272727272727274, 0.15272727272727274, 0.17616033755274263, 0.17616033755274263, 0.18421052631578946, 0.18421052631578946, 0.21249999999999994, 0.21249999999999994, 0.2132701421800948, 0.2132701421800948, 0.2209944751381215, 0.2209944751381215, 0.22796352583586627, 0.22796352583586627, 0.2342857142857143, 0.2342857142857143, 0.23754789272030652, 0.23754789272030652, 0.2820670562903722, 0.2820670562903722, 0.30871491875923196, 0.30871491875923196, 0.31952662721893493, 0.31952662721893493, 0.3333333333333333, 0.3333333333333333, 0.3394683026584867, 0.3394683026584867, 0.3486299108616705, 0.3486299108616705, 0.3801916932907349, 0.3801916932907349, 0.3941368078175896, 0.3941368078175896, 0.41954123621082123, 0.41954123621082123, 0.45454545454545453, 0.45454545454545453, 0.4672353625436216, 0.4672353625436216, 0.4797608095676172, 0.4797608095676172, 0.5, 0.5, 0.53923520167627, 0.53923520167627, 0.5547169811320758, 0.5547169811320758, 0.5840336134453782, 0.5840336134453782, 0.6317602480192904, 0.6317602480192904, 0.642692239389096, 0.642692239389096, 0.6518987341772152, 0.6518987341772152, 0.6631205673758866, 0.6631205673758866, 0.6666666666666666, 0.6666666666666666, 0.69394261424017, 0.69394261424017, 0.7001862197392923, 0.7001862197392923, 0.7049016338779591, 0.7049016338779591, 0.7107501933488012, 0.7107501933488012, 0.7246835443037974, 0.7246835443037974, 0.7256598874945911, 0.7256598874945911, 0.7439065108514192, 0.7439065108514192, 0.7764842840512225, 0.7764842840512225, 0.7789115646258503, 0.7789115646258503, 0.7858963466440099, 0.7858963466440099, 0.7913385826771654, 0.7913385826771654, 0.7961165048543689, 0.7961165048543689, 0.8032786885245902, 0.8032786885245902, 0.8118393234672305, 0.8118393234672305, 0.8155339805825242, 0.8155339805825242, 0.8269005847953217, 0.8269005847953217, 0.8307149727476756, 0.8307149727476756, 0.8425196850393699, 0.8425196850393699, 0.8495934959349594, 0.8495934959349594, 0.8632629107981221, 0.8632629107981221, 0.8726953467954346, 0.8726953467954346, 0.88822913028292, 0.88822913028292, 0.8975945017182131, 0.8975945017182131, 0.8986486486486487, 0.8986486486486487, 0.9184866195016917, 0.9184866195016917, 0.9285714285714286, 0.9285714285714286, 0.93216, 0.93216, 0.9462424574876577, 0.9462424574876577, 0.9508357915437562, 0.9508357915437562, 0.9619666048237476, 0.9619666048237476, 0.9666666666666667, 0.9666666666666667, 0.9747899159663865, 0.9747899159663865, 0.9795081967213115, 0.9795081967213115, 0.9830769230769231, 0.9830769230769231, 0.985207100591716, 0.985207100591716, 0.9857142857142858, 0.9857142857142858, 0.9906687402799378, 0.9906687402799378, 0.9941860465116279, 0.9941860465116279, 0.9961538461538462, 0.9961538461538462, 0.9976851851851852, 0.9976851851851852, 1.0, 1.0]}, "random": {"points": 16200, "x": [1.702705617709983e-07, 0.01486392881674933, 0.014865098351489395, 0.02520252328947964, 0.02525810642863964, 0.04241407889026103, 0.04244333984936829, 0.06754087452179133, 0.06757953696104485, 0.11205533343683378, 0.11214708109688135, 0.11486494114512971, 0.11491713586337561, 0.1658177748059501, 0.16590076869033757, 0.16892072921861492, 0.16895670515470124, 0.1850985595009382, 0.18521572260748348, 0.187093892721438, 0.18746221845397204, 0.2370927792654925, 0.23720867328742237, 0.29223454752736233, 0.2923235848123044, 0.3154910772304463, 0.31579816310857645, 0.3250931514675609, 0.32515861221443326, 0.3303789891433202, 0.33038954420392397, 0.3330796541596303, 0.33337721025902445, 0.42020933270949007, 0.42024545606070834, 0.44232982263124887, 0.4425019067180407, 0.5147050496244641, 0.5148034189586748, 0.5553159818835172, 0.5553417961700988, 0.56358200927443, 0.5636031525899297, 0.5667599192339917, 0.5670733877952293, 0.5722657850867603, 0.5724074464829099, 0.6433346645876016, 0.6434472531079493, 0.6540085789195638, 0.6540191317970108, 0.6551242297304658, 0.655141832619804, 0.6654785602748982, 0.6654795437233963, 0.6921419286429981, 0.6922100604826484, 0.7382434874372009, 0.7382507792711808, 0.7502736686619051, 0.750283357256136, 0.7522840972322238, 0.7523398701960584, 0.776248234882893, 0.7762511475012769, 0.7884385579043673, 0.7884515435389441, 0.8342974969030247, 0.8344109981764207, 0.8521988946205478, 0.8522004231547298, 0.8544045771180578, 0.854585036336982, 0.8589146090807289, 0.8589275220835594, 0.8935318621705161, 0.8935435755419905, 0.9300910529777136, 0.9302274808674217, 0.9328941281027887, 0.9329084920103105, 0.9337153881480811, 0.933745896824762, 0.9341203623699317, 0.9341251317368469, 0.9561823935502944, 0.9562196021175401, 0.958616140618286, 0.9586174411559695, 0.9615884673294325, 0.961597300797378, 0.9692951254005925, 0.9693157520863821, 0.9760078317398998, 0.9760165361154648, 0.9763114213562313, 0.9763407077211878, 0.9804146480125058, 0.9804770787019438, 0.9887225807740085, 0.9887332441192123, 0.9917886681325808, 0.9918232374231511, 0.9922980005916557, 0.9922995718249841, 0.9942241467739695, 0.994224246635393, 0.9965138760842995, 0.9965219135196729, 0.9968343041583646, 0.996838957928801, 0.9970309191096411, 0.9970339643321807, 0.9972352158045301, 0.9972466416674032, 0.9980893514097717, 0.99809227031196, 0.9988346761577271, 0.998837191308765, 0.9995763912403405, 0.9995781370435617, 0.9996204423306626, 0.9996216497969123, 0.9999973728458371], "y": [0.0, 0.0, 0.004761904761904762, 0.004761904761904762, 0.01090909090909091, 0.01090909090909091, 0.01818181818181818, 0.01818181818181818, 0.02412280701754386, 0.02412280701754386, 0.041666666666666664, 0.041666666666666664, 0.04608294930875576, 0.04608294930875576, 0.047619047619047616, 0.047619047619047616, 0.07518796992481203, 0.07518796992481203, 0.1111111111111111, 0.1111111111111111, 0.12698412698412698, 0.12698412698412698, 0.16736401673640167, 0.16736401673640167, 0.17647058823529413, 0.17647058823529413, 0.1875, 0.1875, 0.19148936170212766, 0.19148936170212766, 0.19230769230769232, 0.19230769230769232, 0.22809457579972184, 0.22809457579972184, 0.27011494252873564, 0.27011494252873564, 0.3037974683544304, 0.3037974683544304, 0.3174061433447099, 0.3174061433447099, 0.32894736842105265, 0.32894736842105265, 0.34375, 0.34375, 0.37142857142857144, 0.37142857142857144, 0.39215686274509803, 0.39215686274509803, 0.4251968503937008, 0.4251968503937008, 0.47368421052631576, 0.47368421052631576, 0.4774774774774775, 0.4774774774774775, 0.47750865051903124, 0.47750865051903124, 0.5344000000000002, 0.5344000000000002, 0.53757225433526, 0.53757225433526, 0.5483870967741935, 0.5483870967741935, 0.5566037735849056, 0.5566037735849056, 0.563953488372093, 0.563953488372093, 0.6170520231213873, 0.6170520231213873, 0.6547231270358306, 0.6547231270358306, 0.65625, 0.65625, 0.6707317073170731, 0.6707317073170731, 0.6829268292682927, 0.6829268292682927, 0.710059171597633, 0.710059171597633, 0.7466666666666667, 0.7466666666666667, 0.75, 0.75, 0.7692307692307693, 0.7692307692307693, 0.7699115044247787, 0.7699115044247787, 0.7717391304347826, 0.7717391304347826, 0.7924528301886793, 0.7924528301886793, 0.819078947368421, 0.819078947368421, 0.8379204892966361, 0.8379204892966361, 0.8421052631578947, 0.8421052631578947, 0.851528384279476, 0.851528384279476, 0.8611570247933884, 0.8611570247933884, 0.8884892086330936, 0.8884892086330936, 0.8928571428571429, 0.8928571428571429, 0.8955223880597015, 0.8955223880597015, 0.9041095890410958, 0.9041095890410958, 0.918918918918919, 0.918918918918919, 0.925, 0.925, 0.9583333333333334, 0.9583333333333334, 0.9590909090909091, 0.9590909090909091, 0.9681274900398407, 0.9681274900398407, 0.9701897018970189, 0.9701897018970189, 0.9767441860465116, 0.9767441860465116, 1.0, 1.0]}, "sprt": {"points": 3880, "x": [0.008737596357758736, 0.019141571630515653, 0.019635163976515217, 0.025241100224432867, 0.025282384631871845, 0.10180285614301421, 0.10243187770804031, 0.17734990999544353, 0.17997961329774056, 0.2444549493009361, 0.24746135833590552, 0.3445237832471313, 0.3449183604059117, 0.49640684609087365, 0.49832455659750535, 0.5223479125069047, 0.5262519532139953, 0.602351576762069, 0.6023991550082053, 0.6050394388864366, 0.6050532225157222, 0.7300398383837263, 0.7307942779691813, 0.7417094595425688, 0.741863963213456, 0.8172961150904463, 0.8185052205716742, 0.8432194603884325, 0.8432350299060837, 0.8493416398157931, 0.8531674830140237, 0.9326017109035719, 0.9331741198496348, 0.9753972069694583, 0.9765781551167155, 0.981778742950285], "y": [0.0, 0.0, 0.02857142857142857, 0.02857142857142857, 0.0859375, 0.0859375, 0.12631578947368421, 0.12631578947368421, 0.1388888888888889, 0.1388888888888889, 0.2018348623853211, 0.2018348623853211, 0.2371967654986523, 0.2371967654986523, 0.2571428571428571, 0.2571428571428571, 0.288135593220339, 0.288135593220339, 0.3103448275862069, 0.3103448275862069, 0.34, 0.34, 0.34782608695652173, 0.34782608695652173, 0.40804597701149425, 0.40804597701149425, 0.4444444444444444, 0.4444444444444444, 0.5, 0.5, 0.6796875000000002, 0.6796875000000002, 0.7335423197492164, 0.7335423197492164, 0.8778409090909091, 0.8778409090909091]}}

plainproof-0.1.0/data/edm-v2-e0/study/calibration.receipt.json

@@ -0,0 +1,22 @@
+{
+ "sha256": "7b3151ea834b753b85efef01a9810cf69aec9a7954f0bd9dc6dda618001f2bd7",
+ "method": "isotonic, pooled over the 4 confirmatory cells and all steps",
+ "learners_per_cell": 250,
+ "seeds": [
+  2026102540,
+  2026102541,
+  2026102542,
+  2026102543
+ ],
+ "same_learners_for_every_method": true,
+ "sprt": {
+  "delta": 0.7,
+  "max": 20
+ },
+ "points": {
+  "sprt": 3880,
+  "fixed": 162000,
+  "random": 16200,
+  "bobcat": 16200
+ }
+}