medsci-skills 5.15.0 → 5.17.0

package/README.md

@@ -2,14 +2,14 @@
 
 # MedSci Skills
 
-**53 skills that actually work.** Built by a physician-researcher, tested on real publications.
+**55 skills that actually work.** Built by a physician-researcher, tested on real publications.
 
 *MedSci Skills is an end-to-end research tool for physician and medical-engineering researchers — design → scaffold → validate → publish — for the clinical manuscript and the medical-AI model behind it. Its moat is the compliance layer — 44 reporting guidelines and risk-of-bias tools, reference/citation verification, and deterministic integrity gates before peer review — now extended by a model-engineering lane that scaffolds reproducible, leakage-safe training repos and audits model validation. Clinical AI model research engineering is in scope; a general AI-scientist platform is not. It competes on clinical submission reliability, not skill count.*
 
 [![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](LICENSE)
 [![Release](https://img.shields.io/github/v/release/Aperivue/medsci-skills?style=flat-square&color=blue)](https://github.com/Aperivue/medsci-skills/releases/latest)
 [![CI](https://img.shields.io/github/actions/workflow/status/Aperivue/medsci-skills/validate.yml?branch=main&style=flat-square&label=CI)](https://github.com/Aperivue/medsci-skills/actions/workflows/validate.yml)
-![Skills](https://img.shields.io/badge/Skills-53-brightgreen?style=flat-square)
+![Skills](https://img.shields.io/badge/Skills-55-brightgreen?style=flat-square)
 [![npm](https://img.shields.io/npm/v/medsci-skills?style=flat-square&label=npm&color=cb3837)](https://www.npmjs.com/package/medsci-skills)
 [![Watch the 2-min intro](https://img.shields.io/badge/▶_Watch-2--min_intro-FF0000?style=flat-square&logo=youtube&logoColor=white)](https://youtu.be/MclQ_RIofpE)
 [![good first issues](https://img.shields.io/github/issues/Aperivue/medsci-skills/good%20first%20issue?style=flat-square&label=good%20first%20issues&color=7057ff)](https://github.com/Aperivue/medsci-skills/contribute)
@@ -285,6 +285,10 @@ The E2E pipeline (`orchestrate --e2e`) produces everything up to `qc/`. The `sub
 
 ## What's New
 
+**v5.17** — model-engineering produce-side depth, **completion**. Deployment safety + the final roadmap/candidate items: a new **`uncertainty-imaging`** skill + `check_uncertainty_reporting` gate (calibrated per-case uncertainty / OOD guard on a held-out set / abstention at a pre-specified target / calibration-under-shift — for a deployment-framed model), an **MLOps wiring reference** for `model-scaffold` (experiment tracking, config/data/environment versioning, CI-for-ML — pointing to W&B / MLflow / nnU-Net, reimplementing nothing), and an **`architecture-zoo` graph-neural-net family card** (GCN / GraphSAGE / GAT / GIN / BrainGNN for brain connectomes) that closes the last candidate gap. The six-item produce-side depth roadmap and its candidate list are now complete. Additive and backward-compatible; **55 skills / 44 guidelines / 50 integrity detectors / 22 domain-probe modules**. (See the [CHANGELOG](CHANGELOG.md) for v5.0–v5.16.)
+
+**v5.16** — model-engineering produce-side depth, clinical fine-tuning focus (Items 3–4 of the [produce-side depth roadmap](docs/roadmap_model_engineering_depth.md)). A new **`radiomics-ml`** skill + `check_radiomics_ml` gate for the most common solo-doable clinical-ML workflow — radiomics / tabular features → any classical learner (LASSO / SVM / random forest / XGBoost / …) → a clinical outcome, no GPU — with a learner-agnostic nested-CV / calibration / stability gate; plus a **`model-scaffold` fine-tuning mode** (`--task finetune` + `--from-pretrained`) that adapts a pretrained backbone on collected clinical data with a frozen→unfrozen schedule, discriminative learning rates, and a pretrained-weight provenance record (`PRETRAINED.md` + a `PRETRAINED_PROVENANCE_MISSING` verdict on the existing `check_training_hygiene`, plus a MedSAM-adaptation + train-only diffusion-augmentation guide). Additive and backward-compatible; **54 skills / 44 guidelines / 49 integrity detectors / 22 domain-probe modules**. (See the [CHANGELOG](CHANGELOG.md) for v5.0–v5.15.)
+
 **v5.15** — model-engineering produce-side depth. Two new skills that *produce* what the review lane previously only audited: **`preprocess-imaging`** (DICOM/NIfTI data prep + a `check_preprocessing_leakage` gate that extends the split-leakage moat upstream to the data stage) and **`explainability`** (Grad-CAM / saliency held to the reviewer bar — Adebayo sanity checks, quantitative localisation vs ground truth, attribution-not-validation framing, via `check_explainability_report`). Plus a by-stage skill index, multi-host README/About (Claude Code · Codex · Cursor · Copilot), copy-paste citation ergonomics, and a real-project precision fix. Additive and backward-compatible; **53 skills / 44 guidelines / 48 integrity detectors / 22 domain-probe modules**. (See the [CHANGELOG](CHANGELOG.md) for v5.0–v5.14.)
 
 **v4.10** — reviewer-coverage expansion reverse-engineered from high-IF, CC-BY papers (learn-only under the `reverse_engineer/` license firewall), plus a clinician-friendly update path. Additive and backward-compatible; 45 skills / **44 guidelines** / 36 detectors / **15 domain-probe modules** (was 12):
@@ -402,6 +406,8 @@ MedSci Skills is **opinionated and narrow on purpose**: a single physician-resea
 
 📖 **Per-skill reference:** [`docs/skills/`](docs/skills/) — one page per skill (what it does, when it activates, its Quality Card — purpose, safety boundaries, known limitations, validation, evidence — and bundled resources), generated from each `SKILL.md` + `skill.yml`. See [`docs/skills/AUDIT.md`](docs/skills/AUDIT.md) for how the skills are validated.
 
+🧠 **ML / DL method coverage:** [`docs/method_coverage_map.md`](docs/method_coverage_map.md) — which machine-learning and deep-learning method families (CNN / transformer / segmentation / detection / foundation / diffusion / SSL for imaging; the full classical family — penalised regression, SVM, k-NN, trees, boosting [XGBoost / LightGBM / CatBoost], MLP, ensembles, clustering — for radiomics/tabular; LLM/MLLM) map to which skills for selection, production, validation, interpretation, and reporting.
+
 ```
                               ┌─────────────────────────────────┐
                               │  orchestrate: single entry point │
@@ -451,14 +457,14 @@ ma-scout -> search-lit -> fulltext-retrieval -> design-study ──> write-proto
 
 ### By research stage
 
-All 53 skills, grouped by where they fit in the clinical-manuscript and medical-AI lifecycle. Full descriptions are in the table below; one page per skill lives in the [per-skill reference](docs/skills/).
+All 55 skills, grouped by where they fit in the clinical-manuscript and medical-AI lifecycle. Full descriptions are in the table below; one page per skill lives in the [per-skill reference](docs/skills/).
 
 | Stage | Skills |
 |-------|--------|
 | 🔭 **Discover & scope** | `ma-scout` · `find-cohort-gap` · `search-lit` · `fulltext-retrieval` · `lit-sync` · `author-strategy` |
 | 📐 **Design & plan** | `design-study` · `calc-sample-size` · `define-variables` · `write-protocol` · `fill-protocol` · `design-ai-benchmarking` |
 | 🧹 **Data & analysis** | `deidentify` · `clean-data` · `generate-codebook` · `version-dataset` · `analyze-stats` · `batch-cohort` · `cross-national` · `replicate-study` |
-| 🤖 **Medical-AI model engineering** | `preprocess-imaging` · `architecture-zoo` · `model-scaffold` · `model-validation` · `model-evaluation` · `explainability` · `model-card` · `mllm-eval` |
+| 🤖 **Medical-AI model engineering** | `preprocess-imaging` · `architecture-zoo` · `model-scaffold` · `model-validation` · `model-evaluation` · `uncertainty-imaging` · `explainability` · `radiomics-ml` · `model-card` · `mllm-eval` |
 | ✍️ **Write & visualize** | `write-paper` · `make-figures` · `review-paper` · `present-paper` · `humanize` · `polish-language` · `academic-aio` |
 | ✅ **Comply & verify** | `check-reporting` · `self-review` · `verify-refs` · `manage-refs` |
 | 📤 **Submit & respond** | `find-journal` · `add-journal` · `sync-submission` · `revise` · `peer-review` · `fill-icmje-coi` |
@@ -481,11 +487,13 @@ All 53 skills, grouped by where they fit in the clinical-manuscript and medical-
 | **design-ai-benchmarking** | Design and validity review for benchmarking AI system(s) against a human-expert panel: evaluation-question and arm definition, decoupled multi-dimensional rubrics with anchors, planted calibration probes (positive-control / known-bad / instability / mechanism-contradiction), reviewer-panel construction with per-reviewer randomization, inter-rater reliability targets with separate control-item reliability, LLM-as-judge vs human-as-judge adjudication, construct-independence guards, and a structured JSON rating-export schema. Locks the rubric before data collection. |
 | **model-validation** | Design or audit the clinical-validation study for an engineer-built medical-imaging model (segmentation / classification / detection): patient-level split disjointness and the data-leakage taxonomy, tuning-on-test, internal vs genuine external validation, comparator design, single-run vs multi-seed variance, task-correct metric selection (Metrics Reloaded), test-set sizing, and CLAIM 2024 / TRIPOD+AI / STARD-AI reporting fit. Ships a deterministic split-leakage gate that proves patient disjointness by set arithmetic on the emitted split table. Integrates with MONAI / nnU-Net — does not replace them. |
 | **preprocess-imaging** | Design or audit the data-preparation stage of a medical-imaging model — DICOM/NIfTI intake, resampling, intensity normalization, and the augmentation plan — so the pipeline is leakage-safe before `model-scaffold` builds the training repo. Emits a declarative preprocessing manifest and a deterministic data-stage leakage gate (`check_preprocessing_leakage`) that catches what the split table cannot see: a dataset-level normaliser fit on non-train data (`NORMALIZATION_LEAKAGE`), a data-fitted transform run before the split (`PREPROCESS_BEFORE_SPLIT`), and a patient's slices crossing splits (`PATIENT_CROSS_SPLIT`). Integrates MONAI / TorchIO transforms; never reimplements them or touches real patient data. |
-| **model-scaffold** | Generate a reproducible, runnable PyTorch training repo for a medical-imaging task — segmentation (U-Net), classification, detection, image-to-image synthesis, or self-supervised pretraining — the missing middle link between choosing an architecture and validating a trained model. Emits a patient-level seed-locked split as an auditable artifact, a task-appropriate model, train/evaluate scripts that seed every RNG and infer under eval mode, a config, requirements, a reproducibility record, and a Methods stub with VERIFY placeholders (no fabricated numbers). Reproducibility holds by construction; ships a `check_training_hygiene` AST gate + a network-free build→validate challenge. Emits a minimal runnable default model for a forward-pass smoke test, and integrates with MONAI / nnU-Net / TorchIO / timm / torchvision for production-grade models. |
+| **model-scaffold** | Generate a reproducible, runnable PyTorch training repo for a medical-imaging task — segmentation (U-Net), classification, detection, image-to-image synthesis, self-supervised pretraining, or fine-tuning a pretrained backbone (transfer learning) — the missing middle link between choosing an architecture and validating a trained model. Emits a patient-level seed-locked split as an auditable artifact, a task-appropriate model, train/evaluate scripts that seed every RNG and infer under eval mode, a config, requirements, a reproducibility record, and a Methods stub with VERIFY placeholders (no fabricated numbers). Fine-tuning mode (`--task finetune`) adds a frozen→unfrozen schedule, discriminative learning rates, and a pretrained-weight provenance record (`PRETRAINED.md`), with a MedSAM-adaptation + train-only diffusion-augmentation guide. Reproducibility holds by construction; ships a `check_training_hygiene` AST gate (RNG seeding, eval-mode inference, train-split-only loaders, pretrained-provenance) + a network-free build→validate challenge. Integrates with MONAI / nnU-Net / TorchIO / timm / torchvision for production-grade models. |
 | **architecture-zoo** | "Which architecture for which research question" decision tool: maps task (classification / segmentation / detection / transfer), modality, data scale, and class imbalance to a paper-grounded architecture shortlist. Curates the foundational curriculum (ResNet / DenseNet / EfficientNet / ViT / Swin; U-Net / 3-D U-Net / Attention & Residual U-Net / nnU-Net / Mask R-CNN; SAM/MedSAM / TotalSegmentator / BiomedCLIP / DINO / MAE / SimCLR) — each with core idea, when-to-use, medical-imaging use, reference implementation, validation setup, and the matching model-scaffold template. Advisory; teaches archetypes, not a live SOTA leaderboard. |
 | **model-card** | Generate the documentation an engineer-built medical-imaging model must carry — a Model Card (Mitchell et al. 2019), a Datasheet for its dataset (Gebru et al. 2021), and a METRIC-informed data-quality pass — filled from user-supplied facts (never fabricated), then verify every required section is present and non-empty with a deterministic completeness gate (`check_model_card_complete`). Model Card / Datasheet are documentation standards vendored as templates, not counted reporting checklists. |
 | **model-evaluation** | Compute and report task-correct held-out metrics for a trained medical-imaging model — segmentation (Dice + a boundary metric HD95/NSD, per structure), classification (AUROC + AUPRC + sensitivity/specificity with bootstrap CIs at the deployment prevalence), or detection (FROC/mAP with a stated IoU criterion) — plus calibration and subgroup slices. Emits a per-case table for analyze-stats and gates the metric choice against Metrics Reloaded / CLAIM 2024 (`check_metric_reporting`). Numbers come only from executed code. |
 | **explainability** | Produce or audit the interpretability/explainability analysis of a medical-imaging model — Grad-CAM / Grad-CAM++ / attention-rollout / saliency / integrated-gradients — so it clears the rigor bar: mandatory Adebayo sanity checks (model- and data-randomisation), a quantitative localisation metric against ground truth (IoU / pointing game / Dice) instead of eyeballed examples, a cohort-level result, and attribution framing rather than "proof the model is correct". Emits an explainability-report manifest + a deterministic gate (`check_explainability_report`): `SALIENCY_AS_VALIDATION`, `NO_SANITY_CHECK`, `NO_LOCALIZATION_METRIC` (Major); `INSUFFICIENT_SANITY`, `CHERRY_PICKED_EXAMPLES`, `MISSING_METHOD` (Minor). Integrates captum / pytorch-grad-cam; never reimplements them or touches real patient data. |
+| **radiomics-ml** | Produce or audit a radiomics / tabular clinical-ML study — features → random forest / XGBoost / regularised logistic → clinical outcome — the most common solo-doable clinical-ML workflow (no GPU, no engineer). Emits a pipeline manifest + a deterministic rigor gate (`check_radiomics_ml`): `NO_NESTED_CV`, `HIGH_DIM_LOW_EVENTS`, `SELECTION_OUTSIDE_CV` (Major); `NO_FEATURE_STABILITY`, `NO_CALIBRATION`, `NO_EXTERNAL_VALIDATION` (Minor). pyradiomics/IBSI settings, nested CV with in-fold selection, ICC stability, SHAP, calibration + decision curve, CLEAR/TRIPOD+AI/PROBAST-AI reporting. Integrates scikit-learn / xgboost / pyradiomics; never reimplements them. |
+| **uncertainty-imaging** | Design or audit the uncertainty / out-of-distribution / selective-prediction layer of a deployment-framed medical-imaging model — so a clinical-use claim carries calibrated per-case uncertainty (MC-dropout / deep ensemble / conformal / Bayesian), an OOD guard validated on a held-out OOD set, an abstention rule at a pre-specified operating point, and calibration checked under distribution shift. Emits an uncertainty manifest + a deterministic gate (`check_uncertainty_reporting`): `POINT_PREDICTION_NO_UNCERTAINTY`, `CONFORMAL_NO_COVERAGE_VALIDATION`, `OOD_NO_HELDOUT_SET` (Major); `ENSEMBLE_NOT_INDEPENDENT`, `MCDROPOUT_DISABLED_AT_INFERENCE`, `SELECTIVE_NO_TARGET`, `NO_CALIBRATION_UNDER_SHIFT` (Minor). Integrates MAPIE / captum / OOD scorers; never reimplements them or touches real patient data. |
 | **mllm-eval** | Model-agnostic evaluation harness (closed API or open weights) for an LLM/MLLM on a clinical task — radiology report generation, VQA, clinical text extraction — covering the adjudicated reference standard, clinical-efficacy metrics (RadGraph-F1 / CheXbert-F1 beyond BLEU/ROUGE), faithfulness/hallucination, pretraining-contamination, prompt sensitivity, and a reader study; gates the plan with `check_mllm_eval_completeness` and routes the reviewer audit to the MLLM probe. |
 | **intake-project** | Classifies new research projects, summarizes current state, identifies missing inputs, and recommends next steps. |
 | **grant-builder** | Structures grant proposals: significance, innovation, approach, milestones, and consortium roles. |

package/metadata/distribution_files.json

@@ -423,8 +423,8 @@
     },
     {
       "path": "skills/architecture-zoo/SKILL.md",
-      "size": 5712,
-      "sha256": "ffb9a52d417f309a3b22c8d0f74e6700b67350c0d7a2a2e2c785f0cb4cb066bc"
+      "size": 6094,
+      "sha256": "abb4656f36e0ef068508269ce2ec87c832b7c8fb13c4cbc44af27b2dc8058bff"
     },
     {
       "path": "skills/architecture-zoo/references/classification.md",
@@ -441,10 +441,15 @@
       "size": 5267,
       "sha256": "495453b025f1cb13d5ba0bac9be6d3b0d63dd958ea48d2b9e55bc222e9c26786"
     },
+    {
+      "path": "skills/architecture-zoo/references/graph.md",
+      "size": 6913,
+      "sha256": "d6bea2d61a2f1d515810d1bf96bef80f156d816998134a3c911e6c4585728c2e"
+    },
     {
       "path": "skills/architecture-zoo/references/index.md",
-      "size": 4024,
-      "sha256": "d2360eb8635347f0f22be0b0e337a540db865aafdc12678455cf32bc49fd9d3d"
+      "size": 4334,
+      "sha256": "f812ec9afe2ba06c42da8de851cea08632d61eb98e87cd3edd7cdd17f39e226e"
     },
     {
       "path": "skills/architecture-zoo/references/segmentation.md",
@@ -458,8 +463,8 @@
     },
     {
       "path": "skills/architecture-zoo/skill.yml",
-      "size": 2836,
-      "sha256": "7d7c727a9fc75383e775feac14faf1c4caad90307ed8ca20859ef499ac17deb0"
+      "size": 2851,
+      "sha256": "c9e03a47973bab737587d22ebac4cd7b27b5c5af55a271efb8f71abba7fa70cf"
     },
     {
       "path": "skills/author-strategy/SKILL.md",
@@ -2868,23 +2873,33 @@
     },
     {
       "path": "skills/model-scaffold/SKILL.md",
-      "size": 7686,
-      "sha256": "cede2020d3ceee0e1599cbcfb412230ab9c04b08032c8bbaff620e4129ec6785"
+      "size": 9527,
+      "sha256": "8fcf4060f064a1924d4bec278e0c0c628c99caf6ea75f617f8b9748cbb207ed8"
+    },
+    {
+      "path": "skills/model-scaffold/references/finetuning_guide.md",
+      "size": 6208,
+      "sha256": "b7817d53eeeb506b573beaae1889fa863dd81286d474ab99b46b38ad046b32e7"
+    },
+    {
+      "path": "skills/model-scaffold/references/mlops_guide.md",
+      "size": 5171,
+      "sha256": "cc9b62ed588daf97b40b6d7a8e27f9b6de96b9f5752ad2baa8e180e01d3d4973"
     },
     {
       "path": "skills/model-scaffold/references/training_guide.md",
-      "size": 2661,
-      "sha256": "4a3197a89b8d3473071051f67a7bcf40f71ecf007e942f81e9c40dc48fce1a9c"
+      "size": 2840,
+      "sha256": "9a7f7b5dda65e71d8007cb6539cda0cfb9c6b1f2c877aedee4646f368686e96f"
     },
     {
       "path": "skills/model-scaffold/scripts/check_training_hygiene.py",
-      "size": 11752,
-      "sha256": "66970049c85e46a0080b5f19eb3b5ac9dfd656a674b6f1698825e968eedd4814"
+      "size": 14095,
+      "sha256": "57542a54dac607e89e7f13e5025bd2ce6b32e629064a18cbb0f0c15fdfc6181c"
     },
     {
       "path": "skills/model-scaffold/scripts/scaffold.py",
-      "size": 40470,
-      "sha256": "33569806ecd230aebb9d35c77a27b8480d23329b00f633d7fee9531a7bcec974"
+      "size": 51482,
+      "sha256": "150abbc4864a92913b202893962c29cda8ec6ce1918f35558aa5b02514b6a0cb"
     },
     {
       "path": "skills/model-scaffold/scripts/scaffold_challenge/expected/split_assignment.csv",
@@ -2898,18 +2913,18 @@
     },
     {
       "path": "skills/model-scaffold/scripts/scaffold_challenge/problem.md",
-      "size": 2678,
-      "sha256": "369e98da65cbd16c67f5ff3f17d99b707d713bbf3239409f9921190c85f8f08a"
+      "size": 3226,
+      "sha256": "950af6c956f73b491b2bee102d884765aaeb783b5842eb428ac2ad81b49f67e8"
     },
     {
       "path": "skills/model-scaffold/scripts/scaffold_challenge/verify.sh",
-      "size": 5136,
-      "sha256": "040acee712943e8392b70b40b790438bec056a3a4e7a282f76455d2a2b791447"
+      "size": 6396,
+      "sha256": "77d81387647abf00de4b03f91a7c7bf9bef38d9679b148762c906eaccfee9f73"
     },
     {
       "path": "skills/model-scaffold/skill.yml",
-      "size": 3195,
-      "sha256": "06c4ed02872bfc38abd1c753c02a640a2bfaa1141fbfdd9f8b9ccbe18a148d82"
+      "size": 3772,
+      "sha256": "aaae59edb50c50b01be2aaca3c94b63ce76af067ff25750248517c5ce91ccf41"
     },
     {
       "path": "skills/model-validation/SKILL.md",
@@ -3411,6 +3426,56 @@
       "size": 1372,
       "sha256": "81caa10775246f2db3f5e08948292f63076d44ffc039d8eec764f1d46aab275f"
     },
+    {
+      "path": "skills/radiomics-ml/SKILL.md",
+      "size": 8273,
+      "sha256": "cc65bfd50db2b6e9b6681e1c9649b306490cd5dd74192bfdf5316362b71f141b"
+    },
+    {
+      "path": "skills/radiomics-ml/references/radiomics_ml_guide.md",
+      "size": 6707,
+      "sha256": "29bf2b2b847c488ddb33e50cd21ea0e2cd4937a1a62ab2655f31227a0e42215a"
+    },
+    {
+      "path": "skills/radiomics-ml/scripts/check_radiomics_ml.py",
+      "size": 10179,
+      "sha256": "b1cfbd9991aa8871d5aabc528c9aa22eecf8e46cb5983872bca2359229223840"
+    },
+    {
+      "path": "skills/radiomics-ml/scripts/check_radiomics_ml_challenge/expected/strong.txt",
+      "size": 369,
+      "sha256": "c73c776e6558d9a78dacd3c63ae1cc3dee183d9e1a2f27d99b1e0db70f44997e"
+    },
+    {
+      "path": "skills/radiomics-ml/scripts/check_radiomics_ml_challenge/expected/weak.txt",
+      "size": 1408,
+      "sha256": "3bb90f31587e94f3f2b267874a9ac58cce5adf3436254bc206092e0acfb86cd7"
+    },
+    {
+      "path": "skills/radiomics-ml/scripts/check_radiomics_ml_challenge/fixture/pipeline_strong.json",
+      "size": 322,
+      "sha256": "83d128fe0b728ef52a1fd98ef5b5bd478c3e48455cdb07d8040f9d130df81cee"
+    },
+    {
+      "path": "skills/radiomics-ml/scripts/check_radiomics_ml_challenge/fixture/pipeline_weak.json",
+      "size": 313,
+      "sha256": "2fa1a3f98f952faf2e6e1faf1bdbf4675a44dc88679dcfaf18a4f32eb47ba9e7"
+    },
+    {
+      "path": "skills/radiomics-ml/scripts/check_radiomics_ml_challenge/problem.md",
+      "size": 894,
+      "sha256": "9a6abad4e12f9b4e9290eb305fb9ad04127fa1cde03961a38ac4ccb5431a2100"
+    },
+    {
+      "path": "skills/radiomics-ml/scripts/check_radiomics_ml_challenge/verify.sh",
+      "size": 1988,
+      "sha256": "b9e55aaf9b29f3e810b837fc373c7a212dc5f778a49bac11854bdb50ed84a184"
+    },
+    {
+      "path": "skills/radiomics-ml/skill.yml",
+      "size": 3790,
+      "sha256": "9b99b87add656873d3f7277ce12490ffea36d919e9538bc4f4fbe1ebbfedc18e"
+    },
     {
       "path": "skills/render-pdf-doc/SKILL.md",
       "size": 7490,
@@ -3976,6 +4041,56 @@
       "size": 1911,
       "sha256": "7f549269905cad97493d7699dad0068e410e8a8d771814988911bec5b0648d4c"
     },
+    {
+      "path": "skills/uncertainty-imaging/SKILL.md",
+      "size": 8224,
+      "sha256": "0ff26311b9b372a074751d9b64c5fc20ec7440aabe76fd17c3f2e09d54d4a080"
+    },
+    {
+      "path": "skills/uncertainty-imaging/references/uncertainty_guide.md",
+      "size": 5574,
+      "sha256": "fb63c7b48b00fc371dca2ed1a7bdb9932b318ceba6334bae5097f4da3b08b38a"
+    },
+    {
+      "path": "skills/uncertainty-imaging/scripts/check_uncertainty_reporting.py",
+      "size": 13042,
+      "sha256": "2f14f78da71254d82977c8edc9f8c32bcde2e6d6d8e9c971af8114219ce558b5"
+    },
+    {
+      "path": "skills/uncertainty-imaging/scripts/check_uncertainty_reporting_challenge/expected/strong.txt",
+      "size": 414,
+      "sha256": "2d3f1cbeb88b00d1ef8968c276f17d276c152eafbf445d3879315bd727a16c61"
+    },
+    {
+      "path": "skills/uncertainty-imaging/scripts/check_uncertainty_reporting_challenge/expected/weak.txt",
+      "size": 1077,
+      "sha256": "b37379da88b17881678d50534ad993823a9a7c3b96a9942ca45be21caed39aaf"
+    },
+    {
+      "path": "skills/uncertainty-imaging/scripts/check_uncertainty_reporting_challenge/fixture/uncertainty_strong.json",
+      "size": 323,
+      "sha256": "39a64a9e327bf00151d3bb7e1394e7ba87c04ed0df6523256f22d55c127320bf"
+    },
+    {
+      "path": "skills/uncertainty-imaging/scripts/check_uncertainty_reporting_challenge/fixture/uncertainty_weak.json",
+      "size": 204,
+      "sha256": "5748d22600c8f68485f3ab665c32eace4a4dfc827df7f98c1c09640d82f304c2"
+    },
+    {
+      "path": "skills/uncertainty-imaging/scripts/check_uncertainty_reporting_challenge/problem.md",
+      "size": 2460,
+      "sha256": "fb3350f915b3b4a36a91718f93837f4331410d209f66fbd7e7d751fd35af4cc9"
+    },
+    {
+      "path": "skills/uncertainty-imaging/scripts/check_uncertainty_reporting_challenge/verify.sh",
+      "size": 2117,
+      "sha256": "5ff542ed3c4b0a479a6c2f906cefbb75494cb1ca8118e121afaf45f07f31bb80"
+    },
+    {
+      "path": "skills/uncertainty-imaging/skill.yml",
+      "size": 3753,
+      "sha256": "a229c56e3133db1ed616880f76903bbf825ee59591eb26534d4ddb172cf0945c"
+    },
     {
       "path": "skills/verify-refs/SKILL.md",
       "size": 11846,

package/metadata/distribution_manifest.json

@@ -1,6 +1,6 @@
 {
   "schema_version": 1,
-  "version": "5.15.0",
+  "version": "5.17.0",
   "owned_skills": [
     "academic-aio",
     "add-journal",
@@ -43,6 +43,7 @@
     "preprocess-imaging",
     "present-paper",
     "publish-skill",
+    "radiomics-ml",
     "render-pdf-doc",
     "replicate-study",
     "review-paper",
@@ -51,6 +52,7 @@
     "self-review",
     "setup-medsci",
     "sync-submission",
+    "uncertainty-imaging",
     "verify-refs",
     "version-dataset",
     "write-paper",

package/metadata/skills_catalog.json

@@ -1,6 +1,6 @@
 {
   "_comment": "AUTO-GENERATED by scripts/gen_skills_catalog_json.py from each skills/<slug>/SKILL.md + skill.yml. Machine-readable skill catalog (single source of truth) consumed by external surfaces such as the aperivue.com storefront to gate skill-list completeness. Do not hand-edit; CI gate: python3 scripts/gen_skills_catalog_json.py --check.",
-  "skill_count": 53,
+  "skill_count": 55,
   "categories": [
     {
       "key": "literature_references",
@@ -38,7 +38,9 @@
         "model-evaluation",
         "model-scaffold",
         "model-validation",
-        "preprocess-imaging"
+        "preprocess-imaging",
+        "radiomics-ml",
+        "uncertainty-imaging"
       ]
     },
     {
@@ -415,7 +417,7 @@
       "layer": "B",
       "owner_domain": "model_development",
       "maturity": "official",
-      "description": "Generate a reproducible, runnable PyTorch training repo for a medical-imaging task — segmentation, classification, detection, image-to-image synthesis, or self-supervised pretraining — the missing mid…"
+      "description": "Generate a reproducible, runnable PyTorch training repo for a medical-imaging task — segmentation, classification, detection, image-to-image synthesis, self-supervised pretraining, or fine-tuning a pr…"
     },
     {
       "slug": "model-validation",
@@ -480,6 +482,15 @@
       "maturity": "official",
       "description": "Convert a personal agent skill into a distributable, open-source-ready skill."
     },
+    {
+      "slug": "radiomics-ml",
+      "category": "model_engineering",
+      "category_label": "Model Engineering & Validation",
+      "layer": "D",
+      "owner_domain": "model_validation",
+      "maturity": "official",
+      "description": "Produce or audit a radiomics / tabular clinical-ML study — imaging or clinical features → any classical learner (penalised logistic [LASSO / ridge / elastic-net], SVM, k-NN, naive Bayes, LDA/QDA, deci…"
+    },
     {
       "slug": "render-pdf-doc",
       "category": "presentation_tooling",
@@ -552,6 +563,15 @@
       "maturity": "official",
       "description": "Audit SSOT-to-submission drift and create journal submission manifests from canonical manuscript artifacts."
     },
+    {
+      "slug": "uncertainty-imaging",
+      "category": "model_engineering",
+      "category_label": "Model Engineering & Validation",
+      "layer": "D",
+      "owner_domain": "model_validation",
+      "maturity": "official",
+      "description": "Design or audit the uncertainty-quantification, out-of-distribution (OOD) detection, and selective-prediction layer of a medical-imaging model framed for deployment — so a clinical-use claim carries c…"
+    },
     {
       "slug": "verify-refs",
       "category": "literature_references",

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "medsci-skills",
-  "version": "5.15.0",
+  "version": "5.17.0",
   "description": "MedSci Skills — a medical/scientific research skill suite for AI coding agents (Claude Code, Codex, Cursor, Copilot). The npm package is a terminal-friendly installer shortcut; the canonical distribution remains the GitHub repository and the Claude Code plugin marketplace.",
   "license": "SEE LICENSE IN LICENSE",
   "homepage": "https://github.com/Aperivue/medsci-skills#readme",

package/skills/architecture-zoo/SKILL.md

@@ -7,9 +7,10 @@ description: >
   when-to-use, a medical-imaging use, a reference implementation, the typical validation setup, and the
   matching model-scaffold template. Covers the foundational curriculum (ResNet, DenseNet, EfficientNet,
   ViT, Swin; U-Net, 3-D U-Net, Attention/Residual U-Net, nnU-Net, Mask R-CNN; SAM/MedSAM,
-  TotalSegmentator, BiomedCLIP, DINO/MAE/SimCLR). It teaches archetypes and the task-to-architecture
-  logic, not a live SOTA leaderboard.
-triggers: architecture zoo, which architecture, choose a model, model selection, ResNet vs ViT, U-Net vs nnU-Net, what backbone, foundation model for, transfer learning choice, MedSAM, TotalSegmentator, DINO, MAE, self-supervised, paper to architecture, reference implementation, when to use ViT, segmentation architecture, classification backbone
+  TotalSegmentator, BiomedCLIP, DINO/MAE/SimCLR; and graph neural nets — GCN/GraphSAGE/GAT/GIN/BrainGNN —
+  for brain connectomes). It teaches archetypes and the task-to-architecture logic, not a live SOTA
+  leaderboard.
+triggers: architecture zoo, which architecture, choose a model, model selection, ResNet vs ViT, U-Net vs nnU-Net, what backbone, foundation model for, transfer learning choice, MedSAM, TotalSegmentator, DINO, MAE, self-supervised, graph neural network, GNN, brain connectome, GCN, GAT, GraphSAGE, BrainGNN, population graph, paper to architecture, reference implementation, when to use ViT, segmentation architecture, classification backbone
 tools: Read, Write, Edit, Grep, Glob
 model: inherit
 ---
@@ -62,6 +63,8 @@ a family card.
   VAE / fastMRI reconstruction.
 - `${CLAUDE_SKILL_DIR}/references/foundation_models.md` — SAM / MedSAM / MedSAM2 / TotalSegmentator /
   SegVol / BiomedCLIP / DINO / MAE / SimCLR / MoCo.
+- `${CLAUDE_SKILL_DIR}/references/graph.md` — GCN / GraphSAGE / GAT / GIN / BrainGNN for brain
+  connectomes & population graphs (integrate PyTorch Geometric / DGL; not scaffolded by model-scaffold).
 Each card gives the paper, core idea, when-to-use, medical-imaging use, reference implementation, and the
 **typical validation/experiment setup** for that architecture class.
 

package/skills/architecture-zoo/references/graph.md

@@ -0,0 +1,110 @@
+# Graph neural networks — brain connectomes & population graphs (architecture-zoo)
+
+For when the data is a **graph, not an image grid**: a brain **connectome** (nodes = ROIs /
+parcels, edges = structural connectivity from DTI tractography or functional connectivity
+from fMRI correlation), or a **population graph** (nodes = subjects, edges = phenotypic /
+imaging similarity). The task is usually **graph-level classification** (diagnose a subject
+from their connectome), **node-level** (flag abnormal ROIs, or classify subjects on a
+population graph), or **link prediction** (connectivity changes).
+
+This is a distinct family because a CNN/U-Net assumes a regular pixel grid; a connectome has
+no grid — permuting the ROI order must not change the prediction, which is exactly the
+symmetry a GNN respects. Each card: **paper → core idea → when to use → medical use →
+reference impl → validation/experiment setup.**
+
+---
+
+## The general-purpose message-passing GNNs
+
+### GCN (graph convolutional network)
+- **Paper**: Kipf & Welling, "Semi-Supervised Classification with Graph Convolutional
+  Networks", *ICLR* 2017.
+- **Core idea**: each layer averages a node's features with its neighbours' (a first-order
+  spectral-graph approximation), stacking to widen the receptive field over the graph.
+- **When to use**: the transparent baseline for any connectome / population-graph task — try
+  it before anything fancier.
+- **Medical use**: connectome classification; **Parisot et al.** (*Medical Image Analysis*
+  2018) put subjects on a **population graph** (phenotypic-similarity edges) for autism
+  (ABIDE) and Alzheimer's (ADNI) prediction — a semi-supervised node-classification framing.
+- **Reference impl**: **PyTorch Geometric** (`GCNConv`) or **DGL**; do not reimplement.
+- **Validation setup**: split at the **subject level** (a subject's graph — or, on a
+  population graph, a subject node's label — never spans train/test); with a small cohort,
+  report a **permutation test** and cross-validated CIs, not a single split.
+
+### GraphSAGE (inductive aggregation)
+- **Paper**: Hamilton, Ying & Leskovec, "Inductive Representation Learning on Large Graphs",
+  *NeurIPS* 2017.
+- **Core idea**: learn an **aggregator** over a sampled neighbourhood so the model generalises
+  to **unseen** nodes/graphs (inductive), unlike transductive GCN.
+- **When to use**: a **new subject** must be classified without retraining (the realistic
+  clinical setting), or the graph is too large to process whole.
+- **Medical use**: inductive connectome classification where test subjects are genuinely held
+  out (the honest deployment framing for a population-graph model).
+- **Reference impl**: PyTorch Geometric (`SAGEConv`) / DGL.
+- **Validation setup**: exploit the inductive setup to keep the test subjects fully out of
+  message passing during training (transductive leakage is a real trap on population graphs).
+
+### GAT (graph attention)
+- **Paper**: Veličković et al., "Graph Attention Networks", *ICLR* 2018.
+- **Core idea**: learn **attention weights** over neighbours, so the model decides which
+  connections matter instead of averaging uniformly.
+- **When to use**: when *which edges/connections drive the prediction* is itself a finding
+  (edge importance is a built-in interpretability signal).
+- **Medical use**: connectome studies that report the most-attended edges/ROIs as candidate
+  biomarkers.
+- **Reference impl**: PyTorch Geometric (`GATConv` / `GATv2Conv`) / DGL.
+- **Validation setup**: treat attention as a **hypothesis-generating** attribution, not proof
+  — sanity-check it (does it survive label permutation?) as `/explainability` requires of any
+  saliency.
+
+### GIN (graph isomorphism network)
+- **Paper**: Xu et al., "How Powerful are Graph Neural Networks?", *ICLR* 2019.
+- **Core idea**: an aggregation as discriminative as the Weisfeiler-Lehman test — the most
+  **expressive** simple GNN for **graph-level** classification.
+- **When to use**: graph-level diagnosis where subtle topology differences separate classes
+  and GCN/GAT underfit.
+- **Reference impl**: PyTorch Geometric (`GINConv`).
+- **Validation setup**: expressiveness raises overfitting risk on small connectome cohorts —
+  pair with heavy regularisation and nested CV (as `/radiomics-ml` does for the p ≫ n regime).
+
+---
+
+## The brain-specific model
+
+### BrainGNN (ROI-aware, interpretable)
+- **Paper**: Li et al., "BrainGNN: Interpretable Brain Graph Neural Network for fMRI Analysis",
+  *Medical Image Analysis* 2021.
+- **Core idea**: ROI-aware convolution + a pooling layer that scores and selects the most
+  informative ROIs, so the model is **interpretable at the region level** by construction.
+- **When to use**: fMRI connectome classification where you must report **which ROIs** drove
+  the decision (the usual neuroimaging reviewer demand).
+- **Medical use**: task-fMRI / resting-state connectome diagnosis (ASD, disorders) with a
+  salient-ROI readout.
+- **Reference impl**: the authors' released BrainGNN repo (on PyTorch Geometric).
+- **Validation setup**: report salient ROIs with **stability across folds** (not one split);
+  keep site-harmonisation (**ComBat**) fit on the **training** fold only.
+
+---
+
+## Connectome-specific validation traps (read before publishing)
+- **Subject-level split.** A subject's connectome must not appear in more than one split; on a
+  population graph, hold test-subject **labels** out of training and (ideally, inductive)
+  their **nodes** out of message passing. This is `/model-validation`'s split-leakage discipline
+  at the subject level.
+- **Site / scanner harmonisation leakage.** Multi-site connectome data (ABIDE, ADNI) is
+  harmonised with **ComBat** — fit it on the **training** fold only, never the whole cohort
+  (the graph analogue of `/preprocess-imaging`'s `NORMALIZATION_LEAKAGE`).
+- **p ≫ n.** A connectome has thousands of edges on tens–hundreds of subjects; treat it like
+  radiomics — nested CV, regularisation, a **permutation test** for tiny cohorts, and don't
+  over-read a single fold (`/radiomics-ml`).
+- **Interpretability ≠ proof.** Attention / ROI-saliency is hypothesis-generating; sanity-check
+  it (`/explainability`).
+
+## Boundary — this family is not scaffolded by `/model-scaffold`
+`/model-scaffold` builds **image-grid** repos (CNN / U-Net / transformer); it has **no graph
+task template**. For GNNs, **integrate PyTorch Geometric / DGL directly** — they own the graph
+layers, loaders, and training loop; the lane does not reimplement them. The lane's
+**subject-level** gates still apply: `/model-validation` (split leakage), `/radiomics-ml`
+(nested-CV rigor for p ≫ n), `/explainability` (attribution sanity), `/uncertainty-imaging`
+(deployment uncertainty), and `/check-reporting` (TRIPOD+AI). Record the choice + paper in the
+decision note; validate the built model with `/model-validation`.

package/skills/architecture-zoo/references/index.md

@@ -14,12 +14,16 @@ per-paper detail and the `/model-scaffold` template to instantiate.
 | "I have few labels / want to pretrain on unlabelled scans" | **self-supervised pretraining → fine-tune** | `foundation_models.md` |
 | "adapt a released medical foundation model" | **transfer / prompt a foundation model** | `foundation_models.md` |
 | "synthesise / translate a modality" (MRI→CT, denoise) | **image-to-image / generative** | `synthesis.md` |
+| "classify from a brain connectome / graph" (ROI connectivity, DTI/fMRI) | **graph neural network** | `graph.md` |
 | "generate a report / answer a visual question" | **multimodal LLM** | *(use `/mllm-eval`; not a CNN choice)* |
 
 ## Step 2 — let the constraints narrow it
 - **Modality / dimensionality**: 2-D (CXR, fundus, path tiles, single CT/MR slices) →
   2-D backbones / 2-D U-Net. 3-D volumes (CT, MR) → **3-D U-Net / SegResNet / nnU-Net**
-  (3-D context matters; do not collapse to slices if the structure is volumetric).
+  (3-D context matters; do not collapse to slices if the structure is volumetric). A
+  **graph** (brain connectome, ROI-connectivity matrix — no pixel grid) → a **GNN**
+  (`graph.md`); integrate PyTorch Geometric / DGL directly (`/model-scaffold` has no graph
+  template).
 - **Labelled data scale** (events/structures, not just images):
   - **small** (hundreds) → a **pretrained** backbone fine-tuned (ImageNet / a medical
     foundation model), strong augmentation, heavy regularisation; prefer **nnU-Net**

package/skills/architecture-zoo/skill.yml

@@ -29,7 +29,7 @@ safety_boundaries:
   - "Advisory only: it writes a decision note, never code or weights; the build is /model-scaffold."
   - "Every recommendation names its source paper; benchmark numbers are cited, never invented; the zoo describes archetypes, not a live leaderboard."
 known_limitations:
-  - "The literature moves fast; this is a curated archetype map (classification, segmentation, detection, synthesis, foundation/SSL families), not an exhaustive or current SOTA ranking."
+  - "The literature moves fast; this is a curated archetype map (classification, segmentation, detection, synthesis, foundation/SSL, and graph/GNN families), not an exhaustive or current SOTA ranking."
   - "A sound architecture choice is necessary, not sufficient; validity still depends on the split, validation design, and metrics (/model-validation, /model-evaluation)."
 validation_commands:
   - "carry the decision note into /model-scaffold to instantiate the chosen template, then /model-validation"