medsci-skills 5.5.0 → 5.7.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +13 -13
- package/metadata/distribution_files.json +35 -15
- package/metadata/distribution_manifest.json +1 -1
- package/package.json +1 -1
- package/skills/check-reporting/SKILL.md +4 -2
- package/skills/check-reporting/references/checklists/PRISMA_ScR.md +70 -0
- package/skills/check-reporting/scripts/check_checklist_exists.py +3 -0
- package/skills/make-figures/references/reporting_guideline_figure_map.md +3 -2
- package/skills/orchestrate/SKILL.md +1 -1
- package/skills/peer-review/SKILL.md +6 -0
- package/skills/peer-review/references/domain-probes/scoping_review.md +51 -0
- package/skills/self-review/SKILL.md +122 -0
- package/skills/self-review/references/domain-probes/scoping_review.md +51 -0
- package/skills/self-review/references/panel_review_template.md +45 -4
- package/skills/self-review/scripts/check_editorial_impression.py +461 -0
- package/skills/self-review/skill.yml +2 -0
- package/skills/self-review/tests/fixtures/editorial_clean.md +29 -0
- package/skills/self-review/tests/fixtures/editorial_defensive.md +25 -0
- package/skills/self-review/tests/test_editorial_impression.sh +61 -0
package/README.md
CHANGED
|
@@ -4,7 +4,7 @@
|
|
|
4
4
|
|
|
5
5
|
**51 skills that actually work.** Built by a physician-researcher, tested on real publications.
|
|
6
6
|
|
|
7
|
-
*MedSci Skills is an end-to-end research tool for physician and medical-engineering researchers — design → scaffold → validate → publish — for the clinical manuscript and the medical-AI model behind it. Its moat is the compliance layer —
|
|
7
|
+
*MedSci Skills is an end-to-end research tool for physician and medical-engineering researchers — design → scaffold → validate → publish — for the clinical manuscript and the medical-AI model behind it. Its moat is the compliance layer — 42 reporting guidelines and risk-of-bias tools, reference/citation verification, and deterministic integrity gates before peer review — now extended by a model-engineering lane that scaffolds reproducible, leakage-safe training repos and audits model validation. Clinical AI model research engineering is in scope; a general AI-scientist platform is not. It competes on clinical submission reliability, not skill count.*
|
|
8
8
|
|
|
9
9
|
[](LICENSE)
|
|
10
10
|
[](https://github.com/Aperivue/medsci-skills/releases/latest)
|
|
@@ -281,54 +281,54 @@ The E2E pipeline (`orchestrate --e2e`) produces everything up to `qc/`. The `sub
|
|
|
281
281
|
|
|
282
282
|
## What's New
|
|
283
283
|
|
|
284
|
-
**v4.10** — reviewer-coverage expansion reverse-engineered from high-IF, CC-BY papers (learn-only under the `reverse_engineer/` license firewall), plus a clinician-friendly update path. Additive and backward-compatible; 45 skills / **
|
|
284
|
+
**v4.10** — reviewer-coverage expansion reverse-engineered from high-IF, CC-BY papers (learn-only under the `reverse_engineer/` license firewall), plus a clinician-friendly update path. Additive and backward-compatible; 45 skills / **42 guidelines** / 36 detectors / **15 domain-probe modules** (was 12):
|
|
285
285
|
|
|
286
286
|
- **Three new reviewer domain-probe modules** (`/peer-review` + `/self-review`, vendored byte-identical): **Mendelian randomization** (MR1–MR8 — IV assumptions, pleiotropy-robust sensitivity suite, Steiger, sample overlap, NLMR, drug-target colocalization), **polygenic risk score** (PG1–PG8 — ancestry portability, base/target leakage, incremental value over the clinical model, screening-vs-discrimination, calibration), and **network meta-analysis** (NM1–NM8 — transitivity, incoherence, SUCRA over-interpretation, CINeMA/GRADE-NMA, component-NMA additivity). Plus observational **O17** (agnostic many-exposure-scan multiplicity: ExWAS/EWAS/MWAS).
|
|
287
287
|
- **Two reporting-guideline checklists** (36 → 38): **STROBE-MR** and **PGS-RS / PRS-RS**, with study-type routing. Four new `/analyze-stats` analysis guides (multiplicity, MR, PRS, NMA) and a `/clean-data` implausible-value + cross-field validity reference.
|
|
288
288
|
- **Clinician-friendly update reminders** — the classroom installers enable the in-app "update available" notice + one-click Desktop updater by default; the `npx`/manual paths print how to turn it on; the install guide recommends `npx medsci-skills install --enable-update-notify`.
|
|
289
289
|
|
|
290
|
-
**v4.9** — analysis-integrity hardening promoted from real review cycles, plus journal-mechanics additions. Additive and backward-compatible; still 45 skills /
|
|
290
|
+
**v4.9** — analysis-integrity hardening promoted from real review cycles, plus journal-mechanics additions. Additive and backward-compatible; still 45 skills / 42 guidelines, analysis-integrity detectors **32 → 36**:
|
|
291
291
|
|
|
292
292
|
- **Four new gates** — a **duplicate-bibliography** check (`check_reference_duplication.py`) for the hybrid `[@key]` + hand-typed `## References` build that renders the list twice; a **cross-script binning / composite-indicator** consistency check (`check_binning_consistency.py`, `BINNING_DRIFT` / `DERIVED_DEF_DRIFT`) for a derived categorical or composite indicator defined inconsistently across analysis scripts; a **float citation-order** check (`check_citation_order.py`) for numbered Tables/Figures not first cited in ascending order per series; and an **audit-dump leak** gate (`/sync-submission`) that blocks a `/check-reporting` output mistakenly attached as a submission file.
|
|
293
293
|
- **KJR technical-check conventions + percentage-decimal style**, reader-allocation-under-burden and generative-image-as-study-object reporting (`/design-ai-benchmarking`, `/check-reporting`), and a **Liver International** CSL with that journal's submission mechanics (`/manage-refs`).
|
|
294
294
|
|
|
295
|
-
**v4.8** is the **review-harvest batch** — deterministic detector hardening promoted from real-manuscript review cycles. Additive and backward-compatible; still 45 skills /
|
|
295
|
+
**v4.8** is the **review-harvest batch** — deterministic detector hardening promoted from real-manuscript review cycles. Additive and backward-compatible; still 45 skills / 42 guidelines, analysis-integrity detectors **30 → 32**:
|
|
296
296
|
|
|
297
297
|
- **Two new gates** — `check_supplement_hygiene.py` lints the rendered supplement / tables / caption files (not just the manuscript) for §-labels, placeholders, build markers, response-letter framing, and unresolved body↔supplement cross-references; `check_null_calibration.py` flags a headline negative/equivalence claim made without a minimum-detectable-effect / power / equivalence statement.
|
|
298
298
|
- **Four detector false-positive fixes** — gates no longer fire on a recommended colorblind-safe palette, author-footnote `§` daggers, a correctly-hedged disclaimer, or a tier-label digit; each with a regression fixture and three newly CI-wired test suites.
|
|
299
299
|
- **Nine reviewer-side domain probes** (SR/MA, observational, diagnostic, AI-overclaiming, survival) plus a `/design-study` design-stage ceiling gate for perceptual/reader-AI studies and a reusable confidence-weighted-rating→AUC monotonicity template.
|
|
300
300
|
|
|
301
|
-
**v4.7** is the **self-update foundation** — physician-researchers stay current without GitHub, git, or a terminal. Additive and backward-compatible; still 45 skills /
|
|
301
|
+
**v4.7** is the **self-update foundation** — physician-researchers stay current without GitHub, git, or a terminal. Additive and backward-compatible; still 45 skills / 42 guidelines / 30 detectors:
|
|
302
302
|
|
|
303
303
|
- **Transactional, crash-recoverable installer.** Each install runs through a durable journal state machine recovered on the next run (roll back / forward-clean / fail-closed), with per-target SHA-256 inventories — your modified or third-party skills are backed up and never clobbered or auto-deleted.
|
|
304
304
|
- **One-click self-updater** (`~/.medsci-skills/updater/`, `install.py --check-update`). Verifies the download against the github.com API digest and **never `extractall()`s** (per-entry rejection of traversal / symlink / duplicate / zip-bomb + an allowlist & per-file hash). The release pipeline injects a verified `provenance.json`, attests build provenance, runs on a protected `release` environment, and verifies each ZIP round-trips through the updater's own safe-extract before publishing.
|
|
305
305
|
- **Opt-in update notice (off by default):** `install.py --enable-update-notify` shows a one-line "update available" message at Claude Code session start — no telemetry, reads nothing about your session, installs nothing. `--disable-update-notify` / `MEDSCI_NO_UPDATE_CHECK=1` turn it off. *(Honest scope: the digest/attestation detect transport tampering, not a compromised publisher account — see `SECURITY.md`.)*
|
|
306
306
|
|
|
307
|
-
**v4.6** is a maintainability, governance, and review-depth release — still 45 skills /
|
|
307
|
+
**v4.6** is a maintainability, governance, and review-depth release — still 45 skills / 42 guidelines; analysis-integrity detectors **28 → 30**, domain probes 11 → 12:
|
|
308
308
|
|
|
309
309
|
- **Fairness / equity / subgroup-performance probe (EQ0–EQ6)** for AI/prediction/diagnostic studies that claim cross-population performance, plus two new detectors: an **AI-disclosure + data/code-availability** check (`/sync-submission`) and a **structured-summary-box conformance** check (`/academic-aio`).
|
|
310
310
|
- **Governance + answer-engine layer:** `ROADMAP.md`, `MAINTAINERS.md`, `SECURITY.md`, a maintainer workflow + release checklist, an AEO/GEO `docs/faq.md`, a "Start here: 3 workflows" + "Validation status" section in this README, and a new `maturity` field (official / experimental / community) on every skill.
|
|
311
311
|
- **Token diet (pilot):** `write-paper` Phase 7 integrity audits moved to a load-on-demand reference (~2,559 tokens saved per invocation). Positioning now leads with the compliance moat rather than skill count.
|
|
312
312
|
|
|
313
|
-
**v4.5** deepens the review + submission surface with no new skill or reporting-guideline count (still 45 skills /
|
|
313
|
+
**v4.5** deepens the review + submission surface with no new skill or reporting-guideline count (still 45 skills / 42 guidelines); analysis-integrity detectors **27 → 28**:
|
|
314
314
|
|
|
315
315
|
- **`/clean-data` + `/analyze-stats` — reverse-coded-item / negative-alpha detector.** A multi-item Likert scale with a negatively-worded item must be recoded `(min+max) − x` before the scale total or Cronbach's alpha is computed; left un-recoded, the item correlates negatively with the rest of the scale and alpha collapses (often negative). A negative alpha is a coding bug, not a "multidimensional construct." New stdlib-only `check_reverse_coding.py` returns `REVERSE_CODING_LIKELY` / `REVERSE_CODING_SUSPECT` / `OK` from per-item item-rest correlations + raw alpha; the Likert summary template gains a `--reverse-items` recode flag.
|
|
316
316
|
- **`/peer-review` + `/self-review` — SR/MA + DTA + prediction-model probe batch.** `sr_ma.md` **P12** risk-of-bias table row-sum ↔ traffic-light figure-matrix reconciliation and **P13** included-study ↔ reference-list completeness; `diagnostic_accuracy.md` **D7** index-test-as-enrollment-criterion circularity; `clinical_prediction_model.md` **CP5** intended-use horizon leakage and **CP6** development/CV vs held-out/external validation-nomenclature conflation. Vendored byte-identical into `/self-review`.
|
|
317
317
|
- **`/sync-submission` — embedded absolute-path leak scan.** A `word/*.xml` attribute (e.g. a pandoc-embedded image's `<pic:cNvPr descr="…">`) carrying an absolute home-dir path (`/Users/…`, `/home/…`) is a username leak invisible to a rendered-text scan; now flagged as `docx_embedded_abs_path` under `check_asset_anonymization.py`.
|
|
318
318
|
|
|
319
|
-
**v4.4** adds reviewer/analysis depth with no new skill or reporting-guideline count (still 45 skills /
|
|
319
|
+
**v4.4** adds reviewer/analysis depth with no new skill or reporting-guideline count (still 45 skills / 42 guidelines / 27 detectors):
|
|
320
320
|
|
|
321
321
|
- **`/author-strategy` — trajectory-archetype classification (optional).** Classifies a queried author's PubMed trajectory into abstract career archetypes (A1 infrastructure builder, A2 methodology rule-maker, A3 clinical→AI hybrid, A4 SR/MA volume engine, A5 large-consortium participation, A6 device/technique depth, + a computed composite) as an **explainable, multi-label, confidence-scored heuristic — not an objective verdict**. The rubric is a single canonical YAML (the narrative doc is generated from it); scores exclude `unavailable` signals (h-index/citation/venue-tier → `[VERIFY]`, never fabricated); a **disambiguation gate** binds an approved `corpus_manifest.json` to the CSV (csv + PMID-set hashes) so a surname alone never classifies, and target-author attribution never borrows a co-author's ORCID/affiliation.
|
|
322
322
|
- **`/peer-review` + `/self-review` — Image-Synthesis / cross-modality probe (IS1–IS4)** for studies that synthesize one imaging modality from another and claim the output carries the target's information, plus a reviewer-side reference-integrity spot-check.
|
|
323
323
|
- **`/verify-refs` — OpenAlex tertiary index** recovers conference-proceedings / non-DOI citations (NeurIPS/ICLR/ACL) that fall through PubMed and CrossRef, the free analogue of a portal's second index.
|
|
324
324
|
|
|
325
|
-
**v4.3** hardens the **cross-sectional / observational cohort** review surface end-to-end, much of it reverse-engineered from real CC-BY cohort papers (learn-only under the license firewall) — no new skill or reporting-guideline count (still 45 skills /
|
|
325
|
+
**v4.3** hardens the **cross-sectional / observational cohort** review surface end-to-end, much of it reverse-engineered from real CC-BY cohort papers (learn-only under the license firewall) — no new skill or reporting-guideline count (still 45 skills / 42 guidelines); analysis-integrity detectors **25 → 27**:
|
|
326
326
|
|
|
327
327
|
- **Observational probes O1 → O14** (`/peer-review` + `/self-review`, vendored) — over-adjustment / analysis-unit clustering / outcome construct-validity (O7–O9), overlapping-subset gradient (O10), **complex-survey design & weighting** for NHANES/KNHANES (O11), **data-driven threshold / "inflection-point" mining** (O12), **cross-sectional mediation** temporal-order & sequential-ignorability (O13), and **interaction scale** — additive RERI/AP/S vs multiplicative (O14). Plus a new **clinical-prediction-model** probe module **CP1–CP4** and survival **S9** (panel-data / multistate variance).
|
|
328
328
|
- **Two new detectors (25 → 27)** — `check_wordcount_cap.py` (the revision-inflation trap: body vs journal cap) and `check_paren_spans.py` (em-dash→paren conversions that wrap a whole sentence). Plus a `check_confounding_completeness.py` upgrade (DB-code↔prose alias map, SMD-from-mean±SD, exposure-defining-covariate exemption), a `check_cohort_arithmetic.py` `ANALYSIS_UNIT_UNDISCLOSED` check, a `check_scope_coherence.py` cross-sectional-yield lexicon, and a verify-refs corporate/collective-author render-abort fix.
|
|
329
329
|
- **Analysis & submission tooling** — `/analyze-stats` gains **mediation** and **interaction & effect-modification** guides; `/sync-submission` gains `assemble_supplement.py` (S{N} index↔file integrity) and a `/revise` body-word-count exit gate; `/render-pdf-doc` gains a `scan_glyph_coverage.py` xelatex silent-glyph-drop scan.
|
|
330
330
|
|
|
331
|
-
**v4.2** builds out the case-report capability end-to-end, grounded in real CC-BY case reports (learn-only under the license firewall) — no new skill or reporting-guideline count (still 45 skills /
|
|
331
|
+
**v4.2** builds out the case-report capability end-to-end, grounded in real CC-BY case reports (learn-only under the license firewall) — no new skill or reporting-guideline count (still 45 skills / 42 guidelines); journal profiles **68 → 73**:
|
|
332
332
|
|
|
333
333
|
- **Case-report + case-series writing** — `/write-paper` gains a CARE narrative + 150-word-abstract case-report exemplar, a **case-series** paper type (methods-light mini-cohort, all-cases summary table, counts-not-rates), and **adverse-event/pharmacovigilance** (Naranjo/WHO-UMC causality) and **diagnostic-pitfall/mimic** subtypes.
|
|
334
334
|
- **Radiology / imaging-led track** — a dedicated `exemplar_case_report_radiology.md` (per-modality technique→findings→impression, structured-reporting lexicons BI-RADS/LI-RADS/PI-RADS/TI-RADS/Lung-RADS/O-RADS, quantitative threshold honesty, an interventional-radiology procedure/complication subtype, DICOM de-identification) plus a `/make-figures` annotated multimodality imaging-panel exemplar.
|
|
@@ -452,7 +452,7 @@ ma-scout -> search-lit -> fulltext-retrieval -> design-study ──> write-proto
|
|
|
452
452
|
| **search-lit** | PubMed + Semantic Scholar + bioRxiv search with anti-hallucination citation verification. Token-efficient error handling -- CrossRef failures are silently batched, not repeated. BibTeX output tags each entry with `verified`/`verified_by`/`verified_on` fields so downstream skills can trust the citation provenance. |
|
|
453
453
|
| **verify-refs** | Pre-submission reference audit for `.md`, `.docx`, `.bib`, or `.tsv` inputs. Extracts references, verifies DOI/PMID via CrossRef/PubMed when available, and writes `qc/reference_audit.json` as the sole output — row-level status (OK / MISMATCH / UNVERIFIED / FABRICATED) lives inside the JSON `records[]` block. `/search-lit` produces candidate BibTeX; `/lit-sync` owns `manuscript/_src/refs.bib`. |
|
|
454
454
|
| **fulltext-retrieval** | Batch open-access PDF downloader. Unpaywall → PMC → OpenAlex → CrossRef pipeline. OA-only -- no paywall bypass. Input: DOI list or TSV. Optional PDF→Markdown conversion via [pymupdf4llm](https://pymupdf.readthedocs.io/en/latest/pymupdf4llm/) for token-efficient LLM analysis of academic papers. |
|
|
455
|
-
| **check-reporting** | Manuscript compliance audit against
|
|
455
|
+
| **check-reporting** | Manuscript compliance audit against 42 reporting guidelines and risk of bias tools (STROBE, STROBE-MR, RECORD, STARD, STARD-AI, TRIPOD, TRIPOD+AI, TRIPOD-LLM, PGS-RS, CHEERS 2022, CROSS, PRISMA, PRISMA-DTA, PRISMA-P, PRISMA-ScR, MOOSE, ARRIVE, CONSORT, CONSORT-AI, CARE, SPIRIT, SPIRIT-AI, CLAIM, DECIDE-AI, SQUIRE 2.0, CLEAR, GRRAS, MI-CLEAR-LLM, SWiM, AMSTAR 2, QUADAS-2, QUADAS-C, RoB 2, ROBINS-I, ROBINS-E, ROBIS, ROB-ME, PROBAST, PROBAST+AI, NOS, COSMIN, RoB NMA). Machine-readable JSON summary with `compliance_pct` and `fixable_by_ai` flags for automated pipeline integration. |
|
|
456
456
|
| **analyze-stats** | Statistical analysis code generation (Python/R) for diagnostic accuracy, DTA meta-analysis (bivariate/HSROC), inter-rater agreement, survival analysis, demographics tables, regression (logistic/linear), propensity score (matching/IPTW/overlap weighting), and repeated measures (RM ANOVA/GEE/mixed models). Calibration mandatory for prediction models. |
|
|
457
457
|
| **meta-analysis** | Full systematic review and meta-analysis pipeline (8 phases). DTA (bivariate/HSROC) and intervention meta-analysis. Protocol to submission-ready manuscript with PRISMA-DTA compliance. |
|
|
458
458
|
| **make-figures** | Publication-ready figures and visual abstracts: ROC curves, forest plots, PRISMA/CONSORT/STARD flow diagrams, Kaplan-Meier curves, Bland-Altman plots, confusion matrices, and journal-specific visual/graphical abstracts (python-pptx template-based). Communication-first design principles (Nat Hum Behav 2026 — key message, audience, cognitive load, figure-vs-table decision) and five flow-diagram production lessons (official-template fidelity, VML fallback PDF export, docx XML escape, sequential placeholder mapping, version freeze); critic rubric Section G adds 5 communication-first checks. `--study-type` auto-generates the full required figure set; structured `_figure_manifest.md` output for downstream pipeline consumption; D2 enforced as default for flow diagrams. |
|
|
@@ -621,8 +621,8 @@ Projects declare their source-of-truth layout in `SSOT.yaml`, and a `qc/migratio
|
|
|
621
621
|
### Meta-Analysis Failure Modes
|
|
622
622
|
`/meta-analysis` ships empirical failure-mode references (data integrity, review orchestration, submission package drift, post-submission release ops) with four automation hooks: `scripts/prisma_5way_consistency.py` (DI-6 PRISMA number consistency), `scripts/extraction_consensus_log_init.py` (DI-1 dual-extraction scaffold), `scripts/tag_cleanup_gate.sh` (DI-8 placeholder tag gate), and `scripts/verify_package_integrity.py` (SPD SHA-256 manifest for submission bundles).
|
|
623
623
|
|
|
624
|
-
###
|
|
625
|
-
`check-reporting` includes bundled checklists for
|
|
624
|
+
### 42 Reporting Guidelines & RoB Tools Built-in
|
|
625
|
+
`check-reporting` includes bundled checklists for 42 guidelines and risk-of-bias tools: STROBE, STROBE-MR, RECORD, STARD, STARD-AI, TRIPOD, TRIPOD+AI, TRIPOD-LLM, PGS-RS, CHEERS 2022, CROSS, PRISMA 2020, PRISMA-DTA, PRISMA-P, PRISMA-ScR, MOOSE, ARRIVE, CONSORT, CONSORT-AI, CARE, SPIRIT, SPIRIT-AI, CLAIM, DECIDE-AI, SQUIRE 2.0, CLEAR, GRRAS, MI-CLEAR-LLM, SWiM, AMSTAR 2, QUADAS-2, QUADAS-C, RoB 2, ROBINS-I, ROBINS-E, ROBIS, ROB-ME, PROBAST, PROBAST+AI, NOS, COSMIN, RoB NMA. Includes Results/Discussion section boundary checks and machine-readable JSON summary for pipeline integration.
|
|
626
626
|
|
|
627
627
|
### Publication-Ready Output
|
|
628
628
|
`analyze-stats` generates reproducible Python/R code for 13 analysis types -- including regression, propensity score, and repeated measures -- with mandatory calibration for prediction models. `make-figures` produces journal-specification figures (300 DPI, colorblind-safe palettes, proper dimensions), visual/graphical abstracts, and a tool selection guide (D2 for flow diagrams, matplotlib for data plots). `--study-type` auto-generates the complete figure set for each study design.
|
|
@@ -538,8 +538,8 @@
|
|
|
538
538
|
},
|
|
539
539
|
{
|
|
540
540
|
"path": "skills/check-reporting/SKILL.md",
|
|
541
|
-
"size":
|
|
542
|
-
"sha256": "
|
|
541
|
+
"size": 38325,
|
|
542
|
+
"sha256": "e4ffb4f0879cfbcff82e2bdd9601eeebbb4e31200b2ec1ca61d7ac46db3745e4"
|
|
543
543
|
},
|
|
544
544
|
{
|
|
545
545
|
"path": "skills/check-reporting/references/LICENSES.md",
|
|
@@ -651,6 +651,11 @@
|
|
|
651
651
|
"size": 4780,
|
|
652
652
|
"sha256": "4727f5970496e5fe4928b426e3eff72a1181e6ae83ea0163cd5b4ec623aa8282"
|
|
653
653
|
},
|
|
654
|
+
{
|
|
655
|
+
"path": "skills/check-reporting/references/checklists/PRISMA_ScR.md",
|
|
656
|
+
"size": 7700,
|
|
657
|
+
"sha256": "ed77ad95bf03fd798db978444514ae66bd36e39685155da320345524e4afddc6"
|
|
658
|
+
},
|
|
654
659
|
{
|
|
655
660
|
"path": "skills/check-reporting/references/checklists/PROBAST.md",
|
|
656
661
|
"size": 3184,
|
|
@@ -783,8 +788,8 @@
|
|
|
783
788
|
},
|
|
784
789
|
{
|
|
785
790
|
"path": "skills/check-reporting/scripts/check_checklist_exists.py",
|
|
786
|
-
"size":
|
|
787
|
-
"sha256": "
|
|
791
|
+
"size": 6817,
|
|
792
|
+
"sha256": "c0a1eea2927b4b0edc2a4e9f15a3ac69a729fc8fa76d13de41f5519ecd782d2f"
|
|
788
793
|
},
|
|
789
794
|
{
|
|
790
795
|
"path": "skills/check-reporting/scripts/check_checklist_version.py",
|
|
@@ -2023,8 +2028,8 @@
|
|
|
2023
2028
|
},
|
|
2024
2029
|
{
|
|
2025
2030
|
"path": "skills/make-figures/references/reporting_guideline_figure_map.md",
|
|
2026
|
-
"size":
|
|
2027
|
-
"sha256": "
|
|
2031
|
+
"size": 7149,
|
|
2032
|
+
"sha256": "f56ed1e6c77209cef20e82d1caa99aa65d7f41aac074198e217025f183bdee5d"
|
|
2028
2033
|
},
|
|
2029
2034
|
{
|
|
2030
2035
|
"path": "skills/make-figures/references/visual_abstract_templates/european_radiology.pptx",
|
|
@@ -2814,7 +2819,7 @@
|
|
|
2814
2819
|
{
|
|
2815
2820
|
"path": "skills/orchestrate/SKILL.md",
|
|
2816
2821
|
"size": 35203,
|
|
2817
|
-
"sha256": "
|
|
2822
|
+
"sha256": "78920458eece7f1d65bd376595f0c5f7a6d199514554da517242aff0837b62e5"
|
|
2818
2823
|
},
|
|
2819
2824
|
{
|
|
2820
2825
|
"path": "skills/orchestrate/references/dialogue_nodes.md",
|
|
@@ -2838,8 +2843,8 @@
|
|
|
2838
2843
|
},
|
|
2839
2844
|
{
|
|
2840
2845
|
"path": "skills/peer-review/SKILL.md",
|
|
2841
|
-
"size":
|
|
2842
|
-
"sha256": "
|
|
2846
|
+
"size": 66025,
|
|
2847
|
+
"sha256": "811ebdfbe6ddb04748cc57fd3e02922d07b3f508ec6307e0790f3b3793a0b827"
|
|
2843
2848
|
},
|
|
2844
2849
|
{
|
|
2845
2850
|
"path": "skills/peer-review/references/aczel_2021_reviewer2_patterns.md",
|
|
@@ -2931,6 +2936,11 @@
|
|
|
2931
2936
|
"size": 7574,
|
|
2932
2937
|
"sha256": "04174053da808ee99f72f21d41225d76e856e94aff5088dffd8040ec40a4aa4e"
|
|
2933
2938
|
},
|
|
2939
|
+
{
|
|
2940
|
+
"path": "skills/peer-review/references/domain-probes/scoping_review.md",
|
|
2941
|
+
"size": 7246,
|
|
2942
|
+
"sha256": "c8d7ab314aaff513638715674d26be7dd32b3b4815cab48de8cef00cba6db2f8"
|
|
2943
|
+
},
|
|
2934
2944
|
{
|
|
2935
2945
|
"path": "skills/peer-review/references/domain-probes/sr_ma.md",
|
|
2936
2946
|
"size": 17239,
|
|
@@ -3393,8 +3403,8 @@
|
|
|
3393
3403
|
},
|
|
3394
3404
|
{
|
|
3395
3405
|
"path": "skills/self-review/SKILL.md",
|
|
3396
|
-
"size":
|
|
3397
|
-
"sha256": "
|
|
3406
|
+
"size": 104929,
|
|
3407
|
+
"sha256": "085c13cd04dae19970ebb2de239fb6d1de9829ba95847e0e18c1e0bbea1e5edf"
|
|
3398
3408
|
},
|
|
3399
3409
|
{
|
|
3400
3410
|
"path": "skills/self-review/references/domain-probes/ai_overclaiming.md",
|
|
@@ -3481,6 +3491,11 @@
|
|
|
3481
3491
|
"size": 7574,
|
|
3482
3492
|
"sha256": "04174053da808ee99f72f21d41225d76e856e94aff5088dffd8040ec40a4aa4e"
|
|
3483
3493
|
},
|
|
3494
|
+
{
|
|
3495
|
+
"path": "skills/self-review/references/domain-probes/scoping_review.md",
|
|
3496
|
+
"size": 7246,
|
|
3497
|
+
"sha256": "c8d7ab314aaff513638715674d26be7dd32b3b4815cab48de8cef00cba6db2f8"
|
|
3498
|
+
},
|
|
3484
3499
|
{
|
|
3485
3500
|
"path": "skills/self-review/references/domain-probes/sr_ma.md",
|
|
3486
3501
|
"size": 17239,
|
|
@@ -3538,8 +3553,8 @@
|
|
|
3538
3553
|
},
|
|
3539
3554
|
{
|
|
3540
3555
|
"path": "skills/self-review/references/panel_review_template.md",
|
|
3541
|
-
"size":
|
|
3542
|
-
"sha256": "
|
|
3556
|
+
"size": 14863,
|
|
3557
|
+
"sha256": "a44567b5ea0c47971bcc75b0e6c46f3846d687240b0607ded07183d6fbaad86f"
|
|
3543
3558
|
},
|
|
3544
3559
|
{
|
|
3545
3560
|
"path": "skills/self-review/scripts/check_artifact_coverage.py",
|
|
@@ -3576,6 +3591,11 @@
|
|
|
3576
3591
|
"size": 21506,
|
|
3577
3592
|
"sha256": "7d3e67074d58a28ffee52ce64b486231f103a3ddcaf6b3b6ee83ba5f89c63bc2"
|
|
3578
3593
|
},
|
|
3594
|
+
{
|
|
3595
|
+
"path": "skills/self-review/scripts/check_editorial_impression.py",
|
|
3596
|
+
"size": 22032,
|
|
3597
|
+
"sha256": "42e0e9315e1c97ca0f9943213c65ea91d7064773d25287b2577f0386dfb7fc41"
|
|
3598
|
+
},
|
|
3579
3599
|
{
|
|
3580
3600
|
"path": "skills/self-review/scripts/check_null_calibration.py",
|
|
3581
3601
|
"size": 7594,
|
|
@@ -3613,8 +3633,8 @@
|
|
|
3613
3633
|
},
|
|
3614
3634
|
{
|
|
3615
3635
|
"path": "skills/self-review/skill.yml",
|
|
3616
|
-
"size":
|
|
3617
|
-
"sha256": "
|
|
3636
|
+
"size": 2223,
|
|
3637
|
+
"sha256": "4009f3148776fab2096da3dad8a15e503c5073b4cc66b42c57498948e2040270"
|
|
3618
3638
|
},
|
|
3619
3639
|
{
|
|
3620
3640
|
"path": "skills/setup-medsci/SKILL.md",
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "medsci-skills",
|
|
3
|
-
"version": "5.
|
|
3
|
+
"version": "5.7.0",
|
|
4
4
|
"description": "MedSci Skills — a medical/scientific research skill suite for AI coding agents (Claude Code, Codex, Cursor, Copilot). The npm package is a terminal-friendly installer shortcut; the canonical distribution remains the GitHub repository and the Claude Code plugin marketplace.",
|
|
5
5
|
"license": "SEE LICENSE IN LICENSE",
|
|
6
6
|
"homepage": "https://github.com/Aperivue/medsci-skills#readme",
|
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: check-reporting
|
|
3
|
-
description: Check manuscript compliance with medical research reporting guidelines. Supports
|
|
4
|
-
triggers: checklist, reporting guideline, STROBE, STROBE-MR, Mendelian randomization, CONSORT, CONSORT-AI, STARD, STARD-AI, TRIPOD, TRIPOD-LLM, PGS-RS, PRS-RS, polygenic risk score, polygenic score, PRISMA, PRISMA-DTA, PRISMA-P, ARRIVE, CARE, CLAIM, DECIDE-AI, MI-CLEAR-LLM, SPIRIT, SPIRIT-AI, QUADAS, QUADAS-C, RoB, ROBINS, ROBINS-E, ROBIS, ROB-ME, PROBAST, NOS, COSMIN, AMSTAR, SWiM, CHEERS, economic evaluation, cost-effectiveness, cost-utility, QALY, ICER, RECORD, RECORD-PE, routinely-collected data, registry, claims, electronic health records, EHR, real-world data, CROSS, CHERRIES, survey, questionnaire, KAP, e-survey, response rate, risk of bias, compliance check, LLM accuracy, large language model, clinical deployment
|
|
3
|
+
description: Check manuscript compliance with medical research reporting guidelines. Supports 42 guidelines including STROBE, STROBE-MR, RECORD, CONSORT, CONSORT-AI, STARD, STARD-AI, TRIPOD, TRIPOD+AI, TRIPOD-LLM, PGS-RS, ARRIVE, PRISMA, PRISMA-DTA, PRISMA-P, PRISMA-ScR (scoping reviews), CARE, SPIRIT, SPIRIT-AI, CLAIM, DECIDE-AI, MI-CLEAR-LLM, SQUIRE 2.0, CLEAR, MOOSE, GRRAS, SWiM, AMSTAR 2, CHEERS 2022, CROSS (survey studies), and risk of bias tools (QUADAS-2, QUADAS-C, RoB 2, ROBINS-I, ROBINS-E, ROBIS, ROB-ME, PROBAST, PROBAST+AI, NOS, COSMIN, RoB NMA). Generates item-by-item assessment with PRESENT/MISSING/PARTIAL status.
|
|
4
|
+
triggers: checklist, reporting guideline, STROBE, STROBE-MR, Mendelian randomization, CONSORT, CONSORT-AI, STARD, STARD-AI, TRIPOD, TRIPOD-LLM, PGS-RS, PRS-RS, polygenic risk score, polygenic score, PRISMA, PRISMA-DTA, PRISMA-P, PRISMA-ScR, scoping review, scoping, evidence map, ARRIVE, CARE, CLAIM, DECIDE-AI, MI-CLEAR-LLM, SPIRIT, SPIRIT-AI, QUADAS, QUADAS-C, RoB, ROBINS, ROBINS-E, ROBIS, ROB-ME, PROBAST, NOS, COSMIN, AMSTAR, SWiM, CHEERS, economic evaluation, cost-effectiveness, cost-utility, QALY, ICER, RECORD, RECORD-PE, routinely-collected data, registry, claims, electronic health records, EHR, real-world data, CROSS, CHERRIES, survey, questionnaire, KAP, e-survey, response rate, risk of bias, compliance check, LLM accuracy, large language model, clinical deployment
|
|
5
5
|
tools: Read, Write, Edit, Bash, Grep, Glob
|
|
6
6
|
model: inherit
|
|
7
7
|
---
|
|
@@ -32,6 +32,7 @@ compliance report suitable for journal submission.
|
|
|
32
32
|
- `CHEERS_2022.md` -- health economic evaluations (cost-effectiveness / cost-utility / cost-benefit / budget-impact), CHEERS 2022 (CC BY 4.0, Husereau et al. BMJ 2022)
|
|
33
33
|
- `RECORD.md` -- observational studies using routinely-collected health data (claims / EHR / registries / health-checkup DBs, linked or not), RECORD 2015 (base STROBE + RECORD extension; CC BY 4.0, Benchimol et al. PLoS Med 2015; RECORD-PE for drug studies)
|
|
34
34
|
- `CROSS.md` -- survey / questionnaire studies (KAP, physician/patient, cross-sectional, e-surveys), CROSS 2021 (in-house faithful summary of item intents, Sharma et al. JGIM 2021) + CHERRIES (CC BY, Eysenbach JMIR 2004) for internet surveys
|
|
35
|
+
- `PRISMA_ScR.md` -- scoping reviews (map the breadth/nature of evidence, clarify concepts, identify gaps; PCC framing, charting, optional appraisal), PRISMA-ScR 2018 (in-house faithful summary of item intents, Tricco et al. Ann Intern Med 2018; DOI 10.7326/M18-0850)
|
|
35
36
|
- `PRISMA_2020.md` -- systematic reviews (CC BY)
|
|
36
37
|
- `ARRIVE_2.md` -- animal studies (CC0)
|
|
37
38
|
- `PRISMA_DTA.md` -- DTA systematic reviews (CC BY, McInnes et al. JAMA 2018)
|
|
@@ -94,6 +95,7 @@ user specification.
|
|
|
94
95
|
| Health economic evaluation (cost-effectiveness / cost-utility / cost-benefit / budget-impact) | CHEERS 2022 | -- |
|
|
95
96
|
| Observational study using routinely-collected data (claims / EHR / registry / health-checkup DB) | RECORD (base STROBE + RECORD extension; RECORD-PE for drug studies) | -- |
|
|
96
97
|
| Survey / questionnaire study (KAP, physician/patient, cross-sectional, e-survey) | CROSS (+ CHERRIES for internet surveys) | -- |
|
|
98
|
+
| Scoping review (maps breadth/nature of evidence, clarifies concepts, identifies gaps — not a focused effectiveness/accuracy question) | PRISMA-ScR (base PRISMA + scoping-review extension) | -- |
|
|
97
99
|
| Randomized controlled trial | CONSORT 2025 | CONSORT-AI |
|
|
98
100
|
| Diagnostic accuracy study | STARD 2015 | STARD-AI |
|
|
99
101
|
| Prediction model (development/validation) | TRIPOD | TRIPOD+AI |
|
|
@@ -0,0 +1,70 @@
|
|
|
1
|
+
# PRISMA-ScR Checklist (scoping reviews)
|
|
2
|
+
|
|
3
|
+
**Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews**
|
|
4
|
+
Version: PRISMA-ScR 2018 — 20 essential items + 2 optional (items 12 and 16, critical appraisal). Organised by the IMRAD-plus-Funding sections of the source.
|
|
5
|
+
Source: Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. *Ann Intern Med* 2018;169(7):467–473 (the PRISMA-ScR statement; DOI 10.7326/M18-0850). EQUATOR Network. Scoping-review conduct guidance: JBI (Peters et al.); Arksey & O'Malley; Levac et al.
|
|
6
|
+
|
|
7
|
+
Apply when the manuscript is a **scoping review** — a review that *maps* the breadth of evidence on a topic, characterises concepts/definitions, and identifies gaps, rather than answering a focused effectiveness/accuracy question (that is a systematic review → use PRISMA 2020 / PRISMA-DTA). For the design/conduct review of the same study, pair with the SC1–SC8 domain probes in `peer-review` / `self-review` `references/domain-probes/scoping_review.md`; for the flow diagram use `make-figures` (PRISMA-style); for an SR/MA instead, use `PRISMA_2020.md` / `PRISMA_DTA.md`.
|
|
8
|
+
|
|
9
|
+
> Licensing note: the PRISMA-ScR statement is published in *Annals of Internal Medicine* (© American College of Physicians); the official EQUATOR checklist carries only the citation, with **no Creative Commons licence** (one secondary source lists CC BY-NC-SA 3.0 — also not permissively reusable). The items below are an **in-house, faithful summary of the reporting items (facts/intents, paraphrased — not the verbatim PRISMA-ScR wording)** for item-by-item assessment; consult the published article (DOI 10.7326/M18-0850) for exact item text. Items 12 and 16 (critical appraisal) are **optional** — a scoping review is not required to appraise risk of bias.
|
|
10
|
+
|
|
11
|
+
## Reporting items (grouped by section)
|
|
12
|
+
|
|
13
|
+
### Title
|
|
14
|
+
| # | Item | What to check is reported |
|
|
15
|
+
|---|------|---------------------------|
|
|
16
|
+
| 1 | Title | The report is identified as a **scoping review** in the title. |
|
|
17
|
+
|
|
18
|
+
### Abstract
|
|
19
|
+
| # | Item | What to check is reported |
|
|
20
|
+
|---|------|---------------------------|
|
|
21
|
+
| 2 | Structured summary | A structured abstract that, as relevant, states the background and objectives, the eligibility criteria and the evidence sources searched, the **charting** approach, and the headline results and conclusions tied to the review questions. |
|
|
22
|
+
|
|
23
|
+
### Introduction
|
|
24
|
+
| # | Item | What to check is reported |
|
|
25
|
+
|---|------|---------------------------|
|
|
26
|
+
| 3 | Rationale | The rationale situated against existing knowledge, and **why the question suits a scoping (mapping) approach** rather than a systematic review. |
|
|
27
|
+
| 4 | Objectives | Explicit questions/objectives stated with their key elements — **Population, Concept, Context (PCC)** or equivalent — used to frame the review. |
|
|
28
|
+
|
|
29
|
+
### Methods
|
|
30
|
+
| # | Item | What to check is reported |
|
|
31
|
+
|---|------|---------------------------|
|
|
32
|
+
| 5 | Protocol and registration | Whether an a-priori **protocol** exists, where it can be accessed, and any registration details. (Note: PROSPERO does **not** register scoping reviews; OSF/Figshare or a published protocol is used.) |
|
|
33
|
+
| 6 | Eligibility criteria | Characteristics used as eligibility criteria (years, language, publication status, source types) **with a rationale**. |
|
|
34
|
+
| 7 | Information sources | All information sources searched (databases with coverage dates, grey-literature sources, author contact) and the date the most recent search was run. |
|
|
35
|
+
| 8 | Search | A reproducible search strategy for **one or more databases** (search terms and any limits), detailed enough to be repeated by another team. |
|
|
36
|
+
| 9 | Selection of sources of evidence | The process for selecting **sources of evidence** (screening and eligibility) into the review. |
|
|
37
|
+
| 10 | Data charting process | The **data-charting** methods (calibrated/team-tested form; whether charting was independent/duplicate; iterative refinement) and any process for obtaining/confirming data from investigators. "Charting," not "extraction." |
|
|
38
|
+
| 11 | Data items | The data items charted — every variable sought — plus any assumptions or simplifications made. |
|
|
39
|
+
| 12 | Critical appraisal of individual sources of evidence (**optional**) | *If done*, the rationale for critical appraisal, the methods used, and how the information was used. Scoping reviews are **not required** to appraise; "critical appraisal" is used instead of "risk of bias." |
|
|
40
|
+
| 13 | Synthesis of results | The methods for **handling and summarising (charting/mapping)** the charted data. |
|
|
41
|
+
|
|
42
|
+
### Results
|
|
43
|
+
| # | Item | What to check is reported |
|
|
44
|
+
|---|------|---------------------------|
|
|
45
|
+
| 14 | Selection of sources of evidence | Numbers screened, assessed for eligibility, and included, with reasons for exclusion at each stage — ideally a **flow diagram**. |
|
|
46
|
+
| 15 | Characteristics of sources of evidence | Per-source characteristics for which data were charted, with citations. |
|
|
47
|
+
| 16 | Critical appraisal within sources of evidence (**optional**) | *If done* (see item 12), the critical-appraisal data per source. Optional. |
|
|
48
|
+
| 17 | Results of individual sources of evidence | For each included source, the relevant charted data that relate to the review questions/objectives. |
|
|
49
|
+
| 18 | Synthesis of results | The charting results **summarised/mapped** in relation to the review questions/objectives — a **map/characterisation, not a pooled effect estimate**. |
|
|
50
|
+
|
|
51
|
+
### Discussion
|
|
52
|
+
| # | Item | What to check is reported |
|
|
53
|
+
|---|------|---------------------------|
|
|
54
|
+
| 19 | Summary of evidence | The main results summarised (overview of concepts, themes, evidence types), linked to the questions/objectives and their relevance to key groups. |
|
|
55
|
+
| 20 | Limitations | Limitations of the **scoping-review process**. |
|
|
56
|
+
| 21 | Conclusions | A general interpretation against the questions/objectives, with potential implications and/or next steps (e.g. whether a systematic review is warranted). |
|
|
57
|
+
|
|
58
|
+
### Funding
|
|
59
|
+
| # | Item | What to check is reported |
|
|
60
|
+
|---|------|---------------------------|
|
|
61
|
+
| 22 | Funding | Sources of funding for the included sources of evidence **and** for the scoping review, and the funders' role. |
|
|
62
|
+
|
|
63
|
+
---
|
|
64
|
+
|
|
65
|
+
## Notes for Assessors
|
|
66
|
+
|
|
67
|
+
- The **highest-yield** checks (where scoping reviews most often go wrong): **item 4** (objectives framed as PCC mapping, not a focused PICO effectiveness question — a study that asks "is X effective/accurate?" should be a systematic review, not a scoping review), **item 18** (results presented as a **map** — counts, categories, themes, evidence gaps — **not** a pooled OR/RR/AUC or a definitive effectiveness/accuracy conclusion), and **items 12/16** (critical appraisal is **optional** — do not penalise a scoping review for omitting risk-of-bias, and do not let it claim GRADE-style certainty it did not derive).
|
|
68
|
+
- A "scoping review" that reports pooled effect estimates / a meta-analysis, or concludes that an intervention is effective / a test is accurate, has overstepped its design — its synthesis (item 18) and conclusions (item 21) should be downgraded to descriptive mapping, or the study reframed as a systematic review.
|
|
69
|
+
- Terminology matters: **charting** (not extraction), **sources of evidence** (not only studies), **critical appraisal** (not risk of bias). A scoping review claiming PROSPERO registration is in error (PROSPERO excludes scoping reviews).
|
|
70
|
+
- This is an **in-house faithful summary of the PRISMA-ScR items (paraphrased intents, not verbatim)**; map the manuscript's content to the items rather than to exact wording, and verify against the published statement (Tricco et al. *Ann Intern Med* 2018; DOI 10.7326/M18-0850). Verified 2026-06-30.
|
|
@@ -49,6 +49,9 @@ ALIAS_TO_STEM = {
|
|
|
49
49
|
"prisma": "PRISMA_2020",
|
|
50
50
|
"prismadta": "PRISMA_DTA",
|
|
51
51
|
"prismap": "PRISMA_P",
|
|
52
|
+
"prismascr": "PRISMA_ScR",
|
|
53
|
+
"scopingreview": "PRISMA_ScR",
|
|
54
|
+
"scoping": "PRISMA_ScR",
|
|
52
55
|
"arrive": "ARRIVE_2",
|
|
53
56
|
"care": "CARE",
|
|
54
57
|
"spirit": "SPIRIT",
|
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
# Reporting Guideline → Figure Requirements Map
|
|
2
2
|
|
|
3
3
|
> **Bridge**: this file connects `/make-figures` to `/check-reporting`
|
|
4
|
-
> (
|
|
4
|
+
> (42 reporting guidelines). Each row tells you which figures the guideline
|
|
5
5
|
> **mandates** and how this skill currently supports them. Use during
|
|
6
6
|
> Step 1 (Specify) once the study type is known.
|
|
7
7
|
|
|
@@ -25,6 +25,7 @@ Legend for **Status** column:
|
|
|
25
25
|
| **PRISMA 2020** | Systematic review | Flow diagram (4-phase: identification → screening → eligibility → included) | ✅ | `templates/official/prisma2020/`; R `PRISMA2020` package |
|
|
26
26
|
| **PRISMA-DTA** | DTA systematic review | Modified PRISMA flow + DTA-specific exclusion reasons | ⚠️ | Salameh et al., *BMJ* 2020 (PMID 32312813); use generic flow + extra columns |
|
|
27
27
|
| **PRISMA-NMA** | Network MA | PRISMA flow + network plot | ❌ | Hutton et al., *Ann Intern Med* 2015; network plot via R `netmeta::netgraph()` |
|
|
28
|
+
| **PRISMA-ScR** | Scoping review | PRISMA-ScR flow diagram (sources of evidence: identification → screening → eligibility → included; item 14) | ⚠️ | Tricco et al., *Ann Intern Med* 2018 (DOI 10.7326/M18-0850); use the generic PRISMA flow with "sources of evidence" wording |
|
|
28
29
|
| **PRISMA-P** | Protocol of SR | (none mandated; PRISMA-S search strategy figure recommended) | ❌ | Rethlefsen et al., *Syst Rev* 2021 |
|
|
29
30
|
| **CONSORT 2025** | RCT | Participant-flow diagram (enrollment → allocation → follow-up → analysis) | ✅ | `templates/official/consort2010/` (now CONSORT 2025); R generator |
|
|
30
31
|
| **CONSORT-AI 2020** | AI intervention RCT | CONSORT flow extended with AI training/validation/deployment dataset boxes | ❌ | Liu et al., *Nat Med* 2020 (PMID 32908283), Fig. 1; D2 / Graphviz custom |
|
|
@@ -95,7 +96,7 @@ flags them:
|
|
|
95
96
|
|
|
96
97
|
## Cross-references
|
|
97
98
|
|
|
98
|
-
- `/check-reporting` skill — supports all
|
|
99
|
+
- `/check-reporting` skill — supports all 42 guidelines, item-level audit
|
|
99
100
|
- `flow_diagram_lessons.md` — production lessons that apply across all flows
|
|
100
101
|
- `pipeline_concepts_medical_ai.md` — DICOM / annotation / federated /
|
|
101
102
|
architecture diagram conventions
|
|
@@ -48,7 +48,7 @@ You do NOT do the work yourself. You classify, plan, and delegate.
|
|
|
48
48
|
| **meta-analysis** | Systematic review | Full MA pipeline: protocol, search, screening, extraction, synthesis, PRISMA-DTA |
|
|
49
49
|
| **write-paper** | Writing | IMRAD manuscript drafting (8-phase pipeline), any section writing |
|
|
50
50
|
| **self-review** | Quality | Pre-submission self-check with domain probes (Survival / SR-MA / Radiomics / Narrative); optional `--panel` for a high-stakes final QC pass |
|
|
51
|
-
| **check-reporting** | Compliance | Audit against
|
|
51
|
+
| **check-reporting** | Compliance | Audit against 42 reporting guidelines and risk-of-bias tools |
|
|
52
52
|
| **revise** | Revision | Parse reviewer comments, generate point-by-point response, track changes |
|
|
53
53
|
| **grant-builder** | Funding | Structure grant proposals: significance, innovation, approach, milestones |
|
|
54
54
|
| **present-paper** | Presentation | Prepare academic talks: analyze paper, draft scripts, inject slide notes, Q&A prep |
|
|
@@ -286,6 +286,12 @@ Apply this 8-probe checklist (SV1–SV8) **only when the manuscript is a self-re
|
|
|
286
286
|
|
|
287
287
|
**Probe detail (SV1–SV8), with output templates and the leads-vs-findings discipline:** `${CLAUDE_SKILL_DIR}/references/domain-probes/survey_research.md`. Load it and apply each probe when the trigger fires. In this skill, map each probe finding to a Major / Minor comment; a convenience/self-selected sample generalised to a population with no representativeness assessment (SV1), a non-probability sample presented as representative (SV2), a response rate with no defined denominator or no non-response analysis behind a population estimate (SV3), or a novel unvalidated/un-piloted instrument carrying the headline (SV4) are design-level — surface them in the Confidential Comments to the Editor and place the strongest as the Major #1 candidate. Missing CHERRIES e-survey reporting (SV5), biased question design / unavailable instrument (SV6), unweighted estimates from a skewed sample or shifting denominators (SV7), and over-generalisation or missing ethics/consent (SV8) are validity/framing-level. For multi-item-scale reliability (incl. the reverse-coded-item α trap), pair with the analyze-stats Survey/Likert guidance.
|
|
288
288
|
|
|
289
|
+
### Phase 2S: Scoping Review Extension
|
|
290
|
+
|
|
291
|
+
Apply this 8-probe checklist (SC1–SC8) **only when the manuscript is a scoping review** — a review that *maps* the breadth/nature of evidence, clarifies concepts, or identifies gaps, rather than answering a focused effectiveness/accuracy question (that is a systematic review → PRISMA 2020 / PRISMA-DTA). These probes complement (do not replace) the generic Phase 2 checklist and the **PRISMA-ScR** reporting items (Tricco et al. *Ann Intern Med* 2018), and assume the JBI / Arksey & O'Malley / Levac conduct frameworks. They target whether the question genuinely suits a *mapping* review, whether the conduct uses scoping methods (PCC framing, charting, optional appraisal), and the commonest over-reach — a synthesis drifting from a map into pooled effect estimates and definitive effectiveness claims.
|
|
292
|
+
|
|
293
|
+
**Probe detail (SC1–SC8), with output templates and the leads-vs-findings discipline:** `${CLAUDE_SKILL_DIR}/references/domain-probes/scoping_review.md`. Load it and apply each probe when the trigger fires. In this skill, map each probe finding to a Major / Minor comment; a focused effectiveness/accuracy question run as a scoping review to sidestep risk-of-bias and synthesis (SC1), or a scoping review reporting a pooled effect/accuracy estimate or definitive effectiveness conclusion (SC7) are design-level — surface them in the Confidential Comments to the Editor and place the strongest as the Major #1 candidate. Note the **asymmetric critical-appraisal calibration** (SC6): do **not** flag "no risk-of-bias assessment" as a deficiency for a scoping review, but do flag GRADE-style certainty claimed without appraisal. Wrong-registry (PROSPERO does not register scoping reviews) claims (SC2), narrow-search comprehensiveness claims (SC4), undocumented charting (SC5), and practice recommendations or mislabelling drawn from a map (SC8) are validity/framing-level.
|
|
294
|
+
|
|
289
295
|
### Phase 3: Draft Review
|
|
290
296
|
|
|
291
297
|
Before writing comments, skim the relevant model in `references/exemplar_reviews/` for the
|
|
@@ -0,0 +1,51 @@
|
|
|
1
|
+
<!-- Domain probe module — shared, vendored BYTE-IDENTICAL by /peer-review and /self-review.
|
|
2
|
+
Severity words below (MAJOR / MINOR / major / minor) denote finding severity, NOT a journal
|
|
3
|
+
recommendation. Each consuming skill maps findings to its own output:
|
|
4
|
+
- peer-review: Major / Minor comments + Confidential Comments to the Editor; a
|
|
5
|
+
scoping-fit / mapping-not-pooling / over-claim flaw is placed as Major #1.
|
|
6
|
+
- self-review: Anticipated Major / Minor Comments (Fatal / Fixable) mapped to category letters.
|
|
7
|
+
Do NOT edit one copy only — run `python3 scripts/check_domain_probe_sync.py --sync`. -->
|
|
8
|
+
|
|
9
|
+
# Scoping review probes (SC1–SC8)
|
|
10
|
+
|
|
11
|
+
An 8-probe checklist for **scoping reviews** — reviews that *map* the breadth of evidence on a topic, clarify concepts/definitions, and identify gaps. These probes complement (do not replace) the generic Phase 2 checklist and the **PRISMA-ScR** reporting items (Tricco et al. *Ann Intern Med* 2018), and assume the JBI / Arksey & O'Malley / Levac conduct frameworks. They target what is specific to a scoping design: whether the question genuinely suits a *mapping* (not an effectiveness/accuracy) review, whether the conduct uses scoping methods (PCC framing, charting, optional appraisal), and — the single most common over-reach — whether the synthesis stays a **map** rather than drifting into pooled effect estimates and definitive effectiveness claims. SC1 (scoping fit), SC6 (critical-appraisal calibration — the asymmetric trap), and SC7 (mapping not pooling) are the highest-yield; run them first.
|
|
12
|
+
|
|
13
|
+
**SC1 — Scoping fit and objectives (mapping intent, PCC framing)**:
|
|
14
|
+
- Is the review genuinely a **scoping** question — mapping the extent/range/nature of evidence, clarifying concepts, or identifying gaps — rather than a focused **effectiveness/accuracy** question that should be a systematic review (PRISMA 2020 / PRISMA-DTA)?
|
|
15
|
+
- Are objectives framed with **Population, Concept, Context (PCC)** or an equivalent mapping structure, not a PICO effectiveness/comparison frame with a defined outcome estimate?
|
|
16
|
+
- A focused "is X effective / is test Y accurate?" question run as a scoping review (to sidestep risk-of-bias and synthesis), or a scoping review whose objectives are really an SR's → MAJOR (reframe as a systematic review, or restate the objective as mapping).
|
|
17
|
+
|
|
18
|
+
**SC2 — Protocol and registration (a-priori; OSF, not PROSPERO)**:
|
|
19
|
+
- Is an **a-priori protocol** available (OSF / Figshare / a published protocol), with the question, eligibility, and charting plan pre-specified?
|
|
20
|
+
- Note that **PROSPERO does not register scoping reviews** — a manuscript claiming PROSPERO registration for a scoping review is in error and should cite the correct registry/repository.
|
|
21
|
+
- No protocol for a scoping review of any size, or a wrong-registry claim → MINOR (protocol absent → MAJOR if the charting plan appears post-hoc / outcome-driven).
|
|
22
|
+
|
|
23
|
+
**SC3 — Eligibility by concept; sources of evidence (not only studies)**:
|
|
24
|
+
- Are eligibility criteria specified by **PCC plus source characteristics** (years, language, publication status, source/evidence types) **with a rationale**?
|
|
25
|
+
- Does the review admit the **heterogeneous "sources of evidence"** a scoping review is meant to map (quantitative and qualitative research, grey literature, policy/guidance, expert opinion) where relevant, rather than silently restricting to a narrow study type and presenting it as a comprehensive map?
|
|
26
|
+
- Over-restrictive, study-only eligibility presented as a comprehensive map of the field, or eligibility with no rationale → MINOR.
|
|
27
|
+
|
|
28
|
+
**SC4 — Search comprehensiveness and reproducibility**:
|
|
29
|
+
- Is the **full search strategy for at least one database reproducible** (terms, limits), the date of the most recent search stated, and the information sources appropriate to a *mapping* aim — typically **multiple databases plus grey literature** rather than a single narrow source?
|
|
30
|
+
- Given that scoping reviews aim for breadth, is the search broad enough to support a "map the field" claim?
|
|
31
|
+
- A comprehensiveness/mapping claim resting on one narrow database with no grey-literature or no reproducible strategy → MAJOR / MINOR per the strength of the claim.
|
|
32
|
+
|
|
33
|
+
**SC5 — Selection and data charting**:
|
|
34
|
+
- Is the **two-stage selection** process (title/abstract then full-text) described, and the **data-charting** process specified — a calibrated/team-tested charting form, whether charting was **independent / in duplicate**, and any **iterative refinement** of the form (charting is iterative in scoping reviews)?
|
|
35
|
+
- Is the correct terminology used (**charting**, not extraction; **sources of evidence**, not only studies)?
|
|
36
|
+
- No charting process described, or single-reviewer charting with no calibration behind a large map → MINOR (or MAJOR if selection itself is undocumented).
|
|
37
|
+
|
|
38
|
+
**SC6 — Critical appraisal is OPTIONAL (the asymmetric trap)**:
|
|
39
|
+
- Critical appraisal / risk-of-bias is **not required** in a scoping review (PRISMA-ScR items 12/16 are optional). A reviewer must **not** flag "no risk-of-bias assessment" as a deficiency for a scoping review, and authors need not appraise.
|
|
40
|
+
- Conversely, if appraisal **was** done, is the rationale, method, and use reported (items 12/16)? And does the review avoid claiming **certainty grading (GRADE) or quality-weighted conclusions** it never derived?
|
|
41
|
+
- The trap is bidirectional: (a) demanding RoB of a scoping review is a mis-calibrated review comment; (b) a scoping review asserting GRADE-style certainty or "high-quality evidence shows…" without having appraised is over-claiming → MINOR/MAJOR per how load-bearing the certainty claim is.
|
|
42
|
+
|
|
43
|
+
**SC7 — Synthesis is mapping, NOT pooling (no effect estimates)**:
|
|
44
|
+
- Are results presented as a **map/characterisation** — counts, categories, concept/theme groupings, evidence-gap maps, charting tables — rather than a **meta-analytic pooled estimate** (pooled OR/RR/HR/AUC, summary sensitivity/specificity)?
|
|
45
|
+
- A scoping review should **not** compute or headline a pooled effect/accuracy estimate; doing so is an estimand/scope mismatch (the design carries no risk-of-bias or synthesis machinery to support an effect claim).
|
|
46
|
+
- A pooled effect/accuracy estimate, forest plot of effects, or quantitative effectiveness synthesis presented from a scoping review → MAJOR (move to a systematic review/meta-analysis, or relabel the figure as a descriptive frequency map).
|
|
47
|
+
|
|
48
|
+
**SC8 — Interpretation, gaps, terminology, and reporting**:
|
|
49
|
+
- Are conclusions matched to a **descriptive map** — what evidence exists, where the gaps are, whether a future systematic review/primary study is warranted — and free of **clinical-practice recommendations** or definitive effectiveness/accuracy claims a map cannot support (cf. the scope-coherence discipline)?
|
|
50
|
+
- Is a **PRISMA-ScR flow diagram** present, the study correctly labelled a scoping review (not conflated with a systematic review), and the report mapped to **PRISMA-ScR**?
|
|
51
|
+
- A practice recommendation or definitive effectiveness/accuracy conclusion drawn from a scoping map, mislabelling the study as a "systematic review," or missing PRISMA-ScR reporting → MAJOR (over-claim) / MINOR (reporting), per centrality.
|