bioai-evidence-validator 0.5.0__tar.gz → 0.7.0__tar.gz

{bioai_evidence_validator-0.5.0 → bioai_evidence_validator-0.7.0}/.gitattributes

@@ -1 +1,2 @@
 * text=auto eol=lf
+*.gz binary

bioai_evidence_validator-0.7.0/.github/ISSUE_TEMPLATE/bug_report.yml

@@ -0,0 +1,53 @@
+name: Bug report
+description: The validator, CLI or GitHub Action does something it should not.
+labels: [bug]
+body:
+  - type: markdown
+    attributes:
+      value: |
+        Thanks for reporting. For security problems (for example a record admitted that a
+        documented rule should reject), use [private reporting](https://github.com/NingyuSUN/bioai-evidence-validator/security/advisories/new) instead.
+        **Do not paste real patient data**; a synthetic record that shows the behavior is enough.
+  - type: input
+    id: version
+    attributes:
+      label: Version
+      description: Output of `pip show bioai-evidence-validator` or `bioevidence --help` header, or the commit.
+      placeholder: "0.7.0"
+    validations:
+      required: true
+  - type: textarea
+    id: command
+    attributes:
+      label: Command or code
+      description: The exact command or Python call, including `--profile`.
+      render: shell
+    validations:
+      required: true
+  - type: textarea
+    id: input
+    attributes:
+      label: Smallest record, draft or profile that reproduces it
+      render: yaml
+    validations:
+      required: true
+  - type: textarea
+    id: expected
+    attributes:
+      label: Expected result
+      description: Which status, reason code or exit code did you expect, and which rule says so?
+    validations:
+      required: true
+  - type: textarea
+    id: actual
+    attributes:
+      label: Actual result
+      description: The report's `overall_status`, `findings` and exit code, or the error message.
+      render: json
+    validations:
+      required: true
+  - type: input
+    id: environment
+    attributes:
+      label: Environment
+      placeholder: "Python 3.12, Ubuntu 24.04"

bioai_evidence_validator-0.7.0/.github/ISSUE_TEMPLATE/config.yml

@@ -0,0 +1,8 @@
+blank_issues_enabled: true
+contact_links:
+  - name: Security vulnerability
+    url: https://github.com/NingyuSUN/bioai-evidence-validator/security/advisories/new
+    about: Report privately; please do not open a public issue.
+  - name: Documentation
+    url: https://github.com/NingyuSUN/bioai-evidence-validator#readme
+    about: Usage, draft format, profiles and benchmarks.

bioai_evidence_validator-0.7.0/.github/ISSUE_TEMPLATE/feature_request.yml

@@ -0,0 +1,28 @@
+name: Feature request
+description: Propose a change to the engine, CLI, formats or integrations.
+labels: [enhancement]
+body:
+  - type: textarea
+    id: problem
+    attributes:
+      label: Problem
+      description: What are you trying to do, and what gets in the way today?
+    validations:
+      required: true
+  - type: textarea
+    id: proposal
+    attributes:
+      label: Proposal
+      description: The behavior you would like. For new rules, describe a record that should pass and one that should not.
+    validations:
+      required: true
+  - type: textarea
+    id: failure
+    attributes:
+      label: Failure mode
+      description: If this goes wrong, does it admit too much or block too much? How would a user notice?
+  - type: textarea
+    id: alternatives
+    attributes:
+      label: Alternatives considered
+      description: For example, doing it in a profile or an importer instead of the engine.

bioai_evidence_validator-0.7.0/.github/ISSUE_TEMPLATE/profile_proposal.yml

@@ -0,0 +1,42 @@
+name: Domain profile proposal
+description: Propose an admission profile for a biological domain.
+labels: [profile]
+body:
+  - type: markdown
+    attributes:
+      value: |
+        Profiles decide which evidence each intended use requires; they do not change the engine.
+        See [docs/PROFILES.md](https://github.com/NingyuSUN/bioai-evidence-validator/blob/main/docs/PROFILES.md)
+        and the [community profile template](https://github.com/NingyuSUN/bioai-evidence-validator/tree/main/community/profiles/_template).
+  - type: input
+    id: domain
+    attributes:
+      label: Domain and assertion
+      placeholder: "Protein–protein interactions: protein A interacts_with protein B"
+    validations:
+      required: true
+  - type: textarea
+    id: uses
+    attributes:
+      label: Intended uses and their evidence requirements
+      description: For each use (e.g. research summary, knowledge-base admission, training data), which evidence types are required, and is human acceptance required?
+    validations:
+      required: true
+  - type: textarea
+    id: basis
+    attributes:
+      label: Basis for the policy
+      description: Community guideline, database policy or published standard the requirements follow (with links), or state that it is your own proposal.
+    validations:
+      required: true
+  - type: textarea
+    id: cases
+    attributes:
+      label: Example cases
+      description: At least one claim that should be admitted and one that should not, with the reason.
+  - type: checkboxes
+    id: pr
+    attributes:
+      label: Contribution
+      options:
+        - label: I am willing to open a pull request with the profile and example cases.

bioai_evidence_validator-0.7.0/.github/pull_request_template.md

@@ -0,0 +1,18 @@
+## What and why
+
+<!-- One purpose per pull request. Link the issue: "Closes #123". -->
+
+## Admission boundary
+
+<!-- Does this change what gets admitted, sent to review or rejected? If yes, say which
+     records move and why, and point to the tests that pin the new boundary. -->
+
+- [ ] No change to admission decisions
+- [ ] Changes admission decisions (explained above; tests on both sides of the boundary)
+
+## Checklist
+
+- [ ] `uv run --frozen ruff check .`, `uv run --frozen mypy` and `uv run --frozen pytest --cov` pass
+- [ ] Committed benchmark results regenerated if report contents changed
+- [ ] `CHANGELOG.md` updated if users will notice
+- [ ] New third-party data has its license, attribution and exact version recorded

{bioai_evidence_validator-0.5.0 → bioai_evidence_validator-0.7.0}/.github/workflows/ci.yml

@@ -6,6 +6,23 @@ on:
 permissions:
   contents: read
 jobs:
+  lint:
+    timeout-minutes: 10
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v4
+      - uses: actions/setup-python@v5
+        with:
+          python-version: '3.12'
+      - name: Install locked tooling
+        run: python -m pip install uv==0.12.17
+      - name: Install locked project
+        run: uv sync --frozen --extra dev
+      - name: Lint
+        run: uv run --frozen ruff check --output-format github .
+      - name: Type-check
+        run: uv run --frozen mypy
+
   verify:
     timeout-minutes: 15
     strategy:
@@ -29,8 +46,12 @@ jobs:
         run: python -m pip install uv==0.12.17
       - name: Install locked project
         run: uv sync --frozen --extra dev --python ${{ matrix.python }}
-      - name: Run tests
-        run: uv run --frozen pytest
+      - name: Run tests with coverage (minimum in pyproject.toml)
+        run: uv run --frozen pytest --cov --cov-report=term
+      - name: Coverage summary
+        if: always()
+        shell: bash
+        run: uv run --frozen coverage report --format=markdown >> "$GITHUB_STEP_SUMMARY" || true
       - name: Build distributable
         run: uv build
       - name: Verify installed wheel and CLI outside editable source

bioai_evidence_validator-0.7.0/.github/workflows/docs.yml

@@ -0,0 +1,43 @@
+name: Documentation
+on:
+  push:
+    branches: [main]
+  pull_request:
+  workflow_dispatch:
+permissions:
+  contents: read
+concurrency:
+  group: docs-${{ github.ref }}
+  cancel-in-progress: true
+jobs:
+  build:
+    timeout-minutes: 10
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v4
+      - uses: actions/setup-python@v5
+        with:
+          python-version: '3.12'
+      # Pinned: MkDocs 2.0 drops the plugin and theme system this site uses.
+      - name: Install MkDocs
+        run: python -m pip install mkdocs==1.6.1 mkdocs-material==9.7.7
+      - name: Build with strict link checking
+        run: mkdocs build --strict --site-dir _site
+      - if: github.event_name != 'pull_request'
+        uses: actions/upload-pages-artifact@v3
+        with:
+          path: _site
+
+  deploy:
+    if: github.event_name != 'pull_request'
+    needs: build
+    runs-on: ubuntu-latest
+    permissions:
+      pages: write
+      id-token: write
+    environment:
+      name: github-pages
+      url: ${{ steps.deployment.outputs.page_url }}
+    steps:
+      - id: deployment
+        uses: actions/deploy-pages@v4

{bioai_evidence_validator-0.5.0 → bioai_evidence_validator-0.7.0}/.gitignore

@@ -7,3 +7,7 @@ dist/
 build/
 artifacts/
 validation_report.json
+_site/
+site/
+.coverage
+htmlcov/

{bioai_evidence_validator-0.5.0 → bioai_evidence_validator-0.7.0}/CHANGELOG.md

@@ -1,5 +1,38 @@
 # Changelog
 
+## 0.7.0 — Expert review, quality checks, community and documentation site
+
+- Add `bioevidence review` (`check`, `agreement`, `adjudication-sheet`, `score`, `freeze`)
+  implementing the gold-standard protocol: strict annotation checks, Krippendorff's α with
+  bootstrap interval and Cohen's κ (both cross-checked against reference implementations),
+  adjudication of disagreements, scoring on the test split with hash-bound joins, and frozen
+  manifests. It never produces labels.
+- Add a blinded ClinVar expert-review kit (`evaluation/clinvar_review/`): all 95 variants where
+  the validator and NCBI disagree plus 95 stratum-matched controls, an Excel workbook with
+  dropdowns, a reviewer rubric, a private key, and an importer into the protocol format.
+- CI runs ruff and mypy, and enforces a 95% test-coverage minimum (currently 98%).
+- Add CONTRIBUTING, CODE_OF_CONDUCT (Contributor Covenant 2.1), SECURITY, issue forms and a
+  pull request template.
+- Add `community/profiles/`: contributed domain profiles whose example cases are built,
+  validated and checked against expected outcomes in CI; `_template/` to copy.
+- Add a documentation site (MkDocs, strict link checking) published to GitHub Pages.
+- The canine 0.3 implementation is also preserved at the `canine-0.3` tag.
+- No change to validation decisions or report format; both benchmarks reproduce 0.6.0 exactly
+  apart from `validator_version`.
+
+## 0.6.0 — ClinVar case and standards alignment
+
+- Add a second real-data case: ClinVar germline classifications. 5,026 sampled variants
+  from the 2023-09 release are built from per-submission evidence and validated with a
+  ClinVar-style profile; decisions are compared with NCBI's own 2023-09 review status and
+  with each classification's 2026-09 outcome, plus controlled faults and a trust-boundary
+  cohort. Frozen, hash-pinned sample; rebuild script verifies the three upstream files.
+- Add `docs/STANDARDS.md`, mapping the record model to ECO, Biolink 4.4.4, GA4GH VA-Spec
+  1.0.1 and PROV-O, with mapping strength and caveats.
+- Annotate `ExtractionMethod` values with ECO meanings in the LinkML schema. The compiled
+  JSON Schema, and therefore every report's `schema_sha256`, is unchanged.
+- The VBO benchmark summary changes only `validator_version`.
+
 ## 0.5.0 — Drafts, LLM draft schema and GitHub Action
 
 - Add compact YAML/JSON drafts: `bioevidence build` and `build_record()` derive identifiers,

{bioai_evidence_validator-0.5.0 → bioai_evidence_validator-0.7.0}/CITATION.cff

@@ -9,7 +9,7 @@ abstract: >-
 authors:
   - family-names: Sun
     given-names: Ningyu
-version: 0.5.0
+version: 0.7.0
 license: Apache-2.0
 repository-code: "https://github.com/NingyuSUN/bioai-evidence-validator"
 keywords:

bioai_evidence_validator-0.7.0/CODE_OF_CONDUCT.md

@@ -0,0 +1,16 @@
+# Code of conduct
+
+This project adopts the
+[Contributor Covenant, version 2.1](https://www.contributor-covenant.org/version/2/1/code_of_conduct/)
+as its code of conduct. It applies to all project spaces (issues, pull requests,
+discussions and reviews) and to anyone representing the project elsewhere.
+
+In short: be respectful and constructive, assume good faith, critique work rather than
+people, and remember that contributors bring expertise from many fields, from biocuration
+to software engineering.
+
+## Reporting
+
+Report unacceptable behavior to the maintainer, Ningyu Sun, at <woshiwosunny@gmail.com>.
+Reports are handled confidentially, and the enforcement guidelines of the Contributor
+Covenant 2.1 apply.

bioai_evidence_validator-0.7.0/CONTRIBUTING.md

@@ -0,0 +1,76 @@
+# Contributing
+
+Thanks for helping make AI-assisted biocuration safer. Contributions of every size are
+welcome: a typo fix, a bug report with a failing record, a new domain profile, or a new
+real-data benchmark.
+
+By participating you agree to follow the [code of conduct](CODE_OF_CONDUCT.md).
+
+## Ways to contribute
+
+| You have… | Start here |
+|---|---|
+| A record the validator judges wrongly | [Bug report](https://github.com/NingyuSUN/bioai-evidence-validator/issues/new?template=bug_report.yml); attach the smallest record or draft that reproduces it |
+| An admission policy for your domain | [Profile proposal](https://github.com/NingyuSUN/bioai-evidence-validator/issues/new?template=profile_proposal.yml), then a pull request to [`community/profiles/`](community/profiles/README.md) |
+| An idea for the engine, CLI or formats | [Feature request](https://github.com/NingyuSUN/bioai-evidence-validator/issues/new?template=feature_request.yml) first, so we can agree on the contract before code |
+| A security problem | Do **not** open an issue; see [SECURITY.md](SECURITY.md) |
+
+Issues labelled [`good first issue`](https://github.com/NingyuSUN/bioai-evidence-validator/labels/good%20first%20issue)
+are scoped to be finished in an afternoon.
+
+## Development setup
+
+Python 3.11+ and [uv](https://docs.astral.sh/uv/):
+
+```bash
+git clone https://github.com/NingyuSUN/bioai-evidence-validator.git
+cd bioai-evidence-validator
+uv sync --frozen --extra dev
+```
+
+Before opening a pull request, run what CI runs:
+
+```bash
+uv run --frozen ruff check .
+uv run --frozen mypy
+uv run --frozen pytest --cov
+```
+
+CI also runs the tests on Linux (Python 3.11–3.13) and Windows, builds the wheel and
+smoke-tests it outside the source tree, and runs the GitHub Action. Coverage must stay at
+or above the minimum in `pyproject.toml`.
+
+## Ground rules for changes
+
+This project's value is that it **fails closed** and **says exactly what it checked**.
+Changes are reviewed against that:
+
+- **No silent weakening.** A change that admits something previously rejected needs an
+  explicit reason in the pull request and a test that shows the new boundary.
+- **Every rule has a test on both sides**: a record that passes and a minimal one that fails.
+- **Reports stay reproducible.** If a change alters report contents, the committed benchmark
+  results must be regenerated in the same pull request, and the diff explained.
+- **Domain logic stays out of the engine.** New domains are profiles and importers, not
+  special cases in `engine.py`.
+- **Honest limits.** Benchmarks state what their labels are (source-derived, authored, or
+  independently reviewed) and what they do not measure.
+- Match the surrounding style; ruff enforces correctness rules, not formatting.
+
+## Contributing a domain profile
+
+Community profiles live in [`community/profiles/`](community/profiles/README.md). Each one is
+a folder with a profile, a short README and example cases whose expected outcomes are
+checked by the test suite. Copy `community/profiles/_template/` to get started.
+
+## Pull requests
+
+- Keep each pull request to one purpose; link the issue it resolves.
+- Update `CHANGELOG.md` under a new heading if users will notice the change.
+- New third-party data needs its license, attribution and exact source version recorded,
+  as in `examples/*/sources/README.md`.
+
+## Releases
+
+Maintainers release by bumping the version in `pyproject.toml` and
+`src/bioevidence_validator/__init__.py`, adding a `CHANGELOG.md` section, and pushing a
+`vX.Y.Z` tag. The release workflow tests, publishes to PyPI and creates the GitHub release.

{bioai_evidence_validator-0.5.0 → bioai_evidence_validator-0.7.0}/PKG-INFO

@@ -1,9 +1,9 @@
 Metadata-Version: 2.5
 Name: bioai-evidence-validator
-Version: 0.5.0
+Version: 0.7.0
 Summary: Standards-aligned evidence policy validation for AI-assisted biological curation
 Project-URL: Homepage, https://github.com/NingyuSUN/bioai-evidence-validator
-Project-URL: Documentation, https://github.com/NingyuSUN/bioai-evidence-validator/tree/main/docs
+Project-URL: Documentation, https://ningyusun.github.io/bioai-evidence-validator/
 Project-URL: Changelog, https://github.com/NingyuSUN/bioai-evidence-validator/blob/main/CHANGELOG.md
 Project-URL: Issues, https://github.com/NingyuSUN/bioai-evidence-validator/issues
 Author: Ningyu Sun
@@ -25,7 +25,13 @@ Requires-Dist: jsonschema<5,>=4.23
 Requires-Dist: linkml<2,>=1.8
 Requires-Dist: pyyaml<7,>=6.0
 Provides-Extra: dev
+Requires-Dist: mypy<3,>=2.3; extra == 'dev'
+Requires-Dist: openpyxl<4,>=3.1; extra == 'dev'
+Requires-Dist: pytest-cov<8,>=7; extra == 'dev'
 Requires-Dist: pytest<9,>=8; extra == 'dev'
+Requires-Dist: ruff<0.17,>=0.16; extra == 'dev'
+Requires-Dist: types-jsonschema; extra == 'dev'
+Requires-Dist: types-pyyaml; extra == 'dev'
 Description-Content-Type: text/markdown
 
 # BioAI Evidence Validator
@@ -35,6 +41,7 @@ Description-Content-Type: text/markdown
 [![Python 3.11+](https://img.shields.io/badge/python-3.11%2B-blue)](https://github.com/NingyuSUN/bioai-evidence-validator/blob/main/pyproject.toml)
 [![License: Apache-2.0](https://img.shields.io/badge/license-Apache--2.0-blue)](https://github.com/NingyuSUN/bioai-evidence-validator/blob/main/LICENSE)
 [![Open in Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/NingyuSUN/bioai-evidence-validator/blob/main/examples/quickstart.ipynb)
+[![Docs](https://img.shields.io/badge/docs-site-blue)](https://ningyusun.github.io/bioai-evidence-validator/)
 
 **Stop AI-extracted biological claims from entering your knowledge base or
 training set before their evidence is good enough for that use.**
@@ -52,6 +59,7 @@ pip install bioai-evidence-validator
 
 Or try it in the browser, nothing to install:
 [quickstart notebook on Colab](https://colab.research.google.com/github/NingyuSUN/bioai-evidence-validator/blob/main/examples/quickstart.ipynb).
+Full documentation: **[ningyusun.github.io/bioai-evidence-validator](https://ningyusun.github.io/bioai-evidence-validator/)**.
 
 ## 30-second example
 
@@ -103,9 +111,12 @@ record is trustworthy enough for a particular purpose.
 | Provenance consistency (source hashes, resolved references, scope) | — | ✅ |
 | Human adjudications bound to a specific statement and use | — | ✅ |
 | Machine-readable audit report with hashes of input, schema and profile | — | ✅ |
+| Mapped to ECO, Biolink and GA4GH VA-Spec ([standards alignment](https://github.com/NingyuSUN/bioai-evidence-validator/blob/main/docs/STANDARDS.md)) | — | ✅ |
 
-On the real-data benchmark below, schema-only checks admitted **160/160**
-injected faults; the full validator admitted **0/160**.
+On both real-data benchmarks below, schema-only checks admitted **160/160**
+injected faults; the full validator admitted **0/160**. On ClinVar, 1★ and 2★ variants
+the validator holds back were **about 4–5× more likely** to be reclassified or put in
+conflict three years later.
 
 ## Use it
 
@@ -178,7 +189,7 @@ jobs:
     runs-on: ubuntu-latest
     steps:
       - uses: actions/checkout@v4
-      - uses: NingyuSUN/bioai-evidence-validator@v0.5.0
+      - uses: NingyuSUN/bioai-evidence-validator@v0.7.0
         with:
           files: records/**/*.yaml        # whitespace-separated globs
           format: draft                   # or: record (default)
@@ -250,7 +261,36 @@ Use the [annotation templates](https://github.com/NingyuSUN/bioai-evidence-valid
 source version and intended use. Document reviewer roles and whether labels are
 single-reviewed or independently reviewed by multiple people.
 
-## Real-data case
+## Real-data cases
+
+### ClinVar germline classifications, three years later
+
+The [ClinVar case](https://github.com/NingyuSUN/bioai-evidence-validator/blob/main/examples/clinvar_germline/README.md)
+turns every 2023-09 lab submission into evidence, validates 5,026 sampled variants with a
+ClinVar-style profile, and checks what happened to them by 2026-09.
+
+![ClinVar benchmark: share of 2023 pathogenic classifications reclassified or conflicting by 2026, with and without a dissenting submission, and false admissions under controlled faults and the trust boundary](https://raw.githubusercontent.com/NingyuSUN/bioai-evidence-validator/main/docs/assets/clinvar_germline_benchmark.svg)
+
+- **Policy reproduction:** the profile matches NCBI's own 2023-09 review status on 98–99% of
+  decisions; every disagreement is listed with its cause.
+- **Where the validator is stricter, classifications were less stable.** It sends any P/LP
+  variant with a dissenting submission to review, even when ClinVar's aggregate does not.
+  Across all 218,920 germline P/LP variants, the share later reclassified or put in conflict:
+
+| 2023-09 ClinVar review status | No dissenting submission | With one (validator: review) |
+|---|---:|---:|
+| 1★ single submitter | 2.63% (2.54–2.71) | **13.77%** (11.46–16.47) |
+| 2★ multiple submitters | 2.19% (2.05–2.33) | **8.32%** (6.51–10.59) |
+| 3★ expert panel | 0.07% (0.03–0.16) | **1.30%** (0.63–2.66) |
+
+Wilson 95% intervals. Stability is not correctness, and this is observational; see the
+case's interpretation limits. Not for clinical use.
+
+```bash
+uv run python examples/clinvar_germline/run.py --output artifacts/clinvar
+```
+
+### VBO canine name mapping
 
 [VBO canine name mapping](https://github.com/NingyuSUN/bioai-evidence-validator/blob/main/examples/vbo_canine/README.md) uses a frozen public ontology:
 72 real-name cases, 160 controlled errors, and 16 separately reported trust-boundary
@@ -261,7 +301,7 @@ per-required-evidence-type validation. Source-derived labels are not expert anno
 uv run python examples/vbo_canine/run.py --output artifacts/vbo-canine
 ```
 
-### Benchmark results (v0.4.1)
+#### Benchmark results (v0.4.1)
 
 ![VBO canine benchmark comparing false admissions across three validation methods](https://raw.githubusercontent.com/NingyuSUN/bioai-evidence-validator/main/docs/assets/vbo_canine_benchmark.svg)
 
@@ -271,20 +311,31 @@ On 72 real-source name mappings, the full validator admitted all 48 unambiguous
 
 ## Scope
 
-The VBO case uses attributed public data; other fixtures are synthetic.
+The VBO and ClinVar cases use attributed public data; other fixtures are synthetic.
 Admission means **the supplied record meets the selected
 profile**, not that a biological claim is true. The toolkit does not retrieve papers,
-verify reviewer identities, train models, or measure prediction accuracy. The generic core compares supplied hashes; the VBO importer also hashes its local source
-projection. External source truth and cohort independence require upstream verification.
+verify reviewer identities, train models, or measure prediction accuracy. The generic core compares supplied hashes; the VBO and ClinVar importers also hash their local source
+projections. External source truth and cohort independence require upstream verification.
+Neither benchmark has independent expert annotation yet; a blinded [expert-review kit](https://github.com/NingyuSUN/bioai-evidence-validator/tree/main/evaluation/clinvar_review) for the ClinVar case is ready for reviewers.
 
 ## Versions and branches
 
-`main` is the domain-neutral framework (0.5.0). The complete canine implementation
-and SQLite adapter from 0.3 live on the
-[`canine-breed` branch](https://github.com/NingyuSUN/bioai-evidence-validator/tree/canine-breed);
+`main` is the domain-neutral framework (0.7.0). The complete canine implementation
+and SQLite adapter from 0.3 are preserved at the
+[`canine-0.3` tag](https://github.com/NingyuSUN/bioai-evidence-validator/tree/canine-0.3)
+(also the `canine-breed` branch);
 see the [0.4 migration guide](https://github.com/NingyuSUN/bioai-evidence-validator/blob/main/docs/MIGRATION-0.4.md) and
 [changelog](https://github.com/NingyuSUN/bioai-evidence-validator/blob/main/CHANGELOG.md).
 
+## Contributing
+
+Bug reports, domain profiles and new benchmarks are welcome. See
+[CONTRIBUTING.md](https://github.com/NingyuSUN/bioai-evidence-validator/blob/main/CONTRIBUTING.md),
+the [community profiles](https://github.com/NingyuSUN/bioai-evidence-validator/tree/main/community/profiles)
+and issues labelled [`good first issue`](https://github.com/NingyuSUN/bioai-evidence-validator/labels/good%20first%20issue).
+Report security problems privately as described in
+[SECURITY.md](https://github.com/NingyuSUN/bioai-evidence-validator/blob/main/SECURITY.md).
+
 ## Citing
 
 If you use this toolkit in research, please cite it using the metadata in
@@ -293,6 +344,7 @@ If you use this toolkit in research, please cite it using the metadata in
 
 [Create a profile](https://github.com/NingyuSUN/bioai-evidence-validator/blob/main/docs/PROFILES.md) ·
 [Draft format](https://github.com/NingyuSUN/bioai-evidence-validator/blob/main/docs/DRAFTS.md) ·
+[Standards alignment](https://github.com/NingyuSUN/bioai-evidence-validator/blob/main/docs/STANDARDS.md) ·
 [Engineering contract](https://github.com/NingyuSUN/bioai-evidence-validator/blob/main/docs/ENGINEERING.md) ·
 [Design case study](https://github.com/NingyuSUN/bioai-evidence-validator/blob/main/docs/CASE_STUDY.md) ·
 [Architecture decision](https://github.com/NingyuSUN/bioai-evidence-validator/blob/main/docs/ADR-002-domain-neutral-main.md) ·