supercov 1.1.0 → 1.2.0

package/README.md

@@ -233,7 +233,7 @@ Java and Kotlin have no registry of their own here, so a JVM project takes the b
 | PHP | Coming soon | — | — |
 | C | Coming soon | — | — |
 
-The `npx` path requires Node.js 22 or newer; the other installs need no Node. Rust support currently uses Rust 1.95; cargo-nextest 0.9.138 and 0.9.140 are supported. Python support requires CPython 3.12 or newer and measures pytest and unittest runs. Ruby support requires Ruby 3.3 or newer (3.4 or newer for full measurement) and measures RSpec, Minitest, test-unit and Cucumber runs. Go support requires Go 1.22 or newer and measures `go test`. Java and Kotlin support requires a JDK 17 or newer with Maven or Gradle, and measures every JUnit Platform engine -- JUnit 5, JUnit 4 through Vintage, Kotest and Spock -- as well as TestNG.
+The `npx` path requires Node.js 22 or newer; the other installs need no Node. Rust support currently uses Rust 1.95; cargo-nextest 0.9.138 and 0.9.140 are supported. Python support requires CPython 3.9 or newer and measures pytest and unittest runs. Ruby support requires Ruby 3.3 or newer (3.4 or newer for full measurement) and measures RSpec, Minitest, test-unit and Cucumber runs. Go support requires Go 1.22 or newer and measures `go test`. Java and Kotlin support requires a JDK 17 or newer with Maven or Gradle, and measures every JUnit Platform engine -- JUnit 5, JUnit 4 through Vintage, Kotest and Spock -- as well as TestNG.
 
 ## Supported operating systems and architectures
 
@@ -245,7 +245,7 @@ The CLI is a single native binary. `npx supercov` selects the build for the mach
 | Linux | arm64, x64 | glibc 2.28 or newer (Debian 10, Ubuntu 18.10, RHEL 8 and later), or musl (Alpine); chosen automatically |
 | Windows | arm64, x64 | Windows 10 or newer |
 
-JavaScript, TypeScript, Python, Ruby, Rust, Go, Java and Kotlin suites are verified on Linux, macOS and Windows -- CPython 3.12, 3.13 and 3.14, Ruby 3.3, 3.4 and 4.0, and Go 1.22, 1.25, 1.26 and 1.27 on every one, and JDK 17 and 21 on every one that has them (Temurin publishes no 17 for arm64 Windows, so that pairing is 21 alone). Containers, VMs, and remote executors run the same Linux builds. Every release publishes the same binaries to npm, PyPI (`supercov-cli`, a wheel per platform) and RubyGems (`supercov`, a gem per platform except arm64 Windows, which Ruby has no platform for), and the source to crates.io (`supercov`).
+JavaScript, TypeScript, Python, Ruby, Rust, Go, Java and Kotlin suites are verified on Linux, macOS and Windows -- CPython 3.9 through 3.14 (on arm64 Windows, 3.9 and 3.10 as the x64 builds, since python.org publishes no arm64 build before 3.11), Ruby 3.3, 3.4 and 4.0, and Go 1.22, 1.25, 1.26 and 1.27 on every one, and JDK 17 and 21 on every one that has them (Temurin publishes no 17 for arm64 Windows, so that pairing is 21 alone). Containers, VMs, and remote executors run the same Linux builds. Every release publishes the same binaries to npm, PyPI (`supercov-cli`, a wheel per platform) and RubyGems (`supercov`, a gem per platform except arm64 Windows, which Ruby has no platform for), and the source to crates.io (`supercov`).
 
 ## Supported test suites
 
@@ -322,3 +322,9 @@ npx supercov clean             # remove all runs and the build cache
 ## Free and open source
 
 [MIT licensed](LICENSE). Inspect, extend, and run it anywhere.
+
+## Contributors
+
+- [@DaVinciTachyon](https://github.com/DaVinciTachyon)
+- [@Uhbif2](https://github.com/Uhbif2)
+- [@maik-intellicoach](https://github.com/maik-intellicoach)

package/docs/cli.md

@@ -395,6 +395,12 @@ By default, `clean` removes all stored runs and the isolated build cache.
 `--keep N` keeps the newest N runs. Cleanup removes only marker-owned Supercov
 storage.
 
+If Supercov itself fails to publish a run the tests already paid for, it keeps
+that run's raw evidence in `.supercov/failed-evidence/<run id>` and says so in
+the error. Report the failure with that directory: it is what diagnoses it. Only
+a full `clean` reclaims it -- `--keep N` leaves it alone -- and the summary says
+when it goes.
+
 ## Read bundled documentation
 
 ```sh supercov
@@ -410,7 +416,7 @@ terminal or offline environment after the package has been downloaded.
 
 | Variable | Use |
 | --- | --- |
-| `SUPERCOV_SOURCE_ROOTS` | Set comma-separated first-party source roots when automatic discovery is ambiguous |
+| `SUPERCOV_SOURCE_ROOTS` | Comma-separated directories or files that hold your own code, in any language; everything else is left out |
 | `SUPERCOV_TEST_KIND` | Label the wrapped command as a test level such as `unit` or `e2e` |
 
 Examples:

package/docs/evidence.md

@@ -110,6 +110,14 @@ Preview cleanup first. The final command removes all runs and the isolated build
 cache; `--keep 20` preserves the 20 newest runs. Cleanup removes only
 marker-owned Supercov data.
 
+### Evidence of a run that failed to publish
+
+A suite pays for its measurement in wall clock. If Supercov itself cannot
+publish a run the tests already finished, the run's raw evidence is kept in
+`.supercov/failed-evidence/<run-id>/` rather than going with the work directory,
+and the error names the path. Attach that directory to the bug report. A full
+`clean` reclaims it; `--keep N` does not.
+
 ## Understand test kinds
 
 Reports group tests by kind, such as unit, integration or E2E. Supercov uses

package/docs/getting-started.md

@@ -119,7 +119,7 @@ if anything is missing.
 - for Rust, the Rust 1.95 toolchain;
 - for Go, Go 1.22 or newer;
 - for Java and Kotlin, JDK 17 or newer, with Maven or Gradle;
-- for Python, CPython 3.12 or newer with pytest or unittest;
+- for Python, CPython 3.9 or newer with pytest or unittest;
 - for Ruby, Ruby 3.4 or newer with RSpec, Minitest, test-unit or Cucumber (3.3 measures lines, methods and simple branches only).
 
 The CLI is a native binary. `npx supercov` picks the build for your operating

package/docs/performance.md

@@ -95,6 +95,6 @@ flow, `--view nodes` or `--view edges` pages the details; `--compact` omits repe
 source text while keeping locations and credit reasons. See
 [Investigating assertion evidence](assertion-evidence.md#read-a-large-flow).
 
-The disposable `assertions.report.cache.json` file lives beside the map. A missing
-or damaged cache is rebuilt. Removing it affects the next query's speed, not
+The disposable `assertions.report.cache.json` and `assertions.summary.cache.json`
+files live beside the map. A missing or damaged cache is rebuilt. Removing it affects the next query's speed, not
 your saved explanations.

package/docs/supported-suites.md

@@ -184,14 +184,16 @@ attribution.
 
 | Runner | Attribution | Current requirement |
 | --- | --- | --- |
-| pytest | Exact test, worker, retry, and setup/call/teardown phase identity | CPython 3.12 or newer; run with `npx supercov -- pytest` or `python -m pytest` |
+| pytest | Exact test, worker, retry, and setup/call/teardown phase identity | CPython 3.9 or newer; run with `npx supercov -- pytest` or `python -m pytest` |
 | pytest-xdist | Exact per worker | Workers inherit the run through the environment |
 | pytest-rerunfailures | Exact per attempt; flaky tests are reported as such | |
 | `python -m unittest` | Exact test and setUp/test/tearDown phase identity | Serial in-process; skips and expected failures are recorded; subtest failures roll up to the parent test |
 
 Your project runs in place with its own interpreter and virtual environment.
-Supercov adds its monitoring and runner hooks through the process environment;
-you do not need to rewrite tests or configure a different build.
+Supercov adds its runner hooks through the process environment and places a
+probe for every obligation into each measured module as it is imported --
+nothing on disk changes, and tracebacks keep their line numbers. You do not
+need to rewrite tests or configure a different build.
 
 Coverage includes statements, functions, boolean decisions, loops,
 comprehensions, short-circuit operators, `match` cases and exception paths.
@@ -202,9 +204,11 @@ assertion checks.
 
 Interpreters launched with `-I`, `-E` or `-S` ignore the required startup hook
 and are not measured. Code compiled from strings at runtime has no source
-obligations. Completed observations can survive a hard kill, but a corrupt or
-exhausted evidence channel fails the run rather than reporting partial data as
-complete.
+obligations. A measured module imported before Supercov starts, or compiled
+past the import system, runs without probes; the run names it as a limitation
+rather than reporting it uncovered. What a test executed survives the process
+being killed -- `os._exit`, SIGTERM or SIGKILL -- but a corrupt or exhausted
+evidence channel fails the run rather than reporting partial data as complete.
 
 ```sh
 npx supercov -- pytest

package/docs/troubleshooting.md

@@ -41,6 +41,20 @@ npx supercov runs latest scope
 Do not broaden the roots to dependencies or generated output merely to remove a
 warning. The goal is an honest boundary around code the repository owns.
 
+## Too much is measured
+
+Vendored or generated code beside your own is measured like the rest of the
+repository. Name the directories or files that hold your own code; this works
+for every language:
+
+```sh supercov
+SUPERCOV_SOURCE_ROOTS=src npx supercov -- pytest
+SUPERCOV_SOURCE_ROOTS=app.py,core.py npx supercov -- python -m unittest
+```
+
+Everything outside the roots is left out, and `npx supercov runs latest scope`
+lists what was.
+
 ## The tests pass but coverage is missing
 
 First check runner and source scope:

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "supercov",
-  "version": "1.1.0",
+  "version": "1.2.0",
   "description": "Code quality and coverage for coding agents",
   "license": "MIT",
   "repository": {
@@ -56,6 +56,7 @@
     "test:rust-compiler-spikes": "cargo build -p supercov && node scripts/rust-libtest-companion-spike.mjs && node scripts/rust-async-attribution-spike.mjs && node scripts/rust-subprocess-attribution-spike.mjs && node scripts/rust-custom-harness-spike.mjs && node scripts/rust-libtest-builder-lifecycle-spike.mjs",
     "test": "cargo test --workspace",
     "test:react": "cargo build -p supercov && node scripts/rust-vitest-projects-integration.mjs && npm --prefix examples/react-verification ci && npm --prefix examples/react-verification run demo && node scripts/react-hydration-compatibility.mjs",
+    "test:release-tooling": "node --test tests/release/*.test.mjs",
     "test:runtime": "node --test tests/runtime/*.test.mjs",
     "test:fixture": "cargo build -p supercov && node scripts/rust-fixture-matrix.mjs",
     "test:packed-npx": "cargo build --release -p supercov && node scripts/packed-npx-integration.mjs",
@@ -64,7 +65,8 @@
     "test:watchdog": "cargo build -p supercov && node scripts/watchdog-integration.mjs",
     "test:engine-contract": "cargo build -p supercov && node scripts/engine-contract.mjs",
     "test:agent": "cargo build -p supercov && node scripts/agent-query-eval.mjs",
-    "test:engine": "cargo fmt --all -- --check && cargo clippy --workspace --all-targets -- -D warnings && cargo test --workspace && cargo build -p supercov && npm run test:runtime && npm run test:rust-assets && node scripts/rust-process-supervision.mjs && node scripts/rust-direct-node-integration.mjs && node scripts/rust-public-run-integration.mjs && node scripts/rust-embedded-runtime-integration.mjs && node scripts/rust-direct-vitest-integration.mjs && node scripts/rust-direct-jest-integration.mjs && node scripts/rust-direct-playwright-integration.mjs && node scripts/rust-custom-browser-playwright-integration.mjs && node scripts/rust-generic-esbuild-integration.mjs && node scripts/rust-generic-tsc-integration.mjs && node scripts/rust-generic-build-matrix.mjs && node scripts/rust-vite-playwright-integration.mjs",
+    "test:engine": "cargo fmt --all -- --check && cargo clippy --workspace --all-targets -- -D warnings && cargo test --workspace && npm run test:runtime && npm run test:rust-assets && npm run test:engine-integrations",
+    "test:engine-integrations": "cargo build -p supercov && node scripts/rust-process-supervision.mjs && node scripts/rust-direct-node-integration.mjs && node scripts/rust-public-run-integration.mjs && node scripts/rust-embedded-runtime-integration.mjs && node scripts/rust-direct-vitest-integration.mjs && node scripts/rust-direct-jest-integration.mjs && node scripts/rust-direct-playwright-integration.mjs && node scripts/rust-custom-browser-playwright-integration.mjs && node scripts/rust-generic-esbuild-integration.mjs && node scripts/rust-generic-tsc-integration.mjs && node scripts/rust-generic-build-matrix.mjs && node scripts/rust-vite-playwright-integration.mjs",
     "test:platform": "cargo test --workspace && cargo build -p supercov && node scripts/rust-process-supervision.mjs && node scripts/workspace-crash-integration.mjs",
     "test:native-package": "cargo build --release -p supercov && node scripts/native-package-integration.mjs && node scripts/native-release-set-integration.mjs",
     "test:pypi-wheel": "node scripts/pypi-wheel-integration.mjs",
@@ -76,9 +78,9 @@
     "test:clang-mcdc": "node scripts/clang-mcdc-oracle.mjs",
     "test:test262": "cargo build --release -p supercov && node scripts/test262-equivalence.mjs",
     "benchmark:check": "cargo build --release -p supercov && node scripts/rust-transform-benchmark.mjs",
-    "benchmark:python-monitoring": "cargo build -p supercov && node scripts/python-monitoring-benchmark.mjs",
-    "check": "cargo fmt --all -- --check && cargo clippy --workspace --all-targets -- -D warnings && npm run test && npm run test:runtime && npm run test:rust-assets && npm run test:assertion-maps && npm run test:sweep-target && npm run test:skip-guard && npm run test:windows-tls && node scripts/package-preflight.mjs && node scripts/verify-binstall-metadata.mjs --offline",
-    "release:check": "cargo clean && node scripts/sweep-target.mjs && npm run check && npm run test:engine && npm run test:go && npm run test:jvm && npm run test:launcher && npm run test:fixture && npm run test:watchdog && npm run test:engine-contract && npm run test:agent && npm run test:child-attribution && npm run test:host-loader && npm run test:python-monitoring && npm run test:ruby-coverage && npm run test:rust-public-cargo && npm run test:packed-npx && npm run test:clang-mcdc && npm run benchmark:check",
+    "benchmark:python": "cargo build -p supercov && node scripts/python-benchmark.mjs",
+    "check": "cargo fmt --all -- --check && cargo clippy --workspace --all-targets -- -D warnings && npm run test && npm run test:release-tooling && npm run test:runtime && npm run test:rust-assets && npm run test:assertion-maps && npm run test:sweep-target && npm run test:skip-guard && npm run test:windows-tls && node scripts/package-preflight.mjs && node scripts/verify-binstall-metadata.mjs --offline",
+    "release:check": "cargo clean && node scripts/sweep-target.mjs && npm run check && npm run test:engine && npm run test:go && npm run test:jvm && npm run test:launcher && npm run test:fixture && npm run test:watchdog && npm run test:engine-contract && npm run test:agent && npm run test:child-attribution && npm run test:host-loader && npm run test:python && npm run test:ruby-coverage && npm run test:rust-public-cargo && npm run test:packed-npx && npm run test:clang-mcdc && npm run benchmark:check",
     "release:bump": "node scripts/bump-version.mjs",
     "sweep": "node scripts/sweep-target.mjs",
     "oracle:rust": "cargo build --release -p supercov && node scripts/rust-coverage-oracle.mjs",
@@ -86,7 +88,7 @@
     "prepublishOnly": "npm run release:check",
     "test:child-attribution": "cargo build -p supercov && node scripts/rust-child-attribution-integration.mjs",
     "test:host-loader": "cargo build -p supercov && node scripts/rust-host-loader-integration.mjs",
-    "test:python-monitoring": "cargo build -p supercov && node scripts/python-monitoring-integration.mjs",
+    "test:python": "cargo build -p supercov && node scripts/python-integration.mjs",
     "test:ruby-coverage": "cargo build -p supercov && node scripts/ruby-coverage-integration.mjs",
     "test:go": "cargo test --no-fail-fast -p supercov-engine --test go_frontend --test go_run",
     "test:jvm": "cargo test --no-fail-fast -p supercov-engine --test jvm_frontend --test jvm_run -- --include-ignored --test-threads=1",
@@ -103,14 +105,14 @@
     "test:windows-tls": "node scripts/windows-tls-test.mjs"
   },
   "optionalDependencies": {
-    "@supercov/cli-darwin-arm64": "1.1.0",
-    "@supercov/cli-darwin-x64": "1.1.0",
-    "@supercov/cli-linux-arm64-gnu": "1.1.0",
-    "@supercov/cli-linux-arm64-musl": "1.1.0",
-    "@supercov/cli-linux-x64-gnu": "1.1.0",
-    "@supercov/cli-linux-x64-musl": "1.1.0",
-    "@supercov/cli-win32-arm64": "1.1.0",
-    "@supercov/cli-win32-x64": "1.1.0"
+    "@supercov/cli-darwin-arm64": "1.2.0",
+    "@supercov/cli-darwin-x64": "1.2.0",
+    "@supercov/cli-linux-arm64-gnu": "1.2.0",
+    "@supercov/cli-linux-arm64-musl": "1.2.0",
+    "@supercov/cli-linux-x64-gnu": "1.2.0",
+    "@supercov/cli-linux-x64-musl": "1.2.0",
+    "@supercov/cli-win32-arm64": "1.2.0",
+    "@supercov/cli-win32-x64": "1.2.0"
   },
   "peerDependencies": {
     "@playwright/test": ">=1.55.0",