@functional-systems/srcx 0.1.0-dev.6 → 0.1.0-dev.7

package/CHANGELOG.md

@@ -2,11 +2,11 @@
 
 ## Unreleased
 
+- Default CLI search/read evaluation across two pinned public repositories, with
+  alternative answer sets, exact source verification, and complete stdout accounting.
 - Internal reproducible lexical chunking evaluation with pinned source labels,
   equal path-only enrichment, isolated live indexes, and token-budget metrics.
 
-## Unreleased
-
 ### Added
 
 - Persistent one-to-one Git branch / Collection Branch mapping, branch-local
@@ -27,6 +27,8 @@
 
 ### Fixed
 
+- Reject an unprepared CLI evaluation run before creating its root/lock so a
+  subsequent offline preparation can use the same path.
 - Pin branch control before enumerating versions so a concurrent publication
   cannot advance the selector beyond the version list being read.
 - Reject live checkpoint reuse across different code/harness inputs and preserve

package/README.md

@@ -84,6 +84,11 @@ window chunks on a fixed public corpus and 16 pinned investigation queries.
 `npm run eval:prepare` builds and validates the comparison offline. Live evaluation
 is an explicit separate operation and retains isolated evaluation Collections.
 
+The [default CLI workflow evaluation](https://github.com/lambdadb/srcx/blob/develop/eval/CLI-WORKFLOW.md)
+adds a second public repository and verifies real `search` → `read` results with
+the unchanged CLI preset. It uses normal repository Collections and separate local
+state; see its documented effects before opting into the live run.
+
 ## Explicit live acceptance run
 
 The live harness accepts `LAMBDADB_BASE_URL`, `LAMBDADB_PROJECT_NAME`, and

package/VALIDATION.md

@@ -12,6 +12,33 @@ concurrency, or retrieval-quality benchmark. npm publication evidence is recorde
 separately below. The persistent Git branch changes have a separate synthetic
 live run recorded next; the earlier live runs do not validate this new path.
 
+## Default CLI search/read evaluation
+
+The follow-up uses actual built CLI subprocesses with the unchanged default
+syntax/path-scope-symbol preset across pinned public `srcx` and `lambdadb-cli`
+commits. At harness commit `57b63e1cdbf7ec722b95bb0f40ac0ef5039af3e8`, both
+publications validated and all **136 search results/handles** and **76 read
+responses** matched their pinned source, version and citation. No embeddings
+were used. The run completed at `2026-09-24T20:01:58.865Z`.
+
+The frozen 16-question suite recovered complete labeled evidence for **14/16**.
+The two remaining cases reflect a one-byte blank-line boundary and an omitted
+alternative document/code answer, not demonstrated source-integrity failures.
+Mean full CLI stdout was **7,383 tokens** per query. This fixed-five-read protocol
+is distinct from the earlier full-chunk/token-budget comparison; neither measures
+general task success. Labels remain assistant-authored without independent human
+review. See [eval/CLI-RESULTS.md](https://github.com/lambdadb/srcx/blob/develop/eval/CLI-RESULTS.md)
+for per-repository scores, inspected misses and evidence boundaries, and
+[eval/CLI-WORKFLOW.md](https://github.com/lambdadb/srcx/blob/develop/eval/CLI-WORKFLOW.md)
+for reproduction and normal Collection effects.
+
+Local Node 24.15.0 passed **54 tests**, typechecking, formatting/version checks and
+the installed-package CLI contract. Node 22/24 CI passed at the harness commit.
+Live execution used built CLI subprocesses; package validation used a loopback
+fixture. A completed rerun preserved the original report bytes and timestamp.
+Raw evidence and recovery journals remain under `.srcx/cli-eval/` in the validation
+worktree; the older pilot's original report remains unchanged.
+
 ## Retrieval evaluation harness
 
 The internal pilot adds five checks for unique source-range scoring, token-budget

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@functional-systems/srcx",
-  "version": "0.1.0-dev.6",
+  "version": "0.1.0-dev.7",
   "private": false,
   "description": "Version-aware code search on LambdaDB",
   "type": "module",
@@ -35,7 +35,9 @@
     "test:package": "node scripts/test-package.mjs",
     "test:live:branches": "npm run build && node --env-file=.env.local scripts/live-branches.mjs",
     "eval:prepare": "npm run build && node scripts/retrieval-eval.mjs prepare",
-    "eval:run": "node scripts/retrieval-eval.mjs run"
+    "eval:run": "node scripts/retrieval-eval.mjs run",
+    "eval:cli:prepare": "npm run build && node scripts/cli-eval.mjs prepare",
+    "eval:cli:run": "node scripts/cli-eval.mjs run"
   },
   "dependencies": {
     "@functional-systems/lambdadb": "0.5.1",
@@ -58,5 +60,5 @@
     "url": "https://github.com/lambdadb/srcx/issues"
   },
   "license": "Apache-2.0",
-  "gitHead": "8c0d1656d4d66a6461a32e9072b2e5f7fda9cec1"
+  "gitHead": "c619d643dfd2d945fff1bc470cbfc5ba339dda77"
 }