@functional-systems/srcx 0.1.0-dev.14 → 0.1.0-dev.16

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/CHANGELOG.md CHANGED
@@ -2,6 +2,12 @@
2
2
 
3
3
  ## Unreleased
4
4
 
5
+ - Evaluate fixed-candidate CosQA semantic reranking with local Qwen, shared
6
+ duplicate scores, stable ties and separate official-ID/content metrics.
7
+
8
+ - Cross-check the retained CosQA lexical baseline with an independent offline
9
+ BM25 ranker and the same StandardAnalyzer tokenization.
10
+
5
11
  - Add pinned CoIR CoSQA and MTEB CodeSearchNet Python/Go retrieval baselines,
6
12
  sharing srcx query construction and using trec_eval metrics on official labels.
7
13
 
package/VALIDATION.md CHANGED
@@ -1,6 +1,21 @@
1
1
  # Validation record
2
2
 
3
- Date: 2026-09-25 (Asia/Seoul).
3
+ Date: 2026-09-26 (Asia/Seoul).
4
+
5
+ ## Fixed-candidate CosQA reranking
6
+
7
+ The [completed Qwen comparison](eval/COSQA-RERANK-RESULTS.md), run on September 26
8
+ (Asia/Seoul), improved exact-content hit@10 from 57.4% to 64.8% with roughly one
9
+ second of local model computation per query. All 500 original candidate pools
10
+ and duplicate-ID ordering were preserved. The report separates official-ID
11
+ metrics, content-equivalence diagnostics, regressions and local latency.
12
+
13
+ ## Independent CosQA BM25 cross-check
14
+
15
+ The [independent cross-check](eval/COSQA-BM25-RESULTS.md) reproduces lexical
16
+ quality after aligning score ties and documents duplicate-ID sensitivity in the
17
+ official task. Its supplemental content-equivalence metrics are distinct from
18
+ the unchanged official-label baseline.
4
19
 
5
20
  ## Public code retrieval baseline
6
21
 
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "@functional-systems/srcx",
3
- "version": "0.1.0-dev.14",
3
+ "version": "0.1.0-dev.16",
4
4
  "private": false,
5
5
  "description": "Version-aware code search on LambdaDB",
6
6
  "type": "module",
@@ -62,5 +62,5 @@
62
62
  "url": "https://github.com/lambdadb/srcx/issues"
63
63
  },
64
64
  "license": "Apache-2.0",
65
- "gitHead": "5a214d6124a84f831f4595c159576d319b94f7fc"
65
+ "gitHead": "1da86320e6ef5446b41f3d7f9d7d92d536a33132"
66
66
  }