ko-qmd 2.8.3-ko.7 → 2.8.3-ko.8

package/CHANGELOG.md

@@ -2,6 +2,25 @@
 
 ## [Unreleased]
 
+## [2.8.3-ko.8] - 2026-10-09
+
+- `structuredSearch` (MCP `searches`, SDK `search({ queries })`) no longer lets a relaxed
+  (any-word) first lex list keep the 2x positional boost: it now counts 0.25 instead of 1.0.
+  Even halved, a relaxed rank 1 still tied a vector rank 1 against a lex rank 4 (`hmu-05`
+  probe), so the decoy sharing a few question words kept rank 1 on the `rerank:false` path.
+  On the ko-vault seam form, hard `hybrid_r1` goes 0.4111 → 0.4444 with `full_r1` unchanged at
+  0.6111; one easy query (`sem-08`) trades hybrid rank 1 for 2 while its `full` rank 1 and all
+  recall@5 lines hold. Non-first relaxed lists still count half, as before.
+- Hangul loanword table gains 11 entries mined from real query-log traffic (`지연` →
+  `latency`, `병렬` → `parallel`, `게이트` → `gate`, `가드` → `guard`, `패널` → `panel`,
+  `팔레트` → `palette`, `하네스` → `harness`, `옵시디언` → `obsidian`, `백링크` → `backlink`,
+  `포즈` → `pause`, `루프` → `loop`). Native words from the same logs (`색인`·`질의`·`요약`·`문서`
+  …) stay unbridged. Query-side only, no re-index; ko-vault bench lines are unchanged.
+- Negation routing stays strip-only by measurement: demoting X with lex `-term`s was tried
+  and reverted — the expected note often discusses X itself (`bm25-ranking.md` mentions TF-IDF),
+  so NOT removed the answer with the decoy (`hybrid_r1` 0.4111 → 0.3778). `stripHangulNegation`
+  now shares its parsing through an internal split helper; behavior is unchanged.
+
 ## [2.8.3-ko.7] - 2026-10-02
 
 The query path is now observable and bounded. Every query-log row breaks its latency into

package/README.en.md

@@ -38,7 +38,7 @@ flowchart LR
   (`검색을` → `검색`), a two-particle chain (`청킹에서의` → `청킹`), verb and nominalizing endings
   (`토큰화하는` → `토큰화`, `검색하기` → `검색`), `한`/`된` endings (`필요한` → `필요`) and the 하↔해
   contraction. Quoted phrases, Hanja and kana are left as written.
-- **Loanword bridge** — about 80 built-in Hangul spellings of technical terms (`서치`, `웹`, `코어`,
+- **Loanword bridge** — about 90 built-in Hangul spellings of technical terms (`서치`, `웹`, `코어`,
   `마이그레이션`, …) also search their English spelling, so `하이브리드 서치` finds a `hybrid-search` note.
   Only the query changes; no re-index is needed.
 - **Mixed-script token split** — `SKILL.md계약의핵심` becomes `skill` AND `md` AND `계약의핵심`.

package/README.md

@@ -34,7 +34,7 @@ flowchart LR
 - **조사·어미 제거** — 따옴표 없는 한글 단어는 어간도 매칭한다. 끝 조사 하나(`검색을` → `검색`), 두 조사 연쇄(`청킹에서의` → `청킹`),
   동사·명사화 어미(`토큰화하는` → `토큰화`, `검색하기` → `검색`), `한`/`된` 어미(`필요한` → `필요`), 하↔해 축약(`더하` ↔ `더해`).
   따옴표 구문·한자·가나는 그대로 둔다.
-- **외래어 다리** — 기술 용어의 한글 표기(`서치`·`웹`·`코어`·`마이그레이션` 등 약 80개 내장 표)는 영문 표기도 함께 찾는다.
+- **외래어 다리** — 기술 용어의 한글 표기(`서치`·`웹`·`코어`·`마이그레이션` 등 약 90개 내장 표)는 영문 표기도 함께 찾는다.
   `하이브리드 서치`가 `hybrid-search` 노트를, `리액트 웹 코어`가 `react-web-core`를 찾는다. 질의 쪽만 바뀌므로 재색인은 필요 없다.
 - **문자 체계가 섞인 토큰 분리** — `SKILL.md계약의핵심`은 `skill` AND `md` AND `계약의핵심`으로 나눈다.
 - **긴 질의 완화** — 세 단어 이상 질의가 AND 로 한 건도 안 맞으면 같은 단어를 OR 로 다시 찾는다. 자연어 문장 질의가 0건이 되지 않는다.

package/dist/cli/build-info.json

@@ -1,4 +1,4 @@
 {
-  "commit": "ed12243",
-  "builtAt": "2026-10-02T04:28:17.608Z"
+  "commit": "6698cd5",
+  "builtAt": "2026-10-09T05:15:35.019Z"
 }

package/dist/hangul.js

@@ -65,24 +65,34 @@ export function sharesHangulBigram(a, b) {
     return false;
 }
 /**
- * Drop the excluded clause of a Korean negation query and keep what follows the
- * last marker (`tf-idf 말고 순위 공식` → `순위 공식`), so retrieval and rerank
- * never see the concept the user ruled out. Returns the query unchanged when a
- * side would be empty or hold only `-term` exclusions, a `"` phrase is present, or
- * no marker stands as its own token — a marker glued to X (`이거말고`) is not split.
+ * Split a "X 말고 Y" query at its last exclusion marker into the excluded (X)
+ * and kept (Y) token lists. Null when there is no rewrite: a `"` phrase is
+ * present, no Hangul, no standalone marker, an empty side, or a Y of only
+ * `-term` exclusions (lex needs a positive term to match).
  */
-export function stripHangulNegation(query) {
+function splitHangulNegation(query) {
     if (query.includes('"') || !containsHangul(query))
-        return query;
+        return null;
     const tokens = query.trim().split(/\s+/);
     const last = tokens.findLastIndex((token) => NEGATION_MARKERS.has(token));
     if (last < 1 || last === tokens.length - 1)
-        return query;
+        return null;
     const kept = tokens.slice(last + 1);
     // A Y of only `-term` exclusions leaves lex no positive term to match.
     if (kept.every((token) => token.startsWith("-")))
-        return query;
-    return kept.join(" ");
+        return null;
+    return { excluded: tokens.slice(0, last), kept };
+}
+/**
+ * Drop the excluded clause of a Korean negation query and keep what follows the
+ * last marker (`tf-idf 말고 순위 공식` → `순위 공식`), so retrieval and rerank
+ * never see the concept the user ruled out. Returns the query unchanged when a
+ * side would be empty or hold only `-term` exclusions, a `"` phrase is present, or
+ * no marker stands as its own token — a marker glued to X (`이거말고`) is not split.
+ */
+export function stripHangulNegation(query) {
+    const split = splitHangulNegation(query);
+    return split ? split.kept.join(" ") : query;
 }
 /**
  * Strip one trailing particle (or 기) from a pure-Hangul word when the stem
@@ -173,7 +183,9 @@ export function hangulTermQuery(term) {
  * ASCII words separated by single spaces so they are safe inside an FTS5 phrase.
  */
 const LOANWORDS = {
+    "가드": ["guard"],
     "가이드": ["guide"],
+    "게이트": ["gate"],
     "골든": ["golden"],
     "그래프": ["graph"],
     "노트": ["note"],
@@ -194,14 +206,17 @@ const LOANWORDS = {
     "리트리벌": ["retrieval"],
     "리피티션": ["repetition"],
     "린트": ["lint"],
+    "루프": ["loop"],
     "마이그레이션": ["migration"],
     "메타데이터": ["metadata"],
     "모델": ["model"],
     "미팅": ["meeting"],
     "바이그램": ["bigram"],
+    "백링크": ["backlink"],
     "벡터": ["vector"],
     "벤치": ["bench"],
     "벤치마크": ["benchmark"],
+    "병렬": ["parallel"],
     "서버": ["server"],
     "서치": ["search"],
     "세션": ["session"],
@@ -215,6 +230,7 @@ const LOANWORDS = {
     "엔그램": ["ngram", "n gram"],
     "오토메이션": ["automation"],
     "온리": ["only"],
+    "옵시디언": ["obsidian"],
     "워크플로": ["workflow"],
     "워크플로우": ["workflow"],
     "웹": ["web"],
@@ -227,6 +243,7 @@ const LOANWORDS = {
     "인제스트": ["ingest"],
     "인코더": ["encoder"],
     "임베딩": ["embedding"],
+    "지연": ["latency"],
     "청크": ["chunk"],
     "청킹": ["chunking"],
     "캐시": ["cache"],
@@ -242,6 +259,9 @@ const LOANWORDS = {
     "토픽": ["topic"],
     "트래킹": ["tracking"],
     "파이프라인": ["pipeline"],
+    "패널": ["panel"],
+    "팔레트": ["palette"],
+    "포즈": ["pause"],
     "퓨전": ["fusion"],
     "프로버넌스": ["provenance"],
     "프로비넌스": ["provenance"],
@@ -250,6 +270,7 @@ const LOANWORDS = {
     "프롬프트": ["prompt"],
     "플러그인": ["plugin"],
     "필터": ["filter"],
+    "하네스": ["harness"],
     "하이브리드": ["hybrid"],
     "훅": ["hook"],
 };

package/dist/store.d.ts

@@ -1080,14 +1080,6 @@ export type RankedListMeta = {
  * original vector boost.
  */
 export declare function getHybridRrfWeights(rankedListMeta: RankedListMeta[]): number[];
-/**
- * RRF list weights for structuredSearch: the first list gets 2x (the caller ordered by
- * importance), the rest 1x.
- *
- * ko-qmd: a relaxed FTS list counts half here too, as in getHybridRrfWeights. At a flat 2.0 a
- * lex line that only matched some of a question's words outranked the vector list, and a decoy
- * sharing a few of those words took rank 1 (test/fixtures/ko-vault/BASELINE.md 2026-09-27).
- */
 export declare function getStructuredRrfWeights(rankedListMeta: RankedListMeta[]): number[];
 /**
  * Blend a reranker score with a linear retrieval-position tiebreak.

package/dist/store.js

@@ -4601,11 +4601,15 @@ export function getHybridRrfWeights(rankedListMeta) {
  * ko-qmd: a relaxed FTS list counts half here too, as in getHybridRrfWeights. At a flat 2.0 a
  * lex line that only matched some of a question's words outranked the vector list, and a decoy
  * sharing a few of those words took rank 1 (test/fixtures/ko-vault/BASELINE.md 2026-09-27).
+ * ko-qmd: a relaxed first list forfeits the positional boost and halves again (0.25) — even
+ * halved, its rank 1 still tied a vector rank 1 with a lex rank 4 (hmu-05, 2026-10-09 probe).
  */
+const RELAXED_FIRST_LIST_WEIGHT = 0.25;
 export function getStructuredRrfWeights(rankedListMeta) {
     return rankedListMeta.map((meta, i) => {
-        const weight = i === 0 ? 2.0 : 1.0;
-        return meta.relaxed ? weight * RELAXED_LIST_WEIGHT : weight;
+        if (meta.relaxed)
+            return i === 0 ? RELAXED_FIRST_LIST_WEIGHT : RELAXED_LIST_WEIGHT;
+        return i === 0 ? 2.0 : 1.0;
     });
 }
 /**
@@ -4760,6 +4764,9 @@ const rerankDocuments = (candidates, docChunkMap) => candidates.flatMap((cand) =
  */
 export async function hybridQuery(store, rawQuery, options) {
     // ko-qmd: "X 말고 Y" names X to exclude — every list and the reranker see only Y.
+    // (Tried demoting X with lex -terms: falsified 2026-10-09 — the expected note
+    // often discusses X itself, e.g. bm25-ranking.md mentions TF-IDF, so NOT
+    // removes the answer along with the decoy.)
     const query = stripHangulNegation(rawQuery);
     const limit = options?.limit ?? 10;
     const minScore = options?.minScore ?? 0;

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "ko-qmd",
-  "version": "2.8.3-ko.7",
+  "version": "2.8.3-ko.8",
   "description": "Local hybrid search for Korean Markdown notes and Obsidian vaults — BM25 with Korean particle stripping, Hangul bigram FTS, Qwen3 vector search and LLM reranking, as CLI, MCP server and SDK",
   "type": "module",
   "main": "dist/index.js",