agentcheckup 0.4.2__tar.gz → 0.4.4__tar.gz

{agentcheckup-0.4.2 → agentcheckup-0.4.4}/.github/ISSUE_TEMPLATE/config.yml

@@ -1,8 +1,8 @@
 blank_issues_enabled: false
 contact_links:
   - name: Question or idea
-    url: https://github.com/wanjiaqing/agentcheckup/discussions
+    url: https://github.com/jiaqinq/agentcheckup/discussions
     about: For open-ended discussion, use Discussions instead of an issue.
   - name: Security vulnerability
-    url: https://github.com/wanjiaqing/agentcheckup/security/advisories/new
+    url: https://github.com/jiaqinq/agentcheckup/security/advisories/new
     about: Please report security issues privately, not in a public issue.

{agentcheckup-0.4.2 → agentcheckup-0.4.4}/.github/workflows/publish.yml

@@ -7,7 +7,7 @@ name: Publish
 # publisher"):
 #   https://pypi.org/manage/account/publishing/
 #     PyPI Project Name : agentcheckup
-#     Owner             : wanjiaqing
+#     Owner             : jiaqinq
 #     Repository name   : agentcheckup
 #     Workflow name     : publish.yml
 #     Environment       : pypi

{agentcheckup-0.4.2 → agentcheckup-0.4.4}/CHANGELOG.md

@@ -91,8 +91,9 @@ trusts, so the scoring and the report both changed.
 ### Notes
 
 - Conflict detection produced **zero false positives** across the 18 real tools
-  from the three official servers. That is the number this project lives or dies
-  on, and it held.
+  from the three official servers. *(Corrected in 0.4.4: that measurement was
+  vacuous — those 18 tools contained no conflicts, so there was nothing to get
+  wrong. A real benchmark replaced it.)*
 
 ## [0.3.0] - 2026-11-07
 

{agentcheckup-0.4.2 → agentcheckup-0.4.4}/CONTRIBUTING.md

@@ -6,7 +6,7 @@ your first one takes about ten minutes.
 ## Setup
 
 ```bash
-git clone https://github.com/wanjiaqing/agentcheckup
+git clone https://github.com/jiaqinq/agentcheckup
 cd agentcheckup
 python -m venv .venv
 # Windows: .venv\Scripts\activate

{agentcheckup-0.4.2 → agentcheckup-0.4.4}/LICENSE

@@ -1,6 +1,6 @@
 MIT License
 
-Copyright (c) 2026 wanjiaqing
+Copyright (c) 2026 jiaqinq
 
 Permission is hereby granted, free of charge, to any person obtaining a copy
 of this software and associated documentation files (the "Software"), to deal

agentcheckup-0.4.2/README.md → agentcheckup-0.4.4/PKG-INFO

@@ -1,8 +1,36 @@
+Metadata-Version: 2.5
+Name: agentcheckup
+Version: 0.4.4
+Summary: Diagnose your agent setup: tool conflicts, risky config, context budget.
+Project-URL: Homepage, https://github.com/jiaqinq/agentcheckup
+Project-URL: Issues, https://github.com/jiaqinq/agentcheckup/issues
+Project-URL: Changelog, https://github.com/jiaqinq/agentcheckup/blob/main/CHANGELOG.md
+Author: jiaqinq
+License: MIT
+License-File: LICENSE
+Keywords: agents,ai,cli,linter,mcp,model-context-protocol,security
+Classifier: Development Status :: 3 - Alpha
+Classifier: Environment :: Console
+Classifier: Intended Audience :: Developers
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: Software Development :: Quality Assurance
+Classifier: Typing :: Typed
+Requires-Python: >=3.10
+Provides-Extra: dev
+Requires-Dist: pytest>=8; extra == 'dev'
+Requires-Dist: ruff>=0.6; extra == 'dev'
+Description-Content-Type: text/markdown
+
 # agentcheckup
 
 > Diagnose your agent setup before your agent does.
 
-[![CI](https://github.com/wanjiaqing/agentcheckup/actions/workflows/ci.yml/badge.svg)](https://github.com/wanjiaqing/agentcheckup/actions/workflows/ci.yml)
+[![CI](https://github.com/jiaqinq/agentcheckup/actions/workflows/ci.yml/badge.svg)](https://github.com/jiaqinq/agentcheckup/actions/workflows/ci.yml)
 [![PyPI](https://img.shields.io/pypi/v/agentcheckup.svg)](https://pypi.org/project/agentcheckup/)
 [![Python](https://img.shields.io/pypi/pyversions/agentcheckup.svg)](https://pypi.org/project/agentcheckup/)
 [![License: MIT](https://img.shields.io/badge/license-MIT-blue.svg)](LICENSE)
@@ -121,7 +149,7 @@ The fastest way to keep a manifest from regressing, and the version you pin is
 the version you run — the action installs from its own checkout.
 
 ```yaml
-- uses: wanjiaqing/agentcheckup@v0.4.2
+- uses: jiaqinq/agentcheckup@v0.4.4
   with:
     config: .mcp.json
     fail-on: warning
@@ -165,6 +193,11 @@ Each tool pair across servers is scored on two signals:
 - **name overlap** — normalised token Jaccard (`read_files` ≡ `read_file`)
 - **description overlap** — token Jaccard over stopword-stripped, plural-stemmed words
 
+Chinese is tokenised as character bigrams (`读取文件` → `读取`, `取文`, `文件`) rather
+than by a segmenter, because a segmenter is a dependency. It is cruder than a real
+word split, but without it every Chinese description produced an empty token set
+and two Chinese tools could never be compared at all.
+
 A pair is flagged when the descriptions overlap ≥ 65% **and** the names share a
 head noun, or when the blended score clears 0.55. The shared-noun requirement is
 what keeps `search_repositories` and `search_documents` apart — without it the
@@ -172,6 +205,30 @@ false-positive rate made the report untrustworthy, which is worse than no report
 
 It is a heuristic, and the docs say so. `AGT203` is a warning, not a verdict.
 
+## How well does conflict detection work?
+
+Measured, not asserted. `tests/fixtures/collision_benchmark.json` holds 44
+hand-labelled tool pairs — 20 that should be flagged, 24 that should not — and
+`scripts/benchmark.py` scores the detector against them:
+
+| | value |
+|---|---|
+| pairs | 44 (20 positive, 24 negative) |
+| precision | **0.952** |
+| recall | **1.000** |
+| F1 | 0.976 |
+
+The one disagreement is a pair like `lookup_contact` / `lookup_user` with
+near-identical descriptions: the detector flags it, the label says it should not.
+That is arguably the detector being right and the label being strict.
+
+Two honest caveats. The labels are the author's, not users' — the criterion was
+"would a model picking the wrong one get a materially different result". And this
+benchmark did not exist before 0.4.4; the earlier claim of "zero false positives"
+came from running on 18 tools that contained no conflicts at all, which measured
+nothing. `tests/test_benchmark.py` fails the build if precision or recall drops
+below 0.90.
+
 ## How the score works
 
 Most linters fail here: a rule that fires on 18 of 18 tools is a *preference*,
@@ -223,6 +280,10 @@ rule. A report nobody can read is a report nobody acts on.
 - Not an MCP protocol validator. It checks quality and safety, not conformance —
   the official `modelcontextprotocol/conformance` suite does that.
 
+## Further reading
+
+- [多个 MCP Server 一起使用时，如何检测工具冲突？](https://juejin.cn/post/7704995965740580904) — the design story, in Chinese: why the scope changed from a single-server linter to cross-server conflicts, and how the scoring was rebuilt after it graded the official servers 0/100.
+
 ## Contributing
 
 Adding a rule takes about ten minutes and one small file — see

agentcheckup-0.4.2/PKG-INFO → agentcheckup-0.4.4/README.md

@@ -1,36 +1,8 @@
-Metadata-Version: 2.5
-Name: agentcheckup
-Version: 0.4.2
-Summary: Diagnose your agent setup: tool conflicts, risky config, context budget.
-Project-URL: Homepage, https://github.com/wanjiaqing/agentcheckup
-Project-URL: Issues, https://github.com/wanjiaqing/agentcheckup/issues
-Project-URL: Changelog, https://github.com/wanjiaqing/agentcheckup/blob/main/CHANGELOG.md
-Author: wanjiaqing
-License: MIT
-License-File: LICENSE
-Keywords: agents,ai,cli,linter,mcp,model-context-protocol,security
-Classifier: Development Status :: 3 - Alpha
-Classifier: Environment :: Console
-Classifier: Intended Audience :: Developers
-Classifier: License :: OSI Approved :: MIT License
-Classifier: Programming Language :: Python :: 3
-Classifier: Programming Language :: Python :: 3.10
-Classifier: Programming Language :: Python :: 3.11
-Classifier: Programming Language :: Python :: 3.12
-Classifier: Programming Language :: Python :: 3.13
-Classifier: Topic :: Software Development :: Quality Assurance
-Classifier: Typing :: Typed
-Requires-Python: >=3.10
-Provides-Extra: dev
-Requires-Dist: pytest>=8; extra == 'dev'
-Requires-Dist: ruff>=0.6; extra == 'dev'
-Description-Content-Type: text/markdown
-
 # agentcheckup
 
 > Diagnose your agent setup before your agent does.
 
-[![CI](https://github.com/wanjiaqing/agentcheckup/actions/workflows/ci.yml/badge.svg)](https://github.com/wanjiaqing/agentcheckup/actions/workflows/ci.yml)
+[![CI](https://github.com/jiaqinq/agentcheckup/actions/workflows/ci.yml/badge.svg)](https://github.com/jiaqinq/agentcheckup/actions/workflows/ci.yml)
 [![PyPI](https://img.shields.io/pypi/v/agentcheckup.svg)](https://pypi.org/project/agentcheckup/)
 [![Python](https://img.shields.io/pypi/pyversions/agentcheckup.svg)](https://pypi.org/project/agentcheckup/)
 [![License: MIT](https://img.shields.io/badge/license-MIT-blue.svg)](LICENSE)
@@ -149,7 +121,7 @@ The fastest way to keep a manifest from regressing, and the version you pin is
 the version you run — the action installs from its own checkout.
 
 ```yaml
-- uses: wanjiaqing/agentcheckup@v0.4.2
+- uses: jiaqinq/agentcheckup@v0.4.4
   with:
     config: .mcp.json
     fail-on: warning
@@ -193,6 +165,11 @@ Each tool pair across servers is scored on two signals:
 - **name overlap** — normalised token Jaccard (`read_files` ≡ `read_file`)
 - **description overlap** — token Jaccard over stopword-stripped, plural-stemmed words
 
+Chinese is tokenised as character bigrams (`读取文件` → `读取`, `取文`, `文件`) rather
+than by a segmenter, because a segmenter is a dependency. It is cruder than a real
+word split, but without it every Chinese description produced an empty token set
+and two Chinese tools could never be compared at all.
+
 A pair is flagged when the descriptions overlap ≥ 65% **and** the names share a
 head noun, or when the blended score clears 0.55. The shared-noun requirement is
 what keeps `search_repositories` and `search_documents` apart — without it the
@@ -200,6 +177,30 @@ false-positive rate made the report untrustworthy, which is worse than no report
 
 It is a heuristic, and the docs say so. `AGT203` is a warning, not a verdict.
 
+## How well does conflict detection work?
+
+Measured, not asserted. `tests/fixtures/collision_benchmark.json` holds 44
+hand-labelled tool pairs — 20 that should be flagged, 24 that should not — and
+`scripts/benchmark.py` scores the detector against them:
+
+| | value |
+|---|---|
+| pairs | 44 (20 positive, 24 negative) |
+| precision | **0.952** |
+| recall | **1.000** |
+| F1 | 0.976 |
+
+The one disagreement is a pair like `lookup_contact` / `lookup_user` with
+near-identical descriptions: the detector flags it, the label says it should not.
+That is arguably the detector being right and the label being strict.
+
+Two honest caveats. The labels are the author's, not users' — the criterion was
+"would a model picking the wrong one get a materially different result". And this
+benchmark did not exist before 0.4.4; the earlier claim of "zero false positives"
+came from running on 18 tools that contained no conflicts at all, which measured
+nothing. `tests/test_benchmark.py` fails the build if precision or recall drops
+below 0.90.
+
 ## How the score works
 
 Most linters fail here: a rule that fires on 18 of 18 tools is a *preference*,
@@ -251,6 +252,10 @@ rule. A report nobody can read is a report nobody acts on.
 - Not an MCP protocol validator. It checks quality and safety, not conformance —
   the official `modelcontextprotocol/conformance` suite does that.
 
+## Further reading
+
+- [多个 MCP Server 一起使用时，如何检测工具冲突？](https://juejin.cn/post/7704995965740580904) — the design story, in Chinese: why the scope changed from a single-server linter to cross-server conflicts, and how the scoring was rebuilt after it graded the official servers 0/100.
+
 ## Contributing
 
 Adding a rule takes about ten minutes and one small file — see

{agentcheckup-0.4.2 → agentcheckup-0.4.4}/README.zh-CN.md

@@ -118,12 +118,35 @@ agentcheckup rules                              # 列出全部规则
 - **名字重叠**：归一化后的 token Jaccard（`read_files` ≡ `read_file`）
 - **描述重叠**：去停用词、粗词干化之后的 token Jaccard
 
+中文按**字符二元组**切分（`读取文件` → `读取`、`取文`、`文件`），没有引入分词器——
+分词器就是依赖。这比真正的分词粗，但没有它的时候中文描述会得到空集合，
+两个中文工具根本无法比较。
+
 判定条件：描述重叠 ≥ 65% **且** 名字共享中心词，或加权分 ≥ 0.55。
 共享中心词这个约束是关键——没有它，`search_repositories` 和 `search_documents`
 会因为都含 "search" 被误报，而**充满噪音的报告比没有报告更糟**。
 
 这是启发式，文档里写明了。`AGT203` 是警告，不是判决。
 
+## 冲突检测到底准不准
+
+这是测出来的，不是声称的。`tests/fixtures/collision_benchmark.json` 里有 44 对人工标注的工具对
+（20 对该报、24 对不该报），`scripts/benchmark.py` 拿检测器去跑：
+
+| 指标 | 值 |
+|---|---|
+| 样本 | 44 对（20 正 / 24 负） |
+| 精确率 | **0.952** |
+| 召回率 | **1.000** |
+| F1 | 0.976 |
+
+唯一的分歧是一对类似 `lookup_contact` / `lookup_user`、描述几乎一样的工具——检测器报了，
+我的标注说不该报。**这更像是检测器对、标注太严。**
+
+两个必须说明的限制：标注是我自己做的，不是用户标注（判断标准是「模型选错会不会拿到实质不同的结果」）；
+这个基准是 0.4.4 才有的，**之前那句「零误报」是在 18 个根本没有冲突的工具上跑出来的，什么都没测到**。
+`tests/test_benchmark.py` 会在精确率或召回率跌破 0.90 时让 CI 失败。
+
 ## 分数是怎么算的
 
 大多数 linter 在这里翻车：一条在 18 个工具上全部触发的规则，是**偏好**不是缺陷，
@@ -165,6 +188,10 @@ agentcheckup rules                              # 列出全部规则
 - 不是运行时防护。它不在 agent 会话里运行。
 - 不是 MCP 协议校验器。协议一致性由官方 `modelcontextprotocol/conformance` 负责。
 
+## 相关文章
+
+- [多个 MCP Server 一起使用时，如何检测工具冲突？](https://juejin.cn/post/7704995965740580904) —— 设计复盘：为什么从单 server linter 改成跨 server 冲突检测，以及评分把官方 server 打成 0 分之后怎么重做。
+
 ## 贡献
 
 加一条规则大约十分钟、一个文件，见 [CONTRIBUTING.md](CONTRIBUTING.md)。

{agentcheckup-0.4.2 → agentcheckup-0.4.4}/SECURITY.md

@@ -14,7 +14,7 @@ Nothing leaves your machine.
 ## Reporting a vulnerability
 
 Use GitHub's private advisory flow:
-`https://github.com/wanjiaqing/agentcheckup/security/advisories/new`
+`https://github.com/jiaqinq/agentcheckup/security/advisories/new`
 
 Please do not open a public issue for a vulnerability. Expect an initial response
 within 7 days.

{agentcheckup-0.4.2 → agentcheckup-0.4.4}/action.yml

@@ -1,6 +1,6 @@
 name: agentcheckup
 description: Diagnose your agent setup - cross-server tool conflicts, risky MCP config, context budget.
-author: wanjiaqing
+author: jiaqinq
 
 branding:
   icon: activity

{agentcheckup-0.4.2 → agentcheckup-0.4.4}/docs/github-action.md

@@ -13,7 +13,7 @@ jobs:
     runs-on: ubuntu-latest
     steps:
       - uses: actions/checkout@v4
-      - uses: wanjiaqing/agentcheckup@main
+      - uses: jiaqinq/agentcheckup@main
         with:
           config: .mcp.json
           fail-on: warning
@@ -45,7 +45,7 @@ Outputs are published even when the gate fails, so you can gate on score without
 parsing the log:
 
 ```yaml
-      - uses: wanjiaqing/agentcheckup@main
+      - uses: jiaqinq/agentcheckup@main
         id: doctor
         with:
           config: .mcp.json
@@ -64,7 +64,7 @@ permissions:
 
 steps:
   - uses: actions/checkout@v4
-  - uses: wanjiaqing/agentcheckup@main
+  - uses: jiaqinq/agentcheckup@main
     with:
       config: .mcp.json
       sarif-file: agentcheckup.sarif
@@ -87,7 +87,7 @@ for locally. On a fresh runner that usually finds nothing, and agentcheckup exit
 For CI, pass the config explicitly:
 
 ```yaml
-      - uses: wanjiaqing/agentcheckup@main
+      - uses: jiaqinq/agentcheckup@main
         with:
           config: |
             .mcp.json
@@ -99,7 +99,7 @@ For CI, pass the config explicitly:
 Spawning every MCP server takes time. If you only need the config checks:
 
 ```yaml
-      - uses: wanjiaqing/agentcheckup@main
+      - uses: jiaqinq/agentcheckup@main
         with:
           config: .mcp.json
           args: --no-spawn
@@ -113,5 +113,5 @@ are skipped too. It is fast and useful, but it is not the full check.
 `@main` tracks the branch. For reproducible CI, pin a tag or a commit SHA:
 
 ```yaml
-      - uses: wanjiaqing/agentcheckup@v0.3.0
+      - uses: jiaqinq/agentcheckup@v0.3.0
 ```

{agentcheckup-0.4.2 → agentcheckup-0.4.4}/pyproject.toml

@@ -4,12 +4,12 @@ build-backend = "hatchling.build"
 
 [project]
 name = "agentcheckup"
-version = "0.4.2"
+version = "0.4.4"
 description = "Diagnose your agent setup: tool conflicts, risky config, context budget."
 readme = "README.md"
 requires-python = ">=3.10"
 license = { text = "MIT" }
-authors = [{ name = "wanjiaqing" }]
+authors = [{ name = "jiaqinq" }]
 keywords = ["mcp", "model-context-protocol", "agents", "ai", "linter", "security", "cli"]
 classifiers = [
   "Development Status :: 3 - Alpha",
@@ -33,9 +33,9 @@ dev = ["pytest>=8", "ruff>=0.6"]
 agentcheckup = "agentcheckup.cli:main"
 
 [project.urls]
-Homepage = "https://github.com/wanjiaqing/agentcheckup"
-Issues = "https://github.com/wanjiaqing/agentcheckup/issues"
-Changelog = "https://github.com/wanjiaqing/agentcheckup/blob/main/CHANGELOG.md"
+Homepage = "https://github.com/jiaqinq/agentcheckup"
+Issues = "https://github.com/jiaqinq/agentcheckup/issues"
+Changelog = "https://github.com/jiaqinq/agentcheckup/blob/main/CHANGELOG.md"
 
 [tool.hatch.build.targets.wheel]
 packages = ["src/agentcheckup"]

agentcheckup-0.4.4/scripts/benchmark.py

@@ -0,0 +1,101 @@
+"""Measure conflict detection against a labelled set of tool pairs.
+
+The README used to claim "zero false positives" on the strength of three official
+servers that contained no conflicts at all. That is not a measurement. This is:
+every pair below was labelled by hand, so precision and recall can be computed
+and regressions become visible.
+
+    python scripts/benchmark.py
+
+Labels are the author's, not users'. The criterion applied to each pair:
+"would a maintainer reasonably consider these two tools confusable by a model
+choosing from one flat list?" A pair is positive when a user picking the wrong
+one would get a materially different result.
+"""
+
+from __future__ import annotations
+
+import json
+import sys
+from pathlib import Path
+
+ROOT = Path(__file__).resolve().parents[1]
+sys.path.insert(0, str(ROOT / "src"))
+
+from agentcheckup.conflicts import ToolRef, detect_conflicts  # noqa: E402
+from agentcheckup.models import Tool  # noqa: E402
+
+FIXTURE = ROOT / "tests" / "fixtures" / "collision_benchmark.json"
+
+
+def to_ref(side: dict) -> ToolRef:
+    tool = Tool.from_raw(
+        {
+            "name": side["name"],
+            "description": side["description"],
+            "inputSchema": {
+                "type": "object",
+                "properties": {"path": {"type": "string", "pattern": "^.*$"}},
+                "additionalProperties": False,
+            },
+        }
+    )
+    return ToolRef(server=side["server"], tool=tool)
+
+
+def main() -> int:
+    cases = json.loads(FIXTURE.read_text(encoding="utf-8"))
+
+    tp = fp = tn = fn = 0
+    false_positives: list[str] = []
+    false_negatives: list[str] = []
+
+    for case in cases:
+        found = detect_conflicts([to_ref(case["a"]), to_ref(case["b"])])
+        predicted = bool(found)
+        actual = case["conflict"]
+
+        if predicted and actual:
+            tp += 1
+        elif predicted and not actual:
+            fp += 1
+            rules = ",".join(sorted({c.rule for c in found}))
+            false_positives.append(f"  {case['id']}  {rules}  {case['why']}")
+        elif not predicted and actual:
+            fn += 1
+            false_negatives.append(f"  {case['id']}  missed  {case['why']}")
+        else:
+            tn += 1
+
+    total = tp + fp + tn + fn
+    precision = tp / (tp + fp) if tp + fp else 0.0
+    recall = tp / (tp + fn) if tp + fn else 0.0
+    f1 = 2 * precision * recall / (precision + recall) if precision + recall else 0.0
+    accuracy = (tp + tn) / total if total else 0.0
+
+    print(f"pairs       {total}")
+    print(f"positives   {tp + fn}")
+    print(f"negatives   {tn + fp}")
+    print()
+    print(f"true  pos   {tp}")
+    print(f"false pos   {fp}")
+    print(f"true  neg   {tn}")
+    print(f"false neg   {fn}")
+    print()
+    print(f"precision   {precision:.3f}")
+    print(f"recall      {recall:.3f}")
+    print(f"f1          {f1:.3f}")
+    print(f"accuracy    {accuracy:.3f}")
+
+    if false_positives:
+        print("\nfalse positives")
+        print("\n".join(false_positives))
+    if false_negatives:
+        print("\nfalse negatives")
+        print("\n".join(false_negatives))
+
+    return 0
+
+
+if __name__ == "__main__":
+    raise SystemExit(main())

{agentcheckup-0.4.2 → agentcheckup-0.4.4}/src/agentcheckup/conflicts.py

@@ -42,6 +42,10 @@ STOPWORDS = frozenset(
 
 WORD = re.compile(r"[a-z0-9]+")
 
+#: CJK ideographs, extension A included. Matched per character because Chinese
+#: has no word delimiters and a real segmenter would be a dependency.
+CJK = re.compile(r"[\u3400-\u4dbf\u4e00-\u9fff]+")
+
 
 @dataclass(frozen=True)
 class ToolRef:
@@ -94,13 +98,33 @@ def _stem(word: str) -> str:
     return word
 
 
+def _cjk_tokens(text: str) -> set[str]:
+    """Character bigrams over every CJK run.
+
+    Chinese has no spaces, so ``WORD`` returns nothing and two Chinese tools
+    would look like two empty sets — silently, which is the worst outcome. A real
+    segmenter is a dependency; character bigrams are the standard cheap
+    substitute: 读取文件 -> 读取, 取文, 文件.
+
+    A single-character run is kept whole, so 读 still matches 读.
+    """
+    out: set[str] = set()
+    for run in CJK.findall(text):
+        if len(run) == 1:
+            out.add(run)
+        else:
+            out.update(run[i : i + 2] for i in range(len(run) - 1))
+    return out
+
+
 def tokens(text: str) -> set[str]:
-    """Lowercase word set, stopwords removed, crude plural stemming."""
-    return {
+    """Lowercase word set, stopwords removed, crude plural stemming, plus CJK."""
+    latin = {
         _stem(w)
         for w in WORD.findall(text.lower())
         if w not in STOPWORDS and len(w) > 1
     }
+    return latin | _cjk_tokens(text)
 
 
 def jaccard(a: set[str], b: set[str]) -> float:
@@ -111,7 +135,8 @@ def jaccard(a: set[str], b: set[str]) -> float:
 
 
 def name_tokens(name: str) -> set[str]:
-    return {_stem(w) for w in WORD.findall(name.lower()) if len(w) > 1}
+    latin = {_stem(w) for w in WORD.findall(name.lower()) if len(w) > 1}
+    return latin | _cjk_tokens(name)
 
 
 def similarity(a: ToolRef, b: ToolRef) -> float:

{agentcheckup-0.4.2 → agentcheckup-0.4.4}/src/agentcheckup/report.py

@@ -10,7 +10,7 @@ from . import rules as _rules
 from .engine import Report
 from .models import Finding, Severity
 
-__version__ = "0.4.2"
+__version__ = "0.4.4"
 
 SARIF_LEVEL = {
     Severity.ERROR: "error",
@@ -195,7 +195,7 @@ def render_text(report: Report, verbose: bool = False) -> str:
         lines.extend(_nudge_lines(nudges))
 
     lines.append("")
-    lines.append("  Rule docs: https://github.com/wanjiaqing/agentcheckup#rules")
+    lines.append("  Rule docs: https://github.com/jiaqinq/agentcheckup#rules")
     return "\n".join(lines)
 
 
@@ -246,7 +246,7 @@ def render_sarif(report: Report) -> str:
                     "driver": {
                         "name": "agentcheckup",
                         "version": __version__,
-                        "informationUri": "https://github.com/wanjiaqing/agentcheckup",
+                        "informationUri": "https://github.com/jiaqinq/agentcheckup",
                         "rules": _rule_metadata(),
                     }
                 },

agentcheckup-0.4.4/tests/fixtures/collision_benchmark.json

@@ -0,0 +1,177 @@
+[
+  {"id": "p01", "conflict": true, "why": "同名工具，跨 server",
+   "a": {"server": "files", "name": "read_file", "description": "Read a text file from the sandbox and return its contents."},
+   "b": {"server": "git", "name": "read_file", "description": "Read a file as it exists in a git revision."}},
+
+  {"id": "p02", "conflict": true, "why": "同名，仅大小写不同，检测器会先 lower()",
+   "a": {"server": "files", "name": "read_file", "description": "Read a file from disk."},
+   "b": {"server": "s3", "name": "Read_File", "description": "Read an object from a bucket."}},
+
+  {"id": "p03", "conflict": true, "why": "单复数差异，归一化后同名",
+   "a": {"server": "files", "name": "read_files", "description": "Read several files and return their contents."},
+   "b": {"server": "git", "name": "read_file", "description": "Read one file from a revision."}},
+
+  {"id": "p04", "conflict": true, "why": "描述几乎一致，名字共享 search",
+   "a": {"server": "github", "name": "search_public", "description": "Search public repositories by keyword and return matching repository names."},
+   "b": {"server": "docs", "name": "search_private", "description": "Search private repositories by keyword and return matching repository names."}},
+
+  {"id": "p05", "conflict": true, "why": "同义动词 + 同一宾语，名字共享 file",
+   "a": {"server": "files", "name": "get_file", "description": "Fetch a file by path and return its bytes."},
+   "b": {"server": "docs", "name": "get_files", "description": "Fetch files by path and return their bytes."}},
+
+  {"id": "p06", "conflict": true, "why": "中文近义，描述几乎相同",
+   "a": {"server": "文件服务", "name": "读取文件", "description": "读取指定路径的文件内容并返回文本"},
+   "b": {"server": "文档服务", "name": "读取文档", "description": "读取指定路径的文件内容并返回字符串"}},
+
+  {"id": "p07", "conflict": true, "why": "同名删除工具",
+   "a": {"server": "files", "name": "delete_file", "description": "Delete a file at the given path."},
+   "b": {"server": "storage", "name": "delete_file", "description": "Delete an object from the bucket."}},
+
+  {"id": "p08", "conflict": true, "why": "单复数 + 同一目录语义",
+   "a": {"server": "files", "name": "list_dir", "description": "List entries in one directory under the sandbox root."},
+   "b": {"server": "shell", "name": "list_dirs", "description": "List entries in one directory under the sandbox root."}},
+
+  {"id": "p09", "conflict": true, "why": "同一动作的 issue 创建，描述高度重叠",
+   "a": {"server": "github", "name": "create_issue", "description": "Create an issue with a title, body and assignee in a repository."},
+   "b": {"server": "jira", "name": "create_issues", "description": "Create an issue with a title, body and assignee in a project."}},
+
+  {"id": "p10", "conflict": true, "why": "描述相同，名字只差一个词且共享 run",
+   "a": {"server": "shell", "name": "run_command", "description": "Run a shell command and return stdout and stderr."},
+   "b": {"server": "docker", "name": "run_commands", "description": "Run a shell command and return stdout and stderr."}},
+
+  {"id": "p11", "conflict": true, "why": "同名，一个本地一个远端",
+   "a": {"server": "files", "name": "write_file", "description": "Write text to a file on disk."},
+   "b": {"server": "s3", "name": "write_file", "description": "Write text to an object in a bucket."}},
+
+  {"id": "p12", "conflict": true, "why": "描述几乎逐字相同",
+   "a": {"server": "db", "name": "query_table", "description": "Query rows from a table using a SQL where clause and return them as JSON."},
+   "b": {"server": "warehouse", "name": "query_tables", "description": "Query rows from a table using a SQL where clause and return them as JSON."}},
+
+  {"id": "p13", "conflict": true, "why": "同一份数据的两种读取入口，名字共享 read",
+   "a": {"server": "cache", "name": "read_cache", "description": "Read a value from the cache by key."},
+   "b": {"server": "redis", "name": "read_cached", "description": "Read a value from the cache by key."}},
+
+  {"id": "p14", "conflict": true, "why": "中文同名",
+   "a": {"server": "文件服务", "name": "搜索文件", "description": "按关键词搜索文件并返回匹配的路径"},
+   "b": {"server": "代码服务", "name": "搜索文件", "description": "按关键词搜索仓库中的文件"}},
+
+  {"id": "p15", "conflict": true, "why": "单复数 + 同一搜索动作",
+   "a": {"server": "docs", "name": "search_doc", "description": "Search documents by title across the workspace and return matching ids."},
+   "b": {"server": "wiki", "name": "search_docs", "description": "Search documents by title across the workspace and return matching ids."}},
+
+  {"id": "p16", "conflict": true, "why": "同名上传",
+   "a": {"server": "s3", "name": "upload", "description": "Upload a local file to remote storage."},
+   "b": {"server": "gcs", "name": "upload", "description": "Upload a local file to remote storage."}},
+
+  {"id": "p17", "conflict": true, "why": "描述一致，名字共享 get 与 issue",
+   "a": {"server": "github", "name": "get_issue", "description": "Get one issue by number and return its title, body, state and labels."},
+   "b": {"server": "jira", "name": "get_issues", "description": "Get one issue by number and return its title, body, state and labels."}},
+
+  {"id": "p18", "conflict": true, "why": "同一动作的中英文混写，描述相同",
+   "a": {"server": "files", "name": "read_file", "description": "读取文件内容并返回文本"},
+   "b": {"server": "docs", "name": "read_file", "description": "读取文件内容并返回文本"}},
+
+  {"id": "p19", "conflict": true, "why": "单复数 + 同一删除动作，描述相同",
+   "a": {"server": "db", "name": "drop_table", "description": "Drop a table and all of its rows."},
+   "b": {"server": "warehouse", "name": "drop_tables", "description": "Drop a table and all of its rows."}},
+
+  {"id": "p20", "conflict": true, "why": "同名创建",
+   "a": {"server": "k8s", "name": "create_namespace", "description": "Create a namespace in the cluster."},
+   "b": {"server": "cloud", "name": "create_namespace", "description": "Create a namespace in the project."}},
+
+  {"id": "n01", "conflict": false, "why": "完全不同的事",
+   "a": {"server": "files", "name": "read_file", "description": "Read a text file from the sandbox and return its contents."},
+   "b": {"server": "jira", "name": "create_ticket", "description": "Create a ticket with a title, body and assignee."}},
+
+  {"id": "n02", "conflict": false, "why": "共享 search 但宾语不同，这是最常见的误报来源",
+   "a": {"server": "github", "name": "search_repositories", "description": "Search repositories by name across the org."},
+   "b": {"server": "docs", "name": "search_documents", "description": "Search documents by title across the workspace."}},
+
+  {"id": "n03", "conflict": false, "why": "共享 get 但对象完全不同",
+   "a": {"server": "time", "name": "get_current_time", "description": "Return the current time in a given timezone."},
+   "b": {"server": "weather", "name": "get_weather", "description": "Return the forecast for a city and date."}},
+
+  {"id": "n04", "conflict": false, "why": "共享 list 但宾语不同",
+   "a": {"server": "files", "name": "list_files", "description": "List files under a directory."},
+   "b": {"server": "db", "name": "list_tables", "description": "List tables in a database."}},
+
+  {"id": "n05", "conflict": false, "why": "共享 upload 但媒体类型不同",
+   "a": {"server": "assets", "name": "upload_image", "description": "Upload an image and return its asset id."},
+   "b": {"server": "docs", "name": "upload_document", "description": "Upload a document and return its document id."}},
+
+  {"id": "n06", "conflict": false, "why": "中文共享文件但动作相反",
+   "a": {"server": "文件服务", "name": "读取文件", "description": "读取指定路径的文件内容并返回文本"},
+   "b": {"server": "文件服务", "name": "删除文件", "description": "删除指定路径的文件"}},
+
+  {"id": "n07", "conflict": false, "why": "共享 file 但读与写相反",
+   "a": {"server": "files", "name": "read_file", "description": "Read a file and return its contents."},
+   "b": {"server": "files", "name": "write_file", "description": "Write text to a file."}},
+
+  {"id": "n08", "conflict": false, "why": "共享 git 但动作不同",
+   "a": {"server": "git", "name": "git_commit", "description": "Record staged changes as a commit."},
+   "b": {"server": "git", "name": "git_status", "description": "Show the working tree status."}},
+
+  {"id": "n09", "conflict": false, "why": "名字完全不共享词",
+   "a": {"server": "fetch", "name": "fetch", "description": "Fetch a URL and convert it to markdown."},
+   "b": {"server": "time", "name": "convert_time", "description": "Convert a time between timezones."}},
+
+  {"id": "n10", "conflict": false, "why": "共享 create 但资源不同",
+   "a": {"server": "github", "name": "create_branch", "description": "Create a git branch in a repository."},
+   "b": {"server": "jira", "name": "create_project", "description": "Create a project with a key and name."}},
+
+  {"id": "n11", "conflict": false, "why": "名字共享 file，但一个是读内容一个是读元数据",
+   "a": {"server": "files", "name": "read_file", "description": "Read the full text content of a file from disk."},
+   "b": {"server": "meta", "name": "file_info", "description": "Return size, mtime and permissions for a file."}},
+
+  {"id": "n12", "conflict": false, "why": "共享 search 但一个是代码一个是日志",
+   "a": {"server": "code", "name": "search_code", "description": "Search source files for a pattern."},
+   "b": {"server": "logs", "name": "search_logs", "description": "Search application logs for a pattern."}},
+
+  {"id": "n13", "conflict": false, "why": "共享 send 但渠道不同",
+   "a": {"server": "slack", "name": "send_message", "description": "Send a message to a channel."},
+   "b": {"server": "mail", "name": "send_email", "description": "Send an email to a recipient."}},
+
+  {"id": "n14", "conflict": false, "why": "中文共享仓库但动作不同",
+   "a": {"server": "代码服务", "name": "克隆仓库", "description": "把远端仓库克隆到本地目录"},
+   "b": {"server": "代码服务", "name": "删除仓库", "description": "删除远端仓库及其全部分支"}},
+
+  {"id": "n15", "conflict": false, "why": "共享 run 但一个是测试一个是迁移",
+   "a": {"server": "ci", "name": "run_tests", "description": "Run the test suite and return failures."},
+   "b": {"server": "db", "name": "run_migrations", "description": "Apply pending database migrations."}},
+
+  {"id": "n16", "conflict": false, "why": "共享 get 但一个是配置一个是统计",
+   "a": {"server": "config", "name": "get_config", "description": "Return the current configuration as JSON."},
+   "b": {"server": "metrics", "name": "get_stats", "description": "Return request counts for the last hour."}},
+
+  {"id": "n17", "conflict": false, "why": "描述用词相似但对象不同（跨域同义）",
+   "a": {"server": "crm", "name": "lookup_contact", "description": "Look up a contact by email and return the profile."},
+   "b": {"server": "auth", "name": "lookup_user", "description": "Look up a user by email and return the profile."}},
+
+  {"id": "n18", "conflict": false, "why": "共享 list 但一个是文件一个是容器",
+   "a": {"server": "docker", "name": "list_containers", "description": "List running containers."},
+   "b": {"server": "files", "name": "list_directory", "description": "List entries in a directory."}},
+
+  {"id": "n19", "conflict": false, "why": "共享 delete 但资源不同",
+   "a": {"server": "k8s", "name": "delete_pod", "description": "Delete a pod by name."},
+   "b": {"server": "s3", "name": "delete_object", "description": "Delete an object by key."}},
+
+  {"id": "n20", "conflict": false, "why": "名字共享 repo，一个是读一个是搜",
+   "a": {"server": "github", "name": "get_repo", "description": "Return metadata for one repository."},
+   "b": {"server": "github", "name": "search_repos", "description": "Search repositories by keyword."}},
+
+  {"id": "n21", "conflict": false, "why": "共享 write 但一个是文件一个是日志",
+   "a": {"server": "files", "name": "write_file", "description": "Write text to a file on disk."},
+   "b": {"server": "logs", "name": "write_log", "description": "Append a line to the application log."}},
+
+  {"id": "n22", "conflict": false, "why": "共享 create 但一个是目录一个是分支",
+   "a": {"server": "files", "name": "create_dir", "description": "Create a directory under the sandbox root."},
+   "b": {"server": "git", "name": "create_branch", "description": "Create a branch at the current HEAD."}},
+
+  {"id": "n23", "conflict": false, "why": "中文共享搜索但对象不同",
+   "a": {"server": "代码服务", "name": "搜索代码", "description": "在源码文件中搜索指定模式"},
+   "b": {"server": "日志服务", "name": "搜索日志", "description": "在应用日志中搜索指定模式"}},
+
+  {"id": "n24", "conflict": false, "why": "共享 read 但一个是文件一个是环境变量",
+   "a": {"server": "files", "name": "read_file", "description": "Read a file and return its contents."},
+   "b": {"server": "env", "name": "read_env", "description": "Read an environment variable by name."}}
+]

agentcheckup-0.4.4/tests/test_benchmark.py

@@ -0,0 +1,82 @@
+"""Regression guard on the labelled collision benchmark.
+
+`scripts/benchmark.py` prints the numbers for humans; this keeps them from
+silently decaying. The floors are set a little below the measured values so a
+small, deliberate trade-off does not fail the build, but a real regression does.
+"""
+
+from __future__ import annotations
+
+import json
+import sys
+from pathlib import Path
+
+ROOT = Path(__file__).resolve().parents[1]
+sys.path.insert(0, str(ROOT / "src"))
+
+from agentcheckup.conflicts import ToolRef, detect_conflicts  # noqa: E402
+from agentcheckup.models import Tool  # noqa: E402
+
+FIXTURE = Path(__file__).resolve().parent / "fixtures" / "collision_benchmark.json"
+
+MIN_PRECISION = 0.90
+MIN_RECALL = 0.90
+
+
+def to_ref(side: dict) -> ToolRef:
+    tool = Tool.from_raw(
+        {
+            "name": side["name"],
+            "description": side["description"],
+            "inputSchema": {
+                "type": "object",
+                "properties": {"path": {"type": "string", "pattern": "^.*$"}},
+                "additionalProperties": False,
+            },
+        }
+    )
+    return ToolRef(server=side["server"], tool=tool)
+
+
+def score() -> tuple[float, float, list[str], list[str]]:
+    cases = json.loads(FIXTURE.read_text(encoding="utf-8"))
+    tp = fp = fn = 0
+    false_positives: list[str] = []
+    false_negatives: list[str] = []
+
+    for case in cases:
+        found = detect_conflicts([to_ref(case["a"]), to_ref(case["b"])])
+        predicted = bool(found)
+        if predicted and case["conflict"]:
+            tp += 1
+        elif predicted and not case["conflict"]:
+            fp += 1
+            false_positives.append(case["id"])
+        elif not predicted and case["conflict"]:
+            fn += 1
+            false_negatives.append(case["id"])
+
+    precision = tp / (tp + fp) if tp + fp else 0.0
+    recall = tp / (tp + fn) if tp + fn else 0.0
+    return precision, recall, false_positives, false_negatives
+
+
+def test_benchmark_precision_and_recall_hold():
+    precision, recall, false_positives, false_negatives = score()
+    assert precision >= MIN_PRECISION, f"precision dropped to {precision:.3f}; FP: {false_positives}"
+    assert recall >= MIN_RECALL, f"recall dropped to {recall:.3f}; FN: {false_negatives}"
+
+
+def test_benchmark_covers_both_labels():
+    cases = json.loads(FIXTURE.read_text(encoding="utf-8"))
+    positives = sum(1 for c in cases if c["conflict"])
+    negatives = len(cases) - positives
+    # A benchmark that drifts to one class measures nothing.
+    assert positives >= 10, positives
+    assert negatives >= 10, negatives
+
+
+def test_benchmark_includes_chinese_cases():
+    cases = json.loads(FIXTURE.read_text(encoding="utf-8"))
+    chinese = [c for c in cases if any("\u4e00" <= ch <= "\u9fff" for ch in c["a"]["name"])]
+    assert len(chinese) >= 4, len(chinese)

{agentcheckup-0.4.2 → agentcheckup-0.4.4}/tests/test_conflicts.py

@@ -128,3 +128,40 @@ def test_audit_tokens_sum_across_servers():
     tools = {"a": [tool("alpha_tool")], "b": [tool("beta_tool")]}
     report = lint_audit(servers, tools)
     assert report.tokens > 0
+
+
+# --------------------------------------------------------------------------- #
+# CJK support
+# --------------------------------------------------------------------------- #
+
+
+def test_cjk_runs_become_character_bigrams():
+    assert tokens("读取文件") == {"读取", "取文", "文件"}
+
+
+def test_single_cjk_character_is_kept_whole():
+    assert tokens("读") == {"读"}
+
+
+def test_cjk_and_latin_mix():
+    got = tokens("read 文件")
+    assert "read" in got
+    assert "文件" in got
+
+
+def test_chinese_near_duplicates_are_flagged():
+    """Before CJK support this pair produced two empty token sets and no finding."""
+    a = ref("文件服务", "读取文件", "读取指定路径的文件内容并返回文本")
+    b = ref("文档服务", "读取文档", "读取指定路径的文件内容并返回字符串")
+    assert "AGT203" in {c.rule for c in detect_conflicts([a, b])}
+
+
+def test_chinese_unrelated_tools_are_not_flagged():
+    a = ref("文件服务", "读取文件", "读取指定路径的文件内容并返回文本")
+    b = ref("文件服务", "删除文件", "删除指定路径的文件")
+    assert detect_conflicts([a, b]) == []
+
+
+def test_english_scores_are_unchanged_by_cjk_support():
+    """The CJK path must not touch Latin tokenisation."""
+    assert tokens("Read a file") == {"read", "file"}