mingjing 0.11.9__tar.gz

mingjing-0.11.9/CHANGELOG.md

@@ -0,0 +1,165 @@
+# Changelog
+
+## [v0.11.9m] — 2026-05-05
+
+### Added
+- Probe management commands (`ming probe list` / `ming probe uninstall`)
+- Safe probe uninstall: backup → stop observation → DB cleanup → file cleanup → VACUUM
+- `--dry-run` mode previews uninstall without executing
+- `--keep-data` flag retains DB records while stopping observation
+- `--force` flag skips interactive confirmation
+- Protected systems guard (`__admin__`, `__self_health__`, `__host__`, `unknown`)
+
+### Changed
+- Version: 0.11.9-alpha → 0.11.9m
+
+## [v0.11.9-alpha] — 2026-05-05
+
+### Added
+- Diagnosis timeline replay (`ming replay --system X --since 1h`)
+- Environment-aware rule thresholds (container/VM/baremetal detection)
+- CPU% calculation in probe_platform via `/proc/stat` jiffies delta
+- `ming admin cleanup` command for stale events/diagnoses
+- Healthbeat independent thread in Hermes plugin
+- KNOWN_PROBES whitelist-based instance filtering (report + web dashboard)
+- QueryBridge: 7 new methods + unified `/api/query` entry + 4 quick endpoints + CLI extensions
+- Always-on mechanism for LIT diagnostics + 20 tusunsun diagnosis rules
+- TLT-058 diagnosis enhancement + SYS-004 adaptive thresholds
+- Resource footprint panel (web dashboard)
+- OpenClaw probe enhancements
+
+### Fixed
+- False Podman detection on bare-metal cgroups v2
+- `unknown` system fallback in diagnosis source → `mingjing`
+- Archiver self-measurement inflating CPU footprint in reports
+- Frontend displaying `__host__`/`unknown`/`all` as instance cards
+- Probe CPU showing 0.0% for `mingjing` system-level instance
+- Web dashboard export thread import caching (added importlib.reload)
+- `mingjing` not rendering as a card in web dashboard
+- 10 diagnosis rule false positives
+- 8 diagnosis rule false positives + orphan process cleanup
+- 5 diagnosis rule SQL bugs
+- LangChain adapter: langchain-core >= 1.0 compatibility (invoke entry patch)
+- LangChain adapter: filled 6 diagnostic gaps (session_id, cache_hit, error, agent_step, relevance, embedding)
+- Dashboard diagnosis caps display: verified 3 / inferred 9
+
+### Removed
+- PRB-083 ("探针离线") and DQT-085 ("数据质量问题-探针缺失") — flawed rules assuming all probes must be online
+- Triage Prism from frontend (replaced by instance card system)
+
+### Changed
+- BSL 1.1 licensing: free for orgs with annual revenue <$100K USD
+- Diseases.yaml rule count: 159 → 157
+- Report/frontend filtering: blacklist → KNOWN_PROBES whitelist
+- Documentation restructured for open-source release
+- Memory optimization across archiver and hot rail processing
+
+## [v0.11.6] — 2026-05-01
+
+### Added
+- Health center CLI: report reorder, ignore/archive/reset commands, instance list
+- Health center web: health reset / archive / ignore trinity + probe status
+- Hermes Agent: `./ming hermes-install` one-click installation + skill registration
+- Web: hash chain break alerts can be dismissed (fixed alert_key + dismiss API)
+- Hermes probe: independent healthbeat thread, `__anchor__` support
+- Hermes probe: synthetic agent_step, OS sampling, event name mapping, deep extract
+- Hermes probe: tool_input_hash + 4-prong strategy
+- Web: system card shows per-system diagnosis count
+- CLI: report added disease summary (dedup + inference chain), `dx list` shows cause
+- Package: probe directory, requirements.txt, user guide, .gitignore
+
+### Refactored
+- archiver.py 586→406 lines: split into schema/triage/score/util modules
+- cli.py + lit_lite.py split for code size compliance
+- CLI UX fixes: port handling, empty query, JSON consistency, time format
+- P3 code style cleanup + probe dead code removal
+- P2 performance/security/dead code optimization
+- P2 archiver 3 tool modules split + P1 full security hardening
+- P0/P1 full code audit: 28 P0 + 30 P1/P2 fixes
+
+### Changed
+- Code budget: archiver.py limit relaxed to <410 lines (atomic transaction boundary)
+- 5 test case fixes + cluster_archiver hash chain bug fix
+
+## [v0.11.5] — 2026-04-30
+
+### Added
+- OpenClaw probe: enhanced event coverage and adapter stability
+- Web dashboard: alert banner dismiss support + toast deduplication
+- `__health__` / `__register__` / `__touch__` synchronized write to events table
+
+### Fixed
+- SYS diagnosis rules: relaxed system filter + corrected field names
+- `data.json` added to .gitignore (auto-generated runtime artifact)
+
+## [v0.11.4] — 2026-04-30
+
+### Added
+- Full probe adapter coverage across all supported frameworks
+- Configurable content truncation for large payloads
+- End-to-end diagnosis pipeline: probe → archiver → diagnosis → web
+
+## [v0.11.3] — 2026-04-29
+
+### Added
+- opencode probe: enhanced event extraction, embedding, and diagnosis gaps
+- Diagnosis engine: improved rule matching and coverage
+
+### Performance
+- Backfill batch write: 36K records from 75min → 1-2min
+
+## [v0.11.1] — 2026-04-28~29
+
+### Added
+- Self-health detection system (Phase 1+2)
+- Remedy engine decoupled from diagnostics
+- Configuration management (Phase 3)
+- Migration system (Phase 4)
+- Privacy controls (Phase 5)
+- OTEL bidirectional translation hub
+
+### Fixed
+- 7 SQL schema issues in diseases.yaml (error_type → json_extract + JSON path fixes)
+- 14 P0/P1 security fixes (exit mechanism, etc.)
+- Code review fixes: obvious bugs + limit relaxations
+
+### Changed
+- **Project renamed: Cosmoscope → Mingjing** — env vars, paths, CLI, deployment files updated
+- Full code review: module structure optimization, redundancy cleanup, style unification
+- MCP → LIT naming migration across codebase
+- Web Dashboard filter enhancements
+
+## [v0.10.5] — 2026-04-29
+
+### Added
+- OTEL bidirectional translation hub implementation
+- Frontend alignment: web_exporter field completion, server.py version switching, new frontend activation
+- Frontend i18n missing fields + diagnosis table header translation
+
+### Docs
+- OTEL upgrade plan v1.0→v1.2 (3 revisions, expert feedback incorporated)
+- Data dictionary and build specification updates
+
+## [v0.10.3] — 2026-04-28
+
+### Added
+- Diagnosis enhancement Phase 1: 96 disease diagnosis & treatment list
+- Adapter Phase 2: field completion, eliminated hardcoding, unified payload builders
+- Benchmark: `bench_continuity.py` + test guide rewrite
+- Smoke test + report generator + frontend Config read-only display + README tuning guide
+- Archive success rate: 98% → 100%
+
+### Docs
+- Diagnosis enhancement plan v1.0→v2.3 (3 revisions, expert opinions incorporated)
+- Performance benchmark report (A: 15min×1000/s, B: 3min×5000/s)
+- Complete documentation supplement
+
+## [v0.10] — 2026-04-27
+
+### Added
+- M9: Open-source preparation complete
+- M10: Production environment verification passed
+
+### Fixed
+- Exit mechanism + 14 P0/P1 security issues
+- mcp_received.jsonl added to .gitignore

mingjing-0.11.9/LICENSE

@@ -0,0 +1,108 @@
+Business Source License 1.1
+
+License text copyright (c) 2017 MariaDB Corporation Ab, All Rights Reserved.
+"Business Source License" is a trademark of MariaDB Corporation Ab.
+
+-----------------------------------------------------------------------------
+
+Parameters
+
+Licensor:             Chenzheng (wulun811)
+
+Licensed Work:        乾坤镜 (Ming) v0.11.9m
+                      The Licensed Work is (c) 2026 Chenzheng (wulun811).
+
+Additional Use Grant: You may make production use of the Licensed Work,
+                      provided your company's (or organization's) total
+                      annual gross revenue does not exceed USD 100,000
+                      in the most recent fiscal year. Non-production use
+                      (development, testing, evaluation) is permitted
+                      without revenue restriction.
+
+Change Date:          2030-12-31
+
+Change License:       Apache License, Version 2.0
+
+For information about alternative licensing arrangements for the Licensed Work,
+please visit the project's website or contact the Licensor.
+
+-----------------------------------------------------------------------------
+
+Notice
+
+The Business Source License (this document, or the "License") is not an Open
+Source license. However, the Licensed Work will eventually be made available
+under an Open Source License, as stated in this License.
+
+License text copyright (c) 2017 MariaDB Corporation Ab, All Rights Reserved.
+"Business Source License" is a trademark of MariaDB Corporation Ab.
+
+-----------------------------------------------------------------------------
+
+Business Source License 1.1
+
+Terms
+
+The Licensor hereby grants you the right to copy, modify, create derivative
+works, redistribute, and make non-production use of the Licensed Work. The
+Licensor may make an Additional Use Grant, above, permitting limited production use.
+
+Effective on the Change Date, or the fourth anniversary of the first publicly
+available distribution of a specific version of the Licensed Work under this
+License, whichever comes first, the Licensor hereby grants you rights under
+the terms of the Change License, and the rights granted in the paragraph
+above terminate.
+
+If your use of the Licensed Work does not comply with the requirements
+currently in effect as described in this License, you must purchase a
+commercial license from the Licensor, its affiliated entities, or authorized
+resellers, or you must refrain from using the Licensed Work.
+
+All copies of the original and modified Licensed Work, and derivative works
+of the Licensed Work, are subject to this License. This License applies
+separately for each version of the Licensed Work and the Change Date may vary
+for each version of the Licensed Work released by Licensor.
+
+You must conspicuously display this License on each original or modified copy
+of the Licensed Work. If you receive the Licensed Work in original or
+modified form from a third party, the terms and conditions set forth in this
+License apply to your use of that work.
+
+Any use of the Licensed Work in violation of this License will automatically
+terminate your rights under this License for the current and all other
+versions of the Licensed Work.
+
+This License does not grant you any right in any trademark or logo of
+Licensor or its affiliates (provided that you may use a trademark or logo of
+Licensor as expressly required by this License).
+
+TO THE EXTENT PERMITTED BY APPLICABLE LAW, THE LICENSED WORK IS PROVIDED ON
+AN "AS IS" BASIS. LICENSOR HEREBY DISCLAIMS ALL WARRANTIES AND CONDITIONS,
+EXPRESS OR IMPLIED, INCLUDING (WITHOUT LIMITATION) WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, NON-INFRINGEMENT, AND
+TITLE.
+
+MariaDB hereby grants you permission to use this License's text to license
+your works, and to refer to it using the trademark "Business Source License",
+as long as you comply with the Covenants of Licensor below.
+
+Covenants of Licensor
+
+In consideration of the right to use this License's text and the "Business
+Source License" name and trademark, Licensor covenants to MariaDB, and to all
+other recipients of the licensed work to be provided by Licensor:
+
+1. To specify as the Change License the GPL Version 2.0 or any later version,
+   or a license that is compatible with GPL Version 2.0 or a later version,
+   where "compatible" means that software provided under the Change License can
+   be included in a program with software provided under GPL Version 2.0 or a
+   later version. Licensor may specify additional Change Licenses without
+   limitation.
+
+2. To either: (a) specify an additional grant of rights to use that does not
+   impose any additional restriction on the right granted in this License, as
+   the Additional Use Grant; or (b) insert the text "None".
+
+3. To specify a Change Date.
+
+4. Not to modify this License in any other way.

mingjing-0.11.9/MANIFEST.in

@@ -0,0 +1,12 @@
+include README.md
+include LICENSE
+include CHANGELOG.md
+include setup.sh
+graft config
+graft filters
+graft extensions
+graft updocs
+prune __pycache__
+recursive-exclude *.pyc
+recursive-exclude *.pyo
+prune .git

mingjing-0.11.9/PKG-INFO

@@ -0,0 +1,278 @@
+Metadata-Version: 2.4
+Name: mingjing
+Version: 0.11.9
+Summary: 乾坤镜 — AI Agent 诊断折射阵列
+License-Expression: BUSL-1.1
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Dynamic: license-file
+
+# 乾坤镜 Mingjing
+
+> **AI Agent 诊断折射阵列** — 零侵入观测 LLM 调用、工具执行、记忆检索与 Agent 编排。
+
+[![Python](https://img.shields.io/badge/python-3.10+-blue.svg)](https://www.python.org/downloads/)
+[![License](https://img.shields.io/badge/license-BUSL--1.1-green.svg)](LICENSE)
+[![Version](https://img.shields.io/badge/version-0.11.9m-green.svg)](https://github.com/wulun811/Ming_qiankun/releases)
+
+**乾坤镜是 LIT 1.4 的轻量折射阵列，不是独立诊断中台。** 它通过热轨 JSONL 文件 + SQLite/MySQL 持久层，为 LangChain、LlamaIndex、CrewAI、OpenHands、AutoGPT 等 Agent 框架提供无侵入的可观测性（部分适配器尚在适配中）。
+
+---
+
+📖 完整手册：请参阅 [updocs/](updocs/) 目录下的完整文档。
+
+## 5 分钟上手
+
+### 1. 克隆
+
+```bash
+git clone https://github.com/wulun811/Ming_qiankun.git
+cd Ming_qiankun
+```
+
+### 2. 运行（零依赖）
+
+```bash
+# Standalone 模式 — 纯 Python 标准库，零第三方依赖
+MING_MODE=standalone python src/ming.py start
+```
+
+### 3. 发射测试事件
+
+> **注意**：以下命令必须在 `Ming_qiankun` 项目根目录执行。`sys.path.insert(0, 'src')` 是为让 Python 能找到探针模块。
+
+```bash
+# 打开另一个终端，确保在项目根目录
+python -c "
+import sys; sys.path.insert(0, 'src')
+from probe_uni import ProbeUni
+p = ProbeUni(system='demo', mode='white')
+p.emit('llm_invoke', {
+    'layer_agent': {'step_id': 'test', 'session_id': 's1', 'agent_name': 'demo'},
+    'layer_llm': {'model': 'gpt-4', 'input_tokens': 100, 'output_tokens': 50, 'latency_ms': 230, 'cache_hit': False},
+    'layer_network': {'target_host': 'api.openai.com', 'status_code': 200}
+})
+print('Event emitted!')
+"
+```
+
+### 4. 查看诊断
+
+> **两个入口**：`src/ming.py` 负责服务管理（启动/停止归档器和 Web），`src/cli.py` 负责查询诊断。你也可以用 `python src/cli.py --help` 查看所有命令。
+
+```bash
+python src/cli.py dx list
+```
+
+### 5. 查看 Web 目镜
+
+```bash
+# 启动 Web 服务（自动导出 + 自动刷新，绑定 127.0.0.1:18088）
+python src/ming.py web start
+
+# 局域网访问（绑定 0.0.0.0）
+python src/ming.py web start --port 18088
+# 然后在 server 启动时手动指定 --host 0.0.0.0：
+python src/plugins/web_dashboard/server.py --daemon --host 0.0.0.0 --port 18088 --no-browser
+
+# 浏览器打开 http://localhost:18088 或 http://<本机IP>:18088
+```
+
+**自动更新**：Web 服务内置每 30 秒自动导出 data.json + 前端自动刷新，无需手动执行 export 命令。
+
+**局域网访问**：
+| 场景 | 命令 | 浏览器地址 |
+|------|------|-----------|
+| 本机仅 | `python src/plugins/web_dashboard/server.py --daemon --port 18088` | `http://localhost:18088` |
+| 局域网开放 | `python src/plugins/web_dashboard/server.py --daemon --host 0.0.0.0 --port 18088 --no-browser` | `http://<本机IP>:18088` |
+| 加认证 | `python src/plugins/web_dashboard/server.py --daemon --host 0.0.0.0 --port 18088 --no-browser --token your-secret` | `http://<本机IP>:18088/?token=your-secret` |
+
+---
+
+## Docker 一键运行
+
+```bash
+docker build -t ming .
+docker run -d --name ming -p 18088:18088 ming
+# 打开 http://localhost:18088
+```
+
+---
+
+## 架构概览
+
+```
+┌─────────────┐     JSONL hot files      ┌──────────────┐
+│  Probes     │ ───────────────────────► │  Archiver    │
+│  (无状态)    │                          │  (唯一写入者) │
+└─────────────┘                          └──────┬───────┘
+       │                                        │
+       │  LangChain / LlamaIndex                │ SQLite / MySQL
+       │  CrewAI / OpenHands                    ▼
+       │  AutoGPT / Hermes / MCP         ┌──────────────┐
+       │                                 │  Query       │
+       └────────────────────────────────►│  Bridge      │
+                                         └──────┬───────┘
+                                                │
+                                          ┌─────▼─────┐
+                                          │  Web UI   │
+                                          │  / MCP    │
+                                          └───────────┘
+```
+
+### 核心模块
+
+| 模块 | 行数 | 职责 |
+|------|------|------|
+| `probe_uni.py` | ~245 | 无状态热轨写入器，零数据库依赖 |
+| `archiver.py` | ~465 | 唯一写入者，顺序扫描 hot → SQLite |
+| `cli.py` | ~259 | 命令行：dx/health/skill/query/status/web |
+| `watchdog.py` | ~163 | 进程守护 + 磁盘告警 |
+| `query_bridge.py` | ~99 | 只读查询接口 |
+
+### 适配器（官方参考实现）
+
+| 适配器 | 语言 | 事件类型 |
+|--------|------|----------|
+| LangChain | Python | llm_invoke, tool_call, memory_retrieve (待适配) |
+| LlamaIndex | Python | llm_invoke, memory_retrieve, agent_step (待适配) |
+| CrewAI | Python | agent_step, llm_invoke (待适配) |
+| OpenHands | Python | agent_step, llm_invoke, tool_call (待适配) |
+| AutoGPT | Python | agent_step, llm_invoke (待适配) |
+| Hermes | Python | llm_invoke, tool_call, memory_retrieve |
+| MCP | Python | tool_call, memory_retrieve, llm_invoke |
+
+> 所有适配器采用 **monkey-patch + 零第三方依赖** 设计。未安装目标框架时静默降级，不影响主流程。使用第三方框架的适配器需额外安装对应框架。（标记"待适配"的为社区贡献方向，欢迎 PR。）
+
+---
+
+## 双模式
+
+| 模式 | 环境变量 | 持久层 | 依赖 |
+|------|----------|--------|------|
+| **Standalone** | `MING_MODE=standalone`（默认） | SQLite | 纯标准库 |
+| **Cluster** | `MING_MODE=cluster` | MySQL | pymysql |
+
+```bash
+# Standalone（默认）
+python src/ming.py start
+
+# Cluster
+MING_MODE=cluster \
+  WQ_DB_HOST=127.0.0.1 \
+  WQ_DB_USER=root \
+  WQ_DB_PASSWORD=secret \
+  WQ_DB_NAME=ming \
+  python src/ming.py start
+```
+
+---
+
+## 性能调参
+
+Standalone 模式下，归档器默认处理 **1000 事件/秒**。通过环境变量可灵活调整：
+
+| 环境变量 | 默认值 | 说明 | 典型场景 |
+|----------|--------|------|----------|
+| `WQ_ARCHIVER_BATCH_SIZE` | `1000` | 每次扫描的热轨文件数上限 | 高密度写入：`5000` |
+| `WQ_ARCHIVER_FLUSH_SEC` | `1.0` | 扫描间隔（秒） | 低延迟要求：`0.5` |
+| `WQ_ARCHIVER_VACUUM_HOURS` | `24` | VACUUM 间隔（小时） | 磁盘紧张时：`6` |
+
+### 场景推荐
+
+```bash
+# 场景 1: 默认（大多数用户，1000 events/s）
+MING_MODE=standalone python src/ming.py start
+
+# 场景 2: 高吞吐（写入密集，~5000 events/s）
+WQ_ARCHIVER_BATCH_SIZE=5000 \
+WQ_ARCHIVER_FLUSH_SEC=0.5 \
+MING_MODE=standalone python src/ming.py start
+
+# 场景 3: 省电模式（低负载设备，~200 events/s）
+WQ_ARCHIVER_BATCH_SIZE=200 \
+WQ_ARCHIVER_FLUSH_SEC=5.0 \
+MING_MODE=standalone python src/ming.py start
+```
+
+> **提示**：调整参数后需重启归档器生效。前端 Config 面板可查看当前配置值（只读）。
+
+---
+
+## 运行测试
+
+```bash
+# 全量测试
+python -m pytest tests/ -v
+
+# 仅适配器 Mock 测试
+python -m pytest tests/test_probe_*_mock.py -v
+```
+
+当前状态：**389 passed, 2 skipped, 0 failed**
+
+---
+
+## 代码量预算
+
+乾坤镜采用分类预算制，配置见 [`config/budget.json`](config/budget.json)：
+
+| 分类 | 预算 | 说明 |
+|------|------|------|
+| core_base | 1,500 行 | 探针 + 归档器 + CLI + 查询 |
+| cluster_extension | 600 行 | Cluster 扩展（可选） |
+| plugin_layer | 1,000 行 | 插件层（可替换） |
+| adapter_layer | 1,200 行 | 适配器 + 基类 |
+| test_layer | 无上限 | 测试代码单独统计 |
+
+---
+
+## 目录结构
+
+```
+├── src/                    # 源代码
+│   ├── ming.py       # 统一入口
+│   ├── probe_uni.py        # 探针
+│   ├── archiver.py         # 归档器
+│   ├── cli.py              # CLI
+│   ├── adapters/           # 适配器
+│   └── plugins/            # 插件
+├── tests/                  # 测试
+├── config/                 # 配置
+│   └── budget.json         # 代码量预算
+├── updocs/                 # 文档（架构+探针+诊断+数据+接口+运维+测试）
+└── .github/workflows/      # CI/CD
+```
+
+---
+
+## 贡献
+
+见 [CONTRIBUTING.md](CONTRIBUTING.md)。
+
+### 铁律（违反即 P0）
+
+- **Standalone 零第三方依赖**：仅 Python 标准库
+- **Cluster 唯一额外依赖**：仅 `pymysql`
+- **探针纯粹**：`probe_uni.py` 不 import sqlite3/pymysql
+- **唯一写入者**：只有归档器可写入持久层
+- **只读对外**：查询模块使用只读连接
+
+---
+
+## 许可
+
+Business Source License 1.1 — 全球年收入低于 10 万美元的公司和个人可免费生产使用。非生产用途（开发、测试、评估）无收入限制。详见 [LICENSE](LICENSE) 文件。
+
+---
+
+## 作者
+
+- **陈正 (Chenzheng)** · [@wulun811](https://github.com/wulun811)
+- 官方邮箱：zhulong007ai@163.com
+- 灵感始于：**诛仙协议 / THEOCLAST Protocol (TCL)**
+
+---
+
+**乾坤镜 v0.11.9m — 为社区而生。**