isage-middleware 0.2.4.3__cp311-none-any.whl

isage_middleware-0.2.4.3.dist-info/METADATA

@@ -0,0 +1,266 @@
+Metadata-Version: 2.1
+Name: isage-middleware
+Version: 0.2.4.3
+Summary: SAGE Middleware - Streaming-Augmented Generative Execution
+Author-email: IntelliStream Team <shuhao_zhang@hust.edu.cn>
+License: MIT
+Project-URL: Homepage, https://github.com/intellistream/SAGE
+Project-URL: Repository, https://github.com/intellistream/SAGE.git
+Project-URL: Documentation, https://intellistream.github.io/SAGE-Pub/
+Project-URL: Issues, https://github.com/intellistream/SAGE/issues
+Keywords: data,api,reasoning,dataflow,llm,ml,middleware,framework,rag,intellistream,ai,sage
+Classifier: Development Status :: 4 - Beta
+Classifier: Intended Audience :: Developers
+Classifier: Intended Audience :: Science/Research
+Classifier: Operating System :: OS Independent
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Classifier: Topic :: Software Development :: Libraries :: Python Modules
+Classifier: Topic :: System :: Distributed Computing
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+Requires-Dist: openai<1.91.0,>=1.52.0
+Requires-Dist: httpx<1.0.0,>=0.28.0
+Requires-Dist: aiohttp<4.0.0,>=3.12.0
+Requires-Dist: beautifulsoup4<5.0.0,>=4.12.0
+Requires-Dist: feedparser<7.0.0,>=6.0.11
+Requires-Dist: json-repair<1.0.0,>=0.30.0
+Requires-Dist: bm25s<1.0.0,>=0.2.13
+Requires-Dist: rank-bm25<1.0.0,>=0.2.0
+Requires-Dist: PyStemmer<4.0.0,>=3.0.0
+Provides-Extra: all
+Requires-Dist: isage-middleware[auth,compression,libs,llm-providers,ml,neuromem,queue,streaming,vdb]; extra == "all"
+Provides-Extra: auth
+Requires-Dist: python-jose[cryptography]<4.0.0,>=3.5.0; extra == "auth"
+Requires-Dist: passlib[argon2]<2.0.0,>=1.7.4; extra == "auth"
+Provides-Extra: compression
+Requires-Dist: llmlingua<1.0.0,>=0.2.0; extra == "compression"
+Provides-Extra: dev
+Requires-Dist: pytest>=7.4.0; extra == "dev"
+Requires-Dist: pytest-cov>=4.0.0; extra == "dev"
+Requires-Dist: pytest-asyncio>=0.21.0; extra == "dev"
+Requires-Dist: ruff==0.14.6; extra == "dev"
+Requires-Dist: mypy>=1.7.0; extra == "dev"
+Requires-Dist: pybind11>=2.10.0; extra == "dev"
+Provides-Extra: libs
+Requires-Dist: isage-libs; extra == "libs"
+Requires-Dist: isage-agentic>=0.1.0.0; extra == "libs"
+Requires-Dist: isage-eval>=0.1.0.0; extra == "libs"
+Requires-Dist: isage-finetune>=0.1.0.0; extra == "libs"
+Requires-Dist: isage-privacy>=0.1.0.0; extra == "libs"
+Requires-Dist: isage-rag>=0.1.0.0; extra == "libs"
+Requires-Dist: isage-safety>=0.1.0.0; extra == "libs"
+Requires-Dist: isage-refiner>=0.1.0.0; extra == "libs"
+Provides-Extra: llm-providers
+Requires-Dist: ollama<1.0.0,>=0.5.0; extra == "llm-providers"
+Requires-Dist: zhipuai<3.0.0,>=2.1.0; extra == "llm-providers"
+Requires-Dist: cohere<6.0.0,>=5.16.0; extra == "llm-providers"
+Requires-Dist: anthropic<1.0.0,>=0.25.0; extra == "llm-providers"
+Provides-Extra: ml
+Requires-Dist: transformers<4.54.0,>=4.52.0; extra == "ml"
+Requires-Dist: tokenizers<0.24.0,>=0.21.0; extra == "ml"
+Requires-Dist: sentence-transformers<4.0.0,>=3.1.0; extra == "ml"
+Requires-Dist: InstructorEmbedding<2.0.0,>=1.0.0; extra == "ml"
+Requires-Dist: accelerate<2.0.0,>=1.9.0; extra == "ml"
+Requires-Dist: huggingface-hub<1.0.0,>=0.34.0; extra == "ml"
+Requires-Dist: peft<1.0.0,>=0.18.0; extra == "ml"
+Requires-Dist: scipy<2.0.0,>=1.15.0; extra == "ml"
+Provides-Extra: neuromem
+Requires-Dist: isage-neuromem>=0.2.1.1; extra == "neuromem"
+Provides-Extra: queue
+Requires-Dist: celery<6.0.0,>=5.5.0; extra == "queue"
+Requires-Dist: flower<3.0.0,>=2.0.0; extra == "queue"
+Provides-Extra: streaming
+Requires-Dist: isage-flow>=0.1.1; extra == "streaming"
+Requires-Dist: isage-tsdb>=0.1.5; extra == "streaming"
+Provides-Extra: vdb
+Requires-Dist: isage-vdb>=0.1.5; extra == "vdb"
+Requires-Dist: faiss-cpu<2.0.0,>=1.7.0; extra == "vdb"
+
+# SAGE Middleware（中间件）
+
+## 📋 Overview
+
+用于构建带有 AI 能力的流式数据应用的中间件层，集成了多家大模型提供商、异步任务、鉴权以及高性能的数据处理组件。
+
+## 🧭 Governance / 团队协作制度
+
+- `docs/governance/TEAM.md`
+- `docs/governance/MAINTAINERS.md`
+- `docs/governance/DEVELOPER_GUIDE.md`
+- `docs/governance/PR_CHECKLIST.md`
+- `docs/governance/SELF_HOSTED_RUNNER.md`
+- `docs/governance/TODO.md`
+
+## ✨ Key Features
+
+- 🤖 **LLM 推理**：
+  - **sageLLM** ✅ 推荐：统一 LLM 推理引擎，支持 CUDA/Ascend/Mock 后端
+  - vLLM ⚠️ 已弃用：将在 v0.4.0 移除，请迁移至 sageLLM
+- 🔎 检索与向量：RAG、BM25、FAISS 等
+- 📋 任务调度：Celery 异步任务
+- 🔐 安全鉴权：JWT、密码学工具
+- ⚙️ 核心组件：
+  - `sage_db`：数据库/向量存储相关组件（含 C/C++ 扩展）
+  - `sage_flow`：高性能向量流处理（可能包含扩展或独立子模块）
+
+## 🚀 Installation
+
+```bash
+pip install isage-middleware
+
+# 可选：VLLM 支持（需要 CUDA）
+pip install isage-common[vllm]
+
+# 可选：与完整 SAGE 框架集成
+pip install isage-middleware[sage]
+```
+
+## 📖 Quick Start
+
+### LLM 推理（推荐：sageLLM）
+
+```python
+from sage.middleware.operators.llm import SageLLMGenerator
+
+# 自动选择最佳后端
+generator = SageLLMGenerator(
+    model_path="Qwen/Qwen2.5-7B-Instruct",
+    backend_type="auto",  # auto/cuda/ascend/mock
+    temperature=0.7,
+    max_tokens=2048,
+)
+
+result = generator.execute("你好，世界！")
+print(result)
+```
+
+### API 客户端
+
+```python
+from sage.middleware.api.client import APIClient
+from sage.middleware.auth.jwt import JWTManager
+
+client = APIClient()
+jwt_manager = JWTManager()
+
+resp = client.chat_completion(
+    provider="openai",
+    messages=[{"role": "user", "content": "Hello!"}],
+)
+print(resp)
+```
+
+> 📖 **迁移指南**：如果您正在使用 `VLLMGenerator`，请参阅
+> [vLLM to sageLLM Migration Guide](../../docs-public/docs_src/dev-notes/migration/VLLM_TO_SAGELLM_MIGRATION.md)
+
+## 配置示例
+
+```yaml
+# config.yaml
+middleware:
+  auth:
+    secret_key: "your-secret-key"  # pragma: allowlist secret
+    algorithm: "HS256"
+  providers:
+    openai:
+      api_key: "sk-..."  # pragma: allowlist secret
+      base_url: "https://api.openai.com/v1"
+```
+
+## 开发与本地安装
+
+```bash
+git clone https://github.com/intellistream/SAGE.git
+cd SAGE/packages/sage-middleware
+pip install -e .
+```
+
+> 说明：中间件组件（sage_db/sage_flow/sage_tsdb 等）现已随源码直接提供或通过 pip 依赖分发，无需初始化任何子模块。
+
+## 新增中间件组件的规范（重要）
+
+当你添加新的中间件组件（例如 `sage_foo`）时，请务必在 `setup.py` 中接入其构建逻辑，这样在安装 `isage-middleware` 时会自动构建/准备该组件。
+
+建议遵循以下约定：
+
+### 1. 目录结构
+
+- `src/sage/middleware/components/sage_foo/`
+  - `__init__.py`（Python 包）
+  - （如包含 C/C++ 部分）`cmake/`、`build.sh`、`CMakeLists.txt`
+  - 其他源码/资源文件
+
+### 2. C++ 扩展与依赖要求
+
+如果组件包含 C/C++ 扩展，**必须**遵守以下依赖约束，以与现有 `sage_db`、`sage_flow` 保持一致：
+
+> **注意**: 以下代码示例中的 `SAGE_COMMON_DEPS_FILE` 等变量是 CMake 环境变量，非占位符。
+
+1. **共享依赖入口：**
+
+   - 在 `CMakeLists.txt` 中优先加载共享依赖脚本（通过环境变量）：
+     ```cmake
+     set(_sage_foo_shared_deps FALSE)
+     # Check if shared deps file is defined
+     if(DEFINED SAGE_COMMON_DEPS_FILE AND EXISTS "$ENV(SAGE_COMMON_DEPS_FILE)")
+         include("$ENV(SAGE_COMMON_DEPS_FILE)")
+         set(_sage_foo_shared_deps TRUE)
+     endif()
+     ```
+   - 共享脚本会提供 `pybind11::module`、统一的可见性编译选项、以及全部 gperftools 配置变量。
+
+1. **本地回退脚本：**
+
+   - 请在组件目录的 `cmake/` 下提供 `pybind11_dependency.cmake` 和（如需要）`gperftools.cmake`，用于在独立构建或共享脚本缺失时下载依赖。
+   - 在 `CMakeLists.txt` 中检测 `_sage_foo_shared_deps`，若为 `FALSE` 再加载本地脚本：
+     ```cmake
+     if(NOT _sage_foo_shared_deps)
+         include(cmake/pybind11_dependency.cmake)
+     endif()
+     ```
+
+1. **gperftools 约定：**
+
+   - 新增扩展应暴露 `ENABLE_GPERFTOOLS` 选项，并默认遵循 `SAGE_ENABLE_GPERFTOOLS` 环境变量。
+   - 只有在确认找到 `SAGE_GPERFTOOLS_LIBS`（或本地回退脚本成功解析）时才链接 gperftools；否则务必禁用该选项并给出清晰日志。
+
+1. **环境变量约定：**
+
+   - 共享脚本会设置 `SAGE_COMMON_COMPILE_OPTIONS`、`SAGE_COMMON_COMPILE_DEFINITIONS` 等变量，请在目标上引用，避免重复配置。
+   - 新扩展若需要自定义变量，务必提供合理的默认值，并允许通过环境变量覆写。
+
+1. **打包要求：**
+
+   - `pyproject.toml` 中需包含 `"sage.middleware.components.sage_foo" = ["cmake/*.cmake"]` 等条目，保证 CMake
+     脚本在发布包内。
+   - 如扩展存在 Python 侧绑定（`python/` 目录），确保 `pyproject.toml` 中的 `package-data` 同步更新。
+
+### 3. 构建脚本
+
+- 如果组件需要编译或额外准备工作，请提供标准的 `build.sh`，支持无交互执行：
+  - `bash build.sh --install-deps`
+- `build.sh` 应读取相关环境变量（如依赖文件路径、gperftools 开关等），并在调用 `cmake` 时透传（参考 `sage_db`、`sage_flow`）。
+
+### 4. 在 `setup.py` 中接入
+
+- 在自定义的 `build_ext` 流程中：
+  - 新增 `build_sage_foo()` 方法（参照现有 `build_sage_db()` / `build_sage_flow()`）。
+  - 使用统一的 `_shared_env()` 帮助函数为子进程注入共享依赖环境。
+  - 在 `run()` 中调用 `self.build_sage_foo()`，并保证失败不阻断安装（打印清晰日志即可）。
+
+### 5. 环境变量开关（可选）
+
+- 通过设置 `SAGE_SKIP_C_EXTENSIONS=1` 可以跳过所有扩展构建（调试纯 Python 逻辑时常用）。
+
+### 6. CI 与子模块提示
+
+- CI 会递归检出子模块并按 `setup.py` 的逻辑尝试构建。
+- 中间件组件不再通过 Git submodule 分发；请不要在 CI 或本地执行子模块初始化命令。
+
+## 贡献
+
+欢迎提交 PR！请先阅读仓库根目录的 [CONTRIBUTING.md](../../CONTRIBUTING.md)。
+
+## 📄 License
+
+MIT License - see [LICENSE](../../LICENSE) for details.

isage_middleware-0.2.4.3.dist-info/RECORD

@@ -0,0 +1,94 @@
+sage/middleware/__init__.py,sha256=0VLtoshNFWRzLHvE_wVq3DuYXwQrzyBJ9yfMa3Vaj-A,1972
+sage/middleware/_version.py,sha256=kilIikRCA21kF-bP0fRc6XmTREV9gA8bIyf_HD5GJUk,177
+sage/middleware/py.typed,sha256=42WLrVlzpn7jMsIIEdXWWE5YOGnCHXrlnm5sbY6TFmQ,96
+sage/middleware/components/__init__.py,sha256=KwVxO1BJzE7vvrAEQRX9ZESizZyrfdy921cch9qmHUU,821
+sage/middleware/components/extensions_compat.py,sha256=s84uXImqyM72VMp6Q3JoeR8ud6LjzlQKvnorPv5fObY,4706
+sage/middleware/components/sage_db/__init__.py,sha256=rA1z9DGqYgxCY9UiRyRDrMLQxaGCHJTN0ySr7GEWMr0,3130
+sage/middleware/components/sage_db/backend.py,sha256=0de4XsgALCEjS_WEGGz9BtD50ly8af5mHIdMLuAdiJM,3915
+sage/middleware/components/sage_db/service.py,sha256=oQNveAXhiCcBXR5tusk3G67D3ON0RUXhpZxvLjvnYBI,463
+sage/middleware/components/sage_flow/__init__.py,sha256=vs6wj9g5I5OArMgwnlFW_E4GXMshY0p54HL3r8lsmTY,2016
+sage/middleware/components/sage_flow/service.py,sha256=jvsnap0QnznIHAHfYeucvfeW_O3Rrop-BFRZb6wai0c,361
+sage/middleware/components/sage_flow/python/__init__.py,sha256=5hEJGXJSj9Dpo9n2VX5egr-e7dxgzgnMAUkVwtELde0,457
+sage/middleware/components/sage_flow/python/sage_flow.py,sha256=DOvFJ5nvqgzBFwf1Xk-qNTQIXyqDEucySqW6JNvCT4M,571
+sage/middleware/components/sage_flow/python/micro_service/__init__.py,sha256=gMNyW3GRLBIrP3qiAaKjAX_yLfBpcrFbW9rDVtqs-9Q,118
+sage/middleware/components/sage_flow/python/micro_service/sage_flow_service.py,sha256=hwcnlPIbbsrnkl8g9XNdyDTKZXPtVOqFkrHymEWP6a0,2884
+sage/middleware/components/sage_mem/__init__.py,sha256=0Vb2ZKzRo82danMZJl2Nxh7krj5mKZUCcLrY_UEk4MM,2903
+sage/middleware/components/sage_sias/__init__.py,sha256=Ia1jCniFokDnKvCS6LFp1S1jh3E1VpDMMGHMeQGqrLk,1899
+sage/middleware/components/sage_sias/continual_learner.py,sha256=LA_o2k81VO287jLvt7HmFvAhNtpJv-Zz7xjXqi0YPAo,6240
+sage/middleware/components/sage_sias/coreset_selector.py,sha256=L8JJfUvFwQl0GQOSWVZ2bl9uxSB7q-WCuoQpiawU9TU,10756
+sage/middleware/components/sage_sias/types.py,sha256=iAlEU2Obxp5F0iTxpwGXLoOA3LyiOKqY-Oqm133tfQw,2418
+sage/middleware/components/sage_tsdb/__init__.py,sha256=BaY8TthTdkQ7oMWD6flAu_6cqw0CiErDU6t6A8P_2Rc,2081
+sage/middleware/components/sage_tsdb/service.py,sha256=iPz2D4Lc6NPQhuLzL2mZmzTqOEKxlBVr4AZNd8C-tAA,428
+sage/middleware/components/sage_tsdb/python/__init__.py,sha256=umH2E_KItHaRMG0pLzUhuEWhIWZYaLmYe1K3al3qKIY,553
+sage/middleware/components/sage_tsdb/python/_sage_tsdb.pyi,sha256=jatBiI4eInV5z_g8aaqlKyXcz37-NV5dfTLtLsTSmXU,502
+sage/middleware/components/sage_tsdb/python/sage_tsdb.py,sha256=CGbv9e9MNoQlCF37RCP4hdMswqdVqjfp3HlcBlRfjg8,16133
+sage/middleware/components/sage_tsdb/python/algorithms/__init__.py,sha256=miozMiOag6xpJ0-g3zSMgnyAV9vXSqwtWAPNhdjh2K4,443
+sage/middleware/components/sage_tsdb/python/algorithms/base.py,sha256=kNQmzmYjcCIQW7xDNqMlRReTkDzGFoy3P5aQjMS8gzs,1199
+sage/middleware/components/sage_tsdb/python/algorithms/out_of_order_join.py,sha256=UV1l_B_oqdEYIb2njjjK8CcIir7Od-gB5RlCB7MYs3Y,8295
+sage/middleware/components/sage_tsdb/python/algorithms/window_aggregator.py,sha256=hy8QIJVe8oI5_PCfVP1DOWvE_SIFvJvJ0qG_tb-U88w,10120
+sage/middleware/components/sage_tsdb/python/micro_service/__init__.py,sha256=NPeT85nf9EHX4Feb2ITuAPRwp4NfcBOhbl0xiCekul4,169
+sage/middleware/components/sage_tsdb/python/micro_service/sage_tsdb_service.py,sha256=w0jTnQkZzbpmBe9CywI9MGyexmIWguNa6x2euutl85Y,11356
+sage/middleware/components/vector_stores/__init__.py,sha256=T97vJljRHvFjdEkU0vSUJyYF4VYLseoRBNVI5QR1wpE,809
+sage/middleware/components/vector_stores/chroma.py,sha256=Xu5q3eMIup0CmexR1QnLV0amnQq6gcoMDgU3ucUKGZk,16298
+sage/middleware/components/vector_stores/chroma_adapter.py,sha256=1VWf4jIksWsrBuscMZn6M8idMJUZ05DLlu0-4dIF3g8,5893
+sage/middleware/components/vector_stores/milvus.py,sha256=vosZkNJVFerouv4mJm7I7_Kj0OVjVTjnXvpfTLgKfYo,26260
+sage/middleware/operators/__init__.py,sha256=GrbDf99fsYzzaCQRaydi86g5pkPvvv697u1I3RCOGI4,1806
+sage/middleware/operators/agent/__init__.py,sha256=F_2sQJNfCff6HhObi8WVjSwjzjNVAg1xIK4EZjYZFS0,607
+sage/middleware/operators/agent/runtime.py,sha256=QLY2gu7eeTaBeXPOPFpljKSe-Y2U8mqXQeo41-0SLr8,11276
+sage/middleware/operators/agent/planning/__init__.py,sha256=-b6-ti_HI8wfHvSTAurwMXXX8ARG0RL0_AfIPnizrJE,219
+sage/middleware/operators/agent/planning/llm_adapter.py,sha256=sWLqglPfZSa9awXBopDJpYNNKiGeWupk6C78ZtwtqXY,1445
+sage/middleware/operators/agent/planning/planner_adapter.py,sha256=ga_5K8et_1c5aOvhgpt2eirBMxKOrkzeBCf-klwMphE,3557
+sage/middleware/operators/agent/planning/router.py,sha256=mW6Um0tk4-t9QnDSY-daObUHGK9Iyt8a5VCAzKyP41U,4220
+sage/middleware/operators/agentic/__init__.py,sha256=LCUGAMu4pNtoH9PcpvgCpS4kzngj1xFdxitTsFlZEho,1303
+sage/middleware/operators/agentic/config.py,sha256=Bj8NmW8pHOp3r4SaFdq8AkLJJ2zQY9CGTeXlwmZXLOc,7804
+sage/middleware/operators/agentic/planning_operator.py,sha256=RZLoCGq9d1WjerH3Xty2MmVciiSHbPW5rDCY2jZHAVw,4068
+sage/middleware/operators/agentic/refined_searcher.py,sha256=8VZGqDo83GqqBT_p3HdhDPYpweKG4WmWAxAbQY7zOEg,4961
+sage/middleware/operators/agentic/runtime.py,sha256=9DjQGEqsEYZhaz3uLYCAfrsJSBHBkMlcCEg6qFmTxkc,8590
+sage/middleware/operators/agentic/timing_operator.py,sha256=fmoMee8WI547dvmukwpceQKXYSETS9ILonRtW4dhKME,4138
+sage/middleware/operators/agentic/tool_selection_operator.py,sha256=GlyqGc59zpDk7fw3TIVZN9bM4LYPUBFfVmvjQdCxW7A,4298
+sage/middleware/operators/context/__init__.py,sha256=QReFA5qvVeKv3nRsoj8xyJHtvNQVSaAvnqTaXE0Ax4A,660
+sage/middleware/operators/context/critic_evaluation.py,sha256=t6d4Kb_WpOIK8ADf-eIT5ocL-aOHcNLN3J0A-kGdBU4,419
+sage/middleware/operators/context/model_context.py,sha256=gjKykFuy5Gnh9CiYc21ezv3ymVxQ36TeiLC8vJuJKis,23241
+sage/middleware/operators/context/quality_label.py,sha256=tJlkK-LwTP5GbhpE_T-2ufM82kwuymd-TyY-Xj9iNHk,362
+sage/middleware/operators/context/search_query_results.py,sha256=EZkhBoCwHj_7yvRhALnSG0U9h2y52LP4fBL52MNWyoc,2316
+sage/middleware/operators/context/search_result.py,sha256=nOl3KpvnFx7wdJUxooTNEU-x3XWE3kPe1_0-B2ZAjGc,1326
+sage/middleware/operators/context/search_session.py,sha256=cElX3KpwXs58CnQImuxxA8XgzCPPtd1HUFSoSXeqvm4,3138
+sage/middleware/operators/filters/__init__.py,sha256=k5V5EMjWNXxi7XkKfnuv6IK9MTOZRM3QOnPHulGbzfI,689
+sage/middleware/operators/filters/context_sink.py,sha256=mdnrExkaW1aTu-oMYivm6U1pF6hECgZiy7hUVWoGcR4,15274
+sage/middleware/operators/filters/context_source.py,sha256=GgqnBCorU-_NqKl7s8tOY264SCiM00BLqr_5o1ENGTk,13238
+sage/middleware/operators/filters/evaluate_filter.py,sha256=EntVTZ7RYXCPL-vXpMZrUGcZxA37jJvq3gYOMHzpHj4,2693
+sage/middleware/operators/filters/tool_filter.py,sha256=wgODlItxK8RFPqIr6mnzGUL_WWw0CX6Y5mvIeMCjhq0,2354
+sage/middleware/operators/llm/__init__.py,sha256=SuL-rKzWyElGjeQiz_C2xaD2gb1F90hyL1ko4BgUiEw,543
+sage/middleware/operators/llm/sagellm_generator.py,sha256=PpEitNvVsIvKs9iS-QHPGImg85HHg9ELWlRn7gJRePo,15719
+sage/middleware/operators/rag/__init__.py,sha256=MbkM0FOt1EUG12vs6mMueFGna9DfDjYhAZKpNCxdkoQ,5762
+sage/middleware/operators/rag/arxiv.py,sha256=G3a74WWFxrsZmUT-wkWt4NXFxIa3-KELJr0HrS8eyU0,14404
+sage/middleware/operators/rag/chunk.py,sha256=dh3Feu52H1pGa0xYzurBLXC9PRf8osZ6ehUh5rnNjeY,435
+sage/middleware/operators/rag/document_loaders.py,sha256=ahfpEHMeiZmAjShizoiBCIFo6DhUHnAv8VPJzOI4pIA,496
+sage/middleware/operators/rag/evaluate.py,sha256=pnToHK3T5OK6lug4CuMrCIkrr9pPIB6cPW3jEcg21lw,22319
+sage/middleware/operators/rag/generator.py,sha256=hqaSD_SpLBb3v2zpKGRNsxHAUWUb5jc8RjreaTw8j_k,11887
+sage/middleware/operators/rag/pipeline.py,sha256=sX_GPuY9AZbuetU62k8LAaD-ZZqThZZS0cBequHg32Q,1441
+sage/middleware/operators/rag/profiler.py,sha256=iQGVoZS7aA3pSV7wuTH3qLggREnUQvadSYqpx6YPaxc,2138
+sage/middleware/operators/rag/promptor.py,sha256=m38jRBUwkF7cYqwWu09B9c63e3Ho2QRlhGDNnkZFa74,15695
+sage/middleware/operators/rag/refiner.py,sha256=Gd85_TS6HxXp6ENPQTzeLKeO-w0TBsYg0ytDOOE_fOY,8270
+sage/middleware/operators/rag/reranker.py,sha256=m5wTeOZTs_PFTjgSPdVsYP-YBIYvBlZXRaFNpG-4ImQ,14501
+sage/middleware/operators/rag/retriever.py,sha256=gwFwXUfVtMnBzzVLT6rrdvzolFmo0SrUVT-EHJHXCeg,49856
+sage/middleware/operators/rag/searcher.py,sha256=ahdA8lUp0sThtR55-6gNwD4o-ukCMz6EyLMFGEEhkM4,1261
+sage/middleware/operators/rag/types.py,sha256=11jfviVUWddDW0rVaaGXk2Fe5bnmv2k2kzIzS5oB-Lo,530
+sage/middleware/operators/rag/writer.py,sha256=rq9j0_Fb6693xWDhZCyRhex-mme_Mu5hgWj7ZXE15k0,3374
+sage/middleware/operators/rag/index_builder/__init__.py,sha256=b2RHIM-ob4ufhEwlaJ8qTjABRKrLn_vikZLwIb5Q7Sg,1617
+sage/middleware/operators/rag/index_builder/builder.py,sha256=btE1u_-9DHjf6h0XzzAfbeNHCRBuFGFw86FIsEnxBxM,13058
+sage/middleware/operators/rag/index_builder/manifest.py,sha256=Fur4n5rLy11mn1cb2NOvxVUdWb0k-F0qwsrgmD3MF3g,3476
+sage/middleware/operators/rag/index_builder/storage.py,sha256=x0LRyRXkYpVi86U2gJ9LDAjnPf79Jx0C-NaBRr3Dzvk,4044
+sage/middleware/operators/tools/__init__.py,sha256=t_UD661nXFUuKOeOFP-fn7AxTR7wBbu4FGyg-NFUbkA,2320
+sage/middleware/operators/tools/arxiv_paper_searcher.py,sha256=PKhUfko1r_56n2kAjfUPw7jMiF9bcg5hRxgxjawyrnY,6339
+sage/middleware/operators/tools/arxiv_searcher.py,sha256=U-yujbcXCAsJ1QZhozidYrsb5AJszGlUYQKs8ww8pZM,3422
+sage/middleware/operators/tools/duckduckgo_searcher.py,sha256=j0vtY_T8xtg6usC9hcRf5cyrZYMRH-HLjt1I9nZ_ZmM,3499
+sage/middleware/operators/tools/image_captioner.py,sha256=ql44Lmvr88lmXgkR9vO-Gh1GAmtU_fEYXQC26-B7KSM,4586
+sage/middleware/operators/tools/nature_news_fetcher.py,sha256=_muGIZnPBeSpboWQM8xKt1bi8r2SyPIdWD7-1sqE2Xc,8369
+sage/middleware/operators/tools/searcher_tool.py,sha256=fqWgJ_YnfO6F6vXEm-F0JgmaXwHDjyQT0zYwFfytRao,19534
+sage/middleware/operators/tools/text_detector.py,sha256=xmpePKVxjU66y9WWM78eheJMyY9pDBh3xMRW11t4sPc,6643
+sage/middleware/operators/tools/url_text_extractor.py,sha256=OAmkTbLUt2vFDuNEGwOKhtjpRwtk6hwm8n2SiNpyDR4,3281
+isage_middleware-0.2.4.3.dist-info/METADATA,sha256=6d5i6ovLU6ZH3VTVR_XRqH90HqWG94Ay0uYz7mQtLbw,10225
+isage_middleware-0.2.4.3.dist-info/WHEEL,sha256=ZJeWpR6hcCRGwxVKXlDk-HsGwijNyTq4fszaDj4Ycyo,93
+isage_middleware-0.2.4.3.dist-info/top_level.txt,sha256=hibFyzQHiLOMK68qL1OWsNKaXOmSXqZjeLTBem6Yy7I,5
+isage_middleware-0.2.4.3.dist-info/RECORD,,

isage_middleware-0.2.4.3.dist-info/WHEEL

@@ -0,0 +1,5 @@
+Wheel-Version: 1.0
+Generator: setuptools (73.0.1)
+Root-Is-Purelib: true
+Tag: cp311-none-any
+

isage_middleware-0.2.4.3.dist-info/top_level.txt

@@ -0,0 +1 @@
+sage

sage/middleware/__init__.py

@@ -0,0 +1,59 @@
+"""
+SAGE Middleware - 中间件和领域算子层
+
+Layer: L4 (Domain Components)
+Dependencies: sage.libs (L3), sage.kernel (L3), sage.platform (L2), sage.common (L1)
+
+提供：
+- 领域算子：
+  * RAG operators: 检索增强生成 (pipeline, retriever, generator, profiler, document_loaders)
+  * RAG backends: 向量数据库集成 (Milvus, Chroma)
+  * LLM operators: 大语言模型算子
+  * LLM clients: LLM服务客户端 (OpenAI, HuggingFace)
+  * Tool operators: 领域工具 (arxiv_searcher, image_captioner, nature_news等)
+  * Filters: 业务过滤器 (tool_filter, evaluate_filter, context_source/sink)
+- 业务上下文：Agent/RAG workflow 上下文管理 (ModelContext, SearchSession等)
+- 中间件组件：
+  * sage_db: 数据库抽象
+  * sage_mem: 内存管理和缓存
+  * sage_refiner: 数据精炼工具 (仅保留service层，算法已下移到sage.libs.context.compression)
+  * sage_flow: 工作流编排
+  * sage_tsdb: 时序数据库
+
+Architecture:
+- L4 层提供领域特定的功能组件
+- 依赖 L1-L3 的基础设施、核心引擎和通用算法
+- 为 L5 (应用层) 提供可复用的领域组件
+- 包含各种中间件和高级算子实现
+
+子模块：
+- operators/: 领域算子
+  * rag/: RAG operators + backends (Milvus, Chroma)
+  * llm/: LLM operators + clients (OpenAI, HuggingFace)
+  * tools/: 领域特定工具
+  * filters/: 业务过滤器
+- context/: Agent/RAG业务上下文 (从sage.libs迁移)
+- components/: 中间件组件（DB, Memory, Refiner等）
+"""
+
+# 直接从本包的_version模块加载版本信息
+try:
+    from sage.middleware._version import __author__, __email__, __version__
+except ImportError:
+    # 备用硬编码版本
+    __version__ = "0.1.4"
+    __author__ = "IntelliStream Team"
+    __email__ = "shuhao_zhang@hust.edu.cn"
+
+# 导出子模块
+__layer__ = "L4"
+
+from . import components, operators
+
+__all__ = [
+    "__version__",
+    "__author__",
+    "__email__",
+    "operators",
+    "components",
+]

sage/middleware/_version.py

@@ -0,0 +1,6 @@
+"""Version information for sage-middleware package."""
+
+# 独立硬编码版本
+__version__ = "0.2.4.3"
+__author__ = "IntelliStream Team"
+__email__ = "shuhao_zhang@hust.edu.cn"

sage/middleware/components/__init__.py

@@ -0,0 +1,30 @@
+"""
+SAGE Middleware Components
+
+Core middleware components including databases, flow engines, and other services.
+
+Note: sage_refiner has been migrated to the independent isage-refiner package.
+      Install with: pip install isage-refiner
+      Use: from sage_refiner import LongRefinerCompressor
+"""
+
+# Lazy imports to avoid loading heavy dependencies (FAISS, etc.) at module load time
+from . import sage_db, sage_flow, sage_sias, sage_tsdb
+from .extensions_compat import *  # noqa: F403
+
+# Import sage_mem - it's a namespace package that handles its own lazy loading
+try:
+    from . import sage_mem
+except ImportError:
+    # sage_mem namespace package might not be available
+    sage_mem = None
+
+
+__all__ = [
+    "sage_db",
+    "sage_flow",
+    "sage_mem",
+    "sage_sias",
+    "sage_tsdb",
+    "extensions_compat",
+]

sage/middleware/components/extensions_compat.py

@@ -0,0 +1,141 @@
+"""
+SAGE Middleware Components - 运行时兼容性检测
+
+此模块处理C++扩展的可选导入，提供优雅的降级机制。
+C++扩展模块（_sage_flow）在未编译时可能不存在，
+此模块确保在扩展不可用时也能正常导入和运行。
+
+注意：
+- SageVDB 已独立为 PyPI 包 (PyPI: isage-vdb, Python: sagevdb)，不再作为 SAGE C++ 扩展。
+- SageTSDB 已独立为 PyPI 包 (isage-tsdb)，不再作为 SAGE C++ 扩展。
+"""
+
+from typing import TYPE_CHECKING, Any
+
+# 类型检查时导入，运行时通过try/except处理
+if TYPE_CHECKING:
+    # 当扩展编译可用时，这些导入会成功
+    # stub文件（.pyi）提供类型提示
+    from sage.middleware.components.sage_flow.python import sage_flow as _sage_flow
+else:
+    # 运行时动态导入，优雅处理缺失的扩展
+    _sage_flow: Any = None
+
+# 尝试导入C++扩展，失败时使用纯Python实现
+_SAGE_DB_AVAILABLE = False  # 通过 isage-vdb 包检测 (Python: sagevdb)
+_SAGE_FLOW_AVAILABLE = False
+_SAGE_TSDB_AVAILABLE = False  # 通过 isage-tsdb 包检测
+
+if not TYPE_CHECKING:
+    # SageVDB 现在是独立的 PyPI 包 (PyPI: isage-vdb, Python: sagevdb)
+    try:
+        import sagevdb  # noqa: F401
+
+        _SAGE_DB_AVAILABLE = True
+    except ImportError:
+        # Don't warn on import - only when trying to use the feature
+        pass
+
+    try:
+        # 只导入 Python wrapper 模块，避免重复加载 C++ 扩展
+        from sage.middleware.components.sage_flow.python import sage_flow as _sage_flow
+
+        _SAGE_FLOW_AVAILABLE = True
+    except ImportError:
+        _sage_flow = None
+        # Don't warn on import - only when trying to use the feature
+        pass
+
+    # SageTSDB 现在是独立的 PyPI 包
+    try:
+        import sage_tsdb  # noqa: F401
+
+        _SAGE_TSDB_AVAILABLE = True
+    except ImportError:
+        # Don't warn on import - only when trying to use the feature
+        pass
+
+
+def is_sage_db_available() -> bool:
+    """检查SAGE DB扩展是否可用"""
+    return _SAGE_DB_AVAILABLE
+
+
+def is_sage_flow_available() -> bool:
+    """检查SAGE Flow扩展是否可用"""
+    return _SAGE_FLOW_AVAILABLE
+
+
+def is_sage_tsdb_available() -> bool:
+    """检查SAGE TSDB扩展是否可用"""
+    return _SAGE_TSDB_AVAILABLE
+
+
+def get_extension_status() -> dict:
+    """获取所有扩展的状态"""
+    return {
+        "sage_db": _SAGE_DB_AVAILABLE,
+        "sage_flow": _SAGE_FLOW_AVAILABLE,
+        "sage_tsdb": _SAGE_TSDB_AVAILABLE,
+        "total_available": sum([_SAGE_DB_AVAILABLE, _SAGE_FLOW_AVAILABLE, _SAGE_TSDB_AVAILABLE]),
+        "total_extensions": 3,
+    }
+
+
+def check_extensions_availability() -> dict:
+    """检查扩展可用性，返回兼容格式用于CI"""
+    return {
+        "sage_db": _SAGE_DB_AVAILABLE,
+        "sage_flow": _SAGE_FLOW_AVAILABLE,
+        "sage_tsdb": _SAGE_TSDB_AVAILABLE,
+    }
+
+
+def require_sage_db():
+    """要求SageVDB可用，否则抛出异常"""
+    if not _SAGE_DB_AVAILABLE:
+        raise ImportError(
+            "此功能需要 SageVDB。请安装:\n"
+            "  pip install isage-vdb\n"
+            "注意: PyPI 包名是 'isage-vdb'，Python 导入名是 'sagevdb'"
+        )
+    import sagevdb
+
+    return sagevdb
+
+
+def require_sage_flow():
+    """要求SAGE Flow扩展可用，否则抛出异常"""
+    if not _SAGE_FLOW_AVAILABLE:
+        raise ImportError(
+            "此功能需要SAGE Flow C++扩展。请安装完整版本：\n"
+            "pip install --force-reinstall isage-middleware\n"
+            "或安装构建依赖后重新安装：\n"
+            "Ubuntu/Debian: sudo apt-get install build-essential cmake\n"
+            "macOS: brew install cmake"
+        )
+    return _sage_flow
+
+
+def require_sage_tsdb():
+    """要求SAGE TSDB可用，否则抛出异常"""
+    if not _SAGE_TSDB_AVAILABLE:
+        raise ImportError("此功能需要 SAGE TSDB。请安装: pip install isage-tsdb")
+    import sage_tsdb
+
+    return sage_tsdb
+
+
+# 在模块导入时显示状态（仅在明确导入时）
+# 避免在用户导入其他模块时显示无关警告
+if __name__ == "__main__":
+    status = get_extension_status()
+    if status["total_available"] < status["total_extensions"]:
+        print(f"ℹ️  SAGE扩展状态: {status['total_available']}/{status['total_extensions']} 可用")
+        if not _SAGE_DB_AVAILABLE:
+            print("  ❌ SageVDB: 未安装 (pip install isage-vdb)")
+        if not _SAGE_FLOW_AVAILABLE:
+            print("  ❌ SAGE Flow: C++扩展不可用")
+        if not _SAGE_TSDB_AVAILABLE:
+            print("  ❌ SAGE TSDB: 未安装 (pip install isage-tsdb)")
+        print("  💡 提示: 安装相应依赖可启用完整功能")