isagellm-core 0.1.0.3__cp311-none-any.whl → 0.2.1.0__cp311-none-any.whl

{isagellm_core-0.1.0.3.dist-info → isagellm_core-0.2.1.0.dist-info}/METADATA

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: isagellm-core
-Version: 0.1.0.3
+Version: 0.2.1.0
 Summary: sageLLM core runtime (config/observability/registries), plugin-ready
 Author: IntelliStream Team
 License: Proprietary - IntelliStream
@@ -14,7 +14,7 @@ Description-Content-Type: text/markdown
 Requires-Dist: pydantic>=2.0.0
 Requires-Dist: pyyaml>=6.0.0
 Requires-Dist: isagellm-protocol<0.2.0,>=0.1.0
-Requires-Dist: isagellm-backend<0.2.0,>=0.1.0
+Requires-Dist: isagellm-backend<0.3.0,>=0.2.0.0
 Provides-Extra: dev
 Requires-Dist: pytest>=7.0.0; extra == "dev"
 Requires-Dist: pytest-cov>=4.0.0; extra == "dev"
@@ -32,15 +32,50 @@ Requires-Dist: pre-commit>=3.0.0; extra == "dev"
 [![License](https://img.shields.io/github/license/intellistream/sagellm-core.svg)](https://github.com/intellistream/sagellm-core/blob/main/LICENSE)
 [![Code style: ruff](https://img.shields.io/badge/code%20style-ruff-000000.svg)](https://github.com/astral-sh/ruff)
 
-sageLLM Core - Engine runtime and configuration system for LLM inference.
+sageLLM Core - 引擎协调层与运行时系统
+
+## 架构定位
+
+```
+┌─────────────────────────────────────────────────────────────┐
+│  sagellm-core (引擎协调层) ← 本仓库                         │
+│  ┌─────────────────────────────────────────────────────┐    │
+│  │  Engine Abstraction (BaseEngine, EngineFactory)    │    │
+│  │  • MockEngine, CPUEngine, HFCudaEngine             │    │
+│  │  • 自描述架构 (is_available, priority)              │    │
+│  │  • 引擎自动发现与注册                                │    │
+│  └─────────────────────────────────────────────────────┘    │
+│  ┌─────────────────────────────────────────────────────┐    │
+│  │  Configuration System (config.py)                  │    │
+│  │  • YAML/JSON 配置解析                               │    │
+│  │  • Pydantic v2 类型验证                            │    │
+│  └─────────────────────────────────────────────────────┘    │
+│  ┌─────────────────────────────────────────────────────┐    │
+│  │  Demo Runner (runner.py)                           │    │
+│  │  • 协调 backend + engine + workload                │    │
+│  │  • Year 1 Demo Contract 验证                       │    │
+│  └─────────────────────────────────────────────────────┘    │
+├─────────────────────────────────────────────────────────────┤
+│  sagellm-backend (硬件抽象层)                               │
+│  • BackendProvider (CUDA/Ascend/Mock)                      │
+│  • Stream/Event/KVBlock 管理                              │
+└─────────────────────────────────────────────────────────────┘
+```
+
+**职责分离**：
+- ❌ **Backend 不再包含**：BaseEngine, EngineFactory（已移至 core）
+- ✅ **Core 负责**：引擎接口、工厂、运行时、配置、协调
+- ✅ **Backend 负责**：硬件抽象、设备管理、内存原语
 
 ## Features
 
-- 🔧 Flexible configuration system (YAML/JSON)
-- 🔌 Plugin-based backend and engine discovery
-- 🎯 Mock mode for development and testing
-- 📊 Built-in demo runner for benchmarking
-- ✅ Type-safe with Pydantic v2
+- 🔧 引擎抽象层与自描述架构
+- 🏭 EngineFactory - 支持自动发现与优先级选择
+- 🎯 内置引擎实现（Mock/CPU/CUDA/Embedding）
+- 🔌 插件系统 - 扩展引擎与后端
+- 📊 Demo Runner - Year 1 验证框架
+- ⚙️ 配置系统 - YAML/JSON + Pydantic v2
+- ✅ Mock-First - 无 GPU 测试支持
 
 ## 安装
 

isagellm_core-0.2.1.0.dist-info/RECORD

@@ -0,0 +1,47 @@
+sagellm_core/__init__.py,sha256=idV5mkOvtUDrEs57ka2HrKe9CZBJ7mw-3C9nyy3w4og,3029
+sagellm_core/__init__.pyc,sha256=px30KQ5LM_H_h5HmAdN0wxv-hGAh6KQIEG8SZU17VL4,2972
+sagellm_core/__main__.pyc,sha256=4wEXHFB0JVZaI6wLACU59_b-LfEbujTQZyzONaalAYA,384
+sagellm_core/base_engine.pyc,sha256=XANZ2YIQGyhI6GqBvoZdmYkMblO3N2eMWHhU4waJZIg,9823
+sagellm_core/config.pyc,sha256=8gGOOBcHRSSv883bDIJNXzB069ntBc0yYEf-PFAeWdU,9617
+sagellm_core/demo.pyc,sha256=MAeTgokTW8kW906wjvTLN1yNLfOOl3_hokpVzJ-Lt4I,6377
+sagellm_core/engine.pyc,sha256=-qUIh257hxKfcrT_usrrD1Bs9YYjeUNTGyXnB1Cxec8,747
+sagellm_core/engine_factory.pyc,sha256=QeKOE607E_xf2cOKbPKZ4NLwXY8sXNsi66nm890R9qg,16172
+sagellm_core/factory.pyc,sha256=PF-xQQn-fYn25GO5muzf9rCdHKQ3NhQYiCKOnkHBjxY,2692
+sagellm_core/health.pyc,sha256=oEWyaaTix4YXhyu8JSYOQAy9KBySxbIcHt2hNpchi-w,684
+sagellm_core/mock_engine.pyc,sha256=iadJef1bNdQXdXJLFo_FE9aVglecothXLhxMoMtzEv0,532
+sagellm_core/plugins.pyc,sha256=rhdewQ_zJxnmRFBjUozBlhQtIwFg0C1rFD8zMT7ZeKI,2618
+sagellm_core/py.typed,sha256=ixa8YukDZ3kLo0WsFJRGohLMyHzbMur1ALmmASML2cs,64
+sagellm_core/runner.pyc,sha256=kUPITl68dX1rOY5Fg5o6KRBMjMhMAQFNizEuRF44PgM,14248
+sagellm_core/workload.pyc,sha256=LDuZAdimFAd3pHn8E9WG7LjwU_1IKABZ-gaMCMjOTus,4118
+sagellm_core/__pycache__/__init__.cpython-311.pyc,sha256=Gy4DiPzL45yOxumS2iBaChKzWN5Vt7CYvfFme0Im3nU,3002
+sagellm_core/__pycache__/base_engine.cpython-311.pyc,sha256=L5Al-v9E7_wvO_wCzwy-uogVGhcREnrEhWOPY8CMEdQ,9853
+sagellm_core/__pycache__/config.cpython-311.pyc,sha256=4c_gjzVmxIRApzmUq8LCboOG3wPqmmwWVFxZS3JOHOg,9647
+sagellm_core/__pycache__/demo.cpython-311.pyc,sha256=yOMGCRRQigl8sclMTcg-iHThQoxrRTPWSUdgDYJ3hgU,6407
+sagellm_core/__pycache__/engine.cpython-311.pyc,sha256=a9K-RsPxh1XlyXRvSUEwUgyMXZcjFURlnbUU439vqj8,777
+sagellm_core/__pycache__/engine_factory.cpython-311.pyc,sha256=ajVs8bvnRjQz0nDctWkDgKoWgQIVPPkRSouUDlUgEbQ,16202
+sagellm_core/__pycache__/factory.cpython-311.pyc,sha256=Dl6w_PHlzEVr62cT6D11_gm9F-MAcqouBNNHZEHCjqw,2722
+sagellm_core/__pycache__/health.cpython-311.pyc,sha256=t8l6F_O808YWsFBDQfdJU6_Ps8H-nnE6k0fdLxYwLJk,714
+sagellm_core/__pycache__/mock_engine.cpython-311.pyc,sha256=KcHBGI1dVIEKm7rhZOkPWQ27rzNVEhmXDYsiQ_5Lfe8,562
+sagellm_core/__pycache__/plugins.cpython-311.pyc,sha256=K6-SC0yOVvT-qVh7Fp2GC-O0GloaWY00W9_8y_jrBnk,2648
+sagellm_core/__pycache__/runner.cpython-311.pyc,sha256=aZCGktjzcGBqNB7tJahEHfUgbTOYPCn-TyKp6yzpD6s,14278
+sagellm_core/__pycache__/workload.cpython-311.pyc,sha256=ah0QMR3-t_EdjS6km5zi64LLn0FB3XgN7ALa1rVlDYY,4148
+sagellm_core/engines/__init__.py,sha256=o2Yb0_kbIfBAJMAa1y0fB-JfkalNIh1FXFtWEytSQfU,1389
+sagellm_core/engines/__init__.pyc,sha256=8BB5P3ewZazw3vPiHxqGdU3SsAouZRr728gjj00ILZQ,1388
+sagellm_core/engines/cpu.pyc,sha256=bvSyz1Rxu2T38_m3BjeP2stzcGrT6gwKBxnddLKw_V0,20190
+sagellm_core/engines/embedding.pyc,sha256=0cT3ODDmp-1aJlb6VthnzeKd09stAnITdTHuSaAssiA,11476
+sagellm_core/engines/hf_cuda.pyc,sha256=N6Pk-Vhj_5zOCdWiXLTasO3BU-7mNO5F0-HK4TaRn1g,50838
+sagellm_core/engines/mock.pyc,sha256=aOvuEPng6SUqQIB1Mpxcbb-8vzbrrwZSwal1atgSn3w,14611
+sagellm_core/engines/pytorch.pyc,sha256=I3oBL28pzeMCT6GNfaG52CY0yt1KR4tsOaVY-amkN7I,18413
+sagellm_core/engines/pytorch_engine.pyc,sha256=XFRcrBNL3ccxHPWuqv2uBg56HNDW0xg7_fK5jOdaHio,9872
+sagellm_core/engines/__pycache__/__init__.cpython-311.pyc,sha256=IlXu4lev2PfOkLGSO6dbKDf_RIcxUvmL5cV0EIE3P0I,1418
+sagellm_core/engines/__pycache__/cpu.cpython-311.pyc,sha256=gGjhwViirf7jzzFgcKqKo4ciiDJwWxNoBOC04vWL4dQ,20220
+sagellm_core/engines/__pycache__/embedding.cpython-311.pyc,sha256=-kRmbxPN1IsSmNUi9FA3vp-zpOBiqLXf67gWVOU1wZg,11506
+sagellm_core/engines/__pycache__/hf_cuda.cpython-311.pyc,sha256=RjPewreHvv_9N_iSt8wAxlhTJ_kM-FsoaDWplYAf-cc,50868
+sagellm_core/engines/__pycache__/mock.cpython-311.pyc,sha256=O5j1RVjz8mAgoA0Aogt_3bVmChAtuJSrjMgDFB8YTAI,14641
+sagellm_core/engines/__pycache__/pytorch.cpython-311.pyc,sha256=grmN4cmJmGdeO89jBPllYZGlB8gbRDYA2Zzy7pPWCjQ,18443
+sagellm_core/engines/__pycache__/pytorch_engine.cpython-311.pyc,sha256=T6r2t5X9UNh8uT36gdow1cF5qB5_aeK9NruvdIkreWE,9902
+isagellm_core-0.2.1.0.dist-info/METADATA,sha256=FT7qXDZbnlsUvA2rDwBd-4EQbDj8oULbNh4wBaU-PRU,10597
+isagellm_core-0.2.1.0.dist-info/WHEEL,sha256=ZJeWpR6hcCRGwxVKXlDk-HsGwijNyTq4fszaDj4Ycyo,93
+isagellm_core-0.2.1.0.dist-info/entry_points.txt,sha256=FoTEGna8tmx20UEjrNJGXOOgUnfIbNbdCyhxlDiSfHA,303
+isagellm_core-0.2.1.0.dist-info/top_level.txt,sha256=wcgdWrvkaoYYh_dWSFI5Toi8PZsHutVqfhTB2tb0K6g,13
+isagellm_core-0.2.1.0.dist-info/RECORD,,

isagellm_core-0.2.1.0.dist-info/entry_points.txt

@@ -0,0 +1,6 @@
+[sagellm.engines]
+cpu = sagellm_core.engines.cpu:create_cpu_engine
+embedding = sagellm_core.engines.embedding:create_embedding_engine
+hf-cuda = sagellm_core.engines.hf_cuda:create_hf_cuda_engine
+mock = sagellm_core.engines:create_mock_engine
+pytorch = sagellm_core.engines.pytorch:create_pytorch_engine

sagellm_core/__init__.py

@@ -3,13 +3,14 @@
 本包提供 sageLLM 的核心运行时组件：
 - 配置 schema 与校验
 - Engine 抽象接口与实现
-- Backend 与 Engine 工厂函数
+- Engine 工厂函数
 - 插件系统
 - Demo Runner
 """
 
 from __future__ import annotations
 
+from sagellm_core.base_engine import BaseEngine, EngineInstanceConfig
 from sagellm_core.config import (
     BackendConfig,
     DemoConfig,
@@ -21,18 +22,69 @@ from sagellm_core.config import (
     load_config,
 )
 from sagellm_core.demo import main as demo_main
-from sagellm_core.engine import BaseEngine
+from sagellm_core.engine_factory import EngineFactory
+from sagellm_core.engines import (
+    CPUEngine,
+    EmbeddingEngine,
+    EmbeddingEngineConfig,
+    HFCudaEngine,
+    HFCudaEngineConfig,
+    MockEngine,
+    MockEngineConfig,
+    create_mock_engine,
+)
+
+# PyTorch engine (optional, loaded lazily)
+PyTorchEngine = None
+PyTorchEngineConfig = None
+PyTorchEngineInstanceConfig = None
+create_pytorch_engine = None
+
+try:
+    from sagellm_core.engines.pytorch import (
+        PyTorchEngine,
+        PyTorchEngineConfig,
+        PyTorchEngineInstanceConfig,
+        create_pytorch_engine,
+    )
+except ImportError:
+    pass  # torch or transformers not available
 from sagellm_core.factory import create_backend, create_engine
 from sagellm_core.health import HealthStatus
 from sagellm_core.plugins import PluginResolutionError, list_entry_points, resolve_kind
 from sagellm_core.runner import DemoRunner, RunnerContext
 
-__version__ = "0.1.0.3"
+# Auto-register built-in engines
+EngineFactory.register(MockEngine)
+
+# Conditional registration for engines with optional dependencies
+try:
+    EngineFactory.register(CPUEngine)
+except Exception:
+    pass  # torch not available
+
+try:
+    EngineFactory.register(HFCudaEngine)
+except Exception:
+    pass  # torch or CUDA not available
+
+try:
+    EngineFactory.register(EmbeddingEngine)
+except Exception:
+    pass  # sentence-transformers not available
+
+try:
+    if PyTorchEngine is not None:
+        EngineFactory.register(PyTorchEngine)
+except Exception:
+    pass  # torch or transformers not available
+
+__version__ = "0.2.1.0"
 
 __all__ = [
     # Version
     "__version__",
-    # Configuration
+    # Configuration (for YAML/config files)
     "BackendConfig",
     "DemoConfig",
     "EngineConfig",
@@ -43,10 +95,25 @@ __all__ = [
     "load_config",
     # Engine abstraction
     "BaseEngine",
+    "EngineInstanceConfig",  # For runtime engine instantiation
     "HealthStatus",
+    # Engine implementations
+    "MockEngine",
+    "MockEngineConfig",
+    "create_mock_engine",
+    "CPUEngine",
+    "HFCudaEngine",
+    "HFCudaEngineConfig",
+    "EmbeddingEngine",
+    "EmbeddingEngineConfig",
+    "PyTorchEngine",
+    "PyTorchEngineConfig",
+    "PyTorchEngineInstanceConfig",
+    "create_pytorch_engine",
     # Factory functions
     "create_backend",
     "create_engine",
+    "EngineFactory",
     # Plugin system
     "PluginResolutionError",
     "list_entry_points",

sagellm_core/engines/__init__.py

@@ -1,5 +1,45 @@
-"""Engine implementations package."""
+"""Engine implementations for sageLLM Core.
+
+This module provides built-in engine implementations:
+- MockEngine: GPU-free mock engine for testing
+- CPUEngine: CPU-only inference with HuggingFace Transformers
+- HFCudaEngine: CUDA inference with HuggingFace Transformers
+- PyTorchEngine: Unified PyTorch engine (auto-detects CUDA/NPU/CPU)
+- EmbeddingEngine: Embedding model inference
+"""
 
 from __future__ import annotations
 
-__all__: list[str] = []
+from sagellm_core.engines.cpu import CPUEngine
+from sagellm_core.engines.embedding import EmbeddingEngine, EmbeddingEngineConfig
+from sagellm_core.engines.hf_cuda import HFCudaEngine, HFCudaEngineInstanceConfig
+from sagellm_core.engines.mock import (
+    MockEngine,
+    MockEngineInstanceConfig,
+    create_mock_engine,
+)
+from sagellm_core.engines.pytorch_engine import PyTorchEngine, create_pytorch_engine
+
+# Export aliases for backward compatibility
+HFCudaEngineConfig = HFCudaEngineInstanceConfig
+MockEngineConfig = MockEngineInstanceConfig
+
+__all__ = [
+    # Mock engine
+    "MockEngine",
+    "MockEngineConfig",
+    "MockEngineInstanceConfig",
+    "create_mock_engine",
+    # CPU engine
+    "CPUEngine",
+    # CUDA engine
+    "HFCudaEngine",
+    "HFCudaEngineConfig",
+    "HFCudaEngineInstanceConfig",
+    # PyTorch engine (unified)
+    "PyTorchEngine",
+    "create_pytorch_engine",
+    # Embedding engine
+    "EmbeddingEngine",
+    "EmbeddingEngineConfig",
+]

isagellm_core-0.1.0.3.dist-info/RECORD

@@ -1,32 +0,0 @@
-sagellm_core/__init__.py,sha256=tCd-s6qtnmcAlkTPIAPI6eVAv2VDpTv1x3BTIPmJksc,1318
-sagellm_core/__init__.pyc,sha256=1gOLrD7tMlJWBJfli9YCkaCz3ARTW6TOF1BV6sC9vjc,1462
-sagellm_core/__main__.pyc,sha256=4wEXHFB0JVZaI6wLACU59_b-LfEbujTQZyzONaalAYA,384
-sagellm_core/config.pyc,sha256=8gGOOBcHRSSv883bDIJNXzB069ntBc0yYEf-PFAeWdU,9617
-sagellm_core/demo.pyc,sha256=MAeTgokTW8kW906wjvTLN1yNLfOOl3_hokpVzJ-Lt4I,6377
-sagellm_core/engine.pyc,sha256=8Et-gI0pYOpDPRCz8IrWMDYKWs_-K31jAAnYoe-HnF8,584
-sagellm_core/factory.pyc,sha256=PF-xQQn-fYn25GO5muzf9rCdHKQ3NhQYiCKOnkHBjxY,2692
-sagellm_core/health.pyc,sha256=oEWyaaTix4YXhyu8JSYOQAy9KBySxbIcHt2hNpchi-w,684
-sagellm_core/mock_engine.pyc,sha256=iadJef1bNdQXdXJLFo_FE9aVglecothXLhxMoMtzEv0,532
-sagellm_core/plugins.pyc,sha256=rhdewQ_zJxnmRFBjUozBlhQtIwFg0C1rFD8zMT7ZeKI,2618
-sagellm_core/py.typed,sha256=ixa8YukDZ3kLo0WsFJRGohLMyHzbMur1ALmmASML2cs,64
-sagellm_core/runner.pyc,sha256=kUPITl68dX1rOY5Fg5o6KRBMjMhMAQFNizEuRF44PgM,14248
-sagellm_core/workload.pyc,sha256=LDuZAdimFAd3pHn8E9WG7LjwU_1IKABZ-gaMCMjOTus,4118
-sagellm_core/__pycache__/__init__.cpython-311.pyc,sha256=rD-1rR4IMX4lKJKlNtTrMkPLHY-rWF-S06ZjtGu1pQU,1492
-sagellm_core/__pycache__/config.cpython-311.pyc,sha256=4c_gjzVmxIRApzmUq8LCboOG3wPqmmwWVFxZS3JOHOg,9647
-sagellm_core/__pycache__/demo.cpython-311.pyc,sha256=yOMGCRRQigl8sclMTcg-iHThQoxrRTPWSUdgDYJ3hgU,6407
-sagellm_core/__pycache__/engine.cpython-311.pyc,sha256=6wUoB2Rz8YqoVpefE28b_vqxAozdXFiCYJZ_gn5Vi9A,614
-sagellm_core/__pycache__/factory.cpython-311.pyc,sha256=Dl6w_PHlzEVr62cT6D11_gm9F-MAcqouBNNHZEHCjqw,2722
-sagellm_core/__pycache__/health.cpython-311.pyc,sha256=t8l6F_O808YWsFBDQfdJU6_Ps8H-nnE6k0fdLxYwLJk,714
-sagellm_core/__pycache__/mock_engine.cpython-311.pyc,sha256=KcHBGI1dVIEKm7rhZOkPWQ27rzNVEhmXDYsiQ_5Lfe8,562
-sagellm_core/__pycache__/plugins.cpython-311.pyc,sha256=K6-SC0yOVvT-qVh7Fp2GC-O0GloaWY00W9_8y_jrBnk,2648
-sagellm_core/__pycache__/runner.cpython-311.pyc,sha256=aZCGktjzcGBqNB7tJahEHfUgbTOYPCn-TyKp6yzpD6s,14278
-sagellm_core/__pycache__/workload.cpython-311.pyc,sha256=ah0QMR3-t_EdjS6km5zi64LLn0FB3XgN7ALa1rVlDYY,4148
-sagellm_core/engines/__init__.py,sha256=Pz_6hPpdL9aZqFSZnP_3Hdo_oOhMgygp8fYDUq60eoM,99
-sagellm_core/engines/__init__.pyc,sha256=F8_ZNvo0w79MF136pvCmRArLhPjae6uGsds7v9OUAEo,331
-sagellm_core/engines/mock.pyc,sha256=D0kWj50DsPdaZAM_2W-vyTW11ofNsSF02knRGtfKEJA,586
-sagellm_core/engines/__pycache__/__init__.cpython-311.pyc,sha256=Y36wU_L1T0NqaGBb-oqt38qVk38lunfTWTv5n-TkCLI,361
-sagellm_core/engines/__pycache__/mock.cpython-311.pyc,sha256=bt1MKmriqKcL_HF2gvQQ5JfxI-ij24G4fZvgFXjBAmM,616
-isagellm_core-0.1.0.3.dist-info/METADATA,sha256=wKlVRTDAi3oqLa6FMZsxPRpjaU2j_O9DivkGDzqzjy0,7558
-isagellm_core-0.1.0.3.dist-info/WHEEL,sha256=ZJeWpR6hcCRGwxVKXlDk-HsGwijNyTq4fszaDj4Ycyo,93
-isagellm_core-0.1.0.3.dist-info/top_level.txt,sha256=wcgdWrvkaoYYh_dWSFI5Toi8PZsHutVqfhTB2tb0K6g,13
-isagellm_core-0.1.0.3.dist-info/RECORD,,