celestialflow 3.1.0__tar.gz → 3.1.1__tar.gz

{celestialflow-3.1.0 → celestialflow-3.1.1}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: celestialflow
-Version: 3.1.0
+Version: 3.1.1
 Summary: A flexible GRAPH-based task orchestration framework.
 Author-email: Mr-xiaotian <mingxiaomingtian@gmail.com>
 License: MIT
@@ -130,7 +130,11 @@ flowchart LR
 安装 CelestialFlow:
 
 ```bash
-pip install celestialflow
+# 推荐使用 `uv` 管理依赖与环境
+uv pip install celestialflow
+
+# 不过也可以直接使用 `pip`
+uv pip install celestialflow
 ```
 
 一个简单的可运行代码:
@@ -202,6 +206,7 @@ flowchart TD
 - [TaskTools](https://github.com/Mr-xiaotian/CelestialFlow/blob/main/docs/reference/task_tools.md)
 - [TaskTypes](https://github.com/Mr-xiaotian/CelestialFlow/blob/main/docs/reference/task_types.md)
 - [TaskLogging](https://github.com/Mr-xiaotian/CelestialFlow/blob/main/docs/reference/task_logging.md)
+- [TaskErrors](https://github.com/Mr-xiaotian/CelestialFlow/blob/main/docs/reference/task_errors.md)
 
 如果你更喜欢通过完整案例理解框架的运行方式，可以参考这篇从零开始构建 TaskGraph 的教程：
 
@@ -231,100 +236,13 @@ flowchart TD
 
 ## 文件结构（File Structure）
 
-```
-📁 CelestialFlow	(224MB 407KB 500B)
-    📁 docs         	(34KB 944B)
-        📁 reference	(29KB 995B)
-            📝 ctree_client.md  	(6KB 997B)
-            📝 go_worker.md     	(6KB 378B)
-            📝 task_graph.md    	(4KB 989B)
-            📝 task_logging.md  	(0B)
-            📝 task_manage.md   	(7KB 499B)
-            📝 task_nodes.md    	(4KB 68B)
-            📝 task_progress.md 	(0B)
-            📝 task_queue.md    	(0B)
-            📝 task_report.md   	(0B)
-            📝 task_stage.md    	(0B)
-            📝 task_structure.md	(112B)
-            📝 task_tools.md    	(0B)
-            📝 task_types.md    	(0B)
-            📝 task_web.md      	(0B)
-        📝 quick_start.md	(4KB 973B)
-        📝 tutorial.md   	(0B)
-    📁 experiments  	(15KB 111B)
-        🐍 benchmark_datastructures.py	(6KB 52B)
-        🐍 benchmark_hash.py          	(1KB 284B)
-        🐍 benchmark_queue.py         	(5KB 504B)
-        🐍 benchmark_tqdm.py          	(1KB 160B)
-        🐍 experiment_tqdm.py         	(1KB 135B)
-    📁 go_worker    	(6MB 968KB 38B)
-        📁 worker	(5KB 746B)
-            🌀 parser.go   	(394B)
-            🌀 processor.go	(2KB 612B)
-            🌀 types.go    	(299B)
-            🌀 worker.go   	(2KB 465B)
-        ❓ go.mod       	(292B)
-        ❓ go.sum       	(1KB 68B)
-        ❓ go_worker.exe	(6MB 960KB)
-        🌀 main.go      	(980B)
-    📁 img          	(4MB 700KB 695B)
-        📷 logo(old).png  	(836KB 542B)
-        📷 logo.png       	(122KB 747B)
-        📷 web_display.png	(129KB 545B)
-        🎞️ web_ui.gif     	(3MB 635KB 909B)
-    📁 src          	(1MB 929KB 111B)
-        📁 celestialflow         	(1MB 911KB 486B)
-            📁 static     	(1MB 417KB 367B)
-                📁 css	(31KB 621B)
-                    🎨 base.css     	(6KB 181B)
-                    🎨 dashboard.css	(7KB 414B)
-                    🎨 errors.css   	(5KB 216B)
-                    🎨 inject.css   	(12KB 834B)
-                📁 js 	(33KB 672B)
-                    📜 main.js          	(5KB 65B)
-                    📜 task_errors.js   	(4KB 595B)
-                    📜 task_injection.js	(8KB 484B)
-                    📜 task_statuses.js 	(8KB 51B)
-                    📜 task_structure.js	(4KB 709B)
-                    📜 task_topology.js 	(1KB 375B)
-                    📜 utils.js         	(1KB 441B)
-                ❓ favicon.ico	(1MB 352KB 98B)
-            📁 templates  	(13KB 174B)
-                🌐 index.html	(13KB 174B)
-            📁 [1项排除的目录]	(339KB 553B)
-            🐍 task_graph.py    	(26KB 700B)
-            🐍 task_logging.py  	(10KB 282B)
-            🐍 task_manage.py   	(36KB 110B)
-            🐍 task_nodes.py    	(10KB 814B)
-            🐍 task_progress.py 	(1KB 477B)
-            🐍 task_queue.py    	(10KB 948B)
-            🐍 task_report.py   	(4KB 828B)
-            🐍 task_stage.py    	(6KB 577B)
-            🐍 task_structure.py	(7KB 255B)
-            🐍 task_tools.py    	(17KB 19B)
-            🐍 task_types.py    	(2KB 269B)
-            🐍 task_web.py      	(6KB 235B)
-            🐍 __init__.py      	(1KB 22B)
-        📁 [1项排除的目录]	(17KB 649B)
-    📁 tests        	(126KB 724B)
-        📁 [1项排除的目录]	(90KB 464B)
-        🐍 conftest.py      	(49B)
-        📝 README.md        	(6KB 324B)
-        🐍 test_graph.py    	(5KB 547B)
-        🐍 test_manage.py   	(3KB 90B)
-        🐍 test_nodes.py    	(11KB 218B)
-        🐍 test_structure.py	(10KB 56B)
-    📁 [6项排除的目录]	(210MB 685KB 450B)
-    ❓ .env          	(88B)
-    ❓ .gitignore    	(272B)
-    ❓ LICENSE       	(1KB 65B)
-    ❓ Makefile      	(501B)
-    ❓ pyproject.toml	(1KB 594B)
-    📝 README.md     	(16KB 3B)
-(celestial-flow 3.0.9)
-```
+<p align="center">
+  <img src="https://raw.githubusercontent.com/Mr-xiaotian/CelestialFlow/main/img/file_structure.svg" alt="FileStructure" />
+  <br/>
+  <em>celestial-flow 3.1.1</em>
+</p>
 
-(该视图由我的另一个项目[CelestialVault](https://github.com/Mr-xiaotian/CelestialVault)中inst_file.FileTree.print_tree()生成。)
+(该视图由我的另一个项目[CelestialVault](https://github.com/Mr-xiaotian/CelestialVault)中inst_file.FileTree.print_tree()生成。转换为图片则借助[Carbon](https://carbon.now.sh)。)
 
 ## 更新日志（Change Log）
 
@@ -353,7 +271,25 @@ flowchart TD
   - 增加大量warning与error, 用于提醒不规范设置; 
   - 优化前后端中错误数据的传输方式, 在大量错误数据时减少内存消耗; 
   - 优化TaskLogger中log队列的准入机制; 
-  - 修改部分Bug
+  - 修改部分Bug;
+- 3.1.0:
+  - 新增:
+    - 优化web端仪表盘页面的"总体状态摘要"卡片, 新增"总重复任务"与"总剩余市场", 后者由节点间拓扑关系计算而成, 后续还需要优化;
+  - 修复:
+    - 3.0.9版本下当web端与celestialflow运行端不同时, error数据无法传递的问题;
+    - 修复NullTaskReporter使用问题;
+- 3.1.1:
+  - 新增:
+    - [Important] CelestialTree中引入grpc, 这大大减少了emit操作的耗时;
+    - [Important] 为TerminationSignal添加id, 并可以像task一样通过CelestialTree进行跟踪;
+    - 优化task_graph与task_executor的log分级, 现在默认为"SUCCESS"级;
+    - 将go_worker部分分离为单独project: [celestialflow-goworker]https://github.com/Mr-xiaotian/celestialflow-goworker
+    - 在readme中使用svg图片来展示文件夹结构;
+    - 优化全局剩余时间的计算;
+    - 优化部分代码结构;
+  - 修复:
+    - 修复节点剩余时间在小于1s时显示0的问题(这很影响判断);
+    - 在task_graph中使用"staged"模式时会报错的问题;
 
 ## Star 历史趋势（Star History）
 

{celestialflow-3.1.0 → celestialflow-3.1.1}/README.md

@@ -104,7 +104,11 @@ flowchart LR
 安装 CelestialFlow:
 
 ```bash
-pip install celestialflow
+# 推荐使用 `uv` 管理依赖与环境
+uv pip install celestialflow
+
+# 不过也可以直接使用 `pip`
+uv pip install celestialflow
 ```
 
 一个简单的可运行代码:
@@ -176,6 +180,7 @@ flowchart TD
 - [TaskTools](https://github.com/Mr-xiaotian/CelestialFlow/blob/main/docs/reference/task_tools.md)
 - [TaskTypes](https://github.com/Mr-xiaotian/CelestialFlow/blob/main/docs/reference/task_types.md)
 - [TaskLogging](https://github.com/Mr-xiaotian/CelestialFlow/blob/main/docs/reference/task_logging.md)
+- [TaskErrors](https://github.com/Mr-xiaotian/CelestialFlow/blob/main/docs/reference/task_errors.md)
 
 如果你更喜欢通过完整案例理解框架的运行方式，可以参考这篇从零开始构建 TaskGraph 的教程：
 
@@ -205,100 +210,13 @@ flowchart TD
 
 ## 文件结构（File Structure）
 
-```
-📁 CelestialFlow	(224MB 407KB 500B)
-    📁 docs         	(34KB 944B)
-        📁 reference	(29KB 995B)
-            📝 ctree_client.md  	(6KB 997B)
-            📝 go_worker.md     	(6KB 378B)
-            📝 task_graph.md    	(4KB 989B)
-            📝 task_logging.md  	(0B)
-            📝 task_manage.md   	(7KB 499B)
-            📝 task_nodes.md    	(4KB 68B)
-            📝 task_progress.md 	(0B)
-            📝 task_queue.md    	(0B)
-            📝 task_report.md   	(0B)
-            📝 task_stage.md    	(0B)
-            📝 task_structure.md	(112B)
-            📝 task_tools.md    	(0B)
-            📝 task_types.md    	(0B)
-            📝 task_web.md      	(0B)
-        📝 quick_start.md	(4KB 973B)
-        📝 tutorial.md   	(0B)
-    📁 experiments  	(15KB 111B)
-        🐍 benchmark_datastructures.py	(6KB 52B)
-        🐍 benchmark_hash.py          	(1KB 284B)
-        🐍 benchmark_queue.py         	(5KB 504B)
-        🐍 benchmark_tqdm.py          	(1KB 160B)
-        🐍 experiment_tqdm.py         	(1KB 135B)
-    📁 go_worker    	(6MB 968KB 38B)
-        📁 worker	(5KB 746B)
-            🌀 parser.go   	(394B)
-            🌀 processor.go	(2KB 612B)
-            🌀 types.go    	(299B)
-            🌀 worker.go   	(2KB 465B)
-        ❓ go.mod       	(292B)
-        ❓ go.sum       	(1KB 68B)
-        ❓ go_worker.exe	(6MB 960KB)
-        🌀 main.go      	(980B)
-    📁 img          	(4MB 700KB 695B)
-        📷 logo(old).png  	(836KB 542B)
-        📷 logo.png       	(122KB 747B)
-        📷 web_display.png	(129KB 545B)
-        🎞️ web_ui.gif     	(3MB 635KB 909B)
-    📁 src          	(1MB 929KB 111B)
-        📁 celestialflow         	(1MB 911KB 486B)
-            📁 static     	(1MB 417KB 367B)
-                📁 css	(31KB 621B)
-                    🎨 base.css     	(6KB 181B)
-                    🎨 dashboard.css	(7KB 414B)
-                    🎨 errors.css   	(5KB 216B)
-                    🎨 inject.css   	(12KB 834B)
-                📁 js 	(33KB 672B)
-                    📜 main.js          	(5KB 65B)
-                    📜 task_errors.js   	(4KB 595B)
-                    📜 task_injection.js	(8KB 484B)
-                    📜 task_statuses.js 	(8KB 51B)
-                    📜 task_structure.js	(4KB 709B)
-                    📜 task_topology.js 	(1KB 375B)
-                    📜 utils.js         	(1KB 441B)
-                ❓ favicon.ico	(1MB 352KB 98B)
-            📁 templates  	(13KB 174B)
-                🌐 index.html	(13KB 174B)
-            📁 [1项排除的目录]	(339KB 553B)
-            🐍 task_graph.py    	(26KB 700B)
-            🐍 task_logging.py  	(10KB 282B)
-            🐍 task_manage.py   	(36KB 110B)
-            🐍 task_nodes.py    	(10KB 814B)
-            🐍 task_progress.py 	(1KB 477B)
-            🐍 task_queue.py    	(10KB 948B)
-            🐍 task_report.py   	(4KB 828B)
-            🐍 task_stage.py    	(6KB 577B)
-            🐍 task_structure.py	(7KB 255B)
-            🐍 task_tools.py    	(17KB 19B)
-            🐍 task_types.py    	(2KB 269B)
-            🐍 task_web.py      	(6KB 235B)
-            🐍 __init__.py      	(1KB 22B)
-        📁 [1项排除的目录]	(17KB 649B)
-    📁 tests        	(126KB 724B)
-        📁 [1项排除的目录]	(90KB 464B)
-        🐍 conftest.py      	(49B)
-        📝 README.md        	(6KB 324B)
-        🐍 test_graph.py    	(5KB 547B)
-        🐍 test_manage.py   	(3KB 90B)
-        🐍 test_nodes.py    	(11KB 218B)
-        🐍 test_structure.py	(10KB 56B)
-    📁 [6项排除的目录]	(210MB 685KB 450B)
-    ❓ .env          	(88B)
-    ❓ .gitignore    	(272B)
-    ❓ LICENSE       	(1KB 65B)
-    ❓ Makefile      	(501B)
-    ❓ pyproject.toml	(1KB 594B)
-    📝 README.md     	(16KB 3B)
-(celestial-flow 3.0.9)
-```
+<p align="center">
+  <img src="https://raw.githubusercontent.com/Mr-xiaotian/CelestialFlow/main/img/file_structure.svg" alt="FileStructure" />
+  <br/>
+  <em>celestial-flow 3.1.1</em>
+</p>
 
-(该视图由我的另一个项目[CelestialVault](https://github.com/Mr-xiaotian/CelestialVault)中inst_file.FileTree.print_tree()生成。)
+(该视图由我的另一个项目[CelestialVault](https://github.com/Mr-xiaotian/CelestialVault)中inst_file.FileTree.print_tree()生成。转换为图片则借助[Carbon](https://carbon.now.sh)。)
 
 ## 更新日志（Change Log）
 
@@ -327,7 +245,25 @@ flowchart TD
   - 增加大量warning与error, 用于提醒不规范设置; 
   - 优化前后端中错误数据的传输方式, 在大量错误数据时减少内存消耗; 
   - 优化TaskLogger中log队列的准入机制; 
-  - 修改部分Bug
+  - 修改部分Bug;
+- 3.1.0:
+  - 新增:
+    - 优化web端仪表盘页面的"总体状态摘要"卡片, 新增"总重复任务"与"总剩余市场", 后者由节点间拓扑关系计算而成, 后续还需要优化;
+  - 修复:
+    - 3.0.9版本下当web端与celestialflow运行端不同时, error数据无法传递的问题;
+    - 修复NullTaskReporter使用问题;
+- 3.1.1:
+  - 新增:
+    - [Important] CelestialTree中引入grpc, 这大大减少了emit操作的耗时;
+    - [Important] 为TerminationSignal添加id, 并可以像task一样通过CelestialTree进行跟踪;
+    - 优化task_graph与task_executor的log分级, 现在默认为"SUCCESS"级;
+    - 将go_worker部分分离为单独project: [celestialflow-goworker]https://github.com/Mr-xiaotian/celestialflow-goworker
+    - 在readme中使用svg图片来展示文件夹结构;
+    - 优化全局剩余时间的计算;
+    - 优化部分代码结构;
+  - 修复:
+    - 修复节点剩余时间在小于1s时显示0的问题(这很影响判断);
+    - 在task_graph中使用"staged"模式时会报错的问题;
 
 ## Star 历史趋势（Star History）
 

{celestialflow-3.1.0 → celestialflow-3.1.1}/pyproject.toml

@@ -1,60 +1,66 @@
-[build-system]
-requires = ["setuptools>=61.0", "wheel"]
-build-backend = "setuptools.build_meta"
-
-[project]
-name = "celestialflow"                   
-version = "3.1.0"                         
-description = "A flexible GRAPH-based task orchestration framework."
-readme = "README.md"               
-license = { text = "MIT" }    
-authors = [{ name = "Mr-xiaotian", email = "mingxiaomingtian@gmail.com" }]
-keywords = ["workflow", "task", "graph", "async", "CelestialFlow"]
-requires-python = ">=3.8"
-
-dependencies = [
-    "tqdm",
-    "loguru",
-    "fastapi",
-    "uvicorn",
-    "requests",
-    "networkx",
-    "redis",
-    "jinja2",
-    "celestialtree",
-]
-
-classifiers = [
-    "Programming Language :: Python :: 3",
-    "License :: OSI Approved :: MIT License",
-    "Operating System :: OS Independent",
-    "Framework :: FastAPI",
-    "Topic :: Software Development :: Libraries",
-]
-
-[project.urls]
-"Homepage" = "https://github.com/Mr-xiaotian/CelestialFlow"
-"Bug Tracker" = "https://github.com/Mr-xiaotian/CelestialFlow/issues"
-
-[project.scripts]
-celestialflow-web = "celestialflow.task_web:main_entry"
-
-[tool.setuptools]
-license-files = []
-
-[tool.setuptools.package-data]
-"celestialflow" = ["templates/*.html", "static/**/*"]
-
-[tool.pytest.ini_options]
-addopts = "-s"
-log_cli = true
-log_cli_level = "INFO"
-log_cli_format = "%(asctime)s [%(levelname)s] %(message)s"
-log_cli_date_format = "%Y-%m-%d %H:%M:%S"
-
-filterwarnings = [
-    "ignore::DeprecationWarning",
-    "ignore::pytest.PytestDeprecationWarning",
-]
-
-asyncio_default_fixture_loop_scope = "function"
+[build-system]
+requires = ["setuptools>=61.0", "wheel"]
+build-backend = "setuptools.build_meta"
+
+[project]
+name = "celestialflow"                   
+version = "3.1.1"                         
+description = "A flexible GRAPH-based task orchestration framework."
+readme = "README.md"               
+license = { text = "MIT" }    
+authors = [{ name = "Mr-xiaotian", email = "mingxiaomingtian@gmail.com" }]
+keywords = ["workflow", "task", "graph", "async", "CelestialFlow"]
+requires-python = ">=3.8"
+
+dependencies = [
+    "tqdm",
+    "loguru",
+    "fastapi",
+    "uvicorn",
+    "requests",
+    "networkx",
+    "redis",
+    "jinja2",
+    "celestialtree",
+]
+
+classifiers = [
+    "Programming Language :: Python :: 3",
+    "License :: OSI Approved :: MIT License",
+    "Operating System :: OS Independent",
+    "Framework :: FastAPI",
+    "Topic :: Software Development :: Libraries",
+]
+
+[project.urls]
+"Homepage" = "https://github.com/Mr-xiaotian/CelestialFlow"
+"Bug Tracker" = "https://github.com/Mr-xiaotian/CelestialFlow/issues"
+
+[project.scripts]
+celestialflow-web = "celestialflow.task_web:main_entry"
+
+[tool.setuptools]
+license-files = []
+
+[tool.setuptools.package-data]
+"celestialflow" = ["templates/*.html", "static/**/*"]
+
+[tool.pytest.ini_options]
+addopts = "-s"
+log_cli = true
+log_cli_level = "INFO"
+log_cli_format = "%(asctime)s [%(levelname)s] %(message)s"
+log_cli_date_format = "%Y-%m-%d %H:%M:%S"
+
+filterwarnings = [
+    "ignore::DeprecationWarning",
+    "ignore::pytest.PytestDeprecationWarning",
+]
+
+asyncio_default_fixture_loop_scope = "function"
+
+[dependency-groups]
+dev = [
+    "build>=1.2.2.post1",
+    "twine>=6.1.0",
+]

{celestialflow-3.1.0 → celestialflow-3.1.1}/src/celestialflow/static/js/utils.js

@@ -65,7 +65,7 @@ function toggleDarkTheme() {
 
 // task_statuses.js
 function formatDuration(seconds) {
-  seconds = Math.floor(seconds);
+  seconds = seconds > 0 ? Math.max(1, Math.floor(seconds)) : 0;
 
   const hours = Math.floor(seconds / 3600);
   const remainder = seconds % 3600;

celestialflow-3.1.1/src/celestialflow/task_errors.py

@@ -0,0 +1,78 @@
+from __future__ import annotations
+from typing import Iterable, Tuple, Any
+
+
+class CelestialFlowError(Exception):
+    """CelestialFlow 所有自定义异常的基类"""
+
+    pass
+
+
+class ConfigurationError(CelestialFlowError):
+    """配置错误（参数非法、组合不支持等）"""
+
+    pass
+
+
+class InvalidOptionError(ConfigurationError):
+    """
+    某个配置项的取值不合法（不在允许集合里）。
+    """
+
+    def __init__(
+        self,
+        field: str,
+        value: Any,
+        allowed: Iterable[Any],
+        *,
+        prefix: str = "Invalid",
+    ):
+        allowed_tuple: Tuple[Any, ...] = tuple(allowed)
+        message = f"{prefix} {field}: {value}. Valid options are {allowed_tuple}."
+        super().__init__(message)
+
+        self.field = field
+        self.value = value
+        self.allowed = allowed_tuple
+
+
+class ExecutionModeError(InvalidOptionError):
+    """非法的 execution_mode 配置错误"""
+
+    def __init__(self, execution_mode: str, valid_modes=None):
+        valid_modes = valid_modes or ("serial", "process", "thread", "async")
+        super().__init__("execution mode", execution_mode, valid_modes)
+        self.execution_mode = execution_mode
+        self.valid_modes = self.allowed  # 兼容旧字段名
+
+
+class StageModeError(InvalidOptionError):
+    """非法的 stage_mode 配置错误"""
+
+    def __init__(self, stage_mode: str, valid_modes=None):
+        valid_modes = valid_modes or ("serial", "process")
+        super().__init__("stage mode", stage_mode, valid_modes)
+        self.stage_mode = stage_mode
+        self.valid_modes = self.allowed
+
+
+class LogLevelError(InvalidOptionError):
+    """非法的 log_level 配置错误"""
+
+    def __init__(self, log_level: str, valid_levels=None):
+        valid_levels = valid_levels or (
+            "TRACE",
+            "DEBUG",
+            "SUCCESS",
+            "INFO",
+            "WARNING",
+            "ERROR",
+            "CRITICAL",
+        )
+        super().__init__("log level", log_level, valid_levels)
+        self.log_level = log_level
+        self.valid_levels = self.allowed
+
+
+class RemoteWorkerError(CelestialFlowError):
+    pass