model-compose 0.4.9__tar.gz → 0.4.11__tar.gz

model_compose-0.4.11/PKG-INFO

@@ -0,0 +1,184 @@
+Metadata-Version: 2.4
+Name: model-compose
+Version: 0.4.11
+Summary: model-compose: Declarative AI Model and Workflow Orchestrator
+Author-email: Hanyeol Cho <hanyeol.cho@gmail.com>
+License-Expression: MIT
+Project-URL: Homepage, https://github.com/hanyeol/model-compose
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: click
+Requires-Dist: pyyaml
+Requires-Dist: pydantic
+Requires-Dist: python-dotenv
+Requires-Dist: aiohttp
+Requires-Dist: requests
+Requires-Dist: fastapi
+Requires-Dist: uvicorn
+Requires-Dist: mcp>=1.10.1
+Requires-Dist: ulid
+Requires-Dist: gradio
+Requires-Dist: Pillow
+Requires-Dist: docker
+Dynamic: license-file
+
+<div align="center">
+
+![model-compose - Declarative AI Workflow Orchestrator](docs/images/main-banner.png)
+
+[![Python Version](https://img.shields.io/badge/python-3.9+-blue.svg)](https://python.org)
+[![PyPI version](https://img.shields.io/pypi/v/model-compose.svg)](https://pypi.org/project/model-compose/)
+[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
+[![Downloads](https://pepy.tech/badge/model-compose)](https://pepy.tech/project/model-compose)
+[![PRs Welcome](https://img.shields.io/badge/PRs-welcome-brightgreen.svg)](http://makeapullrequest.com)
+
+[한국어](README.ko.md) | [中文](README.zh-cn.md)
+
+</div>
+
+---
+
+# 🤖 model-compose
+
+**model-compose** is a declarative AI workflow orchestrator inspired by `docker-compose`. It lets you define and run AI model pipelines using simple YAML files — no custom code required. Effortlessly connect external AI services (OpenAI, Anthropic, Google, etc.), run local AI models, integrate vector stores, and more — all within powerful, composable workflows.
+
+**No custom code. Just YAML configuration.**
+
+<div align="center">
+
+[📖 User Guide](docs/user-guide/README.md) · [🚀 Quick Start](#-quick-start) · [💡 Examples](examples/README.md) · [🤝 Contributing](#-contributing)
+
+</div>
+
+---
+
+## ✨ Features
+
+- 🎨 **Zero Code**: Pure YAML configuration—no scripting required
+- 🔄 **Composable**: Reusable components and multi-step workflows
+- 🚀 **Production Ready**: HTTP/MCP servers + Web UI + Docker deployment
+- 🔌 **Connect Anything**: External AI services, local models, vector stores, and more
+- ⚡ **Stream & Scale**: Real-time streaming and event-driven automation
+- 🛠️ **Developer Friendly**: Environment variables, tunneling, webhooks
+
+---
+
+
+## 📦 Installation
+
+```
+pip install model-compose
+```
+
+Or install from source:
+
+```
+git clone https://github.com/hanyeol/model-compose.git
+cd model-compose
+pip install -e .
+```
+
+> Requires: Python 3.9 or higher
+
+---
+
+## 🚀 Quick Start
+
+Create a `model-compose.yml`:
+
+```yaml
+controller:
+  type: http-server
+  port: 8080
+  webui:
+    port: 8081
+
+components:
+  - id: chatgpt
+    type: http-client
+    base_url: https://api.openai.com/v1
+    path: /chat/completions
+    method: POST
+    headers:
+      Authorization: Bearer ${env.OPENAI_API_KEY}
+    body:
+      model: gpt-4o
+      messages:
+        - role: user
+          content: ${input.prompt}
+
+workflows:
+  - id: chat
+    default: true
+    jobs:
+      - component: chatgpt
+```
+
+Run it:
+
+```bash
+export OPENAI_API_KEY=your-key
+model-compose up
+```
+
+Your API is now live at `http://localhost:8080` and Web UI at `http://localhost:8081` 🎉
+
+> 💡 Explore [examples](examples/README.md) for more workflows or read the [User Guide](docs/user-guide/README.md).
+
+---
+## 💡 Key Capabilities
+
+### 🖥️ Built-in Web UI
+Add a visual interface with just 3 lines of YAML:
+```yaml
+controller:
+  webui:
+    port: 8081
+```
+Instantly get a user-friendly interface to test and monitor your workflows. Supports both Gradio (default) and custom static frontends.
+
+### 🛰️ MCP Server Ready
+Transform your workflows into MCP tools by changing one line:
+```yaml
+controller:
+  type: mcp-server  # Change from http-server to mcp-server
+```
+No code changes needed. Your workflows become instantly accessible via the Model Context Protocol.
+
+### 🐳 Docker Deployment
+Deploy anywhere with built-in Docker support:
+```yaml
+controller:
+  runtime: docker
+```
+Run your workflows in isolated containers with full control over images, volumes, ports, and environment variables.
+
+> 📖 See the [User Guide](docs/user-guide/README.md) for detailed configuration and [Examples](examples/README.md) for ready-to-run samples.
+
+---
+## 🏗 Architecture
+
+![Archtecture Diagram](docs/images/architecture-diagram.png)
+
+---
+
+## 🤝 Contributing
+We welcome all contributions!
+Whether it's fixing bugs, improving docs, or adding examples — every bit helps.
+
+```
+# Setup for development
+git clone https://github.com/hanyeol/model-compose.git
+cd model-compose
+pip install -e .[dev]
+```
+
+---
+
+## 📄 License
+MIT License © 2025 Hanyeol Cho.
+
+---
+
+## 📬 Contact
+Have questions, ideas, or feedback? [Open an issue](https://github.com/hanyeol/model-compose/issues) or start a discussion on [GitHub Discussions](https://github.com/hanyeol/model-compose/discussions).

model_compose-0.4.11/README.md

@@ -0,0 +1,160 @@
+<div align="center">
+
+![model-compose - Declarative AI Workflow Orchestrator](docs/images/main-banner.png)
+
+[![Python Version](https://img.shields.io/badge/python-3.9+-blue.svg)](https://python.org)
+[![PyPI version](https://img.shields.io/pypi/v/model-compose.svg)](https://pypi.org/project/model-compose/)
+[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
+[![Downloads](https://pepy.tech/badge/model-compose)](https://pepy.tech/project/model-compose)
+[![PRs Welcome](https://img.shields.io/badge/PRs-welcome-brightgreen.svg)](http://makeapullrequest.com)
+
+[한국어](README.ko.md) | [中文](README.zh-cn.md)
+
+</div>
+
+---
+
+# 🤖 model-compose
+
+**model-compose** is a declarative AI workflow orchestrator inspired by `docker-compose`. It lets you define and run AI model pipelines using simple YAML files — no custom code required. Effortlessly connect external AI services (OpenAI, Anthropic, Google, etc.), run local AI models, integrate vector stores, and more — all within powerful, composable workflows.
+
+**No custom code. Just YAML configuration.**
+
+<div align="center">
+
+[📖 User Guide](docs/user-guide/README.md) · [🚀 Quick Start](#-quick-start) · [💡 Examples](examples/README.md) · [🤝 Contributing](#-contributing)
+
+</div>
+
+---
+
+## ✨ Features
+
+- 🎨 **Zero Code**: Pure YAML configuration—no scripting required
+- 🔄 **Composable**: Reusable components and multi-step workflows
+- 🚀 **Production Ready**: HTTP/MCP servers + Web UI + Docker deployment
+- 🔌 **Connect Anything**: External AI services, local models, vector stores, and more
+- ⚡ **Stream & Scale**: Real-time streaming and event-driven automation
+- 🛠️ **Developer Friendly**: Environment variables, tunneling, webhooks
+
+---
+
+
+## 📦 Installation
+
+```
+pip install model-compose
+```
+
+Or install from source:
+
+```
+git clone https://github.com/hanyeol/model-compose.git
+cd model-compose
+pip install -e .
+```
+
+> Requires: Python 3.9 or higher
+
+---
+
+## 🚀 Quick Start
+
+Create a `model-compose.yml`:
+
+```yaml
+controller:
+  type: http-server
+  port: 8080
+  webui:
+    port: 8081
+
+components:
+  - id: chatgpt
+    type: http-client
+    base_url: https://api.openai.com/v1
+    path: /chat/completions
+    method: POST
+    headers:
+      Authorization: Bearer ${env.OPENAI_API_KEY}
+    body:
+      model: gpt-4o
+      messages:
+        - role: user
+          content: ${input.prompt}
+
+workflows:
+  - id: chat
+    default: true
+    jobs:
+      - component: chatgpt
+```
+
+Run it:
+
+```bash
+export OPENAI_API_KEY=your-key
+model-compose up
+```
+
+Your API is now live at `http://localhost:8080` and Web UI at `http://localhost:8081` 🎉
+
+> 💡 Explore [examples](examples/README.md) for more workflows or read the [User Guide](docs/user-guide/README.md).
+
+---
+## 💡 Key Capabilities
+
+### 🖥️ Built-in Web UI
+Add a visual interface with just 3 lines of YAML:
+```yaml
+controller:
+  webui:
+    port: 8081
+```
+Instantly get a user-friendly interface to test and monitor your workflows. Supports both Gradio (default) and custom static frontends.
+
+### 🛰️ MCP Server Ready
+Transform your workflows into MCP tools by changing one line:
+```yaml
+controller:
+  type: mcp-server  # Change from http-server to mcp-server
+```
+No code changes needed. Your workflows become instantly accessible via the Model Context Protocol.
+
+### 🐳 Docker Deployment
+Deploy anywhere with built-in Docker support:
+```yaml
+controller:
+  runtime: docker
+```
+Run your workflows in isolated containers with full control over images, volumes, ports, and environment variables.
+
+> 📖 See the [User Guide](docs/user-guide/README.md) for detailed configuration and [Examples](examples/README.md) for ready-to-run samples.
+
+---
+## 🏗 Architecture
+
+![Archtecture Diagram](docs/images/architecture-diagram.png)
+
+---
+
+## 🤝 Contributing
+We welcome all contributions!
+Whether it's fixing bugs, improving docs, or adding examples — every bit helps.
+
+```
+# Setup for development
+git clone https://github.com/hanyeol/model-compose.git
+cd model-compose
+pip install -e .[dev]
+```
+
+---
+
+## 📄 License
+MIT License © 2025 Hanyeol Cho.
+
+---
+
+## 📬 Contact
+Have questions, ideas, or feedback? [Open an issue](https://github.com/hanyeol/model-compose/issues) or start a discussion on [GitHub Discussions](https://github.com/hanyeol/model-compose/discussions).

{model_compose-0.4.9 → model_compose-0.4.11}/pyproject.toml

@@ -1,6 +1,6 @@
 [project]
 name = "model-compose"
-version = "0.4.9"
+version = "0.4.11"
 description = "model-compose: Declarative AI Model and Workflow Orchestrator"
 authors = [
     { name = "Hanyeol Cho", email = "hanyeol.cho@gmail.com" }

{model_compose-0.4.9 → model_compose-0.4.11}/src/mindor/cli/compose.py

@@ -1,11 +1,18 @@
-import click
-import json
+from typing import Optional, List
+import importlib.metadata
 from pathlib import Path
+import click
 import asyncio
+import json
 
-from mindor.dsl.loader import load_compose_config
-from mindor.core.runtime.env import load_env_files, merge_env_data
-from mindor.core.compose import *
+def _load_compose_config(config_files: List[Path], env_files: List[Path], env_data: List[str]):
+    from mindor.dsl.loader import load_compose_config
+    from mindor.core.runtime.env import load_env_files, merge_env_data
+
+    env = load_env_files(".", env_files or [])
+    env = merge_env_data(env, env_data)
+
+    return load_compose_config(".", config_files, env)
 
 @click.group()
 @click.option(
@@ -13,6 +20,10 @@ from mindor.core.compose import *
     type=click.Path(exists=True, dir_okay=False, path_type=Path),
     help="Compose configuration files."
 )
+@click.version_option(
+    version=importlib.metadata.version("model-compose"),
+    message="%(prog)s %(version)s"
+)
 @click.pass_context
 def compose_command(ctx: click.Context, config_files: List[Path]) -> None:
     """model-compose"""
@@ -34,21 +45,25 @@ def compose_command(ctx: click.Context, config_files: List[Path]) -> None:
 @click.option("--verbose", "-v", is_flag=True, help="Enable verbose output.")
 @click.pass_context
 def up_command(
-    ctx: click.Context, 
+    ctx: click.Context,
     detach: bool,
     env_files: List[Path],
     env_data: List[str],
     verbose: bool
 ) -> None:
+    from mindor.core.compose import launch_services
     config_files = ctx.obj.get("config_files", [])
     async def _async_command():
         try:
-            env = load_env_files(".", env_files or [])
-            env = merge_env_data(env, env_data)
-            config = load_compose_config(".", config_files, env)
+            config = _load_compose_config(config_files, env_files, env_data)
             await launch_services(config, detach, verbose)
         except Exception as e:
-            click.echo(f"❌ {e}", err=True)
+            if verbose:
+                import traceback
+                click.echo(f"❌ Error: {e}\n\nTraceback:", err=True)
+                traceback.print_exc()
+            else:
+                click.echo(f"❌ {e}", err=True)
     asyncio.run(_async_command())
 
 @click.command(name="down")
@@ -70,15 +85,19 @@ def down_command(
     env_data: List[str],
     verbose: bool
 ) -> None:
+    from mindor.core.compose import terminate_services
     config_files = ctx.obj.get("config_files", [])
     async def _async_command():
         try:
-            env = load_env_files(".", env_files or [])
-            env = merge_env_data(env, env_data)
-            config = load_compose_config(".", config_files, env)
+            config = _load_compose_config(config_files, env_files, env_data)
             await terminate_services(config, verbose)
         except Exception as e:
-            click.echo(f"❌ {e}", err=True)
+            if verbose:
+                import traceback
+                click.echo(f"❌ Error: {e}\n\nTraceback:", err=True)
+                traceback.print_exc()
+            else:
+                click.echo(f"❌ {e}", err=True)
     asyncio.run(_async_command())
 
 @click.command(name="start")
@@ -100,15 +119,19 @@ def start_command(
     env_data: List[str],
     verbose: bool
 ) -> None:
+    from mindor.core.compose import start_services
     config_files = ctx.obj.get("config_files", [])
     async def _async_command():
         try:
-            env = load_env_files(".", env_files or [])
-            env = merge_env_data(env, env_data)
-            config = load_compose_config(".", config_files, env)
+            config = _load_compose_config(config_files, env_files, env_data)
             await start_services(config, verbose)
         except Exception as e:
-            click.echo(f"❌ {e}", err=True)
+            if verbose:
+                import traceback
+                click.echo(f"❌ Error: {e}\n\nTraceback:", err=True)
+                traceback.print_exc()
+            else:
+                click.echo(f"❌ {e}", err=True)
     asyncio.run(_async_command())
 
 @click.command(name="stop")
@@ -130,15 +153,19 @@ def stop_command(
     env_data: List[str],
     verbose: bool
 ) -> None:
+    from mindor.core.compose import stop_services
     config_files = ctx.obj.get("config_files", [])
     async def _async_command():
         try:
-            env = load_env_files(".", env_files or [])
-            env = merge_env_data(env, env_data)
-            config = load_compose_config(".", config_files, env)
+            config = _load_compose_config(config_files, env_files, env_data)
             await stop_services(config, verbose)
         except Exception as e:
-            click.echo(f"❌ {e}", err=True)
+            if verbose:
+                import traceback
+                click.echo(f"❌ Error: {e}\n\nTraceback:", err=True)
+                traceback.print_exc()
+            else:
+                click.echo(f"❌ {e}", err=True)
     asyncio.run(_async_command())
 
 @click.command(name="run")
@@ -176,12 +203,11 @@ def run_command(
     output_path: Optional[Path],
     verbose: bool
 ) -> None:
+    from mindor.core.compose import run_workflow
     config_files = ctx.obj.get("config_files", [])
     async def _async_command():
         try:
-            env = load_env_files(".", env_files or [])
-            env = merge_env_data(env, env_data)
-            config = load_compose_config(".", config_files, env)
+            config = _load_compose_config(config_files, env_files, env_data)
             input = json.loads(input_json) if input_json else {}
             state = await run_workflow(config, workflow_id or "__default__", input, output_path, verbose)
             if isinstance(state.output, (dict, list)) or state.error:
@@ -196,7 +222,12 @@ def run_command(
         except json.JSONDecodeError:
             click.echo("❌ Invalid JSON provided for --input", err=True)
         except Exception as e:
-            click.echo(f"❌ {e}", err=True)
+            if verbose:
+                import traceback
+                click.echo(f"❌ Error: {e}\n\nTraceback:", err=True)
+                traceback.print_exc()
+            else:
+                click.echo(f"❌ {e}", err=True)
     asyncio.run(_async_command())
 
 compose_command.add_command(up_command)

{model_compose-0.4.9 → model_compose-0.4.11}/src/mindor/core/controller/base.py

@@ -16,14 +16,14 @@ from mindor.core.workflow import Workflow, WorkflowResolver, create_workflow
 from mindor.core.logger import LoggerService, create_logger
 from mindor.core.controller.webui import ControllerWebUI
 from mindor.core.workflow.schema import WorkflowSchema, create_workflow_schemas
-from mindor.core.utils.workqueue import WorkQueue
+from mindor.core.utils.work_queue import WorkQueue
 from mindor.core.utils.caching import ExpiringDict
 from .runtime.specs import ControllerRuntimeSpecs
 from .runtime.native import NativeRuntimeLauncher
 from .runtime.docker import DockerRuntimeLauncher
 from threading import Lock
 from pathlib import Path
-import asyncio, ulid, os
+import asyncio, ulid, os, threading
 
 class TaskStatus(str, Enum):
     PENDING    = "pending"
@@ -39,6 +39,19 @@ class TaskState:
     error: Optional[Any] = None
 
 class ControllerService(AsyncService):
+    _shared_instance: Optional["ControllerService"] = None
+    _shared_instance_lock = threading.Lock()
+    
+    def __new__(cls, *args, **kwargs):
+        with cls._shared_instance_lock:
+            if cls._shared_instance is None:
+                cls._shared_instance = super().__new__(cls)
+        return cls._shared_instance
+
+    @classmethod
+    def get_shared_instance(cls) -> Optional["ControllerService"]:
+        return cls._shared_instance
+
     def __init__(
         self,
         config: ControllerConfig,
@@ -279,7 +292,9 @@ class ControllerService(AsyncService):
             output = await workflow.run(task_id, input)
             state = TaskState(task_id=task_id, status=TaskStatus.COMPLETED, output=output)
         except Exception as e:
-            state = TaskState(task_id=task_id, status=TaskStatus.FAILED, error=str(e))
+            import traceback
+            error_message = f"{str(e)}\n\nTraceback:\n{''.join(traceback.format_exception(type(e), e, e.__traceback__))}"
+            state = TaskState(task_id=task_id, status=TaskStatus.FAILED, error=error_message)
 
         with self.task_states_lock:
             self.task_states.set(task_id, state, 1 * 3600)

{model_compose-0.4.9 → model_compose-0.4.11}/src/mindor/core/controller/services/http_server.py

@@ -42,6 +42,10 @@ class TaskResult(BaseModel):
             error=instance.error
         )
 
+    @classmethod
+    def to_dict(cls, instance: TaskState) -> Dict[str, Any]:
+        return cls.from_instance(instance).model_dump(exclude_none=True)
+
 class WorkflowVariableResult(BaseModel):
     name: Optional[str]
     type: str
@@ -83,6 +87,10 @@ class WorkflowSimpleResult(BaseModel):
             default=instance.default or None
         )
 
+    @classmethod
+    def to_dict(cls, instance: WorkflowSchema) -> Dict[str, Any]:
+        return cls.from_instance(instance).model_dump(exclude_none=True)
+
 class WorkflowSchemaResult(BaseModel):
     workflow_id: str
     title: Optional[str] = None
@@ -102,6 +110,10 @@ class WorkflowSchemaResult(BaseModel):
             default=instance.default or None
         )
 
+    @classmethod
+    def to_dict(cls, instance: WorkflowSchema) -> Dict[str, Any]:
+        return cls.from_instance(instance).model_dump(exclude_none=True)
+
     @classmethod
     def _to_variable_result(cls, variable: Union[WorkflowVariableConfig, WorkflowVariableGroupConfig]) -> Union[WorkflowVariableResult, WorkflowVariableGroupResult]:
         if isinstance(variable, WorkflowVariableGroupConfig):
@@ -176,6 +188,10 @@ class HttpServerController(ControllerService):
             
             return self._render_task_response(state, output_only)
 
+        @self.router.get("/health")
+        async def health_check():
+            return JSONResponse(content={ "status": "ok" })
+
     async def _serve(self) -> None:
         self.server = uvicorn.Server(uvicorn.Config(
             self.app,
@@ -231,7 +247,7 @@ class HttpServerController(ControllerService):
         return self._render_task_state(state)
 
     def _render_task_state(self, state: TaskState) -> Response:
-        return JSONResponse(content=TaskResult.from_instance(state).model_dump(exclude_none=True))
+        return JSONResponse(content=TaskResult.to_dict(state))
 
     def _render_task_output(self, state: TaskState) -> Response:
         if state.status in [ TaskStatus.PENDING, TaskStatus.PROCESSING ]:
@@ -279,13 +295,13 @@ class HttpServerController(ControllerService):
 
     def _render_workflow_list(self, workflows: Dict[str, WorkflowSchema]) -> Response:
         return JSONResponse(content=[
-            WorkflowSimpleResult.from_instance(workflow).model_dump(exclude_none=True) for workflow in workflows.values()
+            WorkflowSimpleResult.to_dict(workflow) for workflow in workflows.values()
         ])
 
     def _render_workflow_schemas(self, workflows: Dict[str, WorkflowSchema]) -> Response:
         return JSONResponse(content=[
-            WorkflowSchemaResult.from_instance(workflow).model_dump(exclude_none=True) for workflow in workflows.values()
+            WorkflowSchemaResult.to_dict(workflow) for workflow in workflows.values()
         ])
 
     def _render_workflow_schema(self, workflow: WorkflowSchema) -> Response:
-        return JSONResponse(content=WorkflowSchemaResult.from_instance(workflow).model_dump(exclude_none=True))
+        return JSONResponse(content=WorkflowSchemaResult.to_dict(workflow))

{model_compose-0.4.9 → model_compose-0.4.11}/src/mindor/core/listener/base.py

@@ -1,7 +1,7 @@
 from typing import Type, Union, Literal, Optional, Dict, List, Tuple, Set, Annotated, Any
 from mindor.dsl.schema.listener import ListenerConfig, ListenerType
 from mindor.core.foundation import AsyncService
-from mindor.core.utils.workqueue import WorkQueue
+from mindor.core.utils.work_queue import WorkQueue
 from mindor.core.logger import logging
 
 class ListenerService(AsyncService):

{model_compose-0.4.9 → model_compose-0.4.11}/src/mindor/core/listener/services/__init__.py

@@ -1 +1,2 @@
 from .http_callback import *
+from .http_trigger import *