codepp 0.0.438__tar.gz → 0.0.443__tar.gz

{codepp-0.0.438 → codepp-0.0.443}/.gitignore

@@ -1,3 +1,7 @@
+# User config directory — contains OAuth tokens, session keys, and local state
+# Must NEVER be committed (even if copied/symlinked into the repo)
+.code_puppy/
+
 # Python-generated files
 __pycache__/
 *.py[oc]
@@ -45,3 +49,11 @@ code_puppy/bundled_skills/
 .claude/hooks/ts-hooks/dist/
 
 .json
+
+# Eval log output
+evals/logs/
+
+# Beads / Dolt files (added by bd init)
+.dolt/
+*.db
+.beads-credential-key

{codepp-0.0.438 → codepp-0.0.443}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: codepp
-Version: 0.0.438
+Version: 0.0.443
 Summary: Code generation agent
 Project-URL: repository, https://github.com/mpfaffenberger/code_puppy
 Project-URL: HomePage, https://github.com/mpfaffenberger/code_puppy
@@ -25,10 +25,11 @@ Requires-Dist: fastapi>=0.135.2
 Requires-Dist: httpx[http2]>=0.28.1
 Requires-Dist: json-repair>=0.58.7
 Requires-Dist: mcp>=1.26.0
+Requires-Dist: msgpack>=1.0.0
 Requires-Dist: openai>=2.30.0
 Requires-Dist: pillow>=12.1.1
 Requires-Dist: playwright>=1.58.0
-Requires-Dist: prompt-toolkit>=3.0.52
+Requires-Dist: prompt-toolkit>=3.0.50
 Requires-Dist: pydantic-ai-slim[anthropic,mcp,openai]==1.60.0
 Requires-Dist: pydantic>=2.12.5
 Requires-Dist: pyfiglet>=1.0.4
@@ -39,6 +40,7 @@ Requires-Dist: rich>=14.3.3
 Requires-Dist: ripgrep==15.0.0
 Requires-Dist: tenacity>=9.1.4
 Requires-Dist: termflow-md>=0.1.9
+Requires-Dist: textual>=8.2.1
 Requires-Dist: typer>=0.24.1
 Requires-Dist: uvicorn[standard]>=0.42.0
 Requires-Dist: websockets>=16.0
@@ -54,8 +56,6 @@ Description-Content-Type: text/markdown
 [![Downloads](https://img.shields.io/badge/Downloads-170k%2B-brightgreen?style=for-the-badge&logo=download)](https://pypi.org/project/code-puppy/)
 [![Python](https://img.shields.io/badge/Python-3.11%2B-blue?style=for-the-badge&logo=python&logoColor=white)](https://python.org)
 [![License](https://img.shields.io/badge/License-MIT-green?style=for-the-badge)](LICENSE)
-[![Build Status](https://img.shields.io/badge/Build-Passing-brightgreen?style=for-the-badge&logo=github)](https://github.com/mpfaffenberger/code_puppy/actions)
-[![Tests](https://img.shields.io/badge/Tests-Passing-success?style=for-the-badge&logo=pytest)](https://github.com/mpfaffenberger/code_puppy/tests)
 
 [![100% Open Source](https://img.shields.io/badge/100%25-Open%20Source-blue?style=for-the-badge)](https://github.com/mpfaffenberger/code_puppy)
 [![Pydantic AI](https://img.shields.io/badge/Pydantic-AI-success?style=for-the-badge)](https://github.com/pydantic/pydantic-ai)
@@ -225,6 +225,47 @@ For examples and more information about agent rules, visit [https://agent.md](ht
 
 Use the `/mcp` command to manage MCP (list, start, stop, status, etc.)
 
+## Security Model: Shell Commands and Plugins
+
+### Shell command paths
+
+Code Puppy has **two distinct shell execution paths**:
+
+1. **Agent tool path** — `agent_run_shell_command`
+   - Used by agents and sub-agents
+   - Flows through the `run_shell_command` callback hook
+   - Can be governed by the `shell_safety` plugin and `PolicyEngine`
+   - In non-yolo mode, also supports interactive user confirmation
+
+2. **Direct shell passthrough** — `!<command>`
+   - Runs a shell command immediately from the user prompt
+   - **Bypasses the AI agent entirely**
+   - **Does not use the agent/tool safety pipeline**
+   - Should be treated like running the command directly in your terminal
+
+If you want Code Puppy safety and policy checks, use the agent tool path rather than `!<command>`.
+If you use `!<command>`, you are explicitly choosing direct local execution.
+
+### Plugin trust boundary
+
+Built-in plugins ship with Code Puppy, but **user plugins are fully trusted local code**.
+Any Python in `~/.code_puppy/plugins/` is imported and executed during plugin discovery.
+That means user plugins can read files, execute processes, modify configuration, and access any data your local Python process can access.
+
+Only install or keep user plugins you trust at the same level as other local developer tooling.
+
+### Safe-mode expectations
+
+At the moment, Code Puppy does **not** provide a fully isolated "safe mode" for user plugins.
+If you need a more locked-down session, the safest current approach is:
+
+- remove or rename untrusted directories under `~/.code_puppy/plugins/`
+- avoid `!<command>` passthrough for sensitive workflows
+- prefer non-yolo execution so agent tool calls can be reviewed
+- use policy rules for `agent_run_shell_command` where appropriate
+
+A future hardening direction is an explicit user-plugin disable switch and/or policy-aware shell passthrough mode.
+
 ## Round Robin Model Distribution
 
 Code Puppy supports **Round Robin model distribution** to help you overcome rate limits and distribute load across multiple AI models. This feature automatically cycles through configured models with each request, maximizing your API usage while staying within rate limits.

{codepp-0.0.438 → codepp-0.0.443}/README.md

@@ -8,8 +8,6 @@
 [![Downloads](https://img.shields.io/badge/Downloads-170k%2B-brightgreen?style=for-the-badge&logo=download)](https://pypi.org/project/code-puppy/)
 [![Python](https://img.shields.io/badge/Python-3.11%2B-blue?style=for-the-badge&logo=python&logoColor=white)](https://python.org)
 [![License](https://img.shields.io/badge/License-MIT-green?style=for-the-badge)](LICENSE)
-[![Build Status](https://img.shields.io/badge/Build-Passing-brightgreen?style=for-the-badge&logo=github)](https://github.com/mpfaffenberger/code_puppy/actions)
-[![Tests](https://img.shields.io/badge/Tests-Passing-success?style=for-the-badge&logo=pytest)](https://github.com/mpfaffenberger/code_puppy/tests)
 
 [![100% Open Source](https://img.shields.io/badge/100%25-Open%20Source-blue?style=for-the-badge)](https://github.com/mpfaffenberger/code_puppy)
 [![Pydantic AI](https://img.shields.io/badge/Pydantic-AI-success?style=for-the-badge)](https://github.com/pydantic/pydantic-ai)
@@ -179,6 +177,47 @@ For examples and more information about agent rules, visit [https://agent.md](ht
 
 Use the `/mcp` command to manage MCP (list, start, stop, status, etc.)
 
+## Security Model: Shell Commands and Plugins
+
+### Shell command paths
+
+Code Puppy has **two distinct shell execution paths**:
+
+1. **Agent tool path** — `agent_run_shell_command`
+   - Used by agents and sub-agents
+   - Flows through the `run_shell_command` callback hook
+   - Can be governed by the `shell_safety` plugin and `PolicyEngine`
+   - In non-yolo mode, also supports interactive user confirmation
+
+2. **Direct shell passthrough** — `!<command>`
+   - Runs a shell command immediately from the user prompt
+   - **Bypasses the AI agent entirely**
+   - **Does not use the agent/tool safety pipeline**
+   - Should be treated like running the command directly in your terminal
+
+If you want Code Puppy safety and policy checks, use the agent tool path rather than `!<command>`.
+If you use `!<command>`, you are explicitly choosing direct local execution.
+
+### Plugin trust boundary
+
+Built-in plugins ship with Code Puppy, but **user plugins are fully trusted local code**.
+Any Python in `~/.code_puppy/plugins/` is imported and executed during plugin discovery.
+That means user plugins can read files, execute processes, modify configuration, and access any data your local Python process can access.
+
+Only install or keep user plugins you trust at the same level as other local developer tooling.
+
+### Safe-mode expectations
+
+At the moment, Code Puppy does **not** provide a fully isolated "safe mode" for user plugins.
+If you need a more locked-down session, the safest current approach is:
+
+- remove or rename untrusted directories under `~/.code_puppy/plugins/`
+- avoid `!<command>` passthrough for sensitive workflows
+- prefer non-yolo execution so agent tool calls can be reviewed
+- use policy rules for `agent_run_shell_command` where appropriate
+
+A future hardening direction is an explicit user-plugin disable switch and/or policy-aware shell passthrough mode.
+
 ## Round Robin Model Distribution
 
 Code Puppy supports **Round Robin model distribution** to help you overcome rate limits and distribute load across multiple AI models. This feature automatically cycles through configured models with each request, maximizing your API usage while staying within rate limits.

codepp-0.0.443/code_puppy/_backlog.py

@@ -0,0 +1,53 @@
+"""Event backlog for callbacks fired before listeners register.
+
+During plugin startup, callbacks may fire for phases that have no listeners
+yet (because the plugin that registers the listener hasn't loaded). This
+module buffers those calls and replays them once listeners are available.
+
+Inspired by Gemini CLI's CoreEventEmitter._emitOrQueue() pattern.
+"""
+
+from collections import deque
+
+# Lazy-import PhaseType to avoid circular deps at module scope
+_MAX_BACKLOG_PER_PHASE = 100
+
+# phase -> deque of (args_tuple, kwargs_dict) that were fired with no listeners
+_backlog: dict[str, deque[tuple[tuple, dict]]] = {}
+
+
+def buffer_event(phase: str, args: tuple, kwargs: dict) -> None:
+    """Buffer an event that had no listeners when fired."""
+    buf = _backlog.get(phase)
+    if buf is None:
+        buf = deque(maxlen=_MAX_BACKLOG_PER_PHASE)
+        _backlog[phase] = buf
+    buf.append((args, kwargs))
+
+
+def drain_backlog(phase: str) -> list[tuple[tuple, dict]]:
+    """Pop and return all buffered events for *phase*."""
+    buf = _backlog.pop(phase, None)
+    return list(buf) if buf else []
+
+
+def drain_all() -> dict[str, list[tuple[tuple, dict]]]:
+    """Pop and return buffered events for every phase that has any."""
+    result = {p: list(events) for p, events in _backlog.items() if events}
+    _backlog.clear()
+    return result
+
+
+def pending_count(phase: str | None = None) -> int:
+    """Return number of buffered events, optionally filtered by phase."""
+    if phase is not None:
+        return len(_backlog.get(phase, ()))
+    return sum(len(v) for v in _backlog.values())
+
+
+def clear(phase: str | None = None) -> None:
+    """Clear buffered events."""
+    if phase is None:
+        _backlog.clear()
+    else:
+        _backlog.pop(phase, None)

codepp-0.0.443/code_puppy/_core_bridge.py

@@ -0,0 +1,149 @@
+"""Bridge to Rust extension module with Python fallback.
+
+This is the ONLY place where pydantic-ai message objects are converted to
+the dict format that Rust expects. The Rust module never touches pydantic-ai
+objects directly.
+"""
+
+
+import json
+from typing import Any
+
+try:
+    from _code_puppy_core import (
+        ProcessResult,
+        PruneResult,
+        SplitResult,
+        deserialize_session,
+        process_messages_batch,
+        prune_and_filter,
+        serialize_session,
+        serialize_session_incremental,
+        split_for_summarization,
+        truncation_indices)
+
+    RUST_AVAILABLE = True
+except ImportError:
+    RUST_AVAILABLE = False
+
+    # Provide type stubs so downstream code can reference them
+    ProcessResult = None  # type: ignore[assignment,misc]
+    PruneResult = None  # type: ignore[assignment,misc]
+    SplitResult = None  # type: ignore[assignment,misc]
+    process_messages_batch = None  # type: ignore[assignment]
+    prune_and_filter = None  # type: ignore[assignment]
+    truncation_indices = None  # type: ignore[assignment]
+    split_for_summarization = None  # type: ignore[assignment]
+    serialize_session = None  # type: ignore[assignment]
+    deserialize_session = None  # type: ignore[assignment]
+    serialize_session_incremental = None  # type: ignore[assignment]
+
+
+# --- Hashline acceleration --------------------------------------------------
+try:
+    from _code_puppy_core import (
+        compute_line_hash,
+        format_hashlines,
+        strip_hashline_prefixes,
+        validate_hashline_anchor,
+    )
+    HASHLINE_RUST_AVAILABLE = True
+except ImportError:
+    HASHLINE_RUST_AVAILABLE = False
+    compute_line_hash = None  # type: ignore[assignment]
+    format_hashlines = None  # type: ignore[assignment]
+    strip_hashline_prefixes = None  # type: ignore[assignment]
+    validate_hashline_anchor = None  # type: ignore[assignment]
+# ---------------------------------------------------------------------------
+
+
+# --- Fast Puppy toggle ---------------------------------------------------
+# When True (default), Rust acceleration is used at runtime if the module
+# is installed.  /fast_puppy disable flips this to False so every call
+# falls through to the Python path — no restart needed.
+_rust_user_enabled: bool = True
+
+
+def is_rust_enabled() -> bool:
+    """Check if Rust acceleration is both available AND enabled by the user."""
+    return RUST_AVAILABLE and _rust_user_enabled
+
+
+def set_rust_enabled(enabled: bool) -> None:
+    """Toggle Rust acceleration on or off at runtime."""
+    global _rust_user_enabled
+    _rust_user_enabled = enabled
+
+
+def get_rust_status() -> dict:
+    """Return diagnostic info for /fast_puppy status."""
+    return {
+        "installed": RUST_AVAILABLE,
+        "enabled": _rust_user_enabled,
+        "active": is_rust_enabled(),
+    }
+# --------------------------------------------------------------------------
+
+
+def serialize_message_for_rust(message: Any) -> dict:
+    """Convert a pydantic-ai ModelMessage to the dict format expected by Rust.
+
+    This is the ONLY place where pydantic-ai message objects are converted
+    to dicts. The Rust module never touches pydantic-ai objects directly.
+    """
+    from pydantic_ai.messages import ModelRequest
+
+    kind = "request" if isinstance(message, ModelRequest) else "response"
+    role = getattr(message, "role", None)
+    instructions = getattr(message, "instructions", None)
+
+    parts: list[dict] = []
+    for part in getattr(message, "parts", []):
+        part_dict: dict[str, Any] = {
+            "part_kind": getattr(part, "part_kind", str(type(part).__name__)),
+            "content": None,
+            "content_json": None,
+            "tool_call_id": getattr(part, "tool_call_id", None),
+            "tool_name": getattr(part, "tool_name", None),
+            "args": str(getattr(part, "args", "")) if hasattr(part, "args") else None,
+        }
+
+        content = getattr(part, "content", None)
+        if content is None:
+            pass
+        elif isinstance(content, str):
+            part_dict["content"] = content
+        elif isinstance(content, list):
+            text_parts = []
+            for item in content:
+                if isinstance(item, str):
+                    text_parts.append(item)
+                # Skip BinaryContent for token estimation
+            part_dict["content"] = "\n".join(text_parts) if text_parts else None
+        else:
+            # Dicts, Pydantic models, other — serialize to JSON string
+            try:
+                if hasattr(content, "model_dump_json"):
+                    part_dict["content_json"] = content.model_dump_json(
+                        sort_keys=True
+                    )
+                elif isinstance(content, dict):
+                    part_dict["content_json"] = json.dumps(content, sort_keys=True)
+                else:
+                    part_dict["content"] = repr(content)
+            except (TypeError, ValueError):
+                part_dict["content"] = repr(content)
+
+        parts.append(part_dict)
+
+    return {
+        "kind": kind,
+        "role": role,
+        "instructions": instructions,
+        "parts": parts,
+    }
+
+
+def serialize_messages_for_rust(messages: list) -> list[dict]:
+    """Batch convert messages for Rust consumption."""
+    return [serialize_message_for_rust(m) for m in messages]