pythinker-code 0.55.0__py3-none-any.whl → 0.57.0__py3-none-any.whl

pythinker_code/CHANGELOG.md

@@ -15,6 +15,51 @@ GitHub Releases page; `0.8.0` is the new starting line.
 
 ## Unreleased
 
+## 0.57.0 (2026-07-05)
+
+- **No more ghost/duplicate input prompt while the agent works.** After
+  submitting a prompt, the input card no longer fossilizes above the stream as
+  a second, ghostly prompt. The prompt bar and top border now stay visible
+  through turn-start and lazy-load frames, and running-agent output renders
+  through a stable diff-rendered scene (ported from Pi) so the input card no
+  longer jumps. An experimental Focus TUI mode (`tui.focus_mode`) pins the
+  composer and hides file activity behind a compact live shelf for a cleaner
+  fullscreen view, and active subagent tool work now surfaces in the pinned
+  status tail instead of a generic composing spinner.
+- **Added a native `/benchmark` command suite.** Run deterministic local
+  Pythinker model evaluations with bundled smoke tasks and SWE-style JSONL
+  tasks (`/benchmark:swe`), plus `/benchmark compare`, `/benchmark export`,
+  and `/benchmark discover` actions that produce replayable artifacts,
+  activity metrics, and branded markdown reports.
+- **Hardened benchmark and skill security edges.** SWE verification commands
+  are shape-validated before execution, benchmark discovery requires explicit
+  network opt-in, run IDs avoid clock collisions, runtime overrides restore
+  after setup failures, and active-skill deactivation failures now surface
+  instead of being swallowed. Explicitly invoked skills stay active across
+  later turns through a compact reminder until stopped by name or
+  "normal mode".
+
+Upgrade with `pythinker update`, `pip install --upgrade pythinker-code==0.57.0`, or use the native installer for your platform from the [Releases page](https://github.com/Pythoughts-labs/pythinker-code/releases/latest).
+
+## 0.56.0 (2026-07-02)
+
+- **Windows shell UI recovers from mid-session console blanking.** The TUI's
+  transcript and input box could go blank mid-session until a terminal restart;
+  child processes spawned by the Shell tool, background tasks, and `!` commands
+  no longer attach to the interactive console (`CREATE_NO_WINDOW`), and the
+  prompt renderer now forces an absolute repaint after terminal resizes and
+  failed scrollback handoffs instead of diffing against a stale frame.
+- **Workflow progress rendering and lifecycle fixes.** Progress display no
+  longer duplicates agents once truncated by the per-phase display cap,
+  `agent()` coroutines are no longer leaked when `parallel()` rejects its
+  arguments, and a 1000-agent lifetime backstop now guards against runaway
+  workflow loops.
+- **Stale update-success notice cleared after downgrading.** Restarting into
+  an older Homebrew install no longer leaves a permanent "Restart to apply"
+  banner — the `/update` command surfaces again as expected.
+
+Upgrade with `pythinker update`, `pip install --upgrade pythinker-code==0.56.0`, or use the native installer for your platform from the [Releases page](https://github.com/Pythoughts-labs/pythinker-code/releases/latest).
+
 ## 0.55.0 (2026-06-30)
 
 - **Local-model reliability fixes for compaction, Qwen3 reasoning, and stuck loops.**

pythinker_code/agents/default/system.md

@@ -127,7 +127,7 @@ Default to `ImplementAndJudge` for non-trivial scoped edits (see §4.4); reserve
 
 **Background shell** (root agent only). Launch long-running commands via `Shell` with `run_in_background=true` and a short `description`; the system notifies you at terminal states. `TaskList` re-enumerates active tasks (especially after context compaction); `TaskOutput` gives non-blocking snapshots (`block=true` only to intentionally wait); `TaskStop` cancels. After starting a background task, default to returning control to the user. The only task-management slash command for users is `/task` — never invent subcommands like `/task list` or `/tasks`. Subagents and sessions without these tools must not assume background-task control.
 
-**Skills (`ReadSkill`).** Load a skill's exact instructions before applying its workflow — mandatory for `review-pr`, `diagnose-ci-failures`, `fix-errors`, `implement-specs`, `spec-driven-implementation`, `check-impl-against-spec`, `resolve-merge-conflicts`, and `create-pr`. Read skill details only when needed, to conserve context. Catalog and scope precedence in §12.
+**Skills (`ReadSkill`).** Load a skill's exact instructions before applying its workflow — mandatory for `review-pr`, `diagnose-ci-failures`, `fix-errors`, `implement-specs`, `spec-driven-implementation`, `check-impl-against-spec`, `resolve-merge-conflicts`, and `create-pr`. If the user explicitly invokes or names a skill as an active mode, keep applying that loaded skill until they ask to stop it or return to normal mode. Read skill details only when needed, to conserve context. Catalog and scope precedence in §12.
 
 **Inline `/command` references.** Slash commands execute only as their own message starting with `/`. A `/command` or `/skill:<name>` mentioned mid-message did not auto-run, but it still expresses intent — act on it rather than leading your reply by reporting it as failed. For `/plan`, call `EnterPlanMode` (a real tool in your toolset, not just prose); for `/goal`, pursue the described objective until it is verifiably done; for `/skill:<name>`, load it via `ReadSkill` and apply it; for other guidance commands, apply the equivalent guidance yourself. Mention invoking the real command only when genuinely needed. Never silently drop such a reference.
 
@@ -259,4 +259,4 @@ Skills are reusable, self-contained capability directories, each with a `SKILL.m
 
 ${PYTHINKER_SKILLS}
 
-Identify the skills relevant to the current task and read their `SKILL.md` before applying the workflow (§5). If a skill `<name>` has a companion `<name>-local`, treat it as local project specialization applied after the core skill. Read skill details only when needed, to conserve the context window.
+Identify the skills relevant to the current task and read their `SKILL.md` before applying the workflow (§5). If a skill `<name>` has a companion `<name>-local`, treat it as local project specialization applied after the core skill. Read skill details only when needed, to conserve the context window.

pythinker_code/background/manager.py

@@ -12,6 +12,7 @@ from pathlib import Path
 from typing import TYPE_CHECKING, Any, Literal
 
 from pythinker_host.local import local_host
+from pythinker_host.windows import windows_console_detach_flags
 
 from pythinker_code.config import BackgroundConfig
 from pythinker_code.notifications import NotificationEvent, NotificationManager
@@ -243,7 +244,10 @@ class BackgroundTaskManager:
             "cwd": str(task_dir),
         }
         if os.name == "nt":
-            kwargs["creationflags"] = getattr(subprocess, "CREATE_NEW_PROCESS_GROUP", 0)
+            # CREATE_NO_WINDOW: don't share the interactive console — a child
+            # touching it via the Win32 console API bypasses DEVNULL stdio and
+            # can blank the parent TUI until terminal restart.
+            kwargs["creationflags"] = windows_console_detach_flags()
         else:
             kwargs["start_new_session"] = True
 

pythinker_code/background/worker.py

@@ -9,6 +9,8 @@ import time
 from pathlib import Path
 from typing import Any
 
+from pythinker_host.windows import windows_console_detach_flags
+
 from pythinker_code.utils.logging import logger
 from pythinker_code.utils.subprocess_env import get_clean_env, scrub_secret_env
 
@@ -185,7 +187,10 @@ async def run_background_task_worker(
                 "env": scrub_secret_env(get_clean_env()) if spec.scrub_secrets else get_clean_env(),
             }
             if os.name == "nt":
-                spawn_kwargs["creationflags"] = getattr(subprocess, "CREATE_NEW_PROCESS_GROUP", 0)
+                # CREATE_NO_WINDOW: don't share the interactive console — a child
+                # touching it via the Win32 console API bypasses the redirected
+                # stdio and can blank the parent TUI until terminal restart.
+                spawn_kwargs["creationflags"] = windows_console_detach_flags()
             else:
                 spawn_kwargs["start_new_session"] = True
 

pythinker_code/benchmark/__init__.py

@@ -0,0 +1,5 @@
+"""Native Pythinker Benchmark support."""
+
+from pythinker_code.benchmark.commands import benchmark_usage
+
+__all__ = ["benchmark_usage"]

pythinker_code/benchmark/activity.py

@@ -0,0 +1,88 @@
+from __future__ import annotations
+
+import difflib
+import json
+from collections.abc import Mapping
+from pathlib import Path
+from typing import cast
+
+
+def summarize_benchmark_activity(
+    before: Mapping[str, str],
+    after: Mapping[str, str],
+    wire_file: Path,
+    wire_offset: int,
+) -> dict[str, object]:
+    added, removed = _changed_line_counts(before, after)
+    tool_calls_by_name = _tool_calls_by_name(wire_file, wire_offset)
+    shell_tool_calls = sum(
+        count for name, count in tool_calls_by_name.items() if name.casefold() in {"bash", "shell"}
+    )
+    return {
+        "changed_files_count": len(_changed_file_names(before, after)),
+        "added_lines": added,
+        "removed_lines": removed,
+        "tool_calls_by_name": dict(sorted(tool_calls_by_name.items())),
+        "shell_tool_calls": shell_tool_calls,
+    }
+
+
+def _changed_file_names(before: Mapping[str, str], after: Mapping[str, str]) -> set[str]:
+    names = set(before) | set(after)
+    return {name for name in names if before.get(name) != after.get(name)}
+
+
+def _changed_line_counts(before: Mapping[str, str], after: Mapping[str, str]) -> tuple[int, int]:
+    added = 0
+    removed = 0
+    for name in sorted(_changed_file_names(before, after)):
+        diff = difflib.ndiff(
+            before.get(name, "").splitlines(),
+            after.get(name, "").splitlines(),
+        )
+        for line in diff:
+            if line.startswith("+ "):
+                added += 1
+            elif line.startswith("- "):
+                removed += 1
+    return added, removed
+
+
+def _tool_calls_by_name(wire_file: Path, offset: int) -> dict[str, int]:
+    counts: dict[str, int] = {}
+    if not wire_file.exists():
+        return counts
+    try:
+        with wire_file.open("r", encoding="utf-8", errors="replace") as f:
+            f.seek(offset)
+            for line in f:
+                try:
+                    raw: object = json.loads(line)
+                except json.JSONDecodeError:
+                    continue
+                if not isinstance(raw, dict):
+                    continue
+                message = cast(dict[str, object], raw).get("message")
+                if not isinstance(message, dict):
+                    continue
+                message_data = cast(dict[str, object], message)
+                if message_data.get("type") != "ToolCall":
+                    continue
+                payload = message_data.get("payload")
+                if not isinstance(payload, dict):
+                    continue
+                name = _tool_name(cast(dict[str, object], payload))
+                if isinstance(name, str) and name:
+                    counts[name] = counts.get(name, 0) + 1
+    except OSError:
+        return {}
+    return counts
+
+
+def _tool_name(payload: Mapping[str, object]) -> str | None:
+    function = payload.get("function")
+    if isinstance(function, dict):
+        name = cast(dict[str, object], function).get("name")
+        return name if isinstance(name, str) else None
+    legacy_name = payload.get("name")
+    return legacy_name if isinstance(legacy_name, str) else None

pythinker_code/benchmark/bundled/__init__.py

@@ -0,0 +1 @@
+"""Bundled benchmark definitions."""

pythinker_code/benchmark/bundled/suites/__init__.py

@@ -0,0 +1 @@
+"""Bundled benchmark suites."""

pythinker_code/benchmark/bundled/suites/pythinker-core.json

@@ -0,0 +1,11 @@
+{
+  "name": "pythinker-core",
+  "title": "Pythinker Core Suite",
+  "description": "Deterministic local coding tasks covering common agent benchmark failure modes.",
+  "tasks": [
+    "core-atomic-transfer",
+    "core-dedup-order",
+    "core-explicit-none-metadata",
+    "core-safe-path-join"
+  ]
+}

pythinker_code/benchmark/bundled/suites/pythinker-smoke.json

@@ -0,0 +1,10 @@
+{
+  "name": "pythinker-smoke",
+  "title": "Pythinker Smoke Suite",
+  "description": "Small deterministic tasks for validating the native benchmark runner.",
+  "tasks": [
+    "smoke-edit-readme",
+    "smoke-fix-python-test",
+    "smoke-add-small-function"
+  ]
+}

pythinker_code/benchmark/bundled/tasks/__init__.py

@@ -0,0 +1 @@
+"""Bundled benchmark tasks."""

pythinker_code/benchmark/bundled/tasks/core-atomic-transfer.json

@@ -0,0 +1,21 @@
+{
+  "id": "core-atomic-transfer",
+  "title": "Atomic Ledger Transfer",
+  "description": "Fix a money-transfer bug without leaving partial state behind.",
+  "prompt": "Fix ledger.py. Ledger.transfer(src, dst, amount) must move funds atomically: reject missing source accounts, missing destination accounts, non-positive amounts, and insufficient funds without changing any balance. Keep the public API minimal.",
+  "workspace": {
+    "files": {
+      "ledger.py": "class Ledger:\n    def __init__(self, balances):\n        self.balances = dict(balances)\n\n    def transfer(self, src, dst, amount):\n        self.balances[src] -= amount\n        if self.balances[src] < 0:\n            raise ValueError('insufficient funds')\n        self.balances[dst] += amount\n",
+      "test_ledger.py": "import pytest\n\nfrom ledger import Ledger\n\n\ndef test_transfer_moves_funds():\n    ledger = Ledger({'a': 10, 'b': 1})\n    ledger.transfer('a', 'b', 4)\n    assert ledger.balances == {'a': 6, 'b': 5}\n\n\ndef test_insufficient_funds_rolls_back():\n    ledger = Ledger({'a': 3, 'b': 1})\n    with pytest.raises(ValueError):\n        ledger.transfer('a', 'b', 5)\n    assert ledger.balances == {'a': 3, 'b': 1}\n\n\ndef test_missing_destination_does_not_create_accounts():\n    ledger = Ledger({'a': 3})\n    with pytest.raises((KeyError, ValueError)):\n        ledger.transfer('a', 'missing', 1)\n    assert ledger.balances == {'a': 3}\n\n\ndef test_missing_source_rolls_back():\n    ledger = Ledger({'a': 3, 'b': 1})\n    with pytest.raises((KeyError, ValueError)):\n        ledger.transfer('missing', 'b', 1)\n    assert ledger.balances == {'a': 3, 'b': 1}\n\n\n@pytest.mark.parametrize('amount', [0, -1])\ndef test_non_positive_amount_rejected(amount):\n    ledger = Ledger({'a': 3, 'b': 1})\n    with pytest.raises(ValueError):\n        ledger.transfer('a', 'b', amount)\n    assert ledger.balances == {'a': 3, 'b': 1}\n\n\ndef test_non_positive_amount_checked_before_accounts():\n    ledger = Ledger({'a': 3, 'b': 1})\n    with pytest.raises(ValueError):\n        ledger.transfer('missing', 'b', -1)\n    assert ledger.balances == {'a': 3, 'b': 1}\n"
+    }
+  },
+  "verification": {
+    "type": "command",
+    "command": "python -m pytest test_ledger.py -q"
+  },
+  "limits": {
+    "timeout_seconds": 180,
+    "max_steps": 60
+  },
+  "tags": ["core", "python", "state", "deterministic"]
+}

pythinker_code/benchmark/bundled/tasks/core-dedup-order.json

@@ -0,0 +1,21 @@
+{
+  "id": "core-dedup-order",
+  "title": "Stable Deduplication",
+  "description": "Preserve first-seen order while removing duplicates.",
+  "prompt": "Fix seqkit.py. unique(items) must return unique values from any iterable in first-seen order. It must support unhashable values such as dictionaries and must not mutate the input.",
+  "workspace": {
+    "files": {
+      "seqkit.py": "def unique(items):\n    return sorted(set(items))\n",
+      "test_seqkit.py": "from seqkit import unique\n\n\ndef test_unique_preserves_first_seen_order():\n    assert unique(['b', 'a', 'b', 'c', 'a']) == ['b', 'a', 'c']\n\n\ndef test_unique_supports_unhashable_dicts():\n    first = {'id': 1, 'name': 'first'}\n    duplicate = {'id': 1, 'name': 'first'}\n    second = {'id': 2, 'name': 'second'}\n    assert unique([first, duplicate, second, first]) == [first, second]\n\n\ndef test_unique_does_not_mutate_input():\n    values = ['b', 'a', 'b']\n    assert unique(values) == ['b', 'a']\n    assert values == ['b', 'a', 'b']\n\n\ndef test_unique_accepts_generators():\n    assert unique(x for x in ['a', 'a', 'b']) == ['a', 'b']\n\n\ndef test_unique_keeps_falsey_values_distinct():\n    assert unique([0, False, '', None, 0, None]) == [0, '', None]\n"
+    }
+  },
+  "verification": {
+    "type": "command",
+    "command": "python -m pytest test_seqkit.py -q"
+  },
+  "limits": {
+    "timeout_seconds": 180,
+    "max_steps": 60
+  },
+  "tags": ["core", "python", "algorithm", "deterministic"]
+}

pythinker_code/benchmark/bundled/tasks/core-explicit-none-metadata.json

@@ -0,0 +1,21 @@
+{
+  "id": "core-explicit-none-metadata",
+  "title": "Explicit None Metadata",
+  "description": "Distinguish omitted metadata from explicit None.",
+  "prompt": "Fix metadata.py. build_driver_info must distinguish omitted name/version from explicitly passing None: omitted fields use defaults, explicit None suppresses that field, and if both are explicitly None the result is empty. Other explicit falsey values, such as empty string, False, or 0, must be preserved.",
+  "workspace": {
+    "files": {
+      "metadata.py": "DEFAULT_NAME = 'pythinker-client'\nDEFAULT_VERSION = '1.0'\n\n\ndef build_driver_info(name=None, version=None):\n    return {\n        'name': name or DEFAULT_NAME,\n        'version': version or DEFAULT_VERSION,\n    }\n",
+      "test_metadata.py": "from metadata import build_driver_info\n\n\ndef test_omitted_fields_use_defaults():\n    assert build_driver_info() == {'name': 'pythinker-client', 'version': '1.0'}\n\n\ndef test_explicit_none_suppresses_one_field():\n    assert build_driver_info(name=None) == {'version': '1.0'}\n    assert build_driver_info(version=None) == {'name': 'pythinker-client'}\n\n\ndef test_explicit_none_for_both_fields_returns_empty_metadata():\n    assert build_driver_info(name=None, version=None) == {}\n\n\ndef test_explicit_values_are_used():\n    assert build_driver_info(name='wrapper', version='2.5') == {'name': 'wrapper', 'version': '2.5'}\n\n\ndef test_falsey_explicit_values_are_preserved():\n    assert build_driver_info(name='', version='0') == {'name': '', 'version': '0'}\n    assert build_driver_info(name=False, version=0) == {'name': False, 'version': 0}\n    assert build_driver_info(name=None, version='') == {'version': ''}\n"
+    }
+  },
+  "verification": {
+    "type": "command",
+    "command": "python -m pytest test_metadata.py -q"
+  },
+  "limits": {
+    "timeout_seconds": 180,
+    "max_steps": 60
+  },
+  "tags": ["core", "python", "api-semantics", "deterministic"]
+}

pythinker_code/benchmark/bundled/tasks/core-safe-path-join.json

@@ -0,0 +1,21 @@
+{
+  "id": "core-safe-path-join",
+  "title": "Safe Path Join",
+  "description": "Reject path traversal while keeping normal relative paths usable.",
+  "prompt": "Fix paths.py. safe_join(root, user_path) must return a Path inside root for normal relative paths, and reject absolute paths, sibling-prefix paths, parent traversal, or symlink traversal outside root with ValueError.",
+  "workspace": {
+    "files": {
+      "paths.py": "from pathlib import Path\n\n\ndef safe_join(root, user_path):\n    return Path(root) / user_path\n",
+      "test_paths.py": "from pathlib import Path\n\nimport pytest\n\nfrom paths import safe_join\n\n\ndef test_safe_join_allows_nested_relative_path(tmp_path):\n    root = tmp_path / 'root'\n    root.mkdir()\n    assert safe_join(root, 'logs/app.txt') == root.resolve() / 'logs/app.txt'\n\n\ndef test_safe_join_allows_root_relative_path(tmp_path):\n    root = tmp_path / 'root'\n    root.mkdir()\n    assert safe_join(root, '.') == root.resolve()\n\n\ndef test_safe_join_rejects_parent_traversal(tmp_path):\n    root = tmp_path / 'root'\n    root.mkdir()\n    with pytest.raises(ValueError):\n        safe_join(root, '../secret.txt')\n\n\ndef test_safe_join_rejects_absolute_path(tmp_path):\n    root = tmp_path / 'root'\n    root.mkdir()\n    with pytest.raises(ValueError):\n        safe_join(root, Path('/tmp/secret.txt'))\n\n\ndef test_safe_join_rejects_sibling_prefix_absolute_path(tmp_path):\n    root = tmp_path / 'root'\n    sibling = tmp_path / 'root-sibling'\n    root.mkdir()\n    sibling.mkdir()\n    with pytest.raises(ValueError):\n        safe_join(root, sibling / 'secret.txt')\n\n\ndef test_safe_join_rejects_symlink_escape(tmp_path):\n    root = tmp_path / 'root'\n    outside = tmp_path / 'outside'\n    root.mkdir()\n    outside.mkdir()\n    link = root / 'link'\n    try:\n        link.symlink_to(outside, target_is_directory=True)\n    except OSError:\n        pytest.skip('symlinks unavailable')\n    with pytest.raises(ValueError):\n        safe_join(root, 'link/secret.txt')\n"
+    }
+  },
+  "verification": {
+    "type": "command",
+    "command": "python -m pytest test_paths.py -q"
+  },
+  "limits": {
+    "timeout_seconds": 180,
+    "max_steps": 60
+  },
+  "tags": ["core", "python", "security", "deterministic"]
+}

pythinker_code/benchmark/bundled/tasks/smoke-add-small-function.json

@@ -0,0 +1,21 @@
+{
+  "id": "smoke-add-small-function",
+  "title": "Add Small Function",
+  "description": "Add a tiny function required by a deterministic check.",
+  "prompt": "Add a slugify(text) function to strings.py. It should lowercase text, strip leading/trailing whitespace, and replace spaces with hyphens.",
+  "workspace": {
+    "files": {
+      "strings.py": "",
+      "test_strings.py": "from strings import slugify\n\n\ndef test_slugify():\n    assert slugify(' Hello Benchmark ') == 'hello-benchmark'\n"
+    }
+  },
+  "verification": {
+    "type": "command",
+    "command": "python -m pytest test_strings.py -q"
+  },
+  "limits": {
+    "timeout_seconds": 120,
+    "max_steps": 30
+  },
+  "tags": ["smoke", "offline", "deterministic"]
+}

pythinker_code/benchmark/bundled/tasks/smoke-edit-readme.json

@@ -0,0 +1,20 @@
+{
+  "id": "smoke-edit-readme",
+  "title": "Edit README",
+  "description": "Update a README with a requested sentence.",
+  "prompt": "Update README.md to include a short sentence explaining that this project is used for a Pythinker benchmark smoke test.",
+  "workspace": {
+    "files": {
+      "README.md": "# Example Project\n\n"
+    }
+  },
+  "verification": {
+    "type": "command",
+    "command": "python - <<'PY'\nfrom pathlib import Path\ntext = Path('README.md').read_text(encoding='utf-8')\nassert 'Pythinker benchmark smoke test' in text\nPY"
+  },
+  "limits": {
+    "timeout_seconds": 120,
+    "max_steps": 30
+  },
+  "tags": ["smoke", "offline", "deterministic"]
+}

pythinker_code/benchmark/bundled/tasks/smoke-fix-python-test.json

@@ -0,0 +1,21 @@
+{
+  "id": "smoke-fix-python-test",
+  "title": "Fix Python Test",
+  "description": "Fix a small Python function so the included test passes.",
+  "prompt": "Fix calc.py so python -m pytest test_calc.py passes. Keep the change minimal.",
+  "workspace": {
+    "files": {
+      "calc.py": "def add(a, b):\n    return a - b\n",
+      "test_calc.py": "from calc import add\n\n\ndef test_add():\n    assert add(2, 3) == 5\n"
+    }
+  },
+  "verification": {
+    "type": "command",
+    "command": "python -m pytest test_calc.py -q"
+  },
+  "limits": {
+    "timeout_seconds": 120,
+    "max_steps": 30
+  },
+  "tags": ["smoke", "offline", "deterministic"]
+}