mtplx 2.2.0__tar.gz → 2.3.0__tar.gz

{mtplx-2.2.0 → mtplx-2.3.0}/CHANGELOG.md

@@ -4,6 +4,135 @@ All notable user-facing changes to MTPLX. The format is based on
 [Keep a Changelog](https://keepachangelog.com/en/1.1.0/); versions follow
 [Semantic Versioning](https://semver.org/).
 
+## [2.3.0] - 2026-07-21
+
+The agent reliability release: the #170 tool-argument collapse is
+root-caused and fixed, structured output ships with full speculative
+speed (community-contributed), agent sessions keep their warm cache
+through client history rewrites, and eight findings from an independent
+source review of v2.2.0 are fixed, each with a regression test that
+fails on the pre-fix code.
+
+### Fixed
+
+- Agent tool calls with nested arguments no longer collapse to empty `{}`
+  arguments (#170). The streaming Qwen-XML tool parser silently discarded
+  function-body text that was not wrapped in `<parameter=>` blocks, so a
+  model that wrote its arguments as a JSON object inside the
+  `<function=...>` envelope — the common slip on nested `edits` arrays —
+  produced a schema-valid call with empty arguments on requiredless tools
+  and a silently vanished call otherwise. Both the streaming and the final
+  parser now accept a pure JSON-object function body as the arguments
+  payload, and every unwrapped, lead, or trailing text lane is a loud
+  protocol fallback with identical contracts in the two parsers.
+- The injected tool contract no longer shows degenerate `[]` examples for
+  array parameters: exemplars are populated from the item schema's own
+  keys (an `edits` array renders as
+  `[{"search": "ARGUMENT_VALUE", "replace": "ARGUMENT_VALUE"}]`), removing
+  an in-prompt template for empty-array emissions.
+- The final tool-call extraction lane (non-stream parsing and the stream
+  fallback) no longer fabricates `{}`-argument calls out of function bodies
+  it could not read — live-reproduced on v2.2.0 as a `grep` call arriving
+  with empty arguments. All extraction dialects now share the strict
+  parsers' contract: a pure JSON-object function body is the arguments
+  payload, an unreadable body stays visible content, blank-body no-argument
+  calls still parse, and partial arguments are delivered exactly as the
+  model wrote them (schema validation remains the client's job, per the
+  OpenAI protocol).
+- Context-copy speculative rounds now stop accepting at the first
+  accepted stop token, exactly like the MTP acceptance loop. Previously
+  the copy lane could accept an entire block past a stop, leaving the
+  target cache, logits/hidden selection, and MTP history advanced beyond
+  the emitted response while the final state was still marked safe to
+  commit — a session-cache poisoning risk on recurrent (GDN) models.
+- Context-copy is prompt-only again at the boundary: proposal blocks are
+  sliced from the prompt and capped at its edge instead of running into
+  the model's own generated output (the self-repetition case the feature
+  contract excludes). Boundary-less candidates are skipped inside the
+  n-gram index so the best *valid* match still fires.
+- Non-divisor packed MTP quantization widths (5-bit, 3-bit, 6-bit) now
+  infer the correct group size via total-bit arithmetic (#182; fix by
+  @Jonathangadeaharder in #183). A 5-bit group-64 head previously
+  inferred group 60, overwrote the artifact's correct declared contract,
+  and made the model unloadable.
+- Long-running daemons no longer accumulate unbounded telemetry: the
+  SessionBank eviction log is a bounded ring, the scheduler's
+  started-by-batch-key counter collapses per-session key suffixes to
+  stable classes, the dashboard per-session TPS map is LRU-bounded, and
+  the OpenCode title fast path trims request metrics like every other
+  lane (#145-adjacent slow-creep hygiene).
+- The desktop Hugging Face probe now recognizes rootless assistant-pair
+  bundles (`mtplx_pair.json` + `target/config.json`) the same way the
+  Python runtime does, so the official Gemma4 pair repos classify as
+  ready to download instead of unreadable (#107); Forge routes them to
+  install-instead-of-rebuild.
+- `mtplx doctor --json` stdout is now guaranteed machine-parseable: the
+  report is built with stdout routed to stderr, so third-party lazy
+  importers that print() their errors (huggingface_hub does, whenever its
+  HTTP dependencies are broken or split across install locations) can no
+  longer prefix the JSON document with prose and break `--json` consumers.
+- Agent tool-loop sessions no longer lose their warm cache when the
+  client rewrites history (transcript compaction, retroactive tool-result
+  digests): a common-prefix identity fallback (≥4096 shared tokens and
+  ≥25% of the prompt) keeps the session id instead of minting an
+  anonymous one, ending the cold full-context re-prefills those
+  rotations caused mid-session.
+- Fan restore goes through the ThermalForge daemon socket instead of the
+  app-killing CLI path, and `mtplx pull` detects interrupted downloads
+  as incomplete instead of treating them as ready (thanks @titan550,
+  #178/#179/#180/#181).
+
+### Changed
+
+- `parallel_tool_calls` is now honored: a request that declares it gets
+  the declared behavior in both directions (false → at most one tool
+  call per turn), with the previous client-profile heuristic kept only
+  as the fallback when the field is absent (thanks @PhilipJohnBasile,
+  #190 — Android Studio declares false today and was being ignored).
+- Agent tool contract v13: instructs whole-file reads (the old
+  "smallest read range" clause provoked storms of 1-to-5-line
+  micro-reads) and forbids echoing file contents into visible text
+  (double-emitted file bodies inflated agent turns by tens of
+  thousands of characters). Measured on live agent sessions: thinking
+  share of generated tokens 75% → 6-29%, double emissions eliminated.
+
+### Added
+
+- Structured output: `response_format` `json_object` and `json_schema`
+  are now enforced with llguidance token masks instead of silently
+  ignored — and the grammar composes with the MTP verify loop, so
+  constrained requests keep full speculative speed (measured: decode
+  parity within noise, under 5ms total mask cost per request). On
+  thinking templates a prelude grammar lets reasoning finish before the
+  document is forced. Opt-in strict tool-call grammars
+  (`MTPLX_TOOL_CALL_STRICT=1`) force every tool call to a declared tool
+  name with schema-valid arguments — a real OpenCode session built a
+  complete project through the strict lane with zero malformed calls.
+  Thanks @PhilipJohnBasile (#186, #187, #188). Requires the `[server]`
+  extra, which the desktop app installs by default; bare pip installs
+  get a clear 400 with an install hint.
+- Durable per-request telemetry: `--request-log-jsonl` (env
+  `MTPLX_REQUEST_LOG_JSONL`) appends every request record as one JSON
+  line, and `scripts/session_forensics.py` correlates that log with an
+  OpenCode database into a single timeline with detectors for re-prefill
+  rewinds, TTFT stalls, thinking marathons, double emissions,
+  session-identity rotations, and usage mismatches.
+- An **opt-in** agent-lane reasoning budget (`--agent-thinking-budget`,
+  env `MTPLX_THINKING_BUDGET`; OFF by default): at the budget the
+  reasoning segment is force-closed with a visible bridge so the turn
+  proceeds to its answer or tool call, and every engagement is surfaced
+  per-request in telemetry (`thinking_guard`). Below the budget decoding
+  is bit-exact; plain chat is never touched.
+- Stream stall watchdog (#86 containment): if a stream receives nothing
+  while the model owner's progress heartbeat is frozen for
+  `MTPLX_STREAM_STALL_DEADLINE_S` (default 300s, 0 disables), the
+  request fails with a structured, diagnosable error and releases its
+  slot instead of hanging forever. Healthy long prefills and model loads
+  tick the heartbeat and are never affected; the daemon is never killed.
+- `pip install mtplx` now includes Pillow, matching the advertised image
+  support in the app and server (#103); previously vision failed at
+  import unless the `[server]` extra was installed.
+
 ## [2.2.0] - 2026-07-19
 
 The copy-drafting and small-Mac release. Decoding: context-copy

{mtplx-2.2.0 → mtplx-2.3.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: mtplx
-Version: 2.2.0
+Version: 2.3.0
 Summary: Native MTP speculative decoding for Qwen3-Next on Apple Silicon.
 Author-email: Youssof Altoukhi <business@youssofal.com>
 License-Expression: Apache-2.0
@@ -25,6 +25,7 @@ License-File: LICENSE
 License-File: NOTICE
 Requires-Dist: fastapi>=0.136
 Requires-Dist: huggingface-hub>=0.36
+Requires-Dist: pillow>=10
 Requires-Dist: mlx<0.33,>=0.31; sys_platform == "darwin" and platform_machine == "arm64"
 Requires-Dist: mlx-lm<0.32,>=0.31; sys_platform == "darwin" and platform_machine == "arm64"
 Requires-Dist: transformers!=5.13.0,<5.14; sys_platform == "darwin" and platform_machine == "arm64"
@@ -38,7 +39,7 @@ Provides-Extra: competitors
 Requires-Dist: dflash-mlx==0.1.0; extra == "competitors"
 Provides-Extra: server
 Requires-Dist: fastapi>=0.136; extra == "server"
-Requires-Dist: pillow>=10; extra == "server"
+Requires-Dist: llguidance>=1.7; extra == "server"
 Requires-Dist: uvicorn>=0.46; extra == "server"
 Provides-Extra: dev
 Requires-Dist: build>=1.2; extra == "dev"

{mtplx-2.2.0 → mtplx-2.3.0}/mtplx/artifacts.py

@@ -811,7 +811,6 @@ def _inspect_hf_model(repo_id: str) -> ModelInspection:
             config = dict(target_config)
             config["assistant_pair_bundle"] = pair_manifest
             config["mtplx_pair.json"] = True
-            config_path = target_path
             config_error = None
     if config is None:
         raise RuntimeError(

{mtplx-2.2.0 → mtplx-2.3.0}/mtplx/commands/public.py

@@ -2,6 +2,7 @@
 
 from __future__ import annotations
 
+import contextlib
 import hashlib
 import json
 import os
@@ -1828,6 +1829,22 @@ class _temporary_env:
 
 
 def cmd_doctor(args: Any) -> int:
+    # --json promises machine-parseable stdout. Probes import third-party
+    # packages whose lazy loaders print() import errors straight to stdout
+    # (huggingface_hub does, and a split/partially broken install makes it
+    # certain), which used to prefix the JSON document with prose and break
+    # every consumer. Build the whole report with stdout routed to stderr,
+    # then emit only the document.
+    if getattr(args, "json", False):
+        with contextlib.redirect_stdout(sys.stderr):
+            report = _build_doctor_report(args)
+        _print(report)
+        return 0
+    report = _build_doctor_report(args)
+    return _render_doctor_report(args, report)
+
+
+def _build_doctor_report(args: Any) -> dict[str, Any]:
     env = collect_environment(args.project_root).to_dict()
     from mtplx.hf_loader import hf_cache_report
     from mtplx.thermal import detect_thermal_control
@@ -1886,9 +1903,11 @@ def cmd_doctor(args: Any) -> int:
             output_dir=getattr(args, "output_dir", None),
             include_paths=bool(getattr(args, "include_paths", False)),
         )
-    if getattr(args, "json", False):
-        _print(report)
-    elif getattr(args, "summary", False):
+    return report
+
+
+def _render_doctor_report(args: Any, report: dict[str, Any]) -> int:
+    if getattr(args, "summary", False):
         diagnostics = report["diagnostics"]
         print(f"MTPLX doctor: {diagnostics['overall']}")
         for check in diagnostics["checks"]:
@@ -2066,7 +2085,6 @@ def cmd_stop_public(args: Any) -> int:
     """Stop a running MTPLX server via its health-reported pid."""
 
     from mtplx.daemon_client import (
-        DAEMON_PROBE_PORTS,
         probe_running_daemons,
         stop_daemon,
     )
@@ -10420,7 +10438,6 @@ def _quickstart_openwebui_payload(
     port = int(getattr(args, "port", 8000))
     model_id = _public_model_id_for_args(args, str(getattr(args, "model", "")))
     base = f"http://{_connect_host_for_bind(host)}:{port}"
-    profile = str(getattr(args, "profile", None) or DEFAULT_PROFILE_NAME)
     context_window = _inspection_context_window(inspection)
     return {
         "integration": "openwebui",