@aefree/pi-unity 0.13.0 → 0.14.0

package/CHANGELOG.md

@@ -7,6 +7,15 @@ and this project follows semantic versioning for public package releases.
 
 ## Unreleased
 
+## 0.14.0 - 2026-09-14
+
+### Fixed
+
+- Preserve durable normalized connected-test evidence for terminal failed, cancelled, runner-error, and incomplete Pipeline results without replaying dispatch, overriding active Pipeline state from partial records, or misreporting inconsistent counts/records as passing.
+- Select one primary latest normalized result and only its validated project-contained backend links when inspecting historical artifacts, including canonical contained aliases.
+- Forward optional `unity_pipeline_eval.handlerTimeoutMilliseconds` only when the exact reachable Pipeline descriptor confirms raw argv support and the documented `code`/`timeout` signature. Preserve `timeoutSeconds` as the separate host/CLI wait; a dispatcher expiry cannot cancel eval code already started on Unity's main thread, so effects remain uncertain and are never retried or rerouted.
+- Treat Pipeline 0.7's explicit `compilationFailed: true` response as a failed recompile even when its status is `up_to_date` or `completed` and no compiler-error array is present.
+
 ## 0.13.0 - 2026-09-10
 
 ### Added

package/README.md

@@ -34,13 +34,13 @@ Use these tools with an already-open exact Unity project copy that has a reachab
 - `unity_project_status` — inspect lockfiles, matching Unity processes, Pipeline reachability, package version, and advertised commands without launching Unity.
 - `unity_pipeline_recompile` — recompile through Pipeline with exact-copy preflight, bounded polling, and compact compiler evidence.
 - `unity_run_tests` — one intent-oriented EditMode or PlayMode workflow. It reuses compatible connected Pipeline execution or selects isolated `unity test` when the exact project copy is closed.
-- `unity_pipeline_eval` — execute bounded project-specific C# through Pipeline's Roslyn REPL. It accepts `timeoutSeconds` from 1–86,400 seconds; a timeout is uncertain and does not cancel or retry Editor work.
+- `unity_pipeline_eval` — execute bounded project-specific C# through Pipeline's Roslyn REPL. `timeoutSeconds` bounds pi-unity and Unity CLI waits (1–86,400 seconds). Optional `handlerTimeoutMilliseconds` is forwarded only when the exact reachable Pipeline advertises raw argv plus the verified eval timeout signature; it bounds that Pipeline dispatcher wait, not code already running on Unity's main thread. A timeout is uncertain and does not cancel or retry Editor work.
 - `unity_pipeline_inspect` — dispatch supported package-owned inspection commands (including read-only `get_runtime_pipeline_settings`) and return structured evidence. Runtime settings are refused by Pipeline in Play Mode; pi-unity never exits Play Mode to read them.
 - `unity_pipeline_run_script` — compile one existing project `.cs` file in Pipeline's ephemeral in-memory mode and invoke a named static entry point; supports bounded JSON arguments and compile-only `dryRun`. It deliberately does not expose hotpatch.
 
 Connected recompilation follows Unity's Script Changes While Playing policy and never preemptively sends `editor_stop`. Connected tests may exit Play Mode through advertised `editor_stop` when necessary, then verify Edit Mode before dispatch. Play Mode exit is allowed by default; `/unity-playmode-exit allow|disallow|status` controls the current session.
 
-A timeout is uncertain: work may still be running. The tools do not silently cancel, retry, launch another Editor, or switch to batchmode. Pipeline 0.6 can report busy for a modal dialog as well as startup settling, so ambiguous busy responses are surfaced and never blindly retried.
+A timeout is uncertain: work may still be running. The tools do not silently cancel, retry, launch another Editor, or switch to batchmode. Pipeline 0.6 can report busy for a modal dialog as well as startup settling, so ambiguous busy responses are surfaced and never blindly retried. Pipeline 0.7 improves recovery of standing compile errors and console output. For non-development Player builds, Pipeline also requires the `ENABLE_RUNTIME_PIPELINE` scripting define; enabling its runtime setting alone is insufficient.
 
 ### Editor and batchmode
 
@@ -48,7 +48,7 @@ A timeout is uncertain: work may still be running. The tools do not silently can
 - `unity_launch_batchmode` — run a bounded batchmode command through Unity CLI or the direct Editor executable.
 - `unity_inspect_artifacts` — validate existing normalized JSON test artifacts, Unity Test Framework XML and Unity logs without launching Unity. `details.status` describes inspection; `details.testOutcome` describes the tests, including failures and uncertainty. A valid failed-test artifact is a successful inspection, not a passing run.
 
-Pass `normalizedResultPath` for standalone JSON evidence. Any explicit artifact path disables implicit latest-file selection; missing requested files fail inspection. With all paths omitted, `latestFromLogs` discovers recent files but cannot establish current-run identity. Mixed JSON/XML evidence must agree; without an explicit native artifact link, matching counts alone leave correlation uncertain.
+Pass `normalizedResultPath` for standalone JSON evidence. Any explicit artifact path disables implicit latest-file selection and link expansion; missing requested files fail inspection. With all paths omitted, `latestFromLogs` selects one newest top-level JSON (mtime then filename) and only its contained declared NUnit/log links. Without JSON it selects XML alone, then log context. Historical selection cannot establish current-run identity. Mixed JSON/XML evidence must agree; without an explicit native artifact link, matching counts alone leave correlation uncertain.
 
 Use `unity_run_tests` for all ordinary Unity Test Framework work. It writes a durable normalized JSON result under `Logs/`; isolated `unity test` runs retain requested native reports. Connected Pipeline is selected only for compatible requests. A reachable Editor is never closed automatically to obtain isolated-only features.
 
@@ -113,6 +113,8 @@ Another connected client is not a project lock. When Pipeline returns stable cor
 { code: "var s = UnityEngine.Application.dataPath; return s.Length;" }
 ```
 
+`timeoutSeconds` remains the host/CLI wait. On exact copies that advertise raw argv and the verified eval `code`/integer-`timeout` signature, `handlerTimeoutMilliseconds` (1–86,400,000) also sets Pipeline's dispatcher wait through its positional command argument. A shorter host timeout may still win. This server wait can prevent queued work from starting, but cannot cancel eval code that already began on Unity's main thread; treat expiry as uncertain and never retry or fall back.
+
 Use `unity_pipeline_inspect` when a purpose-built structured command fits. Use eval for bounded project-specific work that matches the user's intent. Prefer typed tools when they provide stronger lifecycle, polling, validation, or recovery semantics.
 
 ### Pipeline run_script

package/index.ts

@@ -1,8 +1,8 @@
 import { keyHint, type ExtensionAPI, type ExtensionContext } from "@earendil-works/pi-coding-agent";
 import { StringEnum } from "@earendil-works/pi-ai";
 import { Type } from "typebox";
-import { mkdir, readFile, readdir, stat, unlink } from "node:fs/promises";
-import { dirname, isAbsolute, join, resolve } from "node:path";
+import { mkdir, readFile, readdir, realpath, stat, unlink } from "node:fs/promises";
+import { dirname, isAbsolute, join, relative, resolve } from "node:path";
 import { setTimeout as delay } from "node:timers/promises";
 import { getKeybindings, Text, truncateToWidth } from "@earendil-works/pi-tui";
 import {
@@ -32,7 +32,7 @@ import { applyUnityCliRetrySummary, compactUnityTestSummary, defaultUnityTestRep
 import { validateNormalizedUnityTestArtifact } from "./src/unity-artifact-inspection";
 import { UNITY_TEST_MAX_ARTIFACT_BYTES } from "./src/unity-tests";
 import { auditUnityGuidance, type UnityGuidanceAuditResult } from "./src/unity-guidance-audit";
-import { runUnityPipelineRecompile, runUnityPipelineTests, type UnityPipelineOperationDetails } from "./src/unity-pipeline";
+import { runUnityPipelineRecompile, runUnityPipelineTests, UnityPipelineTerminalTestEvidenceError, type UnityPipelineOperationDetails } from "./src/unity-pipeline";
 import {
   createOptionalIntegrationRegistryV1,
   isOptionalIntegrationActive,
@@ -103,6 +103,9 @@ type UnityToolDetails = {
   pipelineEval?: { outcome: "dispatched"; command: string; output: string; truncated: boolean } | { outcome: "rejected"; code: string; message: string };
   pipelineRunScript?: { outcome: "dispatched"; command: string; output: string; truncated: boolean } | { outcome: "rejected"; code: string; message: string };
   pipeline?: UnityPipelineOperationDetails;
+  testResult?: NormalizedUnityTestResult;
+  artifactPath?: string;
+  route?: "connected" | "isolated";
 };
 
 const LAUNCHER_SCHEMA = Type.Optional(StringEnum(["auto", "unity-cli", "editor-executable"] as const, { description: "Launch backend. Defaults to auto, which prefers the Unity CLI and falls back to direct editor executable launch when the CLI is unavailable." }));
@@ -165,7 +168,8 @@ const PIPELINE_TEST_PARAMS = Type.Object({
 const PIPELINE_EVAL_PARAMS = Type.Object({
   path: Type.Optional(Type.String({ maxLength: 1000, description: "Unity project path, workspace copy root, or folder containing project copies." })),
   code: Type.String({ minLength: 1, maxLength: 4000, description: "Bounded C# source for advertised Pipeline eval. Roslyn compiles it on the connected Editor main thread; include an explicit return value when evidence is needed." }),
-  timeoutSeconds: Type.Optional(Type.Integer({ minimum: 1, maximum: 86400, default: 12, description: "Connected eval deadline in seconds (maximum 24 hours). A timeout is uncertain and does not retry or cancel Unity work." })),
+  timeoutSeconds: Type.Optional(Type.Integer({ minimum: 1, maximum: 86400, default: 12, description: "Connected eval host/CLI deadline in seconds (maximum 24 hours). A timeout is uncertain and does not retry or cancel Unity work." })),
+  handlerTimeoutMilliseconds: Type.Optional(Type.Integer({ minimum: 1, maximum: 86400000, description: "Optional advertised Pipeline eval dispatcher wait in milliseconds. Forwarded only when the exact copy advertises raw argv and the verified code/timeout signature; it cannot cancel code already started on Unity's main thread." })),
 }, { additionalProperties: false });
 
 const PIPELINE_RUN_SCRIPT_PARAMS = Type.Object({
@@ -196,7 +200,7 @@ const INSPECT_ARTIFACTS_PARAMS = Type.Object({
   testResultsPath: Type.Optional(Type.String({ description: "Unity Test Framework XML results path. Relative paths are resolved against cwd and the Unity project root." })),
   normalizedResultPath: Type.Optional(Type.String({ description: "pi-unity normalized JSON test artifact path." })),
   logFilePath: Type.Optional(Type.String({ description: "Unity log file path. Relative paths are resolved against cwd and the Unity project root." })),
-  latestFromLogs: Type.Optional(Type.Boolean({ default: true, description: "Only when all artifact paths are omitted, inspect the newest .json, .xml and .log files under Logs. Latest files are not proof of a shared run." })),
+  latestFromLogs: Type.Optional(Type.Boolean({ default: true, description: "Only when all artifact paths are omitted, select one newest top-level Logs JSON (mtime then filename) and only its declared contained NUnit/log links. Without JSON, select newest XML alone, otherwise newest log context. Latest files are not proof of a shared run." })),
   maxLines: Type.Optional(Type.Integer({ minimum: 1, maximum: 500, default: 60, description: "Maximum log/output lines to include." })),
   maxChars: Type.Optional(Type.Integer({ minimum: 500, maximum: 20000, default: 6000, description: "Maximum log/output characters to include." })),
 });
@@ -686,8 +690,9 @@ async function findNewestFile(root: string, suffixes: string[]): Promise<string
   let entries: Awaited<ReturnType<typeof readdir>>;
   try {
     entries = await readdir(root, { withFileTypes: true });
-  } catch {
-    return undefined;
+  } catch (error) {
+    if ((error as NodeJS.ErrnoException).code === "ENOENT") return undefined;
+    throw error;
   }
 
   const files = await Promise.all(entries
@@ -697,7 +702,16 @@ async function findNewestFile(root: string, suffixes: string[]): Promise<string
       const stats = await stat(fullPath);
       return { fullPath, mtimeMs: stats.mtimeMs };
     }));
-  return files.sort((left, right) => right.mtimeMs - left.mtimeMs)[0]?.fullPath;
+  return files.sort((left, right) => right.mtimeMs - left.mtimeMs || left.fullPath.localeCompare(right.fullPath))[0]?.fullPath;
+}
+
+async function resolveLinkedArtifact(projectRoot: string, linkPath: string): Promise<string> {
+  const canonicalRoot = await realpath(projectRoot);
+  const candidate = resolve(projectRoot, linkPath);
+  const canonicalCandidate = await realpath(candidate);
+  const relativePath = relative(canonicalRoot, canonicalCandidate);
+  if (!relativePath || isAbsolute(relativePath) || relativePath === ".." || relativePath.startsWith(`..${process.platform === "win32" ? "\\" : "/"}`)) throw new Error(`Linked artifact escapes the project root: ${linkPath}`);
+  return canonicalCandidate;
 }
 
 function resolveArtifactPath(cwd: string, projectRoot: string, value: string | undefined): string | undefined {
@@ -726,12 +740,14 @@ async function buildArtifactInspectionReport(
   // An exact artifact request must not silently recruit unrelated latest evidence.
   const useLatest = params.latestFromLogs !== false && ![params.testResultsPath, params.logFilePath, params.normalizedResultPath].some(value => value?.trim());
   const logsRoot = join(candidate.projectRoot, "Logs");
-  const testResultsPath = resolveArtifactPath(ctx.cwd, candidate.projectRoot, params.testResultsPath)
-    ?? (useLatest ? await findNewestFile(logsRoot, [".xml"]) : undefined);
-  const logFilePath = resolveArtifactPath(ctx.cwd, candidate.projectRoot, params.logFilePath)
-    ?? (useLatest ? await findNewestFile(logsRoot, [".log", ".txt"]) : undefined);
+  let testResultsPath = resolveArtifactPath(ctx.cwd, candidate.projectRoot, params.testResultsPath);
+  let logFilePath = resolveArtifactPath(ctx.cwd, candidate.projectRoot, params.logFilePath);
   const normalizedResultPath = resolveArtifactPath(ctx.cwd, candidate.projectRoot, params.normalizedResultPath)
     ?? (useLatest ? await findNewestFile(logsRoot, [".json"]) : undefined);
+  if (useLatest && !normalizedResultPath) {
+    testResultsPath = await findNewestFile(logsRoot, [".xml"]);
+    if (!testResultsPath) logFilePath = await findNewestFile(logsRoot, [".log", ".txt"]);
+  }
   let normalized: NormalizedUnityTestResult | undefined;
   const evidenceErrors: string[] = [];
   const evidenceWarnings: string[] = [];
@@ -739,6 +755,11 @@ async function buildArtifactInspectionReport(
     try {
       if ((await stat(normalizedResultPath)).size > UNITY_TEST_MAX_ARTIFACT_BYTES) throw new Error("Normalized artifact exceeds its size limit.");
       normalized = validateNormalizedUnityTestArtifact(JSON.parse(await readFile(normalizedResultPath, "utf8")));
+      // Stored backend links, not unrelated directory recency, are the only automatic companions.
+      if (useLatest) {
+        if (normalized.backendArtifacts?.nunit) testResultsPath = await resolveLinkedArtifact(candidate.projectRoot, normalized.backendArtifacts.nunit);
+        if (normalized.backendArtifacts?.log) logFilePath = await resolveLinkedArtifact(candidate.projectRoot, normalized.backendArtifacts.log);
+      }
     } catch (error) {
       evidenceErrors.push(`Normalized test result could not be loaded/validated: ${normalizedResultPath}: ${error instanceof Error ? error.message : String(error)}`);
     }
@@ -769,7 +790,13 @@ async function buildArtifactInspectionReport(
     }
     if ((normalized.outcome === "passed" || normalized.outcome === "passed_with_flakes") && parsedTestResults.failedTests.length > 0) evidenceErrors.push("Conflicting normalized/XML evidence: XML contains failed tests.");
     const linkedXml = normalized.backendArtifacts?.nunit;
-    if (linkedXml && resolve(candidate.projectRoot, linkedXml) !== resolve(testResultsPath!)) evidenceErrors.push("Conflicting artifact identity: selected XML is not the normalized artifact's nunit path.");
+    if (linkedXml && testResultsPath) {
+      try {
+        if (await resolveLinkedArtifact(candidate.projectRoot, linkedXml) !== await realpath(testResultsPath)) evidenceErrors.push("Conflicting artifact identity: selected XML is not the normalized artifact's nunit path.");
+      } catch (error) {
+        evidenceErrors.push(`Normalized NUnit link could not be resolved: ${linkedXml}: ${error instanceof Error ? error.message : String(error)}`);
+      }
+    }
     if (!linkedXml) {
       evidenceWarnings.push("Normalized JSON and XML have no shared run identity; matching counts alone do not correlate these files.");
       testOutcome = "uncertain";
@@ -1230,7 +1257,25 @@ async function runUnifiedUnityTests(
   }
   const formats = request.reportFormats ?? defaultUnityTestReportFormats(route);
   if (route === "connected") {
-    const result = await runUnityPipelineTests({ projectRoot: candidate.projectRoot, unityVersion: await requireManualUnityVersion(candidate), testPlatform: request.testPlatform, testFilter: request.testFilters[0], testCategory: request.testCategories[0], timeoutSeconds: request.timeoutSeconds, allowAutonomousExitPlayMode }, createPipelineDependencies(pi), { signal, onUpdate: message => onUpdate?.({ content: [{ type: "text", text: message }] }) });
+    let result;
+    try {
+      result = await runUnityPipelineTests({ projectRoot: candidate.projectRoot, unityVersion: await requireManualUnityVersion(candidate), testPlatform: request.testPlatform, testFilter: request.testFilters[0], testCategory: request.testCategories[0], timeoutSeconds: request.timeoutSeconds, allowAutonomousExitPlayMode }, createPipelineDependencies(pi), { signal, onUpdate: message => onUpdate?.({ content: [{ type: "text", text: message }] }) });
+    } catch (error) {
+      if (!(error instanceof UnityPipelineTerminalTestEvidenceError)) throw error;
+      const outcome = error.evidence.outcome;
+      const normalized: NormalizedUnityTestResult = {
+        schemaVersion: 1, source: "pipeline", platform: request.testPlatform,
+        selection: { testFilters: request.testFilters, testCategories: request.testCategories },
+        durationSeconds: error.evidence.elapsedSeconds, outcome, summary: {}, tests: error.evidence.testRecords,
+        diagnostics: [error.evidence.reason, ...error.evidence.observations, ...error.evidence.warnings].slice(0, 8),
+      };
+      let artifactPath: string;
+      try { artifactPath = await writeNormalizedUnityTestArtifact(candidate.projectRoot, normalized); } catch (persistenceError) {
+        throw new Error(`${error.evidence.reason} Durable terminal evidence could not be persisted: ${persistenceError instanceof Error ? persistenceError.message : String(persistenceError)}`);
+      }
+      const text = `${compactUnityTestSummary(normalized)}\nRoute: connected Pipeline. Terminal evidence was incomplete or non-passing; no retry, fallback, or replay was performed. Normalized artifact: ${artifactPath}`;
+      return { content: [{ type: "text", text }], details: { mode: "tests", projectRoot: candidate.projectRoot, unityVersion: await requireManualUnityVersion(candidate), editorPath: "", status: "failed", testResult: { ...normalized, tests: [] }, artifactPath, route } };
+    }
     const counts = result.details.counts!;
     const normalized: NormalizedUnityTestResult = {
       schemaVersion: 1, source: "pipeline", platform: request.testPlatform,
@@ -1404,7 +1449,8 @@ export default function freeUnityPi(pi: ExtensionAPI) {
     const details = event.details as UnityToolDetails | undefined;
     if ((event.toolName === "unity_pipeline_eval" && details?.mode === "pipeline_eval" && details.pipelineEval?.outcome === "rejected")
       || (event.toolName === "unity_pipeline_inspect" && details?.mode === "pipeline_inspection" && details.pipelineInspection?.outcome === "rejected")
-      || (event.toolName === "unity_pipeline_run_script" && details?.mode === "pipeline_run_script" && details.pipelineRunScript?.outcome === "rejected")) {
+      || (event.toolName === "unity_pipeline_run_script" && details?.mode === "pipeline_run_script" && details.pipelineRunScript?.outcome === "rejected")
+      || (event.toolName === "unity_run_tests" && details?.mode === "tests" && details.testResult?.outcome !== "passed" && details.testResult?.outcome !== "passed_with_flakes" && details.testResult?.outcome !== "empty_selection")) {
       return { isError: true };
     }
   });
@@ -1667,12 +1713,13 @@ export default function freeUnityPi(pi: ExtensionAPI) {
   pi.registerTool({
     name: "unity_pipeline_eval",
     label: "Unity Pipeline Eval",
-    description: "Execute one bounded C# snippet through advertised eval in an already-open exact Unity Pipeline Editor.",
+    description: "Execute one bounded C# snippet through advertised eval in an already-open exact Unity Pipeline Editor. timeoutSeconds bounds pi-unity and Unity CLI waits; optional handlerTimeoutMilliseconds is forwarded only through a verified Pipeline raw-argv timeout contract and cannot cancel code already started on Unity's main thread.",
     promptSnippet: "Query or operate on an already-open exact Unity project through Pipeline's Roslyn C# REPL.",
     promptGuidelines: [
       "Use unity_pipeline_eval for project-specific properties, APIs, and operations that advertised typed commands do not cover. It revalidates exact-copy identity and advertised eval immediately before dispatch.",
       "Pipeline eval compiles arbitrary C# with Roslyn on the Editor main thread. Include an explicit return value for observable evidence; normal property reads and local-variable snippets are supported.",
       "Eval is not statically read-only. Follow user intent and project guidance, and obtain explicit authorization before lifecycle, persistent-setting, destructive, asset, scene-save, package, build, or test mutations.",
+      "timeoutSeconds bounds the host and Unity CLI wait. When supplied, handlerTimeoutMilliseconds bounds only the verified Pipeline dispatcher wait; a shorter host deadline may still win, and a server wait expiry cannot cancel code already started on Unity's main thread.",
       "A rejected, malformed, failing, or timed-out eval is not success; do not silently retry it through another route.",
     ],
     parameters: PIPELINE_EVAL_PARAMS,
@@ -1685,6 +1732,7 @@ export default function freeUnityPi(pi: ExtensionAPI) {
         unityVersion: await requireManualUnityVersion(candidate),
         command: "eval",
         evalSnippet: params.code,
+        handlerTimeoutMilliseconds: params.handlerTimeoutMilliseconds,
       }, {
         execute: createPlanningUnityCliExecutor(pi),
         signal,
@@ -1804,7 +1852,7 @@ export default function freeUnityPi(pi: ExtensionAPI) {
       "Use unity_inspect_artifacts after Unity failures when existing -testResults or -logFile artifacts need concise parsing without another Unity launch.",
       "Prefer unity_inspect_artifacts over ad hoc bash parsing of Unity XML/log files when paths are known or Logs/ contains recent artifacts.",
       "unity_inspect_artifacts does not launch Unity and is safe to use even when the Unity project is busy.",
-      "Inspect details.testOutcome, not inspection status, for test success. Passing evidence needs consistent positive passing counts; missing explicit paths and conflicting artifacts fail inspection. Latest files are not current-run identity.",
+      "Inspect details.testOutcome, not inspection status, for test success. Passing evidence needs consistent positive passing counts; missing explicit paths and conflicting artifacts fail inspection. With all paths omitted, latest selection uses one JSON and its contained declared links, otherwise XML alone then log context; explicit paths disable selection/link expansion. Latest files are not current-run identity.",
     ],
     parameters: INSPECT_ARTIFACTS_PARAMS,
     async execute(_toolCallId, params, signal, _onUpdate, ctx) {

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@aefree/pi-unity",
-  "version": "0.13.0",
+  "version": "0.14.0",
   "type": "module",
   "exports": {
     ".": "./index.ts"
@@ -18,7 +18,7 @@
     ]
   },
   "scripts": {
-    "test": "tsx tests/unity-core.test.ts && tsx tests/unity-launch.test.ts && tsx tests/unity-pipeline.test.ts && tsx tests/unity-processes.test.ts && tsx tests/pi-unity-settings.test.ts && tsx tests/unity-projects.test.ts && tsx tests/unity-guidance-audit.test.ts && tsx tests/unity-batchmode.test.ts && tsx tests/unity-test-batch.test.ts && tsx tests/unity-tests.test.ts && tsx tests/unity-cli.test.ts && tsx tests/unity-project-lock.test.ts && tsx tests/unity-artifact-profile.test.ts && tsx tests/unity-file-discovery-filter.test.ts && tsx tests/unity-registration.test.ts && tsx tests/unity-optional-integrations.test.ts && tsx tests/unity-package-validation.test.ts",
+    "test": "tsx tests/unity-core.test.ts && tsx tests/unity-launch.test.ts && tsx tests/unity-pipeline.test.ts && tsx tests/unity-processes.test.ts && tsx tests/pi-unity-settings.test.ts && tsx tests/unity-projects.test.ts && tsx tests/unity-guidance-audit.test.ts && tsx tests/unity-batchmode.test.ts && tsx tests/unity-test-batch.test.ts && tsx tests/unity-tests.test.ts && tsx tests/unity-cli.test.ts && tsx tests/unity-project-lock.test.ts && tsx tests/unity-artifact-profile.test.ts && tsx tests/unity-file-discovery-filter.test.ts && tsx tests/unity-registration.test.ts && tsx tests/unity-optional-integrations.test.ts && tsx tests/release-registry-preflight.test.ts && tsx tests/unity-package-validation.test.ts",
     "eval:guidance-skill": "tsx evals/auditing-unity-agent-guidance/run-eval.ts"
   },
   "dependencies": {

package/skills/unity-pipeline-workflows/SKILL.md

@@ -67,4 +67,4 @@ Normally call the typed tools, not raw CLI commands. If a typed tool is unavaila
 
 Use `unity_run_tests` with `execution: "isolated"` for a closed project, intentional isolation/CI, multiple selectors in one run, retries, sharding, coverage, or required NUnit/JUnit evidence. Multiple independent fixtures alone do not require closing a reachable Editor: use the serial recipe above. A single category is supported connected when Pipeline advertises the command; do not claim broader connected selector support. Do not use batchmode as an automatic fallback after an uncertain connected dispatch.
 
-Use the typed compile/test tools when their polling and terminal evidence fit the task. For an explicitly requested existing C# builder file, `unity_pipeline_run_script` uses Pipeline 0.6 ephemeral in-memory compilation with bounded JSON arguments or compile-only dry run; it never enables hotpatch and remains arbitrary code execution requiring explicit mutation authorization. Advertised Pipeline `eval` remains available through `unity_pipeline_eval` for bounded project-specific inspection or operations outside those typed workflows; its `timeoutSeconds` range is 1–86,400 seconds, and a timeout remains uncertain without cancellation or retry. It is an assistance surface, not a forbidden fallback or a substitute for the typed tools' completion protocol. Eval compiles arbitrary C# with Roslyn on the Editor main thread, so ordinary properties and local-variable snippets are valid; it is not expression-only or reliably statically read-only. Prefer typed tools for their stronger evidence, but let user intent and project guidance govern mutations. Lifecycle, persistent-setting, destructive, asset, scene-save, package, build, and test mutations require explicit authorization.
+Use the typed compile/test tools when their polling and terminal evidence fit the task. For an explicitly requested existing C# builder file, `unity_pipeline_run_script` uses Pipeline 0.6 ephemeral in-memory compilation with bounded JSON arguments or compile-only dry run; it never enables hotpatch and remains arbitrary code execution requiring explicit mutation authorization. Advertised Pipeline `eval` remains available through `unity_pipeline_eval` for bounded project-specific inspection or operations outside those typed workflows. Its `timeoutSeconds` range is 1–86,400 seconds and bounds pi-unity/Unity CLI waits. Optional `handlerTimeoutMilliseconds` (1–86,400,000) is forwarded only when the exact reachable Pipeline advertises raw argv and the verified eval `code`/integer-`timeout` signature; it bounds Pipeline's dispatcher wait, while a shorter host wait can still win. A dispatcher expiry cannot cancel code already started on Unity's main thread, so the effect remains uncertain and no retry or fallback is allowed. It is an assistance surface, not a forbidden fallback or a substitute for the typed tools' completion protocol. Eval compiles arbitrary C# with Roslyn on the Editor main thread, so ordinary properties and local-variable snippets are valid; it is not expression-only or reliably statically read-only. Prefer typed tools for their stronger evidence, but let user intent and project guidance govern mutations. Lifecycle, persistent-setting, destructive, asset, scene-save, package, build, and test mutations require explicit authorization.

package/src/unity-artifact-inspection.ts

@@ -9,6 +9,16 @@ const strings = (value: unknown): value is string[] => Array.isArray(value) && v
 const relativeId = (value: unknown): value is string => typeof value === "string" && !!value.trim()
   && !isAbsolute(value) && !/^(?:[A-Za-z]:|[\\/])/.test(value) && !value.split(/[\\/]/).includes("..") && !/\0/.test(value);
 
+/** Shared count/retained-record invariant for durable validation and Pipeline pass acceptance. */
+export function hasConsistentUnityTestCounts(summary: Record<string, unknown>, tests: Array<{ status: string }>): boolean {
+  const total = summary.total; const passed = summary.passed; const failed = summary.failed;
+  const skipped = summary.skipped; const inconclusive = summary.inconclusive;
+  if (![total, passed, failed, skipped, inconclusive].every(value => value === undefined || count(value))) return false;
+  if (count(total) && [passed, failed, skipped, inconclusive].reduce<number>((sum, value) => sum + (count(value) ? value : 0), 0) > total) return false;
+  if (count(total) && tests.length > total) return false;
+  return [["passed", passed], ["failed", failed], ["skipped", skipped], ["inconclusive", inconclusive]].every(([status, limit]) => !count(limit) || tests.filter(test => status === "passed" ? /^(?:passed|success)$/i.test(test.status) : test.status.toLowerCase() === status).length <= limit);
+}
+
 /** Read the durable schema, not a transport response. Missing optional counts remain unknown.
  * Test records may be bounded or absent: never require tests.length === summary.total.
  */
@@ -25,10 +35,7 @@ export function validateNormalizedUnityTestArtifact(value: unknown): NormalizedU
   for (const key of ["total", "passed", "failed", "skipped", "inconclusive"]) {
     if (summary[key] !== undefined && !count(summary[key])) invalid(`summary.${key} must be a non-negative integer`);
   }
-  if (count(summary.total)) {
-    const accounted = [summary.passed, summary.failed, summary.skipped, summary.inconclusive].reduce<number>((sum, item) => sum + (count(item) ? item : 0), 0);
-    if (accounted > summary.total) invalid("summary counts exceed total");
-  }
+  if (!hasConsistentUnityTestCounts(summary, [])) invalid("summary counts are inconsistent");
   if (!Array.isArray(result.tests)) invalid("tests must be an array");
   const tests = result.tests as unknown[];
   for (const test of tests) {
@@ -38,14 +45,11 @@ export function validateNormalizedUnityTestArtifact(value: unknown): NormalizedU
     if (item.durationSeconds !== undefined && !nonnegative(item.durationSeconds)) invalid("test durationSeconds must be non-negative");
     if (item.attempts !== undefined && (!count(item.attempts) || item.attempts < 1)) invalid("test attempts must be positive");
   }
-  if (count(summary.total) && tests.length > summary.total) invalid("test records exceed total");
+  if (!hasConsistentUnityTestCounts(summary, tests as Array<{ status: string }>)) invalid("test records conflict with summary counts");
   const typed = result as unknown as NormalizedUnityTestResult;
-  for (const [status, key] of [["passed", "passed"], ["failed", "failed"], ["skipped", "skipped"], ["inconclusive", "inconclusive"]] as const) {
-    const observed = typed.tests.filter(test => test.status.toLowerCase() === status).length;
-    if (count(summary[key]) && observed > summary[key]) invalid(`test records conflict with summary.${key}`);
-  }
   if (result.projectRelativeId !== undefined && !relativeId(result.projectRelativeId)) invalid("projectRelativeId must be project-relative");
   if (result.backendArtifacts !== undefined && (!record(result.backendArtifacts) || !Object.values(result.backendArtifacts).every(relativeId))) invalid("backendArtifacts must contain project-relative paths");
+  if (result.diagnostics !== undefined && (!Array.isArray(result.diagnostics) || result.diagnostics.length > 8 || !result.diagnostics.every(item => typeof item === "string" && !!item.trim() && item.length <= 1_000))) invalid("diagnostics must contain at most eight bounded strings");
   for (const key of ["startedAt", "completedAt"]) if (result[key] !== undefined && (typeof result[key] !== "string" || !Number.isFinite(Date.parse(result[key] as string)))) invalid(`${key} must be a timestamp`);
   if (typed.startedAt && typed.completedAt && Date.parse(typed.completedAt) < Date.parse(typed.startedAt)) invalid("completion precedes start");
   if (result.durationSeconds !== undefined && !nonnegative(result.durationSeconds)) invalid("durationSeconds must be non-negative");

package/src/unity-cli.ts

@@ -46,6 +46,13 @@ export type UnityCliPipelineInstance = {
 
 export type UnityCliDiscoveryState = "not_attempted" | "available" | "absent" | "timeout" | "unavailable";
 
+export type UnityCliCommandParameter = {
+  name: string;
+  type: string;
+  required: boolean;
+  defaultValue?: unknown;
+};
+
 export type UnityCliProjectCapabilities = {
   cliAvailable: boolean;
   cliVersion?: string;
@@ -56,6 +63,12 @@ export type UnityCliProjectCapabilities = {
   advertisedCommands: string[];
   advertisedCommandCount: number;
   advertisedCommandsTruncated: boolean;
+  /** Display-oriented command descriptors. They are never capability evidence. */
+  advertisedCommandParameters?: Record<string, readonly UnityCliCommandParameter[]>;
+  /** Complete, bounded, unambiguous descriptors eligible for exact capability gates. */
+  verifiedCommandParameters?: Record<string, readonly UnityCliCommandParameter[]>;
+  /** True only when the exact live Pipeline descriptor advertises raw argv support. */
+  pipelineSupportsExecArgv?: boolean;
   commandDiscoveryAttempted: boolean;
   commandDiscoverySucceeded: boolean;
   latestPipelineVersion?: string;
@@ -346,10 +359,16 @@ export function parseUnityCliPipelineListOutput(output: string, projectRoot: str
 type UnityCliCommandCatalog = {
   valid: boolean;
   commands: string[];
+  parametersByCommand: Record<string, readonly UnityCliCommandParameter[]>;
+  verifiedParametersByCommand: Record<string, readonly UnityCliCommandParameter[]>;
   total: number;
   truncated: boolean;
 };
 
+function isBoundedDescriptorString(value: unknown): value is string {
+  return typeof value === "string" && value.length > 0 && value.length <= 120 && !/[\u0000-\u001f\u007f]/.test(value);
+}
+
 function parseUnityCliCommandCatalog(output: string): UnityCliCommandCatalog {
   const payload = parseJsonObject(output);
   const data = getRecord(payload?.data);
@@ -366,21 +385,53 @@ function parseUnityCliCommandCatalog(output: string): UnityCliCommandCatalog {
       candidates.push(...value);
     }
   }
-  const names = candidates.flatMap((entry): string[] => {
-    const rawName = typeof entry === "string"
-      ? entry
-      : optionalString(getRecord(entry)?.name, getRecord(entry)?.command, getRecord(entry)?.id);
-    if (!rawName) return [];
+
+  const parametersByCommand: Record<string, readonly UnityCliCommandParameter[]> = {};
+  const verifiedCandidates = new Map<string, Array<readonly UnityCliCommandParameter[] | undefined>>();
+  const names: string[] = [];
+  for (const entry of candidates) {
+    const record = getRecord(entry);
+    const rawName = typeof entry === "string" ? entry : optionalString(record?.name, record?.command, record?.id);
+    if (!isBoundedDescriptorString(rawName)) continue;
     const name = rawName.trim();
-    if (!name || name.length > 120 || /[\u0000-\u001f\u007f]/.test(name)) return [];
-    return [name];
-  });
+    if (!isBoundedDescriptorString(name)) continue;
+    names.push(name);
+
+    // Preserve a best-effort descriptor for status display, but retain authoritative
+    // evidence only when every declared parameter is valid and the array was not cut.
+    const rawParameters = record?.parameters;
+    let parsed: UnityCliCommandParameter[] | undefined;
+    if (Array.isArray(rawParameters) && rawParameters.length <= 32) {
+      parsed = [];
+      for (const item of rawParameters) {
+        const parameter = getRecord(item);
+        const parameterName = parameter?.name;
+        const type = parameter?.type;
+        if (!isBoundedDescriptorString(parameterName) || !isBoundedDescriptorString(type) || typeof parameter?.required !== "boolean") {
+          parsed = undefined;
+          break;
+        }
+        parsed.push({ name: parameterName, type, required: parameter.required, ...(Object.prototype.hasOwnProperty.call(parameter, "defaultValue") ? { defaultValue: parameter.defaultValue } : {}) });
+      }
+    }
+    if (!(name in parametersByCommand) && parsed) parametersByCommand[name] = parsed;
+    const entries = verifiedCandidates.get(name) ?? [];
+    entries.push(parsed);
+    verifiedCandidates.set(name, entries);
+  }
+
   const unique = [...new Set(names)].sort((left, right) => left.localeCompare(right));
+  const commands = unique.slice(0, 256);
+  const verifiedParametersByCommand = Object.fromEntries([...verifiedCandidates].flatMap(([name, descriptors]) =>
+    descriptors.length === 1 && descriptors[0] ? [[name, descriptors[0]]] : [],
+  ));
   return {
     valid: Boolean(payload?.success === true && valid),
-    commands: unique.slice(0, 256),
+    commands,
+    parametersByCommand: Object.fromEntries(commands.flatMap(name => parametersByCommand[name] ? [[name, parametersByCommand[name]]] : [])),
+    verifiedParametersByCommand,
     total: unique.length,
-    truncated: unique.length > 256 || names.length < candidates.length,
+    truncated: unique.length > 256,
   };
 }
 
@@ -428,6 +479,14 @@ export async function readDeclaredUnityPipelineVersion(projectRoot: string): Pro
   return optionalString(manifestDependencies?.["com.unity.pipeline"]);
 }
 
+/** Read only the public capability names; the descriptor's authentication token is never retained or surfaced. */
+async function readPipelineDescriptorCapabilities(projectRoot: string): Promise<string[] | undefined> {
+  const descriptor = await readJsonFile(join(projectRoot, "Library", "Pipeline", ".unity-pipeline-port"));
+  if (!descriptor) return undefined;
+  const values = Array.isArray(descriptor.capabilities) ? descriptor.capabilities : [];
+  return [...new Set(values.filter((value): value is string => typeof value === "string" && value.length > 0 && value.length <= 120 && !/[\u0000-\u001f\u007f]/.test(value)))];
+}
+
 export function isUnityCliTimeout(result: Pick<UnityCliExecResult, "error">): boolean {
   const error = result.error as (NodeJS.ErrnoException & { killed?: boolean }) | undefined;
   return error?.code === "ETIMEDOUT" || error?.killed === true || error?.signal === "SIGTERM";
@@ -511,6 +570,8 @@ export async function inspectUnityCliProjectCapabilities(
   result.pipelineDiscovery = "available";
   const pipeline = parseUnityCliPipelineListOutput(pipelineResult.stdout, projectRoot);
   result.matchingInstances = pipeline.instances;
+  const descriptorCapabilities = await readPipelineDescriptorCapabilities(projectRoot);
+  result.pipelineSupportsExecArgv = descriptorCapabilities?.includes("exec.argv") === true;
   result.latestPipelineVersion = pipeline.latestVersion;
   if (pipeline.instances.length === 0) {
     result.pipelineDiscovery = "absent";
@@ -522,7 +583,9 @@ export async function inspectUnityCliProjectCapabilities(
   }
 
   result.commandDiscoveryAttempted = true;
-  const listResult = await execute(command, ["--format", "json", "--no-banner", "--non-interactive", "list", "--project-path", projectRoot], { timeout: discoveryTimeout, signal: options.signal });
+  // `unity list` normalizes parameter types/defaults, while `unity command` with no command
+  // returns the live Pipeline catalog descriptor needed for exact capability-gated forwarding.
+  const listResult = await execute(command, ["--format", "json", "--no-banner", "--non-interactive", "command", "--project-path", projectRoot, "--detail", "full"], { timeout: discoveryTimeout, signal: options.signal });
   const catalog = parseUnityCliCommandCatalog(listResult.stdout);
   const listPayload = parseJsonObject(listResult.stdout);
   const commandDiagnostics = cliEnvelopeDiagnostics(listPayload);
@@ -533,12 +596,16 @@ export async function inspectUnityCliProjectCapabilities(
     // Commands in a warning-bearing catalog are informational only, not advertised
     // capability evidence. Keep descriptors for status visibility without enabling dispatch.
     result.advertisedCommands = catalog.commands;
+    result.advertisedCommandParameters = catalog.parametersByCommand;
+    result.verifiedCommandParameters = catalog.verifiedParametersByCommand;
     result.advertisedCommandCount = catalog.total;
     result.advertisedCommandsTruncated = catalog.truncated;
     return result;
   }
   result.commandDiscovery = "available";
   result.advertisedCommands = catalog.commands;
+  result.advertisedCommandParameters = catalog.parametersByCommand;
+  result.verifiedCommandParameters = catalog.verifiedParametersByCommand;
   result.advertisedCommandCount = catalog.total;
   result.advertisedCommandsTruncated = catalog.truncated;
   result.commandDiscoverySucceeded = true;
@@ -569,6 +636,8 @@ export type UnityPlanningInspectionRequest = {
   args?: string[];
   /** A bounded C# snippet for advertised eval. Pipeline compiles it with Roslyn on the Editor main thread. */
   evalSnippet?: string;
+  /** Verified Pipeline eval dispatcher wait in milliseconds; distinct from the CLI/host wait. */
+  handlerTimeoutMilliseconds?: number;
 };
 
 export type UnityPlanningInspectionResult =
@@ -624,6 +693,20 @@ function runScriptCommandFailure(output: string): "malformed" | "failure" | unde
   return undefined;
 }
 
+function hasVerifiedEvalTimeoutContract(capabilities: UnityCliProjectCapabilities): boolean {
+  const parameters = capabilities.verifiedCommandParameters?.eval;
+  return capabilities.pipelineSupportsExecArgv === true
+    && Array.isArray(parameters)
+    && parameters.length === 2
+    && parameters[0]?.name === "code"
+    && parameters[0]?.type === "String"
+    && parameters[0]?.required === true
+    && parameters[1]?.name === "timeout"
+    && parameters[1]?.type === "Int32"
+    && parameters[1]?.required === false
+    && parameters[1]?.defaultValue === 5000;
+}
+
 function connectedCommandFailure(output: string, isEval: boolean): "malformed" | "failure" | undefined {
   const envelope = parseJsonObject(output);
   if (!envelope) return "malformed";
@@ -691,6 +774,12 @@ export async function dispatchUnityPlanningInspection(
     if (request.args?.length || !snippet || snippet.length > UNITY_PIPELINE_EVAL_MAX_CHARS || /[\u0000]/.test(snippet)) {
       return { outcome: "rejected", code: "planning_eval_invalid", message: "Eval requires one non-empty bounded C# snippet and no separate arguments." };
     }
+    if (request.handlerTimeoutMilliseconds !== undefined && (!Number.isInteger(request.handlerTimeoutMilliseconds) || request.handlerTimeoutMilliseconds < 1 || request.handlerTimeoutMilliseconds > 86_400_000)) {
+      return { outcome: "rejected", code: "planning_eval_invalid", message: "Eval handler timeout must be an integer from 1 to 86400000 milliseconds." };
+    }
+    if (request.handlerTimeoutMilliseconds !== undefined && !hasVerifiedEvalTimeoutContract(initial)) {
+      return { outcome: "rejected", code: "planning_eval_timeout_unavailable", message: "The exact Pipeline copy does not establish raw argv support and the documented eval timeout signature; eval was not dispatched." };
+    }
   } else if (!UNITY_PLANNING_READ_COMMANDS.includes(request.command as typeof UNITY_PLANNING_READ_COMMANDS[number]) || (request.evalSnippet?.trim() ?? "") !== "") {
     return { outcome: "rejected", code: "planning_command_invalid", message: "Only a package-owned purpose-built inspection command may be selected here." };
   }
@@ -706,13 +795,16 @@ export async function dispatchUnityPlanningInspection(
   if (!refreshed.advertisedCommands.includes(request.command)) {
     return { outcome: "rejected", code: "planning_command_unadvertised", message: "The refreshed exact Pipeline copy did not advertise the requested command." };
   }
+  if (isEval && request.handlerTimeoutMilliseconds !== undefined && !hasVerifiedEvalTimeoutContract(refreshed)) {
+    return { outcome: "rejected", code: "planning_eval_timeout_unavailable", message: "The exact Pipeline eval timeout capability changed before dispatch; eval was not dispatched." };
+  }
 
   const command = resolveUnityCliCommand({ cliCommand: options.cliCommand });
   const args = [
     "--format", "json", "--no-banner", "--non-interactive", "command", "--project-path", projectRoot,
     "--timeout", String(Math.max(1, Math.ceil((options.timeout ?? UNITY_CLI_DISCOVERY_TIMEOUT_MS) / 1000))),
     request.command,
-    ...(isEval ? [request.evalSnippet!.trim()] : request.args ?? []),
+    ...(isEval ? [request.evalSnippet!.trim(), ...(request.handlerTimeoutMilliseconds === undefined ? [] : [String(request.handlerTimeoutMilliseconds)])] : request.args ?? []),
   ];
   const execution = await options.execute(command, args, { timeout: options.timeout ?? UNITY_CLI_DISCOVERY_TIMEOUT_MS, signal: options.signal });
   const raw = [execution.stdout, execution.stderr].filter(Boolean).join("\n");

package/src/unity-pipeline.ts

@@ -1,5 +1,6 @@
 import { realpath } from "node:fs/promises";
 import { projectPathsMatch } from "./unity-core";
+import { hasConsistentUnityTestCounts } from "./unity-artifact-inspection";
 import { redactUnityPlanningOutput, resolveUnityCliCommand, summarizeUnityCliText, unityCapabilityDiagnosticSuffix, type UnityCliExecResult, type UnityCliExecutor, type UnityCliProjectCapabilities } from "./unity-cli";
 
 /** Public limits are deliberately small enough that connected work cannot create an unbounded agent wait loop. */
@@ -37,6 +38,11 @@ export type UnityPipelineOperationDetails = {
 export type UnityPipelineTestRecord = { name: string; status: string; durationSeconds?: number; message?: string; stackTrace?: string };
 /** testRecords are terminal evidence for the caller's durable artifact only; do not expose them in tool details. */
 export type UnityPipelineOperationResult = { text: string; details: UnityPipelineOperationDetails; testRecords?: UnityPipelineTestRecord[] };
+export type UnityPipelineTerminalTestEvidence = { state: "completed" | "failed" | "cancelled"; outcome: "uncertain" | "tests_failed" | "run_error" | "cancelled"; reason: string; elapsedSeconds: number; selection: { platform: "EditMode" | "PlayMode"; filter?: string }; correlation: Record<string, string>; observations: string[]; testRecords: UnityPipelineTestRecord[]; warnings: string[] };
+/** Terminal Pipeline evidence can be durable and inspectable without being passing evidence. */
+export class UnityPipelineTerminalTestEvidenceError extends Error {
+  constructor(readonly evidence: UnityPipelineTerminalTestEvidence) { super(evidence.reason); this.name = "UnityPipelineTerminalTestEvidenceError"; }
+}
 
 type RecordValue = Record<string, unknown>;
 type ParsedEnvelope = { result: RecordValue; outerSuccess: boolean; malformed?: string };
@@ -46,6 +52,8 @@ type NormalizedTest = {
   total?: number; passed?: number; failed?: number; inconclusive?: number; failures: string[];
   correlation: Record<string, string>;
   testRecords?: UnityPipelineTestRecord[];
+  testFailureEstablished: boolean;
+  runnerError: boolean;
 };
 
 type PipelineDependencies = {
@@ -199,7 +207,9 @@ export function normalizeUnityPipelineCompile(output: string): NormalizedCompile
   const parsed = parseUnityPipelineEnvelope(output);
   if (parsed.malformed) return { state: "uncertain", diagnostics: [], failed: false };
   const compilerDiagnostics = diagnostics(parsed.result);
-  const failed = !parsed.outerSuccess || hasSemanticFailure(parsed.result) || compilerDiagnostics.length > 0;
+  let compilationFailed = false;
+  walk(parsed.result, item => { if (field(item, "compilationfailed") === true) compilationFailed = true; });
+  const failed = !parsed.outerSuccess || hasSemanticFailure(parsed.result) || compilationFailed || compilerDiagnostics.length > 0;
   const raw = statusOf(parsed.result);
   const state = failed || raw === "failed" || raw === "error" ? "failed" : raw === "up_to_date" || raw === "uptodate" ? "up_to_date"
     : raw === "triggered" ? "triggered" : raw === "compiling" || raw === "running" ? "compiling"
@@ -229,6 +239,9 @@ function testRecords(result: RecordValue): UnityPipelineTestRecord[] {
   });
   return values.slice(0, 2_000);
 }
+function isRecognizedFailedTestStatus(status: string): boolean {
+  return status.trim().toLowerCase() === "failed";
+}
 function testFailures(result: RecordValue): string[] {
   const values: string[] = [];
   walk(result, item => {
@@ -238,7 +251,7 @@ function testFailures(result: RecordValue): string[] {
       for (const entry of entries.slice(0, 200)) {
         const test = record(entry); if (!test) continue;
         const outcome = string(field(test, "result", "status", "outcome"))?.toLowerCase();
-        if (!outcome || /pass|success/.test(outcome)) continue;
+        if (!outcome || /^(?:passed|success)$/i.test(outcome)) continue;
         const name = string(field(test, "name", "fullname", "testname")) ?? "Unnamed test";
         const message = string(field(test, "message", "error", "failuremessage"));
         const stack = string(field(test, "stacktrace", "stack", "trace"));
@@ -268,19 +281,23 @@ function correlation(result: RecordValue): Record<string, string> {
 }
 export function normalizeUnityPipelineTest(output: string): NormalizedTest {
   const parsed = parseUnityPipelineEnvelope(output);
-  if (parsed.malformed) return { state: "uncertain", failures: [], correlation: {} };
+  if (parsed.malformed) return { state: "uncertain", failures: [], correlation: {}, testFailureEstablished: false, runnerError: false };
   const sum = summary(parsed.result);
   const total = number(field(sum ?? parsed.result, "total"));
   const passed = number(field(sum ?? parsed.result, "passed", "pass"));
   const failedCount = number(field(sum ?? parsed.result, "failed", "fail"));
   const inconclusive = number(field(sum ?? parsed.result, "inconclusive", "skipped"));
   const raw = statusOf(parsed.result);
-  const semanticFailed = !parsed.outerSuccess || hasSemanticFailure(parsed.result) || (failedCount ?? 0) > 0;
-  const state = semanticFailed || raw === "failed" || raw === "error" ? "failed" : raw === "cancelled" || raw === "canceled" ? "cancelled"
+  const records = testRecords(parsed.result);
+  const testFailureEstablished = (Number.isSafeInteger(failedCount) && (failedCount ?? 0) > 0) || records.some(test => isRecognizedFailedTestStatus(test.status));
+  const runnerError = !parsed.outerSuccess || raw === "failed" || raw === "error" || hasSemanticFailure(parsed.result);
+  // A reported active state remains active even when it carries partial records/counts.
+  const state = raw === "cancelled" || raw === "canceled" ? "cancelled"
     : raw === "no_tests" || raw === "idle" || raw === "not_started" || raw === "not_running" ? "inactive"
       : raw === "running" ? "running" : raw === "starting" || raw === "queued" ? "starting"
-        : raw === "completed" || raw === "complete" || raw === "success" ? "completed" : "uncertain";
-  return { state, total, passed, failed: failedCount, inconclusive, failures: testFailures(parsed.result), correlation: correlation(parsed.result), testRecords: testRecords(parsed.result) };
+        : raw === "completed" || raw === "complete" || raw === "success" ? testFailureEstablished || runnerError ? "failed" : "completed"
+          : testFailureEstablished || runnerError ? "failed" : "uncertain";
+  return { state, total, passed, failed: failedCount, inconclusive, failures: testFailures(parsed.result), correlation: correlation(parsed.result), testRecords: records, testFailureEstablished, runnerError };
 }
 
 function editorStopSucceeded(output: string): boolean {
@@ -465,10 +482,18 @@ function checkCorrelation(expected: Record<string, string>, actual: Record<strin
   return Object.entries(expected).every(([key, value]) => !actual[key] || actual[key] === value);
 }
 function passingCounts(state: NormalizedTest): { total: number; passed: number; failed: number; inconclusive?: number } | undefined {
+  const summary = { total: state.total, passed: state.passed, failed: state.failed, inconclusive: state.inconclusive };
+  if (!hasConsistentUnityTestCounts(summary, state.testRecords ?? [])) return undefined;
+  if (state.testRecords?.some(test => !/^(?:passed|success)$/i.test(test.status))) return undefined;
   if (state.total === undefined || state.total <= 0 || state.passed === undefined || state.failed !== 0 || (state.inconclusive ?? 0) > 0) return undefined;
   if (state.passed + state.failed + (state.inconclusive ?? 0) !== state.total) return undefined;
   return { total: state.total, passed: state.passed, failed: state.failed, inconclusive: state.inconclusive };
 }
+function terminalEvidence(state: NormalizedTest, reason: string, request: UnityPipelineTestRequest, elapsedSeconds: number, warnings: string[]): UnityPipelineTerminalTestEvidenceError {
+  const outcome = state.state === "cancelled" ? "cancelled" : state.testFailureEstablished ? "tests_failed" : state.runnerError ? "run_error" : "uncertain";
+  const observations = [`terminal state=${state.state}`, `terminal outcome=${outcome}`, ...["total", "passed", "failed", "inconclusive"].flatMap(key => state[key as keyof Pick<NormalizedTest, "total" | "passed" | "failed" | "inconclusive">] === undefined ? [] : [`reported ${key}=${String(state[key as keyof Pick<NormalizedTest, "total" | "passed" | "failed" | "inconclusive">])}`]), ...Object.entries(state.correlation).map(([key, value]) => `correlation ${key}=${value}`)].slice(0, UNITY_PIPELINE_MAX_DIAGNOSTICS);
+  return new UnityPipelineTerminalTestEvidenceError({ state: state.state as "completed" | "failed" | "cancelled", outcome, reason, elapsedSeconds, selection: { platform: request.testPlatform, ...(request.testFilter ?? request.testCategory ? { filter: request.testFilter ?? request.testCategory } : {}) }, correlation: state.correlation, observations, testRecords: state.testRecords ?? [], warnings });
+}
 function elapsed(start: number, now: () => number): number { return Math.max(0, (now() - start) / 1000); }
 function timeoutMessage(operation: string): Error { return new Error(`Unity Pipeline ${operation} timed out; result is uncertain and may still be running. No cancellation, retry, or route switch was performed.`); }
 function ensureBeforeDeadline(deadline: number, now: () => number, operation: string): void {
@@ -540,14 +565,14 @@ export async function runUnityPipelineTests(request: UnityPipelineTestRequest, d
   const dispatchWarnings = pipelineEnvelopeWarnings(dispatched.stdout);
   let state = normalizeUnityPipelineTest(dispatched.stdout);
   if (state.state === "uncertain" || state.state === "inactive") throw new Error("Unity Pipeline test dispatch returned inactive, malformed, or uncertain evidence; test run may not have started.");
-  if (state.state === "failed" || state.state === "cancelled") throw new Error(`Unity ${request.testPlatform} tests failed: ${state.failures.join("; ") || state.state}.`);
   const requestedCorrelation = { mode: request.testPlatform, ...(request.testFilter ? { filter: request.testFilter } : {}) };
   if (!checkCorrelation(requestedCorrelation, state.correlation)) throw new Error("Unity Pipeline test dispatch reported a different mode or filter; operation state is uncertain.");
+  if (state.state === "failed" || state.state === "cancelled") throw terminalEvidence(state, `Unity ${request.testPlatform} tests ${state.state}: ${state.failures.join("; ") || state.state}.`, request, elapsed(start, now), dispatchWarnings);
   const expected = { ...requestedCorrelation, ...state.correlation };
   // Some Pipeline versions return a complete result directly from asynchronous dispatch.
   if (state.state === "completed") {
     const counts = passingCounts(state);
-    if (!counts) throw new Error("Unity test result is terminal but lacks passing evidence (consistent positive total, passed count, and reported zero failures).");
+    if (!counts) throw terminalEvidence(state, "Unity test result is terminal but lacks passing evidence (consistent positive total, passed count, and reported zero failures).", request, elapsed(start, now), dispatchWarnings);
     return { text: `${lifecyclePrefix}Unity ${request.testPlatform} tests passed for ${projectRoot}: ${counts.total} executed, ${counts.passed} passed, 0 failed in ${elapsed(start, now).toFixed(2)}s.${warningText(dispatchWarnings)}`, details: { projectRoot, operation: "tests", terminalState: "completed", elapsedSeconds: elapsed(start, now), ...playModeDetails(preflight), testPlatform: request.testPlatform, testFilter: request.testFilter ?? request.testCategory, counts, ...(dispatchWarnings.length ? { warnings: dispatchWarnings } : {}) }, testRecords: state.testRecords };
   }
   for (let poll = 0; now() < deadline; poll += 1) {
@@ -565,12 +590,12 @@ export async function runUnityPipelineTests(request: UnityPipelineTestRequest, d
     retainWarnings(dispatchWarnings, response.stdout);
     state = normalizeUnityPipelineTest(response.stdout);
     if (!checkCorrelation(expected, state.correlation)) throw new Error("Unity Pipeline test status was displaced by a different run; operation state is uncertain.");
-    if (state.state === "failed" || state.state === "cancelled") throw new Error(`Unity ${request.testPlatform} tests failed: ${state.failures.join("; ") || state.state}.`);
+    if (state.state === "failed" || state.state === "cancelled") throw terminalEvidence(state, `Unity ${request.testPlatform} tests ${state.state}: ${state.failures.join("; ") || state.state}.`, request, elapsed(start, now), dispatchWarnings);
     if (state.state === "uncertain") throw new Error("Unity Pipeline test status is malformed or uncertain; operation may still be running.");
     if (state.state === "inactive") throw new Error("Unity Pipeline test status became inactive before a terminal result; operation state is uncertain.");
     if (state.state !== "completed") continue;
     const counts = passingCounts(state);
-    if (!counts) throw new Error("Unity test result is terminal but lacks passing evidence (consistent positive total, passed count, and reported zero failures).");
+    if (!counts) throw terminalEvidence(state, "Unity test result is terminal but lacks passing evidence (consistent positive total, passed count, and reported zero failures).", request, elapsed(start, now), dispatchWarnings);
     return { text: `${lifecyclePrefix}Unity ${request.testPlatform} tests passed for ${projectRoot}: ${counts.total} executed, ${counts.passed} passed, 0 failed in ${elapsed(start, now).toFixed(2)}s.${warningText(dispatchWarnings)}`, details: { projectRoot, operation: "tests", terminalState: "completed", elapsedSeconds: elapsed(start, now), ...playModeDetails(preflight), testPlatform: request.testPlatform, testFilter: request.testFilter ?? request.testCategory, counts, ...(dispatchWarnings.length ? { warnings: dispatchWarnings } : {}) }, testRecords: state.testRecords };
   }
   throw timeoutMessage("tests");

package/src/unity-tests.ts

@@ -60,6 +60,8 @@ export type NormalizedUnityTestResult = {
   tests: NormalizedUnityTest[];
   flakyTests?: Array<{ name: string; attempts: number }>;
   backendArtifacts?: Record<string, string>;
+  /** Bounded non-authoritative observations retained when terminal Pipeline evidence cannot establish a result. */
+  diagnostics?: string[];
 };
 
 export type UnityTestRouteRequirements = { requiresIsolation: boolean; reasons: string[] };
@@ -250,6 +252,7 @@ export function normalizeUnityTestResult(result: NormalizedUnityTestResult): Nor
     summary: Object.fromEntries(Object.entries(result.summary).flatMap(([key, value]) => numberOrUndefined(value) === undefined ? [] : [[key, numberOrUndefined(value)!]])),
     tests, ...(result.flakyTests ? { flakyTests: result.flakyTests.slice(0, UNITY_TEST_MAX_TESTS).map(item => ({ name: bound(item.name, 1_000) || "Unnamed test", attempts: Math.max(1, Math.floor(item.attempts)) })) } : {}),
     ...(Object.keys(artifacts).length ? { backendArtifacts: artifacts } : {}),
+    ...(result.diagnostics ? { diagnostics: result.diagnostics.slice(0, 8).flatMap(value => typeof value === "string" ? [bound(value, 1_000) || ""] : []).filter(Boolean) } : {}),
   };
 }