@mrclrchtr/supi-debug 11.1.0 → 11.2.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "@mrclrchtr/supi-core",
3
- "version": "11.1.0",
3
+ "version": "11.2.0",
4
4
  "description": "Shared settings, configuration, reporting, and session infrastructure",
5
5
  "license": "MIT",
6
6
  "repository": {
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "@mrclrchtr/supi-debug",
3
- "version": "11.1.0",
3
+ "version": "11.2.0",
4
4
  "description": "Capture and inspect SuPi debug events",
5
5
  "license": "MIT",
6
6
  "repository": {
@@ -34,7 +34,7 @@
34
34
  "README.md"
35
35
  ],
36
36
  "dependencies": {
37
- "@mrclrchtr/supi-core": "11.1.0"
37
+ "@mrclrchtr/supi-core": "11.2.0"
38
38
  },
39
39
  "bundledDependencies": [
40
40
  "@mrclrchtr/supi-core"
@@ -1,77 +1,55 @@
1
1
  ---
2
- description: Retrospect on SuPi tooling used during the completed task
2
+ description: Assess SuPi tooling for the preceding task with evidence-linked improvements
3
3
  ---
4
4
 
5
- Produce a compact, evidence-based retrospective of the task that just ended. Evaluate the SuPi surfaces that were available and relevant: tools, skills, prompts, extensions, injected context or guidance, documentation, settings, and human-only TUI commands. Do not evaluate the entire suite in the abstract. Do not evaluate pi-core behavior.
5
+ Produce a compact retrospective of the task immediately preceding this prompt. Assess SuPi tooling, not the project's code or general development practices. Cover relevant tools, skills, prompts, extensions, injected guidance, docs, settings, and human-only TUI commands—not the suite in the abstract. Assess context efficiency where the task provides concrete evidence, preserving correct tool selection and use.
6
6
 
7
- ## Evidence rules
7
+ ## Scope and evidence
8
8
 
9
- - Reconstruct the retrospective from this session only. Do not invent tool calls, outcomes, failures, token costs, or user impact.
10
- - You may query the `debug` tool to verify event-level claims. You may query `cache_forensics` when it is available to verify cache-related claims. Use such queries only for verification, and keep them few. Do not perform any other tool calls or follow-up investigation. Stop after you write the retrospective.
11
- - Tag every claim as `[observed]`, `[inferred]`, or `[unknown]`. An observed claim is supported by the transcript, a tool result, or an evidence query. An inferred claim is plausible but untested.
12
- - Rate the impact of each surfaced item as `high`, `medium`, or `low`. The impact is the degree to which the item changed the task outcome or its cost.
13
- - Use the exact surface name that appears in the session. Do not treat an available but unused tool as evidence of failure.
14
- - If no SuPi surface was used or relevant, say so explicitly. Do not build a wishlist. List only task-specific, plausible missed help.
9
+ 1. Identify the preceding task and its actual completion status from the visible session. If no task is identifiable, state that limit and stop. Keep unrelated tasks and this retrospective's own verification outside the assessment.
10
+ 2. Use the task transcript as the primary evidence. If verification would materially change a finding or recommendation, make at most two narrowly filtered `debug` calls against the live session, using sanitized data only. Use only events attributable to this task. A retained buffer can omit earlier events; empty or incomplete results do not establish that nothing failed. If verification is unavailable, disclose the limit and proceed.
11
+ 3. Make no other tool calls or follow-up investigation. Historical scans, delegation, file edits, issue creation, settings changes, and continuing the task are outside this retrospective. Stop after the report.
15
12
 
16
- ## Evaluate
13
+ For each finding, give a brief evidence anchor: a tool result or error, a retry, a user correction, or a specific instruction/context excerpt. Use exact surface names from the session. Keep excerpts minimal and omit secrets or unnecessary identifying details.
17
14
 
18
- - SuPi surfaces that were actually used: what they enabled, where they fell short, and any failure or friction.
19
- - Failed or mis-parameterized tool calls: SuPi surface calls that failed or were rejected for wrong, missing, or invalid parameters, including calls corrected on retry. Name the cause: agent misuse, ambiguous tool description, missing guidance (promptSnippet or promptGuidelines), a schema gap, or a tool bug.
20
- - Recognized problems or bugs: concrete defects in SuPi surfaces, such as crashes, wrong output, failed calls for valid usage, regressions, inconsistent behavior, or guidance that led to a wrong action. Do not report defects in the project's own code.
21
- - Missed opportunities: a relevant unused tool (for example a supi-code-intelligence tool) or context source, and why it was missed. Name the cause: discoverability, guidance, timing, capability, or not applicable.
22
- - Missing pieces: a concrete utility, capability, documentation page, example, or output improvement that would have changed this task.
23
- - Noise: redundant instructions, repeated advice without added value, stale or irrelevant context, excessive output, unnecessary long paths, poor timing, or misleading guidance. Do not criticize necessary context without naming the avoidable cost.
24
- - Keep SuPi or tooling recommendations separate from general code or project recommendations.
15
+ Use these evidence labels:
16
+ - `[observed]`: directly supported by the visible transcript or verification result.
17
+ - `[inferred]`: a plausible interpretation or missed benefit, not demonstrated.
18
+ - `[unknown]`: an unresolved cause, ownership, or measurement; not a standalone finding.
25
19
 
26
- ## Output rules
20
+ Separate the observed outcome from its explanation. An observed failure does not make its suspected cause observed. Distinguish SuPi-owned surfaces, upstream Pi/provider behavior, project-local guidance, and agent behavior. Attribute ownership and cause only when supported; otherwise mark them `[unknown]`. Keep upstream behavior and project-code defects out of SuPi bug claims.
27
21
 
28
- - Keep the result under about 600 words and specific to this task.
29
- - Open with a one-line overall verdict on SuPi tooling for this task.
30
- - Give each item a confidence tag and an impact rating. `None identified` lines need neither.
31
- - Prefer concrete evidence and observed friction over generic praise or a feature wishlist.
32
- - If a section has no supported item, write `None identified` and briefly explain the evidence limit.
33
- - Include at most three recommendations. Each must name a changeable surface (tool, prompt, skill, docs, guidance, or feature), the proposed change, and the expected benefit. Recommended changes may target tool descriptions, parameter schemas, or guidance, especially when they address the Failed or mis-parameterized tool calls listed above. Do not recommend "use the tool more" unless discoverability is the identified cause.
34
- - Do not edit files, open issues, update OpenSpec artifacts, or take any other follow-up action.
22
+ Rate each finding's impact on this task as `high`, `medium`, or `low`, based on the demonstrated effect or explicitly inferred benefit. Report time, token, cache, or cost figures only when measured in the task evidence; describe unmeasured costs qualitatively. Claims about recurring problems or suite-wide reliability require evidence beyond this retrospective's scope.
35
23
 
36
- ## Required output
24
+ ## Assessment checklist
37
25
 
38
- ## SuPi Tooling Retrospective
39
-
40
- **Task completed**: <1–2 sentence summary>
26
+ Consider each category, but report each finding once:
27
+ - **Help:** What a used surface enabled, including useful guidance or context—not just a list of calls.
28
+ - **Tool guidance quality:** Assess visible tool descriptions, parameter explanations, `promptSnippet`, `promptGuidelines`, and result guidance for clarity, correctness, and sufficiency at the decision point. Rate relevant guidance as `effective`, `needs improvement`, or `not assessable`, citing evidence. Distinguish unclear guidance from the agent failing to follow clear guidance.
29
+ - **Context efficiency:** Where concrete task evidence supports a finding, distinguish recurring tool metadata and injected guidance from result text and on-demand content. For deletion proposals, quote the exact overlapping excerpt and identify retained guidance that preserves pre-call selection, argument validity, and safety. Visible overlap is a candidate for reduction, not proof of redundancy; non-use alone does not justify removal. Mark uncertain request placement `[unknown]`; quantify savings only from task evidence.
30
+ - **Failures and retries:** Rejected, failed, or mis-parameterized SuPi calls, including ones corrected on retry. Name the relevant parameter or error and eventual outcome. Distinguish agent misuse, ambiguous descriptions, missing guidance, schema gaps, and tool bugs; leave the cause unknown when the evidence cannot decide.
31
+ - **Defects:** Wrong output, crashes, regressions, or inconsistent behavior under valid usage. Label suspected defects as inferred and state what remains unverified.
32
+ - **Missed or missing help:** A specific unused surface or absent capability that plausibly would have changed this task. For unused surfaces, establish that they were available and relevant at the decision point; non-use alone is not a gap. Infer a reason such as discoverability, guidance, or timing only when supported.
33
+ - **Noise:** Identify redundant, stale, misleading, oversized, or poorly timed results/on-demand context and their avoidable cost. Account for visible mandatory-reading requirements before calling a read unnecessary. Explain what could be reduced or deferred while preserving necessary guidance.
41
34
 
42
- **Verdict**: <one line: the overall state of SuPi tooling for this task and its biggest lever>
35
+ ## Report
43
36
 
44
- ### Tools used
45
- - `[observed · impact: high|medium|low]` **`<surface>`** — concrete help, friction, or failure.
46
- - If none: `None identified — no SuPi surface materially participated in this task.`
37
+ Use the structure below, within 600 words; shorter when evidence is sparse. Prioritize consequential findings rather than filling categories. If a findings section is empty, write `None observed in the available task context.` If no SuPi surface was used or relevant, say so explicitly and omit unsupported findings and recommendations.
47
38
 
48
- ### Failed or mis-parameterized tool calls
49
- - `[observed|inferred · impact: high|medium|low]` **`<surface>`** — the call, the invalid or missing parameter, the outcome, and the cause: agent misuse, ambiguous description, missing guidance, schema gap, or tool bug. Include near misses: a call rejected once and corrected on retry is stronger evidence than a clean pass.
50
- - If none: `None identified — every SuPi call used valid parameters.`
39
+ ## SuPi Tooling Retrospective
51
40
 
52
- ### Recognized problems or bugs
53
- - `[observed|inferred · impact: high|medium|low]` **`<surface>`** — the concrete defect (crash, wrong behavior, regression, inconsistency) and how it affected the task. Do not repeat ordinary friction that belongs under Tools used, and do not repeat parameter-caused call failures that belong under Failed or mis-parameterized tool calls.
54
- - If none: `None identified — no defect surfaced in this task.`
41
+ **Task**: <one sentence, including actual completion status>
55
42
 
56
- ### Missed opportunities
57
- - `[inferred · impact: high|medium|low]` **`<surface>`** — task-specific help it might have provided. Name the cause: discoverability, guidance, timing, capability, or not applicable.
58
- - If none: `None identified — do not infer a gap from non-use alone.`
43
+ **Verdict**: <overall contribution and biggest supported improvement, or no change warranted>
59
44
 
60
- ### Missing pieces
61
- - `[observed|inferred · impact: high|medium|low]` **`<utility, feature, docs, example, or output change>`** — the concrete gap and how it affected this task.
62
- - If none: `None identified.`
45
+ ### What helped
46
+ - `[observed · impact: high|medium|low]` **`<surface>`** — <concrete contribution; evidence anchor>.
63
47
 
64
- ### Unhelpful or noisy context
65
- - `[observed|inferred · impact: high|medium|low]` **`<instruction, context, or output>`** — what was unnecessary or costly, and how it could be reduced or better timed.
66
- - If none: `None identified.`
48
+ ### Friction and gaps
49
+ - `[observed|inferred · impact: high|medium|low]` **`<surface>`** — <category and finding; evidence anchor; task effect>. <Cause or ownership, separately labeled if inferred or unknown. For failed calls, include the retry outcome if visible.>
67
50
 
68
- ### Prioritized recommendations
69
- 1. **`<named surface>`** — <specific change>; <expected benefit>; confidence: <high|medium|low>.
70
- 2. **`<named surface>`** — <specific change>; <expected benefit>; confidence: <high|medium|low>.
71
- 3. **`<named surface>`** — <specific change>; <expected benefit>; confidence: <high|medium|low>.
72
- - Include only supported recommendations. If none are supported, write `None identified`.
51
+ ### Prioritized changes
52
+ Include at most three recommendations, each tied to a reported finding: **owner / named surface → specific change → expected benefit**. Rank by supported task benefit or context reduction; mark benefits as untested. Keep agent-behavior lessons distinct from persistent tooling or guidance changes. Prefer the smallest intervention: persistent changes require a concrete editable target and evidence that changing the surface, rather than following existing guidance, addresses the finding. When ownership or necessity is unresolved, recommend narrow verification rather than deletion. Recommend increased tool use only when a supported discoverability or guidance gap explains the miss. If no change is supported, write `None warranted by the available evidence.`
73
53
 
74
- ### Confidence / evidence
75
- - Direct evidence: <what the session and any evidence queries demonstrate>
76
- - Inference: <what is plausible but untested>
77
- - Limits: <what the session cannot establish>
54
+ ### Evidence limits
55
+ <Briefly state material limits: missing or compacted task context, unavailable verification, uncertain attribution, or unmeasured costs. Distinguish an uneventful observed task from incomplete evidence.>