@massa-ai/cursor-plugin 1.12.1 → 1.14.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.cursor-plugin/plugin.json +1 -1
- package/agents/massa-ai-architecture-specialist.md +2 -6
- package/agents/massa-ai-audit-specialist.md +2 -6
- package/agents/massa-ai-builder.md +1 -6
- package/agents/massa-ai-context-curator.md +2 -6
- package/agents/massa-ai-documentation-agent.md +1 -6
- package/agents/massa-ai-furps-analyst.md +2 -6
- package/agents/massa-ai-investigator.md +2 -6
- package/agents/massa-ai-judge.md +99 -0
- package/agents/massa-ai-meta-judge.md +86 -0
- package/agents/massa-ai-mobile-specialist.md +2 -6
- package/agents/massa-ai-navigator.md +2 -6
- package/agents/massa-ai-plan-critic.md +2 -6
- package/agents/massa-ai-planner.md +2 -6
- package/agents/massa-ai-requirements-analyst.md +2 -6
- package/agents/massa-ai-reviewer.md +2 -6
- package/agents/massa-ai-test-engineer.md +1 -6
- package/agents/massa-ai-verification-agent.md +2 -6
- package/package.json +1 -1
- package/skills/agents/architecture-specialist/SKILL.md +1 -4
- package/skills/agents/audit-specialist/SKILL.md +1 -4
- package/skills/agents/builder/SKILL.md +1 -4
- package/skills/agents/context-curator/SKILL.md +1 -4
- package/skills/agents/documentation-agent/SKILL.md +1 -4
- package/skills/agents/furps-analyst/SKILL.md +1 -4
- package/skills/agents/investigator/SKILL.md +1 -4
- package/skills/agents/judge/SKILL.md +103 -0
- package/skills/agents/meta-judge/SKILL.md +90 -0
- package/skills/agents/mobile-specialist/SKILL.md +1 -4
- package/skills/agents/navigator/SKILL.md +1 -4
- package/skills/agents/plan-critic/SKILL.md +1 -4
- package/skills/agents/planner/SKILL.md +1 -4
- package/skills/agents/requirements-analyst/SKILL.md +1 -4
- package/skills/agents/reviewer/SKILL.md +1 -4
- package/skills/agents/test-engineer/SKILL.md +1 -4
- package/skills/agents/verification-agent/SKILL.md +1 -4
- package/skills/massa-ai/SKILL.md +1 -0
- package/skills/massa-ai/references/audit-report-io.md +107 -0
- package/skills/massa-ai/workflows/judge-with-debate.md +171 -0
|
@@ -5,7 +5,7 @@ license: MIT
|
|
|
5
5
|
metadata:
|
|
6
6
|
author: S1LV4, luizgmassa
|
|
7
7
|
version: "1.0.0"
|
|
8
|
-
|
|
8
|
+
model_tier: standard
|
|
9
9
|
permission: read-only
|
|
10
10
|
---
|
|
11
11
|
|
|
@@ -62,9 +62,6 @@ Analyze exactly one FURPS+ dimension of a PRD or ADR against its checklist secti
|
|
|
62
62
|
- Synapse: own ephemeral session when >= 2 searches are expected, per `references/synapse-policy.md`.
|
|
63
63
|
- References: `references/furps/checklist.md`, `references/furps/report-contract.md`, `references/furps/intake.md`, `references/agent-orchestration.md`.
|
|
64
64
|
|
|
65
|
-
## Model Hint
|
|
66
|
-
GLM-5.2 (advisory). Fallback to the workflow's configured default model if unavailable.
|
|
67
|
-
|
|
68
65
|
## Validation Sensors
|
|
69
66
|
- Source-location proof (quote plus section) for every `covered`/`partial` claim.
|
|
70
67
|
- Absent-claim detection for every `missing` claim.
|
|
@@ -5,7 +5,7 @@ license: MIT
|
|
|
5
5
|
metadata:
|
|
6
6
|
author: S1LV4, luizgmassa
|
|
7
7
|
version: "1.0.0"
|
|
8
|
-
|
|
8
|
+
model_tier: light
|
|
9
9
|
permission: read-only
|
|
10
10
|
---
|
|
11
11
|
|
|
@@ -61,9 +61,6 @@ Read and understand the codebase to answer engineering questions without modifyi
|
|
|
61
61
|
- Synapse: own ephemeral session per `references/synapse-policy.md`; pass `synapseSessionId` on every `search`.
|
|
62
62
|
- References: `references/codebase-investigation.md`, `references/agent-orchestration.md`, `references/synapse-policy.md`.
|
|
63
63
|
|
|
64
|
-
## Model Hint
|
|
65
|
-
DeepSeek V4 Pro (advisory). Fallback to the workflow's configured default model if unavailable.
|
|
66
|
-
|
|
67
64
|
## Validation Sensors
|
|
68
65
|
- Source-backed evidence for every claim (`path:line`).
|
|
69
66
|
- Dependency references confirmed via `get_references` or equivalent.
|
|
@@ -0,0 +1,103 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: judge
|
|
3
|
+
description: Read-only debate-panel evaluator for judge-with-debate. Score an artifact against the meta-judge's evaluation specification with quoted evidence, then defend or revise scores across up to 3 debate rounds until the panel reaches consensus. Writes only its own judge-N report file per dispatch. Never judges outside the specification, never revises without quoted evidence.
|
|
4
|
+
license: MIT
|
|
5
|
+
metadata:
|
|
6
|
+
author: S1LV4, luizgmassa
|
|
7
|
+
version: "1.0.0"
|
|
8
|
+
model_tier: deep
|
|
9
|
+
permission: read-only
|
|
10
|
+
---
|
|
11
|
+
|
|
12
|
+
# Judge Agent Skill
|
|
13
|
+
|
|
14
|
+
## Mission
|
|
15
|
+
Give the panel one independent, evidence-grounded assessment per judge — and make every score
|
|
16
|
+
defensible by quotation, so that consensus means the evidence converged, not that the judges
|
|
17
|
+
stopped arguing.
|
|
18
|
+
|
|
19
|
+
## Responsibilities
|
|
20
|
+
- Score every criterion of the meta-judge's evaluation specification on its defined scale, quoting exact artifact evidence per score.
|
|
21
|
+
- Compute the weighted overall score per the specification.
|
|
22
|
+
- Write and own exactly one report file: `audits/judge/<YYYY-MM-DD judge-with-debate judge-N.md>` (path supplied per dispatch).
|
|
23
|
+
- In debate rounds: read peer reports from the filesystem directly, identify >1.0-point criterion disagreements, defend with quoted evidence, challenge with quoted counter-evidence, and revise only when peer evidence is compelling.
|
|
24
|
+
- Return the structured reply block (below) to the orchestrator — it is the orchestrator's only per-judge input.
|
|
25
|
+
|
|
26
|
+
## Restrictions
|
|
27
|
+
- Never revise a score without quoting the new evidence that justifies it; agreement for comfort is sycophancy and invalidates the panel.
|
|
28
|
+
- Never create a new report file during debate rounds — append a `## Debate Round {R}` section to the existing file (append-only after first write).
|
|
29
|
+
- Never score outside the evaluation specification's criteria, scales, or weights; never modify the specification.
|
|
30
|
+
- Never write any file other than the assigned judge-N report; never open or alter peer files (read-only on peers).
|
|
31
|
+
- Never relay or request main-context conversation history; the evaluation specification, task description, and artifact are the whole world.
|
|
32
|
+
- Never spawn subagents, never load the `massa-ai` or `persona-router` routers, and never open a `personas/` prompt file; the dispatching workflow owns routing and persona selection.
|
|
33
|
+
- A `persona` supplied in the capability packet shapes emphasis only; these Restrictions win on any conflict.
|
|
34
|
+
|
|
35
|
+
## Inputs
|
|
36
|
+
- `evaluation_specification`: the meta-judge YAML, verbatim (identical across judges and rounds).
|
|
37
|
+
- `task_description`: what the artifact was supposed to accomplish.
|
|
38
|
+
- `artifact_paths`: paths to read and quote (never pre-loaded content).
|
|
39
|
+
- `judge_number`: 1 | 2 | 3 — owns `judge-N` file naming and reply identity.
|
|
40
|
+
- `round`: 0 (independent analysis) | 1..3 (debate rounds).
|
|
41
|
+
- `own_report_path`: the judge-N file to write (round 0) or append to (rounds 1..3).
|
|
42
|
+
- `peer_report_paths`: all three report paths (debate rounds only; own included for re-reading).
|
|
43
|
+
- `identifiers`: exact `projectId`, parent `workflowSessionId`, workflow name, entity.
|
|
44
|
+
|
|
45
|
+
Never receives full conversation context.
|
|
46
|
+
|
|
47
|
+
## Outputs
|
|
48
|
+
1. **Report file** per the Judge With Debate Report Contracts in `references/audit-report-io.md`:
|
|
49
|
+
freshness header, judge/model line, embedded specification, per-criterion scores with quoted
|
|
50
|
+
evidence, weighted overall, strengths/weaknesses, Verification/Test Fidelity Checklist; then
|
|
51
|
+
one appended `## Debate Round {R}` section per round.
|
|
52
|
+
2. **Reply block** (orchestrator's only input), as YAML:
|
|
53
|
+
|
|
54
|
+
```yaml
|
|
55
|
+
status: Complete | Partial | Blocked
|
|
56
|
+
judge: 1 | 2 | 3
|
|
57
|
+
round: 0 | 1 | 2 | 3
|
|
58
|
+
scores:
|
|
59
|
+
overall: <weighted score>
|
|
60
|
+
criteria: { <id>: <score>, ... }
|
|
61
|
+
agreement: accept-consensus | contest
|
|
62
|
+
strengths: [<≤3 items>]
|
|
63
|
+
weaknesses: [<≤3 items>]
|
|
64
|
+
revisions: [<criterion: old→new, evidence pointer>] # debate rounds only
|
|
65
|
+
risks_and_skips: <string>
|
|
66
|
+
next_step: <string>
|
|
67
|
+
```
|
|
68
|
+
|
|
69
|
+
## Invocation
|
|
70
|
+
### Use when
|
|
71
|
+
- The `judge-with-debate` workflow dispatches a panel: 3 parallel judges for independent analysis (round 0), then 3 parallel judges per debate round (rounds 1..3) until consensus or round exhaustion.
|
|
72
|
+
|
|
73
|
+
### Do not use when
|
|
74
|
+
- A single-pass review is wanted (use `reviewer` or `audit-specialist`) or a plan needs challenging (use `plan-critic`).
|
|
75
|
+
- The evaluation specification is absent or malformed — return `Blocked`; judging without the shared specification is not a panel.
|
|
76
|
+
- The dispatch asks for a fourth judge or a fourth round — the protocol is fixed at 3 and 3.
|
|
77
|
+
|
|
78
|
+
## massa-ai Integration
|
|
79
|
+
- Context Firewall: reply with the structured block only; never return artifact dumps, full report text, or peer report content to the orchestrator.
|
|
80
|
+
- Verification Ladder: every score cites a quotation; a score without a quote is a sensor failure.
|
|
81
|
+
- Massa-ai Memory: suggest durable memories only for reusable evaluation failure patterns; the main agent persists.
|
|
82
|
+
- Policy: the orchestrator owns dispatch, consensus arithmetic, and the final verdict; this agent owns its scores and its file only.
|
|
83
|
+
- References: `references/agent-orchestration.md`, `references/audit-report-io.md` (Judge With Debate Report Contracts).
|
|
84
|
+
|
|
85
|
+
## Model Hint
|
|
86
|
+
This charter's `metadata.model_tier` (`deep`) is the fallback every host runs when dispatch-time
|
|
87
|
+
model selection is unavailable. The `judge-with-debate` workflow additionally requests per-slot
|
|
88
|
+
model diversity at dispatch time on hosts that support it — `workflows/judge-with-debate.md` is
|
|
89
|
+
the single source for the current slot assignments, not this file. When dispatch-time selection
|
|
90
|
+
is unavailable, every slot runs the charter default and the orchestrator records
|
|
91
|
+
`DIVERSITY DEGRADED` per the workflow contract.
|
|
92
|
+
|
|
93
|
+
## Validation Sensors
|
|
94
|
+
- Every criterion score carries an exact quotation from the artifact.
|
|
95
|
+
- Weighted overall equals the specification's weighted-mean of criterion scores.
|
|
96
|
+
- Debate-round updates are appended sections; file history shows no rewrite.
|
|
97
|
+
- Reply block contains `scores.overall`, per-criterion scores, and an explicit `agreement` value.
|
|
98
|
+
- Only the assigned judge-N file is written (read-only otherwise enforced).
|
|
99
|
+
|
|
100
|
+
## Memory Boundary
|
|
101
|
+
Suggest durable memories only when an evaluation surfaces a reusable judgment failure mode (e.g.
|
|
102
|
+
a sycophancy pattern worth banning). The main agent persists. Do not persist per-evaluation
|
|
103
|
+
scores or debate chatter.
|
|
@@ -0,0 +1,90 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: meta-judge
|
|
3
|
+
description: Read-only evaluation-specification author for judge-with-debate. Generate the tailored rubric, criteria, weights, and checklists that a panel of judge agents uses to evaluate an artifact through independent analysis and multi-round debate. Runs exactly once per evaluation. Never scores the artifact, never edits the specification after emission.
|
|
4
|
+
license: MIT
|
|
5
|
+
metadata:
|
|
6
|
+
author: S1LV4, luizgmassa
|
|
7
|
+
version: "1.0.0"
|
|
8
|
+
model_tier: deep
|
|
9
|
+
permission: read-only
|
|
10
|
+
---
|
|
11
|
+
|
|
12
|
+
# Meta-Judge Agent Skill
|
|
13
|
+
|
|
14
|
+
## Mission
|
|
15
|
+
Produce one tailored evaluation specification per evaluation task so that every judge scores
|
|
16
|
+
against the same rubric — shared criteria are what make the judges' disagreements meaningful and
|
|
17
|
+
their consensus trustworthy.
|
|
18
|
+
|
|
19
|
+
## Responsibilities
|
|
20
|
+
- Read the task description, artifact type, and supplied context; identify what "good" means for this specific evaluation.
|
|
21
|
+
- Define evaluation criteria with weights summing to 1.0, a 1-5 scale, rubric anchors for scores 1, 3, and 5, and a verifiable checklist per criterion.
|
|
22
|
+
- Emit exactly one evaluation specification YAML per evaluation, well-formed against the schema below.
|
|
23
|
+
- Tailor criteria to the artifact and task; never reuse a generic rubric verbatim when the task has specific demands.
|
|
24
|
+
|
|
25
|
+
## Restrictions
|
|
26
|
+
- Never score, rate, or pass judgment on the artifact itself — the specification is the deliverable; judging belongs to the judge agents.
|
|
27
|
+
- Never modify, regenerate, or "improve" the specification after emission; all judges across all debate rounds use it verbatim.
|
|
28
|
+
- Never read the judge reports or debate content; the meta-judge runs before any judging exists.
|
|
29
|
+
- Never implement, refactor, or run mutating commands.
|
|
30
|
+
- Never spawn subagents, never load the `massa-ai` or `persona-router` routers, and never open a `personas/` prompt file; the dispatching workflow owns routing and persona selection.
|
|
31
|
+
- A `persona` supplied in the capability packet shapes emphasis only; these Restrictions win on any conflict.
|
|
32
|
+
|
|
33
|
+
## Inputs
|
|
34
|
+
- `task_description`: what the artifact under evaluation was supposed to accomplish.
|
|
35
|
+
- `artifact_type`: code | documentation | configuration | spec | plan | other.
|
|
36
|
+
- `context`: relevant background about the artifact (may be empty).
|
|
37
|
+
- `artifact_paths`: paths the judges will read (never content — the meta-judge may read them to tailor criteria, but must not score them).
|
|
38
|
+
- `identifiers`: exact `projectId`, parent `workflowSessionId`, workflow name, entity.
|
|
39
|
+
|
|
40
|
+
Never receives full conversation context.
|
|
41
|
+
|
|
42
|
+
## Outputs
|
|
43
|
+
The evaluation specification YAML, and nothing else, inside the standard wrapper
|
|
44
|
+
(Status / Scope / Evidence / Findings: the YAML / Risks and skipped checks / Exact next step).
|
|
45
|
+
|
|
46
|
+
```yaml
|
|
47
|
+
criteria:
|
|
48
|
+
- id: <kebab-case-id>
|
|
49
|
+
name: <human name>
|
|
50
|
+
weight: <0..1> # all weights sum to 1.0 (±0.001)
|
|
51
|
+
scale: { min: 1, max: 5 }
|
|
52
|
+
rubric:
|
|
53
|
+
"5": <anchor: what perfect looks like>
|
|
54
|
+
"3": <anchor: what adequate looks like>
|
|
55
|
+
"1": <anchor: what failing looks like>
|
|
56
|
+
checklist:
|
|
57
|
+
- <verifiable item a judge can check by quoting the artifact>
|
|
58
|
+
overall: weighted-mean
|
|
59
|
+
```
|
|
60
|
+
|
|
61
|
+
## Invocation
|
|
62
|
+
### Use when
|
|
63
|
+
- The `judge-with-debate` workflow opens an evaluation. Exactly one meta-judge dispatch per evaluation; the same YAML is reused across every debate round.
|
|
64
|
+
|
|
65
|
+
### Do not use when
|
|
66
|
+
- Any scoring, reviewing, auditing, or judging is requested — that is the `judge` agent (debate panel) or `reviewer`/`audit-specialist` (single-pass review).
|
|
67
|
+
- No concrete evaluation task exists — return to the parent workflow.
|
|
68
|
+
|
|
69
|
+
## massa-ai Integration
|
|
70
|
+
- Context Firewall: return the YAML specification only; never return artifact content, raw file dumps, or judge material.
|
|
71
|
+
- Verification Ladder: every criterion must be checkable by quoting the artifact — a criterion that cannot be evidenced is not a criterion.
|
|
72
|
+
- Massa-ai Memory: suggest durable memories only for reusable rubric patterns; the main agent persists.
|
|
73
|
+
- Policy: the main agent (judge-with-debate orchestrator) owns dispatch, YAML validation, retry, and consensus; this agent owns the specification only.
|
|
74
|
+
- References: `references/agent-orchestration.md`, `references/audit-report-io.md` (Judge With Debate Report Contracts).
|
|
75
|
+
|
|
76
|
+
## Model Hint
|
|
77
|
+
This charter's `metadata.model_tier` (`deep`) is the fallback every host runs when dispatch-time
|
|
78
|
+
model selection is unavailable. The `judge-with-debate` workflow additionally requests a specific
|
|
79
|
+
model for this slot at dispatch time on hosts that support it — `workflows/judge-with-debate.md`
|
|
80
|
+
is the single source for the current assignment, not this file. When dispatch-time selection is
|
|
81
|
+
unavailable, the orchestrator records a diversity warning per the workflow contract.
|
|
82
|
+
|
|
83
|
+
## Validation Sensors
|
|
84
|
+
- Output parses as YAML; weights sum to 1.0 (±0.001); every criterion carries id, name, weight, scale (min 1, max 5), rubric anchors for 1/3/5, and a non-empty checklist.
|
|
85
|
+
- Exactly one specification emitted; no scoring content present.
|
|
86
|
+
- No files modified (read-only enforced).
|
|
87
|
+
|
|
88
|
+
## Memory Boundary
|
|
89
|
+
Suggest durable memories only when a rubric shape proves reusable across evaluation tasks. The
|
|
90
|
+
main agent persists. Do not persist one-off specifications.
|
|
@@ -5,7 +5,7 @@ license: MIT
|
|
|
5
5
|
metadata:
|
|
6
6
|
author: S1LV4, luizgmassa
|
|
7
7
|
version: "1.0.0"
|
|
8
|
-
|
|
8
|
+
model_tier: standard
|
|
9
9
|
permission: read-only
|
|
10
10
|
---
|
|
11
11
|
|
|
@@ -75,9 +75,6 @@ If none are present, refuse with: `Non-mobile target. Refusing mobile-specialist
|
|
|
75
75
|
- Synapse: own ephemeral session when guidance spans multiple mobile modules with repeated searches.
|
|
76
76
|
- References: `references/mobile-context.md`, `references/mobile-diagnosis.md`, `references/maestro.md`.
|
|
77
77
|
|
|
78
|
-
## Model Hint
|
|
79
|
-
GLM-5.2 (advisory). Fallback to the workflow's configured default model if unavailable.
|
|
80
|
-
|
|
81
78
|
## Validation Sensors
|
|
82
79
|
- At least one detection signal is confirmed present before guidance is given.
|
|
83
80
|
- Every finding has a `path:line` pointer or a platform constraint citation.
|
|
@@ -5,7 +5,7 @@ license: MIT
|
|
|
5
5
|
metadata:
|
|
6
6
|
author: S1LV4, luizgmassa
|
|
7
7
|
version: "1.0.0"
|
|
8
|
-
|
|
8
|
+
model_tier: light
|
|
9
9
|
permission: read-only
|
|
10
10
|
tools: mcp-index
|
|
11
11
|
---
|
|
@@ -68,9 +68,6 @@ The user's codebase is **already indexed** by massa-ai. The first move on any qu
|
|
|
68
68
|
- Massa-ai Memory: suggest durable navigation facts (entry points, ownership boundaries) only when reusable; the main agent persists.
|
|
69
69
|
- References: `references/mcp-tools.md`, `references/codebase-investigation.md`, `references/synapse-policy.md`, `references/context-firewall.md`.
|
|
70
70
|
|
|
71
|
-
## Model Hint
|
|
72
|
-
DeepSeek V4 Pro (advisory). Fallback to the workflow's configured default model if unavailable.
|
|
73
|
-
|
|
74
71
|
## Validation Sensors
|
|
75
72
|
- Every claim carries a `path:line` or symbol pointer.
|
|
76
73
|
- Index-derived claims carry freshness evidence, or are labeled reduced-confidence.
|
|
@@ -5,7 +5,7 @@ license: MIT
|
|
|
5
5
|
metadata:
|
|
6
6
|
author: S1LV4, luizgmassa
|
|
7
7
|
version: "1.0.0"
|
|
8
|
-
|
|
8
|
+
model_tier: deep
|
|
9
9
|
permission: read-only
|
|
10
10
|
---
|
|
11
11
|
|
|
@@ -81,9 +81,6 @@ Never receives full conversation context.
|
|
|
81
81
|
- Policy: the main agent owns mode selection, synthesis, plan revision, and the Evidence Gate; this agent owns the critique only.
|
|
82
82
|
- References: `references/agent-orchestration.md`, `references/the-fool/`, `references/verification-ladder.md`.
|
|
83
83
|
|
|
84
|
-
## Model Hint
|
|
85
|
-
MiniMax M3 (advisory). Fallback to the workflow's configured default model if unavailable.
|
|
86
|
-
|
|
87
84
|
## Validation Sensors
|
|
88
85
|
- Every challenge ties to a plan section plus a concrete evidence gap or falsifiable check.
|
|
89
86
|
- No challenge rests on missing conversation history that the packet intentionally excluded.
|
|
@@ -5,7 +5,7 @@ license: MIT
|
|
|
5
5
|
metadata:
|
|
6
6
|
author: S1LV4, luizgmassa
|
|
7
7
|
version: "1.0.0"
|
|
8
|
-
|
|
8
|
+
model_tier: deep
|
|
9
9
|
permission: read-only
|
|
10
10
|
---
|
|
11
11
|
|
|
@@ -58,9 +58,6 @@ Transform an engineering request into a structured implementation plan.
|
|
|
58
58
|
- Synapse: none (planning is not a repeated-search task).
|
|
59
59
|
- References: `references/agent-orchestration.md`, `references/subagent-design.md`.
|
|
60
60
|
|
|
61
|
-
## Model Hint
|
|
62
|
-
GLM-5.2 (advisory). Fallback to the workflow's configured default model if unavailable.
|
|
63
|
-
|
|
64
61
|
## Validation Sensors
|
|
65
62
|
- Every step in the plan references a concrete file, module, or task.
|
|
66
63
|
- Every risk has a mitigation or accepted-risk note.
|
|
@@ -5,7 +5,7 @@ license: MIT
|
|
|
5
5
|
metadata:
|
|
6
6
|
author: S1LV4, luizgmassa
|
|
7
7
|
version: "1.0.0"
|
|
8
|
-
|
|
8
|
+
model_tier: standard
|
|
9
9
|
permission: read-only
|
|
10
10
|
---
|
|
11
11
|
|
|
@@ -57,9 +57,6 @@ Analyze requirements before implementation to surface ambiguity, gaps, contradic
|
|
|
57
57
|
- Synapse: none (analysis is not a repeated-search task).
|
|
58
58
|
- References: `references/spec-driven/specify.md`, `references/furps/`.
|
|
59
59
|
|
|
60
|
-
## Model Hint
|
|
61
|
-
DeepSeek V4 Pro (advisory). Fallback to the workflow's configured default model if unavailable.
|
|
62
|
-
|
|
63
60
|
## Validation Sensors
|
|
64
61
|
- Every finding cites a requirement ID or spec section.
|
|
65
62
|
- Every implicit requirement is flagged for user acceptance or recorded as an assumption.
|
|
@@ -5,7 +5,7 @@ license: MIT
|
|
|
5
5
|
metadata:
|
|
6
6
|
author: S1LV4, luizgmassa
|
|
7
7
|
version: "1.0.0"
|
|
8
|
-
|
|
8
|
+
model_tier: standard
|
|
9
9
|
permission: read-only
|
|
10
10
|
---
|
|
11
11
|
|
|
@@ -59,9 +59,6 @@ Review implementation quality by analyzing the diff and flagging bugs, regressio
|
|
|
59
59
|
- Synapse: none (review is not a repeated-search task).
|
|
60
60
|
- References: `references/agent-orchestration.md`.
|
|
61
61
|
|
|
62
|
-
## Model Hint
|
|
63
|
-
GLM-5.2 (advisory). Fallback to the workflow's configured default model if unavailable.
|
|
64
|
-
|
|
65
62
|
## Validation Sensors
|
|
66
63
|
- Every finding has a `path:line` pointer.
|
|
67
64
|
- Static checks (lint, typecheck) run when available.
|
|
@@ -5,7 +5,7 @@ license: MIT
|
|
|
5
5
|
metadata:
|
|
6
6
|
author: S1LV4, luizgmassa
|
|
7
7
|
version: "1.0.0"
|
|
8
|
-
|
|
8
|
+
model_tier: standard
|
|
9
9
|
permission: write
|
|
10
10
|
---
|
|
11
11
|
|
|
@@ -59,9 +59,6 @@ Generate a testing strategy that covers unit, integration, edge cases, negative
|
|
|
59
59
|
- Synapse: none (test planning is not a repeated-search task).
|
|
60
60
|
- References: `references/verification-ladder.md`, `references/code-annotation.md`, `references/root-cause-scripts.md`.
|
|
61
61
|
|
|
62
|
-
## Model Hint
|
|
63
|
-
GLM-5.2 (advisory). Fallback to the workflow's configured default model if unavailable.
|
|
64
|
-
|
|
65
62
|
## Validation Sensors
|
|
66
63
|
- Every acceptance criterion maps to at least one test case.
|
|
67
64
|
- Edge cases and negative scenarios are enumerated.
|
|
@@ -5,7 +5,7 @@ license: MIT
|
|
|
5
5
|
metadata:
|
|
6
6
|
author: S1LV4, luizgmassa
|
|
7
7
|
version: "1.0.0"
|
|
8
|
-
|
|
8
|
+
model_tier: standard
|
|
9
9
|
permission: read-only
|
|
10
10
|
---
|
|
11
11
|
|
|
@@ -57,9 +57,6 @@ Centralize Verification Ladder logic and validate that a task's output meets its
|
|
|
57
57
|
- Synapse: none (verification is not a repeated-search task).
|
|
58
58
|
- References: `references/verification-ladder.md`, `references/evidence-gate.md`.
|
|
59
59
|
|
|
60
|
-
## Model Hint
|
|
61
|
-
GLM-5.2 (advisory). Fallback to the workflow's configured default model if unavailable.
|
|
62
|
-
|
|
63
60
|
## Validation Sensors
|
|
64
61
|
- Every acceptance criterion has a PASS/FAIL verdict with evidence.
|
|
65
62
|
- Skipped checks have a concrete reason.
|
package/skills/massa-ai/SKILL.md
CHANGED
|
@@ -145,6 +145,7 @@ current context already contains it.
|
|
|
145
145
|
| `ticket` | draft and create Jira Epics, issues, and sub-tasks through Atlassian MCP | `workflows/ticket.md` |
|
|
146
146
|
| `commit` | draft or create safe Conventional Commits with Jira branch prefixes and audit report exclusions | `workflows/commit.md` |
|
|
147
147
|
| `the-fool` | direct challenge, red-team, pre-mortem, evidence audit | `workflows/the-fool.md` |
|
|
148
|
+
| `judge-with-debate` | standalone multi-judge debate evaluation of user-supplied artifacts | `workflows/judge-with-debate.md` |
|
|
148
149
|
| `furps-refinement` | FURPS+ refinement of a PRD and/or ADR before implementation, with The Fool pre-validation and DoR coverage | `workflows/refinement/furps-refinement.md` |
|
|
149
150
|
| `general` | coding work with no more specific workflow | `workflows/general.md` |
|
|
150
151
|
|
|
@@ -29,6 +29,14 @@ audits/mobile-figma/<YYYY-MM-DD mobile-figma-audit.md>
|
|
|
29
29
|
audits/maestro/<YYYY-MM-DD maestro-audit.md>
|
|
30
30
|
```
|
|
31
31
|
|
|
32
|
+
Judge-with-debate evaluation reports use their own family (no `-audit` suffix — recorded
|
|
33
|
+
deviation: these are evaluation-scored reports, not findings-shaped audits):
|
|
34
|
+
|
|
35
|
+
```text
|
|
36
|
+
audits/judge/<YYYY-MM-DD judge-with-debate judge-N.md> (N = 1|2|3, one per judge)
|
|
37
|
+
audits/judge/<YYYY-MM-DD judge-with-debate consensus.md>
|
|
38
|
+
```
|
|
39
|
+
|
|
32
40
|
Use the local current date. Create the required directory when missing. Do not silently overwrite a different run; ask the user or choose a deterministic suffix and state the deviation. Suffix rule: use `-2`, `-3`, etc. for same-day same-target collisions in one session; use `-<HHMMSS>` only when existing files do not reveal a stable sequence.
|
|
33
41
|
|
|
34
42
|
## Report Schema v2 Determinism
|
|
@@ -398,6 +406,105 @@ Verification Suggestion: <Maestro command, JUnit report check, artifact inspecti
|
|
|
398
406
|
|
|
399
407
|
Only executable flow, fixture, setup/teardown, test-data, or directly scoped Maestro CI/report issues become `MST-*` findings. App bugs, product behavior gaps, backend defects, and unclear requirements must route to `debug`, `feature`, or `requirements-audit` instead of `maestro-fix`.
|
|
400
408
|
|
|
409
|
+
## Judge With Debate Report Contracts
|
|
410
|
+
|
|
411
|
+
Reports produced by `workflows/judge-with-debate.md`. This family is **evaluation-scored, not
|
|
412
|
+
findings-shaped**: no `Findings` section, no severity/confidence finding IDs, and the
|
|
413
|
+
finding-prefix table does not apply. The path shape deviates from the `<...-audit>` suffix
|
|
414
|
+
convention (`audits/judge/<YYYY-MM-DD judge-with-debate ...>`) — deviation recorded here. No
|
|
415
|
+
downstream fix-workflow consumes these reports today; execution-input selection rules are N/A.
|
|
416
|
+
|
|
417
|
+
### Per-Judge Report — `audits/judge/<YYYY-MM-DD judge-with-debate judge-N.md>`
|
|
418
|
+
|
|
419
|
+
Written by judge N at round 0; debate rounds **append** `## Debate Round {R}` sections
|
|
420
|
+
(append-only). Required fields:
|
|
421
|
+
|
|
422
|
+
```md
|
|
423
|
+
# Judge N Evaluation — <target>
|
|
424
|
+
|
|
425
|
+
Date: <YYYY-MM-DD>
|
|
426
|
+
Workflow: judge-with-debate
|
|
427
|
+
ProjectId: <projectId>
|
|
428
|
+
WorkflowSessionId: <judge-with-debate-[entity]>
|
|
429
|
+
Target: <evaluated artifact>
|
|
430
|
+
Target Focus: <paths, task description>
|
|
431
|
+
Scope: <artifact paths | diff | prompt-supplied artifact>
|
|
432
|
+
Git Base: <sha/ref or n/a>
|
|
433
|
+
Git Head: <sha/ref, working-tree, or n/a>
|
|
434
|
+
Source Evidence Timestamp: <YYYY-MM-DD HH:MM local time, or unavailable>
|
|
435
|
+
Judge: N (1|2|3)
|
|
436
|
+
Model Requested: <slot pin: deepseek-v4-pro | minimax-m3 | GLM-5.2>
|
|
437
|
+
Model Note: <fallback state or n/a>
|
|
438
|
+
|
|
439
|
+
## Evaluation Specification
|
|
440
|
+
<meta-judge YAML, embedded verbatim once>
|
|
441
|
+
|
|
442
|
+
## Criterion Scores
|
|
443
|
+
### <criterion id> — <score>/<scale.max> (weight <w>)
|
|
444
|
+
Evidence: <exact quotes from the artifact>
|
|
445
|
+
Justification: <text>
|
|
446
|
+
|
|
447
|
+
## Weighted Overall: <score>
|
|
448
|
+
|
|
449
|
+
## Strengths
|
|
450
|
+
## Weaknesses
|
|
451
|
+
|
|
452
|
+
## Verification/Test Fidelity Checklist
|
|
453
|
+
| Item | Evidence |
|
|
454
|
+
|---|---|
|
|
455
|
+
| Deterministic sensor | <eval-spec YAML + artifact paths + quoted evidence, or not available with reason> |
|
|
456
|
+
| Result | <pass, fail, not run, or not applicable> |
|
|
457
|
+
| Coverage target | <criterion IDs scored> |
|
|
458
|
+
| Validation assets protected | <none> |
|
|
459
|
+
| Skipped-check reason | <none or allowed skipped-check reason> |
|
|
460
|
+
| Execution handoff | <own file path + consensus file path> |
|
|
461
|
+
|
|
462
|
+
## Debate Round {R} (appended per round; absent when consensus at round 0)
|
|
463
|
+
Disagreements (>1.0 gap): <criterion, own score, peer score>
|
|
464
|
+
Defense: <quoted evidence>
|
|
465
|
+
Challenges: <quoted counter-evidence>
|
|
466
|
+
Revision decision: <held | revised old→new + why the evidence was compelling>
|
|
467
|
+
```
|
|
468
|
+
|
|
469
|
+
### Consensus Report — `audits/judge/<YYYY-MM-DD judge-with-debate consensus.md>`
|
|
470
|
+
|
|
471
|
+
Written by the orchestrator from judge reply blocks (it never opens judge-N files). Required
|
|
472
|
+
fields: the same freshness header (minus Judge/Model lines) plus:
|
|
473
|
+
|
|
474
|
+
```md
|
|
475
|
+
Rounds to consensus: <0..3>
|
|
476
|
+
Diversity: <OK | DIVERSITY DEGRADED: <slots and actual models>>
|
|
477
|
+
Local fallbacks: <none | judge-N local, reason>
|
|
478
|
+
|
|
479
|
+
## Consensus Scores
|
|
480
|
+
| Criterion | Judge 1 | Judge 2 | Judge 3 | Final (mean) |
|
|
481
|
+
(+ overall row)
|
|
482
|
+
|
|
483
|
+
## Consensus Strengths
|
|
484
|
+
## Consensus Weaknesses
|
|
485
|
+
(intersection of judge replies)
|
|
486
|
+
|
|
487
|
+
## Debate Summary
|
|
488
|
+
<initial disagreements and how each resolved, from reply revisions>
|
|
489
|
+
|
|
490
|
+
## Final Recommendation
|
|
491
|
+
<Pass | Fail | Needs Revision — justification tied to the scores>
|
|
492
|
+
|
|
493
|
+
## Verification/Test Fidelity Checklist
|
|
494
|
+
| Item | Evidence |
|
|
495
|
+
|---|---|
|
|
496
|
+
| Deterministic sensor | <protocol artifacts on disk (3 judge files) + reply blocks> |
|
|
497
|
+
| Result | <pass | fail> |
|
|
498
|
+
| Coverage target | <spec JD-01..09 behavior executed> |
|
|
499
|
+
| Validation assets protected | <none> |
|
|
500
|
+
| Skipped-check reason | <none or allowed skipped-check reason> |
|
|
501
|
+
| Execution handoff | <all report paths> |
|
|
502
|
+
```
|
|
503
|
+
|
|
504
|
+
A **no-consensus report** uses the same shape with `Final Recommendation: NO CONSENSUS — human
|
|
505
|
+
review required`, the per-judge table showing unresolved gaps, and the `Debate Summary` naming
|
|
506
|
+
the criteria that never converged. A forced verdict is never emitted.
|
|
507
|
+
|
|
401
508
|
## Required Finding Fields
|
|
402
509
|
|
|
403
510
|
All findings require severity, confidence, location, concrete evidence, impact, smallest fix direction, and verification suggestion. Workflow-specific fields are mandatory:
|