incitaciones 0.1.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/LICENSE +395 -0
- package/README.md +410 -0
- package/content/distilled/abstraction-miner.md +32 -0
- package/content/distilled/adversarial-stakeholder-evaluation.md +121 -0
- package/content/distilled/anti-slop-prose.md +46 -0
- package/content/distilled/bias-audit.md +39 -0
- package/content/distilled/code-review/SKILL.md +53 -0
- package/content/distilled/code-review/references/criteria.md +50 -0
- package/content/distilled/code-review/references/templates.md +75 -0
- package/content/distilled/code-review/references/variants.md +32 -0
- package/content/distilled/commit/SKILL.md +41 -0
- package/content/distilled/commit/references/criteria.md +21 -0
- package/content/distilled/commit/references/templates.md +46 -0
- package/content/distilled/composability-diagnostician.md +67 -0
- package/content/distilled/context-guardian.md +20 -0
- package/content/distilled/create-handoff/SKILL.md +16 -0
- package/content/distilled/create-handoff/references/handoff-template.md +65 -0
- package/content/distilled/create-handoff/references/naming.md +7 -0
- package/content/distilled/create-issues/SKILL.md +72 -0
- package/content/distilled/create-issues/references/criteria.md +44 -0
- package/content/distilled/create-issues/references/templates.md +75 -0
- package/content/distilled/create-plan/SKILL.md +19 -0
- package/content/distilled/create-plan/references/plan-template.md +87 -0
- package/content/distilled/create-plan/references/scenarios.md +19 -0
- package/content/distilled/debug/SKILL.md +42 -0
- package/content/distilled/debug/references/criteria.md +27 -0
- package/content/distilled/debug/references/templates.md +39 -0
- package/content/distilled/describe-pr/SKILL.md +17 -0
- package/content/distilled/describe-pr/references/pr-template.md +62 -0
- package/content/distilled/design-practice.md +213 -0
- package/content/distilled/design-review/SKILL.md +29 -0
- package/content/distilled/design-review/references/combined-review.md +27 -0
- package/content/distilled/design-review/references/decision-matrix.md +122 -0
- package/content/distilled/design-review/references/problem-statement.md +141 -0
- package/content/distilled/design-review/references/report-template.md +36 -0
- package/content/distilled/design-review/references/scope-document.md +51 -0
- package/content/distilled/distill-prompt/SKILL.md +41 -0
- package/content/distilled/distill-prompt/references/criteria.md +26 -0
- package/content/distilled/distill-prompt/references/templates.md +30 -0
- package/content/distilled/doc-link-verifier/SKILL.md +212 -0
- package/content/distilled/doc-link-verifier/scripts/check_links.py +453 -0
- package/content/distilled/doc-link-verifier/scripts/extract_links.py +521 -0
- package/content/distilled/edge-case-discovery.md +123 -0
- package/content/distilled/error-handling-diagnostician.md +90 -0
- package/content/distilled/extract-prompt.md +220 -0
- package/content/distilled/formal-verification-evaluator.md +158 -0
- package/content/distilled/grill-me.md +24 -0
- package/content/distilled/guided-review.md +68 -0
- package/content/distilled/implement-documentation.md +68 -0
- package/content/distilled/implement-plan/SKILL.md +23 -0
- package/content/distilled/implement-plan/references/common-situations.md +36 -0
- package/content/distilled/implement-plan/references/verification-template.md +18 -0
- package/content/distilled/invalid-states-diagnostician.md +63 -0
- package/content/distilled/issue-review/SKILL.md +37 -0
- package/content/distilled/issue-review/references/convergence.md +19 -0
- package/content/distilled/issue-review/references/final-report.md +60 -0
- package/content/distilled/issue-review/references/pass-1-clarity.md +28 -0
- package/content/distilled/issue-review/references/pass-2-scope.md +22 -0
- package/content/distilled/issue-review/references/pass-3-dependencies.md +23 -0
- package/content/distilled/issue-review/references/pass-4-alignment.md +17 -0
- package/content/distilled/issue-review/references/pass-5-executability.md +17 -0
- package/content/distilled/issue-review/references/setup.md +25 -0
- package/content/distilled/iterate-plan/SKILL.md +24 -0
- package/content/distilled/iterate-plan/references/change-template.md +15 -0
- package/content/distilled/iterate-plan/references/common-scenarios.md +14 -0
- package/content/distilled/julia-performance-diagnostician.md +71 -0
- package/content/distilled/modularity-diagnostician.md +68 -0
- package/content/distilled/multi-agent-review.md +196 -0
- package/content/distilled/mutability-diagnostician.md +63 -0
- package/content/distilled/narrative-article.md +60 -0
- package/content/distilled/optionality-review.md +190 -0
- package/content/distilled/parallel-review/SKILL.md +49 -0
- package/content/distilled/parallel-review/references/criteria.md +34 -0
- package/content/distilled/parallel-review/references/templates.md +59 -0
- package/content/distilled/plan-review/SKILL.md +42 -0
- package/content/distilled/plan-review/references/criteria.md +51 -0
- package/content/distilled/plan-review/references/templates.md +67 -0
- package/content/distilled/pre-mortem.md +10 -0
- package/content/distilled/project-status-report.md +124 -0
- package/content/distilled/pwa-accessibility-review.md +81 -0
- package/content/distilled/rca-diagnostician/SKILL.md +30 -0
- package/content/distilled/rca-diagnostician/references/action-hierarchy.md +77 -0
- package/content/distilled/rca-diagnostician/references/bias-countermeasures.md +64 -0
- package/content/distilled/rca-diagnostician/references/evidence-timeline.md +49 -0
- package/content/distilled/rca-diagnostician/references/hypothesis-methods.md +53 -0
- package/content/distilled/rca-diagnostician/references/problem-definition.md +34 -0
- package/content/distilled/rca-diagnostician/references/report-template.md +75 -0
- package/content/distilled/rca-diagnostician/references/rigor-checklist.md +66 -0
- package/content/distilled/red-team-review.md +133 -0
- package/content/distilled/research-codebase/SKILL.md +22 -0
- package/content/distilled/research-codebase/references/report-template.md +75 -0
- package/content/distilled/research-codebase/references/search-patterns.md +27 -0
- package/content/distilled/research-documentation.md +79 -0
- package/content/distilled/research-review/SKILL.md +42 -0
- package/content/distilled/research-review/references/criteria.md +51 -0
- package/content/distilled/research-review/references/templates.md +73 -0
- package/content/distilled/resonant-refactor.md +45 -0
- package/content/distilled/resume-handoff/SKILL.md +19 -0
- package/content/distilled/resume-handoff/references/analysis-template.md +40 -0
- package/content/distilled/resume-handoff/references/locating.md +12 -0
- package/content/distilled/review-documentation.md +44 -0
- package/content/distilled/rigidity-diagnostician.md +70 -0
- package/content/distilled/rule-of-5-universal/SKILL.md +26 -0
- package/content/distilled/rule-of-5-universal/references/criteria.md +34 -0
- package/content/distilled/rule-of-5-universal/references/examples.md +69 -0
- package/content/distilled/rule-of-5-universal/references/templates.md +136 -0
- package/content/distilled/specification-evaluation-diagnostician.md +106 -0
- package/content/distilled/specification-review/SKILL.md +43 -0
- package/content/distilled/specification-review/references/criteria.md +51 -0
- package/content/distilled/specification-review/references/templates.md +67 -0
- package/content/distilled/systematic-housekeeping.md +27 -0
- package/content/distilled/tdd/SKILL.md +38 -0
- package/content/distilled/tdd/references/criteria.md +26 -0
- package/content/distilled/tdd/references/templates.md +53 -0
- package/content/distilled/test-abstraction-miner.md +43 -0
- package/content/distilled/test-friction.md +51 -0
- package/content/distilled/testability-implementability-evaluator.md +144 -0
- package/content/distilled/ui-align.md +32 -0
- package/content/distilled/ux-dx-evaluation-diagnostician/SKILL.md +21 -0
- package/content/distilled/ux-dx-evaluation-diagnostician/references/layer-1-product.md +20 -0
- package/content/distilled/ux-dx-evaluation-diagnostician/references/layer-2-engineering.md +20 -0
- package/content/distilled/ux-dx-evaluation-diagnostician/references/layer-3-interface.md +23 -0
- package/content/distilled/ux-dx-evaluation-diagnostician/references/layer-4-ecosystem.md +20 -0
- package/content/distilled/ux-dx-evaluation-diagnostician/references/layer-5-documentation.md +19 -0
- package/content/distilled/ux-dx-evaluation-diagnostician/references/report-template.md +36 -0
- package/content/distilled/verification-diagnostician.md +90 -0
- package/content/distilled/verify-prompt/SKILL.md +32 -0
- package/content/distilled/verify-prompt/references/criteria.md +21 -0
- package/content/manifest.json +3220 -0
- package/package.json +50 -0
- package/pi-package/README.md +9 -0
- package/pi-package/prompts/abstraction-miner.md +10 -0
- package/pi-package/prompts/adversarial-stakeholder-evaluation.md +10 -0
- package/pi-package/prompts/anti-slop-prose.md +10 -0
- package/pi-package/prompts/bias-audit.md +10 -0
- package/pi-package/prompts/code-review.md +10 -0
- package/pi-package/prompts/commit.md +10 -0
- package/pi-package/prompts/composability-diagnostician.md +10 -0
- package/pi-package/prompts/context-guardian.md +10 -0
- package/pi-package/prompts/create-handoff.md +10 -0
- package/pi-package/prompts/create-issues.md +10 -0
- package/pi-package/prompts/create-plan.md +10 -0
- package/pi-package/prompts/debug.md +10 -0
- package/pi-package/prompts/describe-pr.md +10 -0
- package/pi-package/prompts/design-practice.md +10 -0
- package/pi-package/prompts/design-review.md +10 -0
- package/pi-package/prompts/distill-prompt.md +10 -0
- package/pi-package/prompts/doc-link-verifier.md +10 -0
- package/pi-package/prompts/edge-case-discovery.md +10 -0
- package/pi-package/prompts/error-handling-diagnostician.md +10 -0
- package/pi-package/prompts/extract-prompt.md +10 -0
- package/pi-package/prompts/formal-verification-evaluator.md +10 -0
- package/pi-package/prompts/grill-me.md +10 -0
- package/pi-package/prompts/guided-review.md +10 -0
- package/pi-package/prompts/implement-documentation.md +10 -0
- package/pi-package/prompts/implement-plan.md +10 -0
- package/pi-package/prompts/invalid-states-diagnostician.md +10 -0
- package/pi-package/prompts/issue-review.md +10 -0
- package/pi-package/prompts/iterate-plan.md +10 -0
- package/pi-package/prompts/julia-performance-diagnostician.md +10 -0
- package/pi-package/prompts/modularity-diagnostician.md +10 -0
- package/pi-package/prompts/multi-agent-review.md +10 -0
- package/pi-package/prompts/mutability-diagnostician.md +10 -0
- package/pi-package/prompts/narrative-article.md +10 -0
- package/pi-package/prompts/optionality-review.md +10 -0
- package/pi-package/prompts/parallel-review.md +10 -0
- package/pi-package/prompts/plan-review.md +10 -0
- package/pi-package/prompts/pre-mortem.md +10 -0
- package/pi-package/prompts/project-status-report.md +10 -0
- package/pi-package/prompts/pwa-accessibility-review.md +10 -0
- package/pi-package/prompts/rca-diagnostician.md +10 -0
- package/pi-package/prompts/red-team-review.md +10 -0
- package/pi-package/prompts/research-codebase.md +10 -0
- package/pi-package/prompts/research-documentation.md +10 -0
- package/pi-package/prompts/research-review.md +10 -0
- package/pi-package/prompts/resonant-refactor.md +10 -0
- package/pi-package/prompts/resume-handoff.md +10 -0
- package/pi-package/prompts/review-documentation.md +10 -0
- package/pi-package/prompts/rigidity-diagnostician.md +10 -0
- package/pi-package/prompts/rule-of-5-universal.md +10 -0
- package/pi-package/prompts/specification-evaluation-diagnostician.md +10 -0
- package/pi-package/prompts/specification-review.md +10 -0
- package/pi-package/prompts/systematic-housekeeping.md +10 -0
- package/pi-package/prompts/tdd.md +10 -0
- package/pi-package/prompts/test-abstraction-miner.md +10 -0
- package/pi-package/prompts/test-friction.md +10 -0
- package/pi-package/prompts/testability-implementability-evaluator.md +10 -0
- package/pi-package/prompts/ui-align.md +10 -0
- package/pi-package/prompts/ux-dx-evaluation-diagnostician.md +10 -0
- package/pi-package/prompts/verification-diagnostician.md +10 -0
- package/pi-package/prompts/verify-prompt.md +10 -0
- package/pi-package/skills/abstraction-miner/SKILL.md +38 -0
- package/pi-package/skills/adversarial-stakeholder-evaluation/SKILL.md +127 -0
- package/pi-package/skills/anti-slop-prose/SKILL.md +52 -0
- package/pi-package/skills/bias-audit/SKILL.md +45 -0
- package/pi-package/skills/code-review/SKILL.md +59 -0
- package/pi-package/skills/code-review/references/criteria.md +50 -0
- package/pi-package/skills/code-review/references/templates.md +75 -0
- package/pi-package/skills/code-review/references/variants.md +32 -0
- package/pi-package/skills/commit/SKILL.md +47 -0
- package/pi-package/skills/commit/references/criteria.md +21 -0
- package/pi-package/skills/commit/references/templates.md +46 -0
- package/pi-package/skills/composability-diagnostician/SKILL.md +73 -0
- package/pi-package/skills/context-guardian/SKILL.md +26 -0
- package/pi-package/skills/create-handoff/SKILL.md +22 -0
- package/pi-package/skills/create-handoff/references/handoff-template.md +65 -0
- package/pi-package/skills/create-handoff/references/naming.md +7 -0
- package/pi-package/skills/create-issues/SKILL.md +78 -0
- package/pi-package/skills/create-issues/references/criteria.md +44 -0
- package/pi-package/skills/create-issues/references/templates.md +75 -0
- package/pi-package/skills/create-plan/SKILL.md +25 -0
- package/pi-package/skills/create-plan/references/plan-template.md +87 -0
- package/pi-package/skills/create-plan/references/scenarios.md +19 -0
- package/pi-package/skills/debug/SKILL.md +48 -0
- package/pi-package/skills/debug/references/criteria.md +27 -0
- package/pi-package/skills/debug/references/templates.md +39 -0
- package/pi-package/skills/describe-pr/SKILL.md +23 -0
- package/pi-package/skills/describe-pr/references/pr-template.md +62 -0
- package/pi-package/skills/design-practice/SKILL.md +219 -0
- package/pi-package/skills/design-review/SKILL.md +35 -0
- package/pi-package/skills/design-review/references/combined-review.md +27 -0
- package/pi-package/skills/design-review/references/decision-matrix.md +122 -0
- package/pi-package/skills/design-review/references/problem-statement.md +141 -0
- package/pi-package/skills/design-review/references/report-template.md +36 -0
- package/pi-package/skills/design-review/references/scope-document.md +51 -0
- package/pi-package/skills/distill-prompt/SKILL.md +47 -0
- package/pi-package/skills/distill-prompt/references/criteria.md +26 -0
- package/pi-package/skills/distill-prompt/references/templates.md +30 -0
- package/pi-package/skills/doc-link-verifier/SKILL.md +218 -0
- package/pi-package/skills/doc-link-verifier/scripts/check_links.py +453 -0
- package/pi-package/skills/doc-link-verifier/scripts/extract_links.py +521 -0
- package/pi-package/skills/edge-case-discovery/SKILL.md +129 -0
- package/pi-package/skills/error-handling-diagnostician/SKILL.md +96 -0
- package/pi-package/skills/extract-prompt/SKILL.md +226 -0
- package/pi-package/skills/formal-verification-evaluator/SKILL.md +164 -0
- package/pi-package/skills/grill-me/SKILL.md +30 -0
- package/pi-package/skills/guided-review/SKILL.md +74 -0
- package/pi-package/skills/implement-documentation/SKILL.md +74 -0
- package/pi-package/skills/implement-plan/SKILL.md +29 -0
- package/pi-package/skills/implement-plan/references/common-situations.md +36 -0
- package/pi-package/skills/implement-plan/references/verification-template.md +18 -0
- package/pi-package/skills/invalid-states-diagnostician/SKILL.md +69 -0
- package/pi-package/skills/issue-review/SKILL.md +43 -0
- package/pi-package/skills/issue-review/references/convergence.md +19 -0
- package/pi-package/skills/issue-review/references/final-report.md +60 -0
- package/pi-package/skills/issue-review/references/pass-1-clarity.md +28 -0
- package/pi-package/skills/issue-review/references/pass-2-scope.md +22 -0
- package/pi-package/skills/issue-review/references/pass-3-dependencies.md +23 -0
- package/pi-package/skills/issue-review/references/pass-4-alignment.md +17 -0
- package/pi-package/skills/issue-review/references/pass-5-executability.md +17 -0
- package/pi-package/skills/issue-review/references/setup.md +25 -0
- package/pi-package/skills/iterate-plan/SKILL.md +30 -0
- package/pi-package/skills/iterate-plan/references/change-template.md +15 -0
- package/pi-package/skills/iterate-plan/references/common-scenarios.md +14 -0
- package/pi-package/skills/julia-performance-diagnostician/SKILL.md +77 -0
- package/pi-package/skills/modularity-diagnostician/SKILL.md +74 -0
- package/pi-package/skills/multi-agent-review/SKILL.md +202 -0
- package/pi-package/skills/mutability-diagnostician/SKILL.md +69 -0
- package/pi-package/skills/narrative-article/SKILL.md +66 -0
- package/pi-package/skills/optionality-review/SKILL.md +196 -0
- package/pi-package/skills/parallel-review/SKILL.md +55 -0
- package/pi-package/skills/parallel-review/references/criteria.md +34 -0
- package/pi-package/skills/parallel-review/references/templates.md +59 -0
- package/pi-package/skills/plan-review/SKILL.md +48 -0
- package/pi-package/skills/plan-review/references/criteria.md +51 -0
- package/pi-package/skills/plan-review/references/templates.md +67 -0
- package/pi-package/skills/pre-mortem/SKILL.md +16 -0
- package/pi-package/skills/project-status-report/SKILL.md +130 -0
- package/pi-package/skills/pwa-accessibility-review/SKILL.md +87 -0
- package/pi-package/skills/rca-diagnostician/SKILL.md +36 -0
- package/pi-package/skills/rca-diagnostician/references/action-hierarchy.md +77 -0
- package/pi-package/skills/rca-diagnostician/references/bias-countermeasures.md +64 -0
- package/pi-package/skills/rca-diagnostician/references/evidence-timeline.md +49 -0
- package/pi-package/skills/rca-diagnostician/references/hypothesis-methods.md +53 -0
- package/pi-package/skills/rca-diagnostician/references/problem-definition.md +34 -0
- package/pi-package/skills/rca-diagnostician/references/report-template.md +75 -0
- package/pi-package/skills/rca-diagnostician/references/rigor-checklist.md +66 -0
- package/pi-package/skills/red-team-review/SKILL.md +139 -0
- package/pi-package/skills/research-codebase/SKILL.md +28 -0
- package/pi-package/skills/research-codebase/references/report-template.md +75 -0
- package/pi-package/skills/research-codebase/references/search-patterns.md +27 -0
- package/pi-package/skills/research-documentation/SKILL.md +85 -0
- package/pi-package/skills/research-review/SKILL.md +48 -0
- package/pi-package/skills/research-review/references/criteria.md +51 -0
- package/pi-package/skills/research-review/references/templates.md +73 -0
- package/pi-package/skills/resonant-refactor/SKILL.md +51 -0
- package/pi-package/skills/resume-handoff/SKILL.md +25 -0
- package/pi-package/skills/resume-handoff/references/analysis-template.md +40 -0
- package/pi-package/skills/resume-handoff/references/locating.md +12 -0
- package/pi-package/skills/review-documentation/SKILL.md +50 -0
- package/pi-package/skills/rigidity-diagnostician/SKILL.md +76 -0
- package/pi-package/skills/rule-of-5-universal/SKILL.md +32 -0
- package/pi-package/skills/rule-of-5-universal/references/criteria.md +34 -0
- package/pi-package/skills/rule-of-5-universal/references/examples.md +69 -0
- package/pi-package/skills/rule-of-5-universal/references/templates.md +136 -0
- package/pi-package/skills/specification-evaluation-diagnostician/SKILL.md +112 -0
- package/pi-package/skills/specification-review/SKILL.md +49 -0
- package/pi-package/skills/specification-review/references/criteria.md +51 -0
- package/pi-package/skills/specification-review/references/templates.md +67 -0
- package/pi-package/skills/systematic-housekeeping/SKILL.md +33 -0
- package/pi-package/skills/tdd/SKILL.md +44 -0
- package/pi-package/skills/tdd/references/criteria.md +26 -0
- package/pi-package/skills/tdd/references/templates.md +53 -0
- package/pi-package/skills/test-abstraction-miner/SKILL.md +49 -0
- package/pi-package/skills/test-friction/SKILL.md +57 -0
- package/pi-package/skills/testability-implementability-evaluator/SKILL.md +150 -0
- package/pi-package/skills/ui-align/SKILL.md +38 -0
- package/pi-package/skills/ux-dx-evaluation-diagnostician/SKILL.md +27 -0
- package/pi-package/skills/ux-dx-evaluation-diagnostician/references/layer-1-product.md +20 -0
- package/pi-package/skills/ux-dx-evaluation-diagnostician/references/layer-2-engineering.md +20 -0
- package/pi-package/skills/ux-dx-evaluation-diagnostician/references/layer-3-interface.md +23 -0
- package/pi-package/skills/ux-dx-evaluation-diagnostician/references/layer-4-ecosystem.md +20 -0
- package/pi-package/skills/ux-dx-evaluation-diagnostician/references/layer-5-documentation.md +19 -0
- package/pi-package/skills/ux-dx-evaluation-diagnostician/references/report-template.md +36 -0
- package/pi-package/skills/verification-diagnostician/SKILL.md +96 -0
- package/pi-package/skills/verify-prompt/SKILL.md +38 -0
- package/pi-package/skills/verify-prompt/references/criteria.md +21 -0
- package/scripts/cli.mjs +453 -0
|
@@ -0,0 +1,144 @@
|
|
|
1
|
+
<!-- Full version: content/prompt-task-testability-implementability-evaluator.md -->
|
|
2
|
+
You are a Specification Feasibility Analyst. Evaluate software specifications across two co-dependent axes — Implementability (can it be built?) and Testability (can it be verified?) — then determine Definition of Ready status. Do NOT modify the specification — advisory only.
|
|
3
|
+
|
|
4
|
+
**GUARD:** Do not apply to draft outlines or brainstorms not yet formalized. Do not apply to specification completeness/correctness/coherence review (use specification-evaluation-diagnostician — this prompt evaluates *buildability and verifiability*). Do not apply to code review (use code-review or red-team-review). Do not apply to factual verification (use verification-diagnostician). Do not apply to trivial changes where evaluation overhead exceeds implementation cost. **This diagnostic is performed by a probabilistic model.** Treat output as structured triage, not ground truth. Critical and High findings must be verified by the engineering team.
|
|
5
|
+
|
|
6
|
+
**INPUT**
|
|
7
|
+
- Specification to evaluate: [PASTE OR SPECIFY FILE PATH]
|
|
8
|
+
- System context (optional): [architecture docs, infrastructure constraints, team capabilities — or "none"]
|
|
9
|
+
- Deployment environment (optional): [hardware, latency SLAs, legacy integrations — or "none"]
|
|
10
|
+
- Test infrastructure (optional): [test frameworks, CI/CD, mock capabilities — or "none"]
|
|
11
|
+
|
|
12
|
+
**PROTOCOL (Six-Step Pipeline)**
|
|
13
|
+
|
|
14
|
+
Step 1 — ISO 29148 Baseline Gate: Verify structural minimum before further evaluation.
|
|
15
|
+
- Missing Verifiability (Critical): unmeasurable terms — "fast," "intuitive," "acceptable."
|
|
16
|
+
- Implementation Bias (High): dictates *how* (vendor, algorithm, pattern) not *what*.
|
|
17
|
+
- Missing Traceability (High): requirements not traceable to stakeholder need or test case.
|
|
18
|
+
- Ambiguous Language (High): vague adjectives, unresolved pronouns, passive voice, universal quantifiers ("all," "every," "any").
|
|
19
|
+
- Missing Ranked Importance (Medium): no prioritization — can't make feasibility trade-offs.
|
|
20
|
+
- Compound Requirements (Medium): "and/or" joining capabilities with different feasibility profiles.
|
|
21
|
+
|
|
22
|
+
If the specification mixes mature and placeholder requirements, categorize each as EVALUABLE or PLACEHOLDER. Report placeholders as a single structural completeness finding — do not run them through Steps 2-5.
|
|
23
|
+
|
|
24
|
+
If multiple Critical baseline failures, report and recommend structural remediation before proceeding.
|
|
25
|
+
|
|
26
|
+
Step 2 — Implementability: PIECES Framework. Assess each dimension:
|
|
27
|
+
- **Performance:** Can architecture handle specified throughput/latency under peak stress? Flag: latency below physical network limits, throughput exceeding hardware, real-time on batch infrastructure.
|
|
28
|
+
- **Information:** Can system generate, organize, retrieve demanded data accurately and on time? Flag: incompatible storage joins, queries violating DB design, freshness exceeding replication lag.
|
|
29
|
+
- **Economy:** Is implementation cost justified by return? Flag: feature cost exceeding business value, 10x infrastructure for marginal capability.
|
|
30
|
+
- **Control:** Can security/compliance be enforced without breaking functionality or performance? Flag: MFA vs sub-second response, audit logging exceeding storage, encryption making latency SLAs impossible.
|
|
31
|
+
- **Efficiency:** Does spec introduce unnecessary waste? Flag: manual steps in automated pipelines, redundant transformations, requiring sync and async for same operation.
|
|
32
|
+
- **Services:** Does spec align with operational goals? Flag: uptime impossible without absent redundancy, maintainability requiring absent expertise.
|
|
33
|
+
|
|
34
|
+
Specify requirement, constraint violated, and whether issue is absolute (impossible) or conditional (possible with remediation). If no system context provided, evaluate against general engineering feasibility and caveat findings as "unverifiable without infrastructure context."
|
|
35
|
+
|
|
36
|
+
Step 3 — Implementability: GLIA Triad. While PIECES evaluates external constraints, the GLIA triad evaluates whether each requirement's *internal logic* can become deterministic code.
|
|
37
|
+
- **Computability:** Can behavior be algorithmically expressed? Failure: relies on subjective judgment without quantifiable thresholds.
|
|
38
|
+
- **Decidability:** Does spec dictate precisely *when* to execute? Failure: triggers depend on invisible external states or ambiguous conditions.
|
|
39
|
+
- **Executability:** Does spec communicate exactly *what* to do once triggered? Failure: vague directives — "optimize," "handle gracefully," "ensure quality."
|
|
40
|
+
|
|
41
|
+
Requirements failing all three dimensions are fundamentally unimplementable.
|
|
42
|
+
|
|
43
|
+
Step 4 — Testability: Bach's Five Dimensions.
|
|
44
|
+
- **Intrinsic:** Observability (can states be queried? logging specified?), Controllability (can inputs/states be manipulated for automation?), Simplicity (excessive coupling, circular dependencies?), Availability (can be tested in stages, not all-or-nothing?).
|
|
45
|
+
- **Epistemic:** How much is unknown? Novel technology, unknown failure modes, first-of-kind integrations.
|
|
46
|
+
- **Value-Related:** Does testability rigor match business criticality? Mission-critical with loose criteria = bad. Cosmetic with exhaustive tests = waste.
|
|
47
|
+
- **Project-Related:** Specs evolving faster than tests? Test data unavailable? No simulated environment? Missing documentation?
|
|
48
|
+
- **Subjective:** Does team have domain expertise to verify? Crypto/ML requirements assigned to generalists without support?
|
|
49
|
+
|
|
50
|
+
When Intrinsic Testability is low, identify specific **testability transformations**: assertion injection, dependency decoupling, logging mandates, boundary definitions for mock/harness configuration.
|
|
51
|
+
|
|
52
|
+
Step 5 — Syntax Enforcement: EARS + NLP Anti-Patterns.
|
|
53
|
+
|
|
54
|
+
*EARS Pattern Compliance* — identify which pattern each requirement matches or should match:
|
|
55
|
+
- Ubiquitous: *The \<system\> shall \<response\>* — always-active property, static analysis testable.
|
|
56
|
+
- Event-Driven: *When \<trigger\>, the \<system\> shall \<response\>* — test by simulating trigger.
|
|
57
|
+
- State-Driven: *While \<precondition\>, the \<system\> shall \<response\>* — monitor during state.
|
|
58
|
+
- Unwanted Behavior: *If \<error\>, then the \<system\> shall \<response\>* — explicit error handling.
|
|
59
|
+
- Optional Feature: *Where \<feature present\>, the \<system\> shall \<response\>* — config-dependent test matrix.
|
|
60
|
+
|
|
61
|
+
*NLP Anti-Pattern Detection:*
|
|
62
|
+
- Weak Phrases (HIGH): "adequate," "as appropriate," "sufficient" — subjective, no binary test.
|
|
63
|
+
- Options (HIGH): "can," "may," "optionally" — destroys binary verifiability.
|
|
64
|
+
- Continuances (MEDIUM): "and," "also," "below" joining requirements — obscures single responsibility.
|
|
65
|
+
- Non-Specific Temporals (HIGH): "immediately," "quickly," "in real time" — unmeasurable.
|
|
66
|
+
- Universal Quantifiers (HIGH): "all," "every," "any," "never," "always" — unbounded testing.
|
|
67
|
+
- Passive Voice (MEDIUM): "the data shall be processed" — obscures responsible component.
|
|
68
|
+
- Missing Imperative (HIGH): no "shall" — aspirational, not mandatory.
|
|
69
|
+
|
|
70
|
+
For non-compliant requirements, show current text and EARS rewrite.
|
|
71
|
+
|
|
72
|
+
Step 6 — Definition of Ready Synthesis. Score both axes:
|
|
73
|
+
|
|
74
|
+
Implementability: FEASIBLE (all PIECES clear, GLIA satisfied) | CONDITIONAL (feasible with remediation/spike) | IMPLAUSIBLE (multiple failures, no clear path, or requires fundamental architectural changes) | IMPOSSIBLE (violates physical laws or mathematical limits — no remediation can make this work).
|
|
75
|
+
|
|
76
|
+
Testability: TESTABLE (Bach dimensions adequate, EARS-compliant, observable/controllable) | PARTIAL (some dimensions weak, testable with transformations) | UNTESTABLE (multiple Bach failures, pervasive anti-patterns, no observability).
|
|
77
|
+
|
|
78
|
+
Verdict:
|
|
79
|
+
- **READY**: FEASIBLE + TESTABLE. No Critical findings. Acceptance criteria defined and automatable.
|
|
80
|
+
- **READY_WITH_SPIKES**: CONDITIONAL on spike results. Testability TESTABLE or PARTIAL with clear transformations. Spike scope and timebox defined.
|
|
81
|
+
- **NOT_READY**: IMPLAUSIBLE/IMPOSSIBLE or UNTESTABLE. Structural changes required before sprint.
|
|
82
|
+
|
|
83
|
+
**OUTPUT**
|
|
84
|
+
|
|
85
|
+
Evaluation Summary:
|
|
86
|
+
```
|
|
87
|
+
Specification: [title or path]
|
|
88
|
+
Requirements Evaluated: [count]
|
|
89
|
+
System Context Referenced: [yes/no]
|
|
90
|
+
|
|
91
|
+
Axis Scores:
|
|
92
|
+
Implementability: [FEASIBLE | CONDITIONAL | IMPLAUSIBLE | IMPOSSIBLE]
|
|
93
|
+
Testability: [TESTABLE | PARTIAL | UNTESTABLE]
|
|
94
|
+
|
|
95
|
+
Definition of Ready: [READY | READY_WITH_SPIKES | NOT_READY]
|
|
96
|
+
```
|
|
97
|
+
|
|
98
|
+
Findings — per finding (AXIS = IMPL|TEST|BASE, STEP = step number, N = finding number). Step 5 EARS/NLP findings appear here for severity tracking; the EARS Compliance Report below provides before/after rewrites for the same requirements:
|
|
99
|
+
```
|
|
100
|
+
[IMPL-2.1] [CRITICAL|HIGH|MEDIUM|LOW] — [requirement ID or section]
|
|
101
|
+
Axis: Implementability
|
|
102
|
+
Framework: PIECES / [dimension] or GLIA / [dimension]
|
|
103
|
+
Issue: [what makes this implausible or impossible]
|
|
104
|
+
Constraint: [specific limit violated]
|
|
105
|
+
Remediation: [requirement revision, spike, constraint relaxation]
|
|
106
|
+
```
|
|
107
|
+
```
|
|
108
|
+
[TEST-4.1] [CRITICAL|HIGH|MEDIUM|LOW] — [requirement ID or section]
|
|
109
|
+
Axis: Testability
|
|
110
|
+
Dimension: [Bach dimension] / [sub-dimension]
|
|
111
|
+
Issue: [what makes this untestable]
|
|
112
|
+
Impact: [what cannot be verified]
|
|
113
|
+
Transformation: [add logging, decouple, inject assertions, define boundaries]
|
|
114
|
+
```
|
|
115
|
+
|
|
116
|
+
EARS Compliance Report — for non-compliant requirements:
|
|
117
|
+
```
|
|
118
|
+
Requirement: [ID or text]
|
|
119
|
+
Current: [original text]
|
|
120
|
+
Pattern: [None or mismatched pattern]
|
|
121
|
+
Rewrite: [EARS-compliant version]
|
|
122
|
+
Pattern: [correct EARS pattern]
|
|
123
|
+
```
|
|
124
|
+
|
|
125
|
+
Confirmed Strengths: well-formed, measurable, EARS-compliant requirements the author can rely on.
|
|
126
|
+
|
|
127
|
+
Spike Recommendations (if CONDITIONAL):
|
|
128
|
+
```
|
|
129
|
+
Spike: [name]
|
|
130
|
+
Validates: [requirement IDs]
|
|
131
|
+
Question: [what spike must answer]
|
|
132
|
+
Timebox: [duration]
|
|
133
|
+
Success Criteria: [what constitutes conclusive result]
|
|
134
|
+
```
|
|
135
|
+
|
|
136
|
+
Needs Human Judgment: implementability/testability tensions, missing infrastructure context, cost/benefit trade-offs, team expertise unknowns.
|
|
137
|
+
|
|
138
|
+
Verdict Rationale: one paragraph — what drives the rating, weaker axis, what would change verdict to READY.
|
|
139
|
+
|
|
140
|
+
Severity: CRITICAL = blocks implementation or verification, physically impossible, governance violations. HIGH = significant feasibility gaps, testability failures, pervasive anti-patterns. MEDIUM = missing traceability, weak phrases, passive voice. LOW = style inconsistency, minor formatting.
|
|
141
|
+
|
|
142
|
+
PIECES requires context — without infrastructure/budget knowledge, evaluation is theoretical, not practical. EARS is syntax, not semantics — structural testability, not correctness. Not every requirement needs EARS — behavioral requirements driving test cases benefit most. Do not fabricate findings.
|
|
143
|
+
|
|
144
|
+
Stop when all requirements evaluated across all six steps. Do not modify the specification. If no issues found: "Specification passes evaluation. Implementability: FEASIBLE, Testability: TESTABLE. Definition of Ready: READY. No remediations proposed." Do not fabricate findings.
|
|
@@ -0,0 +1,32 @@
|
|
|
1
|
+
# UI_ALIGN: VIBE-TO-SPEC (DISTILLED)
|
|
2
|
+
|
|
3
|
+
Expert UI Product Engineer: Move from "vibe" to verified implementation contract using `content/research-llm-ui-workflow-methodology.md`.
|
|
4
|
+
|
|
5
|
+
## MANDATORY MANDATES
|
|
6
|
+
1. **Layered Stack:** Separate **Intent** (EARS), **Plan** (Typed tasks.md), and **Evidence** (Test outcomes).
|
|
7
|
+
2. **FSM Governance:** Resolve: Initial/Terminal states and specific event triggers for all transitions.
|
|
8
|
+
3. **Selector Policy:** `role + accessible name` > `label` > `testid` >> `css/xpath` (forbidden).
|
|
9
|
+
4. **Observable Waits:** Forbid `sleep`. Anchor to element visibility, text change, or network idle.
|
|
10
|
+
5. **Semantic Retries:** Check for success evidence before re-executing mutations.
|
|
11
|
+
|
|
12
|
+
## PROCESS
|
|
13
|
+
|
|
14
|
+
### Phase 1: Interactive Alignment
|
|
15
|
+
- **Protocol:** Adopt the **GRILL_ME** protocol. Interrogate mental model focusing on **MANDATORY MANDATES**.
|
|
16
|
+
- **Constraint:** One question at a time + recommended answer.
|
|
17
|
+
|
|
18
|
+
### Phase 2: Spec Drafting (Kiro Triad)
|
|
19
|
+
Draft in unique subdirectory `specs/<feature-name>/`:
|
|
20
|
+
1. `requirements.md`: EARS format stories (`WHEN... THEN... SHALL`).
|
|
21
|
+
2. `design.md`: Mermaid FSM graph + component architecture.
|
|
22
|
+
3. `tasks.md`: Phased Typed Plan (Red -> Green -> Refactor).
|
|
23
|
+
|
|
24
|
+
### Phase 3: Methodology Verification
|
|
25
|
+
- **Audit:** Run **SPECIFICATION_REVIEW** on drafted spec.
|
|
26
|
+
- **Focus:** Amnesia Test (standalone-complete), Precision (no weak words), Behavioral Coverage (GIVEN-WHEN-THEN).
|
|
27
|
+
- **Loop:** If verdict is `NEEDS_REVISION`, return to Phase 2 to resolve findings before implementation.
|
|
28
|
+
|
|
29
|
+
## OUTPUT
|
|
30
|
+
1. Verified Spec Package (Requirements, Design, Tasks).
|
|
31
|
+
2. Review Verdict (READY_TO_IMPLEMENT).
|
|
32
|
+
3. Implementation Strategy: TDD guardrails summary.
|
|
@@ -0,0 +1,21 @@
|
|
|
1
|
+
# UX/DX Evaluation Diagnostician
|
|
2
|
+
|
|
3
|
+
Systematically assess a target product, API, CLI, library, documentation, or codebase against industry-standard frameworks across five evaluation layers.
|
|
4
|
+
|
|
5
|
+
## Procedure
|
|
6
|
+
1. **Analyze Input:** Identify the `[TARGET]`, `[LAYER_FOCUS]`, `[AUDIENCE]`, and `[CONTEXT]`.
|
|
7
|
+
2. **Select Layers:** Determine which of the five layers apply to the target.
|
|
8
|
+
3. **Evaluate:** For each applicable layer, use the corresponding reference for detailed criteria:
|
|
9
|
+
- **Layer 1: Product (HEART):** Read `references/layer-1-product.md`.
|
|
10
|
+
- **Layer 2: Engineering (SPACE):** Read `references/layer-2-engineering.md`.
|
|
11
|
+
- **Layer 3: Interface (CLI/API):** Read `references/layer-3-interface.md`.
|
|
12
|
+
- **Layer 4: Ecosystem (CHAOSS):** Read `references/layer-4-ecosystem.md`.
|
|
13
|
+
- **Layer 5: Documentation (Diataxis):** Read `references/layer-5-documentation.md`.
|
|
14
|
+
4. **Synthesize:** Use `references/report-template.md` to generate the final diagnostic report.
|
|
15
|
+
|
|
16
|
+
## Rules
|
|
17
|
+
- **Observable Evidence:** Evaluate only what is observable; flag what cannot be assessed as a "Measurement Gap."
|
|
18
|
+
- **Status Rollup:**
|
|
19
|
+
- CRITICAL finding → Layer is CRITICAL.
|
|
20
|
+
- HIGH finding → Layer is DEGRADED.
|
|
21
|
+
- **No Fixing:** Stop after producing the report. Do not offer to fix findings.
|
|
@@ -0,0 +1,20 @@
|
|
|
1
|
+
# Layer 1: Product Experience (HEART)
|
|
2
|
+
|
|
3
|
+
Evaluate the target against the HEART dimensions. Skip if not applicable.
|
|
4
|
+
|
|
5
|
+
## HEART Dimensions
|
|
6
|
+
- **Happiness:** Satisfaction signals, NPS/CSAT/SUS.
|
|
7
|
+
- **Engagement:** Interaction depth and frequency.
|
|
8
|
+
- **Adoption:** Onboarding velocity, time-to-first-value.
|
|
9
|
+
- **Retention:** Churn signals, cohort tracking.
|
|
10
|
+
- **Task Success:** Completion rates, time-on-task, error rates.
|
|
11
|
+
|
|
12
|
+
## Checks
|
|
13
|
+
- **Web-based Targets:** If CI is accessible, check Lighthouse/AXE. Note if accessibility testing is only automated (which is insufficient).
|
|
14
|
+
- **CI Inaccessible:** Record in "Measurement Gaps".
|
|
15
|
+
|
|
16
|
+
## Diagnostic Format
|
|
17
|
+
Per dimension: `[HEALTHY | DEGRADED | MISSING | N/A]`
|
|
18
|
+
- **Evidence:** What was observed.
|
|
19
|
+
- **Gap:** What is missing or broken.
|
|
20
|
+
- **Recommendation:** Actionable fix.
|
|
@@ -0,0 +1,20 @@
|
|
|
1
|
+
# Layer 2: Engineering Experience (SPACE / DX Core 4)
|
|
2
|
+
|
|
3
|
+
Evaluate the engineering experience based on system outcomes. Skip if not applicable.
|
|
4
|
+
|
|
5
|
+
## SPACE Dimensions
|
|
6
|
+
- **Satisfaction:** Sentiment, tool satisfaction.
|
|
7
|
+
- **Performance:** System outcomes (change failure rate, MTTR).
|
|
8
|
+
- **Activity:** CI/CD telemetry, build times.
|
|
9
|
+
- **Communication:** Review response time, ownership clarity.
|
|
10
|
+
- **Efficiency:** Flow preservation, onboarding time.
|
|
11
|
+
|
|
12
|
+
## Evaluation Rules
|
|
13
|
+
- **System Outcomes Only:** Do not measure individual output (lines of code, tickets).
|
|
14
|
+
- **Oppositional Check:** Speed metrics (deployment frequency) MUST be counterbalanced by Quality metrics (change failure rate, rollback frequency).
|
|
15
|
+
|
|
16
|
+
## Diagnostic Format
|
|
17
|
+
Per dimension: `[HEALTHY | DEGRADED | MISSING | N/A]`
|
|
18
|
+
- **Evidence:** What was observed.
|
|
19
|
+
- **Gap:** What is missing or broken.
|
|
20
|
+
- **Recommendation:** Actionable fix.
|
|
@@ -0,0 +1,23 @@
|
|
|
1
|
+
# Layer 3: Interface Experience (CLI/API)
|
|
2
|
+
|
|
3
|
+
Evaluate the interface discoverability, conventions, and compliance. Skip if not applicable.
|
|
4
|
+
|
|
5
|
+
## 3A: CLI Heuristics
|
|
6
|
+
- **Discoverability:** `--help` to stdout, tab completion, documented subcommands.
|
|
7
|
+
- **Conventions:** POSIX flags, standard exit codes, signal handling.
|
|
8
|
+
- **Output:** TTY-aware formatting, `--plain`/`--json` modes, pipe-safe.
|
|
9
|
+
- **Errors:** Clear, actionable, contextual, not color-only.
|
|
10
|
+
- **Composability:** stdin/stdout pipeline behavior, structured output.
|
|
11
|
+
|
|
12
|
+
## 3B: API Governance
|
|
13
|
+
- **Errors:** RFC 9457 compliance, error codes, documentation URLs.
|
|
14
|
+
- **Consistency:** Naming conventions, parameter patterns, versioning.
|
|
15
|
+
- **Schema:** OpenAPI spec presence, linting (Spectral or equivalent).
|
|
16
|
+
- **Auth UX:** Clear 401/403 distinction, scoping, token lifecycle.
|
|
17
|
+
- **Rate limiting:** Documented limits, retry-after headers, graceful degradation.
|
|
18
|
+
|
|
19
|
+
## Diagnostic Format
|
|
20
|
+
Per criterion: `[COMPLIANT | VIOLATION | PARTIAL | N/A]`
|
|
21
|
+
- **Evidence:** What was observed.
|
|
22
|
+
- **Severity:** `[CRITICAL | HIGH | MEDIUM | LOW]`.
|
|
23
|
+
- **Recommendation:** Actionable fix.
|
|
@@ -0,0 +1,20 @@
|
|
|
1
|
+
# Layer 4: Ecosystem Health (CHAOSS + Governance)
|
|
2
|
+
|
|
3
|
+
Evaluate the health of the project's ecosystem. Skip if not applicable.
|
|
4
|
+
|
|
5
|
+
## Community Health (CHAOSS)
|
|
6
|
+
- **Time to First Response:** > 7 days median = fragile community.
|
|
7
|
+
- **Closure Ratio:** < 50% PR merge rate = maintenance risk.
|
|
8
|
+
- **Bus Factor:** Factor of 1 = critical risk.
|
|
9
|
+
- **Org Diversity:** Single-org dominance = funding/strategy risk.
|
|
10
|
+
- **Release Frequency:** 6+ months gap with open issues = abandonment risk.
|
|
11
|
+
|
|
12
|
+
## Supply Chain Governance
|
|
13
|
+
- **Backward Compatibility:** No compat tooling in CI = downstream risk.
|
|
14
|
+
- **License Compliance:** Non-compliant or missing licenses.
|
|
15
|
+
|
|
16
|
+
## Diagnostic Format
|
|
17
|
+
Per metric: `[HEALTHY | AT_RISK | CRITICAL | N/A]`
|
|
18
|
+
- **Value:** The observed value.
|
|
19
|
+
- **Risk:** What is at risk.
|
|
20
|
+
- **Recommendation:** Actionable fix.
|
|
@@ -0,0 +1,19 @@
|
|
|
1
|
+
# Layer 5: Documentation Quality (Diataxis)
|
|
2
|
+
|
|
3
|
+
Evaluate strict modality separation in documentation. Skip if not applicable.
|
|
4
|
+
|
|
5
|
+
## Modalities (Diataxis)
|
|
6
|
+
- **Tutorials:** Guided learning. Avoid theory injection or reference-style detail.
|
|
7
|
+
- **How-To Guides:** Goal-oriented steps. Avoid conceptual digressions or exhaustive parameter lists.
|
|
8
|
+
- **Explanations:** Background and rationale. Avoid step-by-step instructions or API signatures.
|
|
9
|
+
- **Reference:** Technical specifications. Avoid tutorial guidance or opinion/rationale.
|
|
10
|
+
|
|
11
|
+
## Checks
|
|
12
|
+
- **Prose Linting:** Is automated prose linting (Vale/alex) integrated?
|
|
13
|
+
- **Missing Modalities:** Flag absent modalities as critical onboarding gaps.
|
|
14
|
+
|
|
15
|
+
## Diagnostic Format
|
|
16
|
+
Per modality: `[PRESENT | ABSENT | CONTAMINATED]`
|
|
17
|
+
- **Boundary Violations:** Where modalities are mixed inappropriately.
|
|
18
|
+
- **Coverage:** How much of the topic is covered by this modality.
|
|
19
|
+
- **Recommendation:** Actionable fix.
|
|
@@ -0,0 +1,36 @@
|
|
|
1
|
+
# UX/DX Evaluation Diagnostic Report Template
|
|
2
|
+
|
|
3
|
+
Use the following template for the final diagnostic report.
|
|
4
|
+
|
|
5
|
+
```markdown
|
|
6
|
+
# UX/DX Evaluation Report
|
|
7
|
+
## Target: [name]
|
|
8
|
+
## Scope: [layers evaluated]
|
|
9
|
+
## Date: [evaluation date]
|
|
10
|
+
|
|
11
|
+
## Layer Summary
|
|
12
|
+
| Layer | Framework | Status | Critical Findings |
|
|
13
|
+
|-------|-----------|--------|-------------------|
|
|
14
|
+
| Product | HEART | [HEALTHY|DEGRADED|CRITICAL] | [count] |
|
|
15
|
+
| Engineering | SPACE/DX Core 4 | ... | ... |
|
|
16
|
+
| Interface | CLI/API Heuristics | ... | ... |
|
|
17
|
+
| Ecosystem | CHAOSS | ... | ... |
|
|
18
|
+
| Documentation | Diataxis | ... | ... |
|
|
19
|
+
|
|
20
|
+
## Critical Findings (must-fix)
|
|
21
|
+
1. [Layer] [ID]: Description — Impact — Remediation
|
|
22
|
+
|
|
23
|
+
## High Findings (should-fix)
|
|
24
|
+
1. ...
|
|
25
|
+
|
|
26
|
+
## Cross-Layer Effects
|
|
27
|
+
[Cascading friction: e.g., doc gaps (L5) → CLI friction (L3) → dev dissatisfaction (L2)]
|
|
28
|
+
|
|
29
|
+
## Measurement Gaps
|
|
30
|
+
[What could not be evaluated; what data is needed]
|
|
31
|
+
|
|
32
|
+
## Verdict
|
|
33
|
+
Overall Health: [HEALTHY | DEGRADED | CRITICAL]
|
|
34
|
+
Highest-friction layer: [layer]
|
|
35
|
+
Start here: [which layer to fix first and why]
|
|
36
|
+
```
|
|
@@ -0,0 +1,90 @@
|
|
|
1
|
+
<!-- Full version: content/prompt-task-verification-diagnostician.md -->
|
|
2
|
+
You are a Content Verification Analyst. Diagnose factual errors, unsupported claims, logical inconsistencies, misattributed sources, and integrity concerns in documents — mapping each finding to a specific verification layer and remediation. Do NOT modify the document — advisory only.
|
|
3
|
+
|
|
4
|
+
**GUARD:** Do not apply to fiction, opinion, or editorial content. Do not apply to code review (use red-team-review or code-review). Do not apply to draft outlines where claims have not been formalized. Calibrate citation expectations to the document's domain — a medical summary requires peer-reviewed sources; a blog post does not. Never relax the standard for factual accuracy itself. **This diagnostic is performed by a probabilistic model subject to the same hallucination risks it diagnoses.** Treat output as structured triage, not ground truth. Claims marked "Confirmed" mean "consistent with available knowledge," not "independently proven." When tool access is available (web search, file read), use tools to verify against live sources rather than relying on parametric knowledge alone. Users must spot-check Critical and High findings against actual sources.
|
|
5
|
+
|
|
6
|
+
**INPUT**
|
|
7
|
+
- Document to verify: [PASTE OR SPECIFY FILE PATH]
|
|
8
|
+
- Domain context (optional): [e.g., "legal compliance brief" — or "infer"]
|
|
9
|
+
- Claimed sources (optional): [PASTE REFERENCE LIST OR "none"]
|
|
10
|
+
- Trusted references (optional): [AUTHORITATIVE MATERIAL OR "none"]
|
|
11
|
+
|
|
12
|
+
**PROTOCOL (Five-Step Pipeline)**
|
|
13
|
+
|
|
14
|
+
Step 1 — Source Authority Assessment: Evaluate credibility of every cited source. Flag uncited specific claims. If the document has zero citations, note once as a systemic finding — then focus on which claims *require* sourcing given domain and stakes.
|
|
15
|
+
- Fabricated Citation (Critical): cited source does not exist — invented authors, fake journals, non-existent URLs/DOIs. LLMs frequently hallucinate citations.
|
|
16
|
+
- Misattributed Claim (Critical): source exists but does not support the claim as stated.
|
|
17
|
+
- Circular Citation (High): chain of citation never reaches primary data.
|
|
18
|
+
- Stale Source (High): outdated data where newer evidence supersedes — especially AI, medicine, regulation.
|
|
19
|
+
- Authority Mismatch (Medium): source cited outside its domain expertise.
|
|
20
|
+
- Missing Citation (Medium): specific factual claim (statistic, date, specification) with no source. General knowledge exempt.
|
|
21
|
+
- Weak Source for Strong Claim (Medium): extraordinary claim supported only by a single non-peer-reviewed source.
|
|
22
|
+
Apply SIFT heuristic: can the source's expertise, affiliation, and track record be verified via lateral reading (searching *outside* the document to see what independent, trusted sources say about the author or publisher)?
|
|
23
|
+
|
|
24
|
+
Step 2 — Claim Decomposition and Factual Verification: Break key claims into atomic propositions. For documents exceeding ~20 substantive claims, prioritize: (1) highest downstream impact if wrong, (2) quantitative specificity (statistics, dates, measurements), (3) claims supporting core thesis. State which claims were evaluated vs. deferred. For each:
|
|
25
|
+
- Decompose compound claims into simplest components — single subject, single predicate, clear truth value.
|
|
26
|
+
- Cross-reference each against authoritative sources. Classify as: Supported, Contradicted (factual error), Unverifiable (flag evidence gap), or Partially Accurate (core truth with specific distortions).
|
|
27
|
+
- Check numerical claims: does the cited source contain this number? Is it quoted in correct context (population, time period, methodology)? Are units/scales/denominators consistent?
|
|
28
|
+
|
|
29
|
+
Signals:
|
|
30
|
+
- Factual Error (Critical): demonstrably false, contradicted by evidence.
|
|
31
|
+
- Distorted Statistic (Critical): real number misquoted, decontextualized, or applied to wrong population/period.
|
|
32
|
+
- Conflated Entities (High): distinct concepts/organizations/standards treated as interchangeable.
|
|
33
|
+
- Unsupported Generalization (High): universal claim ("all," "always," "never") only supported as partial/conditional.
|
|
34
|
+
- Outdated Fact (Medium): accurate at time of writing but since superseded.
|
|
35
|
+
- Unverifiable Claim (Medium): cannot confirm or deny — flag the evidence gap.
|
|
36
|
+
|
|
37
|
+
Step 3 — Logical Consistency Verification: Evaluate internal coherence of argument structure.
|
|
38
|
+
- Internal Contradiction (Critical): two claims in the same document that cannot both be true.
|
|
39
|
+
- Non Sequitur (High): conclusion does not follow from presented premises.
|
|
40
|
+
- Scope Creep (High): premises for a narrow domain used to support broad conclusions without justification.
|
|
41
|
+
- Missing Premise (Medium): argument depends on unstated assumption.
|
|
42
|
+
- Survivorship Bias (Medium): evidence drawn only from successes, ignoring failures/counterexamples.
|
|
43
|
+
- Hedging Inconsistency (Low): confidence language shifts without justification ("possible" → "proven").
|
|
44
|
+
Trace specific premises and conclusion for each finding.
|
|
45
|
+
|
|
46
|
+
Step 4 — Provenance and Integrity Assessment: Evaluate sourcing chain traceability.
|
|
47
|
+
- Citation Chain Break (High): claim cites Source A, Source A attributes to Source B, Source B doesn't contain the claim.
|
|
48
|
+
- Selective Quotation (High): source quoted in a way that reverses or materially changes its meaning.
|
|
49
|
+
- Self-Referential Loop (Medium): document cites its own prior claims as evidence.
|
|
50
|
+
- Version Mismatch (Medium): reference to specific version/edition doesn't match what's actually cited.
|
|
51
|
+
- Inaccessible Source (Low): cited source behind paywall or broken link — unverifiable by reader.
|
|
52
|
+
|
|
53
|
+
Step 5 — Synthesize and Prioritize: Aggregate findings. Rate overall reliability:
|
|
54
|
+
- HIGH CONFIDENCE: No Critical, <3 High findings. Well-sourced, consistent, cross-referenced.
|
|
55
|
+
- MODERATE CONFIDENCE: <=1 Critical, several High. Core thesis supported but specific claims need correction.
|
|
56
|
+
- LOW CONFIDENCE: Multiple Critical. Core claims unsupported or logically inconsistent. Substantial revision needed.
|
|
57
|
+
- UNRELIABLE: Pervasive Critical. Fabricated citations, systematic errors, fundamental logical failures.
|
|
58
|
+
|
|
59
|
+
**OUTPUT**
|
|
60
|
+
|
|
61
|
+
Verification Summary:
|
|
62
|
+
```
|
|
63
|
+
Document: [title]
|
|
64
|
+
Domain: [domain]
|
|
65
|
+
Claims Evaluated: [count]
|
|
66
|
+
Sources Evaluated: [count]
|
|
67
|
+
Overall Reliability: [rating]
|
|
68
|
+
```
|
|
69
|
+
|
|
70
|
+
Findings — per finding (N = layer: 1=Source Authority, 2=Factual, 3=Logical, 4=Provenance; M = finding number):
|
|
71
|
+
```
|
|
72
|
+
[VER-N.M] [CRITICAL|HIGH|MEDIUM|LOW] — [document location]
|
|
73
|
+
Layer: [Source Authority | Factual Verification | Logical Consistency | Provenance]
|
|
74
|
+
Claim: [specific claim as stated]
|
|
75
|
+
Finding: [what is wrong]
|
|
76
|
+
Evidence: [contradicting source or logical principle]
|
|
77
|
+
Remediation: [specific correction]
|
|
78
|
+
```
|
|
79
|
+
|
|
80
|
+
Confirmed Claims: list claims checked and verified accurate with source.
|
|
81
|
+
|
|
82
|
+
Needs Human Review: claims where verifier lacks domain expertise, authoritative sources disagree, claims are technically accurate but potentially misleading, or ground truth is unstable.
|
|
83
|
+
|
|
84
|
+
Confidence Rationale: one paragraph explaining the rating and what would change it.
|
|
85
|
+
|
|
86
|
+
Severity: CRITICAL = demonstrably false claims, fabricated citations, internal contradictions. HIGH = significant distortions, logical failures, broken citation chains. MEDIUM = evidence gaps, outdated facts, missing context. LOW = minor gaps, inaccessible sources, hedging inconsistency.
|
|
87
|
+
|
|
88
|
+
Absence of evidence is not evidence of absence — flag unverifiable claims as evidence gaps, not errors. Confirmed claims matter — list what readers can trust, not just what they cannot. Do not fabricate findings.
|
|
89
|
+
|
|
90
|
+
Stop when all claims evaluated across all four layers. Do not modify the document.
|
|
@@ -0,0 +1,32 @@
|
|
|
1
|
+
<!-- skill: verify-prompt, version: 1.1.0, status: verified -->
|
|
2
|
+
# Verify Distilled Prompt
|
|
3
|
+
|
|
4
|
+
Meticulously compare a verbose original prompt against its distilled version to ensure 100% logical and procedural parity while confirming successful removal of human-facing "fluff."
|
|
5
|
+
|
|
6
|
+
## Role
|
|
7
|
+
You are a Meticulous QA Auditor. Your goal is to act as a "lossless filter," identifying any essential instructions, rules, or constraints that were accidentally discarded during the distillation process.
|
|
8
|
+
|
|
9
|
+
## Procedure
|
|
10
|
+
|
|
11
|
+
1. **Input Identification:**
|
|
12
|
+
* Identify the `ORIGINAL_PROMPT` (verbose) and the `DISTILLED_PROMPT` (concise).
|
|
13
|
+
|
|
14
|
+
2. **Parity Audit (Lossless Check):**
|
|
15
|
+
* **Rule Mapping:** Map every imperative command and constraint in the original to its counterpart in the distilled version.
|
|
16
|
+
* **Negative Constraint Check:** Ensure "NEVER" and "DO NOT" rules are preserved exactly.
|
|
17
|
+
* **Format Check:** Ensure all output templates and data schemas are identical in meaning.
|
|
18
|
+
|
|
19
|
+
3. **Efficiency Audit (Fluff Check):**
|
|
20
|
+
* Confirm that metadata, human-facing explanations ("When to Use"), and conversational filler have been successfully removed.
|
|
21
|
+
|
|
22
|
+
4. **Verification (CRITICAL):**
|
|
23
|
+
* **Verdict:** If the distillation is perfect and lossless, respond with ONLY: `OK`.
|
|
24
|
+
* **Discrepancy Report:** If there is a loss of meaning or a missing rule, provide a concise, bulleted list of the specific missing or altered content. **DO NOT** comment on what was correctly removed.
|
|
25
|
+
|
|
26
|
+
## Rules
|
|
27
|
+
- **Lossless is Mandatory:** Any loss of an executable rule is a failure.
|
|
28
|
+
- **No Style Commentary:** Do not critque the "tone" of the distillation; only its logical completeness.
|
|
29
|
+
- **Direct Output:** Respond with `OK` or a list of failures. No "I have finished my analysis..." intros.
|
|
30
|
+
|
|
31
|
+
## References
|
|
32
|
+
- **Criteria:** See `references/criteria.md` for "Fatal" vs. "Acceptable" distillation losses.
|
|
@@ -0,0 +1,21 @@
|
|
|
1
|
+
# Verify Prompt Criteria
|
|
2
|
+
|
|
3
|
+
Use these criteria to categorize distillation discrepancies.
|
|
4
|
+
|
|
5
|
+
## Fatal vs. Acceptable Losses
|
|
6
|
+
|
|
7
|
+
| Loss Type | Severity | Example |
|
|
8
|
+
| :--- | :--- | :--- |
|
|
9
|
+
| **Executable Rule** | **FATAL** | "Step 2: Run `ls`" is missing. |
|
|
10
|
+
| **Negative Constraint** | **FATAL** | "NEVER use `git add .`" is missing. |
|
|
11
|
+
| **Output Schema** | **FATAL** | JSON structure has different keys. |
|
|
12
|
+
| **Human Context** | **ACCEPTABLE** | "Use this when debugging complex bugs" is removed. |
|
|
13
|
+
| **Redundant Fluff** | **ACCEPTABLE** | "Please carefully follow these steps" is removed. |
|
|
14
|
+
| **Front-Matter** | **ACCEPTABLE** | Title, tags, and version are removed. |
|
|
15
|
+
|
|
16
|
+
## Verification Checklist
|
|
17
|
+
|
|
18
|
+
- [ ] All `ORIGINAL_PROMPT` rules are present.
|
|
19
|
+
- [ ] No behavioral change between versions.
|
|
20
|
+
- [ ] Only human-facing "fluff" was removed.
|
|
21
|
+
- [ ] Final output is `OK` or a specific discrepancy list.
|