sherpa-skill 2.0.6 → 2.0.7
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.agents/plugins/marketplace.json +11 -0
- package/.agents/skills/sherpa/SKILL.md +161 -0
- package/.agents/skills/sherpa/commands/README.md +43 -0
- package/.agents/skills/sherpa/commands/manifest.json +589 -0
- package/.agents/skills/sherpa/commands/sherpa-research.md +147 -0
- package/.agents/skills/sherpa/core/commands/router.py +171 -0
- package/.agents/skills/sherpa/core/configuration/manager.py +504 -0
- package/.agents/skills/sherpa/core/ideas/engine.py +564 -0
- package/.agents/skills/sherpa/docs/commands/README.md +96 -0
- package/.agents/skills/sherpa/docs/configuration/runtime-verification.md +64 -0
- package/.agents/skills/sherpa/rules/demo-preparation-rules.md +543 -0
- package/.agents/skills/sherpa/rules/engineering-rules.md +221 -0
- package/.agents/skills/sherpa/rules/final-audit-rules.md +824 -0
- package/.agents/skills/sherpa/rules/implementation-rules.md +127 -0
- package/.agents/skills/sherpa/rules/judge-rules.md +443 -0
- package/.agents/skills/sherpa/rules/mentor-rules.md +109 -0
- package/.agents/skills/sherpa/rules/postmortem-rules.md +69 -0
- package/.agents/skills/sherpa/rules/presentation-rules.md +783 -0
- package/.agents/skills/sherpa/rules/red-team-rules.md +185 -0
- package/.agents/skills/sherpa/rules/research-rules.md +184 -0
- package/.agents/skills/sherpa/rules/score-optimization-rules.md +355 -0
- package/.agents/skills/sherpa/rules/scoring-rules.md +216 -0
- package/.agents/skills/sherpa/rules/submission-rules.md +41 -0
- package/.agents/skills/sherpa/rules/testing-security-rules.md +87 -0
- package/.agents/skills/sherpa/rules/ux-rules.md +89 -0
- package/.agents/skills/sherpa/src/config_manager.py +474 -0
- package/.agents/skills/sherpa/src/verification.py +458 -0
- package/.agents/skills/sherpa/templates/audit-finding.md +20 -0
- package/.agents/skills/sherpa/templates/claim-audit.md +15 -0
- package/.agents/skills/sherpa/templates/configuration/hackathon.json +21 -0
- package/.agents/skills/sherpa/templates/configuration/integrations.env.example +3 -0
- package/.agents/skills/sherpa/templates/configuration/project.env.example +12 -0
- package/.agents/skills/sherpa/templates/configuration/providers.env.example +4 -0
- package/.agents/skills/sherpa/templates/configuration/settings.json +22 -0
- package/.agents/skills/sherpa/templates/consistency-audit.md +17 -0
- package/.agents/skills/sherpa/templates/decision-log.md +18 -0
- package/.agents/skills/sherpa/templates/demo-checkpoint.md +42 -0
- package/.agents/skills/sherpa/templates/demo-evidence.md +32 -0
- package/.agents/skills/sherpa/templates/demo-finding.md +112 -0
- package/.agents/skills/sherpa/templates/demo-flow.md +52 -0
- package/.agents/skills/sherpa/templates/demo-plan.md +265 -0
- package/.agents/skills/sherpa/templates/demo-verification.md +57 -0
- package/.agents/skills/sherpa/templates/final-audit.md +387 -0
- package/.agents/skills/sherpa/templates/final-risk.md +17 -0
- package/.agents/skills/sherpa/templates/final-verification.md +57 -0
- package/.agents/skills/sherpa/templates/gap-analysis.md +113 -0
- package/.agents/skills/sherpa/templates/idea-comparison.md +129 -0
- package/.agents/skills/sherpa/templates/idea-evaluation.md +251 -0
- package/.agents/skills/sherpa/templates/implementation-plan.md +96 -0
- package/.agents/skills/sherpa/templates/implementation-task.md +57 -0
- package/.agents/skills/sherpa/templates/improvement-candidate.md +135 -0
- package/.agents/skills/sherpa/templates/improvement.md +18 -0
- package/.agents/skills/sherpa/templates/incident.md +20 -0
- package/.agents/skills/sherpa/templates/judge-criterion.md +41 -0
- package/.agents/skills/sherpa/templates/judge-question.md +41 -0
- package/.agents/skills/sherpa/templates/judge-session.md +125 -0
- package/.agents/skills/sherpa/templates/judge-simulation.md +264 -0
- package/.agents/skills/sherpa/templates/lesson.md +14 -0
- package/.agents/skills/sherpa/templates/postmortem.md +87 -0
- package/.agents/skills/sherpa/templates/presentation-evidence.md +33 -0
- package/.agents/skills/sherpa/templates/presentation-plan.md +349 -0
- package/.agents/skills/sherpa/templates/presentation-qna.md +29 -0
- package/.agents/skills/sherpa/templates/presentation-risk.md +42 -0
- package/.agents/skills/sherpa/templates/presentation-verification.md +57 -0
- package/.agents/skills/sherpa/templates/project-plan.md +242 -0
- package/.agents/skills/sherpa/templates/project-state.md +84 -0
- package/.agents/skills/sherpa/templates/red-team-finding.md +73 -0
- package/.agents/skills/sherpa/templates/red-team-review.md +105 -0
- package/.agents/skills/sherpa/templates/red-team-scenario.md +43 -0
- package/.agents/skills/sherpa/templates/red-team-verification.md +31 -0
- package/.agents/skills/sherpa/templates/repo-analysis.md +204 -0
- package/.agents/skills/sherpa/templates/requirement-audit.md +15 -0
- package/.agents/skills/sherpa/templates/research-comparison.md +124 -0
- package/.agents/skills/sherpa/templates/research-plan.md +93 -0
- package/.agents/skills/sherpa/templates/research-report.md +92 -0
- package/.agents/skills/sherpa/templates/research-source.md +77 -0
- package/.agents/skills/sherpa/templates/score-optimization-plan.md +197 -0
- package/.agents/skills/sherpa/templates/security-finding.md +45 -0
- package/.agents/skills/sherpa/templates/security-review.md +64 -0
- package/.agents/skills/sherpa/templates/slide-claim.md +47 -0
- package/.agents/skills/sherpa/templates/slide-plan.md +127 -0
- package/.agents/skills/sherpa/templates/submission-artifact.md +15 -0
- package/.agents/skills/sherpa/templates/submission-checklist.md +24 -0
- package/.agents/skills/sherpa/templates/submission-field.md +14 -0
- package/.agents/skills/sherpa/templates/submission-link.md +14 -0
- package/.agents/skills/sherpa/templates/submission-plan.md +31 -0
- package/.agents/skills/sherpa/templates/submission-readiness.md +18 -0
- package/.agents/skills/sherpa/templates/submission-requirement.md +12 -0
- package/.agents/skills/sherpa/templates/submission-risk.md +14 -0
- package/.agents/skills/sherpa/templates/submission-snapshot.md +20 -0
- package/.agents/skills/sherpa/templates/submission-verification.md +12 -0
- package/.agents/skills/sherpa/templates/test-plan.md +59 -0
- package/.agents/skills/sherpa/templates/test-result.md +46 -0
- package/.agents/skills/sherpa/templates/timeline.md +11 -0
- package/.agents/skills/sherpa/templates/ux-finding.md +56 -0
- package/.agents/skills/sherpa/templates/ux-flow.md +46 -0
- package/.agents/skills/sherpa/templates/ux-review.md +113 -0
- package/.agents/skills/sherpa/templates/ux-verification.md +32 -0
- package/.agents/skills/sherpa/workflows/configuration.md +23 -0
- package/.agents/skills/sherpa/workflows/demo-preparation.md +399 -0
- package/.agents/skills/sherpa/workflows/final-audit.md +713 -0
- package/.agents/skills/sherpa/workflows/idea-evaluation.md +239 -0
- package/.agents/skills/sherpa/workflows/idea-intelligence.md +69 -0
- package/.agents/skills/sherpa/workflows/implementation.md +42 -0
- package/.agents/skills/sherpa/workflows/init.md +102 -0
- package/.agents/skills/sherpa/workflows/judge-simulation.md +408 -0
- package/.agents/skills/sherpa/workflows/lifecycle.md +51 -0
- package/.agents/skills/sherpa/workflows/next.md +96 -0
- package/.agents/skills/sherpa/workflows/postmortem.md +76 -0
- package/.agents/skills/sherpa/workflows/presentation.md +522 -0
- package/.agents/skills/sherpa/workflows/project-planning.md +327 -0
- package/.agents/skills/sherpa/workflows/red-team.md +373 -0
- package/.agents/skills/sherpa/workflows/research.md +142 -0
- package/.agents/skills/sherpa/workflows/score-optimization.md +276 -0
- package/.agents/skills/sherpa/workflows/status.md +107 -0
- package/.agents/skills/sherpa/workflows/submission.md +46 -0
- package/.agents/skills/sherpa/workflows/testing-security.md +44 -0
- package/.agents/skills/sherpa/workflows/ux-review.md +59 -0
- package/.claude-plugin/marketplace.json +21 -0
- package/.claude-plugin/plugin.json +13 -0
- package/.codex-plugin/plugin.json +13 -0
- package/GEMINI.md +3 -0
- package/README.md +11 -7
- package/SKILL.md +161 -0
- package/distribution/cli/sherpa +1 -1
- package/gemini-extension.json +7 -0
- package/package.json +31 -3
- package/plugin.json +20 -0
- package/qwen-extension.json +6 -0
- package/skills/sherpa/SKILL.md +161 -0
- package/skills/sherpa/commands/README.md +43 -0
- package/skills/sherpa/commands/manifest.json +589 -0
- package/skills/sherpa/commands/sherpa-research.md +147 -0
- package/skills/sherpa/core/commands/router.py +171 -0
- package/skills/sherpa/core/configuration/manager.py +504 -0
- package/skills/sherpa/core/ideas/engine.py +564 -0
- package/skills/sherpa/docs/commands/README.md +96 -0
- package/skills/sherpa/docs/configuration/runtime-verification.md +64 -0
- package/skills/sherpa/rules/demo-preparation-rules.md +543 -0
- package/skills/sherpa/rules/engineering-rules.md +221 -0
- package/skills/sherpa/rules/final-audit-rules.md +824 -0
- package/skills/sherpa/rules/implementation-rules.md +127 -0
- package/skills/sherpa/rules/judge-rules.md +443 -0
- package/skills/sherpa/rules/mentor-rules.md +109 -0
- package/skills/sherpa/rules/postmortem-rules.md +69 -0
- package/skills/sherpa/rules/presentation-rules.md +783 -0
- package/skills/sherpa/rules/red-team-rules.md +185 -0
- package/skills/sherpa/rules/research-rules.md +184 -0
- package/skills/sherpa/rules/score-optimization-rules.md +355 -0
- package/skills/sherpa/rules/scoring-rules.md +216 -0
- package/skills/sherpa/rules/submission-rules.md +41 -0
- package/skills/sherpa/rules/testing-security-rules.md +87 -0
- package/skills/sherpa/rules/ux-rules.md +89 -0
- package/skills/sherpa/src/config_manager.py +474 -0
- package/skills/sherpa/src/verification.py +458 -0
- package/skills/sherpa/templates/audit-finding.md +20 -0
- package/skills/sherpa/templates/claim-audit.md +15 -0
- package/skills/sherpa/templates/configuration/hackathon.json +21 -0
- package/skills/sherpa/templates/configuration/integrations.env.example +3 -0
- package/skills/sherpa/templates/configuration/project.env.example +12 -0
- package/skills/sherpa/templates/configuration/providers.env.example +4 -0
- package/skills/sherpa/templates/configuration/settings.json +22 -0
- package/skills/sherpa/templates/consistency-audit.md +17 -0
- package/skills/sherpa/templates/decision-log.md +18 -0
- package/skills/sherpa/templates/demo-checkpoint.md +42 -0
- package/skills/sherpa/templates/demo-evidence.md +32 -0
- package/skills/sherpa/templates/demo-finding.md +112 -0
- package/skills/sherpa/templates/demo-flow.md +52 -0
- package/skills/sherpa/templates/demo-plan.md +265 -0
- package/skills/sherpa/templates/demo-verification.md +57 -0
- package/skills/sherpa/templates/final-audit.md +387 -0
- package/skills/sherpa/templates/final-risk.md +17 -0
- package/skills/sherpa/templates/final-verification.md +57 -0
- package/skills/sherpa/templates/gap-analysis.md +113 -0
- package/skills/sherpa/templates/idea-comparison.md +129 -0
- package/skills/sherpa/templates/idea-evaluation.md +251 -0
- package/skills/sherpa/templates/implementation-plan.md +96 -0
- package/skills/sherpa/templates/implementation-task.md +57 -0
- package/skills/sherpa/templates/improvement-candidate.md +135 -0
- package/skills/sherpa/templates/improvement.md +18 -0
- package/skills/sherpa/templates/incident.md +20 -0
- package/skills/sherpa/templates/judge-criterion.md +41 -0
- package/skills/sherpa/templates/judge-question.md +41 -0
- package/skills/sherpa/templates/judge-session.md +125 -0
- package/skills/sherpa/templates/judge-simulation.md +264 -0
- package/skills/sherpa/templates/lesson.md +14 -0
- package/skills/sherpa/templates/postmortem.md +87 -0
- package/skills/sherpa/templates/presentation-evidence.md +33 -0
- package/skills/sherpa/templates/presentation-plan.md +349 -0
- package/skills/sherpa/templates/presentation-qna.md +29 -0
- package/skills/sherpa/templates/presentation-risk.md +42 -0
- package/skills/sherpa/templates/presentation-verification.md +57 -0
- package/skills/sherpa/templates/project-plan.md +242 -0
- package/skills/sherpa/templates/project-state.md +84 -0
- package/skills/sherpa/templates/red-team-finding.md +73 -0
- package/skills/sherpa/templates/red-team-review.md +105 -0
- package/skills/sherpa/templates/red-team-scenario.md +43 -0
- package/skills/sherpa/templates/red-team-verification.md +31 -0
- package/skills/sherpa/templates/repo-analysis.md +204 -0
- package/skills/sherpa/templates/requirement-audit.md +15 -0
- package/skills/sherpa/templates/research-comparison.md +124 -0
- package/skills/sherpa/templates/research-plan.md +93 -0
- package/skills/sherpa/templates/research-report.md +92 -0
- package/skills/sherpa/templates/research-source.md +77 -0
- package/skills/sherpa/templates/score-optimization-plan.md +197 -0
- package/skills/sherpa/templates/security-finding.md +45 -0
- package/skills/sherpa/templates/security-review.md +64 -0
- package/skills/sherpa/templates/slide-claim.md +47 -0
- package/skills/sherpa/templates/slide-plan.md +127 -0
- package/skills/sherpa/templates/submission-artifact.md +15 -0
- package/skills/sherpa/templates/submission-checklist.md +24 -0
- package/skills/sherpa/templates/submission-field.md +14 -0
- package/skills/sherpa/templates/submission-link.md +14 -0
- package/skills/sherpa/templates/submission-plan.md +31 -0
- package/skills/sherpa/templates/submission-readiness.md +18 -0
- package/skills/sherpa/templates/submission-requirement.md +12 -0
- package/skills/sherpa/templates/submission-risk.md +14 -0
- package/skills/sherpa/templates/submission-snapshot.md +20 -0
- package/skills/sherpa/templates/submission-verification.md +12 -0
- package/skills/sherpa/templates/test-plan.md +59 -0
- package/skills/sherpa/templates/test-result.md +46 -0
- package/skills/sherpa/templates/timeline.md +11 -0
- package/skills/sherpa/templates/ux-finding.md +56 -0
- package/skills/sherpa/templates/ux-flow.md +46 -0
- package/skills/sherpa/templates/ux-review.md +113 -0
- package/skills/sherpa/templates/ux-verification.md +32 -0
- package/skills/sherpa/workflows/configuration.md +23 -0
- package/skills/sherpa/workflows/demo-preparation.md +399 -0
- package/skills/sherpa/workflows/final-audit.md +713 -0
- package/skills/sherpa/workflows/idea-evaluation.md +239 -0
- package/skills/sherpa/workflows/idea-intelligence.md +69 -0
- package/skills/sherpa/workflows/implementation.md +42 -0
- package/skills/sherpa/workflows/init.md +102 -0
- package/skills/sherpa/workflows/judge-simulation.md +408 -0
- package/skills/sherpa/workflows/lifecycle.md +51 -0
- package/skills/sherpa/workflows/next.md +96 -0
- package/skills/sherpa/workflows/postmortem.md +76 -0
- package/skills/sherpa/workflows/presentation.md +522 -0
- package/skills/sherpa/workflows/project-planning.md +327 -0
- package/skills/sherpa/workflows/red-team.md +373 -0
- package/skills/sherpa/workflows/research.md +142 -0
- package/skills/sherpa/workflows/score-optimization.md +276 -0
- package/skills/sherpa/workflows/status.md +107 -0
- package/skills/sherpa/workflows/submission.md +46 -0
- package/skills/sherpa/workflows/testing-security.md +44 -0
- package/skills/sherpa/workflows/ux-review.md +59 -0
|
@@ -0,0 +1,251 @@
|
|
|
1
|
+
# Idea Evaluation — <idea-name>
|
|
2
|
+
|
|
3
|
+
**One-line description:** <one-sentence description>
|
|
4
|
+
|
|
5
|
+
**Submitted by:** <team member or "team">
|
|
6
|
+
**Evaluation date:** <UTC date/time>
|
|
7
|
+
|
|
8
|
+
---
|
|
9
|
+
|
|
10
|
+
## 1. Problem & Solution Framing
|
|
11
|
+
|
|
12
|
+
**Problem statement:** <problem as stated by user>
|
|
13
|
+
|
|
14
|
+
**Target users:** <who the product is for, or UNKNOWN>
|
|
15
|
+
|
|
16
|
+
**Proposed solution:** <one-sentence solution description>
|
|
17
|
+
|
|
18
|
+
---
|
|
19
|
+
|
|
20
|
+
## 2. Category Scores
|
|
21
|
+
|
|
22
|
+
Each dimension is scored 1–10 with reasoning, evidence type (FACT / INFERENCE / ASSUMPTION / UNKNOWN), source, and confidence (low / medium / high).
|
|
23
|
+
|
|
24
|
+
### Category 1: Problem & Solution
|
|
25
|
+
|
|
26
|
+
| Dimension | Score | Reasoning | Evidence Type | Source | Confidence |
|
|
27
|
+
|-----------|-------|-----------|---------------|--------|------------|
|
|
28
|
+
| 1. Problem importance | | | | | |
|
|
29
|
+
| 2. Problem clarity | | | | | |
|
|
30
|
+
| 3. Target-user clarity | | | | | |
|
|
31
|
+
| 4. User pain | | | | | |
|
|
32
|
+
| 5. Solution usefulness | | | | | |
|
|
33
|
+
|
|
34
|
+
**Category score:** <weighted average or simple average>
|
|
35
|
+
|
|
36
|
+
---
|
|
37
|
+
|
|
38
|
+
### Category 2: Innovation & Differentiation
|
|
39
|
+
|
|
40
|
+
| Dimension | Score | Reasoning | Evidence Type | Source | Confidence |
|
|
41
|
+
|-----------|-------|-----------|---------------|--------|------------|
|
|
42
|
+
| 6. Innovation | | | | | |
|
|
43
|
+
| 7. Differentiation | | | | | |
|
|
44
|
+
|
|
45
|
+
**Category score:** <average>
|
|
46
|
+
|
|
47
|
+
---
|
|
48
|
+
|
|
49
|
+
### Category 3: Technical Feasibility
|
|
50
|
+
|
|
51
|
+
| Dimension | Score | Reasoning | Evidence Type | Source | Confidence |
|
|
52
|
+
|-----------|-------|-----------|---------------|--------|------------|
|
|
53
|
+
| 8. Technical feasibility | | | | | |
|
|
54
|
+
| 9. AI/ML necessity | | | | | |
|
|
55
|
+
| 10. Implementation complexity | | | | | |
|
|
56
|
+
|
|
57
|
+
**Category score:** <average>
|
|
58
|
+
|
|
59
|
+
---
|
|
60
|
+
|
|
61
|
+
### Category 4: Implementation Reality
|
|
62
|
+
|
|
63
|
+
| Dimension | Score | Reasoning | Evidence Type | Source | Confidence |
|
|
64
|
+
|-----------|-------|-----------|---------------|--------|------------|
|
|
65
|
+
| 11. Time required | | | | | |
|
|
66
|
+
| 12. Team skill fit | | | | | |
|
|
67
|
+
|
|
68
|
+
**Category score:** <average>
|
|
69
|
+
|
|
70
|
+
---
|
|
71
|
+
|
|
72
|
+
### Category 5: Demo & Presentation
|
|
73
|
+
|
|
74
|
+
| Dimension | Score | Reasoning | Evidence Type | Source | Confidence |
|
|
75
|
+
|-----------|-------|-----------|---------------|--------|------------|
|
|
76
|
+
| 13. Demo potential | | | | | |
|
|
77
|
+
| 14. Judge appeal | | | | | |
|
|
78
|
+
|
|
79
|
+
**Category score:** <average>
|
|
80
|
+
|
|
81
|
+
---
|
|
82
|
+
|
|
83
|
+
### Category 6: Criteria Alignment (Meta-Validation)
|
|
84
|
+
|
|
85
|
+
| Dimension | Score | Reasoning | Evidence Type | Source | Confidence |
|
|
86
|
+
|-----------|-------|-----------|---------------|--------|------------|
|
|
87
|
+
| 15. Judging-criteria alignment | | | | | |
|
|
88
|
+
|
|
89
|
+
**Alignment check:** <PASS / FAIL — do all category scores map to stated judging criteria?>
|
|
90
|
+
|
|
91
|
+
**Note:** Category 6 does not add points. It validates that other category scores correctly map to the hackathon's stated criteria.
|
|
92
|
+
|
|
93
|
+
---
|
|
94
|
+
|
|
95
|
+
### Category 7: Impact & Market
|
|
96
|
+
|
|
97
|
+
| Dimension | Score | Reasoning | Evidence Type | Source | Confidence |
|
|
98
|
+
|-----------|-------|-----------|---------------|--------|------------|
|
|
99
|
+
| 16. Scalability/potential | | | | | |
|
|
100
|
+
| 17. Real-world impact | | | | | |
|
|
101
|
+
|
|
102
|
+
**Category score:** <average>
|
|
103
|
+
|
|
104
|
+
---
|
|
105
|
+
|
|
106
|
+
### Category 8: Competition & Risk Context
|
|
107
|
+
|
|
108
|
+
| Dimension | Score | Reasoning | Evidence Type | Source | Confidence |
|
|
109
|
+
|-----------|-------|-----------|---------------|--------|------------|
|
|
110
|
+
| 18. Competitive landscape | | | | | |
|
|
111
|
+
| 19. Defensibility | | | | | |
|
|
112
|
+
|
|
113
|
+
**Category score:** <average>
|
|
114
|
+
|
|
115
|
+
---
|
|
116
|
+
|
|
117
|
+
### Category 9: Risk & Evidence Quality
|
|
118
|
+
|
|
119
|
+
| Dimension | Score | Reasoning | Evidence Type | Source | Confidence |
|
|
120
|
+
|-----------|-------|-----------|---------------|--------|------------|
|
|
121
|
+
| 20. Risk | | | | | |
|
|
122
|
+
| 21. Evidence quality | | | | | |
|
|
123
|
+
|
|
124
|
+
**Category score:** <average>
|
|
125
|
+
|
|
126
|
+
---
|
|
127
|
+
|
|
128
|
+
## 3. Research Evidence
|
|
129
|
+
|
|
130
|
+
List all external research used to support dimension scores. Each entry must be tagged FACT / INFERENCE / ASSUMPTION / UNKNOWN with a source.
|
|
131
|
+
|
|
132
|
+
| # | Claim | Type | Source | Confidence |
|
|
133
|
+
|---|-------|------|--------|------------|
|
|
134
|
+
| 1 | | | | |
|
|
135
|
+
| 2 | | | | |
|
|
136
|
+
| 3 | | | | |
|
|
137
|
+
|
|
138
|
+
**Rule:** Never claim research was performed unless evidence was actually retrieved. If no evidence exists, mark UNKNOWN.
|
|
139
|
+
|
|
140
|
+
---
|
|
141
|
+
|
|
142
|
+
## 4. Feasibility & Risk Gate
|
|
143
|
+
|
|
144
|
+
**Calculation:**
|
|
145
|
+
|
|
146
|
+
```
|
|
147
|
+
feasibility_composite = avg(
|
|
148
|
+
dimension_8, // technical feasibility
|
|
149
|
+
(11 - dimension_10), // implementation complexity inverted
|
|
150
|
+
(11 - dimension_11), // time required inverted
|
|
151
|
+
dimension_12, // team skill fit
|
|
152
|
+
(11 - dimension_20) // risk inverted
|
|
153
|
+
)
|
|
154
|
+
```
|
|
155
|
+
|
|
156
|
+
| Component | Value |
|
|
157
|
+
|-----------|-------|
|
|
158
|
+
| Dimension 8 (technical feasibility) | |
|
|
159
|
+
| Dimension 10 (implementation complexity) | |
|
|
160
|
+
| 11 − dimension_10 (inverted complexity) | |
|
|
161
|
+
| Dimension 11 (time required) | |
|
|
162
|
+
| 11 − dimension_11 (inverted time) | |
|
|
163
|
+
| Dimension 12 (team skill fit) | |
|
|
164
|
+
| Dimension 20 (risk) | |
|
|
165
|
+
| 11 − dimension_20 (inverted risk) | |
|
|
166
|
+
| **feasibility_composite** | **<value> / 10** |
|
|
167
|
+
|
|
168
|
+
**Gate result:** <PASS (≥ 6.0) | FAIL (< 6.0)>
|
|
169
|
+
|
|
170
|
+
---
|
|
171
|
+
|
|
172
|
+
## 5. Red-Team Outcome
|
|
173
|
+
|
|
174
|
+
**Outcome:** <KILL | MAJOR CONCERN | MINOR CONCERN>
|
|
175
|
+
|
|
176
|
+
**KILL conditions checked:**
|
|
177
|
+
- [ ] Feasibility gate FAIL with no credible revision path within time
|
|
178
|
+
- [ ] Dimension 20 (risk) ≥ 9 AND Dimension 8 (feasibility) ≤ 3
|
|
179
|
+
- [ ] Dimension 9 (AI necessity) ≤ 3 AND idea claims "AI-powered"
|
|
180
|
+
|
|
181
|
+
**Weaknesses identified:**
|
|
182
|
+
1. <weakness 1>
|
|
183
|
+
2. <weakness 2>
|
|
184
|
+
3. <weakness 3>
|
|
185
|
+
|
|
186
|
+
**Kill question that exposes biggest weakness:** <question>
|
|
187
|
+
|
|
188
|
+
---
|
|
189
|
+
|
|
190
|
+
## 6. Scoring
|
|
191
|
+
|
|
192
|
+
**Judging criteria used:** <list criteria and weights, or "UNKNOWN — equal weights applied">
|
|
193
|
+
|
|
194
|
+
| Criterion | Weight | Score |
|
|
195
|
+
|-----------|--------|-------|
|
|
196
|
+
| | | |
|
|
197
|
+
| | | |
|
|
198
|
+
| | | |
|
|
199
|
+
|
|
200
|
+
**Raw score:** <0–100>
|
|
201
|
+
|
|
202
|
+
**Feasibility factor:** <feasibility_composite / 10>
|
|
203
|
+
|
|
204
|
+
**Final score:** <raw_score × feasibility_factor>
|
|
205
|
+
|
|
206
|
+
**Overall confidence:** <low | medium | high>
|
|
207
|
+
|
|
208
|
+
**Confidence factors:**
|
|
209
|
+
- Evidence quality (dimension 21): <score>
|
|
210
|
+
- Criteria known: <yes / partial / UNKNOWN>
|
|
211
|
+
- All dimensions filled: <yes / no>
|
|
212
|
+
|
|
213
|
+
---
|
|
214
|
+
|
|
215
|
+
## 7. Decision-Relevant Fields
|
|
216
|
+
|
|
217
|
+
**Recommended outcome:** <SELECT | REVISE | REJECT_ALL>
|
|
218
|
+
|
|
219
|
+
**Why this outcome:**
|
|
220
|
+
<explanation tied to category scores and red-team outcome>
|
|
221
|
+
|
|
222
|
+
**Strongest advantages:**
|
|
223
|
+
<top 3 category strengths with scores>
|
|
224
|
+
|
|
225
|
+
**Biggest risks:**
|
|
226
|
+
<red-team findings that survived but remain concerns>
|
|
227
|
+
|
|
228
|
+
**What must be true for this idea to succeed:**
|
|
229
|
+
<assumptions that must hold>
|
|
230
|
+
|
|
231
|
+
**Minimum viable version:**
|
|
232
|
+
<scope that can be built in remaining time>
|
|
233
|
+
|
|
234
|
+
**Highest-value differentiator:**
|
|
235
|
+
<the one thing that makes this win>
|
|
236
|
+
|
|
237
|
+
**Estimated implementation difficulty:** <low | medium | high>
|
|
238
|
+
|
|
239
|
+
**Recommended next action:**
|
|
240
|
+
<exactly ONE action>
|
|
241
|
+
|
|
242
|
+
---
|
|
243
|
+
|
|
244
|
+
## 8. Human Confirmation
|
|
245
|
+
|
|
246
|
+
**Human confirmation status:** <pending | confirmed | rejected>
|
|
247
|
+
|
|
248
|
+
**Confirmed by:** <name or "pending">
|
|
249
|
+
**Confirmed at:** <UTC date/time or "pending">
|
|
250
|
+
|
|
251
|
+
**Rule:** Only explicit human confirmation can set `selected idea` in `.sherpa/project-state.md`. The engine recommends; the human decides.
|
|
@@ -0,0 +1,96 @@
|
|
|
1
|
+
# Implementation Plan
|
|
2
|
+
|
|
3
|
+
## Project
|
|
4
|
+
- Name: UNKNOWN
|
|
5
|
+
- Source project-state: `.sherpa/project-state.md`
|
|
6
|
+
- Plan status: NOT READY | READY | IN PROGRESS | BLOCKED | COMPLETE
|
|
7
|
+
- Last reviewed: UNKNOWN
|
|
8
|
+
|
|
9
|
+
## Selected Idea
|
|
10
|
+
- Name: UNKNOWN
|
|
11
|
+
- Phase 2 evidence: UNKNOWN
|
|
12
|
+
|
|
13
|
+
## Readiness
|
|
14
|
+
- Selected idea: UNKNOWN
|
|
15
|
+
- Repository baseline: UNKNOWN
|
|
16
|
+
- Phase 3 repository analysis: UNKNOWN
|
|
17
|
+
- Phase 3 project plan: UNKNOWN
|
|
18
|
+
- Architecture: UNKNOWN
|
|
19
|
+
- MVP: UNKNOWN
|
|
20
|
+
- Implementation readiness: NOT READY | READY
|
|
21
|
+
- Blocking issues: UNKNOWN
|
|
22
|
+
|
|
23
|
+
## Development Baseline
|
|
24
|
+
- Repository root: UNKNOWN
|
|
25
|
+
- Revision: UNKNOWN
|
|
26
|
+
- Working tree: UNKNOWN
|
|
27
|
+
- Runtime: UNKNOWN
|
|
28
|
+
- Framework: UNKNOWN
|
|
29
|
+
- Package manager: UNKNOWN
|
|
30
|
+
- Entry points: UNKNOWN
|
|
31
|
+
- Existing tests: UNKNOWN
|
|
32
|
+
- Build command: UNKNOWN
|
|
33
|
+
- Run command: UNKNOWN
|
|
34
|
+
- Environment/configuration: UNKNOWN (record variable names only; never secret values)
|
|
35
|
+
- Current implementation status: UNKNOWN
|
|
36
|
+
|
|
37
|
+
## Workstreams
|
|
38
|
+
|
|
39
|
+
### Workstream 1 — <name>
|
|
40
|
+
- Objective: UNKNOWN
|
|
41
|
+
- Files/components: UNKNOWN
|
|
42
|
+
- Dependencies: UNKNOWN
|
|
43
|
+
- Tasks: UNKNOWN
|
|
44
|
+
- Validation: UNKNOWN
|
|
45
|
+
- Status: NOT_STARTED | IN_PROGRESS | BLOCKED | COMPLETE
|
|
46
|
+
|
|
47
|
+
### Workstream 2 — <name>
|
|
48
|
+
- Objective: UNKNOWN
|
|
49
|
+
- Files/components: UNKNOWN
|
|
50
|
+
- Dependencies: UNKNOWN
|
|
51
|
+
- Tasks: UNKNOWN
|
|
52
|
+
- Validation: UNKNOWN
|
|
53
|
+
- Status: NOT_STARTED | IN_PROGRESS | BLOCKED | COMPLETE
|
|
54
|
+
|
|
55
|
+
## Critical Path
|
|
56
|
+
|
|
57
|
+
1. UNKNOWN
|
|
58
|
+
|
|
59
|
+
## Task Queue
|
|
60
|
+
|
|
61
|
+
| ID | Task | Workstream | MVP priority | Dependencies | Status |
|
|
62
|
+
|---|---|---|---|---|---|
|
|
63
|
+
| UNKNOWN | UNKNOWN | UNKNOWN | MUST HAVE / SHOULD HAVE / OPTIONAL | UNKNOWN | NOT_STARTED / IN_PROGRESS / BLOCKED / COMPLETE |
|
|
64
|
+
|
|
65
|
+
## Implementation Risks
|
|
66
|
+
|
|
67
|
+
| Risk | Likelihood | Impact | Mitigation | Evidence type |
|
|
68
|
+
|---|---|---|---|---|
|
|
69
|
+
| UNKNOWN | UNKNOWN | UNKNOWN | UNKNOWN | UNKNOWN |
|
|
70
|
+
|
|
71
|
+
## Blockers
|
|
72
|
+
- UNKNOWN
|
|
73
|
+
|
|
74
|
+
## Validation Strategy
|
|
75
|
+
- Relevant checks by task/component: UNKNOWN
|
|
76
|
+
- Checks actually executed and results: UNKNOWN
|
|
77
|
+
- Checks not run: UNKNOWN
|
|
78
|
+
|
|
79
|
+
## Execution Evidence
|
|
80
|
+
- Record command, date/time, exit/result, scope, and relevant output for each execution claim. Do not use generated planning artifacts as execution evidence.
|
|
81
|
+
- Evidence: UNKNOWN
|
|
82
|
+
|
|
83
|
+
## Time Strategy
|
|
84
|
+
- Time remaining: UNKNOWN
|
|
85
|
+
- Priority focus: UNKNOWN
|
|
86
|
+
|
|
87
|
+
## Unknowns
|
|
88
|
+
- UNKNOWN
|
|
89
|
+
|
|
90
|
+
## Current Implementation Status
|
|
91
|
+
- Overall: NOT_STARTED | IN_PROGRESS | BLOCKED | COMPLETE
|
|
92
|
+
- Current task: UNKNOWN
|
|
93
|
+
- Completed workstreams: UNKNOWN
|
|
94
|
+
|
|
95
|
+
## Recommended Next Action
|
|
96
|
+
- PRIMARY NEXT ACTION: UNKNOWN
|
|
@@ -0,0 +1,57 @@
|
|
|
1
|
+
# Implementation Task
|
|
2
|
+
|
|
3
|
+
## Task ID
|
|
4
|
+
UNKNOWN
|
|
5
|
+
|
|
6
|
+
## Title
|
|
7
|
+
UNKNOWN
|
|
8
|
+
|
|
9
|
+
## Objective
|
|
10
|
+
UNKNOWN
|
|
11
|
+
|
|
12
|
+
## Why This Task Exists
|
|
13
|
+
Approved plan reference: UNKNOWN
|
|
14
|
+
MVP priority: MUST HAVE | SHOULD HAVE | OPTIONAL
|
|
15
|
+
|
|
16
|
+
## Workstream
|
|
17
|
+
UNKNOWN
|
|
18
|
+
|
|
19
|
+
## Priority
|
|
20
|
+
MUST HAVE | SHOULD HAVE | OPTIONAL
|
|
21
|
+
|
|
22
|
+
## Dependencies
|
|
23
|
+
- UNKNOWN
|
|
24
|
+
|
|
25
|
+
## Files / Components
|
|
26
|
+
- UNKNOWN
|
|
27
|
+
|
|
28
|
+
## Preconditions
|
|
29
|
+
- Readiness evidence: UNKNOWN
|
|
30
|
+
- Architecture approval: UNKNOWN
|
|
31
|
+
- Required dependencies available: UNKNOWN
|
|
32
|
+
|
|
33
|
+
## Planned Change
|
|
34
|
+
UNKNOWN
|
|
35
|
+
|
|
36
|
+
## Validation Required
|
|
37
|
+
- Commands/checks: UNKNOWN
|
|
38
|
+
- Expected evidence: UNKNOWN
|
|
39
|
+
|
|
40
|
+
## Execution Result
|
|
41
|
+
- Status: NOT_STARTED | IN_PROGRESS | BLOCKED | COMPLETE
|
|
42
|
+
- Change summary: UNKNOWN
|
|
43
|
+
- Validation result: UNKNOWN
|
|
44
|
+
- Failures/blockers: UNKNOWN
|
|
45
|
+
|
|
46
|
+
## Evidence
|
|
47
|
+
- Command, date/time, exit/result, scope, and relevant output: UNKNOWN
|
|
48
|
+
- Source (repository path or execution record): UNKNOWN
|
|
49
|
+
|
|
50
|
+
## Risks
|
|
51
|
+
- UNKNOWN
|
|
52
|
+
|
|
53
|
+
## Status
|
|
54
|
+
NOT_STARTED | IN_PROGRESS | BLOCKED | COMPLETE
|
|
55
|
+
|
|
56
|
+
## Notes
|
|
57
|
+
UNKNOWN
|
|
@@ -0,0 +1,135 @@
|
|
|
1
|
+
# Improvement Candidate — <ID>
|
|
2
|
+
|
|
3
|
+
**Candidate ID:** <unique ID>
|
|
4
|
+
**Title:** <short title>
|
|
5
|
+
**Description:** <what specifically would change>
|
|
6
|
+
|
|
7
|
+
---
|
|
8
|
+
|
|
9
|
+
## 1. Target Criterion
|
|
10
|
+
|
|
11
|
+
| Field | Value |
|
|
12
|
+
|-------|-------|
|
|
13
|
+
| Criterion | <name> |
|
|
14
|
+
| Weight | <weight or UNKNOWN> |
|
|
15
|
+
| Weight Label | OFFICIAL / UNKNOWN / PROVISIONAL |
|
|
16
|
+
| Current Performance | <1–10 or UNKNOWN> |
|
|
17
|
+
| Gap Classification | NONE / LOW / MEDIUM / HIGH / CRITICAL / UNKNOWN |
|
|
18
|
+
|
|
19
|
+
---
|
|
20
|
+
|
|
21
|
+
## 2. Category Assignment
|
|
22
|
+
|
|
23
|
+
**Category(ies):**
|
|
24
|
+
|
|
25
|
+
| ID | Category | Rationale |
|
|
26
|
+
|----|----------|-----------|
|
|
27
|
+
| A | Differentiation | |
|
|
28
|
+
| B | Technical Credibility | |
|
|
29
|
+
| C | Core Functionality | |
|
|
30
|
+
| D | Demo Impact | |
|
|
31
|
+
| E | UX | |
|
|
32
|
+
| F | Security / Trust | |
|
|
33
|
+
| G | Evidence | |
|
|
34
|
+
| H | Presentation | |
|
|
35
|
+
| I | Reliability | |
|
|
36
|
+
|
|
37
|
+
**Rule:** Select one or more. Presentation (H) only within current phase scope; no PPT creation.
|
|
38
|
+
|
|
39
|
+
---
|
|
40
|
+
|
|
41
|
+
## 3. Expected Score Impact
|
|
42
|
+
|
|
43
|
+
**Score Impact:** VERY LOW / LOW / MEDIUM / HIGH / VERY HIGH
|
|
44
|
+
|
|
45
|
+
**Reasoning:** <why this impact level>
|
|
46
|
+
|
|
47
|
+
**Evidence:** <FACT / INFERENCE / ASSUMPTION / UNKNOWN>
|
|
48
|
+
**Source:** <path or description>
|
|
49
|
+
**Confidence:** HIGH / MEDIUM / LOW / UNKNOWN
|
|
50
|
+
|
|
51
|
+
**Score Label:** OFFICIAL / ESTIMATED / PROVISIONAL / UNKNOWN
|
|
52
|
+
|
|
53
|
+
---
|
|
54
|
+
|
|
55
|
+
## 4. Evaluation Dimensions
|
|
56
|
+
|
|
57
|
+
| Dimension | Value |
|
|
58
|
+
|-----------|-------|
|
|
59
|
+
| Score Impact | VERY LOW / LOW / MEDIUM / HIGH / VERY HIGH |
|
|
60
|
+
| Confidence | HIGH / MEDIUM / LOW / UNKNOWN |
|
|
61
|
+
| Judge Visibility | LOW / MEDIUM / HIGH / VERY HIGH |
|
|
62
|
+
| Implementation Cost | TRIVIAL / LOW / MEDIUM / HIGH / VERY HIGH |
|
|
63
|
+
| Risk | LOW / MEDIUM / HIGH / CRITICAL / UNKNOWN |
|
|
64
|
+
|
|
65
|
+
---
|
|
66
|
+
|
|
67
|
+
## 5. Optimization Heuristic
|
|
68
|
+
|
|
69
|
+
**OPTIMIZATION HEURISTIC — Not judging mathematics.**
|
|
70
|
+
|
|
71
|
+
```
|
|
72
|
+
Expected Value = Score Impact × Confidence × Judge Visibility ÷ Implementation Cost
|
|
73
|
+
```
|
|
74
|
+
|
|
75
|
+
**Heuristic Rank:** <number or UNKNOWN>
|
|
76
|
+
**Heuristic Basis:** <qualitative explanation>
|
|
77
|
+
|
|
78
|
+
---
|
|
79
|
+
|
|
80
|
+
## 6. Implementation Details
|
|
81
|
+
|
|
82
|
+
| Field | Value |
|
|
83
|
+
|-------|-------|
|
|
84
|
+
| Time Required | <hours or UNKNOWN> |
|
|
85
|
+
| Dependencies | <list or UNKNOWN> |
|
|
86
|
+
| Blockers | <list or UNKNOWN> |
|
|
87
|
+
| Files/Components Affected | <list or UNKNOWN> |
|
|
88
|
+
| Validation Required | <commands/checks or UNKNOWN> |
|
|
89
|
+
|
|
90
|
+
---
|
|
91
|
+
|
|
92
|
+
## 7. Worth Doing Assessment
|
|
93
|
+
|
|
94
|
+
**Is this improvement worth doing?** YES / NO / UNKNOWN
|
|
95
|
+
|
|
96
|
+
**Reasoning:** <why or why not, tied to impact, cost, risk, time, and judge visibility>
|
|
97
|
+
|
|
98
|
+
**Time-aware filtering applied:** YES / NO
|
|
99
|
+
**Time-aware category:** >24h / 12–24h / 6–12h / 2–6h / <2h / UNKNOWN
|
|
100
|
+
|
|
101
|
+
---
|
|
102
|
+
|
|
103
|
+
## 8. What Should NOT Be Changed (Related)
|
|
104
|
+
|
|
105
|
+
| Item | Reason | Risk of Changing |
|
|
106
|
+
|------|--------|------------------|
|
|
107
|
+
| | | |
|
|
108
|
+
|
|
109
|
+
---
|
|
110
|
+
|
|
111
|
+
## 9. Priority Classification
|
|
112
|
+
|
|
113
|
+
**Priority:** P0 — CRITICAL | P1 — HIGH IMPACT | P2 — MEDIUM IMPACT | P3 — LOW IMPACT | DROP
|
|
114
|
+
|
|
115
|
+
**Reasoning:** <exactly one priority, tied to the definitions>
|
|
116
|
+
|
|
117
|
+
**Rule:** Every candidate receives exactly one priority.
|
|
118
|
+
|
|
119
|
+
---
|
|
120
|
+
|
|
121
|
+
## 10. Unknowns
|
|
122
|
+
|
|
123
|
+
| Unknown | Why Unknown | Impact | Source |
|
|
124
|
+
|---------|-------------|--------|--------|
|
|
125
|
+
| | | | |
|
|
126
|
+
|
|
127
|
+
---
|
|
128
|
+
|
|
129
|
+
## 11. Evidence Summary
|
|
130
|
+
|
|
131
|
+
| Claim | Evidence Type | Source | Confidence |
|
|
132
|
+
|-------|---------------|--------|------------|
|
|
133
|
+
| | FACT / INFERENCE / ASSUMPTION / UNKNOWN | | HIGH / MEDIUM / LOW / UNKNOWN |
|
|
134
|
+
|
|
135
|
+
**Rule:** Never convert UNKNOWN into a favorable assumption. Do not claim score improvements without evidence.
|
|
@@ -0,0 +1,18 @@
|
|
|
1
|
+
# Internal Improvement Record
|
|
2
|
+
|
|
3
|
+
- Improvement ID: UNKNOWN
|
|
4
|
+
- Title: UNKNOWN
|
|
5
|
+
- Affected phase: UNKNOWN
|
|
6
|
+
- Problem / contract gap: UNKNOWN
|
|
7
|
+
- Evidence: UNKNOWN
|
|
8
|
+
- Recommendation: UNKNOWN
|
|
9
|
+
- Expected impact: UNKNOWN
|
|
10
|
+
- Cost: UNKNOWN
|
|
11
|
+
- Dependencies: UNKNOWN
|
|
12
|
+
- Priority: P0 / P1 / P2 / P3
|
|
13
|
+
- Status: UNKNOWN
|
|
14
|
+
- Target / owner: UNKNOWN
|
|
15
|
+
|
|
16
|
+
**INTERNAL sherpa IMPROVEMENT PRIORITY — NOT OFFICIAL HACKATHON SCORING**
|
|
17
|
+
|
|
18
|
+
Recommendation only. Does not authorize modification of locked prior-phase artifacts.
|
|
@@ -0,0 +1,20 @@
|
|
|
1
|
+
# Incident Retrospective Record
|
|
2
|
+
|
|
3
|
+
- Incident ID: UNKNOWN
|
|
4
|
+
- Title: UNKNOWN
|
|
5
|
+
- Phase: UNKNOWN
|
|
6
|
+
- Severity: UNKNOWN
|
|
7
|
+
- Date / time: UNKNOWN
|
|
8
|
+
- What happened: UNKNOWN
|
|
9
|
+
- Expected behavior: UNKNOWN
|
|
10
|
+
- Actual behavior: UNKNOWN
|
|
11
|
+
- Evidence: UNKNOWN
|
|
12
|
+
- Impact: UNKNOWN
|
|
13
|
+
- Immediate response: UNKNOWN
|
|
14
|
+
- Resolution: UNKNOWN
|
|
15
|
+
- Root cause status: UNKNOWN
|
|
16
|
+
- Contributing factors: UNKNOWN
|
|
17
|
+
- Preventive action: UNKNOWN
|
|
18
|
+
- Lesson: UNKNOWN
|
|
19
|
+
|
|
20
|
+
Do not create an incident without evidence. Avoid blame unless evidence supports an appropriate attribution.
|
|
@@ -0,0 +1,41 @@
|
|
|
1
|
+
# Judge Criterion
|
|
2
|
+
|
|
3
|
+
## Criterion ID
|
|
4
|
+
|
|
5
|
+
## Criterion Name
|
|
6
|
+
|
|
7
|
+
## Source
|
|
8
|
+
|
|
9
|
+
OFFICIAL | USER_PROVIDED | UNKNOWN | SIMULATION CRITERION (NOT OFFICIAL RUBRIC)
|
|
10
|
+
|
|
11
|
+
## Official Weight
|
|
12
|
+
|
|
13
|
+
## Weight Source
|
|
14
|
+
|
|
15
|
+
## Judge Question
|
|
16
|
+
|
|
17
|
+
## Evidence
|
|
18
|
+
|
|
19
|
+
| Evidence Item | Evidence Type | Source | Confidence | Mapping Status |
|
|
20
|
+
|---------------|---------------|--------|------------|----------------|
|
|
21
|
+
| | | | | SUPPORTED / PARTIALLY_SUPPORTED / UNKNOWN / CONTRADICTED / NOT_APPLICABLE |
|
|
22
|
+
|
|
23
|
+
## Observed Strengths
|
|
24
|
+
|
|
25
|
+
## Observed Weaknesses
|
|
26
|
+
|
|
27
|
+
## Likely Judge Reaction
|
|
28
|
+
|
|
29
|
+
## Confidence
|
|
30
|
+
|
|
31
|
+
HIGH | MEDIUM | LOW | UNKNOWN
|
|
32
|
+
|
|
33
|
+
## Unknowns
|
|
34
|
+
|
|
35
|
+
## Potential Concern
|
|
36
|
+
|
|
37
|
+
## Contributing Categories
|
|
38
|
+
|
|
39
|
+
| Category | Diagnostic Dimensions |
|
|
40
|
+
|----------|----------------------|
|
|
41
|
+
| | | |
|
|
@@ -0,0 +1,41 @@
|
|
|
1
|
+
# Judge Question
|
|
2
|
+
|
|
3
|
+
## Question ID
|
|
4
|
+
|
|
5
|
+
## Persona
|
|
6
|
+
|
|
7
|
+
TECHNICAL | PRODUCT | DEMO | SKEPTICAL
|
|
8
|
+
|
|
9
|
+
## Question
|
|
10
|
+
|
|
11
|
+
## Why a judge might ask
|
|
12
|
+
|
|
13
|
+
## Relevant criterion
|
|
14
|
+
|
|
15
|
+
## Expected answer points
|
|
16
|
+
|
|
17
|
+
1.
|
|
18
|
+
2.
|
|
19
|
+
3.
|
|
20
|
+
|
|
21
|
+
## Evidence supporting answer
|
|
22
|
+
|
|
23
|
+
## Potential trap
|
|
24
|
+
|
|
25
|
+
## Confidence
|
|
26
|
+
|
|
27
|
+
HIGH | MEDIUM | LOW | UNKNOWN
|
|
28
|
+
|
|
29
|
+
## Status
|
|
30
|
+
|
|
31
|
+
EXPECTED | ANSWERED | UNANSWERED | BLOCKED | UNKNOWN
|
|
32
|
+
|
|
33
|
+
## Answer quality
|
|
34
|
+
|
|
35
|
+
STRONG | ADEQUATE | WEAK | UNKNOWN | UNSUPPORTED
|
|
36
|
+
|
|
37
|
+
## Answer readiness
|
|
38
|
+
|
|
39
|
+
READY | PARTIALLY_READY | WEAK | UNKNOWN | NOT_APPLICABLE
|
|
40
|
+
|
|
41
|
+
## Reasoning
|