sherpa-skill 2.0.6 → 2.0.7
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.agents/plugins/marketplace.json +11 -0
- package/.agents/skills/sherpa/SKILL.md +161 -0
- package/.agents/skills/sherpa/commands/README.md +43 -0
- package/.agents/skills/sherpa/commands/manifest.json +589 -0
- package/.agents/skills/sherpa/commands/sherpa-research.md +147 -0
- package/.agents/skills/sherpa/core/commands/router.py +171 -0
- package/.agents/skills/sherpa/core/configuration/manager.py +504 -0
- package/.agents/skills/sherpa/core/ideas/engine.py +564 -0
- package/.agents/skills/sherpa/docs/commands/README.md +96 -0
- package/.agents/skills/sherpa/docs/configuration/runtime-verification.md +64 -0
- package/.agents/skills/sherpa/rules/demo-preparation-rules.md +543 -0
- package/.agents/skills/sherpa/rules/engineering-rules.md +221 -0
- package/.agents/skills/sherpa/rules/final-audit-rules.md +824 -0
- package/.agents/skills/sherpa/rules/implementation-rules.md +127 -0
- package/.agents/skills/sherpa/rules/judge-rules.md +443 -0
- package/.agents/skills/sherpa/rules/mentor-rules.md +109 -0
- package/.agents/skills/sherpa/rules/postmortem-rules.md +69 -0
- package/.agents/skills/sherpa/rules/presentation-rules.md +783 -0
- package/.agents/skills/sherpa/rules/red-team-rules.md +185 -0
- package/.agents/skills/sherpa/rules/research-rules.md +184 -0
- package/.agents/skills/sherpa/rules/score-optimization-rules.md +355 -0
- package/.agents/skills/sherpa/rules/scoring-rules.md +216 -0
- package/.agents/skills/sherpa/rules/submission-rules.md +41 -0
- package/.agents/skills/sherpa/rules/testing-security-rules.md +87 -0
- package/.agents/skills/sherpa/rules/ux-rules.md +89 -0
- package/.agents/skills/sherpa/src/config_manager.py +474 -0
- package/.agents/skills/sherpa/src/verification.py +458 -0
- package/.agents/skills/sherpa/templates/audit-finding.md +20 -0
- package/.agents/skills/sherpa/templates/claim-audit.md +15 -0
- package/.agents/skills/sherpa/templates/configuration/hackathon.json +21 -0
- package/.agents/skills/sherpa/templates/configuration/integrations.env.example +3 -0
- package/.agents/skills/sherpa/templates/configuration/project.env.example +12 -0
- package/.agents/skills/sherpa/templates/configuration/providers.env.example +4 -0
- package/.agents/skills/sherpa/templates/configuration/settings.json +22 -0
- package/.agents/skills/sherpa/templates/consistency-audit.md +17 -0
- package/.agents/skills/sherpa/templates/decision-log.md +18 -0
- package/.agents/skills/sherpa/templates/demo-checkpoint.md +42 -0
- package/.agents/skills/sherpa/templates/demo-evidence.md +32 -0
- package/.agents/skills/sherpa/templates/demo-finding.md +112 -0
- package/.agents/skills/sherpa/templates/demo-flow.md +52 -0
- package/.agents/skills/sherpa/templates/demo-plan.md +265 -0
- package/.agents/skills/sherpa/templates/demo-verification.md +57 -0
- package/.agents/skills/sherpa/templates/final-audit.md +387 -0
- package/.agents/skills/sherpa/templates/final-risk.md +17 -0
- package/.agents/skills/sherpa/templates/final-verification.md +57 -0
- package/.agents/skills/sherpa/templates/gap-analysis.md +113 -0
- package/.agents/skills/sherpa/templates/idea-comparison.md +129 -0
- package/.agents/skills/sherpa/templates/idea-evaluation.md +251 -0
- package/.agents/skills/sherpa/templates/implementation-plan.md +96 -0
- package/.agents/skills/sherpa/templates/implementation-task.md +57 -0
- package/.agents/skills/sherpa/templates/improvement-candidate.md +135 -0
- package/.agents/skills/sherpa/templates/improvement.md +18 -0
- package/.agents/skills/sherpa/templates/incident.md +20 -0
- package/.agents/skills/sherpa/templates/judge-criterion.md +41 -0
- package/.agents/skills/sherpa/templates/judge-question.md +41 -0
- package/.agents/skills/sherpa/templates/judge-session.md +125 -0
- package/.agents/skills/sherpa/templates/judge-simulation.md +264 -0
- package/.agents/skills/sherpa/templates/lesson.md +14 -0
- package/.agents/skills/sherpa/templates/postmortem.md +87 -0
- package/.agents/skills/sherpa/templates/presentation-evidence.md +33 -0
- package/.agents/skills/sherpa/templates/presentation-plan.md +349 -0
- package/.agents/skills/sherpa/templates/presentation-qna.md +29 -0
- package/.agents/skills/sherpa/templates/presentation-risk.md +42 -0
- package/.agents/skills/sherpa/templates/presentation-verification.md +57 -0
- package/.agents/skills/sherpa/templates/project-plan.md +242 -0
- package/.agents/skills/sherpa/templates/project-state.md +84 -0
- package/.agents/skills/sherpa/templates/red-team-finding.md +73 -0
- package/.agents/skills/sherpa/templates/red-team-review.md +105 -0
- package/.agents/skills/sherpa/templates/red-team-scenario.md +43 -0
- package/.agents/skills/sherpa/templates/red-team-verification.md +31 -0
- package/.agents/skills/sherpa/templates/repo-analysis.md +204 -0
- package/.agents/skills/sherpa/templates/requirement-audit.md +15 -0
- package/.agents/skills/sherpa/templates/research-comparison.md +124 -0
- package/.agents/skills/sherpa/templates/research-plan.md +93 -0
- package/.agents/skills/sherpa/templates/research-report.md +92 -0
- package/.agents/skills/sherpa/templates/research-source.md +77 -0
- package/.agents/skills/sherpa/templates/score-optimization-plan.md +197 -0
- package/.agents/skills/sherpa/templates/security-finding.md +45 -0
- package/.agents/skills/sherpa/templates/security-review.md +64 -0
- package/.agents/skills/sherpa/templates/slide-claim.md +47 -0
- package/.agents/skills/sherpa/templates/slide-plan.md +127 -0
- package/.agents/skills/sherpa/templates/submission-artifact.md +15 -0
- package/.agents/skills/sherpa/templates/submission-checklist.md +24 -0
- package/.agents/skills/sherpa/templates/submission-field.md +14 -0
- package/.agents/skills/sherpa/templates/submission-link.md +14 -0
- package/.agents/skills/sherpa/templates/submission-plan.md +31 -0
- package/.agents/skills/sherpa/templates/submission-readiness.md +18 -0
- package/.agents/skills/sherpa/templates/submission-requirement.md +12 -0
- package/.agents/skills/sherpa/templates/submission-risk.md +14 -0
- package/.agents/skills/sherpa/templates/submission-snapshot.md +20 -0
- package/.agents/skills/sherpa/templates/submission-verification.md +12 -0
- package/.agents/skills/sherpa/templates/test-plan.md +59 -0
- package/.agents/skills/sherpa/templates/test-result.md +46 -0
- package/.agents/skills/sherpa/templates/timeline.md +11 -0
- package/.agents/skills/sherpa/templates/ux-finding.md +56 -0
- package/.agents/skills/sherpa/templates/ux-flow.md +46 -0
- package/.agents/skills/sherpa/templates/ux-review.md +113 -0
- package/.agents/skills/sherpa/templates/ux-verification.md +32 -0
- package/.agents/skills/sherpa/workflows/configuration.md +23 -0
- package/.agents/skills/sherpa/workflows/demo-preparation.md +399 -0
- package/.agents/skills/sherpa/workflows/final-audit.md +713 -0
- package/.agents/skills/sherpa/workflows/idea-evaluation.md +239 -0
- package/.agents/skills/sherpa/workflows/idea-intelligence.md +69 -0
- package/.agents/skills/sherpa/workflows/implementation.md +42 -0
- package/.agents/skills/sherpa/workflows/init.md +102 -0
- package/.agents/skills/sherpa/workflows/judge-simulation.md +408 -0
- package/.agents/skills/sherpa/workflows/lifecycle.md +51 -0
- package/.agents/skills/sherpa/workflows/next.md +96 -0
- package/.agents/skills/sherpa/workflows/postmortem.md +76 -0
- package/.agents/skills/sherpa/workflows/presentation.md +522 -0
- package/.agents/skills/sherpa/workflows/project-planning.md +327 -0
- package/.agents/skills/sherpa/workflows/red-team.md +373 -0
- package/.agents/skills/sherpa/workflows/research.md +142 -0
- package/.agents/skills/sherpa/workflows/score-optimization.md +276 -0
- package/.agents/skills/sherpa/workflows/status.md +107 -0
- package/.agents/skills/sherpa/workflows/submission.md +46 -0
- package/.agents/skills/sherpa/workflows/testing-security.md +44 -0
- package/.agents/skills/sherpa/workflows/ux-review.md +59 -0
- package/.claude-plugin/marketplace.json +21 -0
- package/.claude-plugin/plugin.json +13 -0
- package/.codex-plugin/plugin.json +13 -0
- package/GEMINI.md +3 -0
- package/README.md +11 -7
- package/SKILL.md +161 -0
- package/distribution/cli/sherpa +1 -1
- package/gemini-extension.json +7 -0
- package/package.json +31 -3
- package/plugin.json +20 -0
- package/qwen-extension.json +6 -0
- package/skills/sherpa/SKILL.md +161 -0
- package/skills/sherpa/commands/README.md +43 -0
- package/skills/sherpa/commands/manifest.json +589 -0
- package/skills/sherpa/commands/sherpa-research.md +147 -0
- package/skills/sherpa/core/commands/router.py +171 -0
- package/skills/sherpa/core/configuration/manager.py +504 -0
- package/skills/sherpa/core/ideas/engine.py +564 -0
- package/skills/sherpa/docs/commands/README.md +96 -0
- package/skills/sherpa/docs/configuration/runtime-verification.md +64 -0
- package/skills/sherpa/rules/demo-preparation-rules.md +543 -0
- package/skills/sherpa/rules/engineering-rules.md +221 -0
- package/skills/sherpa/rules/final-audit-rules.md +824 -0
- package/skills/sherpa/rules/implementation-rules.md +127 -0
- package/skills/sherpa/rules/judge-rules.md +443 -0
- package/skills/sherpa/rules/mentor-rules.md +109 -0
- package/skills/sherpa/rules/postmortem-rules.md +69 -0
- package/skills/sherpa/rules/presentation-rules.md +783 -0
- package/skills/sherpa/rules/red-team-rules.md +185 -0
- package/skills/sherpa/rules/research-rules.md +184 -0
- package/skills/sherpa/rules/score-optimization-rules.md +355 -0
- package/skills/sherpa/rules/scoring-rules.md +216 -0
- package/skills/sherpa/rules/submission-rules.md +41 -0
- package/skills/sherpa/rules/testing-security-rules.md +87 -0
- package/skills/sherpa/rules/ux-rules.md +89 -0
- package/skills/sherpa/src/config_manager.py +474 -0
- package/skills/sherpa/src/verification.py +458 -0
- package/skills/sherpa/templates/audit-finding.md +20 -0
- package/skills/sherpa/templates/claim-audit.md +15 -0
- package/skills/sherpa/templates/configuration/hackathon.json +21 -0
- package/skills/sherpa/templates/configuration/integrations.env.example +3 -0
- package/skills/sherpa/templates/configuration/project.env.example +12 -0
- package/skills/sherpa/templates/configuration/providers.env.example +4 -0
- package/skills/sherpa/templates/configuration/settings.json +22 -0
- package/skills/sherpa/templates/consistency-audit.md +17 -0
- package/skills/sherpa/templates/decision-log.md +18 -0
- package/skills/sherpa/templates/demo-checkpoint.md +42 -0
- package/skills/sherpa/templates/demo-evidence.md +32 -0
- package/skills/sherpa/templates/demo-finding.md +112 -0
- package/skills/sherpa/templates/demo-flow.md +52 -0
- package/skills/sherpa/templates/demo-plan.md +265 -0
- package/skills/sherpa/templates/demo-verification.md +57 -0
- package/skills/sherpa/templates/final-audit.md +387 -0
- package/skills/sherpa/templates/final-risk.md +17 -0
- package/skills/sherpa/templates/final-verification.md +57 -0
- package/skills/sherpa/templates/gap-analysis.md +113 -0
- package/skills/sherpa/templates/idea-comparison.md +129 -0
- package/skills/sherpa/templates/idea-evaluation.md +251 -0
- package/skills/sherpa/templates/implementation-plan.md +96 -0
- package/skills/sherpa/templates/implementation-task.md +57 -0
- package/skills/sherpa/templates/improvement-candidate.md +135 -0
- package/skills/sherpa/templates/improvement.md +18 -0
- package/skills/sherpa/templates/incident.md +20 -0
- package/skills/sherpa/templates/judge-criterion.md +41 -0
- package/skills/sherpa/templates/judge-question.md +41 -0
- package/skills/sherpa/templates/judge-session.md +125 -0
- package/skills/sherpa/templates/judge-simulation.md +264 -0
- package/skills/sherpa/templates/lesson.md +14 -0
- package/skills/sherpa/templates/postmortem.md +87 -0
- package/skills/sherpa/templates/presentation-evidence.md +33 -0
- package/skills/sherpa/templates/presentation-plan.md +349 -0
- package/skills/sherpa/templates/presentation-qna.md +29 -0
- package/skills/sherpa/templates/presentation-risk.md +42 -0
- package/skills/sherpa/templates/presentation-verification.md +57 -0
- package/skills/sherpa/templates/project-plan.md +242 -0
- package/skills/sherpa/templates/project-state.md +84 -0
- package/skills/sherpa/templates/red-team-finding.md +73 -0
- package/skills/sherpa/templates/red-team-review.md +105 -0
- package/skills/sherpa/templates/red-team-scenario.md +43 -0
- package/skills/sherpa/templates/red-team-verification.md +31 -0
- package/skills/sherpa/templates/repo-analysis.md +204 -0
- package/skills/sherpa/templates/requirement-audit.md +15 -0
- package/skills/sherpa/templates/research-comparison.md +124 -0
- package/skills/sherpa/templates/research-plan.md +93 -0
- package/skills/sherpa/templates/research-report.md +92 -0
- package/skills/sherpa/templates/research-source.md +77 -0
- package/skills/sherpa/templates/score-optimization-plan.md +197 -0
- package/skills/sherpa/templates/security-finding.md +45 -0
- package/skills/sherpa/templates/security-review.md +64 -0
- package/skills/sherpa/templates/slide-claim.md +47 -0
- package/skills/sherpa/templates/slide-plan.md +127 -0
- package/skills/sherpa/templates/submission-artifact.md +15 -0
- package/skills/sherpa/templates/submission-checklist.md +24 -0
- package/skills/sherpa/templates/submission-field.md +14 -0
- package/skills/sherpa/templates/submission-link.md +14 -0
- package/skills/sherpa/templates/submission-plan.md +31 -0
- package/skills/sherpa/templates/submission-readiness.md +18 -0
- package/skills/sherpa/templates/submission-requirement.md +12 -0
- package/skills/sherpa/templates/submission-risk.md +14 -0
- package/skills/sherpa/templates/submission-snapshot.md +20 -0
- package/skills/sherpa/templates/submission-verification.md +12 -0
- package/skills/sherpa/templates/test-plan.md +59 -0
- package/skills/sherpa/templates/test-result.md +46 -0
- package/skills/sherpa/templates/timeline.md +11 -0
- package/skills/sherpa/templates/ux-finding.md +56 -0
- package/skills/sherpa/templates/ux-flow.md +46 -0
- package/skills/sherpa/templates/ux-review.md +113 -0
- package/skills/sherpa/templates/ux-verification.md +32 -0
- package/skills/sherpa/workflows/configuration.md +23 -0
- package/skills/sherpa/workflows/demo-preparation.md +399 -0
- package/skills/sherpa/workflows/final-audit.md +713 -0
- package/skills/sherpa/workflows/idea-evaluation.md +239 -0
- package/skills/sherpa/workflows/idea-intelligence.md +69 -0
- package/skills/sherpa/workflows/implementation.md +42 -0
- package/skills/sherpa/workflows/init.md +102 -0
- package/skills/sherpa/workflows/judge-simulation.md +408 -0
- package/skills/sherpa/workflows/lifecycle.md +51 -0
- package/skills/sherpa/workflows/next.md +96 -0
- package/skills/sherpa/workflows/postmortem.md +76 -0
- package/skills/sherpa/workflows/presentation.md +522 -0
- package/skills/sherpa/workflows/project-planning.md +327 -0
- package/skills/sherpa/workflows/red-team.md +373 -0
- package/skills/sherpa/workflows/research.md +142 -0
- package/skills/sherpa/workflows/score-optimization.md +276 -0
- package/skills/sherpa/workflows/status.md +107 -0
- package/skills/sherpa/workflows/submission.md +46 -0
- package/skills/sherpa/workflows/testing-security.md +44 -0
- package/skills/sherpa/workflows/ux-review.md +59 -0
|
@@ -0,0 +1,142 @@
|
|
|
1
|
+
# sherpa — Research Workflow
|
|
2
|
+
|
|
3
|
+
**Operation**: RESEARCH
|
|
4
|
+
**Purpose**: Evaluate research questions against evidence in a deterministic, evidence-based pipeline.
|
|
5
|
+
**Prerequisite:** sherpa must be initialized (`.sherpa/project-state.md` exists). If not, run INIT first.
|
|
6
|
+
|
|
7
|
+
## When to Use
|
|
8
|
+
|
|
9
|
+
Use RESEARCH when:
|
|
10
|
+
- You have a specific research question about the hackathon project
|
|
11
|
+
- You need evidence to support or refute a claim
|
|
12
|
+
- You want to know what is known, unknown, or assumed about a topic
|
|
13
|
+
- You need to research competitors, technologies, rules, or best practices
|
|
14
|
+
|
|
15
|
+
## Workflow Steps
|
|
16
|
+
|
|
17
|
+
### Step 1: Define the Research Question
|
|
18
|
+
|
|
19
|
+
Read from `.sherpa/project-state.md`:
|
|
20
|
+
- Hackathon name, deadline, time remaining
|
|
21
|
+
- Judging criteria and weights (or UNKNOWN)
|
|
22
|
+
- Problem statement
|
|
23
|
+
- Target users (if known)
|
|
24
|
+
|
|
25
|
+
Accept from user:
|
|
26
|
+
- Research question (one sentence)
|
|
27
|
+
- Scope (what is in scope, what is out of scope)
|
|
28
|
+
- Depth (calibration, standard, deep)
|
|
29
|
+
|
|
30
|
+
If no research question provided:
|
|
31
|
+
- Report "No research question provided."
|
|
32
|
+
- Ask user to supply a research question before research can run.
|
|
33
|
+
- Stop.
|
|
34
|
+
|
|
35
|
+
### Step 2: Research Plan
|
|
36
|
+
|
|
37
|
+
Define:
|
|
38
|
+
- What evidence is needed
|
|
39
|
+
- Where to look (repository files, web search, team input, docs)
|
|
40
|
+
- Evidence quality threshold
|
|
41
|
+
- Time budget
|
|
42
|
+
|
|
43
|
+
Record the plan in `.sherpa/evidence/research/<research-query>.md`.
|
|
44
|
+
|
|
45
|
+
### Step 3: Retrieve
|
|
46
|
+
|
|
47
|
+
Retrieve candidate evidence from:
|
|
48
|
+
- Repository source code, config, tests, docs
|
|
49
|
+
- Web search (if available and permitted)
|
|
50
|
+
- Team input
|
|
51
|
+
- Existing sherpa artifacts
|
|
52
|
+
|
|
53
|
+
Save raw retrieval results to `.sherpa/evidence/research/`.
|
|
54
|
+
|
|
55
|
+
### Step 4: Verify
|
|
56
|
+
|
|
57
|
+
For each candidate evidence item:
|
|
58
|
+
- Verify the source is real and accessible
|
|
59
|
+
- Check the claim against the source text
|
|
60
|
+
- Verify numbers, dates, entity names match exactly
|
|
61
|
+
- Check polarity/negation
|
|
62
|
+
- Check temporal consistency (dates, versions)
|
|
63
|
+
|
|
64
|
+
### Step 5: Analyze
|
|
65
|
+
|
|
66
|
+
Classify each claim as FACT, INFERENCE, ASSUMPTION, or UNKNOWN.
|
|
67
|
+
|
|
68
|
+
### Step 6: Synthesize
|
|
69
|
+
|
|
70
|
+
Combine evidence into a coherent answer. Address:
|
|
71
|
+
- What is known
|
|
72
|
+
- What is unknown
|
|
73
|
+
- What assumptions must hold
|
|
74
|
+
- What the evidence does and does not support
|
|
75
|
+
|
|
76
|
+
### Step 7: Decide
|
|
77
|
+
|
|
78
|
+
Determine what the research means for the project decision:
|
|
79
|
+
- Does it support proceeding?
|
|
80
|
+
- Does it raise blockers?
|
|
81
|
+
- What assumptions must hold?
|
|
82
|
+
- What is the recommended next action?
|
|
83
|
+
|
|
84
|
+
### Step 8: Persist
|
|
85
|
+
|
|
86
|
+
Save the research record to `.sherpa/evidence/research/<research-query>.md`.
|
|
87
|
+
Include all evidence, gates, decisions, and unknowns.
|
|
88
|
+
|
|
89
|
+
## 5. Evidence Model
|
|
90
|
+
|
|
91
|
+
| Field | Values |
|
|
92
|
+
|-------|--------|
|
|
93
|
+
| type | FACT | INFERENCE | ASSUMPTION | UNKNOWN |
|
|
94
|
+
| value | The claim |
|
|
95
|
+
| source | URL, file path, or "team input" |
|
|
96
|
+
| confidence | low | medium | high |
|
|
97
|
+
|
|
98
|
+
Rules:
|
|
99
|
+
- No claim may be tagged FACT unless directly verified from source
|
|
100
|
+
- No claim may be tagged INFERENCE without explicit reasoning
|
|
101
|
+
- ASSUMPTION must be explicitly marked as provisional
|
|
102
|
+
- UNKNOWN means no information available
|
|
103
|
+
- Never claim research was performed unless evidence was actually retrieved
|
|
104
|
+
|
|
105
|
+
## 6. Source Priority
|
|
106
|
+
|
|
107
|
+
Priority order for evidence:
|
|
108
|
+
1. Official documentation / official repository / official specification
|
|
109
|
+
2. Repository source code and tests (direct inspection)
|
|
110
|
+
3. Team input (explicitly attributed)
|
|
111
|
+
4. Secondary sources (blog posts, tutorials, secondary docs)
|
|
112
|
+
5. General web search results (lowest confidence)
|
|
113
|
+
|
|
114
|
+
## 7. Time Awareness
|
|
115
|
+
|
|
116
|
+
- If remaining time is UNKNOWN, record TIME STRATEGY = UNKNOWN
|
|
117
|
+
- Do not spend unlimited time on research
|
|
118
|
+
- If time is limited, prefer repository evidence over web search
|
|
119
|
+
|
|
120
|
+
## 8. Human Authority
|
|
121
|
+
|
|
122
|
+
Research recommends; the human decides. Research does not:
|
|
123
|
+
- Auto-approve ideas
|
|
124
|
+
- Auto-approve architecture
|
|
125
|
+
- Auto-approve implementation
|
|
126
|
+
- Change the selected idea
|
|
127
|
+
- Silently redesign architecture
|
|
128
|
+
- Replace Phase 5/7/8 engines
|
|
129
|
+
|
|
130
|
+
Research findings route to the appropriate phase but do not replace it.
|
|
131
|
+
|
|
132
|
+
## 9. Output Contract
|
|
133
|
+
|
|
134
|
+
After each research invocation, return:
|
|
135
|
+
- Research question
|
|
136
|
+
- Evidence found (with sources and confidence)
|
|
137
|
+
- Contradictions found (if any)
|
|
138
|
+
- Unknowns
|
|
139
|
+
- Decision/recommendation
|
|
140
|
+
- Exactly one PRIMARY NEXT ACTION
|
|
141
|
+
|
|
142
|
+
All research artifacts live in `.sherpa/evidence/research/`.
|
|
@@ -0,0 +1,276 @@
|
|
|
1
|
+
# sherpa — Score Optimization Workflow
|
|
2
|
+
|
|
3
|
+
**Operation:** SCORE-OPTIMIZE
|
|
4
|
+
**Lifecycle Phase:** Phase 15 — Score Optimization Intelligence
|
|
5
|
+
**Purpose:** Answer "Given the official judging criteria, actual project evidence, judge simulation results, current implementation state, and remaining time, what changes provide the highest expected increase in judging score?" Produce a prioritized optimization plan. Phase 15 optimizes score, not feature count.
|
|
6
|
+
|
|
7
|
+
## Prerequisites
|
|
8
|
+
|
|
9
|
+
- `.sherpa/project-state.md` must exist
|
|
10
|
+
- `selected idea` must be known (not UNKNOWN)
|
|
11
|
+
- Phase 2 idea evaluation evidence must exist
|
|
12
|
+
- Phase 3 project plan evidence must exist
|
|
13
|
+
- Phase 4 implementation evidence must exist
|
|
14
|
+
- Phase 5 testing/security evidence must exist
|
|
15
|
+
- Phase 7 UX evidence must exist
|
|
16
|
+
- Phase 8 Red Team evidence must exist
|
|
17
|
+
- Phase 9 Judge Simulation report must exist (`.sherpa/judge-simulation.md`)
|
|
18
|
+
- Judging criteria and weights must be identified (KNOWN) or explicitly marked UNKNOWN
|
|
19
|
+
|
|
20
|
+
If any prerequisite is missing, mark it UNKNOWN, report SCORE-OPTIMIZE = BLOCKED or LIMITED, and do not invent criteria, weights, or evidence.
|
|
21
|
+
|
|
22
|
+
## Pipeline
|
|
23
|
+
|
|
24
|
+
### Stage 1: Read Project State
|
|
25
|
+
|
|
26
|
+
Read `.sherpa/project-state.md` and capture:
|
|
27
|
+
|
|
28
|
+
- Hackathon name, deadline, time remaining
|
|
29
|
+
- Phase
|
|
30
|
+
- Selected idea
|
|
31
|
+
- Judging criteria and weights
|
|
32
|
+
- Current estimated score, potential score (if previously recorded)
|
|
33
|
+
- Largest gaps (if previously recorded)
|
|
34
|
+
- Highest-priority improvement (if previously recorded)
|
|
35
|
+
- Time-aware strategy category
|
|
36
|
+
|
|
37
|
+
### Stage 2: Read Prior-Phase Evidence
|
|
38
|
+
|
|
39
|
+
Consume (do not duplicate or replace) the following evidence:
|
|
40
|
+
|
|
41
|
+
| Phase | Source | What to consume |
|
|
42
|
+
|-------|--------|-----------------|
|
|
43
|
+
| Phase 2 | `.sherpa/decisions.md`, `.sherpa/evaluations/<idea>.md` | Selected idea, evaluation scores, differentiation, MVP scope |
|
|
44
|
+
| Phase 3 | `.sherpa/evidence/project-plan-*.md` | Architecture, MVP scope (MUST/SHOULD/OPTIONAL/EXCLUDED), workstreams, dependencies, critical path, technical risks, time strategy |
|
|
45
|
+
| Phase 4 | `.sherpa/evidence/` implementation artifacts | Repository baseline, components implemented, tests executed, deployment configuration, known issues |
|
|
46
|
+
| Phase 5 | `.sherpa/evidence/` testing/security artifacts | Test results, security findings, blocked tests, regression risks, known failures |
|
|
47
|
+
| Phase 7 | `.sherpa/ux-review.md`, `.sherpa/ux/` artifacts | UX baseline, critical flows, findings, quality gate status, limitations |
|
|
48
|
+
| Phase 8 | `.sherpa/red-team.md`, `.sherpa/red-team/` artifacts | Red team findings, risks, mitigations, quality gate status, limitations |
|
|
49
|
+
| Phase 9 | `.sherpa/judge-simulation.md` | Judge simulation report, criterion-by-criterion observations, judge concerns, judge trust, differentiation perception |
|
|
50
|
+
|
|
51
|
+
Do not re-run Phase 2–9 engines. Consume their evidence only.
|
|
52
|
+
|
|
53
|
+
Flag contradictory claims between phases or between documentation and repository:
|
|
54
|
+
|
|
55
|
+
```text
|
|
56
|
+
Documentation says X
|
|
57
|
+
Repository does Y
|
|
58
|
+
Phase 9 simulation says Z
|
|
59
|
+
```
|
|
60
|
+
|
|
61
|
+
Do not silently reconcile contradictions. Record them as separate findings.
|
|
62
|
+
|
|
63
|
+
### Stage 3: Inspect Current Repository
|
|
64
|
+
|
|
65
|
+
Inspect the actual repository:
|
|
66
|
+
|
|
67
|
+
- Project metadata
|
|
68
|
+
- Dependency manifests
|
|
69
|
+
- Top-level project structure
|
|
70
|
+
- Application entry points
|
|
71
|
+
- Frontend/backend/database/AI components
|
|
72
|
+
- APIs
|
|
73
|
+
- Tests
|
|
74
|
+
- Deployment configuration
|
|
75
|
+
- Documentation
|
|
76
|
+
- Environment configuration
|
|
77
|
+
|
|
78
|
+
Classify every observation as FACT, INFERENCE, ASSUMPTION, or UNKNOWN. Cite repository path/line or execution result.
|
|
79
|
+
|
|
80
|
+
Rules:
|
|
81
|
+
- Never fabricate repository facts.
|
|
82
|
+
- Seeing a file does not mean it works.
|
|
83
|
+
- Generated sherpa artifacts are not independent evidence.
|
|
84
|
+
|
|
85
|
+
### Stage 4: Build Score Model
|
|
86
|
+
|
|
87
|
+
For each official judging criterion:
|
|
88
|
+
|
|
89
|
+
1. Map criterion to contributing evidence from Phases 2–9 and repository inspection.
|
|
90
|
+
2. Assign a current performance level (1–10 scale) with evidence type and confidence.
|
|
91
|
+
3. Use official criterion weight if KNOWN. If weights are UNKNOWN, mark UNKNOWN and use a clearly labeled PROVISIONAL equal-weight model only for prioritization. Never pretend provisional weights are official.
|
|
92
|
+
4. Calculate weighted contribution = criterion score × criterion weight.
|
|
93
|
+
5. Label every score estimate: OFFICIAL, ESTIMATED, PROVISIONAL, or UNKNOWN.
|
|
94
|
+
6. Do not fabricate numerical precision (e.g., do not report "exactly 23.7/30" without supporting evidence).
|
|
95
|
+
|
|
96
|
+
Score model record:
|
|
97
|
+
|
|
98
|
+
```
|
|
99
|
+
Criterion Score = Evidence-backed performance level (1–10)
|
|
100
|
+
Weighted Contribution = Criterion Score × Criterion Weight
|
|
101
|
+
Total Estimated Score = Σ(Weighted Contributions) / Σ(Weights)
|
|
102
|
+
```
|
|
103
|
+
|
|
104
|
+
### Stage 5: Gap Analysis
|
|
105
|
+
|
|
106
|
+
For every criterion, complete a gap analysis using `templates/gap-analysis.md`:
|
|
107
|
+
|
|
108
|
+
| Field | Description |
|
|
109
|
+
|-------|-------------|
|
|
110
|
+
| Criterion | Official judging criterion name |
|
|
111
|
+
| Official Weight | Weight or UNKNOWN |
|
|
112
|
+
| Current Evidence | Summary of evidence backing current level |
|
|
113
|
+
| Current Performance | 1–10 with confidence |
|
|
114
|
+
| Confidence | HIGH / MEDIUM / LOW / UNKNOWN |
|
|
115
|
+
| Strengths | What is working well |
|
|
116
|
+
| Weaknesses | What is weak |
|
|
117
|
+
| Evidence Gap | Weak project performance vs weak evidence of performance (separate findings) |
|
|
118
|
+
| Judge Visibility | How observable is this to a judge |
|
|
119
|
+
| Improvement Potential | NONE / LOW / MEDIUM / HIGH / CRITICAL / UNKNOWN |
|
|
120
|
+
| Risk | Risk of attempting improvement |
|
|
121
|
+
|
|
122
|
+
Classify the gap:
|
|
123
|
+
- **NONE** — No meaningful gap
|
|
124
|
+
- **LOW** — Small gap
|
|
125
|
+
- **MEDIUM** — Moderate gap
|
|
126
|
+
- **HIGH** — Large gap
|
|
127
|
+
- **CRITICAL** — Severe gap threatening scoring
|
|
128
|
+
- **UNKNOWN** — Insufficient evidence to classify
|
|
129
|
+
|
|
130
|
+
Separate findings:
|
|
131
|
+
- **Weak project performance** — The capability itself is weak
|
|
132
|
+
- **Weak evidence of project performance** — The capability may exist but is not demonstrated/documented
|
|
133
|
+
|
|
134
|
+
### Stage 6: Generate Improvement Candidates
|
|
135
|
+
|
|
136
|
+
For every criterion with a gap (LOW or higher), generate improvement candidates. Each candidate must belong to one or more categories:
|
|
137
|
+
|
|
138
|
+
| Category | Description |
|
|
139
|
+
|----------|-------------|
|
|
140
|
+
| A. Differentiation | Improves uniqueness or competitive positioning |
|
|
141
|
+
| B. Technical Credibility | Improves architecture quality, engineering quality, reliability, robustness, technical depth |
|
|
142
|
+
| C. Core Functionality | Improves the primary user-facing value |
|
|
143
|
+
| D. Demo Impact | Makes the core flow clearer, faster, more impressive, more reliable |
|
|
144
|
+
| E. UX | Improves usability, clarity, accessibility, responsive behavior, interaction quality |
|
|
145
|
+
| F. Security / Trust | Improves security, privacy, validation, resilience, trust |
|
|
146
|
+
| G. Evidence | Improves the ability to prove an existing capability works |
|
|
147
|
+
| H. Presentation | Presentation-related score opportunities within current phase scope only (no PPT creation; Phase 17 owns presentation) |
|
|
148
|
+
| I. Reliability | Improves stability and reduces judge-visible failure risk |
|
|
149
|
+
|
|
150
|
+
For each candidate, identify:
|
|
151
|
+
- What specifically would change
|
|
152
|
+
- Which criterion it improves
|
|
153
|
+
- Evidence label (FACT / INFERENCE / ASSUMPTION / UNKNOWN) for the claim that this change helps
|
|
154
|
+
- Dependencies or blockers
|
|
155
|
+
- What explicitly should NOT be changed (to protect stable, high-scoring areas)
|
|
156
|
+
|
|
157
|
+
### Stage 7: Evaluate Each Candidate
|
|
158
|
+
|
|
159
|
+
For each improvement candidate, use `templates/improvement-candidate.md` and evaluate:
|
|
160
|
+
|
|
161
|
+
| Dimension | Scale |
|
|
162
|
+
|-----------|-------|
|
|
163
|
+
| Score Impact | VERY LOW / LOW / MEDIUM / HIGH / VERY HIGH |
|
|
164
|
+
| Confidence | HIGH / MEDIUM / LOW / UNKNOWN |
|
|
165
|
+
| Judge Visibility | LOW / MEDIUM / HIGH / VERY HIGH |
|
|
166
|
+
| Implementation Cost | TRIVIAL / LOW / MEDIUM / HIGH / VERY HIGH |
|
|
167
|
+
| Risk | LOW / MEDIUM / HIGH / CRITICAL / UNKNOWN |
|
|
168
|
+
|
|
169
|
+
**OPTIMIZATION HEURISTIC** (prioritization heuristic only, NOT judging mathematics):
|
|
170
|
+
|
|
171
|
+
```
|
|
172
|
+
Expected Value = Score Impact × Confidence × Judge Visibility ÷ Implementation Cost
|
|
173
|
+
```
|
|
174
|
+
|
|
175
|
+
Label this clearly as **OPTIMIZATION HEURISTIC**. Do not present it as judging mathematics. Use qualitative values where numerical precision is unsupported.
|
|
176
|
+
|
|
177
|
+
Also identify:
|
|
178
|
+
- Time required
|
|
179
|
+
- Whether the improvement is worth doing
|
|
180
|
+
- Time-aware filtering (apply lifecycle time-aware strategy)
|
|
181
|
+
|
|
182
|
+
### Stage 8: Classify Priorities
|
|
183
|
+
|
|
184
|
+
Assign exactly one priority to every candidate:
|
|
185
|
+
|
|
186
|
+
| Priority | Definition |
|
|
187
|
+
|----------|------------|
|
|
188
|
+
| **P0 — CRITICAL** | Must address because it threatens judging readiness, core demo, major criterion, reliability, security, or submission viability |
|
|
189
|
+
| **P1 — HIGH IMPACT** | Strong score improvement with realistic implementation cost |
|
|
190
|
+
| **P2 — MEDIUM IMPACT** | Useful improvement but not essential |
|
|
191
|
+
| **P3 — LOW IMPACT** | Minor polish |
|
|
192
|
+
| **DROP** | Do not implement |
|
|
193
|
+
|
|
194
|
+
Every optimization must receive exactly one priority.
|
|
195
|
+
|
|
196
|
+
### Stage 9: Build Prioritized Optimization Plan
|
|
197
|
+
|
|
198
|
+
Use `templates/score-optimization-plan.md` to produce the output plan:
|
|
199
|
+
|
|
200
|
+
1. Current evidence-backed score position (criterion-by-criterion)
|
|
201
|
+
2. Strongest scoring dimensions
|
|
202
|
+
3. Weakest scoring dimensions
|
|
203
|
+
4. Largest score gaps
|
|
204
|
+
5. Prioritized improvement list (P0 first, then P1, P2, P3, then DROP)
|
|
205
|
+
6. Smallest set of actions likely to produce the largest judging improvement
|
|
206
|
+
7. What should explicitly NOT be changed
|
|
207
|
+
8. Time-aware filtering applied
|
|
208
|
+
|
|
209
|
+
### Stage 10: Update Project State
|
|
210
|
+
|
|
211
|
+
Update ONLY these compact fields in `.sherpa/project-state.md`:
|
|
212
|
+
|
|
213
|
+
| Field | Allowed Values |
|
|
214
|
+
|-------|---------------|
|
|
215
|
+
| Score Optimization Status | NOT_STARTED | IN_PROGRESS | BLOCKED | COMPLETE |
|
|
216
|
+
| Current Estimated Score | <score or UNKNOWN> |
|
|
217
|
+
| Potential Score | <score or UNKNOWN> |
|
|
218
|
+
| Largest Gaps | <concise list or UNKNOWN> |
|
|
219
|
+
| Highest-Priority Improvement | <concise or UNKNOWN> |
|
|
220
|
+
|
|
221
|
+
Rules:
|
|
222
|
+
- Do NOT put detailed optimization analysis inside project-state.md.
|
|
223
|
+
- Detailed material goes to `.sherpa/score-optimization.md` and `.sherpa/score-optimization/`.
|
|
224
|
+
- Do not change `selected idea`.
|
|
225
|
+
- Do not silently change architecture.
|
|
226
|
+
- Do not silently redesign architecture; architecture changes require human approval.
|
|
227
|
+
- Do not silently modify application code.
|
|
228
|
+
- Do not silently modify Phase 1–9 artifacts.
|
|
229
|
+
- Human approval required for major scope or architecture changes.
|
|
230
|
+
|
|
231
|
+
### Stage 11: Return Exactly One Primary Next Action
|
|
232
|
+
|
|
233
|
+
Output format:
|
|
234
|
+
|
|
235
|
+
```
|
|
236
|
+
PRIMARY NEXT ACTION: <exactly one action>
|
|
237
|
+
|
|
238
|
+
WHY: <explanation based on impact, time, risk, and judging criteria>
|
|
239
|
+
|
|
240
|
+
DONE WHEN: <clear definition of done>
|
|
241
|
+
|
|
242
|
+
Time remaining: <hours or UNKNOWN>
|
|
243
|
+
|
|
244
|
+
Blocked by: <blocker or "None">
|
|
245
|
+
```
|
|
246
|
+
|
|
247
|
+
Rule: Exactly one primary next action. Do not produce competing alternatives.
|
|
248
|
+
|
|
249
|
+
## Validation Checklist
|
|
250
|
+
|
|
251
|
+
After SCORE-OPTIMIZE completes:
|
|
252
|
+
|
|
253
|
+
- [ ] Project state read and verified
|
|
254
|
+
- [ ] Phase 2–4, 11–14 evidence consumed (not duplicated)
|
|
255
|
+
- [ ] Repository inspected for evidence
|
|
256
|
+
- [ ] Score model built with official or explicitly provisional weights
|
|
257
|
+
- [ ] Every score labeled OFFICIAL / ESTIMATED / PROVISIONAL / UNKNOWN
|
|
258
|
+
- [ ] No false numerical precision claimed
|
|
259
|
+
- [ ] Gap analysis completed for every criterion
|
|
260
|
+
- [ ] Weak project performance separated from weak evidence of performance
|
|
261
|
+
- [ ] Improvement candidates generated for all gapped criteria
|
|
262
|
+
- [ ] Each candidate assigned to one or more categories (A–I)
|
|
263
|
+
- [ ] Each candidate evaluated with Score Impact, Confidence, Judge Visibility, Cost, Risk
|
|
264
|
+
- [ ] OPTIMIZATION HEURISTIC labeled as heuristic, not judging mathematics
|
|
265
|
+
- [ ] Every candidate assigned exactly one priority (P0–P3 or DROP)
|
|
266
|
+
- [ ] Prioritized optimization plan produced
|
|
267
|
+
- [ ] Smallest set of high-impact actions identified
|
|
268
|
+
- [ ] What NOT to change identified
|
|
269
|
+
- [ ] Time-aware filtering applied
|
|
270
|
+
- [ ] Project state updated with compact fields only
|
|
271
|
+
- [ ] No Phase 1–9 artifacts modified
|
|
272
|
+
- [ ] No application source code modified
|
|
273
|
+
- [ ] No PPT created
|
|
274
|
+
- [ ] No final submission performed
|
|
275
|
+
- [ ] No postmortem performed
|
|
276
|
+
- [ ] Exactly ONE primary next action returned
|
|
@@ -0,0 +1,107 @@
|
|
|
1
|
+
# sherpa — STATUS Workflow
|
|
2
|
+
|
|
3
|
+
**Operation**: STATUS
|
|
4
|
+
**Purpose**: Accurately report the current project state by reading `.sherpa/project-state.md` and inspecting the repository for evidence.
|
|
5
|
+
|
|
6
|
+
## When to Use
|
|
7
|
+
|
|
8
|
+
Use STATUS when:
|
|
9
|
+
- You want to know where you are in the hackathon
|
|
10
|
+
- You want to know what's complete, what's in progress, what's blocked
|
|
11
|
+
- You want to know your biggest risks and what's incomplete
|
|
12
|
+
- You need a snapshot before deciding what to do next
|
|
13
|
+
|
|
14
|
+
## Workflow Steps
|
|
15
|
+
|
|
16
|
+
### Step 1: Verify State Exists
|
|
17
|
+
|
|
18
|
+
Check if `.sherpa/project-state.md` exists in the current project repository.
|
|
19
|
+
|
|
20
|
+
If it does NOT exist:
|
|
21
|
+
- Report that sherpa has not been initialized for this project
|
|
22
|
+
- Recommend running INIT first
|
|
23
|
+
- Stop
|
|
24
|
+
|
|
25
|
+
### Step 2: Read Project State
|
|
26
|
+
|
|
27
|
+
Read `.sherpa/project-state.md` and capture:
|
|
28
|
+
- Hackathon name, deadline, time remaining
|
|
29
|
+
- Phase
|
|
30
|
+
- Problem statement, selected idea, MVP scope
|
|
31
|
+
- Tech stack, architecture
|
|
32
|
+
- Completed work, current work, blocked work
|
|
33
|
+
- Risks, known weaknesses, open questions
|
|
34
|
+
- Current estimated score, potential score
|
|
35
|
+
- Demo status, PPT status, documentation status
|
|
36
|
+
|
|
37
|
+
### Step 3: Inspect Repository for Evidence
|
|
38
|
+
|
|
39
|
+
Inspect the repository to verify claims in the state file. Look for:
|
|
40
|
+
- `package.json`, `requirements.txt`, `pyproject.toml` (tech stack verification)
|
|
41
|
+
- Source code files (implementation evidence)
|
|
42
|
+
- README (documentation evidence)
|
|
43
|
+
- Test files (testing evidence)
|
|
44
|
+
- Deployment configuration (deployment evidence)
|
|
45
|
+
- Environment configuration (secrets/config evidence)
|
|
46
|
+
|
|
47
|
+
Do NOT make claims about the project without evidence when the repository can be inspected.
|
|
48
|
+
|
|
49
|
+
### Step 4: Compare State to Reality
|
|
50
|
+
|
|
51
|
+
Identify gaps between what `.sherpa/project-state.md` says and what the repository shows:
|
|
52
|
+
- State says "Authentication implemented" but no auth code exists → flag discrepancy
|
|
53
|
+
- State says "Tests passing" but no test files exist → flag discrepancy
|
|
54
|
+
- State says "Deployed" but no deployment config exists → flag discrepancy
|
|
55
|
+
|
|
56
|
+
### Step 5: Calculate Time Remaining
|
|
57
|
+
|
|
58
|
+
If deadline is known, calculate time remaining from current date/time. If deadline is `UNKNOWN`, report time remaining as `UNKNOWN`.
|
|
59
|
+
|
|
60
|
+
### Step 6: Report Status
|
|
61
|
+
|
|
62
|
+
Present a structured status report:
|
|
63
|
+
|
|
64
|
+
```
|
|
65
|
+
sherpa Status — [Hackathon Name]
|
|
66
|
+
|
|
67
|
+
Phase: [phase]
|
|
68
|
+
Time remaining: [time or UNKNOWN]
|
|
69
|
+
|
|
70
|
+
Project State:
|
|
71
|
+
Problem: [problem statement or UNKNOWN]
|
|
72
|
+
Selected idea: [idea or UNKNOWN]
|
|
73
|
+
MVP scope: [MVP or UNKNOWN]
|
|
74
|
+
Tech stack: [stack or UNKNOWN]
|
|
75
|
+
|
|
76
|
+
Completed: [list or UNKNOWN]
|
|
77
|
+
In progress: [list or UNKNOWN]
|
|
78
|
+
Blocked: [list or UNKNOWN]
|
|
79
|
+
|
|
80
|
+
Risks: [list or UNKNOWN]
|
|
81
|
+
Known weaknesses: [list or UNKNOWN]
|
|
82
|
+
Open questions: [list or UNKNOWN]
|
|
83
|
+
|
|
84
|
+
Scores:
|
|
85
|
+
Current estimated: [score or UNKNOWN]
|
|
86
|
+
Potential: [score or UNKNOWN]
|
|
87
|
+
|
|
88
|
+
Deliverables:
|
|
89
|
+
Demo: [status or UNKNOWN]
|
|
90
|
+
PPT: [status or UNKNOWN]
|
|
91
|
+
Documentation: [status or UNKNOWN]
|
|
92
|
+
|
|
93
|
+
Evidence Gaps (state vs repository):
|
|
94
|
+
[any discrepancies found]
|
|
95
|
+
|
|
96
|
+
Biggest Current Risk: [single risk or UNKNOWN]
|
|
97
|
+
```
|
|
98
|
+
|
|
99
|
+
## Validation
|
|
100
|
+
|
|
101
|
+
After STATUS completes:
|
|
102
|
+
- [ ] `.sherpa/project-state.md` was read
|
|
103
|
+
- [ ] Repository was inspected for evidence
|
|
104
|
+
- [ ] No claims made without evidence
|
|
105
|
+
- [ ] Discrepancies between state and reality are flagged
|
|
106
|
+
- [ ] Time remaining is calculated or marked UNKNOWN
|
|
107
|
+
- [ ] Biggest current risk is identified (one risk, not a list)
|
|
@@ -0,0 +1,46 @@
|
|
|
1
|
+
# sherpa — SUBMISSION-PREPARE Workflow
|
|
2
|
+
|
|
3
|
+
**Lifecycle Phase:** Phase 19 — Submission Intelligence
|
|
4
|
+
**Purpose:** Prepare, verify, and freeze submission materials without submitting them.
|
|
5
|
+
|
|
6
|
+
## Hard prerequisites
|
|
7
|
+
|
|
8
|
+
1. Read `workflows/lifecycle.md`; require exactly 20 phases in order: Phase 18 Final Audit, Phase 19 Submission, Phase 20 Post-Mortem. Do not renumber or repair.
|
|
9
|
+
2. Read `.sherpa/final-audit.md`; require `Audit status: COMPLETE`. If the artifact is absent or incomplete, stop and report the blocker. Never substitute a framework test report for project audit evidence.
|
|
10
|
+
3. Inspect the Phase 18 project evidence and applicable Phase 1–18 contracts. Preserve prior project decisions and artifacts.
|
|
11
|
+
4. Do not perform an actual competition submission or begin Phase 20.
|
|
12
|
+
|
|
13
|
+
## Procedure
|
|
14
|
+
|
|
15
|
+
1. Read `.sherpa/project-state.md` and prior phase evidence if present. If absent, record that no live project state was inspected; do not treat this framework repository as the project package.
|
|
16
|
+
2. Inspect the actual current repository and its metadata. Cite paths, command output, hashes, or captured evidence. Separate observed FACT from INFERENCE and UNKNOWN. Never simulate inspection.
|
|
17
|
+
3. Discover requirements using the authority order in `rules/submission-rules.md`. Record each in the requirement template. Preserve source conflicts; do not invent mandatory requirements.
|
|
18
|
+
4. Record deadline, timezone, source, confidence, status and time remaining. Unknown deadline/timezone stays UNKNOWN; use the documented deadline strategy only where actual time is known.
|
|
19
|
+
5. Inventory only existing/identified artifacts. Record version/location/access/verification independently. Do not claim an artifact exists because a template names it.
|
|
20
|
+
6. Map submission fields from evidence; unknown or personal/team data remain UNKNOWN. Apply limits/formats only when an authoritative source provides them.
|
|
21
|
+
7. Check each known URL for syntax, destination, content, access, authentication and expiry where actual verification can be performed. Record method/result/time. Unchecked links remain UNKNOWN.
|
|
22
|
+
8. Verify permissions for intended judges. Restricted required artifacts are blockers unless official rules permit restricted access. Do not expose secrets or change visibility.
|
|
23
|
+
9. Audit repository identity, branch, intended commit, README/setup, required files, links, sensitive data, debug artifacts and configuration. Report setup only as verified if it was actually run and evidence recorded; do not install dependencies or alter source.
|
|
24
|
+
10. Verify deployment, demo/video, presentation, formats and limits only against actual artifacts and official requirements. If not available, set UNKNOWN. Do not redesign these artifacts.
|
|
25
|
+
11. Build consistency and claim matrices across form, README, PPT, demo, repository, deployment, project description, selected idea and Phase 18 audit. Preserve contradictions as findings. Unsupported/contradicted claims are not submission-ready.
|
|
26
|
+
12. Run a bounded secret/sensitive-data check on the recorded scope. State the exact scope and method; never claim absolute absence.
|
|
27
|
+
13. Build the risk register, snapshot, and change classification. Values unavailable in repository metadata are UNKNOWN. Activate submission freeze only once all critical artifacts are verified.
|
|
28
|
+
14. Determine readiness from evidence using the gate in the rules. Missing live package or official requirements implies CONDITIONAL at best; do not claim READY_TO_SUBMIT from framework tests.
|
|
29
|
+
15. Present `FINAL HUMAN CONFIRMATION REQUIRED` and the final checklist. “Submission performed” must remain unchecked. Never invoke portal actions, upload, publish, change visibility, or submit.
|
|
30
|
+
16. Record exactly one `PRIMARY NEXT ACTION`.
|
|
31
|
+
|
|
32
|
+
## Required outputs
|
|
33
|
+
|
|
34
|
+
Use the Phase 19 templates for requirement records, inventory, field mapping, links, risks, checklist, snapshot, and verification. Produce `.sherpa/submission-plan.md` and detailed evidence under `.sherpa/submission/` only in the actual project repository. Contract harnesses report to stdout and do not create repository audit reports. Keep `.sherpa/project-state.md` compact and add only the Phase 19 fields specified below; do not overwrite prior phase state.
|
|
35
|
+
|
|
36
|
+
### Additive project-state fields only
|
|
37
|
+
|
|
38
|
+
Submission Status; Submission Readiness; Submission Deadline; Deadline Timezone; Submission Requirements; Artifact Inventory; Required Fields; URL Verification; Access Verification; Submission Snapshot; Freeze Status; Critical Submission Risks; Human Confirmation Status; Current Submission Blocker; Primary Next Action.
|
|
39
|
+
|
|
40
|
+
## Final report sections
|
|
41
|
+
|
|
42
|
+
Prerequisites; Lifecycle Integrity; Submission Requirements; Deadline Verification; Artifact Inventory; Field Verification; URL Verification; Access Verification; Repository Audit; Demo/Video Audit; PPT Audit; README Audit; Secret Audit; Consistency Audit; Claim Audit; Risk Register; Submission Snapshot; Freeze Status; Human Confirmation; Submission Readiness; Scope Compliance; Evidence Integrity; Primary Next Action; Final Decision.
|
|
43
|
+
|
|
44
|
+
## Readiness and phase lock are distinct
|
|
45
|
+
|
|
46
|
+
Phase 19 framework may be COMPLETE & LOCKED while live Submission Readiness remains CONDITIONAL. Framework contract tests do not verify live portal rules, package, links, artifact access, deployment, video, presentation, or deadline. Actual submission is a human action outside this workflow.
|
|
@@ -0,0 +1,44 @@
|
|
|
1
|
+
# sherpa — TESTING + SECURITY Workflow
|
|
2
|
+
|
|
3
|
+
**Operation:** TESTING-SECURITY (Phase 5)
|
|
4
|
+
**Purpose:** Evaluate implemented scope using real test/security evidence and a time-aware quality gate.
|
|
5
|
+
|
|
6
|
+
## Routing
|
|
7
|
+
|
|
8
|
+
Use for TEST, TESTING, SECURITY, SECURITY REVIEW, RUN TESTS, CHECK SECURITY, TEST PROJECT, AUDIT SECURITY, or VERIFY IMPLEMENTATION. A general “what next?” remains owned by `workflows/next.md`. Follow `rules/testing-security-rules.md`. Phase 4 files are frozen; do not modify them. Do not start Phase 6.
|
|
9
|
+
|
|
10
|
+
## Deterministic Workflow
|
|
11
|
+
|
|
12
|
+
1. **Read state first.** Read `.sherpa/project-state.md`. Verify the selected idea and implementation status. If implementation is `NOT_STARTED`, return `Testing blocked until implementation exists.` Do not claim testing readiness.
|
|
13
|
+
2. **Read approved plans.** Read the Phase 3 project plan and Phase 4 implementation plan at their recorded paths. Identify the approved MVP, implemented scope, critical flows, architecture, and recent changes. Missing plans/status are `UNKNOWN`/`BLOCKED`; do not infer completion.
|
|
14
|
+
3. **Inspect actual baseline.** Record repository root/revision when available, runtime/framework, frontend/backend, test frameworks and files, scripts, build/lint/typecheck commands, API/E2E/CI setup, fixtures/mocks, config/environment names, and known failures. Mark unavailable items UNKNOWN. Do not install dependencies.
|
|
15
|
+
4. **Create/update test plan.** Use `templates/test-plan.md` at `.sherpa/test-plan.md`. Plan only applicable categories. Map critical user flows and MUST HAVE behavior first; include security-sensitive paths, regression-prone areas, then lower-priority checks. Include expected results, priority, dependencies, and status.
|
|
16
|
+
5. **Prioritize for available time.** Apply `rules/testing-security-rules.md` Section 7. If time is UNKNOWN, write `TIME STRATEGY = UNKNOWN` and keep priorities time-neutral.
|
|
17
|
+
6. **Execute applicable checks.** Run only checks supported by the observed environment and relevant to scope. Capture exact command/procedure and direct result. If unavailable, record BLOCKED/UNKNOWN. Never treat build success as full test/security success.
|
|
18
|
+
7. **Record each result.** Use `templates/test-result.md` under `.sherpa/testing/test-NNN.md`. Preserve failures and output. Mark unrun checks PLANNED/UNKNOWN/BLOCKED, never PASSED.
|
|
19
|
+
8. **Analyze failures.** Record affected flow, impact, blocking status, and likely cause separately from evidence. Do not hide or relabel a failure. Route source fixes through the Phase 4 implementation process; Phase 5 records remediation and verifies it after implementation.
|
|
20
|
+
9. **Perform bounded security review.** Use `templates/security-review.md` at `.sherpa/security-review.md`. State scope, method, limitations, unknowns, and findings. Inspect applicable security areas listed in the rules. Use FACT/INFERENCE/ASSUMPTION/UNKNOWN and severity/confidence separately. Do not claim no vulnerabilities beyond scope.
|
|
21
|
+
10. **Audit dependencies when possible.** Use an already-available project-native auditor, record exact command and output. If unavailable, record dependency security status UNKNOWN; do not install an auditor or upgrade packages.
|
|
22
|
+
11. **Record and prioritize findings.** Create `.sherpa/security/finding-NNN.md` from `templates/security-finding.md`. Prioritize by severity, exploitability, impact, surface, confidence, and MVP relevance. Do not call a proposed fix FIXED.
|
|
23
|
+
12. **Verify remediation and regressions.** For each implemented fix, run focused verification plus directly affected tests, related tests, critical-flow tests, and security regressions as applicable. Record evidence. If regression cannot run, finding remains BLOCKED/UNKNOWN and is not verified.
|
|
24
|
+
13. **Evaluate quality gate.** Set `READY` only under rules Section 6. Critical failures or unresolved/unverified critical findings prevent READY. Use BLOCKED/CONDITIONAL when critical evidence is missing or lower-severity/unknown issues remain material.
|
|
25
|
+
14. **Update compact state.** Update only Phase 5 fields allowed by rules Section 8. Keep detail in artifacts. Do not change idea, architecture, MVP, or Phase 4 fields.
|
|
26
|
+
15. **Return exactly one primary next action.** State scope, baseline, critical test/security outcomes, direct evidence, failures, unknowns, gate, and one next action. Do not begin Phase 6.
|
|
27
|
+
|
|
28
|
+
## Failure Cases
|
|
29
|
+
|
|
30
|
+
- `Implementation status = NOT_STARTED`: `Testing blocked until implementation exists.`
|
|
31
|
+
- Missing tests: `UNKNOWN` / `NOT PRESENT`, not FAILED.
|
|
32
|
+
- Test command fails: record FAILED and output; rerun after any fix.
|
|
33
|
+
- Test environment broken: BLOCKED.
|
|
34
|
+
- Security evidence insufficient: UNKNOWN, with scope/limitations.
|
|
35
|
+
- Dependency auditor unavailable: dependency security UNKNOWN.
|
|
36
|
+
- Unverified fix: finding remains OPEN/IN_PROGRESS/BLOCKED, never FIXED.
|
|
37
|
+
- Critical unresolved failure/finding: gate is not READY.
|
|
38
|
+
- Unknown time: `TIME STRATEGY = UNKNOWN`.
|
|
39
|
+
- Requested architecture redesign: `ARCHITECTURE CHANGE REQUIRED`; defer to human-controlled architecture process.
|
|
40
|
+
- Request to change selected idea: preserve it; human decision required.
|
|
41
|
+
|
|
42
|
+
## Output Contract
|
|
43
|
+
|
|
44
|
+
Return exactly one `PRIMARY NEXT ACTION`; do not create a parallel NEXT engine or continue to Phase 6.
|