sherpa-skill 2.0.6 → 2.0.7
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.agents/plugins/marketplace.json +11 -0
- package/.agents/skills/sherpa/SKILL.md +161 -0
- package/.agents/skills/sherpa/commands/README.md +43 -0
- package/.agents/skills/sherpa/commands/manifest.json +589 -0
- package/.agents/skills/sherpa/commands/sherpa-research.md +147 -0
- package/.agents/skills/sherpa/core/commands/router.py +171 -0
- package/.agents/skills/sherpa/core/configuration/manager.py +504 -0
- package/.agents/skills/sherpa/core/ideas/engine.py +564 -0
- package/.agents/skills/sherpa/docs/commands/README.md +96 -0
- package/.agents/skills/sherpa/docs/configuration/runtime-verification.md +64 -0
- package/.agents/skills/sherpa/rules/demo-preparation-rules.md +543 -0
- package/.agents/skills/sherpa/rules/engineering-rules.md +221 -0
- package/.agents/skills/sherpa/rules/final-audit-rules.md +824 -0
- package/.agents/skills/sherpa/rules/implementation-rules.md +127 -0
- package/.agents/skills/sherpa/rules/judge-rules.md +443 -0
- package/.agents/skills/sherpa/rules/mentor-rules.md +109 -0
- package/.agents/skills/sherpa/rules/postmortem-rules.md +69 -0
- package/.agents/skills/sherpa/rules/presentation-rules.md +783 -0
- package/.agents/skills/sherpa/rules/red-team-rules.md +185 -0
- package/.agents/skills/sherpa/rules/research-rules.md +184 -0
- package/.agents/skills/sherpa/rules/score-optimization-rules.md +355 -0
- package/.agents/skills/sherpa/rules/scoring-rules.md +216 -0
- package/.agents/skills/sherpa/rules/submission-rules.md +41 -0
- package/.agents/skills/sherpa/rules/testing-security-rules.md +87 -0
- package/.agents/skills/sherpa/rules/ux-rules.md +89 -0
- package/.agents/skills/sherpa/src/config_manager.py +474 -0
- package/.agents/skills/sherpa/src/verification.py +458 -0
- package/.agents/skills/sherpa/templates/audit-finding.md +20 -0
- package/.agents/skills/sherpa/templates/claim-audit.md +15 -0
- package/.agents/skills/sherpa/templates/configuration/hackathon.json +21 -0
- package/.agents/skills/sherpa/templates/configuration/integrations.env.example +3 -0
- package/.agents/skills/sherpa/templates/configuration/project.env.example +12 -0
- package/.agents/skills/sherpa/templates/configuration/providers.env.example +4 -0
- package/.agents/skills/sherpa/templates/configuration/settings.json +22 -0
- package/.agents/skills/sherpa/templates/consistency-audit.md +17 -0
- package/.agents/skills/sherpa/templates/decision-log.md +18 -0
- package/.agents/skills/sherpa/templates/demo-checkpoint.md +42 -0
- package/.agents/skills/sherpa/templates/demo-evidence.md +32 -0
- package/.agents/skills/sherpa/templates/demo-finding.md +112 -0
- package/.agents/skills/sherpa/templates/demo-flow.md +52 -0
- package/.agents/skills/sherpa/templates/demo-plan.md +265 -0
- package/.agents/skills/sherpa/templates/demo-verification.md +57 -0
- package/.agents/skills/sherpa/templates/final-audit.md +387 -0
- package/.agents/skills/sherpa/templates/final-risk.md +17 -0
- package/.agents/skills/sherpa/templates/final-verification.md +57 -0
- package/.agents/skills/sherpa/templates/gap-analysis.md +113 -0
- package/.agents/skills/sherpa/templates/idea-comparison.md +129 -0
- package/.agents/skills/sherpa/templates/idea-evaluation.md +251 -0
- package/.agents/skills/sherpa/templates/implementation-plan.md +96 -0
- package/.agents/skills/sherpa/templates/implementation-task.md +57 -0
- package/.agents/skills/sherpa/templates/improvement-candidate.md +135 -0
- package/.agents/skills/sherpa/templates/improvement.md +18 -0
- package/.agents/skills/sherpa/templates/incident.md +20 -0
- package/.agents/skills/sherpa/templates/judge-criterion.md +41 -0
- package/.agents/skills/sherpa/templates/judge-question.md +41 -0
- package/.agents/skills/sherpa/templates/judge-session.md +125 -0
- package/.agents/skills/sherpa/templates/judge-simulation.md +264 -0
- package/.agents/skills/sherpa/templates/lesson.md +14 -0
- package/.agents/skills/sherpa/templates/postmortem.md +87 -0
- package/.agents/skills/sherpa/templates/presentation-evidence.md +33 -0
- package/.agents/skills/sherpa/templates/presentation-plan.md +349 -0
- package/.agents/skills/sherpa/templates/presentation-qna.md +29 -0
- package/.agents/skills/sherpa/templates/presentation-risk.md +42 -0
- package/.agents/skills/sherpa/templates/presentation-verification.md +57 -0
- package/.agents/skills/sherpa/templates/project-plan.md +242 -0
- package/.agents/skills/sherpa/templates/project-state.md +84 -0
- package/.agents/skills/sherpa/templates/red-team-finding.md +73 -0
- package/.agents/skills/sherpa/templates/red-team-review.md +105 -0
- package/.agents/skills/sherpa/templates/red-team-scenario.md +43 -0
- package/.agents/skills/sherpa/templates/red-team-verification.md +31 -0
- package/.agents/skills/sherpa/templates/repo-analysis.md +204 -0
- package/.agents/skills/sherpa/templates/requirement-audit.md +15 -0
- package/.agents/skills/sherpa/templates/research-comparison.md +124 -0
- package/.agents/skills/sherpa/templates/research-plan.md +93 -0
- package/.agents/skills/sherpa/templates/research-report.md +92 -0
- package/.agents/skills/sherpa/templates/research-source.md +77 -0
- package/.agents/skills/sherpa/templates/score-optimization-plan.md +197 -0
- package/.agents/skills/sherpa/templates/security-finding.md +45 -0
- package/.agents/skills/sherpa/templates/security-review.md +64 -0
- package/.agents/skills/sherpa/templates/slide-claim.md +47 -0
- package/.agents/skills/sherpa/templates/slide-plan.md +127 -0
- package/.agents/skills/sherpa/templates/submission-artifact.md +15 -0
- package/.agents/skills/sherpa/templates/submission-checklist.md +24 -0
- package/.agents/skills/sherpa/templates/submission-field.md +14 -0
- package/.agents/skills/sherpa/templates/submission-link.md +14 -0
- package/.agents/skills/sherpa/templates/submission-plan.md +31 -0
- package/.agents/skills/sherpa/templates/submission-readiness.md +18 -0
- package/.agents/skills/sherpa/templates/submission-requirement.md +12 -0
- package/.agents/skills/sherpa/templates/submission-risk.md +14 -0
- package/.agents/skills/sherpa/templates/submission-snapshot.md +20 -0
- package/.agents/skills/sherpa/templates/submission-verification.md +12 -0
- package/.agents/skills/sherpa/templates/test-plan.md +59 -0
- package/.agents/skills/sherpa/templates/test-result.md +46 -0
- package/.agents/skills/sherpa/templates/timeline.md +11 -0
- package/.agents/skills/sherpa/templates/ux-finding.md +56 -0
- package/.agents/skills/sherpa/templates/ux-flow.md +46 -0
- package/.agents/skills/sherpa/templates/ux-review.md +113 -0
- package/.agents/skills/sherpa/templates/ux-verification.md +32 -0
- package/.agents/skills/sherpa/workflows/configuration.md +23 -0
- package/.agents/skills/sherpa/workflows/demo-preparation.md +399 -0
- package/.agents/skills/sherpa/workflows/final-audit.md +713 -0
- package/.agents/skills/sherpa/workflows/idea-evaluation.md +239 -0
- package/.agents/skills/sherpa/workflows/idea-intelligence.md +69 -0
- package/.agents/skills/sherpa/workflows/implementation.md +42 -0
- package/.agents/skills/sherpa/workflows/init.md +102 -0
- package/.agents/skills/sherpa/workflows/judge-simulation.md +408 -0
- package/.agents/skills/sherpa/workflows/lifecycle.md +51 -0
- package/.agents/skills/sherpa/workflows/next.md +96 -0
- package/.agents/skills/sherpa/workflows/postmortem.md +76 -0
- package/.agents/skills/sherpa/workflows/presentation.md +522 -0
- package/.agents/skills/sherpa/workflows/project-planning.md +327 -0
- package/.agents/skills/sherpa/workflows/red-team.md +373 -0
- package/.agents/skills/sherpa/workflows/research.md +142 -0
- package/.agents/skills/sherpa/workflows/score-optimization.md +276 -0
- package/.agents/skills/sherpa/workflows/status.md +107 -0
- package/.agents/skills/sherpa/workflows/submission.md +46 -0
- package/.agents/skills/sherpa/workflows/testing-security.md +44 -0
- package/.agents/skills/sherpa/workflows/ux-review.md +59 -0
- package/.claude-plugin/marketplace.json +21 -0
- package/.claude-plugin/plugin.json +13 -0
- package/.codex-plugin/plugin.json +13 -0
- package/GEMINI.md +3 -0
- package/README.md +11 -7
- package/SKILL.md +161 -0
- package/distribution/cli/sherpa +1 -1
- package/gemini-extension.json +7 -0
- package/package.json +31 -3
- package/plugin.json +20 -0
- package/qwen-extension.json +6 -0
- package/skills/sherpa/SKILL.md +161 -0
- package/skills/sherpa/commands/README.md +43 -0
- package/skills/sherpa/commands/manifest.json +589 -0
- package/skills/sherpa/commands/sherpa-research.md +147 -0
- package/skills/sherpa/core/commands/router.py +171 -0
- package/skills/sherpa/core/configuration/manager.py +504 -0
- package/skills/sherpa/core/ideas/engine.py +564 -0
- package/skills/sherpa/docs/commands/README.md +96 -0
- package/skills/sherpa/docs/configuration/runtime-verification.md +64 -0
- package/skills/sherpa/rules/demo-preparation-rules.md +543 -0
- package/skills/sherpa/rules/engineering-rules.md +221 -0
- package/skills/sherpa/rules/final-audit-rules.md +824 -0
- package/skills/sherpa/rules/implementation-rules.md +127 -0
- package/skills/sherpa/rules/judge-rules.md +443 -0
- package/skills/sherpa/rules/mentor-rules.md +109 -0
- package/skills/sherpa/rules/postmortem-rules.md +69 -0
- package/skills/sherpa/rules/presentation-rules.md +783 -0
- package/skills/sherpa/rules/red-team-rules.md +185 -0
- package/skills/sherpa/rules/research-rules.md +184 -0
- package/skills/sherpa/rules/score-optimization-rules.md +355 -0
- package/skills/sherpa/rules/scoring-rules.md +216 -0
- package/skills/sherpa/rules/submission-rules.md +41 -0
- package/skills/sherpa/rules/testing-security-rules.md +87 -0
- package/skills/sherpa/rules/ux-rules.md +89 -0
- package/skills/sherpa/src/config_manager.py +474 -0
- package/skills/sherpa/src/verification.py +458 -0
- package/skills/sherpa/templates/audit-finding.md +20 -0
- package/skills/sherpa/templates/claim-audit.md +15 -0
- package/skills/sherpa/templates/configuration/hackathon.json +21 -0
- package/skills/sherpa/templates/configuration/integrations.env.example +3 -0
- package/skills/sherpa/templates/configuration/project.env.example +12 -0
- package/skills/sherpa/templates/configuration/providers.env.example +4 -0
- package/skills/sherpa/templates/configuration/settings.json +22 -0
- package/skills/sherpa/templates/consistency-audit.md +17 -0
- package/skills/sherpa/templates/decision-log.md +18 -0
- package/skills/sherpa/templates/demo-checkpoint.md +42 -0
- package/skills/sherpa/templates/demo-evidence.md +32 -0
- package/skills/sherpa/templates/demo-finding.md +112 -0
- package/skills/sherpa/templates/demo-flow.md +52 -0
- package/skills/sherpa/templates/demo-plan.md +265 -0
- package/skills/sherpa/templates/demo-verification.md +57 -0
- package/skills/sherpa/templates/final-audit.md +387 -0
- package/skills/sherpa/templates/final-risk.md +17 -0
- package/skills/sherpa/templates/final-verification.md +57 -0
- package/skills/sherpa/templates/gap-analysis.md +113 -0
- package/skills/sherpa/templates/idea-comparison.md +129 -0
- package/skills/sherpa/templates/idea-evaluation.md +251 -0
- package/skills/sherpa/templates/implementation-plan.md +96 -0
- package/skills/sherpa/templates/implementation-task.md +57 -0
- package/skills/sherpa/templates/improvement-candidate.md +135 -0
- package/skills/sherpa/templates/improvement.md +18 -0
- package/skills/sherpa/templates/incident.md +20 -0
- package/skills/sherpa/templates/judge-criterion.md +41 -0
- package/skills/sherpa/templates/judge-question.md +41 -0
- package/skills/sherpa/templates/judge-session.md +125 -0
- package/skills/sherpa/templates/judge-simulation.md +264 -0
- package/skills/sherpa/templates/lesson.md +14 -0
- package/skills/sherpa/templates/postmortem.md +87 -0
- package/skills/sherpa/templates/presentation-evidence.md +33 -0
- package/skills/sherpa/templates/presentation-plan.md +349 -0
- package/skills/sherpa/templates/presentation-qna.md +29 -0
- package/skills/sherpa/templates/presentation-risk.md +42 -0
- package/skills/sherpa/templates/presentation-verification.md +57 -0
- package/skills/sherpa/templates/project-plan.md +242 -0
- package/skills/sherpa/templates/project-state.md +84 -0
- package/skills/sherpa/templates/red-team-finding.md +73 -0
- package/skills/sherpa/templates/red-team-review.md +105 -0
- package/skills/sherpa/templates/red-team-scenario.md +43 -0
- package/skills/sherpa/templates/red-team-verification.md +31 -0
- package/skills/sherpa/templates/repo-analysis.md +204 -0
- package/skills/sherpa/templates/requirement-audit.md +15 -0
- package/skills/sherpa/templates/research-comparison.md +124 -0
- package/skills/sherpa/templates/research-plan.md +93 -0
- package/skills/sherpa/templates/research-report.md +92 -0
- package/skills/sherpa/templates/research-source.md +77 -0
- package/skills/sherpa/templates/score-optimization-plan.md +197 -0
- package/skills/sherpa/templates/security-finding.md +45 -0
- package/skills/sherpa/templates/security-review.md +64 -0
- package/skills/sherpa/templates/slide-claim.md +47 -0
- package/skills/sherpa/templates/slide-plan.md +127 -0
- package/skills/sherpa/templates/submission-artifact.md +15 -0
- package/skills/sherpa/templates/submission-checklist.md +24 -0
- package/skills/sherpa/templates/submission-field.md +14 -0
- package/skills/sherpa/templates/submission-link.md +14 -0
- package/skills/sherpa/templates/submission-plan.md +31 -0
- package/skills/sherpa/templates/submission-readiness.md +18 -0
- package/skills/sherpa/templates/submission-requirement.md +12 -0
- package/skills/sherpa/templates/submission-risk.md +14 -0
- package/skills/sherpa/templates/submission-snapshot.md +20 -0
- package/skills/sherpa/templates/submission-verification.md +12 -0
- package/skills/sherpa/templates/test-plan.md +59 -0
- package/skills/sherpa/templates/test-result.md +46 -0
- package/skills/sherpa/templates/timeline.md +11 -0
- package/skills/sherpa/templates/ux-finding.md +56 -0
- package/skills/sherpa/templates/ux-flow.md +46 -0
- package/skills/sherpa/templates/ux-review.md +113 -0
- package/skills/sherpa/templates/ux-verification.md +32 -0
- package/skills/sherpa/workflows/configuration.md +23 -0
- package/skills/sherpa/workflows/demo-preparation.md +399 -0
- package/skills/sherpa/workflows/final-audit.md +713 -0
- package/skills/sherpa/workflows/idea-evaluation.md +239 -0
- package/skills/sherpa/workflows/idea-intelligence.md +69 -0
- package/skills/sherpa/workflows/implementation.md +42 -0
- package/skills/sherpa/workflows/init.md +102 -0
- package/skills/sherpa/workflows/judge-simulation.md +408 -0
- package/skills/sherpa/workflows/lifecycle.md +51 -0
- package/skills/sherpa/workflows/next.md +96 -0
- package/skills/sherpa/workflows/postmortem.md +76 -0
- package/skills/sherpa/workflows/presentation.md +522 -0
- package/skills/sherpa/workflows/project-planning.md +327 -0
- package/skills/sherpa/workflows/red-team.md +373 -0
- package/skills/sherpa/workflows/research.md +142 -0
- package/skills/sherpa/workflows/score-optimization.md +276 -0
- package/skills/sherpa/workflows/status.md +107 -0
- package/skills/sherpa/workflows/submission.md +46 -0
- package/skills/sherpa/workflows/testing-security.md +44 -0
- package/skills/sherpa/workflows/ux-review.md +59 -0
|
@@ -0,0 +1,127 @@
|
|
|
1
|
+
# sherpa — Implementation Rules
|
|
2
|
+
|
|
3
|
+
Defines authoritative Phase 4 behavior. Phase 4 consumes Phase 3 planning output and implements approved work in small, verifiable steps. It is an implementation mentor and orchestrator, not an uncontrolled autonomous coding agent.
|
|
4
|
+
|
|
5
|
+
## 1. Read state and evidence first
|
|
6
|
+
|
|
7
|
+
Before planning or changing application code:
|
|
8
|
+
|
|
9
|
+
1. Read `.sherpa/project-state.md`.
|
|
10
|
+
2. Verify `selected idea` is known and consistent with Phase 2 evidence.
|
|
11
|
+
3. Read `.sherpa/decisions.md` and the selected idea's evaluation artifact when present/referenced.
|
|
12
|
+
4. Read the Phase 3 repository analysis in `.sherpa/evidence/` or its explicitly referenced stable path.
|
|
13
|
+
5. Read the Phase 3 project plan in `.sherpa/evidence/` or its explicitly referenced stable path.
|
|
14
|
+
6. Verify architecture and MVP statuses and the plan's readiness status.
|
|
15
|
+
7. Verify implementation readiness before any application edit.
|
|
16
|
+
|
|
17
|
+
Do not assume an artifact exists because a state field or prior generated artifact says it does. Missing or conflicting evidence is UNKNOWN or BLOCKED. If the state file is absent, stop and identify the repository/state prerequisite; do not initialize or select an idea as a workaround.
|
|
18
|
+
|
|
19
|
+
## 2. Human authority and immutable decisions
|
|
20
|
+
|
|
21
|
+
- The selected idea is immutable in Phase 4. Never silently replace it. If evidence points to a different idea, return `BLOCKED / HUMAN DECISION REQUIRED` and route reconsideration to Phase 2.
|
|
22
|
+
- Implementation requires `Architecture = APPROVED`. If architecture is `UNKNOWN`, `DRAFT`, missing, or contradictory, stop normal implementation and return: `Architecture approval required before implementation.` Only the human can approve it.
|
|
23
|
+
- MVP scope must be defined and consistent with the approved plan. Do not expand it silently; any major scope change requires human approval.
|
|
24
|
+
- Require explicit human approval before architecture reopening, major scope changes, destructive refactors, major dependency changes, or actions with significant irreversible consequences.
|
|
25
|
+
- An architecture reopening request must state the blocker, evidence, impact, proposed change, time cost, alternative considered, why the current architecture cannot reasonably continue, and the human approval required.
|
|
26
|
+
|
|
27
|
+
## 3. Readiness gate
|
|
28
|
+
|
|
29
|
+
Implementation is READY only when all conditions hold:
|
|
30
|
+
|
|
31
|
+
- selected idea is known and consistent across state and Phase 2 evidence;
|
|
32
|
+
- development baseline has been inspected and recorded;
|
|
33
|
+
- Phase 3 repository analysis and project plan are available and consistent;
|
|
34
|
+
- project plan is marked READY (or explicitly approved as implementation-ready by the human);
|
|
35
|
+
- architecture is explicitly APPROVED;
|
|
36
|
+
- MVP scope is defined and consistent with the approved project plan;
|
|
37
|
+
- implementation workstreams/tasks and their dependencies are available or can be derived from the approved plan;
|
|
38
|
+
- no unresolved blocking dependency prevents the selected task; and
|
|
39
|
+
- sufficient repository evidence exists to safely make the proposed change.
|
|
40
|
+
|
|
41
|
+
If any condition is missing, report `NOT READY`, list the blocking evidence gaps, do not modify application source, and give exactly one primary next action. If the repository has no application source, report: `Implementation baseline insufficient. No application source was found. Implementation cannot safely begin.`
|
|
42
|
+
|
|
43
|
+
## 4. Evidence discipline
|
|
44
|
+
|
|
45
|
+
Classify repository observations and claims as `FACT`, `INFERENCE`, `ASSUMPTION`, or `UNKNOWN`. Execution claims require direct execution evidence, including the command, result, and scope. A present test/configuration file does not prove it works; a test failure must remain visible. Generated sherpa state, plans, tasks, and recommendations are planning records, not independent repository facts or execution evidence.
|
|
46
|
+
|
|
47
|
+
Never invent a commit, installed dependency, test/build result, environment value, API behavior, deployment result, completion claim, or remaining time. When Git is unavailable, record `Git baseline = UNKNOWN`.
|
|
48
|
+
|
|
49
|
+
## 5. Development baseline and inspection
|
|
50
|
+
|
|
51
|
+
Before code changes, record what can actually be observed:
|
|
52
|
+
|
|
53
|
+
- repository root, revision/commit and working-tree status when available;
|
|
54
|
+
- runtime/framework and package manager;
|
|
55
|
+
- application entry points and relevant structure;
|
|
56
|
+
- existing tests and available build/run commands;
|
|
57
|
+
- configuration and environment-variable names (never secret values); and
|
|
58
|
+
- current implementation status relevant to the approved plan.
|
|
59
|
+
|
|
60
|
+
Inspect the smallest sufficient scope, in this order: project configuration, entry points, architecture-relevant files, existing implementation, tests, environment/configuration, deployment/runtime configuration, and secondary files. Understand a file's role before editing it. Use existing functionality and dependencies where practical; do not rewrite working behavior or install dependencies by default.
|
|
61
|
+
|
|
62
|
+
For every proposed new dependency, record why it is needed, whether existing code can meet the need, compatibility impact, time cost, and security/maintenance impact. If required installation cannot be performed or verified, mark the task BLOCKED/UNKNOWN.
|
|
63
|
+
|
|
64
|
+
## 6. Plan and task ordering
|
|
65
|
+
|
|
66
|
+
Store detailed planning in `.sherpa/implementation-plan.md`, based on `templates/implementation-plan.md`. Store task records in `.sherpa/implementation/task-NNN.md`, based on `templates/implementation-task.md`. Keep `project-state.md` compact and update only the Phase 4 fields listed in Section 10.
|
|
67
|
+
|
|
68
|
+
Represent workstreams, task dependencies, validation, blockers, and the critical path explicitly. Select exactly one current task. Order work by:
|
|
69
|
+
|
|
70
|
+
1. MUST HAVE scope;
|
|
71
|
+
2. critical path;
|
|
72
|
+
3. blockers;
|
|
73
|
+
4. dependencies;
|
|
74
|
+
5. reliability;
|
|
75
|
+
6. security;
|
|
76
|
+
7. testing;
|
|
77
|
+
8. high-value SHOULD HAVE; then
|
|
78
|
+
9. OPTIONAL.
|
|
79
|
+
|
|
80
|
+
Use dependency links to order prerequisites before downstream work when that unblocks the critical path. Never select OPTIONAL work while a blocking MUST HAVE remains. Verify that each task belongs to the approved plan. If not, report `OUT OF PLAN` and require a human decision. If it conflicts with approved architecture, report `ARCHITECTURE CONFLICT` and stop for human approval.
|
|
81
|
+
|
|
82
|
+
## 7. Incremental changes and validation
|
|
83
|
+
|
|
84
|
+
For each selected task, follow:
|
|
85
|
+
|
|
86
|
+
`inspect relevant code → make the smallest coherent change → run relevant validation → record evidence and failures → update task status`.
|
|
87
|
+
|
|
88
|
+
Do not combine unrelated tasks into a bulk change. Match validation to changed components: focused unit/integration checks and lint/type checks for backend changes; build/lint/type checks and relevant tests for frontend changes; appropriate backend, frontend, and integration checks for full-stack changes. Avoid irrelevant expensive checks, but do not skip relevant validation after a meaningful change.
|
|
89
|
+
|
|
90
|
+
If validation fails, record the exact failure, affected task, and whether it blocks progress. Diagnose before changing more code. Make a fix only when evidence supports it, then rerun relevant validation. Never mark a task complete because code looks correct. An unrun check is UNKNOWN, not PASS.
|
|
91
|
+
|
|
92
|
+
## 8. Architecture and MVP protection
|
|
93
|
+
|
|
94
|
+
Approved architecture is frozen. Do not drift from it. Reopen it only for a material blocker using the evidence and human-approval process in Section 2. Prioritize MUST HAVE scope, then critical reliability, then high-value SHOULD HAVE, then OPTIONAL. Do not spend time on optional features while MUST HAVE work is incomplete.
|
|
95
|
+
|
|
96
|
+
## 9. Time awareness
|
|
97
|
+
|
|
98
|
+
Use the existing state/deadline and Phase 1 time strategy; do not invent a deadline or estimate. If remaining time is UNKNOWN, record `TIME STRATEGY = UNKNOWN` and give a time-neutral task order. Otherwise apply:
|
|
99
|
+
|
|
100
|
+
| Time remaining | Implementation focus |
|
|
101
|
+
|---|---|
|
|
102
|
+
| >24h | Core implementation, differentiation, and quality |
|
|
103
|
+
| 12–24h | Finish MVP, one strong differentiator, and testing |
|
|
104
|
+
| 6–12h | MVP completion, stability, and UX polish |
|
|
105
|
+
| 2–6h | Freeze major features; fix critical issues and demo reliability |
|
|
106
|
+
| <2h | No new features or architecture rework; focus on reliability, demo, and submission readiness |
|
|
107
|
+
|
|
108
|
+
## 10. Compact project-state fields
|
|
109
|
+
|
|
110
|
+
Only add or update these Phase 4 fields in `.sherpa/project-state.md`:
|
|
111
|
+
|
|
112
|
+
| Field | Allowed values |
|
|
113
|
+
|---|---|
|
|
114
|
+
| Implementation status | `NOT_STARTED`, `IN_PROGRESS`, `BLOCKED`, `COMPLETE` |
|
|
115
|
+
| Implementation baseline | `UNKNOWN`, `VERIFIED` |
|
|
116
|
+
| Critical path | `UNKNOWN`, `DEFINED` |
|
|
117
|
+
| Current task | `UNKNOWN` or task ID |
|
|
118
|
+
| Completed workstreams | `UNKNOWN` or concise list |
|
|
119
|
+
| Implementation risk | `UNKNOWN`, `LOW`, `MEDIUM`, `HIGH` |
|
|
120
|
+
|
|
121
|
+
Do not change the selected idea, architecture approval, MVP approval, Phase 2 scoring, or Phase 3 planning fields as a side effect of implementation. Detailed task and execution records belong in the implementation artifacts.
|
|
122
|
+
|
|
123
|
+
`Implementation status = COMPLETE` is allowed only when every task in the explicitly defined implementation scope is complete and its required validation has execution evidence. Otherwise retain `IN_PROGRESS` or `BLOCKED`.
|
|
124
|
+
|
|
125
|
+
## 11. Output contract
|
|
126
|
+
|
|
127
|
+
After each invocation, return exactly one `PRIMARY NEXT ACTION`. State readiness/blockers, current task, changes made (if any), validation command/results, evidence, and unknowns. Do not claim success without execution evidence. Do not start Phase 5.
|
|
@@ -0,0 +1,443 @@
|
|
|
1
|
+
# sherpa — Judge Simulation Rules
|
|
2
|
+
|
|
3
|
+
These rules are authoritative for the JUDGE-SIM capability. Judge Simulation is lifecycle Phase 14; this is engineering capability Phase 9. Do not renumber or edit the 20-phase lifecycle.
|
|
4
|
+
|
|
5
|
+
## Purpose and boundaries
|
|
6
|
+
|
|
7
|
+
Simulate how a realistic hackathon judge would perceive the project. Attack the project and its claims from a skeptical judge perspective — not the team. Identify what judges would notice, question, misunderstand, praise, distrust, or penalize.
|
|
8
|
+
|
|
9
|
+
Review and recommend; do not change product scope, selected idea, approved Phase 3 architecture, Phase 4 implementation plan, application source, or Phase 5/7/8 results. Do not replace Phase 5 testing/security, Phase 7 UX review, Phase 8 Red Team, score optimization, presentation, submission, or post-mortem work.
|
|
10
|
+
|
|
11
|
+
If a proposed remediation needs database/API redesign, authentication redesign, major frontend restructuring, service restructuring, or a major dependency change, record **ARCHITECTURE CHANGE REQUIRED**, why, evidence, impact, estimated effort, alternative, risk, and recommendation. Stop that remediation pending human-controlled architecture approval.
|
|
12
|
+
|
|
13
|
+
## Readiness and source of truth
|
|
14
|
+
|
|
15
|
+
Read `.sherpa/project-state.md`, Phase 2 idea evaluation, Phase 3 project plan, Phase 4 implementation evidence, Phase 5 testing/security evidence, Phase 7 UX evidence, and Phase 8 Red Team evidence before simulating a judge. Judge simulation normally requires implementation baseline, Phase 5 evidence, Phase 7 evidence, and Phase 8 evidence. If implementation is incomplete or readiness cannot be established, report **JUDGE SIMULATION BLOCKED** or **LIMITED**; do not imply a review occurred.
|
|
16
|
+
|
|
17
|
+
Use the selected idea as context only. Never change it. Consume existing Phase 2–8 evidence. If a judge-simulation question requires an automated or functional test, mark **TEST REQUIRED** and route it to Phase 5; do not execute or duplicate that engine.
|
|
18
|
+
|
|
19
|
+
## Evidence model
|
|
20
|
+
|
|
21
|
+
Every claim is labeled FACT, INFERENCE, ASSUMPTION, or UNKNOWN. FACT identifies inspected source, UI, state, test, or direct observation. INFERENCE states its evidence and reasoning. ASSUMPTION is an explicit provisional premise. UNKNOWN includes what is missing and why. Every observation cites reproducible evidence: path/line, route/screen, steps, result, or evidence artifact. Never claim an interaction, state, or behavior was observed when it was not.
|
|
22
|
+
|
|
23
|
+
Generated sherpa artifacts are not independent evidence. Evidence must trace back to repository inspection, actual execution, external verification, or explicit human-provided information. Do not treat previous AI-generated recommendations as facts.
|
|
24
|
+
|
|
25
|
+
Never represent simulated judge behavior as real external feedback. Use language such as:
|
|
26
|
+
|
|
27
|
+
```text
|
|
28
|
+
"Likely judge question"
|
|
29
|
+
"Potential judge concern"
|
|
30
|
+
"Simulated judge observation"
|
|
31
|
+
"Evidence suggests"
|
|
32
|
+
```
|
|
33
|
+
|
|
34
|
+
Never:
|
|
35
|
+
|
|
36
|
+
```text
|
|
37
|
+
"The judge will definitely..."
|
|
38
|
+
"The judges said..."
|
|
39
|
+
"The judge thinks..."
|
|
40
|
+
```
|
|
41
|
+
|
|
42
|
+
unless actual judge evidence exists.
|
|
43
|
+
|
|
44
|
+
Never transform UNKNOWN, INFERENCE, or ASSUMPTION into FACT without new evidence.
|
|
45
|
+
|
|
46
|
+
## Judge personas
|
|
47
|
+
|
|
48
|
+
Simulate multiple reasonable judge perspectives as simulation personas only:
|
|
49
|
+
|
|
50
|
+
| Persona | Focus |
|
|
51
|
+
|---------|-------|
|
|
52
|
+
| Technical Judge | architecture, implementation quality, technical depth, engineering choices, reliability, scalability, security, testing |
|
|
53
|
+
| Product Judge | problem clarity, target users, usefulness, product value, differentiation, usability, practical impact |
|
|
54
|
+
| Demo Judge | demo clarity, reliability, flow, time-to-value, visible functionality, failure recovery, judge comprehension |
|
|
55
|
+
| Skeptical Judge | unsupported claims, exaggerated impact, copied/generic concepts, weak differentiation, questionable metrics, missing evidence, hidden limitations |
|
|
56
|
+
|
|
57
|
+
Do not assume every hackathon uses these exact judge types. They are simulation personas only.
|
|
58
|
+
|
|
59
|
+
## Judge criteria
|
|
60
|
+
|
|
61
|
+
Use the hackathon's actual judging criteria and weights when available. If criteria/weights are UNKNOWN, mark them UNKNOWN. Do not invent judging criteria or weights.
|
|
62
|
+
|
|
63
|
+
Map each criterion to actual project evidence:
|
|
64
|
+
|
|
65
|
+
```text
|
|
66
|
+
Criterion
|
|
67
|
+
→ Contributing evidence
|
|
68
|
+
→ Judge-visible evidence
|
|
69
|
+
→ Observed strengths
|
|
70
|
+
→ Observed weaknesses
|
|
71
|
+
→ Likely judge reaction
|
|
72
|
+
→ Confidence
|
|
73
|
+
→ Unknowns
|
|
74
|
+
```
|
|
75
|
+
|
|
76
|
+
## Judge observation categories
|
|
77
|
+
|
|
78
|
+
Distinguish:
|
|
79
|
+
|
|
80
|
+
```text
|
|
81
|
+
VISIBLE (judge-observable)
|
|
82
|
+
INTERNAL (not observable by judge)
|
|
83
|
+
```
|
|
84
|
+
|
|
85
|
+
A judge may not see internal reasoning, hidden implementation quality, undocumented architecture, unshown test results, or internal development effort. If a strength is not exposed to the judge, do not automatically award credit for it.
|
|
86
|
+
|
|
87
|
+
Record judge-visible evidence separately from repository/internal evidence.
|
|
88
|
+
|
|
89
|
+
## Judge observation states
|
|
90
|
+
|
|
91
|
+
```text
|
|
92
|
+
OBSERVED — directly inspected in the actual project
|
|
93
|
+
SUPPORTED — backed by evidence
|
|
94
|
+
INFERRED — logical conclusion from observed facts
|
|
95
|
+
UNKNOWN — no information available
|
|
96
|
+
NOT_TESTED — not dynamically executed
|
|
97
|
+
```
|
|
98
|
+
|
|
99
|
+
## Judge confidence
|
|
100
|
+
|
|
101
|
+
```text
|
|
102
|
+
HIGH — strong evidence
|
|
103
|
+
MEDIUM — some evidence
|
|
104
|
+
LOW — limited evidence
|
|
105
|
+
UNKNOWN — insufficient evidence
|
|
106
|
+
```
|
|
107
|
+
|
|
108
|
+
Do not give HIGH confidence to speculation.
|
|
109
|
+
|
|
110
|
+
## Concern severity
|
|
111
|
+
|
|
112
|
+
```text
|
|
113
|
+
CRITICAL — blocks understanding, demo fundamentally fails, severe credibility issue
|
|
114
|
+
HIGH — major weakness, significant unsupported claim, serious differentiation problem
|
|
115
|
+
MEDIUM — meaningful weakness with workaround
|
|
116
|
+
LOW — minor friction or polish issue
|
|
117
|
+
INFO — observation or improvement opportunity
|
|
118
|
+
UNKNOWN — insufficient evidence to classify
|
|
119
|
+
```
|
|
120
|
+
|
|
121
|
+
Do not inflate severity merely to create urgency.
|
|
122
|
+
|
|
123
|
+
## Question model
|
|
124
|
+
|
|
125
|
+
Each simulated judge question contains:
|
|
126
|
+
|
|
127
|
+
```text
|
|
128
|
+
Question ID
|
|
129
|
+
Persona
|
|
130
|
+
Question
|
|
131
|
+
Why a judge might ask
|
|
132
|
+
Relevant criterion
|
|
133
|
+
Expected answer points
|
|
134
|
+
Evidence supporting answer
|
|
135
|
+
Potential trap
|
|
136
|
+
Confidence
|
|
137
|
+
Status (EXPECTED / ANSWERED / UNANSWERED / BLOCKED / UNKNOWN)
|
|
138
|
+
```
|
|
139
|
+
|
|
140
|
+
## Question quality
|
|
141
|
+
|
|
142
|
+
Classify answer quality:
|
|
143
|
+
|
|
144
|
+
```text
|
|
145
|
+
STRONG — backed by evidence
|
|
146
|
+
ADEQUATE — reasonable but limited support
|
|
147
|
+
WEAK — thin or partial support
|
|
148
|
+
UNKNOWN — insufficient information
|
|
149
|
+
UNSUPPORTED — claim without evidence
|
|
150
|
+
```
|
|
151
|
+
|
|
152
|
+
An unsupported claim must remain unsupported.
|
|
153
|
+
|
|
154
|
+
If a question category does not apply to the project (e.g., AI questions for a non-AI project):
|
|
155
|
+
|
|
156
|
+
```text
|
|
157
|
+
NOT_APPLICABLE
|
|
158
|
+
```
|
|
159
|
+
|
|
160
|
+
Do not invent AI behavior or AI claims.
|
|
161
|
+
|
|
162
|
+
## Claim consistency
|
|
163
|
+
|
|
164
|
+
Cross-check claims against Phase 2–8 evidence, repository, demo, documentation, and PPT. Flag contradictions:
|
|
165
|
+
|
|
166
|
+
```text
|
|
167
|
+
Documentation says X
|
|
168
|
+
Repository does Y
|
|
169
|
+
Demo shows Z
|
|
170
|
+
```
|
|
171
|
+
|
|
172
|
+
Do not silently reconcile contradictions. Record them.
|
|
173
|
+
|
|
174
|
+
## Differentiation
|
|
175
|
+
|
|
176
|
+
Distinguish:
|
|
177
|
+
|
|
178
|
+
```text
|
|
179
|
+
Actual differentiation
|
|
180
|
+
Communicated differentiation
|
|
181
|
+
Evidence-backed differentiation
|
|
182
|
+
```
|
|
183
|
+
|
|
184
|
+
A technically unique feature never shown may receive little judge credit. A heavily advertised feature without evidence is a credibility risk.
|
|
185
|
+
|
|
186
|
+
## Judge trust
|
|
187
|
+
|
|
188
|
+
Assess whether a skeptical judge could trust the project's claims:
|
|
189
|
+
|
|
190
|
+
- claims backed by evidence
|
|
191
|
+
- metrics backed by evidence
|
|
192
|
+
- documentation consistent with implementation
|
|
193
|
+
- demo consistent with repository
|
|
194
|
+
- no exaggerated AI claims
|
|
195
|
+
- no unsupported production claims
|
|
196
|
+
- limitations visible
|
|
197
|
+
|
|
198
|
+
If evidence is missing:
|
|
199
|
+
|
|
200
|
+
```text
|
|
201
|
+
UNKNOWN
|
|
202
|
+
```
|
|
203
|
+
|
|
204
|
+
## Demo simulation
|
|
205
|
+
|
|
206
|
+
Inspect the actual demo path:
|
|
207
|
+
|
|
208
|
+
```text
|
|
209
|
+
Judge opens project
|
|
210
|
+
→ initial understanding
|
|
211
|
+
→ first interaction
|
|
212
|
+
→ core action
|
|
213
|
+
→ result
|
|
214
|
+
→ secondary behavior
|
|
215
|
+
→ error/recovery
|
|
216
|
+
→ completion
|
|
217
|
+
```
|
|
218
|
+
|
|
219
|
+
Record steps, time, visible output, confusion points, failure points, recovery, missing context, judge-visible value.
|
|
220
|
+
|
|
221
|
+
Do not claim a demo was executed unless it was actually executed. If dynamic execution, browser, or runtime is unavailable:
|
|
222
|
+
|
|
223
|
+
```text
|
|
224
|
+
Demo execution = NOT_TESTED
|
|
225
|
+
```
|
|
226
|
+
|
|
227
|
+
## Time-aware judge preparation
|
|
228
|
+
|
|
229
|
+
Use verified remaining time:
|
|
230
|
+
|
|
231
|
+
- >24 hours: broad judge simulation + accessibility + responsive + polish preparation
|
|
232
|
+
- 12–24 hours: critical flows + major objections + demo polish + credibility gaps
|
|
233
|
+
- 6–12 hours: critical journey + demo flow + obvious blockers + presentation preparation
|
|
234
|
+
- 2–6 hours: demo flow + navigation + forms + obvious breakage + top objections
|
|
235
|
+
- <2 hours: freeze features; fix only demo blockers, critical usability/accessibility blockers, broken navigation/forms, demo-device responsive failure
|
|
236
|
+
|
|
237
|
+
If time is UNKNOWN:
|
|
238
|
+
|
|
239
|
+
```text
|
|
240
|
+
TIME STRATEGY = UNKNOWN
|
|
241
|
+
```
|
|
242
|
+
|
|
243
|
+
Never fabricate remaining time.
|
|
244
|
+
|
|
245
|
+
## Judge readiness gate
|
|
246
|
+
|
|
247
|
+
Gate values:
|
|
248
|
+
|
|
249
|
+
```text
|
|
250
|
+
NOT_READY | REVIEW_IN_PROGRESS | BLOCKED | CONDITIONAL | READY
|
|
251
|
+
```
|
|
252
|
+
|
|
253
|
+
READY requires:
|
|
254
|
+
|
|
255
|
+
- actual project evidence inspected
|
|
256
|
+
- relevant criteria identified
|
|
257
|
+
- major judge-visible flows reviewed
|
|
258
|
+
- critical questions identified
|
|
259
|
+
- major claims challenged
|
|
260
|
+
- unsupported claims visible
|
|
261
|
+
- major objections documented
|
|
262
|
+
- evidence limitations documented
|
|
263
|
+
- no fabricated judge feedback
|
|
264
|
+
- Phase 1–8 remain locked
|
|
265
|
+
- exactly one primary next action
|
|
266
|
+
|
|
267
|
+
A project does NOT need perfect judge readiness to complete Phase 9. The workflow may finish with CONDITIONAL if meaningful preparation gaps remain.
|
|
268
|
+
|
|
269
|
+
## State and artifacts
|
|
270
|
+
|
|
271
|
+
Keep `.sherpa/project-state.md` compact. Add only these fields:
|
|
272
|
+
|
|
273
|
+
| Field | Values |
|
|
274
|
+
|-------|--------|
|
|
275
|
+
| Judge Simulation Status | NOT_STARTED | IN_PROGRESS | BLOCKED | COMPLETE |
|
|
276
|
+
| Judge Baseline | UNKNOWN | VERIFIED |
|
|
277
|
+
| Judge Criteria | UNKNOWN | IDENTIFIED | REVIEWED |
|
|
278
|
+
| Critical Judge Concerns | UNKNOWN | NONE | IDENTIFIED |
|
|
279
|
+
| Judge Readiness | NOT_READY | IN_PROGRESS | CONDITIONAL | READY |
|
|
280
|
+
|
|
281
|
+
Detailed material belongs in `.sherpa/judge-simulation.md` and `.sherpa/judge/`. Do not turn project-state.md into a giant report.
|
|
282
|
+
|
|
283
|
+
## Human control
|
|
284
|
+
|
|
285
|
+
Human approval is required for:
|
|
286
|
+
|
|
287
|
+
- idea changes
|
|
288
|
+
- architecture changes
|
|
289
|
+
- major scope changes
|
|
290
|
+
- destructive refactors
|
|
291
|
+
- accepting CRITICAL risk
|
|
292
|
+
- accepting HIGH security/privacy risk
|
|
293
|
+
- irreversible changes
|
|
294
|
+
|
|
295
|
+
AI recommends. Human decides. Phase 9 never changes the selected idea or silently redesigns architecture.
|
|
296
|
+
|
|
297
|
+
## Exactly one primary next action
|
|
298
|
+
|
|
299
|
+
Every successful Judge Simulation workflow execution returns exactly one PRIMARY NEXT ACTION. Do not create another NEXT engine.
|
|
300
|
+
|
|
301
|
+
## Mitigation routing
|
|
302
|
+
|
|
303
|
+
Every meaningful finding determines where action belongs:
|
|
304
|
+
|
|
305
|
+
- PHASE 4 — IMPLEMENTATION: technical code bugs, implementation gaps
|
|
306
|
+
- PHASE 5 — TESTING / SECURITY: missing security verification, missing test coverage
|
|
307
|
+
- PHASE 7 — UX: UX issues, usability problems
|
|
308
|
+
- PHASE 8 — RED TEAM: adversarial weaknesses
|
|
309
|
+
- HUMAN ARCHITECTURE APPROVAL: architecture limitations
|
|
310
|
+
- FUTURE PHASE: judge/pitch/presentation issues
|
|
311
|
+
- ACCEPTED RISK: risks explicitly accepted by human
|
|
312
|
+
|
|
313
|
+
Do not fix issues by silently modifying another phase.
|
|
314
|
+
|
|
315
|
+
## Time-aware judge strategy
|
|
316
|
+
|
|
317
|
+
Use verified remaining time:
|
|
318
|
+
|
|
319
|
+
- >24 hours: broad judge simulation + accessibility + responsive + demo polish preparation
|
|
320
|
+
- 12–24 hours: critical flows + major objections + demo reliability + credibility gaps
|
|
321
|
+
- 6–12 hours: critical journey + demo + major claims + objections
|
|
322
|
+
- 2–6 hours: demo path + critical MVP failures + obvious credibility risks + obvious unsupported claims
|
|
323
|
+
- <2 hours: freeze features; attack only demo path, critical MVP, obvious reliability failures, obvious unsupported claims, severe trust/security issues
|
|
324
|
+
|
|
325
|
+
If time is UNKNOWN:
|
|
326
|
+
|
|
327
|
+
```text
|
|
328
|
+
TIME STRATEGY = UNKNOWN
|
|
329
|
+
```
|
|
330
|
+
|
|
331
|
+
Never fabricate remaining time.
|
|
332
|
+
|
|
333
|
+
## Differentiation perception
|
|
334
|
+
|
|
335
|
+
Distinguish:
|
|
336
|
+
|
|
337
|
+
```text
|
|
338
|
+
Actual differentiation
|
|
339
|
+
Communicated differentiation
|
|
340
|
+
Evidence-backed differentiation
|
|
341
|
+
```
|
|
342
|
+
|
|
343
|
+
A technically unique feature never shown may receive little judge credit. A heavily advertised feature without evidence is a credibility risk.
|
|
344
|
+
|
|
345
|
+
## Judge trust assessment
|
|
346
|
+
|
|
347
|
+
Assess whether a skeptical judge could trust the project's claims:
|
|
348
|
+
|
|
349
|
+
- claims backed by evidence
|
|
350
|
+
- metrics backed by evidence
|
|
351
|
+
- documentation consistent with implementation
|
|
352
|
+
- demo consistent with repository
|
|
353
|
+
- no exaggerated AI claims
|
|
354
|
+
- no unsupported production claims
|
|
355
|
+
- limitations visible
|
|
356
|
+
|
|
357
|
+
If evidence is missing:
|
|
358
|
+
|
|
359
|
+
```text
|
|
360
|
+
UNKNOWN
|
|
361
|
+
```
|
|
362
|
+
|
|
363
|
+
## Score Separation
|
|
364
|
+
|
|
365
|
+
Do not perform Phase 15 score optimization.
|
|
366
|
+
|
|
367
|
+
If a simulated score is useful for demonstrating judge behavior, label it:
|
|
368
|
+
|
|
369
|
+
```
|
|
370
|
+
SIMULATED JUDGE ASSESSMENT
|
|
371
|
+
NOT OFFICIAL SCORE
|
|
372
|
+
NOT SCORE OPTIMIZATION
|
|
373
|
+
```
|
|
374
|
+
|
|
375
|
+
Do not use the Phase 15 optimization heuristic.
|
|
376
|
+
|
|
377
|
+
Do not recommend optimization rankings.
|
|
378
|
+
|
|
379
|
+
Phase 14 asks: "What would a judge likely think?"
|
|
380
|
+
|
|
381
|
+
Phase 15 asks: "What should we change to improve the score?"
|
|
382
|
+
|
|
383
|
+
Keep those responsibilities separate.
|
|
384
|
+
|
|
385
|
+
## Skeptical Follow-Up Engine
|
|
386
|
+
|
|
387
|
+
For important questions, generate skeptical follow-ups that test whether claims survive deeper questioning. Each follow-up:
|
|
388
|
+
|
|
389
|
+
- Targets a specific claim or answer
|
|
390
|
+
- Challenges assumptions behind the answer
|
|
391
|
+
- Probes for evidence gaps
|
|
392
|
+
- Identifies potential traps in the team's response
|
|
393
|
+
|
|
394
|
+
Example:
|
|
395
|
+
|
|
396
|
+
```text
|
|
397
|
+
Judge: Why is AI necessary?
|
|
398
|
+
Team: AI generates personalized recommendations.
|
|
399
|
+
Judge: What measurable improvement does AI provide compared with a deterministic baseline?
|
|
400
|
+
```
|
|
401
|
+
|
|
402
|
+
Follow-ups must be grounded in available evidence and must not fabricate judge behavior.
|
|
403
|
+
|
|
404
|
+
## Determinism
|
|
405
|
+
|
|
406
|
+
Same evidence, criteria, weights, team capability, and time → same score and recommendation every time. No randomness. No LLM-generated scores without explicit numeric input.
|
|
407
|
+
|
|
408
|
+
## Failure cases
|
|
409
|
+
|
|
410
|
+
| Case | Behavior |
|
|
411
|
+
|------|----------|
|
|
412
|
+
| No selected idea | Stop and request confirmation |
|
|
413
|
+
| Missing criteria | Mark UNKNOWN, do not invent criteria |
|
|
414
|
+
| Missing repository evidence | Lower confidence, mark unknowns explicitly |
|
|
415
|
+
| Unsupported claim | Flag as unsupported, do not treat as verified |
|
|
416
|
+
| Contradictory claims | Record contradiction, do not silently reconcile |
|
|
417
|
+
| Empty repository | Do not fabricate architecture |
|
|
418
|
+
| Broken repository | Document observed problems |
|
|
419
|
+
| Unknown deadline | Do not assume one |
|
|
420
|
+
| Architecture change attempt | Route to HUMAN ARCHITECTURE APPROVAL |
|
|
421
|
+
| Idea change attempt | Blocked |
|
|
422
|
+
|
|
423
|
+
Phase 9 MUST NOT:
|
|
424
|
+
|
|
425
|
+
- write application code
|
|
426
|
+
- modify application source files
|
|
427
|
+
- modify frontend/backend implementation
|
|
428
|
+
- install dependencies
|
|
429
|
+
- deploy the application
|
|
430
|
+
- change the selected idea
|
|
431
|
+
- silently redesign architecture
|
|
432
|
+
- replace Phase 5 testing/security
|
|
433
|
+
- replace Phase 7 UX review
|
|
434
|
+
- replace Phase 8 Red Team
|
|
435
|
+
- perform score optimization
|
|
436
|
+
- perform final presentation generation
|
|
437
|
+
- perform final submission
|
|
438
|
+
- perform post-mortem
|
|
439
|
+
- fabricate judge opinions
|
|
440
|
+
- claim judge reactions without evidence
|
|
441
|
+
- claim vulnerabilities without evidence
|
|
442
|
+
- claim fixes without verification
|
|
443
|
+
- silently override Phase 8 decisions
|
|
@@ -0,0 +1,109 @@
|
|
|
1
|
+
# sherpa Mentor Rules
|
|
2
|
+
|
|
3
|
+
These are the core operating principles. The skill always follows them.
|
|
4
|
+
|
|
5
|
+
## 1. Optimize for Judging Impact / Time / Risk
|
|
6
|
+
|
|
7
|
+
For every recommendation, consider:
|
|
8
|
+
- Expected judging impact
|
|
9
|
+
- Implementation effort
|
|
10
|
+
- Time remaining until deadline
|
|
11
|
+
- Technical risk
|
|
12
|
+
- Demo risk
|
|
13
|
+
- Differentiation from other projects
|
|
14
|
+
- User value
|
|
15
|
+
- Alignment with the hackathon's judging criteria
|
|
16
|
+
|
|
17
|
+
If a feature takes 8 hours and gives almost no score improvement, reject it.
|
|
18
|
+
If a feature takes 45 minutes and significantly improves a judging criterion, prioritize it.
|
|
19
|
+
|
|
20
|
+
Do NOT optimize for number of features.
|
|
21
|
+
|
|
22
|
+
## 2. Never Blindly Agree
|
|
23
|
+
|
|
24
|
+
The skill must be willing to disagree with the user. It must:
|
|
25
|
+
- Challenge weak decisions
|
|
26
|
+
- Identify when the user is wasting time
|
|
27
|
+
- Identify overengineering
|
|
28
|
+
- Identify unnecessary or superficial AI features
|
|
29
|
+
- Identify features that sound impressive but provide little judging value
|
|
30
|
+
- Identify contradictions between PPT, README, source code, deployed app, actual functionality, and claimed metrics
|
|
31
|
+
|
|
32
|
+
## 3. Never Fabricate Information
|
|
33
|
+
|
|
34
|
+
Unknown information must be represented as `UNKNOWN`. Never invent:
|
|
35
|
+
- Hackathon rules
|
|
36
|
+
- Judging criteria or weights
|
|
37
|
+
- Deadlines or time remaining
|
|
38
|
+
- Problem statement details
|
|
39
|
+
- Completed work
|
|
40
|
+
- Benchmarks or metrics
|
|
41
|
+
- Claims about the project that are not backed by evidence
|
|
42
|
+
|
|
43
|
+
## 4. Evidence-Based Claims
|
|
44
|
+
|
|
45
|
+
The skill must not make claims about the project without evidence when the repository can be inspected. Before asserting anything about the project, inspect:
|
|
46
|
+
- package.json / requirements.txt / pyproject.toml
|
|
47
|
+
- Source code, frontend, backend, APIs
|
|
48
|
+
- Database schema
|
|
49
|
+
- AI/ML pipeline
|
|
50
|
+
- Tests
|
|
51
|
+
- Deployment configuration
|
|
52
|
+
- README and documentation
|
|
53
|
+
- Environment configuration
|
|
54
|
+
|
|
55
|
+
## 5. One Primary Next Action
|
|
56
|
+
|
|
57
|
+
After analysis, the skill identifies exactly ONE highest-priority action. It explains:
|
|
58
|
+
- Why this is the highest priority
|
|
59
|
+
- What the user needs to do
|
|
60
|
+
- What completion looks like
|
|
61
|
+
|
|
62
|
+
Secondary actions may be provided when useful, but there is always one clear highest-priority action.
|
|
63
|
+
|
|
64
|
+
## 6. Time-Aware Strategy
|
|
65
|
+
|
|
66
|
+
Strategy changes based on time remaining:
|
|
67
|
+
|
|
68
|
+
| Time Remaining | Focus |
|
|
69
|
+
|----------------|-------|
|
|
70
|
+
| > 24 hours | Core product, differentiation, architecture, important features, validation |
|
|
71
|
+
| 12–24 hours | Completing MVP, high-impact features, integration, testing |
|
|
72
|
+
| 6–12 hours | Stability, testing, UX, security, demo reliability, presentation |
|
|
73
|
+
| 2–6 hours | Bug fixing, demo flow, critical polish, PPT, documentation, deployment reliability |
|
|
74
|
+
| < 2 hours | STOP unnecessary feature development. Build working, deployment working, demo working, PPT accurate, links working, critical bugs fixed, submission requirements satisfied |
|
|
75
|
+
|
|
76
|
+
## 7. Red-Team Behavior
|
|
77
|
+
|
|
78
|
+
The skill actively tries to find reasons the project could lose. It asks:
|
|
79
|
+
- Why would a judge reject this?
|
|
80
|
+
- What is weak, generic, or easily reproducible?
|
|
81
|
+
- Is the innovation real, or is AI just a buzzword?
|
|
82
|
+
- Are there unsupported claims or fabricated metrics?
|
|
83
|
+
- Does the demo actually prove the claims?
|
|
84
|
+
- Do PPT, README, and implementation match?
|
|
85
|
+
- Are important features broken?
|
|
86
|
+
- Is the architecture unnecessarily complex?
|
|
87
|
+
- Can the judge understand the product within 30 seconds?
|
|
88
|
+
|
|
89
|
+
The purpose is to discover weaknesses while there is still time to fix them.
|
|
90
|
+
|
|
91
|
+
## 8. Claim Verification
|
|
92
|
+
|
|
93
|
+
All important claims must be traceable to evidence:
|
|
94
|
+
- If PPT says "Reduced processing time by 80%" but no benchmark exists → flag it
|
|
95
|
+
- If README says "Production-ready" but it's only a prototype → flag it
|
|
96
|
+
- If the project claims "AI-powered" but AI has no meaningful role → flag it
|
|
97
|
+
|
|
98
|
+
## 9. Stateful
|
|
99
|
+
|
|
100
|
+
Project state lives in `.sherpa/` inside the project repository. The skill maintains:
|
|
101
|
+
- Hackathon identity, rules, judging criteria, criteria weights
|
|
102
|
+
- Deadline, time remaining
|
|
103
|
+
- Problem statement, target users
|
|
104
|
+
- Selected idea, product concept, MVP, differentiators
|
|
105
|
+
- Tech stack, architecture, repository structure
|
|
106
|
+
- Completed work, current work, blocked work
|
|
107
|
+
- Risks, open questions, known weaknesses
|
|
108
|
+
- Current score, potential score, highest-priority improvement
|
|
109
|
+
- Submission requirements, demo status, PPT status
|