@cubis/foundry 0.3.70 → 0.3.72
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +15 -0
- package/dist/cli/core.js +4 -18
- package/dist/cli/core.js.map +1 -1
- package/package.json +1 -1
- package/src/cli/core.ts +4 -18
- package/workflows/powers/accessibility/POWER.md +83 -94
- package/workflows/powers/accessibility/SKILL.md +82 -94
- package/workflows/powers/agent-design/POWER.md +201 -0
- package/workflows/powers/agent-design/SKILL.md +198 -0
- package/workflows/powers/agent-design/references/clarification-patterns.md +153 -0
- package/workflows/powers/agent-design/references/skill-testing.md +164 -0
- package/workflows/powers/agent-design/references/workflow-patterns.md +226 -0
- package/workflows/powers/agentic-eval/POWER.md +62 -0
- package/workflows/powers/agentic-eval/SKILL.md +59 -0
- package/workflows/powers/agentic-eval/references/rubric-and-regression-checklist.md +11 -0
- package/workflows/powers/api-designer/POWER.md +43 -71
- package/workflows/powers/api-designer/SKILL.md +43 -71
- package/workflows/powers/api-patterns/POWER.md +42 -56
- package/workflows/powers/api-patterns/SKILL.md +42 -57
- package/workflows/powers/architecture-designer/POWER.md +43 -60
- package/workflows/powers/architecture-designer/SKILL.md +43 -60
- package/workflows/powers/ask-questions-if-underspecified/POWER.md +51 -3
- package/workflows/powers/ask-questions-if-underspecified/SKILL.md +51 -3
- package/workflows/powers/auth-architect/POWER.md +69 -0
- package/workflows/powers/auth-architect/SKILL.md +66 -0
- package/workflows/powers/auth-architect/references/session-token-policy-checklist.md +45 -0
- package/workflows/powers/behavioral-modes/POWER.md +100 -9
- package/workflows/powers/behavioral-modes/SKILL.md +100 -9
- package/workflows/powers/c-pro/POWER.md +105 -0
- package/workflows/powers/c-pro/SKILL.md +102 -0
- package/workflows/powers/c-pro/references/build-systems-and-toolchains.md +148 -0
- package/workflows/powers/c-pro/references/common-ub-and-portability.md +166 -0
- package/workflows/powers/c-pro/references/debugging-with-sanitizers.md +205 -0
- package/workflows/powers/c-pro/references/memory-safety-and-build-checklist.md +60 -0
- package/workflows/powers/c-pro/references/posix-and-platform-apis.md +244 -0
- package/workflows/powers/changelog-generator/POWER.md +127 -63
- package/workflows/powers/changelog-generator/SKILL.md +126 -63
- package/workflows/powers/ci-cd-pipelines/POWER.md +156 -0
- package/workflows/powers/ci-cd-pipelines/SKILL.md +153 -0
- package/workflows/powers/ci-cd-pipelines/references/github-actions-patterns.md +160 -0
- package/workflows/powers/ci-cd-pipelines/references/pipeline-security-checklist.md +57 -0
- package/workflows/powers/cli-developer/POWER.md +152 -95
- package/workflows/powers/cli-developer/SKILL.md +152 -95
- package/workflows/powers/cpp-pro/POWER.md +111 -0
- package/workflows/powers/cpp-pro/SKILL.md +108 -0
- package/workflows/powers/cpp-pro/references/concurrency-primitives.md +266 -0
- package/workflows/powers/cpp-pro/references/move-semantics-and-value-types.md +149 -0
- package/workflows/powers/cpp-pro/references/performance-and-profiling.md +191 -0
- package/workflows/powers/cpp-pro/references/raii-and-modern-cpp-checklist.md +87 -0
- package/workflows/powers/cpp-pro/references/template-and-concepts-patterns.md +205 -0
- package/workflows/powers/csharp-pro/POWER.md +47 -22
- package/workflows/powers/csharp-pro/SKILL.md +47 -22
- package/workflows/powers/dart-pro/POWER.md +68 -0
- package/workflows/powers/dart-pro/SKILL.md +65 -0
- package/workflows/powers/dart-pro/references/isolate-and-concurrency.md +180 -0
- package/workflows/powers/dart-pro/references/null-safety-and-async-patterns.md +133 -0
- package/workflows/powers/dart-pro/references/package-structure-and-linting.md +193 -0
- package/workflows/powers/dart-pro/references/sealed-records-patterns.md +173 -0
- package/workflows/powers/dart-pro/references/testing-and-mocking.md +235 -0
- package/workflows/powers/database-design/POWER.md +47 -33
- package/workflows/powers/database-design/SKILL.md +47 -33
- package/workflows/powers/database-optimizer/POWER.md +43 -64
- package/workflows/powers/database-optimizer/SKILL.md +43 -64
- package/workflows/powers/database-skills/POWER.md +59 -93
- package/workflows/powers/database-skills/SKILL.md +59 -93
- package/workflows/powers/debugging-strategies/POWER.md +69 -0
- package/workflows/powers/debugging-strategies/SKILL.md +66 -0
- package/workflows/powers/debugging-strategies/references/reproduce-isolate-verify-checklist.md +42 -0
- package/workflows/powers/deep-research/POWER.md +67 -0
- package/workflows/powers/deep-research/SKILL.md +64 -0
- package/workflows/powers/deep-research/references/multi-round-research-loop.md +80 -0
- package/workflows/powers/design-system-builder/POWER.md +130 -116
- package/workflows/powers/design-system-builder/SKILL.md +130 -116
- package/workflows/powers/devops-engineer/POWER.md +120 -57
- package/workflows/powers/devops-engineer/SKILL.md +120 -57
- package/workflows/powers/docker-kubernetes/POWER.md +94 -0
- package/workflows/powers/docker-kubernetes/SKILL.md +91 -0
- package/workflows/powers/docker-kubernetes/references/dockerfile-optimization-checklist.md +35 -0
- package/workflows/powers/docker-kubernetes/references/kubernetes-deployment-patterns.md +59 -0
- package/workflows/powers/documentation-templates/POWER.md +158 -127
- package/workflows/powers/documentation-templates/SKILL.md +158 -127
- package/workflows/powers/drizzle-expert/POWER.md +66 -0
- package/workflows/powers/drizzle-expert/SKILL.md +63 -0
- package/workflows/powers/drizzle-expert/references/runtime-pairing-matrix.md +16 -0
- package/workflows/powers/drizzle-expert/references/schema-and-migration-playbook.md +18 -0
- package/workflows/powers/error-ux-observability/POWER.md +144 -131
- package/workflows/powers/error-ux-observability/SKILL.md +143 -131
- package/workflows/powers/fastapi-expert/POWER.md +46 -60
- package/workflows/powers/fastapi-expert/SKILL.md +46 -60
- package/workflows/powers/firebase/POWER.md +65 -0
- package/workflows/powers/firebase/SKILL.md +62 -0
- package/workflows/powers/firebase/references/platform-routing.md +16 -0
- package/workflows/powers/firebase/references/rules-and-indexes-checklist.md +11 -0
- package/workflows/powers/flutter-design-system/POWER.md +63 -0
- package/workflows/powers/flutter-design-system/SKILL.md +60 -0
- package/workflows/powers/flutter-design-system/references/shared-widgets.md +29 -0
- package/workflows/powers/flutter-design-system/references/tokens-and-theme.md +34 -0
- package/workflows/powers/flutter-drift/POWER.md +65 -0
- package/workflows/powers/flutter-drift/SKILL.md +62 -0
- package/workflows/powers/flutter-drift/references/migrations.md +22 -0
- package/workflows/powers/flutter-drift/references/query-patterns.md +26 -0
- package/workflows/powers/flutter-feature/POWER.md +65 -0
- package/workflows/powers/flutter-feature/SKILL.md +62 -0
- package/workflows/powers/flutter-feature/references/architecture-rules.md +85 -0
- package/workflows/powers/flutter-feature/references/composite-provider.md +58 -0
- package/workflows/powers/flutter-feature/references/outbox-pattern.md +87 -0
- package/workflows/powers/flutter-feature/references/testing-patterns.md +218 -0
- package/workflows/powers/flutter-go-router/POWER.md +64 -0
- package/workflows/powers/flutter-go-router/SKILL.md +61 -0
- package/workflows/powers/flutter-go-router/references/guards-and-deeplinks.md +20 -0
- package/workflows/powers/flutter-go-router/references/typed-routes.md +27 -0
- package/workflows/powers/flutter-offline-sync/POWER.md +62 -0
- package/workflows/powers/flutter-offline-sync/SKILL.md +59 -0
- package/workflows/powers/flutter-offline-sync/references/outbox-full.md +44 -0
- package/workflows/powers/flutter-repository/POWER.md +64 -0
- package/workflows/powers/flutter-repository/SKILL.md +61 -0
- package/workflows/powers/flutter-repository/references/drift-patterns.md +21 -0
- package/workflows/powers/flutter-repository/references/retrofit-patterns.md +20 -0
- package/workflows/powers/flutter-riverpod/POWER.md +70 -0
- package/workflows/powers/flutter-riverpod/SKILL.md +67 -0
- package/workflows/powers/flutter-riverpod/references/async-and-mutations.md +19 -0
- package/workflows/powers/flutter-riverpod/references/async-lifecycle.md +19 -0
- package/workflows/powers/flutter-riverpod/references/provider-selection.md +20 -0
- package/workflows/powers/flutter-riverpod/references/testing.md +21 -0
- package/workflows/powers/flutter-riverpod/references/version-matrix.md +24 -0
- package/workflows/powers/flutter-state-machine/POWER.md +62 -0
- package/workflows/powers/flutter-state-machine/SKILL.md +59 -0
- package/workflows/powers/flutter-state-machine/references/app-state-contract.md +23 -0
- package/workflows/powers/flutter-state-machine/references/ui-rendering.md +14 -0
- package/workflows/powers/flutter-testing/POWER.md +64 -0
- package/workflows/powers/flutter-testing/SKILL.md +61 -0
- package/workflows/powers/flutter-testing/references/offline-sync-tests.md +16 -0
- package/workflows/powers/flutter-testing/references/test-layers.md +33 -0
- package/workflows/powers/frontend-code-review/POWER.md +137 -0
- package/workflows/powers/frontend-code-review/SKILL.md +134 -0
- package/workflows/powers/frontend-code-review/references/common-antipatterns.md +86 -0
- package/workflows/powers/frontend-code-review/references/performance-budgets.md +56 -0
- package/workflows/powers/frontend-code-review/references/review-checklists.md +47 -0
- package/workflows/powers/frontend-design/POWER.md +163 -362
- package/workflows/powers/frontend-design/SKILL.md +163 -362
- package/workflows/powers/game-development/POWER.md +57 -140
- package/workflows/powers/game-development/SKILL.md +57 -140
- package/workflows/powers/geo-fundamentals/POWER.md +64 -126
- package/workflows/powers/geo-fundamentals/SKILL.md +64 -127
- package/workflows/powers/git-workflow/POWER.md +135 -0
- package/workflows/powers/git-workflow/SKILL.md +132 -0
- package/workflows/powers/git-workflow/references/pr-review-checklist.md +63 -0
- package/workflows/powers/golang-pro/POWER.md +46 -35
- package/workflows/powers/golang-pro/SKILL.md +46 -35
- package/workflows/powers/graphql-architect/POWER.md +44 -62
- package/workflows/powers/graphql-architect/SKILL.md +44 -62
- package/workflows/powers/i18n-localization/POWER.md +118 -103
- package/workflows/powers/i18n-localization/SKILL.md +118 -103
- package/workflows/powers/java-pro/POWER.md +47 -22
- package/workflows/powers/java-pro/SKILL.md +47 -22
- package/workflows/powers/javascript-pro/POWER.md +47 -34
- package/workflows/powers/javascript-pro/SKILL.md +47 -34
- package/workflows/powers/kotlin-pro/POWER.md +46 -23
- package/workflows/powers/kotlin-pro/SKILL.md +46 -23
- package/workflows/powers/legacy-modernizer/POWER.md +43 -60
- package/workflows/powers/legacy-modernizer/SKILL.md +43 -60
- package/workflows/powers/mcp-builder/POWER.md +65 -0
- package/workflows/powers/mcp-builder/SKILL.md +62 -0
- package/workflows/powers/mcp-builder/references/testing-and-evals.md +17 -0
- package/workflows/powers/mcp-builder/references/transport-and-tool-design.md +17 -0
- package/workflows/powers/microservices-architect/POWER.md +43 -70
- package/workflows/powers/microservices-architect/SKILL.md +43 -70
- package/workflows/powers/mobile-design/POWER.md +110 -345
- package/workflows/powers/mobile-design/SKILL.md +110 -345
- package/workflows/powers/mongodb/POWER.md +67 -0
- package/workflows/powers/mongodb/SKILL.md +64 -0
- package/workflows/powers/mongodb/references/mongodb-checklist.md +20 -0
- package/workflows/powers/mysql/POWER.md +67 -0
- package/workflows/powers/mysql/SKILL.md +64 -0
- package/workflows/powers/mysql/references/mysql-checklist.md +20 -0
- package/workflows/powers/neki/POWER.md +67 -0
- package/workflows/powers/neki/SKILL.md +64 -0
- package/workflows/powers/neki/references/neki-checklist.md +18 -0
- package/workflows/powers/nestjs-expert/POWER.md +45 -91
- package/workflows/powers/nestjs-expert/SKILL.md +45 -91
- package/workflows/powers/nextjs-developer/POWER.md +51 -44
- package/workflows/powers/nextjs-developer/SKILL.md +51 -44
- package/workflows/powers/nodejs-best-practices/POWER.md +48 -29
- package/workflows/powers/nodejs-best-practices/SKILL.md +48 -29
- package/workflows/powers/observability/POWER.md +109 -0
- package/workflows/powers/observability/SKILL.md +106 -0
- package/workflows/powers/observability/references/alerting-and-slo-checklist.md +87 -0
- package/workflows/powers/observability/references/opentelemetry-setup-guide.md +121 -0
- package/workflows/powers/openai-docs/POWER.md +61 -0
- package/workflows/powers/openai-docs/SKILL.md +58 -0
- package/workflows/powers/openai-docs/references/official-source-playbook.md +10 -0
- package/workflows/powers/performance-profiling/POWER.md +61 -114
- package/workflows/powers/performance-profiling/SKILL.md +61 -114
- package/workflows/powers/php-pro/POWER.md +116 -0
- package/workflows/powers/php-pro/SKILL.md +113 -0
- package/workflows/powers/php-pro/references/architecture-and-di.md +239 -0
- package/workflows/powers/php-pro/references/modern-php-features.md +189 -0
- package/workflows/powers/php-pro/references/performance-and-deployment.md +197 -0
- package/workflows/powers/php-pro/references/php84-strict-typing-checklist.md +161 -0
- package/workflows/powers/php-pro/references/testing-and-static-analysis.md +235 -0
- package/workflows/powers/playwright-e2e/POWER.md +85 -0
- package/workflows/powers/playwright-e2e/SKILL.md +82 -0
- package/workflows/powers/playwright-e2e/references/locator-trace-flake-checklist.md +80 -0
- package/workflows/powers/postgres/POWER.md +67 -0
- package/workflows/powers/postgres/SKILL.md +64 -0
- package/workflows/powers/postgres/references/postgres-checklist.md +20 -0
- package/workflows/powers/prompt-engineer/POWER.md +47 -30
- package/workflows/powers/prompt-engineer/SKILL.md +47 -30
- package/workflows/powers/python-pro/POWER.md +47 -36
- package/workflows/powers/python-pro/SKILL.md +47 -36
- package/workflows/powers/react-best-practices/POWER.md +56 -33
- package/workflows/powers/react-best-practices/SKILL.md +56 -33
- package/workflows/powers/react-expert/POWER.md +47 -37
- package/workflows/powers/react-expert/SKILL.md +47 -37
- package/workflows/powers/redis/POWER.md +67 -0
- package/workflows/powers/redis/SKILL.md +64 -0
- package/workflows/powers/redis/references/redis-checklist.md +19 -0
- package/workflows/powers/ruby-pro/POWER.md +118 -0
- package/workflows/powers/ruby-pro/SKILL.md +115 -0
- package/workflows/powers/ruby-pro/references/modern-ruby-features.md +189 -0
- package/workflows/powers/ruby-pro/references/object-design-patterns.md +220 -0
- package/workflows/powers/ruby-pro/references/performance-and-profiling.md +224 -0
- package/workflows/powers/ruby-pro/references/ruby-concurrency-and-testing.md +190 -0
- package/workflows/powers/ruby-pro/references/testing-and-rspec.md +236 -0
- package/workflows/powers/rust-pro/POWER.md +45 -31
- package/workflows/powers/rust-pro/SKILL.md +45 -31
- package/workflows/powers/security-engineer/POWER.md +129 -0
- package/workflows/powers/security-engineer/SKILL.md +126 -0
- package/workflows/powers/seo-fundamentals/POWER.md +59 -102
- package/workflows/powers/seo-fundamentals/SKILL.md +59 -102
- package/workflows/powers/serverless-patterns/POWER.md +171 -0
- package/workflows/powers/serverless-patterns/SKILL.md +168 -0
- package/workflows/powers/skill-creator/POWER.md +90 -0
- package/workflows/powers/skill-creator/SKILL.md +87 -0
- package/workflows/powers/skill-creator/references/platform-formats.md +181 -0
- package/workflows/powers/skill-creator/references/schemas.md +430 -0
- package/workflows/powers/spec-miner/POWER.md +49 -57
- package/workflows/powers/spec-miner/SKILL.md +49 -57
- package/workflows/powers/sqlite/POWER.md +67 -0
- package/workflows/powers/sqlite/SKILL.md +64 -0
- package/workflows/powers/sqlite/references/sqlite-checklist.md +19 -0
- package/workflows/powers/sre-engineer/POWER.md +123 -64
- package/workflows/powers/sre-engineer/SKILL.md +123 -64
- package/workflows/powers/static-analysis/POWER.md +121 -77
- package/workflows/powers/static-analysis/SKILL.md +121 -77
- package/workflows/powers/stripe-best-practices/POWER.md +140 -17
- package/workflows/powers/stripe-best-practices/SKILL.md +139 -17
- package/workflows/powers/supabase/POWER.md +67 -0
- package/workflows/powers/supabase/SKILL.md +64 -0
- package/workflows/powers/supabase/references/supabase-checklist.md +19 -0
- package/workflows/powers/swift-pro/POWER.md +118 -0
- package/workflows/powers/swift-pro/SKILL.md +115 -0
- package/workflows/powers/swift-pro/references/concurrency-patterns.md +165 -0
- package/workflows/powers/swift-pro/references/protocol-and-generics.md +172 -0
- package/workflows/powers/swift-pro/references/sendable-and-isolation.md +116 -0
- package/workflows/powers/swift-pro/references/swift-concurrency-and-protocols.md +260 -0
- package/workflows/powers/swift-pro/references/testing-and-packages.md +192 -0
- package/workflows/powers/tailwind-patterns/POWER.md +71 -240
- package/workflows/powers/tailwind-patterns/SKILL.md +71 -240
- package/workflows/powers/testing-patterns/POWER.md +155 -10
- package/workflows/powers/testing-patterns/SKILL.md +155 -10
- package/workflows/powers/typescript-pro/POWER.md +47 -38
- package/workflows/powers/typescript-pro/SKILL.md +47 -38
- package/workflows/powers/vitess/POWER.md +67 -0
- package/workflows/powers/vitess/SKILL.md +64 -0
- package/workflows/powers/vitess/references/vitess-checklist.md +19 -0
- package/workflows/powers/vulnerability-scanner/POWER.md +146 -10
- package/workflows/powers/vulnerability-scanner/SKILL.md +146 -10
- package/workflows/powers/web-perf/POWER.md +43 -170
- package/workflows/powers/web-perf/SKILL.md +43 -170
- package/workflows/powers/webapp-testing/POWER.md +43 -164
- package/workflows/powers/webapp-testing/SKILL.md +43 -164
- package/workflows/skills/agent-design/SKILL.md +198 -0
- package/workflows/skills/agent-design/references/clarification-patterns.md +153 -0
- package/workflows/skills/agent-design/references/skill-testing.md +164 -0
- package/workflows/skills/agent-design/references/workflow-patterns.md +226 -0
- package/workflows/skills/deep-research/SKILL.md +25 -20
- package/workflows/skills/deep-research/references/multi-round-research-loop.md +73 -8
- package/workflows/skills/frontend-design/SKILL.md +37 -32
- package/workflows/skills/frontend-design/commands/brand.md +167 -0
- package/workflows/skills/frontend-design/references/brand-presets.md +228 -0
- package/workflows/skills/generated/skill-audit.json +11 -2
- package/workflows/skills/generated/skill-catalog.json +37 -5
- package/workflows/skills/skills_index.json +1 -1
- package/workflows/workflows/agent-environment-setup/platforms/claude/skills/agent-design/SKILL.md +198 -0
- package/workflows/workflows/agent-environment-setup/platforms/claude/skills/agent-design/references/clarification-patterns.md +153 -0
- package/workflows/workflows/agent-environment-setup/platforms/claude/skills/agent-design/references/skill-testing.md +164 -0
- package/workflows/workflows/agent-environment-setup/platforms/claude/skills/agent-design/references/workflow-patterns.md +226 -0
- package/workflows/workflows/agent-environment-setup/platforms/claude/skills/deep-research/SKILL.md +25 -20
- package/workflows/workflows/agent-environment-setup/platforms/claude/skills/deep-research/references/multi-round-research-loop.md +73 -8
- package/workflows/workflows/agent-environment-setup/platforms/claude/skills/frontend-design/SKILL.md +37 -32
- package/workflows/workflows/agent-environment-setup/platforms/claude/skills/frontend-design/commands/brand.md +167 -0
- package/workflows/workflows/agent-environment-setup/platforms/claude/skills/frontend-design/references/brand-presets.md +228 -0
- package/workflows/workflows/agent-environment-setup/platforms/claude/skills/skills_index.json +1 -1
- package/workflows/workflows/agent-environment-setup/platforms/copilot/skills/agent-design/SKILL.md +197 -0
- package/workflows/workflows/agent-environment-setup/platforms/copilot/skills/agent-design/references/clarification-patterns.md +153 -0
- package/workflows/workflows/agent-environment-setup/platforms/copilot/skills/agent-design/references/skill-testing.md +164 -0
- package/workflows/workflows/agent-environment-setup/platforms/copilot/skills/agent-design/references/workflow-patterns.md +226 -0
- package/workflows/workflows/agent-environment-setup/platforms/copilot/skills/deep-research/SKILL.md +25 -20
- package/workflows/workflows/agent-environment-setup/platforms/copilot/skills/deep-research/references/multi-round-research-loop.md +73 -8
- package/workflows/workflows/agent-environment-setup/platforms/copilot/skills/frontend-design/SKILL.md +37 -32
- package/workflows/workflows/agent-environment-setup/platforms/copilot/skills/frontend-design/commands/brand.md +167 -0
- package/workflows/workflows/agent-environment-setup/platforms/copilot/skills/frontend-design/references/brand-presets.md +228 -0
- package/workflows/workflows/agent-environment-setup/platforms/copilot/skills/skills_index.json +1 -1
|
@@ -0,0 +1,164 @@
|
|
|
1
|
+
# Skill Testing Reference
|
|
2
|
+
|
|
3
|
+
Load this when writing evals, regression sets, or description-triggering tests for a CBX skill.
|
|
4
|
+
|
|
5
|
+
Source: Anthropic skill-creator research — [Improving skill-creator: Test, measure, and refine Agent Skills](https://claude.com/blog/improving-skill-creator-test-measure-and-refine-agent-skills) (March 2026).
|
|
6
|
+
|
|
7
|
+
---
|
|
8
|
+
|
|
9
|
+
## Two Reasons to Test
|
|
10
|
+
|
|
11
|
+
1. **Catch regressions** — As models and infrastructure evolve, skills that worked last month may behave differently. Evals give you an early signal before it impacts your team.
|
|
12
|
+
2. **Know when the skill is obsolete** — For _capability uplift_ skills: if the base model starts passing your evals without the skill loaded, the skill has been incorporated into model behavior and can be retired.
|
|
13
|
+
|
|
14
|
+
---
|
|
15
|
+
|
|
16
|
+
## Five Test Categories
|
|
17
|
+
|
|
18
|
+
Every skill should pass all five before shipping.
|
|
19
|
+
|
|
20
|
+
### 1. Trigger tests (description precision)
|
|
21
|
+
|
|
22
|
+
Does the skill load when it should — and stay quiet when it shouldn't?
|
|
23
|
+
|
|
24
|
+
**Method:**
|
|
25
|
+
|
|
26
|
+
- Write 5 natural-language prompts that _should_ trigger the skill
|
|
27
|
+
- Write 5 near-miss prompts that _should not_ trigger
|
|
28
|
+
- Load the skill and observe whether it activates
|
|
29
|
+
|
|
30
|
+
**Example for a frontend-design skill:**
|
|
31
|
+
|
|
32
|
+
```
|
|
33
|
+
Should trigger:
|
|
34
|
+
- "Build me a landing page for my SaaS product"
|
|
35
|
+
- "Make this dashboard look less generic"
|
|
36
|
+
- "I need a color system for a health app"
|
|
37
|
+
|
|
38
|
+
Should NOT trigger:
|
|
39
|
+
- "Fix this TypeScript error"
|
|
40
|
+
- "Review my API endpoint design"
|
|
41
|
+
- "Help me write tests"
|
|
42
|
+
```
|
|
43
|
+
|
|
44
|
+
**Fix:** If false positives occur, make the description more specific. If false negatives, broaden or add domain keywords.
|
|
45
|
+
|
|
46
|
+
### 2. Happy path test
|
|
47
|
+
|
|
48
|
+
Does the skill complete its standard task correctly?
|
|
49
|
+
|
|
50
|
+
**Method:**
|
|
51
|
+
|
|
52
|
+
- Write the most common, straightforward version of the task the skill handles
|
|
53
|
+
- Run it and verify the output meets the expected criteria
|
|
54
|
+
|
|
55
|
+
### 3. Edge case tests
|
|
56
|
+
|
|
57
|
+
What happens under abnormal or missing input?
|
|
58
|
+
|
|
59
|
+
Examples:
|
|
60
|
+
|
|
61
|
+
- Missing required information (no brand color, no framework specified)
|
|
62
|
+
- Ambiguous phrasing
|
|
63
|
+
- Conflicting requirements
|
|
64
|
+
- Very large or very small input
|
|
65
|
+
- The user ignored the clarification questions and just said "do it"
|
|
66
|
+
|
|
67
|
+
### 4. Comparison test (A/B)
|
|
68
|
+
|
|
69
|
+
Does the skill actually improve output vs. no skill?
|
|
70
|
+
|
|
71
|
+
**Method:** Run the same prompt with and without the skill loaded. Judge which output is better — ideally with a fresh evaluator agent that doesn't know which is which.
|
|
72
|
+
|
|
73
|
+
If the no-skill output is equivalent, the skill adds no value (or the model has caught up to it).
|
|
74
|
+
|
|
75
|
+
### 5. Reader test
|
|
76
|
+
|
|
77
|
+
Can someone with no conversation context understand the skill's output?
|
|
78
|
+
|
|
79
|
+
**Method:**
|
|
80
|
+
|
|
81
|
+
- Take the skill's final output (plan, document, code, design)
|
|
82
|
+
- Open a fresh conversation or use a sub-agent with only the output, no history
|
|
83
|
+
- Ask: "What is this?", "What are the key decisions?", "What's unclear?"
|
|
84
|
+
|
|
85
|
+
If the fresh reader struggles, the output has context bleed issues. Fix them before shipping.
|
|
86
|
+
|
|
87
|
+
---
|
|
88
|
+
|
|
89
|
+
## Writing Eval Cases
|
|
90
|
+
|
|
91
|
+
Each eval case = one input + expected behavior description.
|
|
92
|
+
|
|
93
|
+
**Format:**
|
|
94
|
+
|
|
95
|
+
```
|
|
96
|
+
Input: [natural language prompt or file +prompt]
|
|
97
|
+
Expected:
|
|
98
|
+
- [Observable behavior 1]
|
|
99
|
+
- [Observable behavior 2]
|
|
100
|
+
- [Observable behavior 3 — what NOT to happen]
|
|
101
|
+
```
|
|
102
|
+
|
|
103
|
+
**Example for `ask-questions-if-underspecified`:**
|
|
104
|
+
|
|
105
|
+
```
|
|
106
|
+
Input: "Build me a feature."
|
|
107
|
+
Expected:
|
|
108
|
+
- Asks at least 1 clarifying question (scope, purpose, or constraints)
|
|
109
|
+
- Provides default options to choose from
|
|
110
|
+
- Does NOT immediately generate code
|
|
111
|
+
- Does NOT ask more than 5 questions
|
|
112
|
+
```
|
|
113
|
+
|
|
114
|
+
**Rules:**
|
|
115
|
+
|
|
116
|
+
- Evals should be independent (not dependent on previous evals)
|
|
117
|
+
- Expected behavior should be observable and binary (pass/fail, not subjective)
|
|
118
|
+
- Aim for 5-10 evals per skill before shipping; 15+ for critical skills
|
|
119
|
+
|
|
120
|
+
---
|
|
121
|
+
|
|
122
|
+
## Benchmark Mode
|
|
123
|
+
|
|
124
|
+
Run all evals after a model update or after editing the skill:
|
|
125
|
+
|
|
126
|
+
1. Run all evals sequentially (or in parallel to avoid context bleed)
|
|
127
|
+
2. Record: pass rate, elapsed time per eval, token usage
|
|
128
|
+
3. Compare to baseline before the change
|
|
129
|
+
|
|
130
|
+
**Pass rate thresholds:**
|
|
131
|
+
|
|
132
|
+
- < 60%: Skill has serious issues. Do not ship.
|
|
133
|
+
- 60-80%: Acceptable for early versions. Target improvement.
|
|
134
|
+
- > 80%: Production-ready.
|
|
135
|
+
- > 90%: Reliable enough for critical workflows.
|
|
136
|
+
|
|
137
|
+
---
|
|
138
|
+
|
|
139
|
+
## Description Tuning Process
|
|
140
|
+
|
|
141
|
+
If triggering is unreliable:
|
|
142
|
+
|
|
143
|
+
1. List 10 prompts that should trigger the skill (write them as a user would)
|
|
144
|
+
2. List 5 prompts of similar tasks that should _not_ trigger
|
|
145
|
+
3. Find the distinguishing words/phrases between the two lists
|
|
146
|
+
4. Rewrite the description to include the distinguishing words and exclude the overlap
|
|
147
|
+
|
|
148
|
+
**Pattern:**
|
|
149
|
+
|
|
150
|
+
```yaml
|
|
151
|
+
description: "Use when [specific verb] [specific noun/domain]: [comma-separated task keywords]. NOT for [adjacent tasks that should not trigger]."
|
|
152
|
+
```
|
|
153
|
+
|
|
154
|
+
---
|
|
155
|
+
|
|
156
|
+
## When to Retire a Skill
|
|
157
|
+
|
|
158
|
+
A skill is ready to retire when:
|
|
159
|
+
|
|
160
|
+
- 90%+ of its evals pass without the skill loaded (for capability uplift skills)
|
|
161
|
+
- The skill's instructions are now standard model behavior
|
|
162
|
+
- Maintenance cost exceeds value
|
|
163
|
+
|
|
164
|
+
Retiring isn't failure — it means the skill did its job and the model caught up.
|
|
@@ -0,0 +1,226 @@
|
|
|
1
|
+
# Workflow Patterns Reference
|
|
2
|
+
|
|
3
|
+
Load this when choosing or implementing a workflow pattern for a CBX agent or skill.
|
|
4
|
+
|
|
5
|
+
Source: Anthropic engineering research — [Common workflow patterns for AI agents](https://claude.com/blog/common-workflow-patterns-for-ai-agents-and-when-to-use-them) (March 2026).
|
|
6
|
+
|
|
7
|
+
---
|
|
8
|
+
|
|
9
|
+
## The Core Insight
|
|
10
|
+
|
|
11
|
+
Workflows don't replace agent autonomy — they _shape where and how_ agents apply it.
|
|
12
|
+
|
|
13
|
+
A fully autonomous agent decides everything: tools, order, when to stop.
|
|
14
|
+
A workflow provides structure: overall flow, checkpoints, boundaries — but each step still uses full agent reasoning.
|
|
15
|
+
|
|
16
|
+
**Start with a single agent call.** If that meets quality bar, you're done. Only add workflow complexity when you can measure the improvement.
|
|
17
|
+
|
|
18
|
+
---
|
|
19
|
+
|
|
20
|
+
## Pattern 1: Sequential Workflow
|
|
21
|
+
|
|
22
|
+
### What it is
|
|
23
|
+
|
|
24
|
+
Agents execute in a fixed order. Each stage processes its input, makes tool calls, then passes results to the next stage.
|
|
25
|
+
|
|
26
|
+
```
|
|
27
|
+
Input → [Agent A] → [Agent B] → [Agent C] → Output
|
|
28
|
+
```
|
|
29
|
+
|
|
30
|
+
### Use when
|
|
31
|
+
|
|
32
|
+
- Steps have explicit dependencies (B needs A's output before starting)
|
|
33
|
+
- Multi-stage transformation where each step adds specific value
|
|
34
|
+
- Draft-review-polish cycles
|
|
35
|
+
- Data extraction → validation → loading pipelines
|
|
36
|
+
|
|
37
|
+
### Avoid when
|
|
38
|
+
|
|
39
|
+
- A single agent can handle the whole task
|
|
40
|
+
- Agents need to collaborate rather than hand off linearly
|
|
41
|
+
- You're forcing sequential structure onto a task that doesn't naturally fit it
|
|
42
|
+
|
|
43
|
+
### Cost/benefit
|
|
44
|
+
|
|
45
|
+
- **Cost:** Latency is linear — step 2 waits for step 1
|
|
46
|
+
- **Benefit:** Each agent focuses on one thing; accuracy often improves
|
|
47
|
+
|
|
48
|
+
### CBX implementation
|
|
49
|
+
|
|
50
|
+
```markdown
|
|
51
|
+
## Workflow
|
|
52
|
+
|
|
53
|
+
1. **[Agent/Step A]** — [what it receives, what it does, what it produces]
|
|
54
|
+
2. **[Agent/Step B]** — [takes A's output, does X, produces Y]
|
|
55
|
+
3. **[Agent/Step C]** — [final synthesis/delivery]
|
|
56
|
+
|
|
57
|
+
Artifacts pass via [file path / variable / structured JSON / natural handoff instructions].
|
|
58
|
+
```
|
|
59
|
+
|
|
60
|
+
### Pro tip
|
|
61
|
+
|
|
62
|
+
First try the pipeline as a single agent where the steps are part of the prompt. If quality is good enough, you've solved the problem without complexity.
|
|
63
|
+
|
|
64
|
+
---
|
|
65
|
+
|
|
66
|
+
## Pattern 2: Parallel Workflow
|
|
67
|
+
|
|
68
|
+
### What it is
|
|
69
|
+
|
|
70
|
+
Multiple agents run simultaneously on independent tasks. Results are merged or synthesized afterward.
|
|
71
|
+
|
|
72
|
+
```
|
|
73
|
+
┌→ [Agent A] →┐
|
|
74
|
+
Input → ├→ [Agent B] →├→ Synthesize → Output
|
|
75
|
+
└→ [Agent C] →┘
|
|
76
|
+
```
|
|
77
|
+
|
|
78
|
+
### Use when
|
|
79
|
+
|
|
80
|
+
- Tasks are genuinely independent (no agent needs another's output to start)
|
|
81
|
+
- Speed matters and concurrent execution helps
|
|
82
|
+
- Multiple perspectives on the same input (e.g., code review from security + performance + quality)
|
|
83
|
+
- Separation of concerns — different engineers can own individual agents
|
|
84
|
+
|
|
85
|
+
### Avoid when
|
|
86
|
+
|
|
87
|
+
- Agents need cumulative context or must build on each other's work
|
|
88
|
+
- Resource constraints (API quotas) make concurrent calls inefficient
|
|
89
|
+
- Aggregation logic is unclear or produces contradictory results with no resolution strategy
|
|
90
|
+
|
|
91
|
+
### Cost/benefit
|
|
92
|
+
|
|
93
|
+
- **Cost:** Tokens multiply (N agents × tokens each); requires aggregation strategy
|
|
94
|
+
- **Benefit:** Faster completion; clean separation of concerns
|
|
95
|
+
|
|
96
|
+
### CBX implementation
|
|
97
|
+
|
|
98
|
+
```markdown
|
|
99
|
+
## Parallel Steps
|
|
100
|
+
|
|
101
|
+
Run these simultaneously:
|
|
102
|
+
|
|
103
|
+
- **[Agent A]** — [focused task, specific scope]
|
|
104
|
+
- **[Agent B]** — [focused task, different scope]
|
|
105
|
+
- **[Agent C]** — [focused task, different scope]
|
|
106
|
+
|
|
107
|
+
## Synthesis
|
|
108
|
+
|
|
109
|
+
After all agents complete:
|
|
110
|
+
[How to merge: majority vote / highest confidence / specialized agent defers to other / human review]
|
|
111
|
+
```
|
|
112
|
+
|
|
113
|
+
### Pro tip
|
|
114
|
+
|
|
115
|
+
Design your aggregation strategy _before_ implementing parallel agents. Without a clear merge plan, you collect conflicting outputs with no way to resolve them.
|
|
116
|
+
|
|
117
|
+
---
|
|
118
|
+
|
|
119
|
+
## Pattern 3: Evaluator-Optimizer Workflow
|
|
120
|
+
|
|
121
|
+
### What it is
|
|
122
|
+
|
|
123
|
+
Two agents loop: one generates content, another evaluates it against criteria, the generator refines based on feedback. Repeat until quality threshold is met or max iterations reached.
|
|
124
|
+
|
|
125
|
+
```
|
|
126
|
+
┌─────────────────────────────────────┐
|
|
127
|
+
↓ |
|
|
128
|
+
Input → [Generator] → Draft → [Evaluator] → Pass? → Output
|
|
129
|
+
↓ Fail
|
|
130
|
+
Feedback → [Generator]
|
|
131
|
+
```
|
|
132
|
+
|
|
133
|
+
### Use when
|
|
134
|
+
|
|
135
|
+
- First-draft quality consistently falls short of the required bar
|
|
136
|
+
- You have clear, measurable quality criteria an AI evaluator can apply consistently
|
|
137
|
+
- The gap between first-attempt and final quality justifies extra tokens and latency
|
|
138
|
+
- Examples: technical docs, customer communications, code against specific standards
|
|
139
|
+
|
|
140
|
+
### Avoid when
|
|
141
|
+
|
|
142
|
+
- First-attempt quality already meets requirements (unnecessary cost)
|
|
143
|
+
- Real-time applications needing immediate responses
|
|
144
|
+
- Evaluation criteria are too subjective for consistent AI evaluation
|
|
145
|
+
- Deterministic tools exist (linters for style, validators for schemas) — use those instead
|
|
146
|
+
|
|
147
|
+
### Cost/benefit
|
|
148
|
+
|
|
149
|
+
- **Cost:** Tokens × iterations; adds latency proportionally
|
|
150
|
+
- **Benefit:** Structured feedback loops produce measurably better outputs
|
|
151
|
+
|
|
152
|
+
### CBX implementation
|
|
153
|
+
|
|
154
|
+
```markdown
|
|
155
|
+
## Generator Prompt
|
|
156
|
+
|
|
157
|
+
Task: [what to create]
|
|
158
|
+
Constraints: [specific, measurable requirements]
|
|
159
|
+
Format: [exact output format]
|
|
160
|
+
|
|
161
|
+
## Evaluator Prompt
|
|
162
|
+
|
|
163
|
+
Review this output against these criteria:
|
|
164
|
+
|
|
165
|
+
1. [Criterion A] — Pass/Fail + specific failure note
|
|
166
|
+
2. [Criterion B] — Pass/Fail + specific failure note
|
|
167
|
+
3. [Criterion C] — Pass/Fail + specific failure note
|
|
168
|
+
|
|
169
|
+
Output JSON: { "pass": bool, "failures": ["..."], "revision_note": "..." }
|
|
170
|
+
|
|
171
|
+
## Loop Control
|
|
172
|
+
|
|
173
|
+
- Max iterations: [3-5]
|
|
174
|
+
- Stop when: all criteria pass OR max iterations reached
|
|
175
|
+
- On max with failures: surface remaining issues for human review
|
|
176
|
+
```
|
|
177
|
+
|
|
178
|
+
### Pro tip
|
|
179
|
+
|
|
180
|
+
Set stopping criteria _before_ iterating. Define max iterations and specific quality thresholds. Without guardrails, you enter expensive loops where the evaluator finds minor issues and quality plateaus well before you stop.
|
|
181
|
+
|
|
182
|
+
---
|
|
183
|
+
|
|
184
|
+
## Decision Tree
|
|
185
|
+
|
|
186
|
+
```
|
|
187
|
+
Can a single agent handle this task effectively?
|
|
188
|
+
→ YES: Don't use workflows. Use a rich single-agent prompt.
|
|
189
|
+
→ NO: Continue...
|
|
190
|
+
|
|
191
|
+
Do steps have dependencies (B needs A's output)?
|
|
192
|
+
→ YES: Use Sequential
|
|
193
|
+
→ NO: Continue...
|
|
194
|
+
|
|
195
|
+
Can steps run independently, and would concurrency help?
|
|
196
|
+
→ YES: Use Parallel
|
|
197
|
+
→ NO: Continue...
|
|
198
|
+
|
|
199
|
+
Does quality improve meaningfully through iteration, and can you measure it?
|
|
200
|
+
→ YES: Use Evaluator-Optimizer
|
|
201
|
+
→ NO: Re-examine whether workflows help at all
|
|
202
|
+
```
|
|
203
|
+
|
|
204
|
+
---
|
|
205
|
+
|
|
206
|
+
## Combining Patterns
|
|
207
|
+
|
|
208
|
+
Patterns are building blocks, not mutually exclusive:
|
|
209
|
+
|
|
210
|
+
- A **sequential workflow** can include **parallel** steps at certain stages (e.g., three parallel reviewers before a final synthesis step)
|
|
211
|
+
- An **evaluator-optimizer** can use **parallel evaluation** where multiple evaluators assess different quality dimensions simultaneously
|
|
212
|
+
- A **sequential chain** can use **evaluator-optimizer** at the critical high-quality step
|
|
213
|
+
|
|
214
|
+
Only add the combination when each additional pattern measurably improves outcomes.
|
|
215
|
+
|
|
216
|
+
---
|
|
217
|
+
|
|
218
|
+
## Pattern Comparison
|
|
219
|
+
|
|
220
|
+
| | Sequential | Parallel | Evaluator-Optimizer |
|
|
221
|
+
| -------------- | -------------------------------------------- | --------------------------------------- | ------------------------------------ |
|
|
222
|
+
| **When** | Dependencies between steps | Independent tasks | Quality below bar |
|
|
223
|
+
| **Examples** | Extract → validate → load; Draft → translate | Code review (security + perf + quality) | Technical docs, comms, SQL |
|
|
224
|
+
| **Latency** | Linear (each waits for previous) | Fast (concurrent) | Multiplied by iterations |
|
|
225
|
+
| **Token cost** | Linear | Multiplicative | Linear × iterations |
|
|
226
|
+
| **Key risk** | Bottleneck at slow steps | Aggregation conflicts | Infinite loops without stop criteria |
|
package/workflows/workflows/agent-environment-setup/platforms/copilot/skills/deep-research/SKILL.md
CHANGED
|
@@ -1,10 +1,10 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: deep-research
|
|
3
|
-
description: "Use when a task needs multi-round research rather than a quick lookup: iterative search, gap finding, corroboration across sources, contradiction handling,
|
|
3
|
+
description: "Use when a task needs multi-round research rather than a quick lookup: iterative search, gap finding, corroboration across sources, contradiction handling, evidence-led synthesis before planning or implementation. Also use when the user asks for 'deep research', 'latest info', or 'how does X compare to Y publicly'."
|
|
4
4
|
license: MIT
|
|
5
5
|
metadata:
|
|
6
6
|
author: cubis-foundry
|
|
7
|
-
version: "1.
|
|
7
|
+
version: "1.1"
|
|
8
8
|
compatibility: Claude Code, Codex, GitHub Copilot
|
|
9
9
|
---
|
|
10
10
|
# Deep Research
|
|
@@ -13,23 +13,25 @@ compatibility: Claude Code, Codex, GitHub Copilot
|
|
|
13
13
|
|
|
14
14
|
You are the specialist for iterative evidence gathering and synthesis.
|
|
15
15
|
|
|
16
|
-
Your job is to find what is missing, not just summarize the first page of results.
|
|
16
|
+
Your job is to find what is missing, not just summarize the first page of results. Stop when remaining uncertainty is low-impact or explicitly reported to the user.
|
|
17
17
|
|
|
18
18
|
## When to Use
|
|
19
19
|
|
|
20
|
-
- The task needs deep web or repo research before planning or implementation
|
|
21
|
-
- The first-pass answer is incomplete, contradictory, or likely stale
|
|
22
|
-
- The user explicitly asks for research, latest information, or public-repo comparison
|
|
20
|
+
- The task needs deep web or repo research before planning or implementation
|
|
21
|
+
- The first-pass answer is incomplete, contradictory, or likely stale
|
|
22
|
+
- The user explicitly asks for research, latest information, or public-repo comparison
|
|
23
|
+
- Claims are contested or the topic changes fast (AI tooling, frameworks, protocols)
|
|
23
24
|
|
|
24
25
|
## Instructions
|
|
25
26
|
|
|
26
27
|
### STANDARD OPERATING PROCEDURE (SOP)
|
|
27
28
|
|
|
28
|
-
1. Define the question and what would count as enough evidence.
|
|
29
|
-
2. Run a first pass and identify gaps
|
|
29
|
+
1. Define the narrowest possible form of the question and what would count as enough evidence.
|
|
30
|
+
2. Run a first pass and identify gaps, contradictions, and missing facts.
|
|
30
31
|
3. Search specifically for the missing facts, stronger sources, or counterexamples.
|
|
31
|
-
4. Rank sources by directness, recency, and authority.
|
|
32
|
-
5. Separate sourced facts
|
|
32
|
+
4. Rank sources by directness (primary > secondary > tertiary), recency, and authority.
|
|
33
|
+
5. Separate **sourced facts**, **informed inference**, and **unresolved gaps** in the output.
|
|
34
|
+
6. Apply the sub-agent reader test for substantial research deliverables — pass the synthesis to a fresh context to verify it's self-contained.
|
|
33
35
|
|
|
34
36
|
### Constraints
|
|
35
37
|
|
|
@@ -40,19 +42,22 @@ Your job is to find what is missing, not just summarize the first page of result
|
|
|
40
42
|
|
|
41
43
|
## Output Format
|
|
42
44
|
|
|
43
|
-
|
|
45
|
+
Structure clearly as:
|
|
44
46
|
|
|
45
|
-
|
|
46
|
-
|
|
47
|
-
|
|
48
|
-
|
|
49
|
-
| `references/multi-round-research-loop.md` | You need the detailed loop for search, corroboration, contradiction handling, and evidence synthesis. |
|
|
47
|
+
- **Key findings** — the answer, directly stated
|
|
48
|
+
- **Evidence** — sourced facts with citations ranked by confidence
|
|
49
|
+
- **Inference** — what follows logically from the evidence (labeled as inference)
|
|
50
|
+
- **Open questions** — what remains unresolved and why it matters
|
|
50
51
|
|
|
51
|
-
##
|
|
52
|
+
## References
|
|
52
53
|
|
|
53
|
-
|
|
54
|
+
| File | Load when |
|
|
55
|
+
| ----------------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------- |
|
|
56
|
+
| `references/multi-round-research-loop.md` | You need the full iterative loop: search, corroboration, contradiction handling, evidence table, sub-agent reader test, stop rules, and failure mode guide. |
|
|
54
57
|
|
|
55
58
|
## Examples
|
|
56
59
|
|
|
57
|
-
- "
|
|
58
|
-
- "
|
|
60
|
+
- "Research how Anthropic structures their agent skills — compare to what CBX does"
|
|
61
|
+
- "What's the latest on evaluator-optimizer patterns in production agent systems?"
|
|
62
|
+
- "Deep research on OKLCH vs HSL for design systems — what do practitioners actually use?"
|
|
63
|
+
- "Find counterexamples to the claim that parallel agents always improve speed"
|
|
@@ -1,15 +1,80 @@
|
|
|
1
1
|
# Multi-Round Research Loop
|
|
2
2
|
|
|
3
|
-
Load this when the research task is broad, unstable, or likely to have conflicting public sources.
|
|
3
|
+
Load this when the research task is broad, unstable, contested, or likely to have conflicting public sources — or when the user explicitly asks for deep or latest research.
|
|
4
4
|
|
|
5
|
-
##
|
|
5
|
+
## The Core Principle
|
|
6
6
|
|
|
7
|
-
|
|
8
|
-
|
|
9
|
-
|
|
10
|
-
|
|
11
|
-
|
|
7
|
+
Your job is to find what is _missing_, not just summarize the first page of results. Stop when remaining uncertainty is low-impact or explicitly reported back to the user.
|
|
8
|
+
|
|
9
|
+
---
|
|
10
|
+
|
|
11
|
+
## The Loop
|
|
12
|
+
|
|
13
|
+
### Round 1: Define and search broadly
|
|
14
|
+
|
|
15
|
+
1. **Narrow the question** — State the most specific version of what you're trying to find. Vague questions produce vague results.
|
|
16
|
+
2. **Search** — Run initial queries across the most likely sources (official docs, engineering blogs, GitHub repos, research papers as appropriate).
|
|
17
|
+
3. **Record gaps** — What did this pass _not_ answer? What's contradictory? What's suspiciously absent?
|
|
18
|
+
|
|
19
|
+
### Round 2: Target the gaps
|
|
20
|
+
|
|
21
|
+
4. **Search directly for the missing facts** — Use specific, targeted queries (not broad topic queries). Prefer: official docs > primary source blog > authoritative community reference > general article.
|
|
22
|
+
5. **Search for contradictions** — If two sources disagree, search specifically for why. Age, version differences, and context often explain it.
|
|
23
|
+
6. **Seek counterexamples** — Actively search for "X doesn't work", "X is wrong", "problems with X" — not just confirmation.
|
|
24
|
+
|
|
25
|
+
### Round 3: Corroborate and synthesize
|
|
26
|
+
|
|
27
|
+
7. **Cross-verify** unstable claims against at least one independent source.
|
|
28
|
+
8. **Rank sources** by directness (primary > secondary > tertiary), recency (newer > older for fast-moving topics), and authority (official > community > anecdotal).
|
|
29
|
+
9. **Write the evidence table** — Track what you found, not just conclusions:
|
|
30
|
+
|
|
31
|
+
| Fact | Source | Confidence | Open question |
|
|
32
|
+
| ------- | ------------ | ------------------- | ------------------------ |
|
|
33
|
+
| [Claim] | [URL or doc] | High / Medium / Low | [What's still uncertain] |
|
|
34
|
+
|
|
35
|
+
---
|
|
12
36
|
|
|
13
37
|
## Stop Rule
|
|
14
38
|
|
|
15
|
-
Stop
|
|
39
|
+
Stop when:
|
|
40
|
+
|
|
41
|
+
- Remaining uncertainty is low-impact (won't change the recommendation)
|
|
42
|
+
- OR the question is genuinely unresolvable from public sources (report this explicitly)
|
|
43
|
+
- OR you've completed 3 rounds without new signal (diminishing returns — report what's known and what's not)
|
|
44
|
+
|
|
45
|
+
Do NOT stop after one source when the claim is unstable, contested, or from a secondary source.
|
|
46
|
+
|
|
47
|
+
---
|
|
48
|
+
|
|
49
|
+
## Output Format
|
|
50
|
+
|
|
51
|
+
Separate clearly:
|
|
52
|
+
|
|
53
|
+
- **Sourced facts** — you have direct evidence
|
|
54
|
+
- **Informed inference** — logically follows from evidence but not directly stated
|
|
55
|
+
- **Unresolved gaps** — you searched and didn't find it; note what's unknown
|
|
56
|
+
|
|
57
|
+
Do not present inference as fact. Do not present absence of evidence as evidence of absence.
|
|
58
|
+
|
|
59
|
+
---
|
|
60
|
+
|
|
61
|
+
## Common Research Failure Modes
|
|
62
|
+
|
|
63
|
+
| Failure | Fix |
|
|
64
|
+
| ------------------------------------- | -------------------------------------------------- |
|
|
65
|
+
| Stopping at first result | Check at least 2-3 sources for any unstable claim |
|
|
66
|
+
| Only finding confirmation | Actively search for counterexamples and criticisms |
|
|
67
|
+
| Treating recent = correct | Cross-check recency with authority and context |
|
|
68
|
+
| Vague queries returning vague results | Restate the question as a specific, narrow query |
|
|
69
|
+
| Reporting uncertainty as fact | Use "inference" or "unknown" tags explicitly |
|
|
70
|
+
| Burying the answer in context | Lead with the finding; evidence follows |
|
|
71
|
+
|
|
72
|
+
---
|
|
73
|
+
|
|
74
|
+
## Sub-Agent Reader Test
|
|
75
|
+
|
|
76
|
+
After completing research, if the output will be used by another agent or handed to a human without context:
|
|
77
|
+
|
|
78
|
+
- Pass the research summary to a fresh sub-agent with no conversation history
|
|
79
|
+
- Ask: "What is the main finding?", "What is still uncertain?", "What sources support the key claims?"
|
|
80
|
+
- If the fresh reader gets it wrong, the synthesis has context bleed — revise before delivery
|
|
@@ -31,9 +31,10 @@ Guide creation of distinctive, production-grade frontend interfaces that avoid g
|
|
|
31
31
|
Before writing code, ask or infer:
|
|
32
32
|
|
|
33
33
|
1. **Purpose** — What problem does this interface solve? Who uses it?
|
|
34
|
-
2. **
|
|
35
|
-
3. **
|
|
36
|
-
4. **
|
|
34
|
+
2. **Brand** — Is there an existing brand system, style guide, or named brand (e.g. "Anthropic", client guidelines, hex palette) to follow? If yes, load `references/brand-presets.md` and use `/brand` to apply it before choosing aesthetic direction.
|
|
35
|
+
3. **Tone** — If no brand system exists, pick a bold aesthetic direction: brutally minimal, maximalist chaos, retro-futuristic, organic/natural, luxury/refined, playful/toy-like, editorial/magazine, brutalist/raw, art deco/geometric, soft/pastel, industrial/utilitarian. There are many flavors. Pick one and commit.
|
|
36
|
+
4. **Constraints** — Technical requirements (framework, performance, a11y level, browser support).
|
|
37
|
+
5. **Differentiation** — What makes this UNFORGETTABLE? What's the one thing someone will remember?
|
|
37
38
|
|
|
38
39
|
Choose a clear conceptual direction and execute it with precision. Bold maximalism and refined minimalism both work — the key is intentionality, not intensity.
|
|
39
40
|
|
|
@@ -166,40 +167,42 @@ Deliver:
|
|
|
166
167
|
|
|
167
168
|
Load only what the current step needs.
|
|
168
169
|
|
|
169
|
-
| File | Load when
|
|
170
|
-
| ---------------------------------- |
|
|
171
|
-
| `references/typography.md` | Task involves font selection, type scale, font loading, or text hierarchy decisions.
|
|
172
|
-
| `references/color-and-contrast.md` | Task involves palette selection, dark mode, OKLCH color, contrast ratios, or tinted neutrals.
|
|
173
|
-
| `references/spatial-design.md` | Task involves grid systems, spacing rhythm, container queries, or layout composition.
|
|
174
|
-
| `references/motion-design.md` | Task involves animation timing, easing curves, staggered reveals, or reduced motion support.
|
|
175
|
-
| `references/interaction-design.md` | Task involves form design, focus management, loading states, or progressive disclosure patterns.
|
|
176
|
-
| `references/responsive-design.md` | Task involves mobile-first design, fluid layouts, container queries, or adaptive interfaces.
|
|
177
|
-
| `references/ux-writing.md` | Task involves button labels, error messages, empty states, or microcopy decisions.
|
|
178
|
-
| `references/ux-psychology.md` | Task involves cognitive load, decision architecture, trust building, or emotional design principles.
|
|
170
|
+
| File | Load when |
|
|
171
|
+
| ---------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------- |
|
|
172
|
+
| `references/typography.md` | Task involves font selection, type scale, font loading, or text hierarchy decisions. |
|
|
173
|
+
| `references/color-and-contrast.md` | Task involves palette selection, dark mode, OKLCH color, contrast ratios, or tinted neutrals. |
|
|
174
|
+
| `references/spatial-design.md` | Task involves grid systems, spacing rhythm, container queries, or layout composition. |
|
|
175
|
+
| `references/motion-design.md` | Task involves animation timing, easing curves, staggered reveals, or reduced motion support. |
|
|
176
|
+
| `references/interaction-design.md` | Task involves form design, focus management, loading states, or progressive disclosure patterns. |
|
|
177
|
+
| `references/responsive-design.md` | Task involves mobile-first design, fluid layouts, container queries, or adaptive interfaces. |
|
|
178
|
+
| `references/ux-writing.md` | Task involves button labels, error messages, empty states, or microcopy decisions. |
|
|
179
|
+
| `references/ux-psychology.md` | Task involves cognitive load, decision architecture, trust building, or emotional design principles. |
|
|
180
|
+
| `references/brand-presets.md` | Task involves applying existing brand guidelines, a named brand system (e.g. Anthropic), or converting a hex palette into CSS tokens. |
|
|
179
181
|
|
|
180
182
|
## Commands
|
|
181
183
|
|
|
182
184
|
17 specialized commands for targeted design operations. Each command focuses on a specific design concern and can be applied to a whole page or a specific element.
|
|
183
185
|
|
|
184
|
-
| Command | Purpose
|
|
185
|
-
| ------------------- |
|
|
186
|
-
| `/audit` | Run technical quality checks: accessibility, performance, responsive behavior
|
|
187
|
-
| `/critique` | UX design review: hierarchy, clarity, emotional resonance, user flow
|
|
188
|
-
| `/normalize` | Align with design system standards: tokens, spacing, typography consistency
|
|
189
|
-
| `/polish` | Final pass before shipping: micro-details, alignment, visual refinement
|
|
190
|
-
| `/distill` | Strip to essence: remove unnecessary complexity, simplify without losing character
|
|
191
|
-
| `/clarify` | Improve unclear UX copy: labels, instructions, error messages, empty states
|
|
192
|
-
| `/optimize` | Performance improvements: image sizes, render-blocking, bundle impact
|
|
193
|
-
| `/harden` | Error handling, i18n readiness, edge cases, defensive UI patterns
|
|
194
|
-
| `/animate` | Add purposeful motion: transitions, micro-interactions, state changes
|
|
195
|
-
| `/colorize` | Introduce strategic color: palette refinement, accent placement, contrast fixes
|
|
196
|
-
| `/bolder` | Amplify timid designs: stronger hierarchy, more contrast, bigger gestures
|
|
197
|
-
| `/quieter` | Tone down overwhelming designs: reduce noise, increase whitespace, simplify
|
|
198
|
-
| `/delight` | Add moments of joy: easter eggs, satisfying interactions, personality
|
|
199
|
-
| `/extract` | Pull into reusable components: identify patterns, create component API
|
|
200
|
-
| `/adapt` | Adapt for different devices: responsive breakpoints, touch targets, viewport optimization
|
|
201
|
-
| `/onboard` | Design onboarding flows: first-run experience, empty states, progressive disclosure
|
|
202
|
-
| `/teach-impeccable` | One-time setup: gather project design context, save preferences for future sessions
|
|
186
|
+
| Command | Purpose |
|
|
187
|
+
| ------------------- | ------------------------------------------------------------------------------------------------------------------- |
|
|
188
|
+
| `/audit` | Run technical quality checks: accessibility, performance, responsive behavior |
|
|
189
|
+
| `/critique` | UX design review: hierarchy, clarity, emotional resonance, user flow |
|
|
190
|
+
| `/normalize` | Align with design system standards: tokens, spacing, typography consistency |
|
|
191
|
+
| `/polish` | Final pass before shipping: micro-details, alignment, visual refinement |
|
|
192
|
+
| `/distill` | Strip to essence: remove unnecessary complexity, simplify without losing character |
|
|
193
|
+
| `/clarify` | Improve unclear UX copy: labels, instructions, error messages, empty states |
|
|
194
|
+
| `/optimize` | Performance improvements: image sizes, render-blocking, bundle impact |
|
|
195
|
+
| `/harden` | Error handling, i18n readiness, edge cases, defensive UI patterns |
|
|
196
|
+
| `/animate` | Add purposeful motion: transitions, micro-interactions, state changes |
|
|
197
|
+
| `/colorize` | Introduce strategic color: palette refinement, accent placement, contrast fixes |
|
|
198
|
+
| `/bolder` | Amplify timid designs: stronger hierarchy, more contrast, bigger gestures |
|
|
199
|
+
| `/quieter` | Tone down overwhelming designs: reduce noise, increase whitespace, simplify |
|
|
200
|
+
| `/delight` | Add moments of joy: easter eggs, satisfying interactions, personality |
|
|
201
|
+
| `/extract` | Pull into reusable components: identify patterns, create component API |
|
|
202
|
+
| `/adapt` | Adapt for different devices: responsive breakpoints, touch targets, viewport optimization |
|
|
203
|
+
| `/onboard` | Design onboarding flows: first-run experience, empty states, progressive disclosure |
|
|
204
|
+
| `/teach-impeccable` | One-time setup: gather project design context, save preferences for future sessions |
|
|
205
|
+
| `/brand` | Apply or enforce a specific brand identity: convert guideline colors to CSS tokens, set typography, verify contrast |
|
|
203
206
|
|
|
204
207
|
Usage: Most commands accept an optional argument to focus on a specific area (e.g., `/audit header`, `/polish checkout-form`).
|
|
205
208
|
|
|
@@ -211,3 +214,5 @@ Usage: Most commands accept an optional argument to focus on a specific area (e.
|
|
|
211
214
|
- "/critique the checkout flow — is the hierarchy clear? Does it build trust?"
|
|
212
215
|
- "/polish the hero section before we ship."
|
|
213
216
|
- "I need a color system for a health tech app. No fintech blue, no AI purple."
|
|
217
|
+
- "/brand anthropic — apply Anthropic's brand colors and typography to this interface."
|
|
218
|
+
- "Here's our brand guide with hex values. Apply it to this dashboard — /brand"
|