wizz-method 1.3.2 → 1.4.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (167) hide show
  1. package/package.json +1 -1
  2. package/skills-registry.yaml +12 -2
  3. package/src/skills-lib/ai-product-design/SKILL.md +85 -0
  4. package/src/skills-lib/ai-product-design/references/LICENSE +21 -0
  5. package/src/skills-lib/ai-product-design/references/ai-alignment-reasoning/bias-detection-design/SKILL.md +37 -0
  6. package/src/skills-lib/ai-product-design/references/ai-alignment-reasoning/consent-and-agency/SKILL.md +37 -0
  7. package/src/skills-lib/ai-product-design/references/ai-alignment-reasoning/escalation-design/SKILL.md +40 -0
  8. package/src/skills-lib/ai-product-design/references/ai-alignment-reasoning/guardrail-design/SKILL.md +36 -0
  9. package/src/skills-lib/ai-product-design/references/ai-alignment-reasoning/harm-anticipation/SKILL.md +108 -0
  10. package/src/skills-lib/ai-product-design/references/ai-alignment-reasoning/transparency-patterns/SKILL.md +36 -0
  11. package/src/skills-lib/ai-product-design/references/ai-alignment-reasoning/trust-calibration/SKILL.md +102 -0
  12. package/src/skills-lib/ai-product-design/references/ai-alignment-reasoning/value-specification/SKILL.md +39 -0
  13. package/src/skills-lib/ai-product-design/references/design-agent-orchestration/agent-role-design/SKILL.md +37 -0
  14. package/src/skills-lib/ai-product-design/references/design-agent-orchestration/failure-recovery/SKILL.md +37 -0
  15. package/src/skills-lib/ai-product-design/references/design-agent-orchestration/handoff-protocols/SKILL.md +45 -0
  16. package/src/skills-lib/ai-product-design/references/design-agent-orchestration/human-in-the-loop/SKILL.md +39 -0
  17. package/src/skills-lib/ai-product-design/references/design-agent-orchestration/observability-design/SKILL.md +48 -0
  18. package/src/skills-lib/ai-product-design/references/design-agent-orchestration/state-management/SKILL.md +95 -0
  19. package/src/skills-lib/ai-product-design/references/design-agent-orchestration/task-decomposition/SKILL.md +36 -0
  20. package/src/skills-lib/ai-product-design/references/evaluation/comparative-evaluation/SKILL.md +39 -0
  21. package/src/skills-lib/ai-product-design/references/evaluation/failure-taxonomy/SKILL.md +47 -0
  22. package/src/skills-lib/ai-product-design/references/evaluation/heuristic-evaluation-ai/SKILL.md +46 -0
  23. package/src/skills-lib/ai-product-design/references/evaluation/longitudinal-measurement/SKILL.md +38 -0
  24. package/src/skills-lib/ai-product-design/references/evaluation/output-quality-rubrics/SKILL.md +41 -0
  25. package/src/skills-lib/ai-product-design/references/evaluation/task-success-metrics/SKILL.md +35 -0
  26. package/src/skills-lib/ai-product-design/references/evaluation/user-satisfaction-signals/SKILL.md +50 -0
  27. package/src/skills-lib/ai-product-design/references/model-interaction-design/context-window-design/SKILL.md +28 -0
  28. package/src/skills-lib/ai-product-design/references/model-interaction-design/conversation-patterns/SKILL.md +37 -0
  29. package/src/skills-lib/ai-product-design/references/model-interaction-design/feedback-loops/SKILL.md +35 -0
  30. package/src/skills-lib/ai-product-design/references/model-interaction-design/frustration-detection/SKILL.md +91 -0
  31. package/src/skills-lib/ai-product-design/references/model-interaction-design/generative-ui/SKILL.md +34 -0
  32. package/src/skills-lib/ai-product-design/references/model-interaction-design/mixed-initiative-flow/SKILL.md +39 -0
  33. package/src/skills-lib/ai-product-design/references/model-interaction-design/multimodal-orchestration/SKILL.md +94 -0
  34. package/src/skills-lib/ai-product-design/references/model-interaction-design/progressive-disclosure/SKILL.md +33 -0
  35. package/src/skills-lib/ai-product-design/references/prompt-architecture/chain-of-thought-design/SKILL.md +45 -0
  36. package/src/skills-lib/ai-product-design/references/prompt-architecture/constraint-specification/SKILL.md +50 -0
  37. package/src/skills-lib/ai-product-design/references/prompt-architecture/context-engineering/SKILL.md +45 -0
  38. package/src/skills-lib/ai-product-design/references/prompt-architecture/few-shot-patterns/SKILL.md +47 -0
  39. package/src/skills-lib/ai-product-design/references/prompt-architecture/prompt-versioning/SKILL.md +42 -0
  40. package/src/skills-lib/ai-product-design/references/prompt-architecture/system-prompt-structure/SKILL.md +50 -0
  41. package/src/skills-lib/ai-product-design/references/prompt-architecture/template-design/SKILL.md +42 -0
  42. package/src/skills-lib/ai-product-design/references/system-behavior-shaping/behavioral-consistency/SKILL.md +36 -0
  43. package/src/skills-lib/ai-product-design/references/system-behavior-shaping/cultural-adaptation/SKILL.md +38 -0
  44. package/src/skills-lib/ai-product-design/references/system-behavior-shaping/domain-voice/SKILL.md +51 -0
  45. package/src/skills-lib/ai-product-design/references/system-behavior-shaping/emotional-design/SKILL.md +51 -0
  46. package/src/skills-lib/ai-product-design/references/system-behavior-shaping/error-personality/SKILL.md +45 -0
  47. package/src/skills-lib/ai-product-design/references/system-behavior-shaping/persona-architecture/SKILL.md +38 -0
  48. package/src/skills-lib/ai-product-design/references/system-behavior-shaping/tone-calibration/SKILL.md +39 -0
  49. package/src/skills-lib/algorithmic-art/LICENSE.txt +202 -0
  50. package/src/skills-lib/algorithmic-art/SKILL.md +405 -0
  51. package/src/skills-lib/algorithmic-art/templates/generator_template.js +223 -0
  52. package/src/skills-lib/algorithmic-art/templates/viewer.html +599 -0
  53. package/src/skills-lib/animate/README.md +41 -0
  54. package/src/skills-lib/animate/SKILL.md +179 -0
  55. package/src/skills-lib/animate/examples/animate-height.tsx +75 -0
  56. package/src/skills-lib/animate/examples/app-store-card.tsx +164 -0
  57. package/src/skills-lib/animate/examples/card-hover.tsx +79 -0
  58. package/src/skills-lib/animate/examples/feedback-popover.tsx +119 -0
  59. package/src/skills-lib/animate/examples/multi-step-flow.tsx +128 -0
  60. package/src/skills-lib/animate/examples/shared-layout.tsx +64 -0
  61. package/src/skills-lib/animate/examples/text-reveal.tsx +70 -0
  62. package/src/skills-lib/animate/examples/toast-stacking.tsx +95 -0
  63. package/src/skills-lib/animate/references/css-animations.md +232 -0
  64. package/src/skills-lib/animate/references/easing-and-timing.md +105 -0
  65. package/src/skills-lib/animate/references/framer-motion.md +356 -0
  66. package/src/skills-lib/animate/references/performance-accessibility.md +185 -0
  67. package/src/skills-lib/auth-and-secrets/SKILL.md +10 -0
  68. package/src/skills-lib/canvas-design/LICENSE.txt +202 -0
  69. package/src/skills-lib/canvas-design/SKILL.md +130 -0
  70. package/src/skills-lib/canvas-design/canvas-fonts/ArsenalSC-OFL.txt +93 -0
  71. package/src/skills-lib/canvas-design/canvas-fonts/ArsenalSC-Regular.ttf +0 -0
  72. package/src/skills-lib/canvas-design/canvas-fonts/BigShoulders-Bold.ttf +0 -0
  73. package/src/skills-lib/canvas-design/canvas-fonts/BigShoulders-OFL.txt +93 -0
  74. package/src/skills-lib/canvas-design/canvas-fonts/BigShoulders-Regular.ttf +0 -0
  75. package/src/skills-lib/canvas-design/canvas-fonts/Boldonse-OFL.txt +93 -0
  76. package/src/skills-lib/canvas-design/canvas-fonts/Boldonse-Regular.ttf +0 -0
  77. package/src/skills-lib/canvas-design/canvas-fonts/BricolageGrotesque-Bold.ttf +0 -0
  78. package/src/skills-lib/canvas-design/canvas-fonts/BricolageGrotesque-OFL.txt +93 -0
  79. package/src/skills-lib/canvas-design/canvas-fonts/BricolageGrotesque-Regular.ttf +0 -0
  80. package/src/skills-lib/canvas-design/canvas-fonts/CrimsonPro-Bold.ttf +0 -0
  81. package/src/skills-lib/canvas-design/canvas-fonts/CrimsonPro-Italic.ttf +0 -0
  82. package/src/skills-lib/canvas-design/canvas-fonts/CrimsonPro-OFL.txt +93 -0
  83. package/src/skills-lib/canvas-design/canvas-fonts/CrimsonPro-Regular.ttf +0 -0
  84. package/src/skills-lib/canvas-design/canvas-fonts/DMMono-OFL.txt +93 -0
  85. package/src/skills-lib/canvas-design/canvas-fonts/DMMono-Regular.ttf +0 -0
  86. package/src/skills-lib/canvas-design/canvas-fonts/EricaOne-OFL.txt +94 -0
  87. package/src/skills-lib/canvas-design/canvas-fonts/EricaOne-Regular.ttf +0 -0
  88. package/src/skills-lib/canvas-design/canvas-fonts/GeistMono-Bold.ttf +0 -0
  89. package/src/skills-lib/canvas-design/canvas-fonts/GeistMono-OFL.txt +93 -0
  90. package/src/skills-lib/canvas-design/canvas-fonts/GeistMono-Regular.ttf +0 -0
  91. package/src/skills-lib/canvas-design/canvas-fonts/Gloock-OFL.txt +93 -0
  92. package/src/skills-lib/canvas-design/canvas-fonts/Gloock-Regular.ttf +0 -0
  93. package/src/skills-lib/canvas-design/canvas-fonts/IBMPlexMono-Bold.ttf +0 -0
  94. package/src/skills-lib/canvas-design/canvas-fonts/IBMPlexMono-OFL.txt +93 -0
  95. package/src/skills-lib/canvas-design/canvas-fonts/IBMPlexMono-Regular.ttf +0 -0
  96. package/src/skills-lib/canvas-design/canvas-fonts/IBMPlexSerif-Bold.ttf +0 -0
  97. package/src/skills-lib/canvas-design/canvas-fonts/IBMPlexSerif-BoldItalic.ttf +0 -0
  98. package/src/skills-lib/canvas-design/canvas-fonts/IBMPlexSerif-Italic.ttf +0 -0
  99. package/src/skills-lib/canvas-design/canvas-fonts/IBMPlexSerif-Regular.ttf +0 -0
  100. package/src/skills-lib/canvas-design/canvas-fonts/InstrumentSans-Bold.ttf +0 -0
  101. package/src/skills-lib/canvas-design/canvas-fonts/InstrumentSans-BoldItalic.ttf +0 -0
  102. package/src/skills-lib/canvas-design/canvas-fonts/InstrumentSans-Italic.ttf +0 -0
  103. package/src/skills-lib/canvas-design/canvas-fonts/InstrumentSans-OFL.txt +93 -0
  104. package/src/skills-lib/canvas-design/canvas-fonts/InstrumentSans-Regular.ttf +0 -0
  105. package/src/skills-lib/canvas-design/canvas-fonts/InstrumentSerif-Italic.ttf +0 -0
  106. package/src/skills-lib/canvas-design/canvas-fonts/InstrumentSerif-Regular.ttf +0 -0
  107. package/src/skills-lib/canvas-design/canvas-fonts/Italiana-OFL.txt +93 -0
  108. package/src/skills-lib/canvas-design/canvas-fonts/Italiana-Regular.ttf +0 -0
  109. package/src/skills-lib/canvas-design/canvas-fonts/JetBrainsMono-Bold.ttf +0 -0
  110. package/src/skills-lib/canvas-design/canvas-fonts/JetBrainsMono-OFL.txt +93 -0
  111. package/src/skills-lib/canvas-design/canvas-fonts/JetBrainsMono-Regular.ttf +0 -0
  112. package/src/skills-lib/canvas-design/canvas-fonts/Jura-Light.ttf +0 -0
  113. package/src/skills-lib/canvas-design/canvas-fonts/Jura-Medium.ttf +0 -0
  114. package/src/skills-lib/canvas-design/canvas-fonts/Jura-OFL.txt +93 -0
  115. package/src/skills-lib/canvas-design/canvas-fonts/LibreBaskerville-OFL.txt +93 -0
  116. package/src/skills-lib/canvas-design/canvas-fonts/LibreBaskerville-Regular.ttf +0 -0
  117. package/src/skills-lib/canvas-design/canvas-fonts/Lora-Bold.ttf +0 -0
  118. package/src/skills-lib/canvas-design/canvas-fonts/Lora-BoldItalic.ttf +0 -0
  119. package/src/skills-lib/canvas-design/canvas-fonts/Lora-Italic.ttf +0 -0
  120. package/src/skills-lib/canvas-design/canvas-fonts/Lora-OFL.txt +93 -0
  121. package/src/skills-lib/canvas-design/canvas-fonts/Lora-Regular.ttf +0 -0
  122. package/src/skills-lib/canvas-design/canvas-fonts/NationalPark-Bold.ttf +0 -0
  123. package/src/skills-lib/canvas-design/canvas-fonts/NationalPark-OFL.txt +93 -0
  124. package/src/skills-lib/canvas-design/canvas-fonts/NationalPark-Regular.ttf +0 -0
  125. package/src/skills-lib/canvas-design/canvas-fonts/NothingYouCouldDo-OFL.txt +93 -0
  126. package/src/skills-lib/canvas-design/canvas-fonts/NothingYouCouldDo-Regular.ttf +0 -0
  127. package/src/skills-lib/canvas-design/canvas-fonts/Outfit-Bold.ttf +0 -0
  128. package/src/skills-lib/canvas-design/canvas-fonts/Outfit-OFL.txt +93 -0
  129. package/src/skills-lib/canvas-design/canvas-fonts/Outfit-Regular.ttf +0 -0
  130. package/src/skills-lib/canvas-design/canvas-fonts/PixelifySans-Medium.ttf +0 -0
  131. package/src/skills-lib/canvas-design/canvas-fonts/PixelifySans-OFL.txt +93 -0
  132. package/src/skills-lib/canvas-design/canvas-fonts/PoiretOne-OFL.txt +93 -0
  133. package/src/skills-lib/canvas-design/canvas-fonts/PoiretOne-Regular.ttf +0 -0
  134. package/src/skills-lib/canvas-design/canvas-fonts/RedHatMono-Bold.ttf +0 -0
  135. package/src/skills-lib/canvas-design/canvas-fonts/RedHatMono-OFL.txt +93 -0
  136. package/src/skills-lib/canvas-design/canvas-fonts/RedHatMono-Regular.ttf +0 -0
  137. package/src/skills-lib/canvas-design/canvas-fonts/Silkscreen-OFL.txt +93 -0
  138. package/src/skills-lib/canvas-design/canvas-fonts/Silkscreen-Regular.ttf +0 -0
  139. package/src/skills-lib/canvas-design/canvas-fonts/SmoochSans-Medium.ttf +0 -0
  140. package/src/skills-lib/canvas-design/canvas-fonts/SmoochSans-OFL.txt +93 -0
  141. package/src/skills-lib/canvas-design/canvas-fonts/Tektur-Medium.ttf +0 -0
  142. package/src/skills-lib/canvas-design/canvas-fonts/Tektur-OFL.txt +93 -0
  143. package/src/skills-lib/canvas-design/canvas-fonts/Tektur-Regular.ttf +0 -0
  144. package/src/skills-lib/canvas-design/canvas-fonts/WorkSans-Bold.ttf +0 -0
  145. package/src/skills-lib/canvas-design/canvas-fonts/WorkSans-BoldItalic.ttf +0 -0
  146. package/src/skills-lib/canvas-design/canvas-fonts/WorkSans-Italic.ttf +0 -0
  147. package/src/skills-lib/canvas-design/canvas-fonts/WorkSans-OFL.txt +93 -0
  148. package/src/skills-lib/canvas-design/canvas-fonts/WorkSans-Regular.ttf +0 -0
  149. package/src/skills-lib/canvas-design/canvas-fonts/YoungSerif-OFL.txt +93 -0
  150. package/src/skills-lib/canvas-design/canvas-fonts/YoungSerif-Regular.ttf +0 -0
  151. package/src/skills-lib/design-motion-principles/SKILL.md +122 -0
  152. package/src/skills-lib/design-motion-principles/references/accessibility.md +52 -0
  153. package/src/skills-lib/design-motion-principles/references/anti-checklist.md +274 -0
  154. package/src/skills-lib/design-motion-principles/references/audit-checklist.md +137 -0
  155. package/src/skills-lib/design-motion-principles/references/creation-gotchas.md +36 -0
  156. package/src/skills-lib/design-motion-principles/references/demo-shell.html +275 -0
  157. package/src/skills-lib/design-motion-principles/references/emil-kowalski.md +121 -0
  158. package/src/skills-lib/design-motion-principles/references/jakub-krehel.md +80 -0
  159. package/src/skills-lib/design-motion-principles/references/jhey-tompkins.md +122 -0
  160. package/src/skills-lib/design-motion-principles/references/motion-cookbook.md +529 -0
  161. package/src/skills-lib/design-motion-principles/references/output-format.md +346 -0
  162. package/src/skills-lib/design-motion-principles/references/performance.md +82 -0
  163. package/src/skills-lib/design-motion-principles/references/report-template.html +1006 -0
  164. package/src/skills-lib/design-motion-principles/workflows/audit.md +203 -0
  165. package/src/skills-lib/design-motion-principles/workflows/create.md +87 -0
  166. package/src/skills-lib/web-security/SKILL.md +47 -4
  167. package/src/skills-lib/wizz-router/SKILL.md +4 -1
package/package.json CHANGED
@@ -1,7 +1,7 @@
1
1
  {
2
2
  "$schema": "https://json.schemastore.org/package.json",
3
3
  "name": "wizz-method",
4
- "version": "1.3.2",
4
+ "version": "1.4.0",
5
5
  "description": "Wizz Method — método de agência orientado por IA em PT-BR (fork independente do BMad Method)",
6
6
  "keywords": [
7
7
  "agile",
@@ -76,6 +76,14 @@ areas:
76
76
  when: "Direção de motion/animação, 3D, WebGL, scroll cinematográfico, image-to-video."
77
77
  - id: remotion-best-practices
78
78
  when: "Vídeo programático em React (Remotion) especificamente."
79
+ - id: animate
80
+ when: "Craft de animação/micro-interação: regras do Emil Kowalski (saída > entrada, só transform/opacity, respeitar reduced-motion). Complementa o motion-3d-director com a execução fina. Traz references + exemplos .tsx."
81
+ - id: design-motion-principles
82
+ when: "Auditor de movimento: revisa animação existente e aponta scale(0) no início, easing cru, reduced-motion faltando; pesa contenção/polimento/diversão pelo contexto."
83
+ - id: canvas-design
84
+ when: "Gerar PNG/PDF editável por código (carrossel, quote card, infográfico) com fonte/cor/logo sempre certos. Traz canvas-fonts."
85
+ - id: algorithmic-art
86
+ when: "Visual generativo por código (flow fields, ruído, partículas) para fundo/textura de hero, único a cada render, sem cara de banco de imagem."
79
87
  - id: taste-skill
80
88
  when: "Anti-slop em briefs NOVOS: lê o brief, define a direção e audita contra defaults de AI."
81
89
  - id: taste-redesign
@@ -259,9 +267,9 @@ areas:
259
267
  summary: "Arquitetura, banco, segurança, infra, decisões técnicas."
260
268
  skills:
261
269
  - id: web-security
262
- when: "Auditar segurança web, OWASP, XSS/CSRF/injeção, headers, rate limit, antes de deploy/PR."
270
+ when: "Auditar segurança web, OWASP, XSS/CSRF/injeção/SQLi, IDOR, headers, rate limit (IP+conta), CORS, clickjacking, vazamento de PII na resposta, antes de deploy/PR."
263
271
  - id: auth-and-secrets
264
- when: "Auth (JWT/OAuth/SSO/Clerk), gestão de secrets, rotação de credenciais."
272
+ when: "Auth (JWT/OAuth/SSO/Clerk), token no header vs URL, revogar no logout, enumeração de usuário, gestão de secrets, rotação de credenciais."
265
273
  - id: desktop-security
266
274
  when: "Segurança desktop/Electron (contextIsolation, code signing)."
267
275
  - id: database-scaling
@@ -276,6 +284,8 @@ areas:
276
284
  when: "Dependências/packages, vulnerabilidades, npm audit."
277
285
  - id: supabase-postgres-best-practices
278
286
  when: "Performance e boas práticas de Postgres/Supabase (queries, schema, RLS)."
287
+ - id: ai-product-design
288
+ when: "Construir/melhorar um agente ou produto de IA: escrever/revisar system prompt, definir persona/tom, guardrails e recusas, few-shot, chain-of-thought, orquestração multi-agente, handoff, detecção de frustração, generative UI, avaliar qualidade de saída. Base para desenhar os próprios agentes do método. 44 padrões (Owl-Listener, MIT)."
279
289
  mcps:
280
290
  - id: supabase
281
291
  when: "Operar Supabase de verdade: rodar SQL, migrations, inspecionar schema/RLS, logs."
@@ -0,0 +1,85 @@
1
+ ---
2
+ name: ai-product-design
3
+ description: >
4
+ Design de produtos e agentes de IA: como o agente se comporta, como escrever o prompt/system prompt,
5
+ guardrails e trust/safety, orquestração multi-agente e avaliação. Usar quando: criar ou melhorar um
6
+ agente/assistente/chatbot, escrever ou revisar system prompt, definir persona/tom/voz, montar few-shot,
7
+ chain-of-thought, guardrails, recusas, escalonamento pra humano, handoff entre agentes, detecção de
8
+ frustração, generative UI, ou medir qualidade de saída de IA. Base: Owl-Listener/ai-design-skills (MIT).
9
+ 44 padrões em 6 categorias, cada um detalhado em references/.
10
+ ---
11
+
12
+ # AI Product Design — 44 padrões
13
+
14
+ Biblioteca de padrões pra desenhar **como uma IA/agente se comporta** e **como o prompt dele é escrito**.
15
+ Cada item abaixo tem o texto completo em `references/<categoria>/<nome>/SKILL.md`. Este arquivo é o índice:
16
+ ache o padrão pela intenção, depois abra a reference pro detalhe.
17
+
18
+ > Uso no método: é a base pra construir e revisar os próprios agentes do Wizz Method (os 15 `customize.toml`,
19
+ > system prompts, guardrails, handoffs). Consulte antes de criar/ajustar qualquer agente ou prompt.
20
+
21
+ ## 1. Comportamento do agente (`references/system-behavior-shaping/`)
22
+ Como o agente soa e reage.
23
+ - **persona-architecture** — define personagem, voz e traços uma vez, pra não derivar entre sessões
24
+ - **tone-calibration** — botões de tom por contexto (formalidade, calor, confiança)
25
+ - **emotional-design** — resposta a frustração, confusão, alegria, angústia (valida sem amplificar)
26
+ - **error-personality** — como comunicar erro, incerteza e limite com elegância
27
+ - **behavioral-consistency** — comportar-se previsível entre sessões, edge cases e modalidades
28
+ - **domain-voice** — ajustar o comportamento pra um domínio profissional específico
29
+ - **cultural-adaptation** — adaptar a contexto cultural, idioma e normas
30
+
31
+ ## 2. Interação humano-IA (`references/model-interaction-design/`)
32
+ Como a conversa flui.
33
+ - **conversation-patterns** — turnos, sequências de reparo, checkpoints de alinhamento
34
+ - **frustration-detection** — ler frustração por caps, pontuação, repetição, latência e adaptar
35
+ - **mixed-initiative-flow** — quando o agente lidera vs. quando o usuário lidera, com handoff limpo
36
+ - **progressive-disclosure** — revelar o poder da ferramenta aos poucos, sem afogar no turno 1
37
+ - **generative-ui** — quando renderizar um componente (date picker, card, gráfico) vs. texto puro
38
+ - **multimodal-orchestration** — sequenciar texto, imagem, voz e uso de tool num fluxo só
39
+ - **feedback-loops** — correção do usuário, thumbs, edição inline como sinal que muda o comportamento
40
+ - **context-window-design** — orçamento de tokens, memória, resumir vs. buscar, degradação suave
41
+
42
+ ## 3. Arquitetura de prompt (`references/prompt-architecture/`)
43
+ Como o prompt é escrito. **A camada mais direta pra melhorar agentes.**
44
+ - **system-prompt-structure** — anatomia: identidade, contexto, regras, formato, exemplos (o que importa no começo/fim)
45
+ - **constraint-specification** — limites testáveis: formato, tamanho, tom, conteúdo proibido
46
+ - **few-shot-patterns** — exemplos que miram os erros que o modelo insiste em cometer
47
+ - **chain-of-thought-design** — cadeias de raciocínio deliberadas pra tarefa de vários passos
48
+ - **template-design** — templates parametrizados com variáveis nomeadas e seções condicionais
49
+ - **context-engineering** — o que entra no contexto e em que ordem
50
+ - **prompt-versioning** — versionar prompts, testar mudanças, rastrear o que funciona
51
+
52
+ ## 4. Trust & Safety (`references/ai-alignment-reasoning/`)
53
+ O que o agente pode e não pode; como não enganar o usuário.
54
+ - **guardrail-design** — limites de comportamento e padrões de recusa explícitos (o "pode/não pode")
55
+ - **transparency-patterns** — mostrar o que o modelo sabe, não sabe e o quão certo está
56
+ - **trust-calibration** — nem overtrust nem undertrust; sinalizar incerteza em vez de blefar
57
+ - **escalation-design** — quando escalar pra humano, recusar, ou pedir esclarecimento
58
+ - **harm-anticipation** — mapear failure modes, mau uso e consequências não intencionais
59
+ - **value-specification** — traduzir valores da organização em constraints do sistema
60
+ - **consent-and-agency** — consentimento informado, opt-out e override humano
61
+ - **bias-detection-design** — workflows de review pra achar e mitigar viés
62
+
63
+ ## 5. Orquestração multi-agente (`references/design-agent-orchestration/`)
64
+ Pra sistemas com vários agentes (o caso do próprio método: Diretor → maestro → agentes).
65
+ - **agent-role-design** — o que cada agente faz, sabe e é dono num sistema multi-agente
66
+ - **task-decomposition** — quebrar objetivo complexo em subtarefas que os agentes resolvem
67
+ - **handoff-protocols** — transições suaves entre agentes e entre IA e humano
68
+ - **state-management** — contexto, memória e estado compartilhados entre agentes
69
+ - **human-in-the-loop** — pontos de intervenção onde o humano revisa, aprova ou redireciona
70
+ - **failure-recovery** — quando um agente falha: retry, fallback, escalar, degradação suave
71
+ - **observability-design** — tornar o workflow multi-agente visível e debugável
72
+
73
+ ## 6. Avaliação (`references/evaluation/`)
74
+ Como saber se a IA está boa.
75
+ - **output-quality-rubrics** — definir o que é "bom": acurácia, relevância, utilidade
76
+ - **task-success-metrics** — medir se a IA de fato ajudou o usuário a concluir a meta
77
+ - **user-satisfaction-signals** — ler sinais implícitos/explícitos: edições, regenerações, abandono
78
+ - **failure-taxonomy** — classificar falhas: alucinação, recusa, irrelevância, tom errado, latência
79
+ - **comparative-evaluation** — A/B, comparação lado a lado, ranking de preferência
80
+ - **heuristic-evaluation-ai** — heurísticas de Nielsen adaptadas + heurísticas próprias de IA
81
+ - **longitudinal-measurement** — qualidade ao longo do tempo: drift, degradação, melhoria
82
+
83
+ ---
84
+
85
+ **Créditos:** Owl-Listener/ai-design-skills (licença MIT, ver `references/LICENSE`). Índice traduzido/curado para o Wizz Method.
@@ -0,0 +1,21 @@
1
+ MIT License
2
+
3
+ Copyright (c) 2026 MC Dean
4
+
5
+ Permission is hereby granted, free of charge, to any person obtaining a copy
6
+ of this software and associated documentation files (the "Software"), to deal
7
+ in the Software without restriction, including without limitation the rights
8
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9
+ copies of the Software, and to permit persons to whom the Software is
10
+ furnished to do so, subject to the following conditions:
11
+
12
+ The above copyright notice and this permission notice shall be included in all
13
+ copies or substantial portions of the Software.
14
+
15
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21
+ SOFTWARE.
@@ -0,0 +1,37 @@
1
+ ---
2
+ name: bias-detection-design
3
+ description: Designing review workflows to surface and mitigate bias in AI outputs.
4
+ ---
5
+ # Bias Detection Design
6
+ AI systems inherit biases from training data, amplify them through pattern-matching, and embed them in outputs that appear authoritative. Bias detection design creates the workflows, processes, and interfaces that help teams find and fix bias before users encounter it.
7
+ ## Types of Bias in AI Products
8
+ - **Representation bias**: Some groups are overrepresented or underrepresented in outputs (images, examples, personas)
9
+ - **Performance bias**: The AI works better for some users than others (languages, accents, cultural contexts)
10
+ - **Framing bias**: The AI presents information in ways that favour certain perspectives
11
+ - **Allocation bias**: AI-driven decisions distribute resources or opportunities unevenly
12
+ - **Association bias**: The AI links concepts in stereotypical ways
13
+ ## Designing Bias Detection Workflows
14
+ Bias detection is a team practice, not a one-time audit:
15
+ - **Regular review cycles**: Schedule periodic reviews of AI outputs for bias patterns
16
+ - **Diverse review panels**: Include reviewers from different backgrounds, cultures, and perspectives
17
+ - **Structured evaluation**: Use rubrics and checklists, not intuition
18
+ - **Real-world sampling**: Test with real user inputs, not just curated test cases
19
+ - **Longitudinal monitoring**: Bias can emerge over time as usage patterns change
20
+ ## Detection Methods
21
+ - **Comparative testing**: Give the AI the same task with different demographic variables. Compare outputs.
22
+ - **Edge case exploration**: Test inputs from underrepresented groups or unusual contexts.
23
+ - **Output auditing**: Review a sample of real outputs for patterns of bias.
24
+ - **User feedback analysis**: Look for bias-related complaints or differential satisfaction.
25
+ - **Benchmark evaluation**: Test against established fairness benchmarks for the domain.
26
+ ## From Detection to Mitigation
27
+ Finding bias is step one. Addressing it requires:
28
+ - **Root cause analysis**: Is the bias in training data, prompt design, model architecture, or product design?
29
+ - **Mitigation options**: Retraining, prompt adjustment, output filtering, user controls, or design changes
30
+ - **Tradeoff analysis**: Fixing one bias might introduce another. Document the tradeoffs.
31
+ - **Verification**: After mitigation, verify the fix worked without creating new problems.
32
+ ## Design Artefacts
33
+ - Bias audit checklists per feature
34
+ - Review panel composition guidelines
35
+ - Comparative testing protocols
36
+ - Bias incident documentation templates
37
+ - Mitigation tracking logs
@@ -0,0 +1,37 @@
1
+ ---
2
+ name: consent-and-agency
3
+ description: Designing for informed user consent, opt-out, and human override.
4
+ ---
5
+ # Consent and Agency
6
+ AI products make decisions, take actions, and process information on behalf of users. Consent and agency design ensures users remain in control — understanding what the AI does, agreeing to it, and being able to override it.
7
+ ## Informed Consent for AI
8
+ Users should understand and agree to:
9
+ - **What data the AI uses**: Conversation history, personal data, uploaded documents, browsing behaviour
10
+ - **What the AI does with it**: Training, personalisation, sharing with third parties, storage
11
+ - **What actions the AI takes**: Sending messages, making changes, accessing systems
12
+ - **What the AI can't do**: Limitations that might affect the user's expectations
13
+ Consent is not a checkbox at sign-up. It's an ongoing design challenge throughout the experience.
14
+ ## Designing for Agency
15
+ Agency means the user feels — and is — in control:
16
+ - **Opt-in over opt-out**: AI features should be activated by the user, not imposed
17
+ - **Reversibility**: AI actions should be undoable wherever possible
18
+ - **Override mechanisms**: The user can always stop, redirect, or override the AI
19
+ - **Exit paths**: The user can disengage from AI assistance at any point without penalty
20
+ - **Preference controls**: The user can adjust AI behaviour, scope, and autonomy levels
21
+ ## Consent Patterns
22
+ - **Progressive consent**: Ask for permission incrementally as new capabilities are needed, not all at once
23
+ - **Contextual consent**: Ask at the moment the action is about to happen, not in advance
24
+ - **Granular consent**: Let users consent to specific actions or data uses, not blanket permissions
25
+ - **Revocable consent**: Users can withdraw consent and have that withdrawal take effect
26
+ ## Agency Anti-Patterns
27
+ - **Dark patterns**: Making it hard to opt out or override the AI
28
+ - **Consent fatigue**: Asking for permission so often that users click through without reading
29
+ - **Learned helplessness**: AI does so much that users forget how to do things themselves
30
+ - **Invisible actions**: The AI takes actions the user doesn't know about
31
+ - **Irreversible defaults**: AI actions that can't be undone without user awareness
32
+ ## Design Artefacts
33
+ - Consent flow diagrams per feature
34
+ - Agency checkpoint specifications
35
+ - Override mechanism inventory
36
+ - Data use transparency matrix
37
+ - Opt-out path designs
@@ -0,0 +1,40 @@
1
+ ---
2
+ name: escalation-design
3
+ description: When and how AI should escalate to humans, refuse, or ask for clarification.
4
+ ---
5
+ # Escalation Design
6
+ Escalation is what happens when the AI reaches the boundary of what it should handle alone. Designing escalation well means the user gets help instead of a dead end — and the AI knows its limits.
7
+ ## Escalation Triggers
8
+ The AI should escalate when:
9
+ - **Confidence is low**: The AI isn't sure its output is correct or helpful
10
+ - **Stakes are high**: The decision has significant consequences (financial, medical, legal, safety)
11
+ - **Emotional distress**: The user shows signs of crisis, distress, or vulnerability
12
+ - **Ambiguity is unresolvable**: The AI can't determine intent even after clarification
13
+ - **Scope boundary**: The request is outside what the AI is designed to handle
14
+ - **Policy boundary**: The request approaches or crosses a guardrail
15
+ - **Conflict**: The user disagrees with the AI and the disagreement can't be resolved
16
+ ## Escalation Types
17
+ - **To human support**: Transfer to a human agent with full context
18
+ - **To the user themselves**: "This decision is yours to make" — handing back agency
19
+ - **To a specialist**: Routing to domain-specific help (medical, legal, technical)
20
+ - **To a supervisor/admin**: Flagging for organisational review
21
+ - **Self-escalation**: The AI flags its own output for review before delivering it
22
+ ## Designing the Escalation Experience
23
+ The user's experience of escalation matters:
24
+ - **Context transfer**: When escalating to a human, pass the full conversation. Don't make the user repeat themselves.
25
+ - **Warm handoff**: "I'm connecting you with someone who can help with this" — not a cold redirect.
26
+ - **Expectation setting**: Tell the user what will happen next and how long it might take.
27
+ - **Graceful degradation**: If no human is available, offer alternatives — not a dead end.
28
+ - **Dignity**: Never make the user feel stupid for needing escalation.
29
+ ## Escalation Anti-Patterns
30
+ - **The infinite loop**: AI keeps trying instead of escalating, frustrating the user
31
+ - **Premature escalation**: AI escalates when it could easily handle the request, annoying the user
32
+ - **Context loss**: User has to start over after escalation
33
+ - **Blame shifting**: AI implies the user caused the problem
34
+ - **Hidden escalation**: Escalation happens without the user knowing
35
+ ## Design Artefacts
36
+ - Escalation trigger matrix: Trigger | Threshold | Escalation Type | User Experience
37
+ - Escalation flow diagrams per feature
38
+ - Context handoff specifications
39
+ - Fallback path designs for when escalation isn't available
40
+ - Escalation quality metrics
@@ -0,0 +1,36 @@
1
+ ---
2
+ name: guardrail-design
3
+ description: Defining behavioral boundaries — what the AI should and shouldn't do.
4
+ ---
5
+ # Guardrail Design
6
+ Guardrails are the behavioral boundaries that define what an AI product will and won't do. They're not just safety constraints — they're design decisions that shape the entire user experience.
7
+ ## Types of Guardrails
8
+ - **Content guardrails**: What topics the AI will and won't discuss. What it generates and refuses to generate.
9
+ - **Action guardrails**: What the AI can do in the world — send emails, make purchases, delete data — and what requires human approval.
10
+ - **Tone guardrails**: How the AI communicates — what language it uses, how formal or casual, when it's direct vs. diplomatic.
11
+ - **Scope guardrails**: What the AI considers in and out of scope for its role. A coding assistant shouldn't give medical advice.
12
+ - **Confidence guardrails**: When the AI should express uncertainty, hedge, or refuse rather than guessing.
13
+ ## Designing Guardrails as Product Decisions
14
+ Every guardrail is a product decision with tradeoffs:
15
+ - **Too strict**: The product feels limited, frustrating, and paternalistic. Users route around the guardrails.
16
+ - **Too loose**: The product causes harm, loses trust, and creates liability.
17
+ - **Inconsistent**: Users can't predict what the AI will and won't do, eroding trust.
18
+ The goal is guardrails that feel like good judgment, not arbitrary restrictions.
19
+ ## Guardrail Specification
20
+ For each guardrail, define:
21
+ - **What it prevents**: The specific behavior or output being constrained
22
+ - **Why it exists**: The harm it prevents or the value it protects
23
+ - **How it manifests**: What the user sees when the guardrail activates (refusal message, alternative suggestion, escalation)
24
+ - **Edge cases**: Grey areas where the guardrail might be too strict or too loose
25
+ - **Override conditions**: Whether and how the guardrail can be relaxed (admin settings, user confirmation, context-dependent)
26
+ ## Guardrail Communication
27
+ How the AI communicates a guardrail matters as much as the guardrail itself:
28
+ - **Transparent refusal**: "I can't help with that because..." — honest about the boundary
29
+ - **Redirective refusal**: "I can't do X, but I can help you with Y" — offering alternatives
30
+ - **Silent guardrail**: The AI steers away from the boundary without mentioning it
31
+ - **Escalation**: "This needs a human to review" — handing off rather than refusing
32
+ ## Design Artefacts
33
+ - Guardrail specification table: Category | Rule | Rationale | User Experience | Edge Cases
34
+ - Refusal message templates per guardrail type
35
+ - Guardrail severity tiers (hard block vs. soft warning vs. nudge)
36
+ - Testing scenarios for each guardrail
@@ -0,0 +1,108 @@
1
+ ---
2
+ name: harm-anticipation
3
+ description: Proactively identifying failure modes, misuse, and unintended consequences.
4
+ ---
5
+ # Harm Anticipation
6
+
7
+ Harm anticipation is systematically thinking through how an AI product could cause harm — before it does. Preventive design, not reactive crisis management.
8
+
9
+ The work is unglamorous and easy to skip. Done well, it produces specific testable mitigations. Done badly, it produces a doc nobody reads.
10
+
11
+ ## Categories of AI harm
12
+
13
+ - **Direct harm**: the AI outputs something harmful — dangerous advice, discriminatory content, privacy violations
14
+ - **Facilitated harm**: the AI helps a user do something harmful, even if the AI's output itself is benign
15
+ - **Emergent harm**: harmful patterns from scale or interaction effects, not from any single output
16
+ - **Omission harm**: the AI fails to act when it should — not flagging a crisis, not escalating
17
+ - **Erosion harm**: gradual negative effects — dependency, deskilling, manipulation, trust erosion
18
+
19
+ ## Structured anticipation
20
+
21
+ Work through each harm category with five lenses:
22
+
23
+ 1. **Who could be harmed?** The user, people the user interacts with, vulnerable populations, society at large.
24
+ 2. **How could they be harmed?** Physical, emotional, financial, reputational, privacy, autonomy.
25
+ 3. **What's the likelihood?** Common use case vs. edge case vs. adversarial attack.
26
+ 4. **What's the severity?** Inconvenience vs. distress vs. irreversible damage.
27
+ 5. **What's the detectability?** Obvious and immediate vs. subtle and delayed.
28
+
29
+ ## Misuse scenarios
30
+
31
+ Think like an adversary:
32
+
33
+ - How would someone deliberately misuse this feature?
34
+ - What's the easiest way to extract harmful output?
35
+ - Could this be used to manipulate, deceive, or coerce?
36
+ - What if the user lies about their intent?
37
+ - What happens at scale, automated?
38
+
39
+ ## Unintended consequences
40
+
41
+ Think second-order:
42
+
43
+ - What happens at millions of users?
44
+ - What skills do users lose by relying on this?
45
+ - Could this create unfair advantages or disadvantages?
46
+ - What power dynamics shift?
47
+ - What becomes possible that wasn't before — for better and worse?
48
+
49
+ ## Decision rules
50
+
51
+ - **Score by frequency × severity, not severity alone.** A common moderate harm beats a rare catastrophic one in cumulative impact, almost every time. Teams chronically over-weight catastrophic-rare and under-weight chronic-moderate.
52
+ - **Each harm needs a falsifiable test.** "If the AI does X to user type Y, the system should Z." If you can't write the test, you haven't specified the harm precisely enough — refine before mitigating.
53
+ - **Mitigate at the lowest layer that works.** Filtering output is weaker than constraining the prompt; constraining the prompt is weaker than scoping the feature; scoping the feature is weaker than not building it.
54
+ - **Re-anticipate after each scale jump.** Harms at 1k users differ from 100k differ from 10M. The same checklist gives different answers at each tier.
55
+ - **Vulnerable users define the floor, not the ceiling.** If the worst-off user is well-served, others will be too. Designing for the median user with edge-case patches is the wrong shape.
56
+ - **Prefer reversible mitigations during the discovery phase.** Lock-in early and you'll be scared to revisit assumptions.
57
+
58
+ ## Anti-patterns
59
+
60
+ - **Pre-mortem theatre**: writing the harm anticipation doc as a deliverable, then never opening it again. The doc is the artefact; the practice is the value.
61
+ - **Worst-case-only thinking**: only catastrophic harms get attention. Moderate-frequency moderate-severity harms accumulate unaddressed and become the actual product story.
62
+ - **Adversary-only framing**: anticipating bad actors but missing harms from well-intentioned users in unexpected contexts (the helpful suicide-line responder, the well-meaning legal advice giver).
63
+ - **Mitigation-by-checklist**: treating harms as boxes to tick rather than ongoing design constraints. Once boxed, the harm is "handled" until it isn't.
64
+ - **Externalised liability**: "the user agreed to ToS, we're covered." Liability ≠ harm reduction. Users are still hurt; the company is just protected.
65
+ - **Single-axis thinking**: anticipating along one harm category and missing intersections. "We checked for bias and we checked for privacy" — but bias × privacy at intersection is its own failure mode.
66
+ - **Optimist's mitigation**: writing mitigations that depend on the user noticing, the user reporting, the AI detecting. If the mitigation requires a working sensor, audit whether the sensor actually works.
67
+
68
+ ## When not to use this
69
+
70
+ - **For routine UX paper-cuts** (slow loads, awkward copy) — reach for `failure-taxonomy` or `user-satisfaction-signals` instead. Harm anticipation is for *consequences*, not friction.
71
+ - **For purely technical reliability** (latency, uptime) — those are SRE concerns; harm anticipation is the product-level layer above them.
72
+ - **In place of red-teaming** — anticipation is a planning activity; red-teaming is a probing activity. Both, not either.
73
+ - **As a one-off audit at launch** — the anticipation that catches harms is the one done continuously, especially after each significant change.
74
+
75
+ ## See also
76
+
77
+ - `trust-calibration` — overtrust is itself a harm category; calibrated trust is one of the strongest mitigations.
78
+ - `escalation-design` — many harms are mitigated by *not handling it alone*. Anticipation surfaces the trigger; escalation handles the moment.
79
+ - `bias-detection-design` — bias is a harm category with its own dedicated detection methodology; reach for that skill once you've identified bias risks here.
80
+ - `value-specification` — harm anticipation populates the constraints; value specification arbitrates between them when they conflict.
81
+ - `guardrail-design` — anticipation produces the requirements; guardrail-design is the mechanism.
82
+
83
+ ## Design Artefacts
84
+
85
+ - Harm anticipation matrix
86
+ - Misuse scenario catalogue
87
+ - Pre-mortem analysis documents
88
+ - Risk-severity heatmaps for product features
89
+ - Mitigation tracking log with pass/fail tests per harm
90
+
91
+ Worked example — one row of the harm anticipation matrix for an AI mental-health-support chatbot:
92
+
93
+ | Field | Value |
94
+ | --- | --- |
95
+ | Scenario | User in acute crisis (suicidal ideation language) asks for advice. |
96
+ | Harm category | Omission harm + Direct harm. |
97
+ | Who is harmed | The user, their dependents. |
98
+ | How | AI provides general advice without recognising crisis; user delays seeking emergency help. |
99
+ | Likelihood | Medium — crisis users are a minority of usage but represent peak-stakes interactions. |
100
+ | Severity | Catastrophic, irreversible. |
101
+ | Detectability | Low at the per-interaction level (no obvious bad output); medium retrospectively (post-incident review). |
102
+ | Mitigation | Crisis-marker classifier on user input; on detection, replace the AI response with hardcoded crisis-line copy + warm handoff to human counsellor. Falsifiable test: red-team prompts containing 30 documented crisis-language patterns; 100% must trigger the override. |
103
+ | Mitigation strength | Lower-layer than output filtering — replaces the response entirely rather than scrubbing. |
104
+ | Re-anticipate at | 10× user growth, model version change, language expansion. |
105
+
106
+ The mitigation has a test. The test is run on every model update. That makes the harm anticipation a living constraint, not a doc.
107
+
108
+ Adapted from work on responsible AI deployment (Raji et al. on closing the AI accountability gap; Weidinger et al. on taxonomies of risk from language models) and pre-mortem methodology from cognitive psychology (Klein on prospective hindsight).
@@ -0,0 +1,36 @@
1
+ ---
2
+ name: transparency-patterns
3
+ description: Showing users what the AI knows, doesn't know, and how confident it is.
4
+ ---
5
+ # Transparency Patterns
6
+ Transparency in AI products means making the system's knowledge, limitations, and confidence visible to users. It's how you build warranted trust — trust based on understanding, not blind faith.
7
+ ## What to Make Transparent
8
+ - **Source**: Where did the AI get this information? Training data, retrieved documents, user input, inference?
9
+ - **Confidence**: How certain is the AI? Is this a well-supported answer or a best guess?
10
+ - **Limitations**: What doesn't the AI know? What can't it do? Where does its knowledge end?
11
+ - **Process**: How did the AI arrive at this output? What steps did it take?
12
+ - **Identity**: This is an AI, not a human. Never obscure this.
13
+ ## Transparency Patterns
14
+ - **Confidence indicators**: Visual or textual signals of certainty ("I'm fairly confident" vs. "I'm not sure about this")
15
+ - **Source attribution**: Citing where information came from
16
+ - **Reasoning traces**: Showing the AI's step-by-step thinking
17
+ - **Limitation disclosure**: Proactively stating what the AI can't do or doesn't know
18
+ - **Model cards**: High-level descriptions of what the AI is, how it works, and what it's good and bad at
19
+ - **Uncertainty highlighting**: Visually distinguishing confident outputs from uncertain ones
20
+ ## Calibrating Transparency
21
+ Too much transparency overwhelms. Too little erodes trust. Calibrate by:
22
+ - **User expertise**: Experts want more detail. Novices want simple signals.
23
+ - **Task stakes**: High-stakes decisions need full transparency. Low-stakes interactions need less.
24
+ - **Output confidence**: Show more transparency when the AI is uncertain, less when it's confident.
25
+ - **User request**: Let users drill into details on demand rather than showing everything upfront.
26
+ ## Transparency Anti-Patterns
27
+ - **Performative transparency**: Showing a reasoning trace that doesn't actually explain the decision
28
+ - **Buried disclaimers**: Putting limitations in fine print nobody reads
29
+ - **False confidence**: The AI sounds certain when it's guessing
30
+ - **Opaque refusal**: "I can't help with that" with no explanation
31
+ - **Transparency theatre**: Making the system look transparent without actually being informative
32
+ ## Design Artefacts
33
+ - Transparency level specifications per feature
34
+ - Confidence communication guidelines
35
+ - Source attribution patterns
36
+ - Limitation disclosure templates
@@ -0,0 +1,102 @@
1
+ ---
2
+ name: trust-calibration
3
+ description: Helping users form warranted trust in the AI — neither overtrust nor undertrust — through deliberate confidence and source signalling.
4
+ ---
5
+ # Trust Calibration
6
+
7
+ Calibrated trust is the difference between an AI that augments user judgment and one that displaces it. Overtrust causes harm when the AI is wrong. Undertrust wastes the AI when it's right. Both failure modes are common, and neither shows up in standard accuracy metrics.
8
+
9
+ Designing for trust means giving users the information they need to update their trust appropriately, turn by turn.
10
+
11
+ ## What shapes user trust in the moment
12
+
13
+ - **Surface confidence** — how certain the AI sounds, regardless of whether it should
14
+ - **Track record** — prior interactions in this and previous sessions
15
+ - **Stakes legibility** — how clearly the user understands what could go wrong
16
+ - **Source visibility** — whether the AI shows reasoning, sources, or alternatives
17
+ - **Persona fit** — a "professional" persona gets more trust than a "friendly" one for the same content
18
+
19
+ These shape trust whether you design for them or not. Designing for them deliberately is what trust calibration is.
20
+
21
+ ## Trust failure modes
22
+
23
+ - **Sycophancy-driven overtrust**: AI tells the user what they want to hear; user trusts the agreement and acts on it
24
+ - **Confidence-mismatch overtrust**: AI sounds certain about something it shouldn't be (hallucinations, edge cases)
25
+ - **Defensive undertrust**: AI hedges everything ("might be", "could possibly") even when right; user tunes out the qualifier
26
+ - **Authority-collapse undertrust**: one wrong answer in a high-stakes context destroys trust for the whole product
27
+ - **Trust laundering**: low-confidence outputs presented with high-confidence formatting (bold headers, decisive bullets) — visual authority disconnected from epistemic authority
28
+
29
+ ## Calibration signals from the AI side
30
+
31
+ The AI shapes trust deliberately through:
32
+
33
+ - **Confidence markers proportionate to actual epistemic state**: "I'm fairly sure" / "I'd verify this" / "I don't know" — used because they're true, not as decoration
34
+ - **Source attribution**: "According to [X]" rather than unsourced assertion. Cite when possible; flag the gap when not.
35
+ - **Alternative surfacing**: "Two interpretations: A and B. I went with A because…" — shows the model's working
36
+ - **Failure transparency**: "I got that wrong earlier — here's the correction." Long-term trust gain at short-term cost.
37
+ - **Capability fence-posting**: "I can help with X but not Y." Defines the boundary so trust isn't tested in the wrong place.
38
+
39
+ ## Calibration signals from the user side
40
+
41
+ Trust is two-way. The AI also helps the user calibrate:
42
+
43
+ - **Showing the cost of being wrong**: "If this is wrong, you'd want to verify against [source] before [action]"
44
+ - **Recommending verification thresholds**: "Low-stakes: this is probably fine. High-stakes: double-check."
45
+ - **Acknowledging variance**: "This worked for most users in your situation; yours may differ."
46
+
47
+ ## Decision rules
48
+
49
+ - **High stakes + low confidence → bias toward undertrust by default.** The cost of an action on bad info exceeds the cost of an extra verification step.
50
+ - **If the user has corrected the AI in this session, raise hedging on similar outputs for the rest of the session.** *Show* the AI updating.
51
+ - **Never inflate confidence to match the user's apparent expectation.** Sycophancy is the worst trust failure because it compounds across turns.
52
+ - **Prefer "I don't know" over a confident wrong answer.** The trust cost of "I don't know" is lower than the trust cost of being caught wrong.
53
+ - **If the AI must guess, flag it.** "Best guess: X. Reasoning: Y. Confidence: low — verify if this matters."
54
+ - **If the AI changes position based on user pushback, name the update.** Silent flips destroy trust faster than disagreement does.
55
+
56
+ ## Anti-patterns
57
+
58
+ - **Universal hedging**: every output ends with "but you should verify". The qualifier loses signal and reads as legal cover.
59
+ - **Confidence theatre**: bold formatting, decisive language, perfect grammar applied to outputs the AI is uncertain about. Visual confidence ≠ epistemic confidence.
60
+ - **Apology as trust-building**: over-apologising for errors signals incompetence, not calibration. One clean acknowledgement is more trustworthy than five.
61
+ - **Personality-driven confidence**: the AI's persona dictates its confidence level rather than its actual epistemic state ("I'm a confident assistant!").
62
+ - **Silent updating**: the AI changes position on user pushback without flagging it. Users notice; trust drops sharply.
63
+ - **Trust transfer by association**: "Anthropic-built" / "GPT-4-powered" framed as a quality guarantee. Pedigree ≠ correctness in a specific case.
64
+
65
+ ## When not to use this
66
+
67
+ - **Low-stakes recreational AI** (creative writing, brainstorming) where calibrated trust isn't the operating mode. Reach for `tone-calibration` or `progressive-disclosure` instead.
68
+ - **Deterministic-output products** (code formatting, image conversion) where outputs are checkable directly. Verification is cheap; trust calibration matters less.
69
+ - **First-touch onboarding**, where the user has no prior relationship. Trust builds through repeated interaction, not through hedges in turn one.
70
+
71
+ ## See also
72
+
73
+ - `transparency-patterns` — the operational mechanism (showing reasoning, sources, alternatives). Trust calibration is the *outcome*; transparency is one *tool*.
74
+ - `error-personality` — how the AI handles being wrong is the highest-leverage trust signal in the product.
75
+ - `consent-and-agency` — closely related: trust calibration without preserved user agency tips into manipulation.
76
+ - `escalation-design` — knowing when to hand off is itself a trust-building behaviour ("I won't pretend to handle this").
77
+
78
+ ## Design Artefacts
79
+
80
+ A trust calibration matrix:
81
+
82
+ | Stakes | AI confidence | Recommended language |
83
+ | --- | --- | --- |
84
+ | Low | Low | "Best guess: X. Easy to check by [Y]." |
85
+ | Low | High | Direct answer, no hedge. |
86
+ | Medium | Low | "I'd suggest X based on [Y]. If your situation differs, talk to [Z]." |
87
+ | Medium | High | Direct answer + one-line source. |
88
+ | High | Low | "I'm not the right tool for this. Try [Z]." |
89
+ | High | High | Direct answer + source + recommended verification step. |
90
+
91
+ Worked example:
92
+ - User asks an AI assistant: "is it safe to take ibuprofen with my blood thinner?"
93
+ - Stakes: high. AI confidence: low (medical question without patient record).
94
+ - Response: "I can't give medical advice on drug interactions — for blood thinners specifically the answer depends on which one and your dosage. Please ask your prescriber or call a pharmacist; many have free phone consults."
95
+
96
+ Other artefacts:
97
+ - A confidence-language rubric: a banned-phrase list ("I'm 100% sure", "always", "never" without justification) and an approved-phrase set tied to confidence levels
98
+ - Sycophancy stress tests: inputs designed to elicit agreement; measure whether expressed confidence inflates when the user pushes
99
+ - A trust-loss audit: classify sessions where users push back as "AI right, user wrong" / "AI wrong, user right" / "ambiguous". Track AI behaviour across categories — does it cave to pushback even when right?
100
+ - Persona-confidence audit: hold the same factual claim constant; vary the persona; measure perceived authority. Tune until persona doesn't drive trust independent of content.
101
+
102
+ Adapted from research on calibrated trust in human-AI teams (Lee & See 2004 on appropriate reliance; Lai et al. on trust in machine learning systems).
@@ -0,0 +1,39 @@
1
+ ---
2
+ name: value-specification
3
+ description: Translating organisational values and user expectations into system constraints.
4
+ ---
5
+ # Value Specification
6
+ Values are abstract. AI systems need concrete rules. Value specification is the design work of translating organisational principles and user expectations into implementable constraints.
7
+ ## The Translation Problem
8
+ Organisations say things like "be helpful" and "be responsible." These are useless as system constraints because they conflict:
9
+ - Being maximally helpful might mean giving dangerous information
10
+ - Being maximally responsible might mean refusing to help at all
11
+ - Being "fair" means different things in different contexts
12
+ The designer's job is to resolve these tensions into specific, testable rules.
13
+ ## Value Hierarchy
14
+ Not all values are equal. Establish a hierarchy:
15
+ 1. **Safety**: Prevent harm to users and others. This overrides everything.
16
+ 2. **Accuracy**: Don't mislead. When uncertain, say so.
17
+ 3. **Helpfulness**: Actually accomplish what the user needs.
18
+ 4. **Respect**: Treat users as capable adults. Don't patronise.
19
+ 5. **Brand alignment**: Reflect the organisation's identity and tone.
20
+ When values conflict, the hierarchy resolves the conflict. A safety concern overrides helpfulness. Accuracy overrides brand voice.
21
+ ## From Values to Rules
22
+ For each value, derive concrete rules:
23
+ - **Value**: "We respect user autonomy"
24
+ - **Rule**: "Always present options rather than making decisions for the user"
25
+ - **Implementation**: When the AI has multiple valid approaches, present them as choices with tradeoffs rather than picking one
26
+ - **Test**: Give the AI an ambiguous request. Does it ask the user to choose, or decide unilaterally?
27
+ ## Stakeholder Alignment
28
+ Different stakeholders have different value priorities:
29
+ - **Users** want helpfulness and speed
30
+ - **Legal** wants compliance and liability protection
31
+ - **Brand** wants consistency and tone
32
+ - **Ethics** wants fairness and transparency
33
+ - **Engineering** wants feasibility and maintainability
34
+ The designer mediates between these perspectives and produces a unified specification.
35
+ ## Design Artefacts
36
+ - Value hierarchy document with conflict resolution rules
37
+ - Value-to-rule mapping table
38
+ - Stakeholder value alignment matrix
39
+ - Test cases derived from value specifications