@codyswann/lisa 2.110.1 → 2.112.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (193) hide show
  1. package/package.json +1 -1
  2. package/plugins/lisa/.claude-plugin/plugin.json +1 -1
  3. package/plugins/lisa/.codex-plugin/plugin.json +1 -1
  4. package/plugins/lisa/commands/repair-intake.md +2 -2
  5. package/plugins/lisa/rules/config-resolution.md +2 -2
  6. package/plugins/lisa/skills/repair-intake/SKILL.md +86 -9
  7. package/plugins/lisa-cdk/.claude-plugin/plugin.json +1 -1
  8. package/plugins/lisa-cdk/.codex-plugin/plugin.json +1 -1
  9. package/plugins/lisa-expo/.claude-plugin/plugin.json +1 -1
  10. package/plugins/lisa-expo/.codex-plugin/plugin.json +1 -1
  11. package/plugins/lisa-expo/.mcp.json +3 -3
  12. package/plugins/lisa-expo/THIRD-PARTY-NOTICES.md +57 -0
  13. package/plugins/lisa-expo/commands/e2e-coverage-gaps.md +7 -0
  14. package/plugins/lisa-expo/commands/exploratory-qa.md +2 -2
  15. package/plugins/lisa-expo/skills/add-app-clip/SKILL.md +280 -0
  16. package/plugins/lisa-expo/skills/add-app-clip/agents/openai.yaml +4 -0
  17. package/plugins/lisa-expo/skills/add-app-clip/references/native-module.md +96 -0
  18. package/plugins/lisa-expo/skills/building-native-ui/SKILL.md +321 -0
  19. package/plugins/lisa-expo/skills/building-native-ui/agents/openai.yaml +4 -0
  20. package/plugins/lisa-expo/skills/building-native-ui/references/animations.md +220 -0
  21. package/plugins/lisa-expo/skills/building-native-ui/references/controls.md +272 -0
  22. package/plugins/lisa-expo/skills/building-native-ui/references/form-sheet.md +253 -0
  23. package/plugins/lisa-expo/skills/building-native-ui/references/gradients.md +106 -0
  24. package/plugins/lisa-expo/skills/building-native-ui/references/icons.md +213 -0
  25. package/plugins/lisa-expo/skills/building-native-ui/references/media.md +198 -0
  26. package/plugins/lisa-expo/skills/building-native-ui/references/route-structure.md +229 -0
  27. package/plugins/lisa-expo/skills/building-native-ui/references/search.md +248 -0
  28. package/plugins/lisa-expo/skills/building-native-ui/references/storage.md +121 -0
  29. package/plugins/lisa-expo/skills/building-native-ui/references/tabs.md +433 -0
  30. package/plugins/lisa-expo/skills/building-native-ui/references/toolbar-and-headers.md +284 -0
  31. package/plugins/lisa-expo/skills/building-native-ui/references/visual-effects.md +197 -0
  32. package/plugins/lisa-expo/skills/building-native-ui/references/webgpu-three.md +605 -0
  33. package/plugins/lisa-expo/skills/building-native-ui/references/zoom-transitions.md +158 -0
  34. package/plugins/lisa-expo/skills/e2e-coverage-gaps/SKILL.md +105 -0
  35. package/plugins/lisa-expo/skills/e2e-coverage-gaps/agents/openai.yaml +4 -0
  36. package/plugins/lisa-expo/skills/eas-update-insights/SKILL.md +228 -0
  37. package/plugins/lisa-expo/skills/eas-update-insights/agents/openai.yaml +4 -0
  38. package/plugins/lisa-expo/skills/eas-update-insights/references/channel-insights-schema.md +47 -0
  39. package/plugins/lisa-expo/skills/eas-update-insights/references/update-insights-schema.md +69 -0
  40. package/plugins/lisa-expo/skills/exploratory-qa/SKILL.md +100 -93
  41. package/plugins/lisa-expo/skills/exploratory-qa/agents/openai.yaml +2 -2
  42. package/plugins/lisa-expo/skills/expo-api-routes/SKILL.md +369 -0
  43. package/plugins/lisa-expo/skills/expo-api-routes/agents/openai.yaml +4 -0
  44. package/plugins/lisa-expo/skills/expo-brownfield/SKILL.md +54 -0
  45. package/plugins/lisa-expo/skills/expo-brownfield/agents/openai.yaml +4 -0
  46. package/plugins/lisa-expo/skills/expo-brownfield/references/brownfield-integrated.md +526 -0
  47. package/plugins/lisa-expo/skills/expo-brownfield/references/brownfield-isolated.md +402 -0
  48. package/plugins/lisa-expo/skills/expo-brownfield/references/comparison.md +63 -0
  49. package/plugins/lisa-expo/skills/expo-brownfield/references/troubleshooting.md +88 -0
  50. package/plugins/lisa-expo/skills/expo-cicd-workflows/SKILL.md +92 -0
  51. package/plugins/lisa-expo/skills/expo-cicd-workflows/agents/openai.yaml +4 -0
  52. package/plugins/lisa-expo/skills/expo-cicd-workflows/scripts/fetch.js +113 -0
  53. package/plugins/lisa-expo/skills/expo-cicd-workflows/scripts/package.json +11 -0
  54. package/plugins/lisa-expo/skills/expo-cicd-workflows/scripts/validate.js +85 -0
  55. package/plugins/lisa-expo/skills/expo-deployment/SKILL.md +190 -0
  56. package/plugins/lisa-expo/skills/expo-deployment/agents/openai.yaml +4 -0
  57. package/plugins/lisa-expo/skills/expo-deployment/references/app-store-metadata.md +479 -0
  58. package/plugins/lisa-expo/skills/expo-deployment/references/ios-app-store.md +355 -0
  59. package/plugins/lisa-expo/skills/expo-deployment/references/play-store.md +246 -0
  60. package/plugins/lisa-expo/skills/expo-deployment/references/testflight.md +58 -0
  61. package/plugins/lisa-expo/skills/expo-deployment/references/workflows.md +200 -0
  62. package/plugins/lisa-expo/skills/expo-dev-client/SKILL.md +164 -0
  63. package/plugins/lisa-expo/skills/expo-dev-client/agents/openai.yaml +4 -0
  64. package/plugins/lisa-expo/skills/expo-module/SKILL.md +141 -0
  65. package/plugins/lisa-expo/skills/expo-module/agents/openai.yaml +4 -0
  66. package/plugins/lisa-expo/skills/expo-module/references/config-plugin.md +90 -0
  67. package/plugins/lisa-expo/skills/expo-module/references/create-expo-module.md +206 -0
  68. package/plugins/lisa-expo/skills/expo-module/references/lifecycle.md +127 -0
  69. package/plugins/lisa-expo/skills/expo-module/references/module-config.md +48 -0
  70. package/plugins/lisa-expo/skills/expo-module/references/native-module.md +286 -0
  71. package/plugins/lisa-expo/skills/expo-module/references/native-view.md +171 -0
  72. package/plugins/lisa-expo/skills/expo-tailwind-setup/SKILL.md +480 -0
  73. package/plugins/lisa-expo/skills/expo-tailwind-setup/agents/openai.yaml +4 -0
  74. package/plugins/lisa-expo/skills/expo-ui-jetpack-compose/SKILL.md +40 -0
  75. package/plugins/lisa-expo/skills/expo-ui-jetpack-compose/agents/openai.yaml +4 -0
  76. package/plugins/lisa-expo/skills/expo-ui-swift-ui/SKILL.md +39 -0
  77. package/plugins/lisa-expo/skills/expo-ui-swift-ui/agents/openai.yaml +4 -0
  78. package/plugins/lisa-expo/skills/native-data-fetching/SKILL.md +507 -0
  79. package/plugins/lisa-expo/skills/native-data-fetching/agents/openai.yaml +4 -0
  80. package/plugins/lisa-expo/skills/native-data-fetching/references/expo-router-loaders.md +344 -0
  81. package/plugins/lisa-expo/skills/upgrading-expo/SKILL.md +134 -0
  82. package/plugins/lisa-expo/skills/upgrading-expo/agents/openai.yaml +4 -0
  83. package/plugins/lisa-expo/skills/upgrading-expo/references/expo-av-to-audio.md +132 -0
  84. package/plugins/lisa-expo/skills/upgrading-expo/references/expo-av-to-video.md +160 -0
  85. package/plugins/lisa-expo/skills/upgrading-expo/references/native-tabs.md +124 -0
  86. package/plugins/lisa-expo/skills/upgrading-expo/references/new-architecture.md +79 -0
  87. package/plugins/lisa-expo/skills/upgrading-expo/references/react-19.md +79 -0
  88. package/plugins/lisa-expo/skills/upgrading-expo/references/react-compiler.md +59 -0
  89. package/plugins/lisa-expo/skills/upgrading-expo/references/react-navigation-to-expo-router.md +61 -0
  90. package/plugins/lisa-expo/skills/use-dom/SKILL.md +417 -0
  91. package/plugins/lisa-expo/skills/use-dom/agents/openai.yaml +4 -0
  92. package/plugins/lisa-harper-fabric/.claude-plugin/plugin.json +1 -1
  93. package/plugins/lisa-harper-fabric/.codex-plugin/plugin.json +1 -1
  94. package/plugins/lisa-harper-fabric/commands/e2e-coverage-gaps.md +7 -0
  95. package/plugins/lisa-harper-fabric/commands/exploratory-qa.md +2 -2
  96. package/plugins/lisa-harper-fabric/skills/e2e-coverage-gaps/SKILL.md +105 -0
  97. package/plugins/lisa-harper-fabric/skills/e2e-coverage-gaps/agents/openai.yaml +4 -0
  98. package/plugins/lisa-harper-fabric/skills/exploratory-qa/SKILL.md +100 -93
  99. package/plugins/lisa-harper-fabric/skills/exploratory-qa/agents/openai.yaml +2 -2
  100. package/plugins/lisa-nestjs/.claude-plugin/plugin.json +1 -1
  101. package/plugins/lisa-nestjs/.codex-plugin/plugin.json +1 -1
  102. package/plugins/lisa-openclaw/.claude-plugin/plugin.json +1 -1
  103. package/plugins/lisa-openclaw/.codex-plugin/plugin.json +1 -1
  104. package/plugins/lisa-rails/.claude-plugin/plugin.json +1 -1
  105. package/plugins/lisa-rails/.codex-plugin/plugin.json +1 -1
  106. package/plugins/lisa-rails/commands/e2e-coverage-gaps.md +7 -0
  107. package/plugins/lisa-rails/commands/exploratory-qa.md +2 -2
  108. package/plugins/lisa-rails/skills/e2e-coverage-gaps/SKILL.md +105 -0
  109. package/plugins/lisa-rails/skills/e2e-coverage-gaps/agents/openai.yaml +4 -0
  110. package/plugins/lisa-rails/skills/exploratory-qa/SKILL.md +100 -93
  111. package/plugins/lisa-rails/skills/exploratory-qa/agents/openai.yaml +2 -2
  112. package/plugins/lisa-typescript/.claude-plugin/plugin.json +1 -1
  113. package/plugins/lisa-typescript/.codex-plugin/plugin.json +1 -1
  114. package/plugins/lisa-wiki/.claude-plugin/plugin.json +1 -1
  115. package/plugins/lisa-wiki/.codex-plugin/plugin.json +1 -1
  116. package/plugins/lisa-wiki/templates/llm-wiki-contract.md +12 -0
  117. package/plugins/src/base/commands/repair-intake.md +2 -2
  118. package/plugins/src/base/rules/config-resolution.md +2 -2
  119. package/plugins/src/base/skills/repair-intake/SKILL.md +86 -9
  120. package/plugins/src/expo/.mcp.json +3 -3
  121. package/plugins/src/expo/THIRD-PARTY-NOTICES.md +57 -0
  122. package/plugins/src/expo/commands/e2e-coverage-gaps.md +7 -0
  123. package/plugins/src/expo/commands/exploratory-qa.md +2 -2
  124. package/plugins/src/expo/skills/add-app-clip/SKILL.md +280 -0
  125. package/plugins/src/expo/skills/add-app-clip/references/native-module.md +96 -0
  126. package/plugins/src/expo/skills/building-native-ui/SKILL.md +321 -0
  127. package/plugins/src/expo/skills/building-native-ui/references/animations.md +220 -0
  128. package/plugins/src/expo/skills/building-native-ui/references/controls.md +272 -0
  129. package/plugins/src/expo/skills/building-native-ui/references/form-sheet.md +253 -0
  130. package/plugins/src/expo/skills/building-native-ui/references/gradients.md +106 -0
  131. package/plugins/src/expo/skills/building-native-ui/references/icons.md +213 -0
  132. package/plugins/src/expo/skills/building-native-ui/references/media.md +198 -0
  133. package/plugins/src/expo/skills/building-native-ui/references/route-structure.md +229 -0
  134. package/plugins/src/expo/skills/building-native-ui/references/search.md +248 -0
  135. package/plugins/src/expo/skills/building-native-ui/references/storage.md +121 -0
  136. package/plugins/src/expo/skills/building-native-ui/references/tabs.md +433 -0
  137. package/plugins/src/expo/skills/building-native-ui/references/toolbar-and-headers.md +284 -0
  138. package/plugins/src/expo/skills/building-native-ui/references/visual-effects.md +197 -0
  139. package/plugins/src/expo/skills/building-native-ui/references/webgpu-three.md +605 -0
  140. package/plugins/src/expo/skills/building-native-ui/references/zoom-transitions.md +158 -0
  141. package/plugins/src/expo/skills/e2e-coverage-gaps/SKILL.md +105 -0
  142. package/plugins/src/expo/skills/eas-update-insights/SKILL.md +228 -0
  143. package/plugins/src/expo/skills/eas-update-insights/references/channel-insights-schema.md +47 -0
  144. package/plugins/src/expo/skills/eas-update-insights/references/update-insights-schema.md +69 -0
  145. package/plugins/src/expo/skills/exploratory-qa/SKILL.md +100 -93
  146. package/plugins/src/expo/skills/expo-api-routes/SKILL.md +369 -0
  147. package/plugins/src/expo/skills/expo-brownfield/SKILL.md +54 -0
  148. package/plugins/src/expo/skills/expo-brownfield/references/brownfield-integrated.md +526 -0
  149. package/plugins/src/expo/skills/expo-brownfield/references/brownfield-isolated.md +402 -0
  150. package/plugins/src/expo/skills/expo-brownfield/references/comparison.md +63 -0
  151. package/plugins/src/expo/skills/expo-brownfield/references/troubleshooting.md +88 -0
  152. package/plugins/src/expo/skills/expo-cicd-workflows/SKILL.md +92 -0
  153. package/plugins/src/expo/skills/expo-cicd-workflows/scripts/fetch.js +113 -0
  154. package/plugins/src/expo/skills/expo-cicd-workflows/scripts/package.json +11 -0
  155. package/plugins/src/expo/skills/expo-cicd-workflows/scripts/validate.js +85 -0
  156. package/plugins/src/expo/skills/expo-deployment/SKILL.md +190 -0
  157. package/plugins/src/expo/skills/expo-deployment/references/app-store-metadata.md +479 -0
  158. package/plugins/src/expo/skills/expo-deployment/references/ios-app-store.md +355 -0
  159. package/plugins/src/expo/skills/expo-deployment/references/play-store.md +246 -0
  160. package/plugins/src/expo/skills/expo-deployment/references/testflight.md +58 -0
  161. package/plugins/src/expo/skills/expo-deployment/references/workflows.md +200 -0
  162. package/plugins/src/expo/skills/expo-dev-client/SKILL.md +164 -0
  163. package/plugins/src/expo/skills/expo-module/SKILL.md +141 -0
  164. package/plugins/src/expo/skills/expo-module/references/config-plugin.md +90 -0
  165. package/plugins/src/expo/skills/expo-module/references/create-expo-module.md +206 -0
  166. package/plugins/src/expo/skills/expo-module/references/lifecycle.md +127 -0
  167. package/plugins/src/expo/skills/expo-module/references/module-config.md +48 -0
  168. package/plugins/src/expo/skills/expo-module/references/native-module.md +286 -0
  169. package/plugins/src/expo/skills/expo-module/references/native-view.md +171 -0
  170. package/plugins/src/expo/skills/expo-tailwind-setup/SKILL.md +480 -0
  171. package/plugins/src/expo/skills/expo-ui-jetpack-compose/SKILL.md +40 -0
  172. package/plugins/src/expo/skills/expo-ui-swift-ui/SKILL.md +39 -0
  173. package/plugins/src/expo/skills/native-data-fetching/SKILL.md +507 -0
  174. package/plugins/src/expo/skills/native-data-fetching/references/expo-router-loaders.md +344 -0
  175. package/plugins/src/expo/skills/upgrading-expo/SKILL.md +134 -0
  176. package/plugins/src/expo/skills/upgrading-expo/references/expo-av-to-audio.md +132 -0
  177. package/plugins/src/expo/skills/upgrading-expo/references/expo-av-to-video.md +160 -0
  178. package/plugins/src/expo/skills/upgrading-expo/references/native-tabs.md +124 -0
  179. package/plugins/src/expo/skills/upgrading-expo/references/new-architecture.md +79 -0
  180. package/plugins/src/expo/skills/upgrading-expo/references/react-19.md +79 -0
  181. package/plugins/src/expo/skills/upgrading-expo/references/react-compiler.md +59 -0
  182. package/plugins/src/expo/skills/upgrading-expo/references/react-navigation-to-expo-router.md +61 -0
  183. package/plugins/src/expo/skills/use-dom/SKILL.md +417 -0
  184. package/plugins/src/harper-fabric/commands/e2e-coverage-gaps.md +7 -0
  185. package/plugins/src/harper-fabric/commands/exploratory-qa.md +2 -2
  186. package/plugins/src/harper-fabric/skills/e2e-coverage-gaps/SKILL.md +105 -0
  187. package/plugins/src/harper-fabric/skills/exploratory-qa/SKILL.md +100 -93
  188. package/plugins/src/rails/commands/e2e-coverage-gaps.md +7 -0
  189. package/plugins/src/rails/commands/exploratory-qa.md +2 -2
  190. package/plugins/src/rails/skills/e2e-coverage-gaps/SKILL.md +105 -0
  191. package/plugins/src/rails/skills/exploratory-qa/SKILL.md +100 -93
  192. package/plugins/src/wiki/templates/llm-wiki-contract.md +12 -0
  193. package/scripts/generate-codex-plugin-artifacts.mjs +7 -2
@@ -1,138 +1,145 @@
1
1
  ---
2
2
  name: exploratory-qa
3
- description: Playwright-backed exploratory QA workflow for web apps that FEEDS THE LIFECYCLE. Use when asked to audit an app with Playwright/e2e tests, find human-noticeable bugs and usability issues, identify gaps in automated test coverage, test responsive breakpoints, observe slow or unclear load states, or exercise mutable workflows with cleanup. Instead of writing a report file, it files every finding as a tracked work item via lisa:tracker-write (bugs, usability suggestions, and missing Playwright tests). A `ready` parameter controls whether bug and suggestion tickets are created build-ready (auto-picked-up by lisa:intake) or in the backlog for human triage (default); missing-test tickets are always created build-ready.
3
+ description: First-time-user exploratory QA walkthrough for web apps that FEEDS THE LIFECYCLE. Use when asked to experience an app the way a brand-new human user would landing cold on the home page and clicking through to find anything confusing, broken, or hard to understand (machine-style labels, slow or unclear loads, cramped or cut-off UI, inconsistent/non-standard UX, awkward scroll behavior, unclear affordances) across all breakpoints. Instead of writing a report file, it files every finding as a tracked work item via lisa:tracker-write (bugs and usability/UX issues). A `ready` parameter controls whether those tickets are created build-ready (auto-picked-up by lisa:intake) or left in the backlog for human triage (default). For gaps in the automated Playwright test suite, use the e2e-coverage-gaps skill instead.
4
4
  ---
5
5
 
6
6
  # Exploratory QA
7
7
 
8
8
  ## Overview
9
9
 
10
- Run a human-style exploratory QA pass informed by the existing Playwright suite, then **file every finding as a tracked work item** in the project's configured tracker so it enters the Lisa lifecycle. The goal is to find issues users notice and machines often miss — bugs, usability friction, and coverage gaps — and turn each into actionable, automatable work, not a static report.
10
+ Experience the app the way a **brand-new human user** would: land cold on the home page with no prior
11
+ knowledge, then click through and actually try to use it — just like a real person. The goal is to
12
+ surface anything **confusing, broken, or hard to understand**, and to do so at **every breakpoint**.
13
+
14
+ This is a usability/experience pass, **not** a test-coverage audit. It does not look at the Playwright
15
+ suite or hunt for coverage gaps — for that, use the `e2e-coverage-gaps` skill. Here, every finding is
16
+ filed as a tracked work item so it enters the Lisa lifecycle — no static report file.
11
17
 
12
18
  ## Parameters
13
19
 
14
- - **`target-url | env`** (first positional) — what to audit.
15
- - **`ready=true|false`** — the build-ready state for the **bug** and **usability/suggestion** tickets this pass creates.
20
+ - **`target-url | env`** (first positional) — what to explore.
21
+ - **`ready=true|false`** — the build-ready state for the tickets this pass creates.
16
22
  - `ready=true` → created build-ready, so `lisa:intake` / the build-intake scanner auto-picks them up.
17
- - `ready=false` (**default**) → created in the backlog (not build-ready) for a human to review and promote into the queue.
18
- - **Missing Playwright test tickets are ALWAYS created build-ready, regardless of this flag** — adding missing coverage is always safe to queue.
19
-
20
- `ready` maps directly to the `build_ready` write-control input on `lisa:tracker-write`.
23
+ - `ready=false` (**default**) → created in the backlog (not build-ready) for a human to review and
24
+ promote into the queue.
21
25
 
22
26
  ## Core Workflow
23
27
 
24
28
  ### 1. Establish Scope
25
29
 
26
- - Identify the target environment, account type, browser requirement, and the `ready` flag value (default `false`).
27
- - **Confirm the tracker is configured.** Findings are filed as tickets, so read `tracker` from `.lisa.config.json` (local overrides global). If it is unset, stop and report that the tracker must be configured (via `/lisa:setup:jira` / `:github` / `:linear`) before exploratory QA can file findings — do not silently fall back to a report file.
28
- - If credentials, tenant, seed data, or mutation boundaries are missing and cannot be discovered safely, ask a concise clarifying question.
29
- - Treat production-like environments conservatively. Do not mutate production data unless the user explicitly approves it.
30
- - Prefer a test user, dev/staging environment, or isolated seeded account for mutation testing.
31
-
32
- ### 2. Research Existing Playwright Coverage
33
-
34
- - Inspect Playwright config, auth/setup projects, fixtures, constants, selectors, test directories, skipped tests, retries, and viewport/device projects.
35
- - Summarize:
36
- - Number and shape of specs/tests.
37
- - Major workflows covered well.
38
- - Skipped/flaky/TODO coverage.
39
- - Viewports and browser projects used.
40
- - Mutating tests and their cleanup strategy.
41
- - Areas where tests assert presence instead of behavior.
42
- - Use existing test helpers/selectors when exploring the app. They reveal intended flows and stable hooks.
43
-
44
- ### 3. Choose Browser Tools
45
-
46
- - Use the user's requested browser/tool when specified.
47
- - Use a real profile browser when the task depends on existing cookies, SSO, extensions, or a logged-in session.
48
- - Use Playwright automation when exact viewport sizing, repeatable navigation, screenshots, console logs, traces, or route timing are needed.
49
- - Do not let automation hide human observations. Screenshots, visible text, layout, latency, scrollability, and affordance clarity matter.
50
-
51
- ### 4. Explore Like A Human
52
-
53
- Cover at least these dimensions unless the user narrows scope:
54
-
55
- - **Navigation:** direct URLs and visible click paths.
56
- - **Responsive behavior:** supported breakpoints, plus boundary widths where layout changes.
57
- - **Visual/layout quality:** cutoff text, overlap, offscreen controls, accidental horizontal scroll, empty space, awkward density, hidden stale content.
58
- - **Load states:** blanks, skeletons, spinners, `Loading...`, `Connecting...`, delayed hydration, and whether delays exceed a human-acceptable threshold.
59
- - **Behavior correctness:** sorting, filtering, saving, deleting, disabled states, permissions, tab persistence, URL canonicalization.
60
- - **Accessibility/testability:** hidden or off-canvas content exposed to accessibility/text locators, duplicate inactive route content, zero-sized interactive elements.
61
- - **Console/network health:** errors, missing assets, failed requests, noisy expected errors that could bury real failures.
62
- - **Data hygiene:** repeated test artifacts, stale seeded content, polluted shared accounts.
30
+ - Identify the target environment, account type, and browser requirement, and read the `ready` flag
31
+ (default `false`).
32
+ - **Confirm the tracker is configured.** Findings are filed as tickets, so read `tracker` from
33
+ `.lisa.config.json` (local overrides global). If it is unset, stop and report that the tracker must
34
+ be configured (via `/lisa:setup:jira` / `:github` / `:linear`) before exploratory QA can file
35
+ findings — do not silently fall back to a report file.
36
+ - If credentials, tenant, or seed data are missing and cannot be discovered safely, ask one concise
37
+ clarifying question.
38
+ - Treat production-like environments conservatively. Do not mutate production data unless the user
39
+ explicitly approves it. Prefer a test user, dev/staging environment, or isolated seeded account.
40
+
41
+ ### 2. Arrive Cold
42
+
43
+ - Start at the home/landing page with **no prior knowledge of the app**. Do **not** pre-read the
44
+ codebase to learn the intended flows — discover them the way a user would, by looking and clicking.
45
+ - Form a first impression: is it obvious what this app is, what to do first, and where to go next?
46
+
47
+ ### 3. Use It Like a Human
48
+
49
+ Click through the visible paths and actually attempt real tasks — a first-time user explores, makes
50
+ mistakes, and tries the obvious thing. Cover at least these dimensions unless the user narrows scope:
51
+
52
+ - **Comprehension & labeling:** machine-style or developer labels shown to users (raw IDs, enum keys,
53
+ `snake_case`, `null`/`undefined`, untranslated i18n keys), jargon, unclear button/menu names, icons
54
+ with no discernible meaning.
55
+ - **Navigation clarity:** is it obvious how to get somewhere and back? Dead ends, hidden entry points,
56
+ surprising redirects, broken links, no clear "home".
57
+ - **Visual/layout quality:** cut-off or truncated text, overlap, cramped/crowded density, offscreen or
58
+ unreachable controls, accidental horizontal scroll, awkward empty space.
59
+ - **Consistency / standard UX:** components, spacing, button styles, terminology, and interaction
60
+ patterns should be consistent across the app and follow common conventions. Flag anything
61
+ non-standard or that differs screen-to-screen.
62
+ - **Load & responsiveness:** long or unclear load times, blank screens, spinners / `Loading...` /
63
+ `Connecting...` with no progress, anything that feels slow or janky.
64
+ - **Scroll behavior:** unexpected scroll position, scroll jumps, nested or locked scroll, sticky
65
+ elements that cover content, content that cannot be reached.
66
+ - **Behavior correctness:** does the obvious action do what a user expects? Confusing errors, silent
67
+ failures, disabled controls with no explanation, state that does not persist.
68
+ - **Affordance clarity:** can the user tell what is clickable, required, in-progress, or complete?
69
+
70
+ ### 4. Cover All Breakpoints
71
+
72
+ - Discover breakpoints from the app (design tokens, CSS, responsive layout changes) when possible; if
73
+ unknown, use a practical baseline: phone, tablet/narrow, desktop, plus any app-specific cutoff.
74
+ - At each breakpoint, walk the key paths again and confirm the experience holds: expected
75
+ shell/navigation variant, critical controls visible and reachable, no unintended horizontal
76
+ overflow, intentional scroll containers still usable, nothing cut off or crowded.
77
+
78
+ ### 5. Watch Load & Latency
79
+
80
+ - Notice time to first meaningful content and time spent in blank/loading/spinner/connecting states.
81
+ - A page can be technically interactive but still visually incomplete — note that.
82
+ - Treat long waits without clear progress, error, retry, or cancellation as findings. Use practical
83
+ labels (noticeable, slow, unacceptable) and include observed durations when available.
63
84
 
64
85
  ## Mutation Discipline
65
86
 
66
- Exploratory QA should exercise mutable workflows when the environment is safe.
67
-
68
- - Prefer high-value user workflows: create/edit/delete records, lists, boards, tags, notes, comments, scenarios, uploads, messages, settings, invitations, or assignments.
69
- - Use unique names with a clear prefix such as `qa-`, `pw-`, or `codex-`.
70
- - Before mutating, identify the cleanup path. After mutating, make a best effort to clean up through the UI, then verify cleanup.
71
- - If UI cleanup is unavailable, file that as a product/test gap (a finding — see below). Use documented API cleanup only if appropriate for the project and account.
72
- - Record all mutations performed, cleanup attempts, and residue left behind.
73
- - Avoid destructive bulk actions unless the user explicitly asks or the test account is clearly disposable.
74
-
75
- ## Breakpoint Strategy
76
-
77
- - Discover breakpoints from the codebase, design tokens, CSS, docs, or Playwright constants when possible.
78
- - Test each named breakpoint and the boundary on both sides of important cutoffs.
79
- - If breakpoints are unknown, use a practical baseline: phone, tablet/narrow, desktop, and any app-specific cutoff discovered during research.
80
- - For each breakpoint, assert both user-visible behavior and automation-relevant state:
81
- - Expected shell/navigation variant.
82
- - Route-specific loaded content.
83
- - Critical controls visible and reachable.
84
- - No unintended document-level horizontal overflow.
85
- - Intentional scroll containers remain usable.
86
- - Hidden/off-canvas UI is not exposed as active content.
87
+ A real first-time user creates, edits, and deletes things — exercise those flows when the environment
88
+ is safe.
87
89
 
88
- ## Load-State Strategy
89
-
90
- Measure perceived latency, not just eventual success.
91
-
92
- - Track time to shell, time to meaningful route content, and time spent in blank/loading/spinner/connecting states.
93
- - Note when a page is technically interactive but still visually incomplete.
94
- - Treat long waits without clear progress, error, retry, or cancellation as bugs or test gaps.
95
- - Do not overfit exact milliseconds unless the project has defined budgets. Use practical labels such as noticeable, slow, or unacceptable and include observed durations when available.
90
+ - Use unique names with a clear prefix such as `qa-` or `codex-`.
91
+ - Before mutating, identify the cleanup path. After mutating, make a best effort to clean up through
92
+ the UI, then verify cleanup. If UI cleanup is unavailable, that itself is a usability finding.
93
+ - Avoid destructive bulk actions unless the user explicitly asks or the account is clearly disposable.
94
+ - Record all mutations performed, cleanup attempts, and any residue left behind.
96
95
 
97
96
  ## Filing findings as tracked work
98
97
 
99
- This skill does **not** write a report file. Every finding becomes a **leaf work item** created via `lisa:tracker-write` (the vendor-neutral writer — it dispatches to the configured tracker and runs the validation gate; never call a vendor `*-write-*` skill directly). Map each finding to a type and a build-ready state:
98
+ This skill does **not** write a report file. Every finding becomes a **leaf work item** created via
99
+ `lisa:tracker-write` (the vendor-neutral writer — it dispatches to the configured tracker and runs the
100
+ validation gate; never call a vendor `*-write-*` skill directly). Map each finding to a type:
100
101
 
101
102
  | Finding | `issue_type` | `build_ready` |
102
103
  |---------|--------------|---------------|
103
- | User-visible **bug** | `Bug` | the `ready` flag (default `false`) |
104
- | **Usability / UX issue** (suggestion) | `Improvement` | the `ready` flag (default `false`) |
105
- | **Missing Playwright test** (coverage gap) | `Task` | **`true` (always)** |
106
-
107
- Each finding is a flat leaf (no children), so `build_ready` applies directly. Pass it explicitly on every create — `build_ready: <ready flag>` for bugs and suggestions, `build_ready: true` for missing tests.
104
+ | User-visible **bug** (broken behavior) | `Bug` | the `ready` flag (default `false`) |
105
+ | **Usability / UX / clarity issue** | `Improvement` | the `ready` flag (default `false`) |
108
106
 
109
- Each ticket MUST be a complete spec (`lisa:tracker-write` runs the validator and rejects thin tickets):
107
+ Each finding is a flat leaf (no children), so `build_ready` applies directly pass it explicitly on
108
+ every create. Each ticket MUST be a complete spec (the validator rejects thin tickets):
110
109
 
111
110
  - **Three-audience description** (context / business value, technical approach, stakeholder impact).
112
- - **For a bug:** exact reproduction steps, observed-vs-expected, the env / account / breakpoint it occurred at, and console/network evidence.
113
- - **For a usability issue:** the observed friction, who it affects, and the proposed improvement.
114
- - **For a missing test:** the user behavior the test must assert and the stable selector/flow to use — concrete and automatable.
115
- - **Gherkin acceptance criteria** describing the fixed (bug / usability) or added (test) behavior.
111
+ - **For a bug:** exact reproduction steps, observed-vs-expected, the env / account / breakpoint it
112
+ occurred at, and console/network evidence.
113
+ - **For a usability issue:** the observed friction (what was confusing, cramped, inconsistent, or hard
114
+ to understand), who it affects, **where** (route + breakpoint), and the proposed improvement.
115
+ - **Gherkin acceptance criteria** describing the fixed behavior.
116
116
 
117
117
  ### Idempotency — don't spam duplicates
118
118
 
119
- Re-running a QA pass must not refile the same finding. Before creating a ticket, search the tracker for an **open** ticket carrying a stable marker `[lisa-exploratory-qa] <finding-key>` in its body (the `<finding-key>` is a stable slug of surface + symptom, e.g. `settings-modal/horizontal-overflow@tablet`). If one exists, reference/update it instead of creating a duplicate; only create when none exists. **Match by the marker, never by title** (titles get edited). A *closed* prior ticket does not suppress a new one — a recurrence after a fix is a genuine regression.
119
+ Re-running a pass must not refile the same finding. Before creating a ticket, search the tracker for an
120
+ **open** ticket carrying a stable marker `[lisa-exploratory-qa] <finding-key>` in its body (the
121
+ `<finding-key>` is a stable slug of surface + symptom, e.g. `settings-modal/horizontal-overflow@tablet`).
122
+ If one exists, reference/update it instead of creating a duplicate; only create when none exists.
123
+ **Match by the marker, never by title** (titles get edited). A *closed* prior ticket does not suppress a
124
+ new one — a recurrence after a fix is a genuine regression.
120
125
 
121
126
  ## Output
122
127
 
123
128
  No report file. Emit a concise in-session summary:
124
129
 
125
130
  - **Scope:** target URL/env, browser/tool, account type, build/version if visible, date.
126
- - **Existing Playwright coverage:** strengths and thin areas observed during research.
127
- - **Findings filed**, bucketed by type — bugs, usability suggestions, missing tests — each with its **created or referenced ticket ref** and its **build-ready state** (`ready` vs `triage/backlog`).
131
+ - **First impression:** could a new user tell what the app is and what to do first?
132
+ - **Findings filed**, bucketed by type — bugs, usability/clarity issues — each with its **created or
133
+ referenced ticket ref** and its **build-ready state** (`ready` vs `triage/backlog`).
128
134
  - **Observed but not filed:** anything noticed but intentionally not ticketed, with why.
129
135
 
130
136
  ## Quality Bar
131
137
 
132
- - Be honest about what was and was not tested.
133
- - Distinguish user-visible bugs from missing automated coverage — they map to different issue types (`Bug` vs `Task`).
134
- - Prefer concrete, reproducible findings. Every ticket must stand alone for an implementer who was not in the session.
138
+ - Explore as a true first-time user judge clarity, not whether you (who can read the code) can figure
139
+ it out.
140
+ - Prefer concrete, reproducible findings. Every ticket must stand alone for an implementer who was not
141
+ in the session.
135
142
  - Do not claim cleanup succeeded unless verified.
136
- - Do not let broad locators pass against hidden/inactive content.
137
- - File missing-test tickets build-ready; file bug and usability tickets per the `ready` flag (default: backlog for human triage).
143
+ - File tickets per the `ready` flag (default: backlog for human triage).
144
+ - This skill is about the human experience only route automated-coverage gaps to `e2e-coverage-gaps`.
138
145
  - Preserve unrelated repo changes.
@@ -0,0 +1,7 @@
1
+ ---
2
+ description: "Explore gaps in the automated Playwright/e2e suite: inventory the app's routes and existing tests, find routes with no coverage or flows tested only on the happy path (missing error, permission, empty, loading, and edge cases), confirm each in the running app, and file one build-ready missing-test ticket per gap via lisa:tracker-write. The optional ready flag (default true) controls build-ready vs backlog. For human usability issues, use exploratory-qa instead."
3
+ allowed-tools: ["Skill"]
4
+ argument-hint: "[target-url | env] [ready=true|false]"
5
+ ---
6
+
7
+ Use the /lisa-rails:e2e-coverage-gaps skill to inventory the app's routes and the existing Playwright suite, find uncovered and happy-path-only paths, confirm each gap in the running app, and file one build-ready missing-test ticket per gap via lisa:tracker-write (build-ready per the ready flag, default true). For human usability/experience findings, use /lisa-rails:exploratory-qa. $ARGUMENTS
@@ -1,7 +1,7 @@
1
1
  ---
2
- description: "Run a Playwright-backed exploratory QA pass: audit the app like a human, find user-noticeable bugs, usability issues, and gaps in automated test coverage, and file each finding as a tracked work item via lisa:tracker-write. The optional ready flag marks bug/suggestion tickets build-ready (auto-picked-up by lisa:intake) or leaves them in the backlog for human triage (default); missing-test tickets are always build-ready."
2
+ description: "Run a first-time-user exploratory QA walkthrough: experience the app like a brand-new human user, clicking through to find anything confusing, broken, or hard to understand (machine-style labels, slow or unclear loads, cramped or cut-off UI, inconsistent UX, awkward scroll behavior) across all breakpoints, and file each finding (bug or usability issue) as a tracked work item via lisa:tracker-write. The optional ready flag marks tickets build-ready (auto-picked-up by lisa:intake) or leaves them in the backlog for human triage (default). For gaps in the automated Playwright suite, use e2e-coverage-gaps instead."
3
3
  allowed-tools: ["Skill"]
4
4
  argument-hint: "[target-url | env] [ready=true|false]"
5
5
  ---
6
6
 
7
- Use the /lisa-rails:exploratory-qa skill to run a human-style exploratory QA pass informed by the existing Playwright suite, then file every finding (bugs, usability issues, missing Playwright tests) as a tracked work item via lisa:tracker-write — bug/suggestion tickets build-ready or in triage per the ready flag (default: triage), missing-test tickets always build-ready. $ARGUMENTS
7
+ Use the /lisa-rails:exploratory-qa skill to experience the app like a brand-new first-time user landing cold on the home page and clicking through to find anything confusing, broken, or hard to understand across all breakpoints — and file each finding (bugs, usability/clarity issues) as a tracked work item via lisa:tracker-write, build-ready or in triage per the ready flag (default: triage). For automated Playwright coverage gaps, use /lisa-rails:e2e-coverage-gaps. $ARGUMENTS
@@ -0,0 +1,105 @@
1
+ ---
2
+ name: e2e-coverage-gaps
3
+ description: Playwright/e2e coverage-gap explorer that FEEDS THE LIFECYCLE. Use when asked to find paths the automated end-to-end suite does NOT cover — routes with no test at all, or flows that are only happy-path tested (missing error, validation, permission, empty, loading, and edge states). It inventories the app's routes and the existing Playwright tests, explores the running app to confirm each uncovered or under-covered path is real and reachable, and files one build-ready missing-test ticket per gap via lisa:tracker-write. For human usability/experience issues (confusing, cramped, or broken UI), use the exploratory-qa skill instead.
4
+ ---
5
+
6
+ # E2E Coverage Gaps
7
+
8
+ ## Overview
9
+
10
+ Find where the automated end-to-end (Playwright) suite is **blind**: routes with no test at all, and
11
+ flows that only assert the **happy path** while ignoring error, permission, empty, loading, and edge
12
+ cases. Inventory the app's routes and the existing tests, explore the running app to confirm each gap
13
+ is real and reachable, then file each gap as a **build-ready missing-test work item** so it enters the
14
+ Lisa lifecycle.
15
+
16
+ This skill is purely about **automated-coverage gaps**. It does not judge whether the UI is confusing
17
+ or pretty — for human usability findings, use the `exploratory-qa` skill.
18
+
19
+ ## Parameters
20
+
21
+ - **`target-url | env`** (first positional) — the app to inventory and explore.
22
+ - **`ready=true|false`** — build-ready state for the missing-test tickets (**default `true`**). Adding
23
+ missing coverage is safe to queue, so these default to build-ready; pass `ready=false` to leave them
24
+ in the backlog for human triage.
25
+
26
+ ## Core Workflow
27
+
28
+ ### 1. Establish Scope
29
+
30
+ - Identify the target environment, account type, and browser requirement, and read the `ready` flag
31
+ (default `true`).
32
+ - **Confirm the tracker is configured.** Gaps are filed as tickets, so read `tracker` from
33
+ `.lisa.config.json` (local overrides global). If it is unset, stop and report that the tracker must
34
+ be configured (via `/lisa:setup:jira` / `:github` / `:linear`) before gaps can be filed.
35
+
36
+ ### 2. Inventory App Routes
37
+
38
+ - Enumerate every route/screen from the project's routing source — filesystem routes, the router
39
+ config, navigation definitions, or a generated sitemap.
40
+ - For each route capture: its path + params, the auth/role it requires, and the primary user actions
41
+ reachable from it (forms, mutations, filters, flows).
42
+
43
+ ### 3. Inventory Existing Playwright Coverage
44
+
45
+ - Inspect the Playwright config, auth/setup projects, fixtures, constants, selectors, spec directories,
46
+ skipped/TODO/flaky tests, retries, and viewport/device projects.
47
+ - For each spec, record which route(s)/flow(s) it exercises and whether it asserts **behavior** or just
48
+ **presence**.
49
+ - Use existing test helpers/selectors when exploring — they reveal intended flows and stable hooks.
50
+
51
+ ### 4. Compute the Gap Matrix
52
+
53
+ Map routes/flows against existing coverage and classify each gap:
54
+
55
+ - **Uncovered route/flow:** no test touches it at all.
56
+ - **Happy-path-only:** the success case is tested but the non-happy paths are not — missing
57
+ error/validation, permission/denied, empty/zero-state, loading/slow, and boundary/edge scenarios.
58
+ - **Assertion-thin:** a test exists but asserts presence rather than behavior/outcome.
59
+ - **Skipped/TODO/flaky:** coverage exists but is disabled or unreliable.
60
+ - **Breakpoint gap:** a flow is only tested at a single viewport when behavior changes across
61
+ breakpoints.
62
+
63
+ ### 5. Explore to Confirm
64
+
65
+ - Navigate each candidate gap in the running app to confirm it is real, reachable, and worth a test.
66
+ Discard gaps that aren't actually reachable or are intentionally out of scope.
67
+
68
+ ### 6. File One Ticket Per Gap
69
+
70
+ Each confirmed gap becomes a leaf **missing-test** work item created via `lisa:tracker-write` (the
71
+ vendor-neutral writer — it dispatches to the configured tracker and runs the validation gate; never
72
+ call a vendor `*-write-*` skill directly), `issue_type: Task`, **build-ready per the `ready` flag
73
+ (default `true`)**. Pass `build_ready` explicitly on every create. Each ticket MUST specify:
74
+
75
+ - The **route/flow** and the exact **user behavior the test must assert**.
76
+ - **Which scenario is missing** (uncovered vs which non-happy path: error / validation / permission /
77
+ empty / loading / edge / breakpoint).
78
+ - The **stable selector / fixture / flow** to use — concrete and automatable.
79
+ - **Three-audience description** + **Gherkin acceptance criteria** describing the test to add.
80
+
81
+ ### Idempotency — don't spam duplicates
82
+
83
+ Before creating a ticket, search the tracker for an **open** ticket carrying a stable marker
84
+ `[lisa-e2e-coverage-gaps] <gap-key>` in its body (the `<gap-key>` is a stable slug of route + missing
85
+ scenario, e.g. `checkout/payment-declined` or `dashboard/empty-state@mobile`). If one exists, reference
86
+ it instead of duplicating. **Match by the marker, never by title.** A *closed* prior ticket does not
87
+ suppress a genuine new gap.
88
+
89
+ ## Output
90
+
91
+ No report file. Emit a concise in-session summary:
92
+
93
+ - **Route inventory:** count of routes/screens discovered.
94
+ - **Existing coverage:** strengths and thin areas (skipped/flaky, assertion-thin, single-viewport).
95
+ - **Gap matrix:** uncovered vs happy-path-only vs breakpoint gaps.
96
+ - **Tickets filed:** each gap with its created/referenced ticket ref and build-ready state.
97
+
98
+ ## Quality Bar
99
+
100
+ - Distinguish **no coverage** from **happy-path-only** — both are gaps, but the ticket must say which.
101
+ - Every ticket must stand alone for an implementer who was not in the session and must be concretely
102
+ automatable (named route, behavior, and stable hook).
103
+ - Do not refile gaps already covered or already ticketed (marker check).
104
+ - This skill is about automated coverage only — route human usability issues to `exploratory-qa`.
105
+ - Preserve unrelated repo changes.