@codyswann/lisa 4.27.8 → 4.28.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/dist/core/nightly-e2e-guard-behavior-certificate.js +2 -2
- package/dist/core/upstream-evidence-manifest.d.ts.map +1 -1
- package/dist/core/upstream-evidence-manifest.js +36 -2
- package/dist/core/upstream-evidence-manifest.js.map +1 -1
- package/package.json +5 -4
- package/plugins/lisa/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa/.codex-plugin/plugin.json +1 -1
- package/plugins/lisa/.codex-plugin/skills/lisa-validate-tracker-mapping/SKILL.md +134 -3
- package/plugins/lisa/scripts/repo-scope-vocabulary-audit.mjs +458 -0
- package/plugins/lisa/skills/lisa-validate-tracker-mapping/SKILL.md +135 -4
- package/plugins/lisa-agy/plugin.json +1 -1
- package/plugins/lisa-agy/scripts/repo-scope-vocabulary-audit.mjs +458 -0
- package/plugins/lisa-agy/skills/lisa-validate-tracker-mapping/SKILL.md +135 -4
- package/plugins/lisa-cdk/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-cdk/.codex-plugin/plugin.json +1 -1
- package/plugins/lisa-cdk-agy/plugin.json +1 -1
- package/plugins/lisa-cdk-copilot/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-cdk-cursor/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-copilot/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-copilot/scripts/repo-scope-vocabulary-audit.mjs +458 -0
- package/plugins/lisa-copilot/skills/lisa-validate-tracker-mapping/SKILL.md +135 -4
- package/plugins/lisa-cursor/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-cursor/scripts/repo-scope-vocabulary-audit.mjs +458 -0
- package/plugins/lisa-cursor/skills/lisa-validate-tracker-mapping/SKILL.md +135 -4
- package/plugins/lisa-expo/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-expo/.codex-plugin/plugin.json +1 -1
- package/plugins/lisa-expo-agy/plugin.json +1 -1
- package/plugins/lisa-expo-copilot/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-expo-cursor/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-harper-fabric/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-harper-fabric/.codex-plugin/plugin.json +1 -1
- package/plugins/lisa-harper-fabric-agy/plugin.json +1 -1
- package/plugins/lisa-harper-fabric-copilot/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-harper-fabric-cursor/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-nestjs/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-nestjs/.codex-plugin/plugin.json +1 -1
- package/plugins/lisa-nestjs-agy/plugin.json +1 -1
- package/plugins/lisa-nestjs-copilot/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-nestjs-cursor/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-openclaw/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-openclaw/.codex-plugin/plugin.json +1 -1
- package/plugins/lisa-openclaw-agy/plugin.json +1 -1
- package/plugins/lisa-openclaw-copilot/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-openclaw-cursor/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-phaser/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-phaser/.codex-plugin/plugin.json +1 -1
- package/plugins/lisa-phaser-agy/plugin.json +1 -1
- package/plugins/lisa-phaser-copilot/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-phaser-cursor/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-rails/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-rails/.codex-plugin/plugin.json +1 -1
- package/plugins/lisa-rails-agy/plugin.json +1 -1
- package/plugins/lisa-rails-copilot/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-rails-cursor/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-typescript/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-typescript/.codex-plugin/plugin.json +1 -1
- package/plugins/lisa-typescript-agy/plugin.json +1 -1
- package/plugins/lisa-typescript-copilot/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-typescript-cursor/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-wiki/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-wiki/.codex-plugin/plugin.json +1 -1
- package/plugins/lisa-wiki-agy/plugin.json +1 -1
- package/plugins/lisa-wiki-copilot/.claude-plugin/plugin.json +1 -1
- package/plugins/lisa-wiki-cursor/.claude-plugin/plugin.json +1 -1
- package/plugins/src/base/scripts/repo-scope-vocabulary-audit.mjs +458 -0
- package/plugins/src/base/skills/lisa-validate-tracker-mapping/SKILL.md +135 -4
- package/scripts/lib/mutation-performance-reporter.mjs +135 -0
- package/scripts/mutation-performance-measure.mjs +1794 -0
- package/scripts/mutation-performance.schema.json +103 -0
- package/typescript/create-only/.github/workflows/review-evidence.yml +18 -10
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: lisa-validate-tracker-mapping
|
|
3
|
-
description: "Detect and repair drift between a project's configured Lisa status/label mappings and the live tracker/source workflow. Compares every lifecycle role in `.lisa.config.json` (JIRA `jira.workflow` statuses, GitHub/Linear `labels.{build,prd}`, Notion `notion.values` select options, Confluence `confluence.parents`) against the authoritative live names the access layer reports — catching renames, deletions, and case drift (e.g. config `On Stg` vs live `ON STG`). Read-only by default; `repair=true` rewrites the config to the canonical live names (config is fixed, never the tracker). Also
|
|
3
|
+
description: "Detect and repair drift between a project's configured Lisa status/label mappings and the live tracker/source workflow. Compares every lifecycle role in `.lisa.config.json` (JIRA `jira.workflow` statuses, GitHub/Linear `labels.{build,prd}`, Notion `notion.values` select options, Confluence `confluence.parents`) against the authoritative live names the access layer reports — catching renames, deletions, and case drift (e.g. config `On Stg` vs live `ON STG`). Read-only by default; `repair=true` rewrites the config to the canonical live names (config is fixed, never the tracker). Also audits the vocabularies no config key declares: `repo:` scope, where an item scoped only by an alias is valid yet invisible to every `repo:<name>` scan (DRIFTED), and `type:`/`priority:`/`component:`/`points:` smells (advisory). Neither is auto-repaired. Audits the current repo by default, or sweeps a set of projects via `projects=<glob>` / `workspaces=<file>`. Safe to schedule for continuous drift detection."
|
|
4
4
|
allowed-tools: ["Skill", "Bash", "Read", "Write", "Edit", "AskUserQuestion"]
|
|
5
5
|
---
|
|
6
6
|
|
|
@@ -125,8 +125,8 @@ One role carries a further check that name-existence cannot express:
|
|
|
125
125
|
A project's verdict:
|
|
126
126
|
|
|
127
127
|
- **VALID** — every role is VALID.
|
|
128
|
-
- **DRIFTED** — at least one CASE_DRIFT, MISSING, or INVERTED role, none of which is UNRESOLVABLE. An INVERTED `ready` is never VALID, no matter how cleanly it resolves.
|
|
129
|
-
- **UNRESOLVABLE** — the live set couldn't be enumerated (auth mismatch, missing tracker config, access failure). Distinguish this loudly from VALID — an unresolved audit is not a passing audit.
|
|
128
|
+
- **DRIFTED** — at least one CASE_DRIFT, MISSING, or INVERTED role, none of which is UNRESOLVABLE, **or** any Step 4b repo-scope finding. An INVERTED `ready` is never VALID, no matter how cleanly it resolves.
|
|
129
|
+
- **UNRESOLVABLE** — the live set couldn't be enumerated (auth mismatch, missing tracker config, access failure), **or** Step 4b could not derive a repo vocabulary. Distinguish this loudly from VALID — an unresolved audit is not a passing audit.
|
|
130
130
|
|
|
131
131
|
## Step 4b — Scoping-label smells (GitHub, advisory)
|
|
132
132
|
|
|
@@ -211,6 +211,99 @@ Three finding kinds, all `severity: "advisory"`:
|
|
|
211
211
|
Do not re-derive any of these thresholds in prose or in a second script. The
|
|
212
212
|
module is the single definition; this step calls it.
|
|
213
213
|
|
|
214
|
+
## Step 4c — Repo-scope vocabulary (all trackers, counts toward the verdict)
|
|
215
|
+
|
|
216
|
+
Steps 2–4 audit **lifecycle** roles, and they can only ever audit lifecycle
|
|
217
|
+
roles: every pair they compare comes from a `(role, configured-name)` mapping
|
|
218
|
+
declared in `.lisa.config.json`. The **scoping** vocabulary is declared in no
|
|
219
|
+
config key at all, so there is nothing to compare a live name against.
|
|
220
|
+
|
|
221
|
+
`repo:` is the scoping family where that blind spot costs the most, because a
|
|
222
|
+
wrong answer there is not a matter of taste: it decides which work items a
|
|
223
|
+
repository's build queue can see. When the repo vocabulary splits, a scan
|
|
224
|
+
filtering on the canonical spelling returns **fewer items, not an error**, and
|
|
225
|
+
an empty result is indistinguishable from "nothing to do". Work sits unrouted
|
|
226
|
+
and nobody is told. This step is what makes that impossible.
|
|
227
|
+
|
|
228
|
+
> The **open** scoping families — `type:`, `priority:`, `points:`,
|
|
229
|
+
> `component:` — are a separate problem with a separate answer, tracked
|
|
230
|
+
> upstream on #3420. An open vocabulary has no wrong member, only inconsistent
|
|
231
|
+
> ones, so findings about it must stay advisory and must never become a gate.
|
|
232
|
+
> That constraint exists to stop a *guess* becoming a gate; it is not weakened
|
|
233
|
+
> here, because nothing in this step is a guess. Do not extend this step to
|
|
234
|
+
> those families.
|
|
235
|
+
|
|
236
|
+
`assertRepoScope` (`lisa-work-item.mjs`, #1957) accepts **three** spellings as
|
|
237
|
+
valid repo scope, while every build-intake scanner filters on one:
|
|
238
|
+
|
|
239
|
+
| spelling | accepted by validation | found by a `repo:<name>` scan |
|
|
240
|
+
| --- | --- | --- |
|
|
241
|
+
| `repo:<name>` (canonical) | yes | **yes** |
|
|
242
|
+
| bare `<name>` label | yes | **no** |
|
|
243
|
+
| Jira component `<name>` | yes | **no** |
|
|
244
|
+
|
|
245
|
+
The bare branch is deliberate and load-bearing — Sentry-provenance items arrive
|
|
246
|
+
carrying only the bare repo name — so it is **not** to be tightened away. What
|
|
247
|
+
this step reports is the *disagreement* between the two columns: an item that
|
|
248
|
+
passes validation while being invisible to every scan looking for it. That is a
|
|
249
|
+
checkable fact about a specific item, not a heuristic about a name, which is
|
|
250
|
+
why these findings count toward the verdict.
|
|
251
|
+
|
|
252
|
+
### Derive the vocabulary — never declare it in config
|
|
253
|
+
|
|
254
|
+
Do **not** add a config key for this, and do not accept one if you find it. A
|
|
255
|
+
hand-written repo vocabulary is per-project curation of a list that is already
|
|
256
|
+
derivable, and it becomes its own drift surface — the same objection that
|
|
257
|
+
rejected declaring the open vocabularies. A key nothing reads would look like
|
|
258
|
+
an assertion while asserting nothing. Derive it instead:
|
|
259
|
+
|
|
260
|
+
- **Single-project mode**: the current-repo identity ladder from
|
|
261
|
+
`config-resolution` — `.lisa.config.local.json` `repo` → `.lisa.config.json`
|
|
262
|
+
`repo` → `.lisa.config.json` `github.repo` → `basename -s .git` of the git
|
|
263
|
+
remote.
|
|
264
|
+
- **Batch mode** (`projects=<glob>` / `workspaces=<file>`): the union of that
|
|
265
|
+
ladder across every resolved project, which is exactly the set of repos this
|
|
266
|
+
one tracker serves.
|
|
267
|
+
|
|
268
|
+
If the vocabulary resolves **empty**, the verdict is `UNRESOLVABLE`, never
|
|
269
|
+
`VALID`. A check that reports "nothing wrong" having looked at nothing is the
|
|
270
|
+
same failure this step exists to catch.
|
|
271
|
+
|
|
272
|
+
### Collect and classify
|
|
273
|
+
|
|
274
|
+
Feed the derived vocabulary, the live work items with their labels (and Jira
|
|
275
|
+
components), and the tracker's declared label set — the declared set is what
|
|
276
|
+
catches a malformed marker carrying zero items:
|
|
277
|
+
|
|
278
|
+
```bash
|
|
279
|
+
node "${CLAUDE_PLUGIN_ROOT}/scripts/repo-scope-vocabulary-audit.mjs" \
|
|
280
|
+
< /tmp/lisa-repo-scope-input.json
|
|
281
|
+
```
|
|
282
|
+
|
|
283
|
+
Input is `{ knownRepos: [...], items: [{ ref, labels, components }], labels: [...] }`.
|
|
284
|
+
It returns `{ verdict, findings, knownAliases, vocabulary }` and always exits
|
|
285
|
+
`0` — the verdict is the answer, and the exit status is not a second, quieter
|
|
286
|
+
channel for it. Three finding kinds, all `severity: "drift"`:
|
|
287
|
+
|
|
288
|
+
- **`unstamped-alias`** — work items carry an accepted alias (bare label or
|
|
289
|
+
Jira component) for a known repo **without** the canonical `repo:<name>`
|
|
290
|
+
beside it. They pass validation and no scan finds them. The finding names the
|
|
291
|
+
alias and every item carrying it.
|
|
292
|
+
- **`malformed-marker`** — a label shaped like a repo marker with the wrong
|
|
293
|
+
separator (`repo-frontend`, `repo_backend`). It scopes nothing at all: no
|
|
294
|
+
scan filters on it and validation does not accept it either.
|
|
295
|
+
- **`undeclared-scope`** — a `repo:<value>` label naming a repo outside the
|
|
296
|
+
derived vocabulary. Either the project set is incomplete or the label is a
|
|
297
|
+
misspelling routing work nowhere.
|
|
298
|
+
|
|
299
|
+
An alias on an item that **also** carries the canonical marker is reported in
|
|
300
|
+
`knownAliases`, **not** as drift — every scan still finds that item, so nothing
|
|
301
|
+
is wrong. That distinction is the whole check: an alias cannot be judged from
|
|
302
|
+
the label set alone, only per item.
|
|
303
|
+
|
|
304
|
+
Fold `DRIFTED` from this step into the project verdict exactly as a
|
|
305
|
+
`CASE_DRIFT` or `MISSING` role does.
|
|
306
|
+
|
|
214
307
|
## Step 5 — Report
|
|
215
308
|
|
|
216
309
|
Per project, print a terminal-first section:
|
|
@@ -236,6 +329,24 @@ An INVERTED `ready` gets a full line rather than a one-word status, because the
|
|
|
236
329
|
via /lisa:setup:linear, then set linear.workflow.ready to it.
|
|
237
330
|
```
|
|
238
331
|
|
|
332
|
+
Print the Step 4c findings **with this mapping table**, not as a separate
|
|
333
|
+
advisory block — they are drift, and a reader must not mistake them for
|
|
334
|
+
smells. Name the items, because "which tickets are invisible" is the operator's
|
|
335
|
+
actual question:
|
|
336
|
+
|
|
337
|
+
```
|
|
338
|
+
repo scope derived vocabulary: backend, frontend, infrastructure
|
|
339
|
+
backend 2 items scoped by the bare label only UNSTAMPED_ALIAS
|
|
340
|
+
SE-9, SE-10 pass repo-scope validation but carry no "repo:backend",
|
|
341
|
+
so every build scan for backend skips them and reports no error.
|
|
342
|
+
Stamping "repo:backend" on those items is a tracker change a human makes.
|
|
343
|
+
repo-frontend 0 items MALFORMED_MARKER
|
|
344
|
+
repo:mobile outside the derived vocabulary UNDECLARED_SCOPE
|
|
345
|
+
```
|
|
346
|
+
|
|
347
|
+
A project whose repo vocabulary is in good order prints
|
|
348
|
+
`repo scope: VALID` and nothing else.
|
|
349
|
+
|
|
239
350
|
Print the Step 4b findings, when there are any, as a clearly separate advisory
|
|
240
351
|
block **below** the mapping table so nobody reads a smell as a mapping failure:
|
|
241
352
|
|
|
@@ -250,7 +361,7 @@ Write those lines for a non-technical operator: say what was seen and what a
|
|
|
250
361
|
person might do about it, never "FAIL". A healthy repository prints
|
|
251
362
|
`scoping labels: none` and nothing else.
|
|
252
363
|
|
|
253
|
-
End with a roll-up: counts of VALID / DRIFTED / UNRESOLVABLE projects and the exact next command (`… repair=true` when drift is auto-repairable; an admin note when a status is genuinely MISSING; `/lisa:setup:linear` when a `ready` is INVERTED). Scoping findings are reported alongside that roll-up as a **separate count**, never folded into DRIFTED.
|
|
364
|
+
End with a roll-up: counts of VALID / DRIFTED / UNRESOLVABLE projects and the exact next command (`… repair=true` when drift is auto-repairable; an admin note when a status is genuinely MISSING; `/lisa:setup:linear` when a `ready` is INVERTED; an admin note naming the items when a repo scope is UNSTAMPED_ALIAS). Scoping-label findings are reported alongside that roll-up as a **separate count**, never folded into DRIFTED.
|
|
254
365
|
|
|
255
366
|
## Step 6 — Repair (only when `repair=true`)
|
|
256
367
|
|
|
@@ -305,6 +416,22 @@ real issue metadata on a coin flip. Report the finding, name the two spellings,
|
|
|
305
416
|
and leave the decision to a human — and note that reconciling them means
|
|
306
417
|
relabelling the issues, which is a tracker mutation this skill never performs.
|
|
307
418
|
|
|
419
|
+
### Repo-scope findings — never repaired, for a different reason
|
|
420
|
+
|
|
421
|
+
Step 4c findings are never auto-repaired either, but not because the right
|
|
422
|
+
answer is unknowable — often it is obvious. It is because **every** available
|
|
423
|
+
fix is a **tracker** mutation, and `repair=true` writes the config only:
|
|
424
|
+
|
|
425
|
+
- an `unstamped-alias` is fixed by adding `repo:<name>` to the work items,
|
|
426
|
+
- a `malformed-marker` by renaming or deleting a label,
|
|
427
|
+
- an `undeclared-scope` by deciding whether the name is a real repository (so
|
|
428
|
+
the project set is incomplete) or a misspelling (so the label is wrong).
|
|
429
|
+
|
|
430
|
+
There is no config edit that resolves any of them, and there is deliberately no
|
|
431
|
+
config key to edit — see Step 4c on why the vocabulary is derived. Report the
|
|
432
|
+
finding, name the items, and leave the tracker to a human.
|
|
433
|
+
|
|
434
|
+
|
|
308
435
|
### Invalidate the verification cache
|
|
309
436
|
|
|
310
437
|
After any JIRA repair, clear the `setup-jira` reachability cache so it re-verifies the new mapping:
|
|
@@ -334,3 +461,7 @@ Re-print the project section showing the post-repair mapping and the new verdict
|
|
|
334
461
|
- Reuse the config-resolution defaults and the vendor access skills (`atlassian-access`, `gh`, Linear/Notion MCP); do not invent a parallel mapping or lifecycle vocabulary.
|
|
335
462
|
- Scoping-label findings (Step 4b) are **advisory**. They never change a project's verdict, never change this skill's exit status, and are never auto-repaired. Do not add a flag that turns them into a gate.
|
|
336
463
|
- Never let Step 4b fail the run. A `gh` error, a non-GitHub tracker, or an empty repository means the scoping section reports "not collected" — the lifecycle verdict is unaffected either way.
|
|
464
|
+
- Step 4c repo-scope findings are **drift**, not smells: they count toward the verdict and are reported with the mapping table. They are still never auto-repaired, because every fix is a tracker mutation.
|
|
465
|
+
- Derive the repo vocabulary from the current-repo identity ladder (and, in batch mode, the resolved project set). Never introduce a config key declaring it, and never trust one — a hand-written vocabulary is a second thing to drift, and a key nothing reads would assert nothing while looking like an assertion.
|
|
466
|
+
- An empty derived repo vocabulary is `UNRESOLVABLE`, never `VALID`. The whole point of Step 4c is that a silent zero is the failure, so a zero-length vocabulary must never read as a pass.
|
|
467
|
+
- Do not extend Step 4c to the open scoping families (`type:`, `priority:`, `points:`, `component:`). Findings about those are heuristic and must stay advisory — see #3420.
|