@andwhy/e2e-pipeline 0.13.2 → 0.14.1

package/README.md

@@ -8,7 +8,9 @@ Scaffolds the full e2e testing pipeline into any project: agent-assisted Playwri
 pnpm dlx @andwhy/e2e-pipeline init
 ```
 
-The CLI copies agent definitions, orchestration rules, and config templates into your project. The install is purely additive — it never creates or overwrites `CLAUDE.md`.
+The CLI writes the config templates and workflows into your project and enables the `e2e-pipeline` **Claude Code plugin** for the repo — that plugin carries the agent definitions, the orchestration rules, and the guided skill, and Claude Code keeps it updated on its own. The install is purely additive — it never creates or overwrites `CLAUDE.md`.
+
+The plugin lives in [`plugin/`](plugin/) in this repository, listed by the marketplace manifest at [`.claude-plugin/marketplace.json`](.claude-plugin/marketplace.json). It loads on developer machines (terminal, VS Code, desktop app); a claude.ai/code cloud session does not load repo-enabled plugins.
 
 **Setup and workflow docs:** [E2E Tests in Notion](https://app.notion.com/p/31ff837b6270805d8922c4a7c7beb6b0) (why-agency internal). These are maintained in one place rather than scaffolded into each project, so a workflow change is published once.
 
@@ -21,21 +23,24 @@ pnpm dlx @andwhy/e2e-pipeline init [--format ts|mjs] [--force] [--reset-config]
 | Flag             | Description                                                                                                  |
 | ---------------- | ------------------------------------------------------------------------------------------------------------ |
 | `--format`       | Config file format (`ts` or `mjs`). Use `mjs` if TS causes conflicts. Prompted if omitted.                   |
-| `--force`        | Update package-owned files. Never touches your configs, `CLAUDE.md`, or anything else you own.               |
+| `--force`        | Update package-owned files and remove pre-plugin copies from `.claude/`. Never touches your configs, workflows, `CLAUDE.md`, or anything else you own. |
 | `--reset-config` | Write a fresh `*.new.{ts,mjs}` next to each config so you can diff it. Your originals are left alone.         |
+| `--update-workflows` | Replace the three GitHub workflows with the current callers of the reusable workflows, and remove the prompt and script copies only pre-0.14.0 workflows read. The one way the scaffold overwrites a workflow. |
 
-Re-running `init --force` in an existing project is the way to pick up a new version.
+The agents, skill and rules update themselves through the plugin; the workflows through the reusable workflows they call. `init --force` is only needed for the package-owned files below, and `init --force --update-workflows` once to migrate a repo scaffolded before 0.14.0.
 
 ## What gets created
 
+**From the plugin** — nothing in the repo but two entries in `.claude/settings.json` (commit it):
+
+- `playwright-test-planner`, `playwright-test-generator`, `playwright-test-healer` agents
+- `playwright-test-pipeline` skill — guided walkthrough; triggers when someone asks to create or fix tests and escorts them through setup check, Plan → Generate → Heal, preview validation, and deployment. It also holds the project test rules and the agent prompt templates.
+- A SessionStart hook with the always-on delegation rules (delegate to the agents, never hand-write spec bodies), active only in repos that carry the pipeline
+
 **Package-owned** — regenerated by `--force`, so don't edit these by hand:
 
-- `.claude/agents/` — Planner, Generator, Healer agent definitions (3 agents, each defines its own MCP server)
-- `.claude/rules/playwright-workflow.md` — orchestration rules for the Plan → Generate → Heal pipeline, auto-loaded into the main session alongside any existing `CLAUDE.md`
-- `.claude/skills/playwright-test-pipeline/` — guided walkthrough skill; triggers when someone asks to create or fix tests and escorts them through setup check, Plan → Generate → Heal, preview validation, and deployment
 - `.mcp.json` — Playwright MCP server config (project root)
 - `playwright.mcp.config.{ts,mjs}` — config the MCP server loads: extends `playwright.config` and clears `testIgnore`, so the planner/generator can execute seeds that normal runs ignore
-- `.github/prompts/checkly-heal.md` — instructions for the auto-heal agent the `checkly-heal` workflow runs
 
 **Seeded once** — starting points your project then owns. Written only when absent and never overwritten, `--force` included:
 
@@ -43,10 +48,12 @@ Re-running `init --force` in an existing project is the way to pick up a new ver
 - `checkly.config.{ts,mjs}` — Checkly config template with placeholders
 - `tests/e2e/seed.spec.{ts,js}` — seed file for Playwright MCP `setup_page`
 - `tests/e2e/helpers/preview-consent-setup.{ts,js}` — `prepareVercelPreviewPage` (Vercel deployment-protection bypass); projects extend it with consent logic
-- `.github/workflows/pr-playwright-tests.yml` — runs the suite against the PR's Vercel preview and comments the result (plus `.github/scripts/playwright-pr-comment.mjs`)
+- `.github/workflows/pr-playwright-tests.yml` — runs the suite against the PR's Vercel preview and comments the result
 - `.github/workflows/checkly-deploy.yml` — deploys monitors when a production deployment succeeds
 - `.github/workflows/checkly-heal.yml` — a failing deployed monitor triggers a triage-and-heal agent: production regressions escalate to Slack immediately; stale tests get fixed and flaky tests hardened — including behavior-neutral test hooks (`data-testid`) in app source when needed — and opened as a human-review PR, whose own preview run validates the app-side hooks. Inert until a Checkly webhook alert channel dispatches to it — the skill walks through that setup.
 
+The three workflow files are callers of a few lines each. The work runs in this repository's `.github/workflows/reusable-*.yml`, referenced at `@main`, so a merge here updates every consumer's CI without a PR there. The heal prompt (`templates/github/prompts/checkly-heal.md`) and the PR comment script (`templates/github/scripts/playwright-pr-comment.mjs`) are read from the published npm package inside those workflows. One-time admin setting on this repository so other repos may call its workflows: Settings → Actions → General → Access → "Accessible from repositories in the organization".
+
 The workflows need repository secrets: `CHECKLY_API_KEY`, `CHECKLY_ACCOUNT_ID`,
 `VERCEL_AUTOMATION_BYPASS_SECRET`, and for auto-heal `SLACK_WEBHOOK_URL`
 (values in 1Password). `ANTHROPIC_API_KEY` is an organization secret inherited
@@ -57,8 +64,8 @@ E2E specs live under **`tests/e2e/`** so a repo can keep unit tests elsewhere un
 kept out of test discovery by `testIgnore` rather than by living outside it.
 
 The agents treat this as a default, not a rule: if a repo already has specs
-somewhere else, they write there instead. See rule 6 in
-`.claude/rules/playwright-workflow.md`.
+somewhere else, they write there instead. See rule 6 of the project test
+rules in the `playwright-test-pipeline` skill.
 
 `.gitignore` gains Playwright/test output and seed entries; existing lines are left in place.
 
@@ -77,6 +84,29 @@ These agents extend the vanilla Playwright test agents with:
 - **Locale-awareness**: no hardcoded domains or locale-specific URL patterns
 - **Optional draft input**: Planner can validate a user-provided journey draft against the live page
 
+## The plugin
+
+`plugin/` is a Claude Code plugin in the standard layout: `agents/`,
+`skills/playwright-test-pipeline/`, `hooks/`, and `.claude-plugin/plugin.json`.
+`agents/` is generated — `npm run build:plugin` inlines
+`templates/claude/partials/_robustness-core.md` into the agent sources under
+`templates/claude/agents/` and syncs the manifest version from `package.json`.
+The output is committed because a marketplace is a git clone; CI fails a pull
+request whose output is stale (`npm run check:plugin`).
+
+To try a branch before it is released, in any consumer repo:
+
+```
+/plugin marketplace add why-agency/why-e2e-pipeline#<branch>
+```
+
+or start Claude Code with `--plugin-dir ../why-e2e-pipeline/plugin`.
+
+Auto-heal in CI does not load the plugin (a headless run with an API key has
+no plugin sources): the workflow copies `plugin/agents/playwright-test-healer.md`
+out of the published package instead, which is why `plugin/` ships in the npm
+package too.
+
 ## Documentation
 
 The Installation and Usage guides live in `docs/notion/` and are the source of

package/dist/bin/init.js

@@ -1,7 +1,7 @@
 #!/usr/bin/env node
 import path from "node:path";
 import { fileURLToPath } from "node:url";
-import { findSpecsOutsideE2e, scaffold, } from "../utils/copy.js";
+import { findSpecsOutsideE2e, PLUGIN_ID, scaffold, } from "../utils/copy.js";
 import { formatFiles } from "../utils/format.js";
 import { installDeps } from "../utils/install.js";
 import { askFileFormat } from "../utils/prompt.js";
@@ -13,6 +13,7 @@ const parseArgs = (argv) => {
     let format;
     let force = false;
     let resetConfig = false;
+    let updateWorkflows = false;
     for (let i = 2; i < argv.length; i++) {
         const arg = argv[i];
         if (arg === "init")
@@ -23,6 +24,9 @@ const parseArgs = (argv) => {
         else if (arg === "--reset-config") {
             resetConfig = true;
         }
+        else if (arg === "--update-workflows") {
+            updateWorkflows = true;
+        }
         else if (arg === "--format" && argv[i + 1]) {
             const val = argv[++i];
             if (val === "ts" || val === "mjs") {
@@ -44,10 +48,10 @@ const parseArgs = (argv) => {
             }
         }
     }
-    return { format, force, resetConfig };
+    return { format, force, resetConfig, updateWorkflows };
 };
 const run = async () => {
-    const { format: formatArg, force, resetConfig } = parseArgs(process.argv);
+    const { format: formatArg, force, resetConfig, updateWorkflows, } = parseArgs(process.argv);
     const fileFormat = formatArg ?? (await askFileFormat());
     const projectRoot = process.cwd();
     const templatesRoot = path.resolve(__dirname, "..", "..", "templates");
@@ -56,6 +60,7 @@ const run = async () => {
         force,
         fileFormat,
         resetConfig,
+        updateWorkflows,
     });
     if (result.created.length > 0) {
         console.log("Created:");
@@ -79,6 +84,12 @@ const run = async () => {
             console.log(`  ${path.relative(projectRoot, f)}`);
         }
     }
+    if (result.removed.length > 0) {
+        console.log(`\nRemoved copies the ${PLUGIN_ID} plugin or the reusable workflows provide now:`);
+        for (const f of result.removed) {
+            console.log(`  ${path.relative(projectRoot, f)}`);
+        }
+    }
     // Dependencies install before the formatting pass: prettier is resolved
     // from the project's node_modules, which a fresh clone doesn't have yet.
     // Formatting after the install means scaffolded files pick up the project's
@@ -123,13 +134,26 @@ const run = async () => {
             "skill walks through that.",
         ].join("\n"));
     }
-    console.log("Next steps:");
+    if (result.warnings.length > 0) {
+        console.log("\nNeeds your attention:");
+        for (const w of result.warnings) {
+            console.log(`  - ${w}`);
+        }
+    }
+    console.log("\nNext steps:");
     let step = 1;
     const ext = fileFormat === "mjs" ? "mjs" : "ts";
     console.log(`  ${step++}. Edit checkly.config.${ext} with your project name and check suites`);
     console.log(`  ${step++}. Run: npx checkly login`);
+    console.log(`  ${step++}. Restart Claude Code in this repo: the ${PLUGIN_ID} plugin (agents, skill, rules) installs at session start`);
     console.log(`  ${step++}. Setup and workflow docs: ${DOCS_URL}`);
-    console.log("\nPlaywright agent rules installed into .claude/rules/ — they load alongside any existing CLAUDE.md without conflict.");
+    console.log([
+        "",
+        `The Playwright agents, the playwright-test-pipeline skill and the workflow rules come from the ${PLUGIN_ID}`,
+        "Claude Code plugin, enabled for this repo in .claude/settings.json (commit it). It updates itself",
+        "on every pipeline release — no more init --force for those. Developer machines only: a claude.ai/code",
+        "cloud session does not load a repo's plugin settings.",
+    ].join("\n"));
     console.log();
 };
 run().catch((err) => {

package/dist/utils/copy.d.ts

@@ -2,7 +2,14 @@ interface CopyResult {
     created: string[];
     skipped: string[];
     regenerated: string[];
+    /** Pre-plugin copies of package files deleted from the project (--force). */
+    removed: string[];
+    /** Things the scaffold cannot fix itself and the user must act on. */
+    warnings: string[];
 }
+export declare const MARKETPLACE_NAME = "andwhy";
+export declare const PLUGIN_NAME = "e2e-pipeline";
+export declare const PLUGIN_ID = "e2e-pipeline@andwhy";
 /**
  * Specs already living under tests/ but outside tests/e2e — a unit or a11y
  * suite that predates the scaffold. They need calling out at install time:
@@ -18,6 +25,13 @@ export interface ScaffoldOptions {
     fileFormat?: FileFormat;
     /** Write a fresh copy of each config alongside the existing one, as `.new`. */
     resetConfig?: boolean;
+    /**
+     * Replace the three GitHub workflows with the current callers of the
+     * pipeline's reusable workflows, and remove the prompt and script copies
+     * the old workflows read. The one way the scaffold ever overwrites a
+     * workflow.
+     */
+    updateWorkflows?: boolean;
 }
-export declare const scaffold: (templatesRoot: string, projectRoot: string, { force, fileFormat, resetConfig }?: ScaffoldOptions) => Promise<CopyResult>;
+export declare const scaffold: (templatesRoot: string, projectRoot: string, { force, fileFormat, resetConfig, updateWorkflows, }?: ScaffoldOptions) => Promise<CopyResult>;
 export {};

package/dist/utils/copy.js

@@ -1,48 +1,153 @@
 import path from "node:path";
 import fs from "fs-extra";
-const copyTemplateDir = async (srcDir, destDir, force, result, destRename) => {
-    const entries = await fs.readdir(srcDir, { withFileTypes: true });
-    for (const entry of entries) {
-        const srcPath = path.join(srcDir, entry.name);
-        const relPath = destRename ? destRename(entry.name) : entry.name;
-        const destPath = path.join(destDir, relPath);
-        if (entry.isDirectory()) {
-            await copyTemplateDir(srcPath, destPath, force, result);
+// The agents, the skill and the always-on rules ship as the `e2e-pipeline`
+// Claude Code plugin (plugin/ in this repository) rather than as copies in
+// each project. The project only carries the two settings entries that
+// register the marketplace and enable the plugin; Claude Code installs and
+// auto-updates it from there, so a pipeline release no longer needs a PR in
+// every consumer repo.
+export const MARKETPLACE_NAME = "andwhy";
+export const PLUGIN_NAME = "e2e-pipeline";
+export const PLUGIN_ID = `${PLUGIN_NAME}@${MARKETPLACE_NAME}`;
+const MARKETPLACE_SOURCE = {
+    source: "github",
+    repo: "why-agency/why-e2e-pipeline",
+};
+// Merges the plugin entries into .claude/settings.json (the committed project
+// settings, not settings.local.json). Only the two keys the plugin needs are
+// touched; everything else in the file is kept as is. Idempotent, so it runs
+// on every init — an existing project picks the plugin up on its next
+// `init --force` without a separate step.
+const writeClaudeSettings = async (projectRoot, result) => {
+    const settingsPath = path.join(projectRoot, ".claude", "settings.json");
+    let settings = {};
+    if (await fs.pathExists(settingsPath)) {
+        try {
+            settings = await fs.readJson(settingsPath);
         }
-        else {
-            if (!force && (await fs.pathExists(destPath))) {
-                result.skipped.push(destPath);
-            }
-            else {
-                await fs.ensureDir(path.dirname(destPath));
-                await fs.copy(srcPath, destPath);
-                result.created.push(destPath);
-            }
+        catch {
+            result.warnings.push(`.claude/settings.json is not valid JSON, so the ${PLUGIN_ID} plugin entry was not written. ` +
+                `Fix the file and re-run, or add the entry by hand (see the installation docs).`);
+            return;
         }
     }
+    const marketplaces = settings.extraKnownMarketplaces ??
+        {};
+    const enabled = settings.enabledPlugins ?? {};
+    const wantMarketplace = { source: MARKETPLACE_SOURCE, autoUpdate: true };
+    const upToDate = JSON.stringify(marketplaces[MARKETPLACE_NAME]) ===
+        JSON.stringify(wantMarketplace) && enabled[PLUGIN_ID] === true;
+    if (upToDate) {
+        result.skipped.push(settingsPath);
+        return;
+    }
+    settings.extraKnownMarketplaces = {
+        ...marketplaces,
+        [MARKETPLACE_NAME]: wantMarketplace,
+    };
+    settings.enabledPlugins = { ...enabled, [PLUGIN_ID]: true };
+    await fs.ensureDir(path.dirname(settingsPath));
+    await fs.writeFile(settingsPath, JSON.stringify(settings, null, 2) + "\n");
+    result.created.push(settingsPath);
 };
-const ROBUSTNESS_MARKER = "<!-- ROBUSTNESS_CORE -->";
-// Copies agent definition files, inlining the shared robustness core partial in
-// place of the ROBUSTNESS_CORE marker. Subagents run in isolated context and
-// cannot read the partial (or any rules file), so the content must be embedded
-// in each agent body at scaffold time. The partials/ directory is never copied.
-const copyAgentsDir = async (agentsSrc, agentsDest, robustnessCore, force, result) => {
-    const entries = await fs.readdir(agentsSrc, { withFileTypes: true });
-    for (const entry of entries) {
-        if (!entry.isFile())
-            continue;
-        const srcPath = path.join(agentsSrc, entry.name);
-        const destPath = path.join(agentsDest, entry.name);
-        if (!force && (await fs.pathExists(destPath))) {
+// What earlier versions copied into .claude/ and the plugin now provides. A
+// copy left in place shadows or duplicates the plugin's agents and skill, so
+// --force deletes them (they were package-owned and overwritten wholesale by
+// --force before, so nothing hand-made is lost). Without --force they are
+// reported, not touched.
+const STALE_CLAUDE_FILES = [
+    path.join(".claude", "agents", "playwright-test-planner.md"),
+    path.join(".claude", "agents", "playwright-test-generator.md"),
+    path.join(".claude", "agents", "playwright-test-healer.md"),
+    path.join(".claude", "rules", "playwright-workflow.md"),
+    path.join(".claude", "skills", "playwright-test-pipeline"),
+];
+const removeStaleClaudeFiles = async (projectRoot, force, result) => {
+    const present = [];
+    for (const rel of STALE_CLAUDE_FILES) {
+        if (await fs.pathExists(path.join(projectRoot, rel)))
+            present.push(rel);
+    }
+    if (present.length === 0)
+        return;
+    if (!force) {
+        result.warnings.push(`Pre-plugin copies still in the repo: ${present.join(", ")}. ` +
+            `They shadow the ${PLUGIN_ID} plugin's agents and skill — run init --force to remove them.`);
+        return;
+    }
+    for (const rel of present) {
+        const abs = path.join(projectRoot, rel);
+        await fs.remove(abs);
+        result.removed.push(abs);
+        // Leave no empty package-created directory behind; a project's own
+        // agents/rules/skills keep the directory alive.
+        const parent = path.dirname(abs);
+        if ((await fs.readdir(parent)).length === 0)
+            await fs.remove(parent);
+    }
+};
+// Since 0.14.0 the three workflows in a project are short callers of the
+// reusable workflows in the pipeline repository, so a workflow change ships
+// on merge without a PR per repo. Workflows are seeded once and never
+// overwritten by --force (repos customize them), so a repo scaffolded
+// earlier keeps its full-length copies until --update-workflows replaces
+// them. The heal prompt and the PR comment script those copies read from
+// the repo are served from the published package to the callers' reusable
+// workflows, so they are removed together with the old workflows.
+const REUSABLE_MARKER = "uses: why-agency/why-e2e-pipeline/";
+const WORKFLOW_FILES = [
+    "pr-playwright-tests.yml",
+    "checkly-deploy.yml",
+    "checkly-heal.yml",
+];
+const WORKFLOW_SIDE_FILES = [
+    path.join(".github", "prompts", "checkly-heal.md"),
+    path.join(".github", "scripts", "playwright-pr-comment.mjs"),
+];
+const isCaller = async (workflowPath) => (await fs.readFile(workflowPath, "utf-8")).includes(REUSABLE_MARKER);
+const writeWorkflows = async (githubSrc, projectRoot, updateWorkflows, result) => {
+    const stale = [];
+    for (const name of WORKFLOW_FILES) {
+        const srcPath = path.join(githubSrc, "workflows", name);
+        const destPath = path.join(projectRoot, ".github", "workflows", name);
+        const exists = await fs.pathExists(destPath);
+        if (exists && !updateWorkflows) {
             result.skipped.push(destPath);
+            if (!(await isCaller(destPath)))
+                stale.push(`.github/workflows/${name}`);
             continue;
         }
-        const content = await fs.readFile(srcPath, "utf-8");
-        const inlined = content.split(ROBUSTNESS_MARKER).join(robustnessCore);
+        if (exists && (await isCaller(destPath))) {
+            // Already a caller; --update-workflows refreshes it like a
+            // package-owned file.
+            const same = (await fs.readFile(srcPath, "utf-8")) ===
+                (await fs.readFile(destPath, "utf-8"));
+            if (same) {
+                result.skipped.push(destPath);
+                continue;
+            }
+        }
         await fs.ensureDir(path.dirname(destPath));
-        await fs.writeFile(destPath, inlined);
+        await fs.copy(srcPath, destPath);
         result.created.push(destPath);
     }
+    if (stale.length > 0) {
+        result.warnings.push(`Workflows from before 0.14.0: ${stale.join(", ")}. They still work, but changes to them ` +
+            `need a PR in this repo. Run init --update-workflows to replace them with callers of the ` +
+            `pipeline's reusable workflows (review the diff: repo customizations become \`with:\` inputs).`);
+        return;
+    }
+    // Every workflow is a caller now, so the copied prompt and script are dead.
+    for (const rel of WORKFLOW_SIDE_FILES) {
+        const abs = path.join(projectRoot, rel);
+        if (!(await fs.pathExists(abs)))
+            continue;
+        await fs.remove(abs);
+        result.removed.push(abs);
+        const parent = path.dirname(abs);
+        if ((await fs.readdir(parent)).length === 0)
+            await fs.remove(parent);
+    }
 };
 const readProjectName = async (projectRoot) => {
     const pkgPath = path.join(projectRoot, "package.json");
@@ -149,19 +254,22 @@ export const findSpecsOutsideE2e = async (projectRoot) => {
     await walk(testsRoot);
     return [...found].sort();
 };
-export const scaffold = async (templatesRoot, projectRoot, { force = false, fileFormat = "ts", resetConfig = false } = {}) => {
-    const result = { created: [], skipped: [], regenerated: [] };
+export const scaffold = async (templatesRoot, projectRoot, { force = false, fileFormat = "ts", resetConfig = false, updateWorkflows = false, } = {}) => {
+    const result = {
+        created: [],
+        skipped: [],
+        regenerated: [],
+        removed: [],
+        warnings: [],
+    };
     const configExt = fileFormat === "mjs" ? "mjs" : "ts";
     const seedExt = fileFormat === "mjs" ? "js" : "ts";
     // The MCP server gets its own config: it must discover seeds that the main
     // config's testIgnore hides from local, CI, and Checkly runs. Package-owned,
     // like .mcp.json which points at it.
     const mcpConfigPath = `./playwright.mcp.config.${configExt}`;
-    const claudeSrc = path.join(templatesRoot, "claude");
-    const robustnessCore = (await fs.readFile(path.join(claudeSrc, "partials", "_robustness-core.md"), "utf-8")).trimEnd();
-    await copyAgentsDir(path.join(claudeSrc, "agents"), path.join(projectRoot, ".claude", "agents"), robustnessCore, force, result);
-    await copyTemplateDir(path.join(claudeSrc, "rules"), path.join(projectRoot, ".claude", "rules"), force, result);
-    await copyTemplateDir(path.join(claudeSrc, "skills"), path.join(projectRoot, ".claude", "skills"), force, result);
+    await writeClaudeSettings(projectRoot, result);
+    await removeStaleClaudeFiles(projectRoot, force, result);
     await writeMcpConfig(path.join(projectRoot, ".mcp.json"), mcpConfigPath, force, result);
     {
         const src = path.join(templatesRoot, "shared", `playwright.mcp.config.template.${configExt}`);
@@ -219,57 +327,10 @@ export const scaffold = async (templatesRoot, projectRoot, { force = false, file
     }
     // GitHub workflows: seeded once, like the configs. Repos customize their
     // workflows (path filters, retry posture), and --force must never clobber
-    // that. Both need repository secrets the scaffold cannot create — the CLI
-    // says which below, the skill walks the user through adding them.
-    const githubSrc = path.join(templatesRoot, "github");
-    const githubMappings = [
-        [
-            path.join("workflows", "checkly-deploy.yml"),
-            path.join(".github", "workflows", "checkly-deploy.yml"),
-        ],
-        [
-            path.join("workflows", "pr-playwright-tests.yml"),
-            path.join(".github", "workflows", "pr-playwright-tests.yml"),
-        ],
-        [
-            path.join("workflows", "checkly-heal.yml"),
-            path.join(".github", "workflows", "checkly-heal.yml"),
-        ],
-        [
-            path.join("scripts", "playwright-pr-comment.mjs"),
-            path.join(".github", "scripts", "playwright-pr-comment.mjs"),
-        ],
-    ];
-    for (const [src, dest] of githubMappings) {
-        const destPath = path.join(projectRoot, dest);
-        if (await fs.pathExists(destPath)) {
-            result.skipped.push(destPath);
-        }
-        else {
-            await fs.ensureDir(path.dirname(destPath));
-            await fs.copy(path.join(githubSrc, src), destPath);
-            result.created.push(destPath);
-        }
-    }
-    // The heal prompt is package-owned like the agent definitions: it carries
-    // agent behavior, not project config, so --force updates it.
-    const githubOwnedMappings = [
-        [
-            path.join("prompts", "checkly-heal.md"),
-            path.join(".github", "prompts", "checkly-heal.md"),
-        ],
-    ];
-    for (const [src, dest] of githubOwnedMappings) {
-        const destPath = path.join(projectRoot, dest);
-        if (!force && (await fs.pathExists(destPath))) {
-            result.skipped.push(destPath);
-        }
-        else {
-            await fs.ensureDir(path.dirname(destPath));
-            await fs.copy(path.join(githubSrc, src), destPath);
-            result.created.push(destPath);
-        }
-    }
+    // that; --update-workflows is the explicit opt-in. They need repository
+    // secrets the scaffold cannot create — the CLI says which below, the skill
+    // walks the user through adding them.
+    await writeWorkflows(path.join(templatesRoot, "github"), projectRoot, updateWorkflows, result);
     await appendGitignore(projectRoot, result);
     return result;
 };

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@andwhy/e2e-pipeline",
-  "version": "0.13.2",
+  "version": "0.14.1",
   "description": "Scaffolds the full e2e testing pipeline: agent-assisted Playwright tests, CI runs against Vercel previews, and Checkly monitors that follow production deploys",
   "type": "module",
   "license": "MIT",
@@ -13,14 +13,18 @@
   },
   "files": [
     "dist",
-    "templates"
+    "templates",
+    "plugin"
   ],
   "publishConfig": {
     "access": "public"
   },
   "scripts": {
     "build": "tsc",
-    "prepublishOnly": "npm run build"
+    "build:plugin": "node scripts/build-plugin.mjs",
+    "check:plugin": "node scripts/build-plugin.mjs --check",
+    "prepublishOnly": "npm run build && npm run check:plugin",
+    "skill:zip": "node scripts/zip-skill.mjs"
   },
   "dependencies": {
     "fs-extra": "^11.3.0",

package/plugin/.claude-plugin/plugin.json

@@ -0,0 +1,18 @@
+{
+  "name": "e2e-pipeline",
+  "displayName": "&why e2e pipeline",
+  "version": "0.14.1",
+  "description": "Agent-assisted Playwright e2e tests: planner, generator and healer agents plus the playwright-test-pipeline skill that drives Plan → Generate → Heal, Checkly preview validation and deployment.",
+  "author": {
+    "name": "&why",
+    "url": "https://why.de"
+  },
+  "repository": "https://github.com/why-agency/why-e2e-pipeline",
+  "license": "MIT",
+  "keywords": [
+    "playwright",
+    "e2e",
+    "testing",
+    "checkly"
+  ]
+}