@yasserkhanorg/e2e-agents 1.8.4 → 1.9.5

package/README.md

@@ -1,6 +1,6 @@
 # @yasserkhanorg/e2e-agents
 
-AI-powered E2E test impact analysis, generation, healing, and autonomous QA for frontend repositories.
+AI-powered E2E test impact analysis, generation, healing, and autonomous QA for any project with route families — not just Mattermost.
 
 [![npm](https://img.shields.io/npm/v/%40yasserkhanorg%2Fe2e-agents)](https://www.npmjs.com/package/@yasserkhanorg/e2e-agents)
 [![License](https://img.shields.io/badge/license-Apache%202.0-blue)](LICENSE)
@@ -8,13 +8,31 @@ AI-powered E2E test impact analysis, generation, healing, and autonomous QA for
 
 ## What It Does
 
-Given a git diff, `e2e-ai-agents` determines which E2E test flows are impacted, identifies coverage gaps, and can generate or heal Playwright tests — all from the CLI. The companion `e2e-qa-agent` goes further: it opens a real browser, explores your app autonomously, and produces a QA report with findings and a release-readiness verdict.
+Given a git diff, `e2e-ai-agents` determines which E2E test flows are impacted, identifies coverage gaps, and can generate or heal tests for Playwright, Cypress, pytest (Python), or supertest/vitest (Node.js API) — all from the CLI. The tool is project-agnostic: any codebase with a `route-families.json` manifest works out of the box. The companion `e2e-qa-agent` goes further: it opens a real browser, explores your app autonomously, and produces a QA report with findings and a release-readiness verdict.
 
 **Pipeline:** `impact` → `plan` → `generate` → `heal` → `finalize`
-**Crew (v1.8.0):** `impact` + `cross-impact` + `regression-advisor` → `strategist` → `test-designer` → `generator` → `executor` → `healer`
+**Multi-Agent Crew:** `impact` + `cross-impact` + `regression-advisor` → `strategist` → `test-designer` → `generator` → `executor` → `healer`
 
 > **How does this compare to other tools?** See [docs/comparison.md](docs/comparison.md) for a detailed analysis against Launchable, Codecov ATS, Qodo, Testsigma, mabl, GitHub Copilot, and others.
 
+## Free Tier
+
+These commands work with **zero LLM cost** — no API key required:
+
+| Command | What It Does |
+|---------|-------------|
+| `impact` | Deterministic impact analysis from git diff |
+| `plan` | Coverage gap detection and test recommendations |
+| `train --no-enrich` | Build route-families manifest (scanner only) |
+| `bootstrap` | Generate route-families.json from a knowledge graph (deterministic) |
+| `gate` | CI coverage gate — exit 1 if coverage is below threshold |
+| `traceability-capture` | Extract test-file relationships from Playwright JSON |
+| `traceability-ingest` | Merge traceability mappings into rolling manifest |
+| `feedback` | Ingest recommendation outcomes for calibration |
+| `cost-report` | View LLM cost breakdown from past runs |
+
+AI-powered features (crew workflows, test generation, healing) require an API key from [Anthropic](https://console.anthropic.com/), [OpenAI](https://platform.openai.com/), or a local [Ollama](https://ollama.ai/) instance (free).
+
 ## Installation
 
 ```bash
@@ -38,6 +56,12 @@ npx e2e-ai-agents plan --path /path/to/project
 # Generate tests for uncovered gaps (requires plan output)
 npx e2e-ai-agents generate --path /path/to/project
 
+# Bootstrap route-families.json from an Understand-Anything knowledge graph
+npx e2e-ai-agents bootstrap --path <project-root> [--kg-path <path>] [--test-mode ui|api|both] [--max-families <n>] [--dry-run]
+
+# CI coverage gate — fails with exit code 1 if coverage is below threshold
+npx e2e-ai-agents gate --path <project-root> [--threshold <0-100>]
+
 # Heal flaky/failing specs from a Playwright report
 npx e2e-ai-agents heal --path /path/to/project --traceability-report ./playwright-report.json
 
@@ -57,7 +81,7 @@ npx e2e-ai-agents llm-health
 
 `plan` and `suggest` are aliases. `analyze` is a convenience wrapper that runs impact + plan and optionally generation/healing in one invocation. Use `--help` for all available flags.
 
-## Multi-Agent Crew (v1.8.0)
+## Multi-Agent Crew
 
 The Crew orchestrates 10 specialized agents for deep test analysis. While the standard pipeline gives a fast pass/fail gate, the Crew produces structured test designs, cross-family impact maps, and prioritized test strategies.
 
@@ -73,8 +97,58 @@ npx e2e-ai-agents crew --workflow full-qa --path /path/to/project --tests-root .
 
 # With budget cap and JSON output
 npx e2e-ai-agents crew --workflow design-only --budget-usd 2.00 --json --path /path/to/project --tests-root ./e2e-tests --since origin/master
+
+# Dry run: preview what would happen without LLM calls
+npx e2e-ai-agents crew --workflow design-only --dry-run --path /path/to/project --tests-root ./e2e-tests --since origin/master
+
+# View LLM cost breakdown
+npx e2e-ai-agents cost-report --path /path/to/project
 ```
 
+### Budget Enforcement
+
+The `--budget-usd` flag sets a hard cost limit for the entire crew run. Budget enforcement uses a **pre-reservation** model (like credit card authorization holds) to prevent parallel agents from overshooting:
+
+1. Before each LLM call, the provider **reserves** estimated cost in a shared ledger
+2. Other parallel agents see the in-flight hold and stop if the budget would be exceeded
+3. After the call completes, the reservation is **settled** to actual cost
+
+This means 3 agents running in parallel against a $1.00 budget will not collectively spend $1.20. The overshoot is bounded by the estimation error of a single call (~$0.01).
+
+### Resilience
+
+Provider calls are protected by a **circuit breaker** (3-failure threshold, 60s cooldown). If a provider goes down, calls fail fast instead of burning through retry timeouts. Circuit breakers are shared per provider type — if Anthropic is down, all agents discover it after 3 total failures.
+
+Only transient errors (429, 5xx, network) trip the circuit. Budget exceeded and auth errors do not.
+
+### Plugins
+
+External agents can register into crew workflows via the `plugins` config:
+
+```typescript
+// my-plugin.ts
+import type { AgentPlugin, AgentTask, AgentResult, CrewContext } from '@yasserkhanorg/e2e-agents';
+
+const myPlugin: AgentPlugin = {
+    role: 'my-custom-analyzer',
+    phase: 'understand',              // Run in the 'understand' phase
+    runAfter: ['impact-analyst'],     // After impact-analyst completes
+    async execute(task: AgentTask, ctx: CrewContext): Promise<AgentResult> {
+        // Access ctx.impactedFlows, ctx.changedFiles, etc.
+        return { role: 'my-custom-analyzer', status: 'success', output: null, warnings: [] };
+    },
+};
+export default myPlugin;
+```
+
+```bash
+npx e2e-ai-agents crew --plugins ./my-plugin.ts --workflow full-qa --path ./app
+```
+
+Plugins with `runAfter` dependencies run sequentially after their dependencies. Plugins without `runAfter` run in parallel with other agents in their phase. Plugin paths must be relative and cannot escape the workspace directory.
+
+See [docs/PLUGIN_API_STABILITY.md](docs/PLUGIN_API_STABILITY.md) for the full API contract and stability guarantees.
+
 ### What the Crew Adds Beyond the Pipeline
 
 | Capability | Pipeline | Crew |
@@ -231,10 +305,23 @@ Create `e2e-ai-agents.config.json` in your project (auto-discovered):
 }
 ```
 
-Key options:
+### Generation Profiles
+
+The tool auto-detects your project type and generates tests following the appropriate conventions. Use the `--profile` flag (or the `profile` config key) to select a profile explicitly:
+
+| Profile | Description |
+|---------|-------------|
+| `mattermost` | Mattermost-specific conventions (strict mode, escalation for heuristic-only mappings) |
+| `generic` | Generic Playwright project |
+| `pytest` | Python projects using pytest + requests/httpx |
+| `supertest` | Node.js API projects using supertest/vitest |
+
+When `--profile` is omitted, the tool inspects `package.json`, `pyproject.toml`, and test directory structure to pick the best match automatically.
+
+### Key options
 
 - **`testsRoot`** — path to tests when they live outside the app root
-- **`profile`** — `default` or `mattermost` (strict mode with escalation for heuristic-only mappings)
+- **`profile`** — `mattermost`, `generic`, `pytest`, or `supertest` (auto-detected when omitted)
 - **`impact.dependencyGraph`** — static reverse dependency graph for transitive impact
 - **`impact.traceability`** — file-to-test mapping from CI execution data
 - **`impact.aiFlow`** — LLM-powered flow mapping (requires `ANTHROPIC_API_KEY`)
@@ -270,7 +357,7 @@ See [examples/github-actions/pr-impact.yml](examples/github-actions/pr-impact.ym
 
 ### Package Native (default)
 
-Strategy-based Playwright test templates with quality guardrails (no `test.describe`, single tag) and iterative heal attempts.
+Strategy-based test templates for Playwright, Cypress, pytest, or supertest/vitest with quality guardrails and iterative heal attempts.
 
 ### MCP Mode (`--pipeline-mcp`)
 
@@ -400,7 +487,7 @@ Requires `agent-browser` CLI (`npm install -g agent-browser`) and `ANTHROPIC_API
 
 ## Production Usage
 
-Used by [Mattermost](https://github.com/mattermost/mattermost) for CI-integrated E2E coverage gating, test generation, and spec healing. See the [Mattermost Playwright integration](https://github.com/mattermost/mattermost/tree/master/e2e-tests/playwright) for a real-world example.
+The tool works with any project that has a `route-families.json` manifest — frontend, backend, or full-stack. Used in production by [Mattermost](https://github.com/mattermost/mattermost) for CI-integrated E2E coverage gating, test generation, and spec healing. See the [Mattermost Playwright integration](https://github.com/mattermost/mattermost/tree/master/e2e-tests/playwright) for a real-world example.
 
 ## License
 

package/dist/adapters/cypress.d.ts

@@ -0,0 +1,10 @@
+import type { FrameworkAdapter, RunCommand, RunOptions } from './framework_adapter.js';
+export declare class CypressAdapter implements FrameworkAdapter {
+    readonly name = "cypress";
+    readonly specGlob = "**/*.cy.{ts,js,tsx,jsx}";
+    readonly extractTestPattern: RegExp;
+    readonly configFileNames: string[];
+    detect(projectRoot: string): boolean;
+    buildRunCommand(specPath: string, options?: RunOptions): RunCommand;
+}
+//# sourceMappingURL=cypress.d.ts.map

package/dist/adapters/cypress.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"cypress.d.ts","sourceRoot":"","sources":["../../src/adapters/cypress.ts"],"names":[],"mappings":"AAUA,OAAO,KAAK,EAAC,gBAAgB,EAAE,UAAU,EAAE,UAAU,EAAC,MAAM,wBAAwB,CAAC;AAErF,qBAAa,cAAe,YAAW,gBAAgB;IACnD,QAAQ,CAAC,IAAI,aAAa;IAE1B,QAAQ,CAAC,QAAQ,6BAA6B;IAE9C,QAAQ,CAAC,kBAAkB,SAAqC;IAEhE,QAAQ,CAAC,eAAe,WAA8C;IAEtE,MAAM,CAAC,WAAW,EAAE,MAAM,GAAG,OAAO;IAwBpC,eAAe,CAAC,QAAQ,EAAE,MAAM,EAAE,OAAO,CAAC,EAAE,UAAU,GAAG,UAAU;CAqBtE"}

package/dist/adapters/cypress.js

@@ -0,0 +1,86 @@
+"use strict";
+// Copyright (c) 2015-present Mattermost, Inc. All Rights Reserved.
+// See LICENSE.txt for license information.
+var __createBinding = (this && this.__createBinding) || (Object.create ? (function(o, m, k, k2) {
+    if (k2 === undefined) k2 = k;
+    var desc = Object.getOwnPropertyDescriptor(m, k);
+    if (!desc || ("get" in desc ? !m.__esModule : desc.writable || desc.configurable)) {
+      desc = { enumerable: true, get: function() { return m[k]; } };
+    }
+    Object.defineProperty(o, k2, desc);
+}) : (function(o, m, k, k2) {
+    if (k2 === undefined) k2 = k;
+    o[k2] = m[k];
+}));
+var __setModuleDefault = (this && this.__setModuleDefault) || (Object.create ? (function(o, v) {
+    Object.defineProperty(o, "default", { enumerable: true, value: v });
+}) : function(o, v) {
+    o["default"] = v;
+});
+var __importStar = (this && this.__importStar) || (function () {
+    var ownKeys = function(o) {
+        ownKeys = Object.getOwnPropertyNames || function (o) {
+            var ar = [];
+            for (var k in o) if (Object.prototype.hasOwnProperty.call(o, k)) ar[ar.length] = k;
+            return ar;
+        };
+        return ownKeys(o);
+    };
+    return function (mod) {
+        if (mod && mod.__esModule) return mod;
+        var result = {};
+        if (mod != null) for (var k = ownKeys(mod), i = 0; i < k.length; i++) if (k[i] !== "default") __createBinding(result, mod, k[i]);
+        __setModuleDefault(result, mod);
+        return result;
+    };
+})();
+Object.defineProperty(exports, "__esModule", { value: true });
+exports.CypressAdapter = void 0;
+/**
+ * Cypress Adapter — FrameworkAdapter implementation for Cypress.
+ */
+const fs = __importStar(require("node:fs"));
+const path = __importStar(require("node:path"));
+class CypressAdapter {
+    constructor() {
+        this.name = 'cypress';
+        this.specGlob = '**/*.cy.{ts,js,tsx,jsx}';
+        this.extractTestPattern = /\b(?:it|describe|context)\s*\(/g;
+        this.configFileNames = ['cypress.config.ts', 'cypress.config.js'];
+    }
+    detect(projectRoot) {
+        const pkgPath = path.join(projectRoot, 'package.json');
+        if (!fs.existsSync(pkgPath)) {
+            return false;
+        }
+        try {
+            const raw = fs.readFileSync(pkgPath, 'utf-8');
+            const pkg = JSON.parse(raw);
+            const allDeps = {
+                ...pkg.dependencies,
+                ...pkg.devDependencies,
+            };
+            return 'cypress' in allDeps;
+        }
+        catch {
+            return false;
+        }
+    }
+    buildRunCommand(specPath, options) {
+        const args = ['cypress', 'run', '--spec', specPath];
+        if (options?.headed) {
+            args.push('--headed');
+        }
+        if (options?.browser) {
+            args.push('--browser', options.browser);
+        }
+        if (options?.project) {
+            args.push('--project', options.project);
+        }
+        if (options?.timeout != null) {
+            args.push('--config', `defaultCommandTimeout=${options.timeout}`);
+        }
+        return { executable: 'npx', args };
+    }
+}
+exports.CypressAdapter = CypressAdapter;

package/dist/adapters/framework_adapter.d.ts

@@ -0,0 +1,41 @@
+import type { KnowledgeGraph } from '../knowledge/kg_types.js';
+import type { TestType } from '../knowledge/route_families.js';
+/** Shared framework name lists used for test-mode detection across the codebase. */
+export declare const UI_FRAMEWORKS: readonly ["playwright", "@playwright/test", "cypress", "selenium"];
+export declare const API_FRAMEWORKS: readonly ["supertest", "pytest", "requests", "vitest", "jest"];
+export interface RunOptions {
+    headed?: boolean;
+    browser?: string;
+    project?: string;
+    timeout?: number;
+}
+export interface RunCommand {
+    executable: string;
+    args: string[];
+}
+export interface FrameworkAdapter {
+    /** Human-readable framework identifier (e.g. 'playwright', 'cypress'). */
+    name: string;
+    /** Return true when `projectRoot` appears to use this framework. */
+    detect(projectRoot: string): boolean;
+    /** Glob that matches spec files for this framework. */
+    specGlob: string;
+    /** Regex that extracts test blocks from source text. */
+    extractTestPattern: RegExp;
+    /** Possible config file names to look for at the project root. */
+    configFileNames: string[];
+    /** Build a structured command to execute a single spec file. */
+    buildRunCommand(specPath: string, options?: RunOptions): RunCommand;
+}
+/**
+ * Auto-detect which test framework a project uses by inspecting its
+ * package.json dependencies.  Falls back to Playwright when detection
+ * is inconclusive.
+ */
+export declare function detectFramework(projectRoot: string): FrameworkAdapter;
+/**
+ * Detect the test mode for a project: UI testing, API testing, or both.
+ * Uses package.json / pyproject.toml dependencies and optional KG metadata.
+ */
+export declare function detectTestMode(projectRoot: string, kg?: KnowledgeGraph | null): TestType;
+//# sourceMappingURL=framework_adapter.d.ts.map

package/dist/adapters/framework_adapter.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"framework_adapter.d.ts","sourceRoot":"","sources":["../../src/adapters/framework_adapter.ts"],"names":[],"mappings":"AAeA,OAAO,KAAK,EAAC,cAAc,EAAC,MAAM,0BAA0B,CAAC;AAC7D,OAAO,KAAK,EAAC,QAAQ,EAAC,MAAM,gCAAgC,CAAC;AAE7D,oFAAoF;AACpF,eAAO,MAAM,aAAa,oEAAqE,CAAC;AAChG,eAAO,MAAM,cAAc,gEAAiE,CAAC;AAE7F,MAAM,WAAW,UAAU;IACvB,MAAM,CAAC,EAAE,OAAO,CAAC;IACjB,OAAO,CAAC,EAAE,MAAM,CAAC;IACjB,OAAO,CAAC,EAAE,MAAM,CAAC;IACjB,OAAO,CAAC,EAAE,MAAM,CAAC;CACpB;AAED,MAAM,WAAW,UAAU;IACvB,UAAU,EAAE,MAAM,CAAC;IACnB,IAAI,EAAE,MAAM,EAAE,CAAC;CAClB;AAED,MAAM,WAAW,gBAAgB;IAC7B,0EAA0E;IAC1E,IAAI,EAAE,MAAM,CAAC;IAEb,oEAAoE;IACpE,MAAM,CAAC,WAAW,EAAE,MAAM,GAAG,OAAO,CAAC;IAErC,uDAAuD;IACvD,QAAQ,EAAE,MAAM,CAAC;IAEjB,wDAAwD;IACxD,kBAAkB,EAAE,MAAM,CAAC;IAE3B,kEAAkE;IAClE,eAAe,EAAE,MAAM,EAAE,CAAC;IAE1B,gEAAgE;IAChE,eAAe,CAAC,QAAQ,EAAE,MAAM,EAAE,OAAO,CAAC,EAAE,UAAU,GAAG,UAAU,CAAC;CACvE;AAED;;;;GAIG;AACH,wBAAgB,eAAe,CAAC,WAAW,EAAE,MAAM,GAAG,gBAAgB,CAiDrE;AAED;;;GAGG;AACH,wBAAgB,cAAc,CAAC,WAAW,EAAE,MAAM,EAAE,EAAE,CAAC,EAAE,cAAc,GAAG,IAAI,GAAG,QAAQ,CAgDxF"}

package/dist/adapters/framework_adapter.js

@@ -0,0 +1,152 @@
+"use strict";
+// Copyright (c) 2015-present Mattermost, Inc. All Rights Reserved.
+// See LICENSE.txt for license information.
+var __createBinding = (this && this.__createBinding) || (Object.create ? (function(o, m, k, k2) {
+    if (k2 === undefined) k2 = k;
+    var desc = Object.getOwnPropertyDescriptor(m, k);
+    if (!desc || ("get" in desc ? !m.__esModule : desc.writable || desc.configurable)) {
+      desc = { enumerable: true, get: function() { return m[k]; } };
+    }
+    Object.defineProperty(o, k2, desc);
+}) : (function(o, m, k, k2) {
+    if (k2 === undefined) k2 = k;
+    o[k2] = m[k];
+}));
+var __setModuleDefault = (this && this.__setModuleDefault) || (Object.create ? (function(o, v) {
+    Object.defineProperty(o, "default", { enumerable: true, value: v });
+}) : function(o, v) {
+    o["default"] = v;
+});
+var __importStar = (this && this.__importStar) || (function () {
+    var ownKeys = function(o) {
+        ownKeys = Object.getOwnPropertyNames || function (o) {
+            var ar = [];
+            for (var k in o) if (Object.prototype.hasOwnProperty.call(o, k)) ar[ar.length] = k;
+            return ar;
+        };
+        return ownKeys(o);
+    };
+    return function (mod) {
+        if (mod && mod.__esModule) return mod;
+        var result = {};
+        if (mod != null) for (var k = ownKeys(mod), i = 0; i < k.length; i++) if (k[i] !== "default") __createBinding(result, mod, k[i]);
+        __setModuleDefault(result, mod);
+        return result;
+    };
+})();
+Object.defineProperty(exports, "__esModule", { value: true });
+exports.API_FRAMEWORKS = exports.UI_FRAMEWORKS = void 0;
+exports.detectFramework = detectFramework;
+exports.detectTestMode = detectTestMode;
+/**
+ * Framework Adapter Interface — abstracts test-framework-specific logic
+ * behind a uniform contract so the rest of the pipeline is framework-agnostic.
+ */
+const fs = __importStar(require("node:fs"));
+const path = __importStar(require("node:path"));
+const playwright_js_1 = require("./playwright.js");
+const cypress_js_1 = require("./cypress.js");
+const supertest_js_1 = require("./supertest.js");
+const pytest_js_1 = require("./pytest.js");
+/** Shared framework name lists used for test-mode detection across the codebase. */
+exports.UI_FRAMEWORKS = ['playwright', '@playwright/test', 'cypress', 'selenium'];
+exports.API_FRAMEWORKS = ['supertest', 'pytest', 'requests', 'vitest', 'jest'];
+/**
+ * Auto-detect which test framework a project uses by inspecting its
+ * package.json dependencies.  Falls back to Playwright when detection
+ * is inconclusive.
+ */
+function detectFramework(projectRoot) {
+    const pkgPath = path.join(projectRoot, 'package.json');
+    if (fs.existsSync(pkgPath)) {
+        try {
+            const raw = fs.readFileSync(pkgPath, 'utf-8');
+            const pkg = JSON.parse(raw);
+            const allDeps = {
+                ...pkg.dependencies,
+                ...pkg.devDependencies,
+            };
+            if ('@playwright/test' in allDeps) {
+                return new playwright_js_1.PlaywrightAdapter();
+            }
+            if ('cypress' in allDeps) {
+                return new cypress_js_1.CypressAdapter();
+            }
+            // Backend API test frameworks
+            if ('supertest' in allDeps) {
+                const runner = 'vitest' in allDeps ? 'vitest' : 'jest';
+                return new supertest_js_1.SupertestAdapter(runner);
+            }
+        }
+        catch {
+            // Malformed package.json — fall through to default.
+        }
+    }
+    // Check for Python project
+    const pyprojectPath = path.join(projectRoot, 'pyproject.toml');
+    if (fs.existsSync(pyprojectPath)) {
+        try {
+            const content = fs.readFileSync(pyprojectPath, 'utf-8');
+            if (content.includes('pytest')) {
+                return new pytest_js_1.PytestAdapter();
+            }
+        }
+        catch {
+            // fall through
+        }
+    }
+    // Default to Playwright when we cannot determine the framework.
+    return new playwright_js_1.PlaywrightAdapter();
+}
+/**
+ * Detect the test mode for a project: UI testing, API testing, or both.
+ * Uses package.json / pyproject.toml dependencies and optional KG metadata.
+ */
+function detectTestMode(projectRoot, kg) {
+    // If KG provides framework hints, use them
+    if (kg) {
+        const frameworks = kg.project.frameworks.map((f) => f.toLowerCase());
+        const uiSet = new Set(exports.UI_FRAMEWORKS);
+        const apiSet = new Set(exports.API_FRAMEWORKS);
+        const hasUi = frameworks.some((f) => uiSet.has(f));
+        const hasApi = frameworks.some((f) => apiSet.has(f));
+        if (hasUi && hasApi)
+            return 'both';
+        if (hasApi)
+            return 'api';
+        if (hasUi)
+            return 'ui';
+    }
+    // Fall back to package.json inspection
+    const pkgPath = path.join(projectRoot, 'package.json');
+    if (fs.existsSync(pkgPath)) {
+        try {
+            const raw = fs.readFileSync(pkgPath, 'utf-8');
+            const pkg = JSON.parse(raw);
+            const allDeps = { ...pkg.dependencies, ...pkg.devDependencies };
+            const hasUi = '@playwright/test' in allDeps || 'cypress' in allDeps;
+            const hasApi = 'supertest' in allDeps;
+            if (hasUi && hasApi)
+                return 'both';
+            if (hasApi)
+                return 'api'; // supertest alone means API-only when no UI framework is present
+        }
+        catch {
+            // fall through
+        }
+    }
+    // Check for Python API testing
+    const pyprojectPath = path.join(projectRoot, 'pyproject.toml');
+    if (fs.existsSync(pyprojectPath)) {
+        try {
+            const content = fs.readFileSync(pyprojectPath, 'utf-8');
+            if (content.includes('pytest') && !fs.existsSync(path.join(projectRoot, 'package.json'))) {
+                return 'api';
+            }
+        }
+        catch {
+            // fall through
+        }
+    }
+    return 'ui';
+}

package/dist/adapters/playwright.d.ts

@@ -0,0 +1,10 @@
+import type { FrameworkAdapter, RunCommand, RunOptions } from './framework_adapter.js';
+export declare class PlaywrightAdapter implements FrameworkAdapter {
+    readonly name = "playwright";
+    readonly specGlob = "**/*.spec.{ts,js}";
+    readonly extractTestPattern: RegExp;
+    readonly configFileNames: string[];
+    detect(projectRoot: string): boolean;
+    buildRunCommand(specPath: string, options?: RunOptions): RunCommand;
+}
+//# sourceMappingURL=playwright.d.ts.map

package/dist/adapters/playwright.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"playwright.d.ts","sourceRoot":"","sources":["../../src/adapters/playwright.ts"],"names":[],"mappings":"AAUA,OAAO,KAAK,EAAC,gBAAgB,EAAE,UAAU,EAAE,UAAU,EAAC,MAAM,wBAAwB,CAAC;AAErF,qBAAa,iBAAkB,YAAW,gBAAgB;IACtD,QAAQ,CAAC,IAAI,gBAAgB;IAE7B,QAAQ,CAAC,QAAQ,uBAAuB;IAExC,QAAQ,CAAC,kBAAkB,SAAiC;IAE5D,QAAQ,CAAC,eAAe,WAAoD;IAE5E,MAAM,CAAC,WAAW,EAAE,MAAM,GAAG,OAAO;IAwBpC,eAAe,CAAC,QAAQ,EAAE,MAAM,EAAE,OAAO,CAAC,EAAE,UAAU,GAAG,UAAU;CAqBtE"}

package/dist/adapters/playwright.js

@@ -0,0 +1,86 @@
+"use strict";
+// Copyright (c) 2015-present Mattermost, Inc. All Rights Reserved.
+// See LICENSE.txt for license information.
+var __createBinding = (this && this.__createBinding) || (Object.create ? (function(o, m, k, k2) {
+    if (k2 === undefined) k2 = k;
+    var desc = Object.getOwnPropertyDescriptor(m, k);
+    if (!desc || ("get" in desc ? !m.__esModule : desc.writable || desc.configurable)) {
+      desc = { enumerable: true, get: function() { return m[k]; } };
+    }
+    Object.defineProperty(o, k2, desc);
+}) : (function(o, m, k, k2) {
+    if (k2 === undefined) k2 = k;
+    o[k2] = m[k];
+}));
+var __setModuleDefault = (this && this.__setModuleDefault) || (Object.create ? (function(o, v) {
+    Object.defineProperty(o, "default", { enumerable: true, value: v });
+}) : function(o, v) {
+    o["default"] = v;
+});
+var __importStar = (this && this.__importStar) || (function () {
+    var ownKeys = function(o) {
+        ownKeys = Object.getOwnPropertyNames || function (o) {
+            var ar = [];
+            for (var k in o) if (Object.prototype.hasOwnProperty.call(o, k)) ar[ar.length] = k;
+            return ar;
+        };
+        return ownKeys(o);
+    };
+    return function (mod) {
+        if (mod && mod.__esModule) return mod;
+        var result = {};
+        if (mod != null) for (var k = ownKeys(mod), i = 0; i < k.length; i++) if (k[i] !== "default") __createBinding(result, mod, k[i]);
+        __setModuleDefault(result, mod);
+        return result;
+    };
+})();
+Object.defineProperty(exports, "__esModule", { value: true });
+exports.PlaywrightAdapter = void 0;
+/**
+ * Playwright Adapter — FrameworkAdapter implementation for @playwright/test.
+ */
+const fs = __importStar(require("node:fs"));
+const path = __importStar(require("node:path"));
+class PlaywrightAdapter {
+    constructor() {
+        this.name = 'playwright';
+        this.specGlob = '**/*.spec.{ts,js}';
+        this.extractTestPattern = /\btest(?:\.describe)?\s*\(/g;
+        this.configFileNames = ['playwright.config.ts', 'playwright.config.js'];
+    }
+    detect(projectRoot) {
+        const pkgPath = path.join(projectRoot, 'package.json');
+        if (!fs.existsSync(pkgPath)) {
+            return false;
+        }
+        try {
+            const raw = fs.readFileSync(pkgPath, 'utf-8');
+            const pkg = JSON.parse(raw);
+            const allDeps = {
+                ...pkg.dependencies,
+                ...pkg.devDependencies,
+            };
+            return '@playwright/test' in allDeps;
+        }
+        catch {
+            return false;
+        }
+    }
+    buildRunCommand(specPath, options) {
+        const args = ['playwright', 'test', specPath];
+        if (options?.headed) {
+            args.push('--headed');
+        }
+        if (options?.browser) {
+            args.push('--browser', options.browser);
+        }
+        if (options?.project) {
+            args.push('--project', options.project);
+        }
+        if (options?.timeout != null) {
+            args.push('--timeout', String(options.timeout));
+        }
+        return { executable: 'npx', args };
+    }
+}
+exports.PlaywrightAdapter = PlaywrightAdapter;

package/dist/adapters/pytest.d.ts

@@ -0,0 +1,10 @@
+import type { FrameworkAdapter, RunCommand, RunOptions } from './framework_adapter.js';
+export declare class PytestAdapter implements FrameworkAdapter {
+    name: string;
+    specGlob: string;
+    extractTestPattern: RegExp;
+    configFileNames: string[];
+    detect(projectRoot: string): boolean;
+    buildRunCommand(specPath: string, options?: RunOptions): RunCommand;
+}
+//# sourceMappingURL=pytest.d.ts.map

package/dist/adapters/pytest.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"pytest.d.ts","sourceRoot":"","sources":["../../src/adapters/pytest.ts"],"names":[],"mappings":"AAUA,OAAO,KAAK,EAAC,gBAAgB,EAAE,UAAU,EAAE,UAAU,EAAC,MAAM,wBAAwB,CAAC;AAErF,qBAAa,aAAc,YAAW,gBAAgB;IAClD,IAAI,SAAY;IAChB,QAAQ,SAAkB;IAC1B,kBAAkB,SAAuB;IACzC,eAAe,WAAgE;IAE/E,MAAM,CAAC,WAAW,EAAE,MAAM,GAAG,OAAO;IAkCpC,eAAe,CAAC,QAAQ,EAAE,MAAM,EAAE,OAAO,CAAC,EAAE,UAAU,GAAG,UAAU;CAOtE"}