playwright 1.56.0-alpha-2025-09-18 → 1.56.0-alpha-1758292576000

package/lib/agents/generator.md

@@ -27,57 +27,96 @@ tools:
   - playwright-test/test_setup_page
 ---
 
-You are a Playwright Test Generator, an expert in browser automation and end-to-end testing. Your specialty is creating robust, reliable Playwright tests that accurately simulate user interactions and validate application behavior.
+You are a Playwright Test Generator, an expert in browser automation and end-to-end testing.
+Your specialty is creating robust, reliable Playwright tests that accurately simulate user interactions and validate
+application behavior.
 
 Your process is methodical and thorough:
 
-1. **Scenario Analysis**: Carefully analyze the test scenario provided, identifying all user actions, expected outcomes, and validation points. Break down complex flows into discrete, testable steps.
+1. **Scenario Analysis**
+   - Carefully analyze the test scenario provided, identifying all user actions,
+     expected outcomes and validation points
 
-2. **Interactive Execution**:
-   - For each test, start with the `test_setup_page` tool to set up page for the scenario
+2. **Interactive Execution**
+   - For each scenario, start with the `test_setup_page` tool to set up page for the scenario
    - Use Playwright tools to manually execute each step of the scenario in real-time
    - Verify that each action works as expected
    - Identify the correct locators and interaction patterns
    - Observe actual application behavior and responses
-   - Catch potential timing issues or dynamic content
    - Validate that assertions will work correctly
 
-3. **Test Code Generation**: After successfully completing the manual execution, generate clean, maintainable @playwright/test source code that:
-   - Uses descriptive test names that clearly indicate what is being tested
-   - Implements proper page object patterns when beneficial
-   - Includes appropriate waits and assertions
-   - Handles dynamic content and loading states
-   - Uses reliable locators (preferring data-testid, role-based, or text-based selectors over fragile CSS selectors)
-   - Includes proper setup and teardown
-   - Is self-contained and can run independently
-   - Use explicit waits rather than arbitrary timeouts
-   - Never wait for networkidle or use other discouraged or deprecated apis
+3. **Test Code Generation**
+
+   After successfully completing the manual execution, generate clean, maintainable
+   @playwright/test source code that follows following convention:
+
+   - One file per scenario, one test in a file
+   - File name must be fs-friendly scenario name
+   - Test must be placed in a describe matching the top-level test plan item
+   - Test title must match the scenario name
+   - Includes a comment with the step text before each step execution
+
+   <example-generation>
+   For following plan:
+
+   ```markdown file=specs/plan.md
+   ### 1. Adding New Todos
+   **Seed:** `tests/seed.spec.ts`
+
+   #### 1.1 Add Valid Todo
+   **Steps:**
+   1. Click in the "What needs to be done?" input field
+
+   #### 1.2 Add Multiple Todos
+   ...
+   ```
 
-4. **Quality Assurance**: Ensure each generated test:
-   - Has clear, descriptive assertions that validate the expected behavior
+   Following file is generated:
+
+   ```ts file=add-valid-todo.spec.ts
+   // spec: specs/plan.md
+   // seed: tests/seed.spec.ts
+
+   test.describe('Adding New Todos', () => {
+     test('Add Valid Todo', async { page } => {
+       // 1. Click in the "What needs to be done?" input field
+       await page.click(...);
+
+       ...
+     });
+   });
+   ```
+   </example-generation>
+
+4. **Best practices**:
+   - Each test has clear, descriptive assertions that validate the expected behavior
    - Includes proper error handling and meaningful failure messages
    - Uses Playwright best practices (page.waitForLoadState, expect.toBeVisible, etc.)
+   - Do not improvise, do not add directives that were not asked for
+   - Uses reliable locators (preferring data-testid, role-based, or text-based selectors over fragile CSS selectors)
+   - Uses local variables for locators that are used multiple times
+   - Uses explicit waits rather than arbitrary timeouts
+   - Never waits for networkidle or use other discouraged or deprecated apis
+   - Is self-contained and can run independently
    - Is deterministic and not prone to flaky behavior
-   - Follows consistent naming conventions and code structure
-
-5. **Browser Management**: Always close the browser after completing the scenario and generating the test code.
-
-Your goal is to produce production-ready Playwright tests that provide reliable validation of application functionality while being maintainable and easy to understand.
-Process all scenarios sequentially, do not run in parallel. Save tests in the tests/ folder.
 
 <example>
   Context: User wants to test a login flow on their web application.
-  user: 'I need a test that logs into my app at localhost:3000 with username admin@test.com and password 123456, then verifies the  dashboard page loads'
+  user: 'I need a test that logs into my app at localhost:3000 with username admin@test.com and password 123456, then
+  verifies the  dashboard page loads'
   assistant: 'I'll use the playwright-test-generator agent to create and validate this login test for you'
   <commentary>
-    The user needs a specific browser automation test created, which is exactly what the playwright-test-generator agent is designed for.
+    The user needs a specific browser automation test created, which is exactly what the playwright-test-generator agent
+    is designed for.
   </commentary>
 </example>
 <example>
   Context: User has built a new checkout flow and wants to ensure it works correctly.
-  user: 'Can you create a test that adds items to cart, proceeds to checkout, fills in payment details, and confirms the order?'
+  user: 'Can you create a test that adds items to cart, proceeds to checkout, fills in payment details, and confirms the
+  order?'
   assistant: 'I'll use the playwright-test-generator agent to build a comprehensive checkout flow test'
   <commentary>
-    This is a complex user journey that needs to be automated and tested, perfect for the playwright-test-generator agent.
+    This is a complex user journey that needs to be automated and tested, perfect for the playwright-test-generator
+    agent.
   </commentary>
 </example>

package/lib/agents/healer.md

@@ -49,7 +49,9 @@ Key principles:
 - If multiple errors exist, fix them one at a time and retest
 - Provide clear explanations of what was broken and how you fixed it
 - You will continue this process until the test runs successfully without any failures or errors.
-- If the error persists and you have high level of confidence that the test is correct, mark this test as test.fixme() so that it is skipped during the execution. Add a comment before the failing step explaining what is happening instead of the expected behavior.
+- If the error persists and you have high level of confidence that the test is correct, mark this test as test.fixme()
+  so that it is skipped during the execution. Add a comment before the failing step explaining what is happening instead
+  of the expected behavior.
 - Do not ask user questions, you are not interactive tool, do the most reasonable thing possible to pass the test.
 - Never wait for networkidle or use other discouraged or deprecated apis
 

package/lib/agents/planner.md

@@ -28,46 +28,97 @@ tools:
   - playwright-test/test_setup_page
 ---
 
-You are an expert web test planner with extensive experience in quality assurance, user experience testing, and test scenario design. Your expertise includes functional testing, usability testing, edge case identification, and comprehensive test coverage planning.
+You are an expert web test planner with extensive experience in quality assurance, user experience testing, and test
+scenario design. Your expertise includes functional testing, edge case identification, and comprehensive test coverage
+planning.
 
-When given a target web page or application, you will:
+You will:
 
-1. **Navigate and Explore**:
+1. **Navigate and Explore**
    - Invoke the `test_setup_page` tool once to set up page before using any other tools
-   - Explore the aria snapshot, use browser_* tools to navigate and discover interface.
+   - Explore the browser snapshot
+   - Do not take screenshots unless absolutely necessary
+   - Use browser_* tools to navigate and discover interface
    - Thoroughly explore the interface, identifying all interactive elements, forms, navigation paths, and functionality
 
-2. **Analyze User Flows**: Map out the primary user journeys and identify critical paths through the application. Consider different user types and their typical behaviors.
+2. **Analyze User Flows**
+   - Map out the primary user journeys and identify critical paths through the application
+   - Consider different user types and their typical behaviors
 
-3. **Design Comprehensive Scenarios**: Create detailed test scenarios that cover:
+3. **Design Comprehensive Scenarios**
+
+   Create detailed test scenarios that cover:
    - Happy path scenarios (normal user behavior)
    - Edge cases and boundary conditions
    - Error handling and validation
 
-4. **Structure Test Plans**: Each scenario must include:
+4. **Structure Test Plans**
+
+   Each scenario must include:
    - Clear, descriptive title
    - Detailed step-by-step instructions
    - Expected outcomes where appropriate
    - Assumptions about starting state (always assume blank/fresh state)
    - Success criteria and failure conditions
 
-5. **Create Documentation**: Save your test plan as a markdown file in specs/ folder with:
+5. **Create Documentation**
+
+   Save your test plan as requested:
    - Executive summary of the tested page/application
    - Individual scenarios as separate sections
    - Each scenario formatted with numbered steps
    - Clear expected results for verification
 
+<example-spec>
+# TodoMVC Application - Comprehensive Test Plan
+
+## Application Overview
+
+The TodoMVC application is a React-based todo list manager that provides core task management functionality. The
+application features:
+
+- **Task Management**: Add, edit, complete, and delete individual todos
+- **Bulk Operations**: Mark all todos as complete/incomplete and clear all completed todos
+- **Filtering**: View todos by All, Active, or Completed status
+- **URL Routing**: Support for direct navigation to filtered views via URLs
+- **Counter Display**: Real-time count of active (incomplete) todos
+- **Persistence**: State maintained during session (browser refresh behavior not tested)
+
+## Test Scenarios
+
+### 1. Adding New Todos
+
+**Seed:** `tests/seed.spec.ts`
+
+#### 1.1 Add Valid Todo
+**Steps:**
+1. Click in the "What needs to be done?" input field
+2. Type "Buy groceries"
+3. Press Enter key
+
+**Expected Results:**
+- Todo appears in the list with unchecked checkbox
+- Counter shows "1 item left"
+- Input field is cleared and ready for next entry
+- Todo list controls become visible (Mark all as complete checkbox)
+
+#### 1.2
+...
+</example-spec>
+
 **Quality Standards**:
 - Write steps that are specific enough for any tester to follow
 - Include negative testing scenarios
 - Ensure scenarios are independent and can be run in any order
 
-**Output Format**: Always save the complete test plan as a markdown file with clear headings, numbered steps, and professional formatting suitable for sharing with development and QA teams.
+**Output Format**: Always save the complete test plan as a markdown file with clear headings, numbered steps, and
+professional formatting suitable for sharing with development and QA teams.
 
 <example>
   Context: User wants to test a new e-commerce checkout flow.
   user: 'I need test scenarios for our new checkout process at https://mystore.com/checkout'
-  assistant: 'I'll use the playwright-test-planner agent to navigate to your checkout page and create comprehensive test scenarios.'
+  assistant: 'I'll use the playwright-test-planner agent to navigate to your checkout page and create comprehensive test
+  scenarios.'
   <commentary>
     The user needs test planning for a specific web page, so use the playwright-test-planner agent to explore and create
     test scenarios.
@@ -76,7 +127,8 @@ When given a target web page or application, you will:
 <example>
   Context: User has deployed a new feature and wants thorough testing coverage.
   user: 'Can you help me test our new user dashboard at https://app.example.com/dashboard?'
-  assistant: 'I'll launch the playwright-test-planner agent to explore your dashboard and develop detailed test scenarios.'
+  assistant: 'I'll launch the playwright-test-planner agent to explore your dashboard and develop detailed test
+  scenarios.'
   <commentary>
     This requires web exploration and test scenario creation, perfect for the playwright-test-planner agent.
   </commentary>

package/lib/mcp/browser/browserContextFactory.js

@@ -28,6 +28,7 @@ var __toESM = (mod, isNodeMode, target) => (target = mod != null ? __create(__ge
 var __toCommonJS = (mod) => __copyProps(__defProp({}, "__esModule", { value: true }), mod);
 var browserContextFactory_exports = {};
 __export(browserContextFactory_exports, {
+  SharedContextFactory: () => SharedContextFactory,
   contextFactory: () => contextFactory
 });
 module.exports = __toCommonJS(browserContextFactory_exports);
@@ -42,6 +43,8 @@ var import_log = require("../log");
 var import_config = require("./config");
 var import_server2 = require("../sdk/server");
 function contextFactory(config) {
+  if (config.sharedBrowserContext)
+    return SharedContextFactory.create(config);
   if (config.browser.remoteEndpoint)
     return new RemoteContextFactory(config);
   if (config.browser.cdpEndpoint)
@@ -231,7 +234,46 @@ async function startTraceServer(config, tracesDir) {
 function createHash(data) {
   return import_crypto.default.createHash("sha256").update(data).digest("hex").slice(0, 7);
 }
+class SharedContextFactory {
+  static create(config) {
+    if (SharedContextFactory._instance)
+      throw new Error("SharedContextFactory already exists");
+    const baseConfig = { ...config, sharedBrowserContext: false };
+    const baseFactory = contextFactory(baseConfig);
+    SharedContextFactory._instance = new SharedContextFactory(baseFactory);
+    return SharedContextFactory._instance;
+  }
+  constructor(baseFactory) {
+    this._baseFactory = baseFactory;
+  }
+  async createContext(clientInfo, abortSignal, toolName) {
+    if (!this._contextPromise) {
+      (0, import_log.testDebug)("create shared browser context");
+      this._contextPromise = this._baseFactory.createContext(clientInfo, abortSignal, toolName);
+    }
+    const { browserContext } = await this._contextPromise;
+    (0, import_log.testDebug)(`shared context client connected`);
+    return {
+      browserContext,
+      close: async () => {
+        (0, import_log.testDebug)(`shared context client disconnected`);
+      }
+    };
+  }
+  static async dispose() {
+    await SharedContextFactory._instance?._dispose();
+  }
+  async _dispose() {
+    const contextPromise = this._contextPromise;
+    this._contextPromise = void 0;
+    if (!contextPromise)
+      return;
+    const { close } = await contextPromise;
+    await close();
+  }
+}
 // Annotate the CommonJS export names for ESM import in node:
 0 && (module.exports = {
+  SharedContextFactory,
   contextFactory
 });

package/lib/mcp/browser/config.js

@@ -164,6 +164,7 @@ function configFromCLIOptions(cliOptions) {
     saveSession: cliOptions.saveSession,
     saveTrace: cliOptions.saveTrace,
     secrets: cliOptions.secrets,
+    sharedBrowserContext: cliOptions.sharedBrowserContext,
     outputDir: cliOptions.outputDir,
     imageResponses: cliOptions.imageResponses,
     timeouts: {

package/lib/mcp/browser/watchdog.js

@@ -21,6 +21,7 @@ __export(watchdog_exports, {
   setupExitWatchdog: () => setupExitWatchdog
 });
 module.exports = __toCommonJS(watchdog_exports);
+var import_browserContextFactory = require("./browserContextFactory");
 var import_context = require("./context");
 function setupExitWatchdog() {
   let isExiting = false;
@@ -30,6 +31,7 @@ function setupExitWatchdog() {
     isExiting = true;
     setTimeout(() => process.exit(0), 15e3);
     await import_context.Context.disposeAll();
+    await import_browserContextFactory.SharedContextFactory.dispose();
     process.exit(0);
   };
   process.stdin.on("close", handleExit);

package/lib/mcp/program.js

@@ -41,7 +41,7 @@ var import_browserServerBackend = require("./browser/browserServerBackend");
 var import_extensionContextFactory = require("./extension/extensionContextFactory");
 var import_host = require("./vscode/host");
 function decorateCommand(command, version) {
-  command.option("--allowed-origins <origins>", "semicolon-separated list of origins to allow the browser to request. Default is to allow all.", import_config.semicolonSeparatedList).option("--blocked-origins <origins>", "semicolon-separated list of origins to block the browser from requesting. Blocklist is evaluated before allowlist. If used without the allowlist, requests not matching the blocklist are still allowed.", import_config.semicolonSeparatedList).option("--block-service-workers", "block service workers").option("--browser <browser>", "browser or chrome channel to use, possible values: chrome, firefox, webkit, msedge.").option("--caps <caps>", "comma-separated list of additional capabilities to enable, possible values: vision, pdf.", import_config.commaSeparatedList).option("--cdp-endpoint <endpoint>", "CDP endpoint to connect to.").option("--cdp-header <headers...>", "CDP headers to send with the connect request, multiple can be specified.", import_config.headerParser).option("--config <path>", "path to the configuration file.").option("--device <device>", 'device to emulate, for example: "iPhone 15"').option("--executable-path <path>", "path to the browser executable.").option("--extension", 'Connect to a running browser instance (Edge/Chrome only). Requires the "Playwright MCP Bridge" browser extension to be installed.').option("--grant-permissions <permissions...>", 'List of permissions to grant to the browser context, for example "geolocation", "clipboard-read", "clipboard-write".', import_config.commaSeparatedList).option("--headless", "run browser in headless mode, headed by default").option("--host <host>", "host to bind server to. Default is localhost. Use 0.0.0.0 to bind to all interfaces.").option("--ignore-https-errors", "ignore https errors").option("--isolated", "keep the browser profile in memory, do not save it to disk.").option("--image-responses <mode>", 'whether to send image responses to the client. Can be "allow" or "omit", Defaults to "allow".').option("--no-sandbox", "disable the sandbox for all process types that are normally sandboxed.").option("--output-dir <path>", "path to the directory for output files.").option("--port <port>", "port to listen on for SSE transport.").option("--proxy-bypass <bypass>", 'comma-separated domains to bypass proxy, for example ".com,chromium.org,.domain.com"').option("--proxy-server <proxy>", 'specify proxy server, for example "http://myproxy:3128" or "socks5://myproxy:8080"').option("--save-session", "Whether to save the Playwright MCP session into the output directory.").option("--save-trace", "Whether to save the Playwright Trace of the session into the output directory.").option("--secrets <path>", "path to a file containing secrets in the dotenv format", import_config.dotenvFileLoader).option("--storage-state <path>", "path to the storage state file for isolated sessions.").option("--timeout-action <timeout>", "specify action timeout in milliseconds, defaults to 5000ms", import_config.numberParser).option("--timeout-navigation <timeout>", "specify navigation timeout in milliseconds, defaults to 60000ms", import_config.numberParser).option("--user-agent <ua string>", "specify user agent string").option("--user-data-dir <path>", "path to the user data directory. If not specified, a temporary directory will be created.").option("--viewport-size <size>", 'specify browser viewport size in pixels, for example "1280, 720"').addOption(new import_utilsBundle.ProgramOption("--connect-tool", "Allow to switch between different browser connection methods.").hideHelp()).addOption(new import_utilsBundle.ProgramOption("--vscode", "VS Code tools.").hideHelp()).addOption(new import_utilsBundle.ProgramOption("--vision", "Legacy option, use --caps=vision instead").hideHelp()).action(async (options) => {
+  command.option("--allowed-origins <origins>", "semicolon-separated list of origins to allow the browser to request. Default is to allow all.", import_config.semicolonSeparatedList).option("--blocked-origins <origins>", "semicolon-separated list of origins to block the browser from requesting. Blocklist is evaluated before allowlist. If used without the allowlist, requests not matching the blocklist are still allowed.", import_config.semicolonSeparatedList).option("--block-service-workers", "block service workers").option("--browser <browser>", "browser or chrome channel to use, possible values: chrome, firefox, webkit, msedge.").option("--caps <caps>", "comma-separated list of additional capabilities to enable, possible values: vision, pdf.", import_config.commaSeparatedList).option("--cdp-endpoint <endpoint>", "CDP endpoint to connect to.").option("--cdp-header <headers...>", "CDP headers to send with the connect request, multiple can be specified.", import_config.headerParser).option("--config <path>", "path to the configuration file.").option("--device <device>", 'device to emulate, for example: "iPhone 15"').option("--executable-path <path>", "path to the browser executable.").option("--extension", 'Connect to a running browser instance (Edge/Chrome only). Requires the "Playwright MCP Bridge" browser extension to be installed.').option("--grant-permissions <permissions...>", 'List of permissions to grant to the browser context, for example "geolocation", "clipboard-read", "clipboard-write".', import_config.commaSeparatedList).option("--headless", "run browser in headless mode, headed by default").option("--host <host>", "host to bind server to. Default is localhost. Use 0.0.0.0 to bind to all interfaces.").option("--ignore-https-errors", "ignore https errors").option("--isolated", "keep the browser profile in memory, do not save it to disk.").option("--image-responses <mode>", 'whether to send image responses to the client. Can be "allow" or "omit", Defaults to "allow".').option("--no-sandbox", "disable the sandbox for all process types that are normally sandboxed.").option("--output-dir <path>", "path to the directory for output files.").option("--port <port>", "port to listen on for SSE transport.").option("--proxy-bypass <bypass>", 'comma-separated domains to bypass proxy, for example ".com,chromium.org,.domain.com"').option("--proxy-server <proxy>", 'specify proxy server, for example "http://myproxy:3128" or "socks5://myproxy:8080"').option("--save-session", "Whether to save the Playwright MCP session into the output directory.").option("--save-trace", "Whether to save the Playwright Trace of the session into the output directory.").option("--secrets <path>", "path to a file containing secrets in the dotenv format", import_config.dotenvFileLoader).option("--shared-browser-context", "reuse the same browser context between all connected HTTP clients.").option("--storage-state <path>", "path to the storage state file for isolated sessions.").option("--timeout-action <timeout>", "specify action timeout in milliseconds, defaults to 5000ms", import_config.numberParser).option("--timeout-navigation <timeout>", "specify navigation timeout in milliseconds, defaults to 60000ms", import_config.numberParser).option("--user-agent <ua string>", "specify user agent string").option("--user-data-dir <path>", "path to the user data directory. If not specified, a temporary directory will be created.").option("--viewport-size <size>", 'specify browser viewport size in pixels, for example "1280, 720"').addOption(new import_utilsBundle.ProgramOption("--connect-tool", "Allow to switch between different browser connection methods.").hideHelp()).addOption(new import_utilsBundle.ProgramOption("--vscode", "VS Code tools.").hideHelp()).addOption(new import_utilsBundle.ProgramOption("--vision", "Legacy option, use --caps=vision instead").hideHelp()).action(async (options) => {
     (0, import_watchdog.setupExitWatchdog)();
     if (options.vision) {
       console.error("The --vision option is deprecated, use --caps=vision instead");

package/lib/mcp/sdk/http.js

@@ -72,6 +72,12 @@ async function installHttpTransport(httpServer, serverBackendFactory) {
   const streamableSessions = /* @__PURE__ */ new Map();
   httpServer.on("request", async (req, res) => {
     const url = new URL(`http://localhost${req.url}`);
+    if (url.pathname === "/killkillkill" && req.method === "GET") {
+      res.statusCode = 200;
+      res.end("Killing process");
+      process.emit("SIGINT");
+      return;
+    }
     if (url.pathname.startsWith("/sse"))
       await handleSSE(serverBackendFactory, req, res, url, sseSessions);
     else

package/lib/mcp/sdk/server.js

@@ -82,7 +82,10 @@ const initializeServer = async (server, backend, runHeartbeat) => {
   const capabilities = server.getClientCapabilities();
   let clientRoots = [];
   if (capabilities?.roots) {
-    const { roots } = await server.listRoots();
+    const { roots } = await server.listRoots().catch((e) => {
+      serverDebug(e);
+      return { roots: [] };
+    });
     clientRoots = roots;
   }
   const clientInfo = {

package/lib/mcp/test/testTools.js

@@ -41,6 +41,7 @@ var import_bundle = require("../sdk/bundle");
 var import_base = require("../../reporters/base");
 var import_list = __toESM(require("../../reporters/list"));
 var import_listModeReporter = __toESM(require("../../reporters/listModeReporter"));
+var import_projectUtils = require("../../runner/projectUtils");
 var import_testTool = require("./testTool");
 var import_streams = require("./streams");
 const listTests = (0, import_testTool.defineTestTool)({
@@ -79,7 +80,8 @@ const runTests = (0, import_testTool.defineTestTool)({
     const testRunner = await context.createTestRunner();
     const result = await testRunner.runTests(reporter, {
       locations: params.locations,
-      projects: params.projects
+      projects: params.projects,
+      disableConfigReporters: true
     });
     const text = stream.content();
     return {
@@ -114,7 +116,8 @@ const debugTest = (0, import_testTool.defineTestTool)({
       // For automatic recovery
       timeout: 0,
       workers: 1,
-      pauseOnError: true
+      pauseOnError: true,
+      disableConfigReporters: true
     });
     const text = stream.content();
     return {
@@ -132,7 +135,7 @@ const setupPage = (0, import_testTool.defineTestTool)({
     description: "Setup the page for test",
     inputSchema: import_bundle.z.object({
       project: import_bundle.z.string().optional().describe('Project to use for setup. For example: "chromium", if no project is provided uses the first project in the config.'),
-      testLocation: import_bundle.z.string().optional().describe('Location of the test to use for setup. For example: "test/e2e/file.spec.ts:20". Sets up blank page if no location is provided.')
+      testLocation: import_bundle.z.string().optional().describe('Location of the seed test to use for setup. For example: "test/seed/default.spec.ts:20".')
     }),
     type: "readOnly"
   },
@@ -143,16 +146,17 @@ const setupPage = (0, import_testTool.defineTestTool)({
     const testRunner = await context.createTestRunner();
     let testLocation = params.testLocation;
     if (!testLocation) {
-      testLocation = ".template.spec.ts";
+      testLocation = "default.seed.spec.ts";
       const config = await testRunner.loadConfig();
-      const project = params.project ? config.projects.find((p) => p.project.name === params.project) : config.projects[0];
+      const project = params.project ? config.projects.find((p) => p.project.name === params.project) : (0, import_projectUtils.findTopLevelProjects)(config)[0];
       const testDir = project?.project.testDir || configDir;
-      const templateFile = import_path.default.join(testDir, testLocation);
-      if (!import_fs.default.existsSync(templateFile)) {
-        await import_fs.default.promises.writeFile(templateFile, `
-          import { test, expect } from '@playwright/test';
-            test('template', async ({ page }) => {});
-          `);
+      const seedFile = import_path.default.join(testDir, testLocation);
+      if (!import_fs.default.existsSync(seedFile)) {
+        await import_fs.default.promises.mkdir(import_path.default.dirname(seedFile), { recursive: true });
+        await import_fs.default.promises.writeFile(seedFile, `import { test, expect } from '@playwright/test';
+
+test('seed', async ({ page }) => {});
+`);
       }
     }
     const result = await testRunner.runTests(reporter, {
@@ -161,7 +165,8 @@ const setupPage = (0, import_testTool.defineTestTool)({
       projects: params.project ? [params.project] : void 0,
       timeout: 0,
       workers: 1,
-      pauseAtEnd: true
+      pauseAtEnd: true,
+      disableConfigReporters: true
     });
     const text = stream.content();
     return {

package/lib/program.js

@@ -173,15 +173,15 @@ function addTestMCPServerCommand(program3) {
 function addInitAgentsCommand(program3) {
   const command = program3.command("init-agents", { hidden: true });
   command.description("Initialize repository agents for the Claude Code");
-  command.option("--claude", "Initialize repository agents for the Claude Code");
-  command.option("--opencode", "Initialize repository agents for the Opencode");
-  command.option("--vscode", "Initialize repository agents for the VS Code Copilot");
+  const option = command.createOption("--loop <loop>", "Agentic loop provider");
+  option.choices(["claude", "opencode", "vscode"]);
+  command.addOption(option);
   command.action(async (opts) => {
-    if (opts.opencode)
+    if (opts.loop === "opencode")
       await (0, import_generateAgents.initOpencodeRepo)();
-    else if (opts.vscode)
+    else if (opts.loop === "vscode")
       await (0, import_generateAgents.initVSCodeRepo)();
-    else
+    else if (opts.loop === "claude")
       await (0, import_generateAgents.initClaudeCodeRepo)();
   });
 }

package/lib/reporters/html.js

@@ -119,10 +119,17 @@ class HtmlReporter {
     else if (process.env.PLAYWRIGHT_HTML_NO_COPY_PROMPT)
       noCopyPrompt = true;
     noCopyPrompt = noCopyPrompt || this._options.noCopyPrompt;
+    let noFiles;
+    if (process.env.PLAYWRIGHT_HTML_NO_FILES === "false" || process.env.PLAYWRIGHT_HTML_NO_FILES === "0")
+      noFiles = false;
+    else if (process.env.PLAYWRIGHT_HTML_NO_FILES)
+      noFiles = true;
+    noFiles = noFiles || this._options.noFiles;
     const builder = new HtmlBuilder(this.config, this._outputFolder, this._attachmentsBaseURL, {
       title: process.env.PLAYWRIGHT_HTML_TITLE || this._options.title,
       noSnippets,
-      noCopyPrompt
+      noCopyPrompt,
+      noFiles
     });
     this._buildResult = await builder.build(this.config.metadata, projectSuites, result, this._topLevelErrors);
   }
@@ -220,23 +227,21 @@ class HtmlBuilder {
   async build(metadata, projectSuites, result, topLevelErrors) {
     const data = /* @__PURE__ */ new Map();
     for (const projectSuite of projectSuites) {
+      const projectName = projectSuite.project().name;
       for (const fileSuite of projectSuite.suites) {
-        const fileName = this._relativeLocation(fileSuite.location).file;
-        const fileId = (0, import_utils.calculateSha1)((0, import_utils.toPosixPath)(fileName)).slice(0, 20);
-        let fileEntry = data.get(fileId);
-        if (!fileEntry) {
-          fileEntry = {
-            testFile: { fileId, fileName, tests: [] },
-            testFileSummary: { fileId, fileName, tests: [], stats: emptyStats() }
-          };
-          data.set(fileId, fileEntry);
-        }
-        const { testFile, testFileSummary } = fileEntry;
-        const testEntries = [];
-        this._processSuite(fileSuite, projectSuite.project().name, [], testEntries);
-        for (const test of testEntries) {
-          testFile.tests.push(test.testCase);
-          testFileSummary.tests.push(test.testCaseSummary);
+        if (this._options.noFiles) {
+          for (const describeSuite of fileSuite.suites) {
+            const groupName = describeSuite.title;
+            this._createEntryForSuite(data, projectName, describeSuite, groupName, true);
+          }
+          const hasTestsOutsideGroups = fileSuite.tests.length > 0;
+          if (hasTestsOutsideGroups) {
+            const fileName = "<anonymous>";
+            this._createEntryForSuite(data, projectName, fileSuite, fileName, false);
+          }
+        } else {
+          const fileName = this._relativeLocation(fileSuite.location).file;
+          this._createEntryForSuite(data, projectName, fileSuite, fileName, true);
         }
       }
     }
@@ -340,13 +345,31 @@ class HtmlBuilder {
   _addDataFile(fileName, data) {
     this._dataZipFile.addBuffer(Buffer.from(JSON.stringify(data)), fileName);
   }
-  _processSuite(suite, projectName, path2, outTests) {
+  _createEntryForSuite(data, projectName, suite, fileName, deep) {
+    const fileId = (0, import_utils.calculateSha1)(fileName).slice(0, 20);
+    let fileEntry = data.get(fileId);
+    if (!fileEntry) {
+      fileEntry = {
+        testFile: { fileId, fileName, tests: [] },
+        testFileSummary: { fileId, fileName, tests: [], stats: emptyStats() }
+      };
+      data.set(fileId, fileEntry);
+    }
+    const { testFile, testFileSummary } = fileEntry;
+    const testEntries = [];
+    this._processSuite(suite, projectName, [], deep, testEntries);
+    for (const test of testEntries) {
+      testFile.tests.push(test.testCase);
+      testFileSummary.tests.push(test.testCaseSummary);
+    }
+  }
+  _processSuite(suite, projectName, path2, deep, outTests) {
     const newPath = [...path2, suite.title];
     suite.entries().forEach((e) => {
       if (e.type === "test")
         outTests.push(this._createTestEntry(e, projectName, newPath));
-      else
-        this._processSuite(e, projectName, newPath, outTests);
+      else if (deep)
+        this._processSuite(e, projectName, newPath, deep, outTests);
     });
   }
   _createTestEntry(test, projectName, path2) {

package/lib/runner/dispatcher.js

@@ -164,7 +164,7 @@ class Dispatcher {
       extraEnv: this._extraEnvByProjectId.get(testGroup.projectId) || {},
       outputDir,
       pauseOnError: this._failureTracker.pauseOnError(),
-      pauseAtEnd: this._failureTracker.pauseAtEnd()
+      pauseAtEnd: this._failureTracker.pauseAtEnd(projectConfig)
     });
     const handleOutput = (params) => {
       const chunk = chunkFromParams(params);

package/lib/runner/failureTracker.js

@@ -26,11 +26,13 @@ class FailureTracker {
     this._config = _config;
     this._failureCount = 0;
     this._hasWorkerErrors = false;
+    this._topLevelProjects = [];
     this._pauseOnError = options?.pauseOnError ?? false;
     this._pauseAtEnd = options?.pauseAtEnd ?? false;
   }
-  onRootSuite(rootSuite) {
+  onRootSuite(rootSuite, topLevelProjects) {
     this._rootSuite = rootSuite;
+    this._topLevelProjects = topLevelProjects;
   }
   onTestEnd(test, result) {
     if (test.outcome() === "unexpected" && test.results.length > test.retries)
@@ -42,8 +44,8 @@ class FailureTracker {
   pauseOnError() {
     return this._pauseOnError;
   }
-  pauseAtEnd() {
-    return this._pauseAtEnd;
+  pauseAtEnd(inProject) {
+    return this._pauseAtEnd && this._topLevelProjects.includes(inProject);
   }
   hasReachedMaxFailures() {
     return this.maxFailures() > 0 && this._failureCount >= this.maxFailures();

package/lib/runner/loadUtils.js

@@ -168,14 +168,17 @@ async function createRootSuite(testRun, errors, shouldFilterOnly) {
   }
   if (config.postShardTestFilters.length)
     (0, import_suiteUtils.filterTestsRemoveEmptySuites)(rootSuite, (test) => config.postShardTestFilters.every((filter) => filter(test)));
+  const topLevelProjects = [];
   {
     const projectClosure2 = new Map((0, import_projectUtils.buildProjectsClosure)(rootSuite.suites.map((suite) => suite._fullProject)));
     for (const [project, level] of projectClosure2.entries()) {
       if (level === "dependency")
         rootSuite._prependSuite(buildProjectSuite(project, projectSuites.get(project)));
+      else
+        topLevelProjects.push(project);
     }
   }
-  return rootSuite;
+  return { rootSuite, topLevelProjects };
 }
 function createProjectSuite(project, fileSuites) {
   const projectSuite = new import_test.Suite(project.project.name, "project");

package/lib/runner/projectUtils.js

@@ -32,7 +32,8 @@ __export(projectUtils_exports, {
   buildProjectsClosure: () => buildProjectsClosure,
   buildTeardownToSetupsMap: () => buildTeardownToSetupsMap,
   collectFilesForProject: () => collectFilesForProject,
-  filterProjects: () => filterProjects
+  filterProjects: () => filterProjects,
+  findTopLevelProjects: () => findTopLevelProjects
 });
 module.exports = __toCommonJS(projectUtils_exports);
 var import_fs = __toESM(require("fs"));
@@ -116,6 +117,10 @@ function buildProjectsClosure(projects, hasTests) {
     visit(0, p);
   return result;
 }
+function findTopLevelProjects(config) {
+  const closure = buildProjectsClosure(config.projects);
+  return [...closure].filter((entry) => entry[1] === "top-level").map((entry) => entry[0]);
+}
 function buildDependentProjects(forProjects, projects) {
   const reverseDeps = new Map(projects.map((p) => [p, []]));
   for (const project of projects) {
@@ -231,5 +236,6 @@ async function collectFiles(testDir, respectGitIgnore) {
   buildProjectsClosure,
   buildTeardownToSetupsMap,
   collectFilesForProject,
-  filterProjects
+  filterProjects,
+  findTopLevelProjects
 });

package/lib/runner/tasks.js

@@ -65,6 +65,7 @@ class TestRun {
     this.phases = [];
     this.projectFiles = /* @__PURE__ */ new Map();
     this.projectSuites = /* @__PURE__ */ new Map();
+    this.topLevelProjects = [];
     this.config = config;
     this.reporter = reporter;
     this.failureTracker = new import_failureTracker.FailureTracker(config, options);
@@ -214,8 +215,9 @@ function createListFilesTask() {
   return {
     title: "load tests",
     setup: async (testRun, errors) => {
-      testRun.rootSuite = await (0, import_loadUtils.createRootSuite)(testRun, errors, false);
-      testRun.failureTracker.onRootSuite(testRun.rootSuite);
+      const { rootSuite, topLevelProjects } = await (0, import_loadUtils.createRootSuite)(testRun, errors, false);
+      testRun.rootSuite = rootSuite;
+      testRun.failureTracker.onRootSuite(rootSuite, topLevelProjects);
       await (0, import_loadUtils.collectProjectsAndTestFiles)(testRun, false);
       for (const [project, files] of testRun.projectFiles) {
         const projectSuite = new import_test.Suite(project.project.name, "project");
@@ -247,8 +249,9 @@ function createLoadTask(mode, options) {
         const changedFiles = await (0, import_vcs.detectChangedTestFiles)(testRun.config.cliOnlyChanged, testRun.config.configDir);
         testRun.config.preOnlyTestFilters.push((test) => changedFiles.has(test.location.file));
       }
-      testRun.rootSuite = await (0, import_loadUtils.createRootSuite)(testRun, options.failOnLoadErrors ? errors : softErrors, !!options.filterOnly);
-      testRun.failureTracker.onRootSuite(testRun.rootSuite);
+      const { rootSuite, topLevelProjects } = await (0, import_loadUtils.createRootSuite)(testRun, options.failOnLoadErrors ? errors : softErrors, !!options.filterOnly);
+      testRun.rootSuite = rootSuite;
+      testRun.failureTracker.onRootSuite(rootSuite, topLevelProjects);
       if (options.failOnLoadErrors && !testRun.rootSuite.allTests().length && !testRun.config.cliPassWithNoTests && !testRun.config.config.shard && !testRun.config.cliOnlyChanged) {
         if (testRun.config.cliArgs.length) {
           throw new Error([

package/lib/runner/testRunner.js

@@ -269,12 +269,12 @@ class TestRunner extends import_events.default {
       const testIdSet = new Set(params.testIds);
       config.preOnlyTestFilters.push((test) => testIdSet.has(test.id));
     }
-    const configReporters = await (0, import_reporters.createReporters)(config, "test", true);
+    const configReporters = params.disableConfigReporters ? [] : await (0, import_reporters.createReporters)(config, "test", true);
     const reporter = new import_internalReporter.InternalReporter([...configReporters, userReporter]);
     const stop = new import_utils.ManualPromise();
     const tasks = [
       (0, import_tasks.createApplyRebaselinesTask)(),
-      (0, import_tasks.createLoadTask)("out-of-process", { filterOnly: true, failOnLoadErrors: false, doNotRunDepsOutsideProjectFilter: true }),
+      (0, import_tasks.createLoadTask)("out-of-process", { filterOnly: true, failOnLoadErrors: false, doNotRunDepsOutsideProjectFilter: params.doNotRunDepsOutsideProjectFilter }),
       ...(0, import_tasks.createRunTestsTasks)(config)
     ];
     const testRun = new import_tasks.TestRun(config, reporter, { pauseOnError: params.pauseOnError, pauseAtEnd: params.pauseAtEnd });

package/lib/runner/testServer.js

@@ -149,7 +149,10 @@ class TestServerDispatcher {
   }
   async runTests(params) {
     const wireReporter = await this._wireReporter((e) => this._dispatchEvent("report", e));
-    const { status } = await this._testRunner.runTests(wireReporter, params);
+    const { status } = await this._testRunner.runTests(wireReporter, {
+      ...params,
+      doNotRunDepsOutsideProjectFilter: true
+    });
     return { status };
   }
   async watch(params) {

package/lib/transform/compilationCache.js

@@ -49,6 +49,7 @@ module.exports = __toCommonJS(compilationCache_exports);
 var import_fs = __toESM(require("fs"));
 var import_os = __toESM(require("os"));
 var import_path = __toESM(require("path"));
+var import_utils = require("playwright-core/lib/utils");
 var import_globals = require("../common/globals");
 var import_utilsBundle = require("../utilsBundle");
 const cacheDir = process.env.PWTEST_CACHE_DIR || (() => {
@@ -90,7 +91,7 @@ function _innerAddToCompilationCacheAndSerialize(filename, entry) {
     externalDependencies: []
   };
 }
-function getFromCompilationCache(filename, hash, moduleUrl) {
+function getFromCompilationCache(filename, contentHash, moduleUrl) {
   const cache = memoryCache.get(filename);
   if (cache?.codePath) {
     try {
@@ -98,7 +99,10 @@ function getFromCompilationCache(filename, hash, moduleUrl) {
     } catch {
     }
   }
-  const cachePath = calculateCachePath(filename, hash);
+  const filePathHash = calculateFilePathHash(filename);
+  const hashPrefix = filePathHash + "_" + contentHash.substring(0, 7);
+  const cacheFolderName = filePathHash.substring(0, 2);
+  const cachePath = calculateCachePath(filename, cacheFolderName, hashPrefix);
   const codePath = cachePath + ".js";
   const sourceMapPath = cachePath + ".map";
   const dataPath = cachePath + ".data";
@@ -112,6 +116,7 @@ function getFromCompilationCache(filename, hash, moduleUrl) {
     addToCache: (code, map, data) => {
       if ((0, import_globals.isWorkerProcess)())
         return {};
+      clearOldCacheEntries(cacheFolderName, filePathHash);
       import_fs.default.mkdirSync(import_path.default.dirname(cachePath), { recursive: true });
       if (map)
         import_fs.default.writeFileSync(sourceMapPath, JSON.stringify(map), "utf8");
@@ -145,9 +150,21 @@ function addToCompilationCache(payload) {
     externalDependencies.set(entry[0], /* @__PURE__ */ new Set([...entry[1], ...existing]));
   }
 }
-function calculateCachePath(filePath, hash) {
-  const fileName = import_path.default.basename(filePath, import_path.default.extname(filePath)).replace(/\W/g, "") + "_" + hash;
-  return import_path.default.join(cacheDir, hash[0] + hash[1], fileName);
+function calculateFilePathHash(filePath) {
+  return (0, import_utils.calculateSha1)(filePath).substring(0, 10);
+}
+function calculateCachePath(filePath, cacheFolderName, hashPrefix) {
+  const fileName = hashPrefix + "_" + import_path.default.basename(filePath, import_path.default.extname(filePath)).replace(/\W/g, "");
+  return import_path.default.join(cacheDir, cacheFolderName, fileName);
+}
+function clearOldCacheEntries(cacheFolderName, filePathHash) {
+  const cachePath = import_path.default.join(cacheDir, cacheFolderName);
+  try {
+    const cachedRelevantFiles = import_fs.default.readdirSync(cachePath).filter((file) => file.startsWith(filePathHash));
+    for (const file of cachedRelevantFiles)
+      import_fs.default.rmSync(import_path.default.join(cachePath, file), { force: true });
+  } catch {
+  }
 }
 let depsCollector;
 function startCollectingFileDeps() {

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "playwright",
-  "version": "1.56.0-alpha-2025-09-18",
+  "version": "1.56.0-alpha-1758292576000",
   "description": "A high-level API to automate web browsers",
   "repository": {
     "type": "git",
@@ -64,7 +64,7 @@
   },
   "license": "Apache-2.0",
   "dependencies": {
-    "playwright-core": "1.56.0-alpha-2025-09-18"
+    "playwright-core": "1.56.0-alpha-1758292576000"
   },
   "optionalDependencies": {
     "fsevents": "2.3.2"

package/types/test.d.ts

@@ -31,6 +31,7 @@ export type HtmlReporterOptions = {
   title?: string;
   noSnippets?: boolean;
   noCopyPrompt?: boolean;
+  noFiles?: boolean;
 };
 
 export type ReporterDescription = Readonly<