testdriverai 7.3.12 → 7.3.13

package/.github/skills/testdriver:quickstart/SKILL.md

@@ -0,0 +1,161 @@
+---
+name: testdriver:quickstart
+description: Run your first computer-use test in minutes.
+---
+<!-- Generated from quickstart.mdx. DO NOT EDIT. -->
+
+TestDriver makes it easy to write automated computer-use tests for web browsers, desktop apps, and more. Follow the directions below to run your first TestDriver test.
+
+<Tip><a href="https://discord.com/invite/cWDFW8DzPm" target="_blank" rel="noreferrer">Join our Discord</a> if you have any questions or need help getting started!</Tip>
+
+<Tabs>
+  <Tab title="Automatic Setup">
+
+    Get started quickly with the TestDriver CLI.
+
+    <Steps>
+      <Step title="Create a TestDriver Account">
+
+        You will need a TestDriver account to get an API key.
+
+        <Card
+          title="Get an API Key"
+          icon="user-plus"
+          href="https://console.testdriver.ai/team"
+          arrow
+          horizontal
+        >
+          Start with 60 free device minutes, no credit-card required!
+        </Card>
+
+      </Step>
+      <Step title="Install TestDriver">
+
+        Use `npx` to quickly set up an example project:
+
+        ```bash
+        npx testdriverai@beta init
+        ```
+
+        This will walk you through creating a new project folder, installing dependencies, and setting up your API key.
+
+      </Step>
+      
+      <Step title="Run Your Test">
+
+        TestDriver uses Vitest as the test runner. To run your test, use:
+        
+        ```bash
+        vitest run
+        ```
+
+        This will spawn a sandbox, launch Chrome, and run the example test!
+
+      </Step>
+    </Steps>
+  </Tab>
+  <Tab title="Manual Setup">
+
+    Install TestDriver and manually create the files yourself.
+
+    <Steps>
+      <Step title="Create a TestDriver Account">
+
+        You will need a TestDriver account to get an API key.
+
+        <Card
+          title="Get an API Key"
+          icon="user-plus"
+          href="https://console.testdriver.ai/team"
+          arrow
+          horizontal
+        >
+          Start with 60 free device minutes, no credit-card required!
+        </Card>
+
+      </Step>
+      <Step title="Install Dependencies">
+
+        Install Vitest and TestDriver as dev dependencies:
+
+        ```bash
+        npm install --save-dev vitest testdriverai@beta
+        ```
+
+      </Step>
+      <Step title="Create a vitest.config.js File">
+
+        In your project root, create a `vitest.config.js` file with the following content:
+
+        ```js vitest.config.js
+        import TestDriver from 'testdriverai/vitest';
+        import { defineConfig } from 'vitest/config';
+
+        export default defineConfig({
+          test: {
+            testTimeout: 900000,
+            hookTimeout: 900000,
+            disableConsoleIntercept: true,
+            maxConcurrency: 1, // this should match your plan's concurrency limit 
+            reporters: [
+              'default',
+              TestDriver()
+            ],
+            setupFiles: ['testdriverai/vitest/setup'],
+          },
+        });
+        ```
+
+      </Step>
+      <Step title="Create an Example Test File">
+
+        Add your API key to the example test file below and save it as `test.mjs` in your project root.
+
+        ```js test.mjs highlight={9}
+        import { describe, expect, it } from "vitest";
+        // Import TestDriver from the vitest hooks
+        import { TestDriver } from "testdriverai/vitest/hooks";
+
+        describe("Google Search Example", () => {
+          it("should search for TestDriver", async (context) => {
+            // Create TestDriver instance - automatically connects to sandbox
+            const testdriver = TestDriver(context, {
+              apiKey: 'YOUR_API_KEY_HERE' // supply your API key here 
+            });
+
+            // Provision Chrome browser with a URL
+            // This also starts dashcam recording automatically
+            await testdriver.provision.chrome({ url: "https://duckduckgo.com" });
+
+            // Find and interact with elements using natural language
+            const searchBox = await testdriver.find("DuckDuckGo search input field");
+            await searchBox.click();
+
+            // Type into the focused element
+            await testdriver.type("testdriver.ai");
+
+            // Press Enter to search
+            await testdriver.pressKeys(["enter"]);
+
+            // Assert something is visible on the page
+            const result = await testdriver.assert("search results are displayed");
+            expect(result).toBeTruthy();
+          });
+        });
+        ```
+
+      </Step>
+      <Step title="Run Your Test">
+
+        TestDriver uses Vitest as the test runner. To run your test, use:
+        
+        ```bash
+        vitest run
+        ```
+
+        This will spawn a sandbox, launch Chrome, and run the example test!
+
+      </Step>
+    </Steps>
+  </Tab>
+</Tabs>

package/.github/skills/testdriver:reusable-code/SKILL.md

@@ -0,0 +1,240 @@
+---
+name: testdriver:reusable-code
+description: Build maintainable test suites with reusable code patterns
+---
+<!-- Generated from reusable-code.mdx. DO NOT EDIT. -->
+
+As your test suite grows, you'll want to extract common patterns into reusable code. This keeps tests DRY, readable, and easy to maintain.
+
+## Helper Functions
+
+The simplest approach is extracting common actions into helper functions. Create a `helpers/` directory for shared utilities:
+
+```javascript test/helpers/auth.js
+export async function login(testdriver, { email, password }) {
+  const emailInput = await testdriver.find('email input');
+  await emailInput.click();
+  await testdriver.type(email);
+  
+  const passwordInput = await testdriver.find('password input');
+  await passwordInput.click();
+  await testdriver.type(password);
+  
+  const loginButton = await testdriver.find('login button');
+  await loginButton.click();
+  
+  const result = await testdriver.assert('user is logged in');
+  return result;
+}
+
+export async function logout(testdriver) {
+  const userMenu = await testdriver.find('user menu');
+  await userMenu.click();
+  
+  const logoutButton = await testdriver.find('logout button');
+  await logoutButton.click();
+}
+```
+
+Now import and use these helpers in any test:
+
+```javascript test/checkout.test.mjs
+import { describe, expect, it } from "vitest";
+import { TestDriver } from "testdriverai/lib/vitest/hooks.mjs";
+import { login } from './helpers/auth.js';
+
+describe("Checkout", () => {
+  it("should complete checkout as logged in user", async (context) => {
+    const testdriver = TestDriver(context);
+    
+    await testdriver.provision.chrome({
+      url: 'https://shop.example.com',
+    });
+
+    // Use the helper
+    await login(testdriver, { 
+      email: 'user@example.com', 
+      password: 'password123' 
+    });
+
+    // Continue with checkout steps...
+    const cartButton = await testdriver.find('cart button');
+    await cartButton.click();
+  });
+});
+```
+
+## Page Objects
+
+For larger test suites, the Page Object pattern encapsulates all interactions with a specific page or component:
+
+```javascript test/pages/LoginPage.js
+export class LoginPage {
+  constructor(testdriver) {
+    this.td = testdriver;
+  }
+
+  async enterEmail(email) {
+    const input = await this.td.find('email input');
+    await input.click();
+    await this.td.type(email);
+  }
+
+  async enterPassword(password) {
+    const input = await this.td.find('password input');
+    await input.click();
+    await this.td.type(password);
+  }
+
+  async submit() {
+    const button = await this.td.find('submit button');
+    await button.click();
+  }
+
+  async login(email, password) {
+    await this.enterEmail(email);
+    await this.enterPassword(password);
+    await this.submit();
+  }
+
+  async assertError(message) {
+    return await this.td.assert(`error message shows "${message}"`);
+  }
+
+  async assertLoggedIn() {
+    return await this.td.assert('user dashboard is visible');
+  }
+}
+```
+
+Use the page object in your tests:
+
+```javascript test/auth.test.mjs
+import { describe, expect, it } from "vitest";
+import { TestDriver } from "testdriverai/lib/vitest/hooks.mjs";
+import { LoginPage } from './pages/LoginPage.js';
+
+describe("Authentication", () => {
+  it("should show error for invalid credentials", async (context) => {
+    const testdriver = TestDriver(context);
+    
+    await testdriver.provision.chrome({
+      url: 'https://app.example.com/login',
+    });
+
+    const loginPage = new LoginPage(testdriver);
+    
+    await loginPage.login('invalid@test.com', 'wrongpassword');
+    
+    const hasError = await loginPage.assertError('Invalid credentials');
+    expect(hasError).toBeTruthy();
+  });
+
+  it("should redirect to dashboard on success", async (context) => {
+    const testdriver = TestDriver(context);
+    
+    await testdriver.provision.chrome({
+      url: 'https://app.example.com/login',
+    });
+
+    const loginPage = new LoginPage(testdriver);
+    
+    await loginPage.login('valid@test.com', 'correctpassword');
+    
+    const isLoggedIn = await loginPage.assertLoggedIn();
+    expect(isLoggedIn).toBeTruthy();
+  });
+});
+```
+
+## Shared Test Fixtures
+
+Create reusable fixtures for common test setup scenarios:
+
+```javascript test/fixtures/index.js
+export const testUsers = {
+  admin: { email: 'admin@example.com', password: 'admin123' },
+  regular: { email: 'user@example.com', password: 'user123' },
+  guest: { email: 'guest@example.com', password: 'guest123' },
+};
+
+export const testUrls = {
+  staging: 'https://staging.example.com',
+  production: 'https://example.com',
+};
+
+export async function setupAuthenticatedSession(testdriver, user = testUsers.regular) {
+  const emailInput = await testdriver.find('email input');
+  await emailInput.click();
+  await testdriver.type(user.email);
+  
+  const passwordInput = await testdriver.find('password input');
+  await passwordInput.click();
+  await testdriver.type(user.password);
+  
+  const loginButton = await testdriver.find('login button');
+  await loginButton.click();
+  
+  await testdriver.assert('user is logged in');
+}
+```
+
+```javascript test/admin.test.mjs
+import { describe, expect, it } from "vitest";
+import { TestDriver } from "testdriverai/lib/vitest/hooks.mjs";
+import { testUsers, testUrls, setupAuthenticatedSession } from './fixtures/index.js';
+
+describe("Admin Panel", () => {
+  it("should access admin settings", async (context) => {
+    const testdriver = TestDriver(context);
+    
+    await testdriver.provision.chrome({
+      url: `${testUrls.staging}/login`,
+    });
+
+    await setupAuthenticatedSession(testdriver, testUsers.admin);
+
+    const settingsLink = await testdriver.find('admin settings link');
+    await settingsLink.click();
+    
+    const result = await testdriver.assert('admin settings panel is visible');
+    expect(result).toBeTruthy();
+  });
+});
+```
+
+## Suggested Project Structure
+
+<FileTree>
+  <Folder name="test" defaultOpen>
+    <Folder name="fixtures" defaultOpen>
+      <File name="index.js" />
+    </Folder>
+    <Folder name="helpers" defaultOpen>
+      <File name="auth.js" />
+      <File name="navigation.js" />
+      <File name="forms.js" />
+    </Folder>
+    <Folder name="pages" defaultOpen>
+      <File name="LoginPage.js" />
+      <File name="DashboardPage.js" />
+      <File name="CheckoutPage.js" />
+    </Folder>
+    <Folder name="specs" defaultOpen>
+      <File name="auth.test.mjs" />
+      <File name="checkout.test.mjs" />
+      <File name="search.test.mjs" />
+    </Folder>
+  </Folder>
+</FileTree>
+
+| Folder | Purpose |
+|--------|---------|
+| `fixtures/` | Test data and setup utilities |
+| `helpers/` | Reusable helper functions |
+| `pages/` | Page object classes |
+| `specs/` | Test files |
+
+<Tip>
+Start simple with helper functions. Only introduce page objects when you find yourself duplicating the same element interactions across multiple tests.
+</Tip>

package/.github/skills/testdriver:right-click/SKILL.md

@@ -0,0 +1,123 @@
+---
+name: testdriver:right-click
+description: Perform a right-click action to open context menus
+---
+<!-- Generated from right-click.mdx. DO NOT EDIT. -->
+
+## Overview
+
+The `rightClick()` method performs a right-click action on an element, typically used to open context menus. You can either call it on an [`Element`](/v7/core-concepts/elements) instance or use it directly with a selector.
+
+## Syntax
+
+```javascript
+// Right-click on an element
+await element.rightClick();
+
+// Right-click using a selector
+await ai.rightClick('selector');
+```
+
+## Parameters
+
+When called on an `Element`, no parameters are required.
+
+When called directly on the AI client:
+
+| Parameter | Type | Description |
+|-----------|------|-------------|
+| `selector` | `string` | The selector describing the element to right-click |
+
+## Returns
+
+Returns a `Promise<void>` that resolves when the right-click action completes.
+
+## Examples
+
+### Right-Click to Open Context Menu
+
+```javascript
+const fileItem = await ai.find('README.md file');
+await fileItem.rightClick();
+
+// Select menu option
+await ai.click('Delete from context menu');
+```
+
+### Direct Right-Click with Selector
+
+```javascript
+await ai.rightClick('image in the gallery');
+await ai.click('Save image as');
+```
+
+### VS Code Context Menu
+
+```javascript
+import { test } from 'vitest';
+import { vscode } from '@testdriver/sdk';
+
+test('renames a file via context menu', async () => {
+  const { ai } = await vscode();
+  
+  // Right-click on a file
+  await ai.rightClick('test.js in the file explorer');
+  
+  // Click rename option
+  await ai.click('Rename');
+  
+  // Type new name
+  await ai.type('test.spec.js');
+  await ai.pressKeys('Enter');
+  
+  // Verify rename
+  const renamedFile = await ai.find('test.spec.js in the file explorer');
+  expect(renamedFile).toBeTruthy();
+});
+```
+
+### Browser Context Menu
+
+```javascript
+import { test } from 'vitest';
+import { chrome } from '@testdriver/sdk';
+
+test('opens link in new tab', async () => {
+  const { ai } = await chrome('https://example.com');
+  
+  // Right-click on a link
+  await ai.rightClick('Documentation link');
+  
+  // Select "Open in new tab"
+  await ai.click('Open link in new tab');
+});
+```
+
+### Custom Context Menu in Web App
+
+```javascript
+test('uses custom context menu', async () => {
+  const { ai } = await chrome('https://app.example.com');
+  
+  // Right-click on custom element
+  await ai.rightClick('project item in the list');
+  
+  // Wait for custom menu to appear
+  await ai.find('custom context menu');
+  
+  // Click menu option
+  await ai.click('Duplicate project');
+  
+  // Verify duplication
+  const duplicatedProject = await ai.find('project item (copy)');
+  expect(duplicatedProject).toBeTruthy();
+});
+```
+
+## Related Methods
+
+- [`click()`](/v7/click) - Single click on an element
+- [`doubleClick()`](/v7/double-click) - Double-click on an element
+- [`mouseDown()`](/v7/mouse-down) - Press mouse button without releasing
+- [`mouseUp()`](/v7/mouse-up) - Release mouse button
+- [`hover()`](/v7/hover) - Move mouse over element without clicking

package/.github/skills/testdriver:running-tests/SKILL.md

@@ -0,0 +1,181 @@
+---
+name: testdriver:running-tests
+description: Run TestDriver tests with Vitest test runner
+---
+<!-- Generated from running-tests.mdx. DO NOT EDIT. -->
+
+Learn how to run TestDriver tests efficiently with Vitest's powerful test runner.
+
+## Running Tests
+
+TestDriver works with Vitest's powerful test runner.
+
+### Run All Tests
+
+```bash
+vitest run
+```
+
+Executes all test files in your project once and exits. Vitest automatically discovers files matching patterns like `*.test.js`, `*.test.mjs`, or `*.spec.js`.
+
+### Run with Coverage
+
+```bash
+vitest run --coverage
+```
+
+Generates a code coverage report showing which lines of your source code were executed during tests. Coverage helps identify untested code paths. Results are displayed in the terminal and saved to a `coverage/` directory.
+
+<Info>
+  Coverage requires the `@vitest/coverage-v8` package. Install it with `npm install -D @vitest/coverage-v8`.
+</Info>
+
+### Run Specific Tests
+
+```bash
+vitest run login.test.js
+```
+
+Runs only the specified test file. Useful when debugging a single test or working on a specific feature.
+
+```bash
+vitest run login.test.js checkout.test.js
+```
+
+Runs multiple specific test files. List as many files as needed, separated by spaces.
+
+### Filter Tests by Name
+
+```bash
+vitest run --grep "login"
+```
+
+The `--grep` flag filters tests by their name (the string passed to `it()` or `test()`). Only tests whose names match the pattern will run. Supports regex patterns for complex matching.
+
+### Run Tests in a Folder
+
+```bash
+vitest run tests/e2e/
+```
+
+Runs all test files within a specific directory. Great for organizing tests by type (unit, integration, e2e) and running them separately.
+
+## Parallel Execution
+
+TestDriver runs each test in its own cloud sandbox, enabling true parallel execution. Run your entire test suite in minutes instead of hours.
+
+### Control Concurrency
+
+```bash
+vitest run --maxConcurrency=5
+```
+
+The `--maxConcurrency` flag limits how many tests run simultaneously. This should match your TestDriver license slots to avoid failures from exhausted slots.
+
+### Thread Configuration
+
+```bash
+vitest run --pool=threads --minThreads=2 --maxThreads=8
+```
+
+Fine-tune thread allocation for optimal performance:
+- `--pool=threads` — Uses worker threads for test isolation
+- `--minThreads` — Minimum number of threads to keep alive (reduces startup overhead)
+- `--maxThreads` — Maximum threads to spawn (limits resource usage)
+
+### License Slots
+
+Your TestDriver plan includes a set number of **license slots** that determine how many tests can run simultaneously. Each running test occupies one slot—when the test completes and the sandbox is destroyed, the slot is immediately available for the next test.
+
+<Info>
+  View your available slots at [console.testdriver.ai](https://console.testdriver.ai). Upgrade anytime to increase parallelization.
+</Info>
+
+### Configuring Concurrency
+
+Set `maxConcurrency` in your Vitest config to match your license slot limit:
+
+```javascript vitest.config.mjs
+import { defineConfig } from 'vitest/config';
+import { TestDriver } from 'testdriverai/vitest';
+
+export default defineConfig({
+  test: {
+    testTimeout: 900000,
+    hookTimeout: 900000,
+    maxConcurrency: 5, // Match your license slot limit
+    reporters: ['default', TestDriver()],
+    setupFiles: ['testdriverai/vitest/setup'],
+  },
+});
+```
+
+<Warning>
+  Setting `maxConcurrency` higher than your license slots will cause tests to fail when slots are exhausted. Always match this value to your plan's limit.
+</Warning>
+
+### Why Parallelization Matters
+
+| Test Suite | Sequential (1 slot) | Parallel (5 slots) | Parallel (10 slots) |
+|------------|--------------------|--------------------|---------------------|
+| 10 tests @ 2min each | 20 min | 4 min | 2 min |
+| 50 tests @ 2min each | 100 min | 20 min | 10 min |
+| 100 tests @ 2min each | 200 min | 40 min | 20 min |
+
+<Tip>
+  **Pro tip:** Upgrading your plan doesn't just increase speed—it enables faster CI/CD feedback loops, letting your team ship with confidence.
+</Tip>
+
+<Card
+  title="View Plans & Pricing"
+  icon="credit-card"
+  href="/v7/cloud"
+>
+  Compare plans and find the right level of parallelization for your team.
+</Card>
+
+## Vitest UI
+
+Use Vitest UI for interactive debugging:
+
+```bash
+vitest --ui
+```
+
+The `--ui` flag launches a web-based interface for managing your test suite. Unlike `vitest run`, this starts in watch mode by default.
+
+Open http://localhost:51204 to see:
+- **Test file tree** — Browse and navigate your test structure
+- **Test status and duration** — See pass/fail states and timing at a glance
+- **Console output** — View logs and errors inline with each test
+- **Re-run individual tests** — Click to re-execute specific tests without restarting
+- **Filter and search** — Quickly find tests by name or status
+
+<Tip>
+  Combine with `--open` to automatically open the UI in your browser: `vitest --ui --open`
+</Tip>
+
+
+## Test Reports
+
+After running tests, view detailed reports and video replays at [console.testdriver.ai](https://console.testdriver.ai).
+
+Reports include:
+- **Video replays** - Watch exactly what happened during each test
+- **Screenshots** - See the state at each step
+- **Timing breakdown** - Identify slow operations
+- **Error details** - Debug failures with full context
+
+```bash
+$ vitest run
+
+ ✓ login.test.js (2) 18.4s
+   ✓ user can login 12.3s
+   ✓ shows error for invalid credentials 6.1s
+
+📹 View reports at: https://console.testdriver.ai
+```
+
+<Tip>
+  Bookmark your team's dashboard at [console.testdriver.ai](https://console.testdriver.ai) for quick access to test history and analytics.
+</Tip>