testdriverai 7.1.4 → 7.2.2

package/docs/v7/features/continuous-testing.mdx

@@ -0,0 +1,346 @@
+---
+title: "Continuous Testing"
+description: "Seamless CI/CD integration for automated testing at scale"
+icon: "arrows-spin"
+---
+
+TestDriver integrates seamlessly with all major CI/CD platforms, enabling automated testing from small projects to enterprise test suites with thousands of tests.
+
+## Works with Vitest
+
+Full integration with Vitest's powerful features:
+
+```javascript vitest.config.mjs
+import { defineConfig } from 'vitest/config';
+
+export default defineConfig({
+  test: {
+    testTimeout: 120000,
+    hookTimeout: 120000,
+    maxConcurrency: 10,      // Run 10 tests in parallel
+    minThreads: 2,
+    maxThreads: 10,
+  },
+});
+```
+
+<CardGroup cols={2}>
+  <Card title="Parallel Execution" icon="layer-group">
+    Run multiple tests simultaneously for maximum throughput:
+
+    ```bash
+    # Run all tests in parallel
+    npx vitest run
+
+    # Control concurrency
+    npx vitest run --max-concurrency=5
+    ```
+  </Card>
+
+  <Card title="Watch Mode" icon="eye">
+    Instant feedback during development:
+
+    ```bash
+    # Run in watch mode
+    npx vitest
+
+    # Only run changed tests
+    npx vitest --changed
+    ```
+  </Card>
+</CardGroup>
+
+[See complete Vitest integration guide](/v7/guides/vitest)
+
+## CI/CD Compatible
+
+TestDriver integrates seamlessly with all major CI/CD platforms:
+
+<Tabs>
+  <Tab title="GitHub Actions">
+    ```yaml .github/workflows/test.yml
+    name: E2E Tests
+
+    on: [push, pull_request]
+
+    jobs:
+      test:
+        runs-on: ubuntu-latest
+        steps:
+          - uses: actions/checkout@v3
+          - uses: actions/setup-node@v3
+          - run: npm install
+          - run: npx vitest run
+            env:
+              TD_API_KEY: ${{ secrets.TD_API_KEY }}
+    ```
+
+    [GitHub Actions guide](/v7/guides/ci-cd/github-actions)
+  </Tab>
+
+  <Tab title="GitLab CI">
+    ```yaml .gitlab-ci.yml
+    test:
+      image: node:20
+      script:
+        - npm install
+        - npx vitest run
+      variables:
+        TD_API_KEY: $TD_API_KEY
+    ```
+
+    [GitLab CI guide](/v7/guides/ci-cd/gitlab)
+  </Tab>
+
+  <Tab title="CircleCI">
+    ```yaml .circleci/config.yml
+    version: 2.1
+    jobs:
+      test:
+        docker:
+          - image: cimg/node:20.0
+        steps:
+          - checkout
+          - run: npm install
+          - run: npx vitest run
+    ```
+
+    [CircleCI guide](/v7/guides/ci-cd/circleci)
+  </Tab>
+
+  <Tab title="Jenkins">
+    ```groovy Jenkinsfile
+    pipeline {
+      agent any
+      stages {
+        stage('Test') {
+          steps {
+            sh 'npm install'
+            sh 'npx vitest run'
+          }
+        }
+      }
+    }
+    ```
+
+    [Jenkins guide](/v7/guides/ci-cd/jenkins)
+  </Tab>
+</Tabs>
+
+## JUnit Reports
+
+Generate JUnit XML reports for test result aggregation:
+
+```bash
+# Generate JUnit report
+npx vitest run --reporter=junit --outputFile=test-results.xml
+```
+
+```xml test-results.xml
+<?xml version="1.0" encoding="UTF-8"?>
+<testsuites name="vitest tests" tests="12" failures="0" errors="0" time="125.3">
+  <testsuite name="login.test.js" tests="3" failures="0" time="31.2">
+    <testcase name="user can login" time="12.4" />
+    <testcase name="invalid credentials show error" time="9.8" />
+    <testcase name="password reset works" time="9.0" />
+  </testsuite>
+  <!-- More test suites -->
+</testsuites>
+```
+
+<Check>
+  JUnit reports integrate with Jenkins, Azure DevOps, TeamCity, and other CI platforms for test result visualization.
+</Check>
+
+## Scale to Thousands of Tests
+
+TestDriver handles large test suites efficiently:
+
+<Card title="Enterprise Test Suite Example" icon="building">
+  ```
+  Project: E-commerce Platform
+  Total tests: 3,847
+  Test files: 412
+  Parallel runners: 20
+  Total duration: 18 minutes
+
+  Breakdown:
+  - Unit tests: 2,134 (3 min)
+  - Integration: 891 (7 min)
+  - E2E (TestDriver): 822 (18 min)
+
+  Cost per run: $4.32
+  Runs per day: 50
+  Monthly cost: $6,480
+  ```
+
+  With caching enabled:
+  ```
+  E2E duration: 8 minutes (2.25x faster)
+  Cost per run: $1.89 (56% reduction)
+  Monthly cost: $2,835 (saves $3,645/month)
+  ```
+</Card>
+
+## Test Sharding
+
+Distribute tests across multiple machines:
+
+<Tabs>
+  <Tab title="GitHub Actions Matrix">
+    ```yaml .github/workflows/test.yml
+    strategy:
+      matrix:
+        shard: [1, 2, 3, 4, 5]
+    steps:
+      - run: npx vitest run --shard=${{ matrix.shard }}/5
+    ```
+
+    Runs 5 parallel jobs, each handling 1/5 of tests.
+  </Tab>
+
+  <Tab title="GitLab CI Parallel">
+    ```yaml .gitlab-ci.yml
+    test:
+      parallel: 5
+      script:
+        - npx vitest run --shard=$CI_NODE_INDEX/$CI_NODE_TOTAL
+    ```
+  </Tab>
+
+  <Tab title="Manual Sharding">
+    ```bash
+    # Machine 1
+    npx vitest run --shard=1/4
+
+    # Machine 2
+    npx vitest run --shard=2/4
+
+    # Machine 3
+    npx vitest run --shard=3/4
+
+    # Machine 4
+    npx vitest run --shard=4/4
+    ```
+  </Tab>
+</Tabs>
+
+## Team Collaboration
+
+Built for teams with multiple developers:
+
+<AccordionGroup>
+  <Accordion title="Shared Test Cache">
+    Tests automatically benefit from each other's cache entries:
+
+    ```javascript
+    // Developer A runs test
+    await testdriver.find('submit button').click();
+    // Creates cache entry
+
+    // Developer B runs test later
+    await testdriver.find('submit button').click();
+    // Uses Developer A's cache ⚡
+    ```
+
+    Per-team cache sharing accelerates everyone's tests.
+  </Accordion>
+
+  <Accordion title="Dashcam Replays">
+    Share test replays with your team:
+
+    ```javascript
+    test('shareable replay', async (context) => {
+      const { testdriver, dashcam } = await chrome(context, { url });
+
+      await testdriver.find('button').click();
+
+      // Share replay URL with team
+      console.log('Replay:', dashcam.url);
+      // https://console.testdriver.ai/dashcam/abc123
+    });
+    ```
+
+    View replays at [app.testdriver.ai](https://app.testdriver.ai)
+  </Accordion>
+
+  <Accordion title="Sandbox Management">
+    Long-running sandboxes for team debugging:
+
+    ```bash
+    # Spawn a sandbox for the team
+    testdriver sandbox spawn --timeout 7200000
+
+    # Team members can connect
+    export TESTDRIVER_SANDBOX_ID=i-0abc123def
+    npx vitest run
+    ```
+
+    [Learn about sandbox management](/agents.md#sandbox-management)
+  </Accordion>
+</AccordionGroup>
+
+## Cost Optimization
+
+TestDriver scales cost-effectively:
+
+<Card title="Pricing Model" icon="dollar-sign">
+  - **API calls:** Pay per AI vision analysis
+  - **Sandbox time:** Pay per minute of VM usage
+  - **Caching:** Reduces both costs dramatically
+  - **Shared cache:** Team benefits from collective cache
+
+  **Example costs:**
+  - Single test run: $0.04 - $0.12
+  - 100-test suite: $4 - $12 (first run)
+  - Cached suite: $0.50 - $2 (90%+ savings)
+</Card>
+
+## Enterprise Scale
+
+TestDriver supports the largest testing operations:
+
+- **Unlimited tests** in enterprise plans
+- **Unlimited sandbox hours** for large suites
+- **Unlimited team members** for collaboration
+- **Priority infrastructure** for faster execution
+- **Dedicated support** for optimization help
+- **Custom SLA** for guaranteed uptime
+
+[Contact sales](https://testdriver.ai/enterprise) for enterprise pricing.
+
+## Learn More
+
+<CardGroup cols={2}>
+  <Card
+    title="Vitest Integration"
+    icon="flask-vial"
+    href="/v7/guides/vitest"
+  >
+    Complete Vitest guide
+  </Card>
+
+  <Card
+    title="CI/CD Setup"
+    icon="arrows-spin"
+    href="/v7/guides/ci-cd/overview"
+  >
+    CI/CD integration guides
+  </Card>
+
+  <Card
+    title="Performance Optimization"
+    icon="gauge-high"
+    href="/v7/guides/performance"
+  >
+    Optimize test performance
+  </Card>
+
+  <Card
+    title="Self-Hosting"
+    icon="server"
+    href="/v7/guides/self-hosting"
+  >
+    Run on your infrastructure
+  </Card>
+</CardGroup>