testdriverai 7.2.9 → 7.2.10

package/docs/v7/features/test-replays.mdx

@@ -1,408 +0,0 @@
----
-title: "Test Replays"
-description: "Video replays with logs, network data, and performance metrics for debugging"
-icon: "video"
----
-
-Every test automatically records a complete replay with video, step-by-step logs, browser console output, network requests, and performance metrics. Perfect for debugging failures and sharing with your team.
-
-## Dashcam Replays
-
-Access test replays at [app.testdriver.ai/replays](https://app.testdriver.ai/replays):
-
-<Card title="Test Replays" icon="video" href="https://app.testdriver.ai/replays">
-  View all test replays with video and debugging information
-</Card>
-
-### What's Included
-
-Every replay captures:
-
-<CardGroup cols={2}>
-  <Card title="Video Recording" icon="video">
-    - Full screen recording
-    - Playback controls (play, pause, skip)
-    - Adjustable speed (0.5x to 3x)
-    - Frame-by-frame navigation
-  </Card>
-
-  <Card title="Action Steps" icon="list">
-    - Every TestDriver command
-    - Timestamps for each action
-    - Element coordinates found
-    - AI vision analysis results
-  </Card>
-
-  <Card title="Console Logs" icon="terminal">
-    - Browser console output
-    - JavaScript errors
-    - Warnings and info logs
-    - Custom console.log() statements
-  </Card>
-
-  <Card title="Network Activity" icon="network-wired">
-    - All HTTP requests
-    - Response status codes
-    - Request/response timing
-    - Downloaded/uploaded data
-  </Card>
-
-  <Card title="Performance Charts" icon="chart-line">
-    - CPU usage over time
-    - Memory usage trends
-    - Top 10 processes
-    - Resource utilization
-  </Card>
-
-  <Card title="Environment Info" icon="server">
-    - Operating system
-    - Browser version
-    - Screen resolution
-    - Sandbox details
-  </Card>
-</CardGroup>
-
-## Video Player
-
-Interactive video playback with timeline:
-
-```
-Replay Interface:
-┌─────────────────────────────────────────────────────┐
-│                                                     │
-│         [Video of test execution]                   │
-│                                                     │
-└─────────────────────────────────────────────────────┘
-
-[◀◀] [▶/⏸] [▶▶]     0:45 / 2:30     [0.5x][1x][2x][3x]
-
-Timeline:
-|─────────○────────────────────────|
-        Current position
-
-Speed Controls:
-- Skip downtime: ON [toggle]
-- Playback speed: 1x
-```
-
-### Timeline Features
-
-Navigate test execution:
-
-- **Action Markers** - Click to jump to specific TestDriver commands
-- **Error Markers** - Red indicators show where failures occurred
-- **Screenshot Points** - View captured screenshots at each step
-- **Skip Downtime** - Automatically fast-forward through idle periods
-
-## Action Log Panel
-
-Step-by-step test execution details:
-
-```
-Steps:
-┌────────────────────────────────────────────────────┐
-│ [0:00] 🟢 Find                                    │
-│   "testdriver-sandbox.vercel.app" not found       │
-│   Text: Element not found                         │
-│   [Screenshot]                                     │
-├────────────────────────────────────────────────────┤
-│ [0:15] 🟢 Find                                    │
-│   "testdriver-sandbox.vercel.app"                 │
-│   Text: [Passed]                                   │
-│   [Screenshot]                                     │
-├────────────────────────────────────────────────────┤
-│ [0:32] 🟢 Find                                    │
-│   "Sign in, black button below the password fld"  │
-│   Text: [Passed]                                   │
-│   Coordinates: (512, 387)                         │
-│   [Screenshot]                                     │
-└────────────────────────────────────────────────────┘
-```
-
-Each step shows:
-- **Timestamp** - When action occurred
-- **Status** - Pass/fail indicator
-- **Command** - TestDriver action
-- **Description** - Natural language selector
-- **Result** - Element found or error message
-- **Screenshot** - Visual confirmation
-
-## Console Logs Tab
-
-View browser console output:
-
-```
-Console Output:
-┌────────────────────────────────────────────────────┐
-│ [0:05] ℹ️ System info configured                  │
-│ [0:08] ℹ️ Response cache: /Users/...cache.json    │
-│ [0:12] ✓ Response was successful!                 │
-│ [0:18] ⚠️ Warning: Deprecated API usage           │
-│ [0:25] ❌ TypeError: Cannot read property 'id'    │
-│        at checkout.js:42:15                       │
-└────────────────────────────────────────────────────┘
-
-Filters:
-□ Errors  □ Warnings  ☑ Info  □ Debug
-```
-
-**Debugging Value:**
-- Catch JavaScript errors
-- Monitor application state
-- Track API responses
-- Debug timing issues
-
-## Browser Tab
-
-Access browser-specific debugging:
-
-```
-Browser Information:
-┌────────────────────────────────────────────────────┐
-│ User Agent:                                        │
-│ Mozilla/5.0 (X11; Linux x86_64) Chrome/120.0      │
-│                                                    │
-│ Viewport: 1280 x 720                              │
-│ Device Scale: 1.0                                  │
-│ Color Depth: 24-bit                               │
-│                                                    │
-│ Cookies: 12 stored                                │
-│ Local Storage: 3 items                            │
-│ Session Storage: 1 item                           │
-└────────────────────────────────────────────────────┘
-```
-
-## Performance Charts Tab
-
-Monitor system resource usage:
-
-### CPU Usage
-
-```
-CPU Usage Over Time:
-┌────────────────────────────────────────────────────┐
-│ 60% │                    ╱╲                        │
-│     │                  ╱    ╲                      │
-│ 40% │              ╱╲╱        ╲                    │
-│     │          ╱╲╱              ╲╱╲                │
-│ 20% │      ╱╲╱                      ╲              │
-│     │  ╱╱                              ╲╱╲         │
-│  0% └────────────────────────────────────────────  │
-│     0s    10s   20s   30s   40s   50s   60s       │
-└────────────────────────────────────────────────────┘
-
-System CPU Usage (%)
-Peak: 58.5% at 35s
-```
-
-### Memory Usage
-
-```
-Memory Usage Over Time:
-┌────────────────────────────────────────────────────┐
-│ 72 │                                              │
-│ GB │                              ╱─────          │
-│ 68 │                        ╱────╱                │
-│    │                  ╱────╱                      │
-│ 64 │            ╱────╱                            │
-│    │      ╱────╱                                  │
-│ 60 │─────╱                                        │
-│     └────────────────────────────────────────────  │
-│     0s    10s   20s   30s   40s   50s   60s       │
-└────────────────────────────────────────────────────┘
-
-System Memory Usage (%)
-Peak: 71.2% (68.8 GB used)
-```
-
-### Network Traffic
-
-```
-Network Traffic:
-┌────────────────────────────────────────────────────┐
-│ Download (MB/s): ▂▃▅▇▇▃▂▁                        │
-│ Upload (MB/s):   ▁▁▂▂▁▁▁▁                        │
-│                                                    │
-│ Total Downloaded: 2.8 MB                          │
-│ Total Uploaded: 0.4 MB                            │
-└────────────────────────────────────────────────────┘
-```
-
-### Top Processes by CPU
-
-```
-Top 10 CPU-Intensive Processes:
-┌────────────────────────────────────────────────────┐
-│ chromium (PID 2766)        ████████████ 45%       │
-│ python (PID 2845)          ██████ 22%             │
-│ Xvfb (PID 2634)            ████ 15%               │
-│ testdriver (PID 3012)      ███ 10%                │
-│ node (PID 2890)            ██ 5%                  │
-│ bash (PID 2521)            ▌ 1.5%                 │
-│ systemd (PID 1)            ▌ 0.8%                 │
-│ sshd (PID 1234)            ▌ 0.5%                 │
-└────────────────────────────────────────────────────┘
-```
-
-**Performance Insights:**
-- Identify resource bottlenecks
-- Monitor browser performance
-- Track memory leaks
-- Optimize heavy operations
-
-## Environment Tab
-
-Complete test environment details:
-
-```
-Environment Information:
-┌────────────────────────────────────────────────────┐
-│ Operating System: Ubuntu 22.04 LTS                │
-│ Kernel: 5.15.0-91-generic                         │
-│                                                    │
-│ Browser: Google Chrome 120.0.6099.109            │
-│ WebDriver: ChromeDriver 120.0.6099.71            │
-│                                                    │
-│ TestDriver SDK: v7.2.1                            │
-│ Node.js: v20.10.0                                 │
-│ Python: 3.11.6                                    │
-│                                                    │
-│ Sandbox ID: i-0abc123def456789                   │
-│ Instance Type: t3.medium                          │
-│ Region: us-east-1                                 │
-│                                                    │
-│ Screen Resolution: 1280x720                       │
-│ Color Depth: 24-bit                               │
-│ Timezone: UTC                                     │
-└────────────────────────────────────────────────────┘
-```
-
-## Sharing Replays
-
-Share debugging information with your team:
-
-<Tabs>
-  <Tab title="Public Link">
-    ```javascript
-    const { dashcam } = await chrome(context, { url });
-    
-    console.log('Public replay:', dashcam.url);
-    // https://app.testdriver.ai/replay/abc123
-    
-    // Anyone with link can view
-    ```
-  </Tab>
-
-  <Tab title="Team Link">
-    ```javascript
-    const { dashcam } = await chrome(context, { url });
-    
-    console.log('Team only:', dashcam.privateUrl);
-    // https://app.testdriver.ai/replay/abc123?access=team
-    
-    // Requires team authentication
-    ```
-  </Tab>
-
-  <Tab title="Embed Link">
-    ```javascript
-    const { dashcam } = await chrome(context, { url });
-    
-    console.log('Embed URL:', dashcam.embedUrl);
-    // https://app.testdriver.ai/embed/abc123
-    
-    // Use in iframe for documentation
-    ```
-  </Tab>
-</Tabs>
-
-## Download Replay
-
-Export replay data:
-
-<CardGroup cols={2}>
-  <Card title="Video File" icon="file-video">
-    Download MP4 video file
-    - Full test execution
-    - Shareable format
-    - Offline viewing
-  </Card>
-
-  <Card title="HAR File" icon="file-code">
-    HTTP Archive format
-    - All network requests
-    - Chrome DevTools compatible
-    - Performance analysis
-  </Card>
-
-  <Card title="Screenshots" icon="images">
-    ZIP file of all screenshots
-    - PNG format
-    - Timestamped filenames
-    - Step-by-step visuals
-  </Card>
-
-  <Card title="JSON Data" icon="file-lines">
-    Complete replay data
-    - Action log
-    - Console logs
-    - Metrics and timing
-  </Card>
-</CardGroup>
-
-## Replay API Access
-
-Programmatic access to replays:
-
-```javascript
-// Fetch replay data
-const response = await fetch(
-  'https://api.testdriver.ai/v1/replays/abc123',
-  {
-    headers: {
-      'Authorization': `Bearer ${TD_API_KEY}`
-    }
-  }
-);
-
-const replay = await response.json();
-console.log(replay.actions);      // Step-by-step log
-console.log(replay.videoUrl);     // MP4 download URL
-console.log(replay.performance);  // Metrics data
-```
-
-## Learn More
-
-<CardGroup cols={2}>
-  <Card
-    title="Observability & Debugging"
-    icon="microscope"
-    href="/v7/features/observable"
-  >
-    Complete debugging guide
-  </Card>
-
-  <Card
-    title="Test Reports"
-    icon="list-check"
-    href="/v7/features/test-reports"
-  >
-    View test run summaries
-  </Card>
-
-  <Card
-    title="Test Cases"
-    icon="file-lines"
-    href="/v7/features/test-cases"
-  >
-    Individual test histories
-  </Card>
-
-  <Card
-    title="Performance"
-    icon="gauge-high"
-    href="/v7/features/fast"
-  >
-    Optimize test speed
-  </Card>
-</CardGroup>

package/docs/v7/features/test-reports.mdx

@@ -1,308 +0,0 @@
----
-title: "Test Reports"
-description: "Comprehensive test run reports with pass/fail status and CI/CD integration"
-icon: "list-check"
----
-
-View all test runs, their status, and detailed execution information in the TestDriver dashboard. Track test results across branches, commits, and CI/CD pipelines.
-
-## Test Runs Dashboard
-
-Access all test runs at [app.testdriver.ai/runs](https://app.testdriver.ai/runs):
-
-<Card title="Test Runs" icon="list" href="https://app.testdriver.ai/runs">
-  View all test executions with filtering and search
-</Card>
-
-### Available Information
-
-Each test run displays:
-
-- **Test Suite** - Which test file or suite ran
-- **Status** - PASSED, FAILED, RUNNING, or SKIPPED
-- **Platform** - OS and browser used (e.g., Linux + Chrome)
-- **Tests** - Number of test cases (e.g., 13 / 23)
-- **Pass Rate** - Success percentage (e.g., 55%)
-- **Duration** - Total execution time
-- **CI/CD** - Branch and commit information
-- **Timestamp** - When the test ran
-
-### Test Run Statuses
-
-<CardGroup cols={2}>
-  <Card title="PASSED" icon="check" color="green">
-    All tests in the suite passed successfully
-  </Card>
-
-  <Card title="FAILED" icon="xmark" color="red">
-    One or more tests failed
-  </Card>
-
-  <Card title="RUNNING" icon="spinner" color="yellow">
-    Test suite is currently executing
-  </Card>
-
-  <Card title="SKIPPED" icon="forward" color="gray">
-    Tests were skipped or not run
-  </Card>
-</CardGroup>
-
-## Filtering & Search
-
-Find specific test runs quickly:
-
-<Tabs>
-  <Tab title="Time Period">
-    ```
-    Last 24 hours
-    Last week
-    Last month
-    Custom date range
-    ```
-  </Tab>
-
-  <Tab title="Branch">
-    ```
-    main
-    develop
-    feature/new-checkout
-    Custom branch name
-    ```
-  </Tab>
-
-  <Tab title="Repository">
-    ```
-    All repositories
-    my-app
-    frontend
-    backend
-    ```
-  </Tab>
-
-  <Tab title="Suite">
-    ```
-    All suites
-    test/login.test.js
-    test/checkout.test.js
-    Custom test file
-    ```
-  </Tab>
-
-  <Tab title="Status">
-    ```
-    All statuses
-    PASSED only
-    FAILED only
-    RUNNING only
-    ```
-  </Tab>
-</Tabs>
-
-## JUnit XML Integration
-
-Export test results in JUnit format for CI/CD platforms:
-
-```bash
-# Generate JUnit report
-npx vitest run --reporter=junit --outputFile=test-results.xml
-```
-
-```xml test-results.xml
-<?xml version="1.0" encoding="UTF-8"?>
-<testsuites name="vitest tests" tests="23" failures="2" errors="0" time="125.3">
-  <testsuite name="login.test.js" tests="5" failures="1" time="31.2">
-    <testcase name="user can login" time="12.4" />
-    <testcase name="invalid credentials show error" time="9.8">
-      <failure message="AssertionError: Element not found">
-        at TestDriver.find (sdk.js:234)
-        at login.test.js:15
-      </failure>
-    </testcase>
-    <testcase name="password reset works" time="9.0" />
-  </testsuite>
-  <testsuite name="checkout.test.js" tests="8" failures="0" time="45.6">
-    <!-- More test cases -->
-  </testsuite>
-</testsuites>
-```
-
-<Check>
-  JUnit reports integrate with Jenkins, GitHub Actions, GitLab CI, CircleCI, Azure DevOps, and TeamCity.
-</Check>
-
-## CI/CD Integration
-
-TestDriver automatically captures CI/CD context:
-
-<Tabs>
-  <Tab title="GitHub Actions">
-    ```yaml .github/workflows/test.yml
-    name: E2E Tests
-
-    on: [push, pull_request]
-
-    jobs:
-      test:
-        runs-on: ubuntu-latest
-        steps:
-          - uses: actions/checkout@v3
-          - uses: actions/setup-node@v3
-          - run: npm install
-          - run: npx vitest run
-            env:
-              TD_API_KEY: ${{ secrets.TD_API_KEY }}
-              GITHUB_SHA: ${{ github.sha }}
-              GITHUB_REF: ${{ github.ref }}
-    ```
-
-    Test runs show:
-    - Branch name
-    - Commit SHA
-    - Pull request number
-    - Workflow run ID
-  </Tab>
-
-  <Tab title="GitLab CI">
-    ```yaml .gitlab-ci.yml
-    test:
-      image: node:20
-      script:
-        - npm install
-        - npx vitest run
-      variables:
-        TD_API_KEY: $TD_API_KEY
-      artifacts:
-        reports:
-          junit: junit.xml
-    ```
-
-    Test runs show:
-    - Branch/tag name
-    - Commit SHA
-    - Pipeline ID
-    - Job ID
-  </Tab>
-
-  <Tab title="CircleCI">
-    ```yaml .circleci/config.yml
-    version: 2.1
-    jobs:
-      test:
-        docker:
-          - image: cimg/node:20.0
-        steps:
-          - checkout
-          - run: npm install
-          - run: npx vitest run
-        environment:
-          TD_API_KEY: ${TD_API_KEY}
-    ```
-
-    Test runs show:
-    - Branch name
-    - Build number
-    - Workflow ID
-  </Tab>
-</Tabs>
-
-## Branch & Commit Tracking
-
-Track test results across your development workflow:
-
-```javascript
-import { test } from 'vitest';
-import { chrome } from 'testdriverai/presets';
-
-test('tracked test run', async (context) => {
-  const { testdriver } = await chrome(context, {
-    url: 'https://example.com',
-    // CI/CD info automatically captured from environment
-  });
-
-  await testdriver.find('button').click();
-});
-```
-
-Dashboard displays:
-- **Branch:** `feature/new-checkout`
-- **Commit:** `a1b2c3d` (first 7 chars of SHA)
-- **Commit Message:** "Add new checkout flow"
-- **Author:** john@example.com
-
-## Export Test Reports
-
-Download test results in multiple formats:
-
-<Tabs>
-  <Tab title="CSV">
-    ```csv
-    Test Suite,Status,Platform,Tests,Pass Rate,Duration,Branch,Commit,Timestamp
-    login.test.js,FAILED,Linux+Chrome,5,80%,31.2s,main,a1b2c3d,2024-12-09T10:30:00Z
-    checkout.test.js,PASSED,Linux+Chrome,8,100%,45.6s,main,a1b2c3d,2024-12-09T10:31:00Z
-    ```
-  </Tab>
-
-  <Tab title="JSON">
-    ```json
-    {
-      "runs": [
-        {
-          "suite": "login.test.js",
-          "status": "FAILED",
-          "platform": "Linux+Chrome",
-          "tests": { "total": 5, "passed": 4, "failed": 1 },
-          "passRate": 0.80,
-          "duration": 31.2,
-          "branch": "main",
-          "commit": "a1b2c3d",
-          "timestamp": "2024-12-09T10:30:00Z"
-        }
-      ]
-    }
-    ```
-  </Tab>
-
-  <Tab title="PDF">
-    Generate executive reports with:
-    - Summary statistics
-    - Test run table
-    - Failure details
-    - Trend charts
-  </Tab>
-</Tabs>
-
-## Learn More
-
-<CardGroup cols={2}>
-  <Card
-    title="Test Analytics"
-    icon="chart-line"
-    href="/v7/features/test-analytics"
-  >
-    View trends and performance metrics
-  </Card>
-
-  <Card
-    title="Test Cases"
-    icon="file-lines"
-    href="/v7/features/test-cases"
-  >
-    Detailed test case reports
-  </Card>
-
-  <Card
-    title="Test Replays"
-    icon="video"
-    href="/v7/features/test-replays"
-  >
-    Video replays and debugging
-  </Card>
-
-  <Card
-    title="Continuous Testing"
-    icon="arrows-spin"
-    href="/v7/features/continuous-testing"
-  >
-    CI/CD integration guide
-  </Card>
-</CardGroup>