testdriverai 7.5.8 → 7.5.10

package/.github/skills/testdriver-waiting-for-elements/SKILL.md

@@ -1,88 +0,0 @@
----
-name: testdriver:waiting-for-elements
-description: Handle async operations and prevent flaky tests
----
-<!-- Generated from waiting-for-elements.mdx. DO NOT EDIT. -->
-
-## Waiting for Elements
-
-By default, `find()` automatically polls for up to 10 seconds, retrying every 5 seconds until the element is found. This means most elements that appear after short async operations will be found without any extra configuration.
-
-For longer operations, increase the `timeout`:
-
-```javascript
-// Default behavior - polls for up to 10 seconds automatically
-const element = await testdriver.find('Loading complete indicator');
-await element.click();
-
-// Wait up to 30 seconds for slower operations
-const element = await testdriver.find('Loading complete indicator', { timeout: 30000 });
-await element.click();
-
-// Useful after actions that trigger loading states
-await testdriver.find('submit button').click();
-await testdriver.find('success message', { timeout: 15000 });
-
-// Disable polling for instant checks
-const toast = await testdriver.find('notification toast', { timeout: 0 });
-```
-
-## Flake Prevention
-
-TestDriver automatically waits for the screen and network to stabilize after each action using **redraw detection**. This prevents flaky tests caused by animations, loading states, or dynamic content updates.
-
-<Note>
-  Redraw detection adds a small delay after each action but significantly reduces test flakiness.
-</Note>
-
-For example, when clicking a submit button that navigates to a new page:
-
-```javascript
-// Click submit - TestDriver automatically waits for the new page to load
-await testdriver.find('submit button').click();
-
-// By the time this runs, the page has fully loaded and stabilized
-await testdriver.assert('dashboard is displayed');
-await testdriver.find('welcome message');
-```
-
-Without redraw detection, you'd need manual waits or retries to handle the page transition. TestDriver handles this automatically by detecting when the screen stops changing and network requests complete.
-
-You can disable redraw detection or customize its behavior:
-
-```javascript
-// Disable redraw detection for faster tests (less reliable)
-const testdriver = TestDriver(context, { 
-  redraw: false 
-});
-```
-
-Here is an example of customizing redraw detection:
-
-```javascript
-// Fine-tune redraw detection
-const testdriver = TestDriver(context, { 
-  redraw: {
-    enabled: true,
-    diffThreshold: 0.1,      // Pixel difference threshold (0-1)
-    screenRedraw: true,      // Monitor screen changes
-    networkMonitor: true,    // Wait for network idle
-  }
-});
-```
-
-## Simple Delays with `wait()`
-
-For simple pauses — waiting for animations, transitions, or state changes after an action — use `wait()`:
-
-```javascript
-// Wait for an animation to complete
-await testdriver.find('menu toggle').click();
-await testdriver.wait(2000);
-
-// Wait for a page transition to settle
-await testdriver.find('next page button').click();
-await testdriver.wait(1000);
-```
-
-For waiting for specific **elements** to appear, prefer `find()` with a `timeout` option. Use `wait()` only for simple time-based pauses.

package/.github/skills/testdriver-what-is-testdriver/SKILL.md

@@ -1,54 +0,0 @@
----
-name: testdriver:what-is-testdriver
-description: Reliably test your most difficult user flows
----
-<!-- Generated from what-is-testdriver.mdx. DO NOT EDIT. -->
-
-## The problem with modern testing tools
-
-Modern testing tools like Playwright are designed to test a single web application, running in a single browser tab using selectors.
-
-However, selectors are often either unreliable or unavailable in complex scenarios, leading to brittle and flaky tests:
-
-| Challenge | Problem | Examples |
-|-----------|---------|----------|
-| **Fast moving teams** | Frequently change UI structure, breaking CSS/XPath selectors | Agile teams, startups, vibe-coders |
-| **Dynamic content** | Cannot be targeted with selectors | AI chatbots, PDFs, images, videos |
-| **Software you don't own** | May lack proper accessibility attributes | Other websites, extensions, third-party applications |
-| **Multi-application workflows** | Cannot be tested with web-only tools | Desktop apps, browser extensions, IDEs |
-| **Visual states** | Impossible to verify with code-based selectors | Charts, graphs, videos, images, spelling errors, UI layout |
-
-## The TestDriver Solution
-
-TestDriver is a complete testing platform built specifically for handling these scenarios. It consists of a Javascript SDK, hosted infrastructure, and debugging tools that make it easy to write, run, and maintain tests for your most difficult user flows.
-
-### Javascript SDK
-
-Here is an example of a TestDriver test that installs a production Chrome extension from the Chrome Web Store and verifies that it appears in the extensions menu:
-
-```javascript Installing Loom from the Chrome Web Store
-import { describe, expect, it } from "vitest";
-import { TestDriver } from "testdriverai/vitest/hooks";
-
-describe("Chrome Extension Test", () => {
-  const testdriver = TestDriver(context);
-
-  // Launch Chrome with Loom loaded by its Chrome Web Store ID
-  await testdriver.provision.chromeExtension({
-    extensionId: 'liecbddmkiiihnedobmlmillhodjkdmb'
-  });
-
-  // Click on the extensions button (puzzle piece icon) in Chrome toolbar
-  const extensionsButton = await testdriver.find("The puzzle-shaped icon in the Chrome toolbar.");
-  await extensionsButton.click();
-
-  // Look for Loom in the extensions menu
-  const loomExtension = await testdriver.find("Loom extension in the extensions dropdown");
-  expect(loomExtension.found()).toBeTruthy();
-});
-```
-
-
-<Tip>[vitest](https://vitest.dev/) is the preferred test runner for TestDriver.</Tip>
-
-,

package/.github/workflows/acceptance-linux-scheduled.yaml

@@ -1,45 +0,0 @@
-name: Scheduled Acceptance Tests (Linux)
-
-permissions:
-  id-token: write
-  contents: read
-
-on:
-  schedule:
-    # Every 6 hours
-    - cron: "0 */6 * * *"
-  workflow_dispatch: # Allow manual trigger
-
-jobs:
-  test-linux:
-    runs-on: ubuntu-latest
-
-    steps:
-      - uses: actions/checkout@v4
-
-      - name: Setup Node.js
-        uses: actions/setup-node@v4
-        with:
-          node-version: "20"
-          cache: "npm"
-
-      - name: Install dependencies
-        run: npm ci
-
-      - name: Install Sentry CLI
-        run: npm install -g @sentry/cli
-
-      - name: Run Linux tests with Sentry Cron monitoring
-        run: |
-          sentry-cli monitors run testdriver-linux-acceptance -- npx vitest run examples/*.test.mjs
-        env:
-          SENTRY_DSN: ${{ secrets.SENTRY_DSN }}
-          TD_API_KEY: ${{ secrets.TD_API_KEY }}
-          TD_OS: linux
-          TWOCAPTCHA_API_KEY: ${{ secrets.TWOCAPTCHA_API_KEY }}
-
-      - name: Upload test results to Sentry Prevent
-        if: ${{ !cancelled() }}
-        uses: getsentry/prevent-action@v0
-        with:
-          token: ${{ secrets.SENTRY_PREVENT_TOKEN }}

package/.github/workflows/acceptance-windows-scheduled.yaml

@@ -1,59 +0,0 @@
-name: Scheduled Acceptance Tests (Windows)
-
-permissions:
-  id-token: write
-  contents: read
-
-on:
-  schedule:
-    # Every day at midnight UTC
-    - cron: "0 0 * * *"
-  workflow_dispatch: # Allow manual trigger
-
-jobs:
-  test-windows:
-    uses: ./.github/workflows/windows-self-hosted.yaml
-    secrets:
-      TD_API_KEY: ${{ secrets.TD_API_KEY }}
-      TWOCAPTCHA_API_KEY: ${{ secrets.TWOCAPTCHA_API_KEY }}
-      TD_WEBSITE: ${{ secrets.TD_WEBSITE }}
-      AWS_ACCESS_KEY_ID: ${{ secrets.AWS_ACCESS_KEY_ID }}
-      AWS_SECRET_ACCESS_KEY: ${{ secrets.AWS_SECRET_ACCESS_KEY }}
-
-  sentry-and-publish:
-    needs: test-windows
-    runs-on: ubuntu-latest
-    if: always()
-
-    steps:
-      - name: Install Sentry CLI
-        run: npm install -g @sentry/cli
-
-      - name: Report to Sentry Cron
-        continue-on-error: true
-        run: |
-          if [ "${{ needs.test-windows.result }}" == "success" ]; then
-            sentry-cli monitors run testdriver-windows-acceptance -- echo "Windows tests passed"
-          else
-            sentry-cli monitors run testdriver-windows-acceptance -- bash -c "echo 'Windows tests failed' && exit 1"
-          fi
-        env:
-          SENTRY_DSN: ${{ secrets.SENTRY_DSN }}
-
-      - name: Download test results
-        uses: actions/download-artifact@v4
-        with:
-          name: test-results-windows
-
-      - name: Upload test results to Sentry Prevent
-        if: ${{ !cancelled() }}
-        uses: getsentry/prevent-action@v0
-        with:
-          token: ${{ secrets.SENTRY_PREVENT_TOKEN }}
-
-      - name: Publish Test Results
-        uses: EnricoMi/publish-unit-test-result-action@v2
-        if: always()
-        with:
-          files: test-report.junit.xml
-          check_name: Test Results (Windows Scheduled)

package/.github/workflows/acceptance.yaml

@@ -1,108 +0,0 @@
-name: Acceptance Tests
-permissions:
-  id-token: write
-  contents: write
-  pull-requests: write
-  checks: write
-on:
-  pull_request:
-    branches: [main]
-
-concurrency:
-  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
-  cancel-in-progress: true
-
-jobs:
-  test-linux:
-    runs-on: testdriver-16
-
-    steps:
-      - uses: actions/checkout@v4
-        with:
-          ref: ${{ github.head_ref }}
-
-      - name: Setup Node.js
-        uses: actions/setup-node@v4
-        with:
-          node-version: "20"
-          cache: "npm"
-
-      - name: Install dependencies
-        run: npm ci
-
-      - name: Run Linux tests
-        run: set -o pipefail && npx vitest run examples/*.test.mjs --maxWorkers 32 2>&1 | tee test-output.log
-        env:
-          TD_API_KEY: ${{ secrets.TD_API_KEY }}
-          TWOCAPTCHA_API_KEY: ${{ secrets.TWOCAPTCHA_API_KEY }}
-          TD_OS: linux
-          TD_API_ROOT: https://testdriver-api-pr-242.onrender.com
-
-      - name: Upload test results to Sentry Prevent
-        if: ${{ !cancelled() }}
-        uses: getsentry/prevent-action@v0
-        with:
-          token: ${{ secrets.SENTRY_PREVENT_TOKEN }}
-
-      - name: Publish Test Results
-        uses: EnricoMi/publish-unit-test-result-action@v2
-        if: always()
-        with:
-          files: test-report.junit.xml
-          comment_mode: always
-          check_name: Test Results (Linux)
-
-  test-windows:
-    if: contains(github.event.pull_request.labels.*.name, 'test-windows')
-    uses: ./.github/workflows/windows-self-hosted.yaml
-    with:
-      test_pattern: "examples/*.test.mjs"
-    secrets:
-      TD_API_KEY: ${{ secrets.TD_API_KEY }}
-      TWOCAPTCHA_API_KEY: ${{ secrets.TWOCAPTCHA_API_KEY }}
-      TD_WEBSITE: ${{ secrets.TD_WEBSITE }}
-      AWS_ACCESS_KEY_ID: ${{ secrets.AWS_ACCESS_KEY_ID }}
-      AWS_SECRET_ACCESS_KEY: ${{ secrets.AWS_SECRET_ACCESS_KEY }}
-
-  publish-windows-results:
-    needs: test-windows
-    runs-on: ubuntu-latest
-    if: always() && contains(github.event.pull_request.labels.*.name, 'test-windows')
-
-    steps:
-      - uses: actions/checkout@v4
-        with:
-          ref: ${{ github.head_ref }}
-
-      - name: Setup Node.js
-        uses: actions/setup-node@v4
-        with:
-          node-version: "20"
-          cache: "npm"
-
-      - name: Install dependencies
-        run: npm ci
-
-      - name: Download test results
-        uses: actions/download-artifact@v4
-        with:
-          name: test-results-windows
-
-      - name: Download test output
-        uses: actions/download-artifact@v4
-        with:
-          name: test-output-windows
-
-      - name: Upload test results to Sentry Prevent
-        if: ${{ !cancelled() }}
-        uses: getsentry/prevent-action@v0
-        with:
-          token: ${{ secrets.SENTRY_PREVENT_TOKEN }}
-
-      - name: Publish Test Results
-        uses: EnricoMi/publish-unit-test-result-action@v2
-        if: always()
-        with:
-          files: test-report.junit.xml
-          comment_mode: always
-          check_name: Test Results (Windows)

package/.github/workflows/publish.yaml

@@ -1,75 +0,0 @@
-name: Publish
-permissions:
-  contents: write
-  id-token: write # Required for OIDC
-on:
-  push:
-    branches: [main]
-
-jobs:
-  publish:
-    runs-on: ubuntu-latest
-
-    steps:
-      - uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-          token: ${{ secrets.GITHUB_TOKEN }}
-
-      - name: Setup Node.js
-        uses: actions/setup-node@v4
-        with:
-          node-version: "20"
-          registry-url: "https://registry.npmjs.org/"
-
-      - name: Configure Git
-        run: |
-          git config user.name "github-actions[bot]"
-          git config user.email "github-actions[bot]@users.noreply.github.com"
-
-      - name: Install dependencies
-        run: npm ci
-
-      - name: Build MCP Server
-        run: npm run build:mcp
-
-      - name: Bump version (patch)
-        run: npm version patch --no-git-tag-version
-
-      - name: Generate Changelog
-        run: |
-          npx conventional-changelog-cli -p angular -i CHANGELOG.md -s
-          git add CHANGELOG.md
-
-      - name: Commit and push version bump
-        run: |
-          git add package.json package-lock.json
-          VERSION=$(node -p "require('./package.json').version")
-          git commit -m "chore(release): ${VERSION}"
-          git tag "v${VERSION}"
-          
-          # Pull any changes that happened since checkout
-          git pull --rebase origin main
-          
-          git push origin main
-          git push origin "v${VERSION}"
-          echo "VERSION=${VERSION}" >> $GITHUB_ENV
-
-      - name: Create GitHub Release
-        uses: softprops/action-gh-release@v1
-        with:
-          tag_name: v${{ env.VERSION }}
-          generate_release_notes: true
-          prerelease: false
-
-      - name: Debug NPM Token
-        run: |
-          echo "NPM_TOKEN is set: ${{ secrets.NPM_TOKEN != '' }}"
-          echo "NPM_TOKEN first 4 chars: ${NPM_TOKEN:0:4}..."
-        env:
-          NPM_TOKEN: ${{ secrets.NPM_TOKEN }}
-
-      - name: Publish to npm
-        run: npm publish
-        env:
-          NODE_AUTH_TOKEN: ${{ secrets.NPM_TOKEN }}

package/.github/workflows/test-init.yml

@@ -1,157 +0,0 @@
-name: Test Init Command
-
-on:
-  push:
-    branches: [ main, develop ]
-  pull_request:
-    branches: [ main, develop ]
-  workflow_dispatch:
-
-jobs:
-  test-init:
-    runs-on: ubuntu-latest
-    
-    steps:
-    - name: Checkout CLI repository
-      uses: actions/checkout@v4
-    
-    - name: Setup Node.js
-      uses: actions/setup-node@v4
-      with:
-        node-version: '20'
-        cache: 'npm'
-    
-    - name: Install CLI dependencies
-      run: npm ci
-    
-    - name: Pack local testdriverai
-      run: |
-        npm pack
-        mv testdriverai-*.tgz /tmp/testdriverai-local.tgz
-    
-    - name: Create test directory
-      run: |
-        mkdir -p /tmp/test-init-project
-        cd /tmp/test-init-project
-    
-    - name: Run init command (skip prompts)
-      working-directory: /tmp/test-init-project
-      run: |
-        # Create .env with API key first to skip the prompt
-        echo "TD_API_KEY=${{ secrets.TD_API_KEY }}" > .env
-        
-        # Run init command using the CLI from the repo
-        node ${{ github.workspace }}/bin/testdriverai.js init
-      env:
-        TD_API_KEY: ${{ secrets.TD_API_KEY }}
-    
-    - name: Replace npm testdriverai with local build
-      working-directory: /tmp/test-init-project
-      run: |
-        # Remove npm-installed version and install local tarball
-        npm uninstall testdriverai
-        npm install /tmp/testdriverai-local.tgz
-    
-    - name: Verify project structure
-      working-directory: /tmp/test-init-project
-      run: |
-        echo "Checking generated files..."
-        
-        # Check for package.json
-        if [ ! -f "package.json" ]; then
-          echo "❌ package.json not found"
-          exit 1
-        fi
-        echo "✓ package.json exists"
-        
-        # Check for vitest config
-        if [ ! -f "vitest.config.js" ]; then
-          echo "❌ vitest.config.js not found"
-          exit 1
-        fi
-        echo "✓ vitest.config.js exists"
-        
-        # Check for test file
-        if [ ! -f "tests/example.test.js" ]; then
-          echo "❌ tests/example.test.js not found"
-          exit 1
-        fi
-        echo "✓ tests/example.test.js exists"
-        
-        # Check for .env file
-        if [ ! -f ".env" ]; then
-          echo "❌ .env not found"
-          exit 1
-        fi
-        echo "✓ .env exists"
-        
-        # Check for .gitignore
-        if [ ! -f ".gitignore" ]; then
-          echo "❌ .gitignore not found"
-          exit 1
-        fi
-        echo "✓ .gitignore exists"
-        
-        # Check for GitHub workflow
-        if [ ! -f ".github/workflows/testdriver.yml" ]; then
-          echo "❌ .github/workflows/testdriver.yml not found"
-          exit 1
-        fi
-        echo "✓ .github/workflows/testdriver.yml exists"
-    
-    - name: Verify vitest config contents
-      working-directory: /tmp/test-init-project
-      run: |
-        echo "Checking vitest.config.js contents..."
-        
-        # Check for TestDriver reporter
-        if ! grep -q "TestDriver()" vitest.config.js; then
-          echo "❌ TestDriver reporter not found in vitest.config.js"
-          cat vitest.config.js
-          exit 1
-        fi
-        echo "✓ TestDriver reporter is configured"
-        
-        # Check for setupFiles
-        if ! grep -q "setupFiles.*testdriverai/vitest/setup" vitest.config.js; then
-          echo "❌ setupFiles not configured correctly"
-          cat vitest.config.js
-          exit 1
-        fi
-        echo "✓ setupFiles is configured"
-    
-    - name: Verify test file contents
-      working-directory: /tmp/test-init-project
-      run: |
-        echo "Checking test file contents..."
-        
-        # Check for .provision usage
-        if ! grep -q "\.provision\.chrome" tests/example.test.js; then
-          echo "❌ Test does not use .provision.chrome"
-          cat tests/example.test.js
-          exit 1
-        fi
-        echo "✓ Test uses .provision.chrome"
-        
-        # Check for TestDriver import
-        if ! grep -q "from 'testdriverai/vitest/hooks'" tests/example.test.js; then
-          echo "❌ Test does not import from testdriverai/vitest/hooks"
-          cat tests/example.test.js
-          exit 1
-        fi
-        echo "✓ Test imports TestDriver from vitest/hooks"
-    
-    - name: Run the generated test
-      working-directory: /tmp/test-init-project
-      run: npm test
-      env:
-        TD_API_KEY: ${{ secrets.TD_API_KEY }}
-    
-    - name: Upload test results
-      if: always()
-      uses: actions/upload-artifact@v4
-      with:
-        name: test-init-results
-        path: /tmp/test-init-project/test-results/
-        retention-days: 7
-        if-no-files-found: warn