testdriverai 6.1.11-canary.648fdd8.0 → 6.1.11-canary.71a85f4.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (7) hide show
  1. package/.github/workflows/self-hosted.yml +1 -1
  2. package/agent/index.js +2 -0
  3. package/docs/getting-started/self-hosting.mdx +47 -8
  4. package/docs/guide/environment-variables.mdx +4 -5
  5. package/docs/overview/comparison.mdx +50 -31
  6. package/package.json +1 -1
  7. package/setup/aws/cloudformation.yaml +9 -2
package/.github/workflows/self-hosted.yml CHANGED
@@ -69,7 +69,7 @@ jobs:
69
69
  AWS_SECRET_ACCESS_KEY: ${{ secrets.AWS_SECRET_ACCESS_KEY }}
70
70
  AWS_REGION: us-east-2
71
71
  AWS_LAUNCH_TEMPLATE_ID: lt-00d02f31cfc602f27
72
- AMI_ID: ami-055cd47506a2f39bb
72
+ AMI_ID: ami-086b5b4b86d78987c
73
73
  RESOLUTION: 1920x1080
74
74
  - name: Run TestDriver
75
75
  run: node bin/testdriverai.js run testdriver/acceptance/${{ matrix.test }} --ip="${{ steps.aws-setup.outputs.public-ip }}" --junit=out.xml
package/agent/index.js CHANGED
@@ -1718,6 +1718,8 @@ ${regression}
1718
1718
  ip: this.ip,
1719
1719
  });
1720
1720
 
1721
+ this.emitter.emit(events.sandbox.connected);
1722
+
1721
1723
  await this.renderSandbox(instance.instance, headless);
1722
1724
  await this.newSession();
1723
1725
  await this.runLifecycle("provision");
package/docs/getting-started/self-hosting.mdx CHANGED
@@ -46,7 +46,7 @@ The setup process involves three main steps:
46
46
  <Tip>
47
47
  Be sure to run `aws configure` with your credentials
48
48
  </Tip>
49
- - Access to the TestDriver AMI (Golden Image is `ami-055cd47506a2f39bb`)\
49
+ - Access to the TestDriver AMI (Golden Image is `ami-086b5b4b86d78987c`)\
50
50
  [Contact us with your preferred AWS Region for access](https://form.typeform.com/to/UECf9rDx?typeform-source=testdriver.ai).
51
51
  - A GitHub repository for committing your tests & workflow.
52
52
 
@@ -134,7 +134,7 @@ AWS_REGION=us-east-2
134
134
 
135
135
  #### Changing Resolution in Lifecycle Files
136
136
 
137
- You can also change the resolution before running tests by adding an `exec` command in your `lifecycle/provision.yaml` file:
137
+ You can also change the resolution before running tests by adding an [`exec`](/commands/exec) command in your `lifecycle/provision.yaml` file:
138
138
 
139
139
  ```yaml lifecycle/provision.yaml
140
140
  version: 6.0.0
@@ -244,7 +244,7 @@ Configure these secrets in your GitHub repository:
244
244
  | `AWS_REGION` | AWS Region | `us-east-2` |
245
245
  | `AWS_SECRET_ACCESS_KEY` | AWS secret key | `wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY` |
246
246
  | `AWS_LAUNCH_TEMPLATE_ID` | Launch template from CloudFormation | `lt-07c53ce8349b958d1` |
247
- | `AMI_ID` | TestDriver AMI ID | `ami-085f872ca0cd80fed` |
247
+ | `AMI_ID` | TestDriver AMI ID | `ami-086b5b4b86d78987c` |
248
248
  | `TD_API_KEY` | TestDriver API key | Your API key from [the dashboard](https://app.testdriver.ai) |
249
249
 
250
250
  ## AMI Customization
@@ -272,12 +272,51 @@ Our TestDriver Golden Image (AMI) comes pre-configured with everything you need
272
272
 
273
273
  ### Modifying the AMI
274
274
 
275
- You can customize the AMI for your specific needs:
275
+ <Danger>
276
+ **Change Default Password First**: The TestDriver AMI includes a default password for initial access. You MUST change this password before saving a new AMI. Never use the default password in production environments.
277
+ </Danger>
278
+
279
+ You can customize the AMI for your specific needs. Follow these steps carefully:
280
+
281
+ #### Step 1: Initial Access
282
+
283
+ Connect to your instance via RDP using the default credentials:
284
+
285
+ - **Username**: `testdriver`
286
+ - **Default Password**: `changemeABC123`
287
+
288
+ #### Step 2: Change the Password
289
+
290
+ Before doing anything else, change the default password:
291
+
292
+ 1. Open PowerShell on the instance
293
+ 2. Run the password rotation script:
294
+
295
+ ```powershell
296
+ C:\testdriver\RotateLocalPasswords.ps1
297
+ ```
298
+ 3. **Save the new password securely** - you'll need it for all future access to this instance
299
+
300
+ <Note>
301
+ The password rotation script will generate a secure password for the `testdriver` account. Make sure to save this password in a secure location (password manager, secrets vault, etc.) before proceeding.
302
+ </Note>
303
+
304
+ #### Step 3: Make Your Customizations
305
+
306
+ Now that you've secured the instance with a new password:
307
+
308
+ 1. **Make your changes** using the `testdriver` account with your new password
309
+ 2. Install additional software as needed
310
+ 3. Configure settings specific to your environment
311
+
312
+ <Tip>
313
+ **Need to make further customizations or debug issues?** RDP back into the instance using the `testdriver` account with the new password you set in Step 2. This gives you full desktop access to install software, modify configurations, or troubleshoot problems before saving your custom AMI.
314
+ </Tip>
315
+
316
+ #### Step 4: Save Your Custom AMI
276
317
 
277
- 1. **Launch an instance** from our base AMI
278
- 2. **Make your changes** (install software, configure settings)
279
- 3. **Create a new AMI** from your modified instance
280
- 4. **Update your workflow** to use the new AMI ID
318
+ 1. **Create a new AMI** from your modified instance using the AWS console or CLI
319
+ 2. **Update your workflow** to use the new AMI ID
281
320
 
282
321
  ### Amazon Image Builder
283
322
 
package/docs/guide/environment-variables.mdx CHANGED
@@ -11,11 +11,10 @@ import GitignoreWarning from "/snippets/gitignore-warning.mdx";
11
11
  The supported environment variables in TestDriver are:
12
12
 
13
13
  <div className="env-vars-table">
14
- | Variable | Type | Description |
15
- |:---------------:|:---------:|---------------------------------------------------------------------------------|
16
- | TD_ANALYTICS | boolean | Send analytics to TestDriver servers. This helps
17
- provide feedback to inform our roadmap. | | TD_API_KEY | string | Set this to
18
- spawn VMs with TestDriver Pro. |
14
+ | Variable | Type | Description |
15
+ |:---------------:|:------------:|:-------------------------------------------------------------------------------:|
16
+ | `TD_ANALYTICS` | `boolean` | Send analytics to TestDriver servers. This helps provide feedback to inform our roadmap. |
17
+ | `TD_API_KEY` | `string` | Set this to spawn VMs with TestDriver Pro. |
19
18
  </div>
20
19
  <GitignoreWarning />
21
20
  ## Example
package/docs/overview/comparison.mdx CHANGED
@@ -11,9 +11,12 @@ TestDriver operates a full desktop environment, so it can run any application.
11
11
 
12
12
  <div className="comparison-table">
13
13
  | Application | TestDriver | Playwright | Selenium |
14
- |:-----------------:|:---------:|:-----------:|:--------:| | Web Apps | ✅ |
15
- ✅ | ✅ | | Mobile Apps | ✅ | ✅ | ✅ | | VS Code | ✅ | ✅ | ✅ | | Desktop
16
- Apps | ✅ | | | | Chrome Extensions | ✅ | | |
14
+ |:-----------------:|:---------:|:-----------:|:--------:|
15
+ | Web Apps | ✅ | ✅ | ✅ |
16
+ | Mobile Apps | ✅ | ✅ | ✅ |
17
+ | VS Code Plugins | ✅ | | |
18
+ | Desktop Apps | ✅ | | |
19
+ | Chrome Extensions | ✅ | | |
17
20
  </div>
18
21
 
19
22
  ## Testing features
@@ -21,11 +24,16 @@ TestDriver operates a full desktop environment, so it can run any application.
21
24
  TestDriver is AI first.
22
25
 
23
26
  <div className="comparison-table">
24
- | Feature | TestDriver | Playwright | Selenium |
25
- |:--------------------:|:---------:|:----------:|:--------:| | Test Generation
26
- | ✅ | | | | Adaptive Testing | ✅ | | | | Visual Assertions | ✅ | | | | Self
27
- Healing | ✅ | | | | Application Switching | ✅ | | | | GitHub Actions | ✅ |
28
- ✅ | | | Team Dashboard | ✅ | | | | Team Collaboration | ✅ | | |
27
+ | Feature | TestDriver | Playwright | Selenium |
28
+ |:--------------------:|:----------:|:----------:|:--------:|
29
+ | Test Generation | ✅ | | |
30
+ | Adaptive Testing | ✅ | | |
31
+ | Visual Assertions | ✅ | | |
32
+ | Self Healing | ✅ | | |
33
+ | Application Switching| ✅ | | |
34
+ | GitHub Actions | ✅ | ✅ | |
35
+ | Team Dashboard | ✅ | | |
36
+ | Team Collaboration | ✅ | | |
29
37
  </div>
30
38
 
31
39
  ## Test coverage
@@ -36,16 +44,16 @@ TestDriver has more coverage than selector-based frameworks.
36
44
  | Feature | TestDriver | Playwright | Selenium |
37
45
  |:------------------:|:----------:|:----------:|:--------:|
38
46
  | Browser Viewport | ✅ | ✅ | ✅ |
39
- | Browser App | ✅ | | |
40
- | Operating System | ✅ | | |
41
- | PDFs | ✅ | | |
42
- | File System | ✅ | | |
43
- | Push Notifications | ✅ | | |
44
- | Image Content | ✅ | | |
45
- | Video Content | ✅ | | |
46
- | `<iframe>` | ✅ | | |
47
- | `<canvas>` | ✅ | | |
48
- | `<video>` | ✅ | | |
47
+ | Browser App | ✅ | | |
48
+ | Operating System | ✅ | | |
49
+ | PDFs | ✅ | | |
50
+ | File System | ✅ | | |
51
+ | Push Notifications | ✅ | | |
52
+ | Image Content | ✅ | | |
53
+ | Video Content | ✅ | | |
54
+ | `<iframe>` | ✅ | | |
55
+ | `<canvas>` | ✅ | | |
56
+ | `<video>` | ✅ | | |
49
57
  </div>
50
58
 
51
59
  ## Debugging features
@@ -53,11 +61,15 @@ TestDriver has more coverage than selector-based frameworks.
53
61
  Debugging features are powered by [Dashcam.io](https://dashcam.io).
54
62
 
55
63
  <div className="comparison-table">
56
- | Feature | TestDriver | Playwright | Selenium |
57
- |:------------------:|:----------:|:----------:|:--------:| | AI Summary | ✅
58
- | | | | Video Replay | ✅ | ✅ | | | Browser Logs | ✅ | ✅ | | | Desktop Logs
59
- | ✅ | | | | Network Requests | ✅ | ✅ | | | Team Dashboard | ✅ | | | | Team
60
- Collaboration | ✅ | | |
64
+ | Feature | TestDriver | Playwright | Selenium |
65
+ |:--------------------:|:----------:|:----------:|:--------:|
66
+ | AI Summary | ✅ | | |
67
+ | Video Replay | ✅ | ✅ | |
68
+ | Browser Logs | ✅ | ✅ | |
69
+ | Desktop Logs | ✅ | | |
70
+ | Network Requests | ✅ | ✅ | |
71
+ | Team Dashboard | ✅ | | |
72
+ | Team Collaboration | ✅ | | |
61
73
  </div>
62
74
 
63
75
  ## Web browser support
@@ -65,18 +77,25 @@ Debugging features are powered by [Dashcam.io](https://dashcam.io).
65
77
  TestDriver is browser agnostic and supports any version of any browser.
66
78
 
67
79
  <div className="comparison-table">
68
- | Feature | TestDriver | Playwright | Selenium |
69
- |:--------:|:----------:|:----------:|:--------:| | Chrome | ✅ | ✅ | ✅ | |
70
- Firefox | ✅ | ✅ | ✅ | | Webkit | ✅ | ✅ | ✅ | | IE | ✅ | | ✅ | | Edge |
71
- ✅ | ✅ | ✅ | | Opera | ✅ | | ✅ | | Safari | ✅ | | ✅ |
80
+ | Feature | TestDriver | Playwright | Selenium |
81
+ |:--------:|:----------:|:----------:|:--------:|
82
+ | Chrome | ✅ | ✅ | ✅ |
83
+ | Firefox | ✅ | ✅ | ✅ |
84
+ | Webkit | ✅ | ✅ | ✅ |
85
+ | IE | ✅ | | ✅ |
86
+ | Edge | ✅ | ✅ | ✅ |
87
+ | Opera | ✅ | | ✅ |
88
+ | Safari | ✅ | | ✅ |
72
89
  </div>
73
90
 
74
91
  ## Operating system support
75
92
 
76
- TestDriver currently supports Mac and Windows!
93
+ TestDriver currently supports all the three major operating systems!
77
94
 
78
95
  <div className="comparison-table">
79
- | Feature | TestDriver | Playwright | Selenium |
80
- |:--------:|:----------:|:----------:|:--------:| | Windows | ✅ | ✅ | ✅ | |
81
- Mac | ✅ | ✅ | ✅ | | Linux | | ✅ | ✅ |
96
+ | Feature | TestDriver | Playwright | Selenium |
97
+ |:--------:|:----------:|:----------:|:--------:|
98
+ | Windows | ✅ | ✅ | ✅ |
99
+ | Mac | ✅ | ✅ | ✅ |
100
+ | Linux | ✅ | ✅ | ✅ |
82
101
  </div>
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "testdriverai",
3
- "version": "6.1.11-canary.648fdd8.0",
3
+ "version": "6.1.11-canary.71a85f4.0",
4
4
  "description": "Next generation autonomous AI agent for end-to-end testing of web & desktop",
5
5
  "main": "index.js",
6
6
  "bin": {
package/setup/aws/cloudformation.yaml CHANGED
@@ -168,8 +168,15 @@ Resources:
168
168
  IpProtocol: tcp,
169
169
  FromPort: 8765,
170
170
  ToPort: 8765,
171
- CidrIp: !Ref AllowedIngressCidr,
172
- Description: "pyautogui-cli WebSockets",
171
+ CidrIp: 35.171.123.200/32,
172
+ Description: "pyautogui-cli WebSockets - Static IP 1",
173
+ }
174
+ - {
175
+ IpProtocol: tcp,
176
+ FromPort: 8765,
177
+ ToPort: 8765,
178
+ CidrIp: 52.201.199.222/32,
179
+ Description: "pyautogui-cli WebSockets - Static IP 2",
173
180
  }
174
181
  - {
175
182
  IpProtocol: tcp,