testdriverai 6.1.11-canary.0fe4fdc.0 → 6.1.11-canary.5037571.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (7) hide show
  1. package/.github/workflows/self-hosted.yml +1 -2
  2. package/agent/index.js +2 -0
  3. package/docs/getting-started/self-hosting.mdx +45 -7
  4. package/docs/guide/environment-variables.mdx +4 -5
  5. package/docs/overview/comparison.mdx +50 -31
  6. package/package.json +1 -1
  7. package/setup/aws/cloudformation.yaml +9 -2
package/.github/workflows/self-hosted.yml CHANGED
@@ -70,8 +70,7 @@ jobs:
70
70
  AWS_REGION: us-east-2
71
71
  AWS_LAUNCH_TEMPLATE_ID: lt-00d02f31cfc602f27
72
72
  AMI_ID: ami-055cd47506a2f39bb
73
- RESOLUTION_WIDTH: 1920
74
- RESOLUTION_HEIGHT: 1080
73
+ RESOLUTION: 1920x1080
75
74
  - name: Run TestDriver
76
75
  run: node bin/testdriverai.js run testdriver/acceptance/${{ matrix.test }} --ip="${{ steps.aws-setup.outputs.public-ip }}" --junit=out.xml
77
76
  env:
package/agent/index.js CHANGED
@@ -1718,6 +1718,8 @@ ${regression}
1718
1718
  ip: this.ip,
1719
1719
  });
1720
1720
 
1721
+ this.emitter.emit(events.sandbox.connected);
1722
+
1721
1723
  await this.renderSandbox(instance.instance, headless);
1722
1724
  await this.newSession();
1723
1725
  await this.runLifecycle("provision");
package/docs/getting-started/self-hosting.mdx CHANGED
@@ -134,7 +134,7 @@ AWS_REGION=us-east-2
134
134
 
135
135
  #### Changing Resolution in Lifecycle Files
136
136
 
137
- You can also change the resolution before running tests by adding an `exec` command in your `lifecycle/provision.yaml` file:
137
+ You can also change the resolution before running tests by adding an [`exec`](/commands/exec) command in your `lifecycle/provision.yaml` file:
138
138
 
139
139
  ```yaml lifecycle/provision.yaml
140
140
  version: 6.0.0
@@ -272,12 +272,50 @@ Our TestDriver Golden Image (AMI) comes pre-configured with everything you need
272
272
 
273
273
  ### Modifying the AMI
274
274
 
275
- You can customize the AMI for your specific needs:
275
+ <Danger>
276
+ **Change Default Password First**: The TestDriver AMI includes a default password for initial access. You MUST change this password before saving a new AMI. Never use the default password in production environments.
277
+ </Danger>
278
+
279
+ You can customize the AMI for your specific needs. Follow these steps carefully:
280
+
281
+ #### Step 1: Initial Access
282
+
283
+ Connect to your instance via RDP using the default credentials:
284
+
285
+ - **Username**: `testdriver`
286
+ - **Default Password**: `changemeABC123`
287
+
288
+ #### Step 2: Change the Password
289
+
290
+ Before doing anything else, change the default password:
291
+
292
+ 1. Open PowerShell on the instance
293
+ 2. Run the password rotation script:
294
+ ```powershell
295
+ C:\testdriver\RotateLocalPasswords.ps1
296
+ ```
297
+ 3. **Save the new password securely** - you'll need it for all future access to this instance
298
+
299
+ <Note>
300
+ The password rotation script will generate a secure password for the `testdriver` account. Make sure to save this password in a secure location (password manager, secrets vault, etc.) before proceeding.
301
+ </Note>
302
+
303
+ #### Step 3: Make Your Customizations
304
+
305
+ Now that you've secured the instance with a new password:
306
+
307
+ 1. **Make your changes** using the `testdriver` account with your new password
308
+ 2. Install additional software as needed
309
+ 3. Configure settings specific to your environment
310
+
311
+ <Tip>
312
+ **Need to make further customizations or debug issues?** RDP back into the instance using the `testdriver` account with the new password you set in Step 2. This gives you full desktop access to install software, modify configurations, or troubleshoot problems before saving your custom AMI.
313
+ </Tip>
314
+
315
+ #### Step 4: Save Your Custom AMI
276
316
 
277
- 1. **Launch an instance** from our base AMI
278
- 2. **Make your changes** (install software, configure settings)
279
- 3. **Create a new AMI** from your modified instance
280
- 4. **Update your workflow** to use the new AMI ID
317
+ 1. **Create a new AMI** from your modified instance using the AWS console or CLI
318
+ 2. **Update your workflow** to use the new AMI ID
281
319
 
282
320
  ### Amazon Image Builder
283
321
 
@@ -366,4 +404,4 @@ For enterprise customers:
366
404
 
367
405
  - Contact your account manager for AMI access issues
368
406
  - Use support channels for infrastructure questions
369
- - Check the TestDriver documentation for CLI usage
407
+ - Check the TestDriver documentation for CLI usage
package/docs/guide/environment-variables.mdx CHANGED
@@ -11,11 +11,10 @@ import GitignoreWarning from "/snippets/gitignore-warning.mdx";
11
11
  The supported environment variables in TestDriver are:
12
12
 
13
13
  <div className="env-vars-table">
14
- | Variable | Type | Description |
15
- |:---------------:|:---------:|---------------------------------------------------------------------------------|
16
- | TD_ANALYTICS | boolean | Send analytics to TestDriver servers. This helps
17
- provide feedback to inform our roadmap. | | TD_API_KEY | string | Set this to
18
- spawn VMs with TestDriver Pro. |
14
+ | Variable | Type | Description |
15
+ |:---------------:|:------------:|:-------------------------------------------------------------------------------:|
16
+ | `TD_ANALYTICS` | `boolean` | Send analytics to TestDriver servers. This helps provide feedback to inform our roadmap. |
17
+ | `TD_API_KEY` | `string` | Set this to spawn VMs with TestDriver Pro. |
19
18
  </div>
20
19
  <GitignoreWarning />
21
20
  ## Example
package/docs/overview/comparison.mdx CHANGED
@@ -11,9 +11,12 @@ TestDriver operates a full desktop environment, so it can run any application.
11
11
 
12
12
  <div className="comparison-table">
13
13
  | Application | TestDriver | Playwright | Selenium |
14
- |:-----------------:|:---------:|:-----------:|:--------:| | Web Apps | ✅ |
15
- ✅ | ✅ | | Mobile Apps | ✅ | ✅ | ✅ | | VS Code | ✅ | ✅ | ✅ | | Desktop
16
- Apps | ✅ | | | | Chrome Extensions | ✅ | | |
14
+ |:-----------------:|:---------:|:-----------:|:--------:|
15
+ | Web Apps | ✅ | ✅ | ✅ |
16
+ | Mobile Apps | ✅ | ✅ | ✅ |
17
+ | VS Code Plugins | ✅ | | |
18
+ | Desktop Apps | ✅ | | |
19
+ | Chrome Extensions | ✅ | | |
17
20
  </div>
18
21
 
19
22
  ## Testing features
@@ -21,11 +24,16 @@ TestDriver operates a full desktop environment, so it can run any application.
21
24
  TestDriver is AI first.
22
25
 
23
26
  <div className="comparison-table">
24
- | Feature | TestDriver | Playwright | Selenium |
25
- |:--------------------:|:---------:|:----------:|:--------:| | Test Generation
26
- | ✅ | | | | Adaptive Testing | ✅ | | | | Visual Assertions | ✅ | | | | Self
27
- Healing | ✅ | | | | Application Switching | ✅ | | | | GitHub Actions | ✅ |
28
- ✅ | | | Team Dashboard | ✅ | | | | Team Collaboration | ✅ | | |
27
+ | Feature | TestDriver | Playwright | Selenium |
28
+ |:--------------------:|:----------:|:----------:|:--------:|
29
+ | Test Generation | ✅ | | |
30
+ | Adaptive Testing | ✅ | | |
31
+ | Visual Assertions | ✅ | | |
32
+ | Self Healing | ✅ | | |
33
+ | Application Switching| ✅ | | |
34
+ | GitHub Actions | ✅ | ✅ | |
35
+ | Team Dashboard | ✅ | | |
36
+ | Team Collaboration | ✅ | | |
29
37
  </div>
30
38
 
31
39
  ## Test coverage
@@ -36,16 +44,16 @@ TestDriver has more coverage than selector-based frameworks.
36
44
  | Feature | TestDriver | Playwright | Selenium |
37
45
  |:------------------:|:----------:|:----------:|:--------:|
38
46
  | Browser Viewport | ✅ | ✅ | ✅ |
39
- | Browser App | ✅ | | |
40
- | Operating System | ✅ | | |
41
- | PDFs | ✅ | | |
42
- | File System | ✅ | | |
43
- | Push Notifications | ✅ | | |
44
- | Image Content | ✅ | | |
45
- | Video Content | ✅ | | |
46
- | `<iframe>` | ✅ | | |
47
- | `<canvas>` | ✅ | | |
48
- | `<video>` | ✅ | | |
47
+ | Browser App | ✅ | | |
48
+ | Operating System | ✅ | | |
49
+ | PDFs | ✅ | | |
50
+ | File System | ✅ | | |
51
+ | Push Notifications | ✅ | | |
52
+ | Image Content | ✅ | | |
53
+ | Video Content | ✅ | | |
54
+ | `<iframe>` | ✅ | | |
55
+ | `<canvas>` | ✅ | | |
56
+ | `<video>` | ✅ | | |
49
57
  </div>
50
58
 
51
59
  ## Debugging features
@@ -53,11 +61,15 @@ TestDriver has more coverage than selector-based frameworks.
53
61
  Debugging features are powered by [Dashcam.io](https://dashcam.io).
54
62
 
55
63
  <div className="comparison-table">
56
- | Feature | TestDriver | Playwright | Selenium |
57
- |:------------------:|:----------:|:----------:|:--------:| | AI Summary | ✅
58
- | | | | Video Replay | ✅ | ✅ | | | Browser Logs | ✅ | ✅ | | | Desktop Logs
59
- | ✅ | | | | Network Requests | ✅ | ✅ | | | Team Dashboard | ✅ | | | | Team
60
- Collaboration | ✅ | | |
64
+ | Feature | TestDriver | Playwright | Selenium |
65
+ |:--------------------:|:----------:|:----------:|:--------:|
66
+ | AI Summary | ✅ | | |
67
+ | Video Replay | ✅ | ✅ | |
68
+ | Browser Logs | ✅ | ✅ | |
69
+ | Desktop Logs | ✅ | | |
70
+ | Network Requests | ✅ | ✅ | |
71
+ | Team Dashboard | ✅ | | |
72
+ | Team Collaboration | ✅ | | |
61
73
  </div>
62
74
 
63
75
  ## Web browser support
@@ -65,18 +77,25 @@ Debugging features are powered by [Dashcam.io](https://dashcam.io).
65
77
  TestDriver is browser agnostic and supports any version of any browser.
66
78
 
67
79
  <div className="comparison-table">
68
- | Feature | TestDriver | Playwright | Selenium |
69
- |:--------:|:----------:|:----------:|:--------:| | Chrome | ✅ | ✅ | ✅ | |
70
- Firefox | ✅ | ✅ | ✅ | | Webkit | ✅ | ✅ | ✅ | | IE | ✅ | | ✅ | | Edge |
71
- ✅ | ✅ | ✅ | | Opera | ✅ | | ✅ | | Safari | ✅ | | ✅ |
80
+ | Feature | TestDriver | Playwright | Selenium |
81
+ |:--------:|:----------:|:----------:|:--------:|
82
+ | Chrome | ✅ | ✅ | ✅ |
83
+ | Firefox | ✅ | ✅ | ✅ |
84
+ | Webkit | ✅ | ✅ | ✅ |
85
+ | IE | ✅ | | ✅ |
86
+ | Edge | ✅ | ✅ | ✅ |
87
+ | Opera | ✅ | | ✅ |
88
+ | Safari | ✅ | | ✅ |
72
89
  </div>
73
90
 
74
91
  ## Operating system support
75
92
 
76
- TestDriver currently supports Mac and Windows!
93
+ TestDriver currently supports all the three major operating systems!
77
94
 
78
95
  <div className="comparison-table">
79
- | Feature | TestDriver | Playwright | Selenium |
80
- |:--------:|:----------:|:----------:|:--------:| | Windows | ✅ | ✅ | ✅ | |
81
- Mac | ✅ | ✅ | ✅ | | Linux | | ✅ | ✅ |
96
+ | Feature | TestDriver | Playwright | Selenium |
97
+ |:--------:|:----------:|:----------:|:--------:|
98
+ | Windows | ✅ | ✅ | ✅ |
99
+ | Mac | ✅ | ✅ | ✅ |
100
+ | Linux | ✅ | ✅ | ✅ |
82
101
  </div>
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "testdriverai",
3
- "version": "6.1.11-canary.0fe4fdc.0",
3
+ "version": "6.1.11-canary.5037571.0",
4
4
  "description": "Next generation autonomous AI agent for end-to-end testing of web & desktop",
5
5
  "main": "index.js",
6
6
  "bin": {
package/setup/aws/cloudformation.yaml CHANGED
@@ -168,8 +168,15 @@ Resources:
168
168
  IpProtocol: tcp,
169
169
  FromPort: 8765,
170
170
  ToPort: 8765,
171
- CidrIp: !Ref AllowedIngressCidr,
172
- Description: "pyautogui-cli WebSockets",
171
+ CidrIp: 35.171.123.200/32,
172
+ Description: "pyautogui-cli WebSockets - Static IP 1",
173
+ }
174
+ - {
175
+ IpProtocol: tcp,
176
+ FromPort: 8765,
177
+ ToPort: 8765,
178
+ CidrIp: 52.201.199.222/32,
179
+ Description: "pyautogui-cli WebSockets - Static IP 2",
173
180
  }
174
181
  - {
175
182
  IpProtocol: tcp,