testdriverai 6.1.11-canary.6f43621.0 → 6.1.11-canary.71a85f4.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
|
@@ -69,7 +69,7 @@ jobs:
|
|
|
69
69
|
AWS_SECRET_ACCESS_KEY: ${{ secrets.AWS_SECRET_ACCESS_KEY }}
|
|
70
70
|
AWS_REGION: us-east-2
|
|
71
71
|
AWS_LAUNCH_TEMPLATE_ID: lt-00d02f31cfc602f27
|
|
72
|
-
AMI_ID: ami-
|
|
72
|
+
AMI_ID: ami-086b5b4b86d78987c
|
|
73
73
|
RESOLUTION: 1920x1080
|
|
74
74
|
- name: Run TestDriver
|
|
75
75
|
run: node bin/testdriverai.js run testdriver/acceptance/${{ matrix.test }} --ip="${{ steps.aws-setup.outputs.public-ip }}" --junit=out.xml
|
|
@@ -46,7 +46,7 @@ The setup process involves three main steps:
|
|
|
46
46
|
<Tip>
|
|
47
47
|
Be sure to run `aws configure` with your credentials
|
|
48
48
|
</Tip>
|
|
49
|
-
- Access to the TestDriver AMI (Golden Image is `ami-
|
|
49
|
+
- Access to the TestDriver AMI (Golden Image is `ami-086b5b4b86d78987c`)\
|
|
50
50
|
[Contact us with your preferred AWS Region for access](https://form.typeform.com/to/UECf9rDx?typeform-source=testdriver.ai).
|
|
51
51
|
- A GitHub repository for committing your tests & workflow.
|
|
52
52
|
|
|
@@ -134,7 +134,7 @@ AWS_REGION=us-east-2
|
|
|
134
134
|
|
|
135
135
|
#### Changing Resolution in Lifecycle Files
|
|
136
136
|
|
|
137
|
-
You can also change the resolution before running tests by adding an `exec` command in your `lifecycle/provision.yaml` file:
|
|
137
|
+
You can also change the resolution before running tests by adding an [`exec`](/commands/exec) command in your `lifecycle/provision.yaml` file:
|
|
138
138
|
|
|
139
139
|
```yaml lifecycle/provision.yaml
|
|
140
140
|
version: 6.0.0
|
|
@@ -244,7 +244,7 @@ Configure these secrets in your GitHub repository:
|
|
|
244
244
|
| `AWS_REGION` | AWS Region | `us-east-2` |
|
|
245
245
|
| `AWS_SECRET_ACCESS_KEY` | AWS secret key | `wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY` |
|
|
246
246
|
| `AWS_LAUNCH_TEMPLATE_ID` | Launch template from CloudFormation | `lt-07c53ce8349b958d1` |
|
|
247
|
-
| `AMI_ID` | TestDriver AMI ID | `ami-
|
|
247
|
+
| `AMI_ID` | TestDriver AMI ID | `ami-086b5b4b86d78987c` |
|
|
248
248
|
| `TD_API_KEY` | TestDriver API key | Your API key from [the dashboard](https://app.testdriver.ai) |
|
|
249
249
|
|
|
250
250
|
## AMI Customization
|
|
@@ -291,6 +291,7 @@ Before doing anything else, change the default password:
|
|
|
291
291
|
|
|
292
292
|
1. Open PowerShell on the instance
|
|
293
293
|
2. Run the password rotation script:
|
|
294
|
+
|
|
294
295
|
```powershell
|
|
295
296
|
C:\testdriver\RotateLocalPasswords.ps1
|
|
296
297
|
```
|
|
@@ -404,4 +405,4 @@ For enterprise customers:
|
|
|
404
405
|
|
|
405
406
|
- Contact your account manager for AMI access issues
|
|
406
407
|
- Use support channels for infrastructure questions
|
|
407
|
-
- Check the TestDriver documentation for CLI usage
|
|
408
|
+
- Check the TestDriver documentation for CLI usage
|
|
@@ -11,11 +11,10 @@ import GitignoreWarning from "/snippets/gitignore-warning.mdx";
|
|
|
11
11
|
The supported environment variables in TestDriver are:
|
|
12
12
|
|
|
13
13
|
<div className="env-vars-table">
|
|
14
|
-
| Variable
|
|
15
|
-
|
|
16
|
-
| TD_ANALYTICS
|
|
17
|
-
|
|
18
|
-
spawn VMs with TestDriver Pro. |
|
|
14
|
+
| Variable | Type | Description |
|
|
15
|
+
|:---------------:|:------------:|:-------------------------------------------------------------------------------:|
|
|
16
|
+
| `TD_ANALYTICS` | `boolean` | Send analytics to TestDriver servers. This helps provide feedback to inform our roadmap. |
|
|
17
|
+
| `TD_API_KEY` | `string` | Set this to spawn VMs with TestDriver Pro. |
|
|
19
18
|
</div>
|
|
20
19
|
<GitignoreWarning />
|
|
21
20
|
## Example
|
|
@@ -11,9 +11,12 @@ TestDriver operates a full desktop environment, so it can run any application.
|
|
|
11
11
|
|
|
12
12
|
<div className="comparison-table">
|
|
13
13
|
| Application | TestDriver | Playwright | Selenium |
|
|
14
|
-
|:-----------------:|:---------:|:-----------:|:--------:|
|
|
15
|
-
|
|
16
|
-
|
|
14
|
+
|:-----------------:|:---------:|:-----------:|:--------:|
|
|
15
|
+
| Web Apps | ✅ | ✅ | ✅ |
|
|
16
|
+
| Mobile Apps | ✅ | ✅ | ✅ |
|
|
17
|
+
| VS Code Plugins | ✅ | | |
|
|
18
|
+
| Desktop Apps | ✅ | | |
|
|
19
|
+
| Chrome Extensions | ✅ | | |
|
|
17
20
|
</div>
|
|
18
21
|
|
|
19
22
|
## Testing features
|
|
@@ -21,11 +24,16 @@ TestDriver operates a full desktop environment, so it can run any application.
|
|
|
21
24
|
TestDriver is AI first.
|
|
22
25
|
|
|
23
26
|
<div className="comparison-table">
|
|
24
|
-
| Feature
|
|
25
|
-
|
|
26
|
-
|
|
|
27
|
-
|
|
28
|
-
|
|
27
|
+
| Feature | TestDriver | Playwright | Selenium |
|
|
28
|
+
|:--------------------:|:----------:|:----------:|:--------:|
|
|
29
|
+
| Test Generation | ✅ | | |
|
|
30
|
+
| Adaptive Testing | ✅ | | |
|
|
31
|
+
| Visual Assertions | ✅ | | |
|
|
32
|
+
| Self Healing | ✅ | | |
|
|
33
|
+
| Application Switching| ✅ | | |
|
|
34
|
+
| GitHub Actions | ✅ | ✅ | |
|
|
35
|
+
| Team Dashboard | ✅ | | |
|
|
36
|
+
| Team Collaboration | ✅ | | |
|
|
29
37
|
</div>
|
|
30
38
|
|
|
31
39
|
## Test coverage
|
|
@@ -36,16 +44,16 @@ TestDriver has more coverage than selector-based frameworks.
|
|
|
36
44
|
| Feature | TestDriver | Playwright | Selenium |
|
|
37
45
|
|:------------------:|:----------:|:----------:|:--------:|
|
|
38
46
|
| Browser Viewport | ✅ | ✅ | ✅ |
|
|
39
|
-
| Browser App | ✅ | |
|
|
40
|
-
| Operating System | ✅ | |
|
|
41
|
-
| PDFs | ✅ | |
|
|
42
|
-
| File System | ✅ | |
|
|
43
|
-
| Push Notifications | ✅ | |
|
|
44
|
-
| Image Content | ✅ | |
|
|
45
|
-
| Video Content | ✅ | |
|
|
46
|
-
| `<iframe>` | ✅ | |
|
|
47
|
-
| `<canvas>` | ✅ | |
|
|
48
|
-
| `<video>` | ✅ | |
|
|
47
|
+
| Browser App | ✅ | | |
|
|
48
|
+
| Operating System | ✅ | | |
|
|
49
|
+
| PDFs | ✅ | | |
|
|
50
|
+
| File System | ✅ | | |
|
|
51
|
+
| Push Notifications | ✅ | | |
|
|
52
|
+
| Image Content | ✅ | | |
|
|
53
|
+
| Video Content | ✅ | | |
|
|
54
|
+
| `<iframe>` | ✅ | | |
|
|
55
|
+
| `<canvas>` | ✅ | | |
|
|
56
|
+
| `<video>` | ✅ | | |
|
|
49
57
|
</div>
|
|
50
58
|
|
|
51
59
|
## Debugging features
|
|
@@ -53,11 +61,15 @@ TestDriver has more coverage than selector-based frameworks.
|
|
|
53
61
|
Debugging features are powered by [Dashcam.io](https://dashcam.io).
|
|
54
62
|
|
|
55
63
|
<div className="comparison-table">
|
|
56
|
-
| Feature
|
|
57
|
-
|
|
58
|
-
|
|
|
59
|
-
|
|
|
60
|
-
|
|
64
|
+
| Feature | TestDriver | Playwright | Selenium |
|
|
65
|
+
|:--------------------:|:----------:|:----------:|:--------:|
|
|
66
|
+
| AI Summary | ✅ | | |
|
|
67
|
+
| Video Replay | ✅ | ✅ | |
|
|
68
|
+
| Browser Logs | ✅ | ✅ | |
|
|
69
|
+
| Desktop Logs | ✅ | | |
|
|
70
|
+
| Network Requests | ✅ | ✅ | |
|
|
71
|
+
| Team Dashboard | ✅ | | |
|
|
72
|
+
| Team Collaboration | ✅ | | |
|
|
61
73
|
</div>
|
|
62
74
|
|
|
63
75
|
## Web browser support
|
|
@@ -65,18 +77,25 @@ Debugging features are powered by [Dashcam.io](https://dashcam.io).
|
|
|
65
77
|
TestDriver is browser agnostic and supports any version of any browser.
|
|
66
78
|
|
|
67
79
|
<div className="comparison-table">
|
|
68
|
-
| Feature
|
|
69
|
-
|:--------:|:----------:|:----------:|:--------:|
|
|
70
|
-
|
|
71
|
-
|
|
80
|
+
| Feature | TestDriver | Playwright | Selenium |
|
|
81
|
+
|:--------:|:----------:|:----------:|:--------:|
|
|
82
|
+
| Chrome | ✅ | ✅ | ✅ |
|
|
83
|
+
| Firefox | ✅ | ✅ | ✅ |
|
|
84
|
+
| Webkit | ✅ | ✅ | ✅ |
|
|
85
|
+
| IE | ✅ | | ✅ |
|
|
86
|
+
| Edge | ✅ | ✅ | ✅ |
|
|
87
|
+
| Opera | ✅ | | ✅ |
|
|
88
|
+
| Safari | ✅ | | ✅ |
|
|
72
89
|
</div>
|
|
73
90
|
|
|
74
91
|
## Operating system support
|
|
75
92
|
|
|
76
|
-
TestDriver currently supports
|
|
93
|
+
TestDriver currently supports all the three major operating systems!
|
|
77
94
|
|
|
78
95
|
<div className="comparison-table">
|
|
79
|
-
| Feature
|
|
80
|
-
|:--------:|:----------:|:----------:|:--------:|
|
|
81
|
-
|
|
96
|
+
| Feature | TestDriver | Playwright | Selenium |
|
|
97
|
+
|:--------:|:----------:|:----------:|:--------:|
|
|
98
|
+
| Windows | ✅ | ✅ | ✅ |
|
|
99
|
+
| Mac | ✅ | ✅ | ✅ |
|
|
100
|
+
| Linux | ✅ | ✅ | ✅ |
|
|
82
101
|
</div>
|