agent-qa 0.1.13 → 0.1.14
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +70 -0
- package/dist/cli.cjs +2 -1
- package/dist/cli.cjs.map +1 -1
- package/dist/cli.js +2 -1
- package/dist/cli.js.map +1 -1
- package/package.json +31 -10
package/README.md
ADDED
|
@@ -0,0 +1,70 @@
|
|
|
1
|
+

|
|
2
|
+
|
|
3
|
+
<!-- # agent-qa -->
|
|
4
|
+
|
|
5
|
+
Open-source AI end-to-end testing for web and mobile apps.
|
|
6
|
+
Write tests in natural language. agent-qa runs them in an agentic test runtime that builds execution memory from every run, so teams and coding agents catch regressions before releases ship.
|
|
7
|
+
|
|
8
|
+
[Docs](https://vostride.com/docs/agent-qa) | [Quickstart](https://vostride.com/docs/agent-qa/quickstart)
|
|
9
|
+
|
|
10
|
+
## Features
|
|
11
|
+
|
|
12
|
+
- **Write tests in natural language**: Define actions and assertions in human language while agents work from visible roles, labels, and screen state.
|
|
13
|
+
- **Self-healing test execution**: When any sub-action, such as click, fill, or select, fails, agent-qa re-observes the UI and tries a different path in the same run. Tests recover from UI drift and flaky interactions instead of failing on the first broken action.
|
|
14
|
+
- **Evolves with every run**: With every test run, agent-qa builds execution memory from product, suite, and test observations, then adds that context to future runs. agent-qa also curates memory from steps that were healed during execution, helping future runs avoid the same mistake.
|
|
15
|
+
- **Built for humans and machines**: A polished dashboard and CLI for developers, plus MCP and skills for coding agents.
|
|
16
|
+
- **Accelerate runs with smart Cache**: The action cache reuses validated plans across similar subsequent test runs, reducing planner work, token usage, and runtime overhead.
|
|
17
|
+
- **Run sandboxed hooks during tests**: Run Node, Bun, Python, or Bash hooks in isolated Docker containers to set up environments, call APIs, seed fixtures, tear down state, or pass structured outputs back into the active test run.
|
|
18
|
+
- **Review your QA like code**: Tests, configs, hooks, memory, and suite logic all live as version-controlled code, so every change can be diffed, reviewed, reused, and shared across teams.
|
|
19
|
+
- **Bring your own LLM**: Run tests with the model of your choice via OpenAI- and Anthropic-compatible endpoints, Gemini, local or open-source models, and subscriptions like Codex and Claude Code.
|
|
20
|
+
|
|
21
|
+
## Quickstart
|
|
22
|
+
|
|
23
|
+
Install the package:
|
|
24
|
+
|
|
25
|
+
```sh
|
|
26
|
+
npm install -D agent-qa
|
|
27
|
+
```
|
|
28
|
+
|
|
29
|
+
For Codex or Claude Code subscription auth, also install:
|
|
30
|
+
|
|
31
|
+
```sh
|
|
32
|
+
npm install -D @vostride/agent-qa-subscription-auth
|
|
33
|
+
```
|
|
34
|
+
|
|
35
|
+
Install Docker before using hooks. agent-qa runs hooks in a sandboxed runtime, and Docker is required for the Node, Bun, Python, and Bash hook containers.
|
|
36
|
+
|
|
37
|
+
Initialize agent-qa and install the runtime support you need:
|
|
38
|
+
|
|
39
|
+
```sh
|
|
40
|
+
npx agent-qa init
|
|
41
|
+
npx agent-qa install-browsers --chromium
|
|
42
|
+
# Mobile projects:
|
|
43
|
+
npx agent-qa install-mobile-drivers --all
|
|
44
|
+
```
|
|
45
|
+
|
|
46
|
+
Start the dashboard, complete auth, and run tests from the UI:
|
|
47
|
+
|
|
48
|
+
```sh
|
|
49
|
+
npx agent-qa dashboard --open
|
|
50
|
+
```
|
|
51
|
+
|
|
52
|
+
For the full setup flow, use the [quickstart](https://vostride.com/docs/agent-qa/quickstart).
|
|
53
|
+
|
|
54
|
+
## CLI
|
|
55
|
+
|
|
56
|
+
Run tests from the CLI:
|
|
57
|
+
|
|
58
|
+
```sh
|
|
59
|
+
npx agent-qa run tests/hacker-news-top-story.yaml
|
|
60
|
+
```
|
|
61
|
+
|
|
62
|
+
## Docs
|
|
63
|
+
|
|
64
|
+
- [Full docs](https://vostride.com/docs/agent-qa)
|
|
65
|
+
- [Quickstart](https://vostride.com/docs/agent-qa/quickstart)
|
|
66
|
+
- [CLI reference](https://vostride.com/docs/agent-qa/cli)
|
|
67
|
+
- [Dashboard](https://vostride.com/docs/agent-qa/dashboard)
|
|
68
|
+
- [Configuration](https://vostride.com/docs/agent-qa/configuration)
|
|
69
|
+
- [License](LICENSE.md)
|
|
70
|
+
- [Notice](NOTICE.md)
|
package/dist/cli.cjs
CHANGED
|
@@ -4569,7 +4569,8 @@ function createMcpCommand() {
|
|
|
4569
4569
|
}
|
|
4570
4570
|
const { startMcpServer } = await import("@vostride/agent-qa-mcp");
|
|
4571
4571
|
try {
|
|
4572
|
-
|
|
4572
|
+
const startupOptions = { analyticsConfig: config, startupOutput: process.stderr };
|
|
4573
|
+
await startMcpServer(startupOptions);
|
|
4573
4574
|
} finally {
|
|
4574
4575
|
await (0, import_agent_qa_core11.flushAnalytics)(config ? { config } : void 0).catch(() => {
|
|
4575
4576
|
});
|