artel-qa-lite 0.2.0 → 0.4.0-ma.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +94 -45
- package/package.json +5 -4
package/README.md
CHANGED
|
@@ -1,15 +1,21 @@
|
|
|
1
1
|
<!-- Generated from README.md and docs/MANUAL.md by scripts/readme.mjs — edit those, not this. -->
|
|
2
|
-
# Artel QA Lite
|
|
2
|
+
# Artel QA Lite (experimental)
|
|
3
3
|
|
|
4
|
-
**
|
|
5
|
-
real browser, and hands you a test plan and a report a QA lead can act on — with the evidence behind
|
|
6
|
-
every verdict.
|
|
4
|
+
**Flow Console and Artel QA Lite, in one install.** Each one runs on your own machine and opens in your browser.
|
|
7
5
|
|
|
8
6
|

|
|
9
7
|

|
|
10
8
|
%20%7C%20Windows%20x64-2f6f5e)
|
|
11
9
|

|
|
12
10
|
|
|
11
|
+
| | Open it | What it is |
|
|
12
|
+
|---|---|---|
|
|
13
|
+
| **Flow Console** | `npx metantel-cli flow-console` | Your Claude Code sessions in one web app: start and steer agents, with memory they share across sessions and teammates. |
|
|
14
|
+
| **Artel QA Lite** *(experimental)* | `npx metantel-cli artel-lite` | Agentic QA for web applications: it reads your source, tests the running application in a real browser, and writes a report a QA lead can act on. |
|
|
15
|
+
|
|
16
|
+
No install needed. The first time, npx asks `Ok to proceed? (y)` before it downloads the package; `npx -y` skips
|
|
17
|
+
the question.
|
|
18
|
+
|
|
13
19
|
<!-- install:start -->
|
|
14
20
|
## Install
|
|
15
21
|
|
|
@@ -17,54 +23,72 @@ every verdict.
|
|
|
17
23
|
npm install -g artel-qa-lite
|
|
18
24
|
```
|
|
19
25
|
|
|
20
|
-
Then
|
|
26
|
+
Then:
|
|
21
27
|
|
|
22
28
|
```sh
|
|
23
|
-
artel
|
|
29
|
+
artel lite # open Artel QA Lite (experimental) in your browser
|
|
30
|
+
artel doctor # check Claude Code and a browser; spends nothing
|
|
24
31
|
```
|
|
25
32
|
|
|
26
33
|
This is Artel QA Lite installed as `artel`, the same product as
|
|
27
34
|
[metantel-cli](https://www.npmjs.com/package/metantel-cli): every `metantel` command on this page
|
|
28
|
-
works as `artel
|
|
35
|
+
works as `artel`: `artel plan --open`, `artel run --dry-run`, `artel flow-console`.
|
|
29
36
|
<!-- install:end -->
|
|
30
37
|
|
|
31
|
-
|
|
38
|
+
Each app starts on `127.0.0.1` and opens your browser. `--no-open` prints the address instead, and `--port N`
|
|
39
|
+
chooses the port.
|
|
32
40
|
|
|
33
|
-
|
|
34
|
-
needed: npx fetches the binary for your platform the first time.
|
|
41
|
+
### Updates
|
|
35
42
|
|
|
36
|
-
|
|
37
|
-
|
|
38
|
-
npx metantel-cli artel-lite # Artel QA Lite: start, watch and steer QA runs
|
|
39
|
-
```
|
|
43
|
+
Updates are on by default. About once an hour the CLI asks Metantel which version is newest (the request carries
|
|
44
|
+
the version you run and nothing else; npm's registry is the fallback):
|
|
40
45
|
|
|
41
|
-
|
|
42
|
-
|
|
46
|
+
- **installed with `npm install -g`:** the update installs itself the next time a command starts;
|
|
47
|
+
- **run with `npx`:** the next run starts the newest version;
|
|
48
|
+
- **an open Flow Console or Artel QA Lite** shows **Restart to update**, and comes back at the same address.
|
|
49
|
+
|
|
50
|
+
`metantel update` does it now. A project that lists `metantel-cli` in its own `package.json` keeps the version it
|
|
51
|
+
pinned, and the CLI prints the command to move it. `METANTEL_NO_UPDATE=1` turns updates off; they are off under CI.
|
|
43
52
|
|
|
44
53
|
### Requirements
|
|
45
54
|
|
|
46
55
|
| | |
|
|
47
56
|
|---|---|
|
|
48
|
-
| **Node.js** | 20 or newer
|
|
49
|
-
| **Claude Code** | [installed](https://code.claude.com/docs/en/setup) and signed in.
|
|
50
|
-
| **A Chromium** | Google Chrome, Chromium, or `npx playwright install chromium chromium-headless-shell` |
|
|
57
|
+
| **Node.js** | 20 or newer, to install and launch; the apps are native binaries |
|
|
58
|
+
| **Claude Code** | [installed](https://code.claude.com/docs/en/setup) and signed in. Both apps run it on your own subscription |
|
|
59
|
+
| **A Chromium** (Artel QA Lite) | Google Chrome, Chromium, or `npx playwright install chromium chromium-headless-shell` |
|
|
51
60
|
| **System** | macOS 12+ on Apple silicon · Windows 10/11 x64 |
|
|
52
61
|
|
|
53
|
-
npm installs one prebuilt binary for your platform. There is no postinstall script
|
|
54
|
-
downloaded at install or at run time.
|
|
62
|
+
npm installs one prebuilt binary for your platform. There is no postinstall script.
|
|
55
63
|
|
|
56
64
|
### Other ways to install
|
|
57
65
|
|
|
58
66
|
```sh
|
|
59
|
-
npx metantel-cli
|
|
67
|
+
npx metantel-cli@latest flow-console # the newest version, without installing
|
|
60
68
|
npm install --save-dev metantel-cli # pin it per project, run with npx metantel
|
|
61
|
-
npm install -g metantel-cli@latest # upgrade
|
|
62
69
|
npm uninstall -g metantel-cli # remove (your .metantel/ folders stay)
|
|
63
70
|
```
|
|
64
71
|
|
|
65
72
|
---
|
|
66
73
|
|
|
67
|
-
##
|
|
74
|
+
## Flow Console
|
|
75
|
+
|
|
76
|
+
```sh
|
|
77
|
+
metantel flow-console
|
|
78
|
+
```
|
|
79
|
+
|
|
80
|
+
Opens Flow Console in your browser. Sign in with your Metantel account (Google), open a folder, and start Claude
|
|
81
|
+
Code sessions from the page: each one sees what earlier sessions and your teammates learned, and you can watch,
|
|
82
|
+
steer and stop them. Your code stays on your machine; sessions run on your own Claude subscription.
|
|
83
|
+
|
|
84
|
+
---
|
|
85
|
+
|
|
86
|
+
## Artel QA Lite (experimental)
|
|
87
|
+
|
|
88
|
+
Experimental: it works, and it is still changing. Inspectors run on your own Claude subscription, so start with
|
|
89
|
+
`metantel run --dry-run` (free) and give real runs a `--budget`.
|
|
90
|
+
|
|
91
|
+
### Quick start
|
|
68
92
|
|
|
69
93
|
From the root of your application's repository, with the application running:
|
|
70
94
|
|
|
@@ -91,7 +115,7 @@ A minimal `.metantel/config.json`:
|
|
|
91
115
|
|
|
92
116
|
---
|
|
93
117
|
|
|
94
|
-
|
|
118
|
+
### What you get
|
|
95
119
|
|
|
96
120
|
**A test plan you did not write.** `metantel plan` reads the repository — routes, views, components,
|
|
97
121
|
forms, translation catalogues — and writes `test-plan.html`: one scenario per thing a user can do,
|
|
@@ -130,7 +154,7 @@ evidence behind it. Both err low, and the report names the reason for every cont
|
|
|
130
154
|
|
|
131
155
|
---
|
|
132
156
|
|
|
133
|
-
|
|
157
|
+
### What it works on
|
|
134
158
|
|
|
135
159
|
Identification reads the source, with readers for Next.js, Nuxt, SvelteKit, React Router, Vue Router,
|
|
136
160
|
Angular, Django, Flask/FastAPI, Rails, Laravel, Symfony, Spring, ASP.NET, Express/Nest, Go routers
|
|
@@ -145,11 +169,11 @@ of whatever type a file input accepts.
|
|
|
145
169
|
|
|
146
170
|
---
|
|
147
171
|
|
|
148
|
-
|
|
172
|
+
### Private by construction
|
|
149
173
|
|
|
150
|
-
It runs entirely on your machine. Your source, credentials and results never leave it. The binary has
|
|
151
|
-
no TLS library in it, so it cannot speak HTTPS to anyone
|
|
152
|
-
|
|
174
|
+
It runs entirely on your machine. Your source, credentials and results never leave it. The QA binary has
|
|
175
|
+
no TLS library in it, so it cannot speak HTTPS to anyone, and nothing calls a model we bill you for. The
|
|
176
|
+
only request to Metantel is the launcher's hourly question about the newest version (see Updates). An inspector is a model reading pages it does not control, so it is fenced:
|
|
153
177
|
|
|
154
178
|
- **no shell, no file access, no web fetch** — only the browser tools this binary serves
|
|
155
179
|
- **only your application's origin** (plus any `safety.allowed_origins` you list); `file:`,
|
|
@@ -164,7 +188,7 @@ nothing phones home. An inspector is a model reading pages it does not control,
|
|
|
164
188
|
|
|
165
189
|
---
|
|
166
190
|
|
|
167
|
-
|
|
191
|
+
### Known limits
|
|
168
192
|
|
|
169
193
|
- OAuth / SSO / 2FA sign-in is not supported yet; password and passkey (WebAuthn) are.
|
|
170
194
|
- Pages that need a record to exist (an employee, a repository) are reached once an inspector has
|
|
@@ -193,13 +217,16 @@ security, troubleshooting and FAQ.
|
|
|
193
217
|
|
|
194
218
|
## User manual
|
|
195
219
|
|
|
196
|
-
*Version 0.
|
|
220
|
+
*Version 0.3 · for the `metantel` command line (`metantel-cli` on npm)*
|
|
197
221
|
|
|
198
222
|
Artel QA Lite reads your application's source code, drives the running application in a real
|
|
199
223
|
browser, and writes a report a QA lead can act on. This manual covers everything a user needs:
|
|
200
224
|
installing it, configuring a project, running it, reading what it produces, and what it will and
|
|
201
225
|
will not do on your machine.
|
|
202
226
|
|
|
227
|
+
The same install also carries Flow Console, the local web app for your Claude Code sessions:
|
|
228
|
+
`metantel flow-console` (or `npx metantel-cli flow-console`) opens it.
|
|
229
|
+
|
|
203
230
|
---
|
|
204
231
|
|
|
205
232
|
### Contents
|
|
@@ -270,8 +297,12 @@ Nothing is downloaded on install or at run time. `metantel doctor` tells you wha
|
|
|
270
297
|
npm install -g metantel-cli
|
|
271
298
|
metantel --version
|
|
272
299
|
metantel doctor
|
|
300
|
+
metantel artel-lite # the console, in your browser (also: metantel lite)
|
|
273
301
|
```
|
|
274
302
|
|
|
303
|
+
Or without installing: `npx metantel-cli artel-lite`. The first npx run asks `Ok to proceed? (y)` before it
|
|
304
|
+
downloads the package.
|
|
305
|
+
|
|
275
306
|
npm installs the prebuilt binary for your platform (`@metantel/cli-<platform>`, pulled in
|
|
276
307
|
automatically) and a small launcher that runs it. There is no postinstall script and nothing is
|
|
277
308
|
downloaded at install or at run time. The same product is also published as `artel-qa-lite`, which
|
|
@@ -284,15 +315,22 @@ rule in the binary. It ends with `ok ready` or a list of what would stop a run.
|
|
|
284
315
|
|
|
285
316
|
| | |
|
|
286
317
|
|---|---|
|
|
287
|
-
| try it once | `npx metantel-cli doctor` |
|
|
318
|
+
| try it once | `npx metantel-cli doctor`, or `npx metantel-cli artel-lite` for the console |
|
|
288
319
|
| pin it per project | `npm install --save-dev metantel-cli`, then `npx metantel run` |
|
|
289
|
-
| in CI | `npm install -g metantel-cli@0.
|
|
290
|
-
| upgrade | `
|
|
320
|
+
| in CI | `npm install -g metantel-cli@0.3.0`: pin the version, and do not pass `--omit=optional` (the binary *is* the optional dependency). Updates are off under CI |
|
|
321
|
+
| upgrade | automatic (below); `metantel update` does it now. Projects and runs are unaffected |
|
|
291
322
|
| uninstall | `npm uninstall -g metantel-cli`. Your `.metantel/` directories stay; delete them if you want the runs gone |
|
|
292
323
|
|
|
293
324
|
**Platforms built:** macOS on Apple silicon and Windows x64. On anything else the launcher says so by
|
|
294
325
|
name.
|
|
295
326
|
|
|
327
|
+
**Updates are automatic.** About once an hour the launcher asks Metantel which version is newest
|
|
328
|
+
(`https://api.metantel.com/releases/metantel-cli`, with npm's registry as the fallback; the request carries the
|
|
329
|
+
version you run and nothing else). A global install updates itself at the next start; an npx run starts the newest
|
|
330
|
+
version; an open console shows **Restart to update** and comes back at the same address. A project that lists
|
|
331
|
+
`metantel-cli` in its own `package.json` keeps the version it pinned, and the launcher prints the command to move
|
|
332
|
+
it. `metantel update` checks and updates now; `METANTEL_NO_UPDATE=1` turns all of it off.
|
|
333
|
+
|
|
296
334
|
---
|
|
297
335
|
|
|
298
336
|
### 4. Set up a project
|
|
@@ -440,7 +478,8 @@ by pointing `codebase.path` at the right directory).
|
|
|
440
478
|
Every command accepts `--help` (`metantel run --help`), and `metantel help` lists them all. Flags
|
|
441
479
|
take their value either way — `--budget 5` or `--budget=5`. Paths in `[config]` are optional; the
|
|
442
480
|
config is otherwise found from the current directory upwards. A mistyped command is answered with
|
|
443
|
-
the one that was probably meant
|
|
481
|
+
the one that was probably meant, and the apps answer to short names: `fc` for `flow-console`, `lite` (or
|
|
482
|
+
`artel`, `ui`) for `artel-lite`, `upgrade` for `update`.
|
|
444
483
|
|
|
445
484
|
Exit codes: `0` the command did what was asked — a run that files findings still exits `0`, the
|
|
446
485
|
findings are in the report; `1` a `selftest` rule failed; `2` it could not do what was asked — a
|
|
@@ -458,9 +497,16 @@ the binary, and where runs will be written. Exit code is non-zero if anything wo
|
|
|
458
497
|
Runs every rule in the binary offline, in about a second. No browser, no network.
|
|
459
498
|
|
|
460
499
|
#### `metantel version` · `metantel --version`
|
|
461
|
-
`--version` prints one line (`metantel 0.
|
|
500
|
+
`--version` prints one line (`metantel 0.3.0`) for scripts; `version` adds the platform the binary
|
|
462
501
|
was built for.
|
|
463
502
|
|
|
503
|
+
#### `metantel update` · `upgrade`
|
|
504
|
+
Asks for the newest version and installs it now (see [Install](#3-install)). Updates otherwise arrive by
|
|
505
|
+
themselves.
|
|
506
|
+
|
|
507
|
+
#### `metantel flow-console` · `fc` — `--port N --no-open`
|
|
508
|
+
Opens Flow Console, the local web app for your Claude Code sessions, on `127.0.0.1` at a free port.
|
|
509
|
+
|
|
464
510
|
#### `metantel where [config]`
|
|
465
511
|
Prints where this project's runs, caches and preferences live, before anything is written.
|
|
466
512
|
|
|
@@ -511,8 +557,8 @@ The main command. See [Running](#9-running).
|
|
|
511
557
|
| `--auto` | off | never stop to ask between waves (required without a terminal) |
|
|
512
558
|
| `--no-sweep` / `--resweep` | | skip the harness's walk, or force a fresh one |
|
|
513
559
|
|
|
514
|
-
#### `metantel
|
|
515
|
-
The local console. Binds `127.0.0.1` only. See [The console](#10-the-console).
|
|
560
|
+
#### `metantel artel-lite [config]` · `lite`, `ui` — `--port N --no-open --store DIR`
|
|
561
|
+
The local console, at `http://127.0.0.1:7788` by default. Binds `127.0.0.1` only. See [The console](#10-the-console).
|
|
516
562
|
|
|
517
563
|
#### `metantel report [config]` — `--run ID --open --config PATH`
|
|
518
564
|
Writes `report.html` and `report.md` into a run (the latest by default). Also done automatically
|
|
@@ -595,16 +641,17 @@ cache. A second run is therefore faster and reaches more, and its numbers are it
|
|
|
595
641
|
### 10. The console
|
|
596
642
|
|
|
597
643
|
```sh
|
|
598
|
-
metantel
|
|
644
|
+
metantel artel-lite
|
|
599
645
|
```
|
|
600
646
|
|
|
601
|
-
Opens `http://127.0.0.1
|
|
647
|
+
Opens `http://127.0.0.1:7788` in your browser: the stages of the current run animated from real
|
|
602
648
|
events, the board, findings as they are filed, coverage, and controls to start a run with the
|
|
603
649
|
preferences shown, set a priority, or stop a run the console started.
|
|
604
650
|
|
|
605
651
|
The console is local only. It binds the loopback address, refuses requests from other origins and
|
|
606
652
|
hosts, and accepts writes only from its own page. It never computes coverage itself; it shows the
|
|
607
|
-
numbers the run published.
|
|
653
|
+
numbers the run published. When a newer version is out, the header shows **Update to x.y.z**; one click
|
|
654
|
+
restarts the console on it (a run in progress stops first).
|
|
608
655
|
|
|
609
656
|
---
|
|
610
657
|
|
|
@@ -723,9 +770,10 @@ $0.04–0.07 per control assessed with the default model. Identification, the pl
|
|
|
723
770
|
### 14. Security and privacy
|
|
724
771
|
|
|
725
772
|
**What leaves your machine.** Only the prompts and tool results exchanged with Claude through Claude
|
|
726
|
-
Code, under your subscription and Anthropic's terms. Metantel receives
|
|
727
|
-
|
|
728
|
-
|
|
773
|
+
Code, under your subscription and Anthropic's terms. Metantel receives no source, no credentials, no
|
|
774
|
+
results and no telemetry. The QA binary contains no TLS library and cannot make an HTTPS connection to
|
|
775
|
+
anyone. The npm launcher asks Metantel, about hourly, which version is newest; that request carries the
|
|
776
|
+
version you run and nothing else.
|
|
729
777
|
|
|
730
778
|
**What an inspector can do.** Only what the browser tools this binary serves allow:
|
|
731
779
|
|
|
@@ -761,6 +809,7 @@ and upgrade routes are withheld from inspectors automatically.
|
|
|
761
809
|
| `PLAYWRIGHT_BROWSERS_PATH` | a Playwright browser directory to search |
|
|
762
810
|
| `METANTEL_CLAUDE_BIN` | the Claude Code executable, if not `claude` on your PATH |
|
|
763
811
|
| `METANTEL_BIN` | (launcher) run a specific `metantel` binary — for a build of your own |
|
|
812
|
+
| `METANTEL_NO_UPDATE` | (launcher) `1` turns automatic updates off (they are off under CI too) |
|
|
764
813
|
| `${NAME}` in config | any of `app.url`, `auth.username`, `auth.email`, `auth.password` may reference the environment |
|
|
765
814
|
|
|
766
815
|
---
|
package/package.json
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "artel-qa-lite",
|
|
3
|
-
"version": "0.
|
|
4
|
-
"description": "Artel QA Lite
|
|
3
|
+
"version": "0.4.0-ma.0",
|
|
4
|
+
"description": "Artel QA Lite (experimental): agentic QA for web applications, installed as `artel`. The same product as metantel-cli: reads your source, tests in a real browser, writes a report a QA lead can act on.",
|
|
5
5
|
"type": "module",
|
|
6
6
|
"bin": {
|
|
7
7
|
"artel": "bin/artel.js"
|
|
@@ -15,7 +15,7 @@
|
|
|
15
15
|
"LICENSE"
|
|
16
16
|
],
|
|
17
17
|
"dependencies": {
|
|
18
|
-
"metantel-cli": "0.
|
|
18
|
+
"metantel-cli": "0.4.0-ma.0"
|
|
19
19
|
},
|
|
20
20
|
"keywords": [
|
|
21
21
|
"qa",
|
|
@@ -37,6 +37,7 @@
|
|
|
37
37
|
"author": "Metantel <projects@metantel.com>",
|
|
38
38
|
"license": "SEE LICENSE IN LICENSE",
|
|
39
39
|
"publishConfig": {
|
|
40
|
-
"access": "public"
|
|
40
|
+
"access": "public",
|
|
41
|
+
"tag": "multi-agent"
|
|
41
42
|
}
|
|
42
43
|
}
|