artel-qa-lite 0.1.1 → 0.3.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +103 -41
- package/package.json +3 -3
package/README.md
CHANGED
|
@@ -1,15 +1,21 @@
|
|
|
1
1
|
<!-- Generated from README.md and docs/MANUAL.md by scripts/readme.mjs — edit those, not this. -->
|
|
2
|
-
# Artel QA Lite
|
|
2
|
+
# Artel QA Lite (experimental)
|
|
3
3
|
|
|
4
|
-
**
|
|
5
|
-
real browser, and hands you a test plan and a report a QA lead can act on — with the evidence behind
|
|
6
|
-
every verdict.
|
|
4
|
+
**Flow Console and Artel QA Lite, in one install.** Each one runs on your own machine and opens in your browser.
|
|
7
5
|
|
|
8
6
|

|
|
9
7
|

|
|
10
|
-
%20%7C%20Windows%20x64-2f6f5e)
|
|
11
9
|

|
|
12
10
|
|
|
11
|
+
| | Open it | What it is |
|
|
12
|
+
|---|---|---|
|
|
13
|
+
| **Flow Console** | `npx metantel-cli flow-console` | Your Claude Code sessions in one web app: start and steer agents, with memory they share across sessions and teammates. |
|
|
14
|
+
| **Artel QA Lite** *(experimental)* | `npx metantel-cli artel-lite` | Agentic QA for web applications: it reads your source, tests the running application in a real browser, and writes a report a QA lead can act on. |
|
|
15
|
+
|
|
16
|
+
No install needed. The first time, npx asks `Ok to proceed? (y)` before it downloads the package; `npx -y` skips
|
|
17
|
+
the question.
|
|
18
|
+
|
|
13
19
|
<!-- install:start -->
|
|
14
20
|
## Install
|
|
15
21
|
|
|
@@ -17,41 +23,72 @@ every verdict.
|
|
|
17
23
|
npm install -g artel-qa-lite
|
|
18
24
|
```
|
|
19
25
|
|
|
20
|
-
Then
|
|
26
|
+
Then:
|
|
21
27
|
|
|
22
28
|
```sh
|
|
23
|
-
artel
|
|
29
|
+
artel lite # open Artel QA Lite (experimental) in your browser
|
|
30
|
+
artel doctor # check Claude Code and a browser; spends nothing
|
|
24
31
|
```
|
|
25
32
|
|
|
26
33
|
This is Artel QA Lite installed as `artel`, the same product as
|
|
27
34
|
[metantel-cli](https://www.npmjs.com/package/metantel-cli): every `metantel` command on this page
|
|
28
|
-
works as `artel
|
|
35
|
+
works as `artel`: `artel plan --open`, `artel run --dry-run`, `artel flow-console`.
|
|
29
36
|
<!-- install:end -->
|
|
30
37
|
|
|
38
|
+
Each app starts on `127.0.0.1` and opens your browser. `--no-open` prints the address instead, and `--port N`
|
|
39
|
+
chooses the port.
|
|
40
|
+
|
|
41
|
+
### Updates
|
|
42
|
+
|
|
43
|
+
Updates are on by default. About once an hour the CLI asks Metantel which version is newest (the request carries
|
|
44
|
+
the version you run and nothing else; npm's registry is the fallback):
|
|
45
|
+
|
|
46
|
+
- **installed with `npm install -g`:** the update installs itself the next time a command starts;
|
|
47
|
+
- **run with `npx`:** the next run starts the newest version;
|
|
48
|
+
- **an open Flow Console or Artel QA Lite** shows **Restart to update**, and comes back at the same address.
|
|
49
|
+
|
|
50
|
+
`metantel update` does it now. A project that lists `metantel-cli` in its own `package.json` keeps the version it
|
|
51
|
+
pinned, and the CLI prints the command to move it. `METANTEL_NO_UPDATE=1` turns updates off; they are off under CI.
|
|
52
|
+
|
|
31
53
|
### Requirements
|
|
32
54
|
|
|
33
55
|
| | |
|
|
34
56
|
|---|---|
|
|
35
|
-
| **Node.js** | 20 or newer
|
|
36
|
-
| **Claude Code** | [installed](https://code.claude.com/docs/en/setup) and signed in.
|
|
37
|
-
| **A Chromium** | Google Chrome, Chromium, or `npx playwright install chromium chromium-headless-shell` |
|
|
38
|
-
| **System** | macOS 12+
|
|
57
|
+
| **Node.js** | 20 or newer, to install and launch; the apps are native binaries |
|
|
58
|
+
| **Claude Code** | [installed](https://code.claude.com/docs/en/setup) and signed in. Both apps run it on your own subscription |
|
|
59
|
+
| **A Chromium** (Artel QA Lite) | Google Chrome, Chromium, or `npx playwright install chromium chromium-headless-shell` |
|
|
60
|
+
| **System** | macOS 12+ on Apple silicon · Windows 10/11 x64 |
|
|
39
61
|
|
|
40
|
-
npm installs one prebuilt binary for your platform. There is no postinstall script
|
|
41
|
-
downloaded at install or at run time.
|
|
62
|
+
npm installs one prebuilt binary for your platform. There is no postinstall script.
|
|
42
63
|
|
|
43
64
|
### Other ways to install
|
|
44
65
|
|
|
45
66
|
```sh
|
|
46
|
-
npx metantel-cli
|
|
67
|
+
npx metantel-cli@latest flow-console # the newest version, without installing
|
|
47
68
|
npm install --save-dev metantel-cli # pin it per project, run with npx metantel
|
|
48
|
-
npm install -g metantel-cli@latest # upgrade
|
|
49
69
|
npm uninstall -g metantel-cli # remove (your .metantel/ folders stay)
|
|
50
70
|
```
|
|
51
71
|
|
|
52
72
|
---
|
|
53
73
|
|
|
54
|
-
##
|
|
74
|
+
## Flow Console
|
|
75
|
+
|
|
76
|
+
```sh
|
|
77
|
+
metantel flow-console
|
|
78
|
+
```
|
|
79
|
+
|
|
80
|
+
Opens Flow Console in your browser. Sign in with your Metantel account (Google), open a folder, and start Claude
|
|
81
|
+
Code sessions from the page: each one sees what earlier sessions and your teammates learned, and you can watch,
|
|
82
|
+
steer and stop them. Your code stays on your machine; sessions run on your own Claude subscription.
|
|
83
|
+
|
|
84
|
+
---
|
|
85
|
+
|
|
86
|
+
## Artel QA Lite (experimental)
|
|
87
|
+
|
|
88
|
+
Experimental: it works, and it is still changing. Inspectors run on your own Claude subscription, so start with
|
|
89
|
+
`metantel run --dry-run` (free) and give real runs a `--budget`.
|
|
90
|
+
|
|
91
|
+
### Quick start
|
|
55
92
|
|
|
56
93
|
From the root of your application's repository, with the application running:
|
|
57
94
|
|
|
@@ -78,7 +115,7 @@ A minimal `.metantel/config.json`:
|
|
|
78
115
|
|
|
79
116
|
---
|
|
80
117
|
|
|
81
|
-
|
|
118
|
+
### What you get
|
|
82
119
|
|
|
83
120
|
**A test plan you did not write.** `metantel plan` reads the repository — routes, views, components,
|
|
84
121
|
forms, translation catalogues — and writes `test-plan.html`: one scenario per thing a user can do,
|
|
@@ -117,7 +154,7 @@ evidence behind it. Both err low, and the report names the reason for every cont
|
|
|
117
154
|
|
|
118
155
|
---
|
|
119
156
|
|
|
120
|
-
|
|
157
|
+
### What it works on
|
|
121
158
|
|
|
122
159
|
Identification reads the source, with readers for Next.js, Nuxt, SvelteKit, React Router, Vue Router,
|
|
123
160
|
Angular, Django, Flask/FastAPI, Rails, Laravel, Symfony, Spring, ASP.NET, Express/Nest, Go routers
|
|
@@ -132,11 +169,11 @@ of whatever type a file input accepts.
|
|
|
132
169
|
|
|
133
170
|
---
|
|
134
171
|
|
|
135
|
-
|
|
172
|
+
### Private by construction
|
|
136
173
|
|
|
137
|
-
It runs entirely on your machine. Your source, credentials and results never leave it. The binary has
|
|
138
|
-
no TLS library in it, so it cannot speak HTTPS to anyone
|
|
139
|
-
|
|
174
|
+
It runs entirely on your machine. Your source, credentials and results never leave it. The QA binary has
|
|
175
|
+
no TLS library in it, so it cannot speak HTTPS to anyone, and nothing calls a model we bill you for. The
|
|
176
|
+
only request to Metantel is the launcher's hourly question about the newest version (see Updates). An inspector is a model reading pages it does not control, so it is fenced:
|
|
140
177
|
|
|
141
178
|
- **no shell, no file access, no web fetch** — only the browser tools this binary serves
|
|
142
179
|
- **only your application's origin** (plus any `safety.allowed_origins` you list); `file:`,
|
|
@@ -151,7 +188,7 @@ nothing phones home. An inspector is a model reading pages it does not control,
|
|
|
151
188
|
|
|
152
189
|
---
|
|
153
190
|
|
|
154
|
-
|
|
191
|
+
### Known limits
|
|
155
192
|
|
|
156
193
|
- OAuth / SSO / 2FA sign-in is not supported yet; password and passkey (WebAuthn) are.
|
|
157
194
|
- Pages that need a record to exist (an employee, a repository) are reached once an inspector has
|
|
@@ -180,13 +217,16 @@ security, troubleshooting and FAQ.
|
|
|
180
217
|
|
|
181
218
|
## User manual
|
|
182
219
|
|
|
183
|
-
*Version 0.
|
|
220
|
+
*Version 0.3 · for the `metantel` command line (`metantel-cli` on npm)*
|
|
184
221
|
|
|
185
222
|
Artel QA Lite reads your application's source code, drives the running application in a real
|
|
186
223
|
browser, and writes a report a QA lead can act on. This manual covers everything a user needs:
|
|
187
224
|
installing it, configuring a project, running it, reading what it produces, and what it will and
|
|
188
225
|
will not do on your machine.
|
|
189
226
|
|
|
227
|
+
The same install also carries Flow Console, the local web app for your Claude Code sessions:
|
|
228
|
+
`metantel flow-console` (or `npx metantel-cli flow-console`) opens it.
|
|
229
|
+
|
|
190
230
|
---
|
|
191
231
|
|
|
192
232
|
### Contents
|
|
@@ -240,7 +280,7 @@ Everything lands in an append-only case file on your disk, and the report is der
|
|
|
240
280
|
|
|
241
281
|
| | |
|
|
242
282
|
|---|---|
|
|
243
|
-
| **Operating system** | macOS 12+
|
|
283
|
+
| **Operating system** | macOS 12+ on Apple silicon, Windows 10/11 x64 |
|
|
244
284
|
| **Node.js** | 20 or newer — only to install and launch; the product is a native binary |
|
|
245
285
|
| **Claude Code** | installed and signed in (`claude --version` works). Inspectors run through it, on your subscription |
|
|
246
286
|
| **A Chromium** | Google Chrome, Chromium, or a Playwright browser (`npx playwright install chromium chromium-headless-shell`) |
|
|
@@ -257,8 +297,12 @@ Nothing is downloaded on install or at run time. `metantel doctor` tells you wha
|
|
|
257
297
|
npm install -g metantel-cli
|
|
258
298
|
metantel --version
|
|
259
299
|
metantel doctor
|
|
300
|
+
metantel artel-lite # the console, in your browser (also: metantel lite)
|
|
260
301
|
```
|
|
261
302
|
|
|
303
|
+
Or without installing: `npx metantel-cli artel-lite`. The first npx run asks `Ok to proceed? (y)` before it
|
|
304
|
+
downloads the package.
|
|
305
|
+
|
|
262
306
|
npm installs the prebuilt binary for your platform (`@metantel/cli-<platform>`, pulled in
|
|
263
307
|
automatically) and a small launcher that runs it. There is no postinstall script and nothing is
|
|
264
308
|
downloaded at install or at run time. The same product is also published as `artel-qa-lite`, which
|
|
@@ -271,14 +315,21 @@ rule in the binary. It ends with `ok ready` or a list of what would stop a run.
|
|
|
271
315
|
|
|
272
316
|
| | |
|
|
273
317
|
|---|---|
|
|
274
|
-
| try it once | `npx metantel-cli doctor` |
|
|
318
|
+
| try it once | `npx metantel-cli doctor`, or `npx metantel-cli artel-lite` for the console |
|
|
275
319
|
| pin it per project | `npm install --save-dev metantel-cli`, then `npx metantel run` |
|
|
276
|
-
| in CI | `npm install -g metantel-cli@0.
|
|
277
|
-
| upgrade | `
|
|
320
|
+
| in CI | `npm install -g metantel-cli@0.3.0`: pin the version, and do not pass `--omit=optional` (the binary *is* the optional dependency). Updates are off under CI |
|
|
321
|
+
| upgrade | automatic (below); `metantel update` does it now. Projects and runs are unaffected |
|
|
278
322
|
| uninstall | `npm uninstall -g metantel-cli`. Your `.metantel/` directories stay; delete them if you want the runs gone |
|
|
279
323
|
|
|
280
|
-
**Platforms built:** macOS
|
|
281
|
-
|
|
324
|
+
**Platforms built:** macOS on Apple silicon and Windows x64. On anything else the launcher says so by
|
|
325
|
+
name.
|
|
326
|
+
|
|
327
|
+
**Updates are automatic.** About once an hour the launcher asks Metantel which version is newest
|
|
328
|
+
(`https://api.metantel.com/releases/metantel-cli`, with npm's registry as the fallback; the request carries the
|
|
329
|
+
version you run and nothing else). A global install updates itself at the next start; an npx run starts the newest
|
|
330
|
+
version; an open console shows **Restart to update** and comes back at the same address. A project that lists
|
|
331
|
+
`metantel-cli` in its own `package.json` keeps the version it pinned, and the launcher prints the command to move
|
|
332
|
+
it. `metantel update` checks and updates now; `METANTEL_NO_UPDATE=1` turns all of it off.
|
|
282
333
|
|
|
283
334
|
---
|
|
284
335
|
|
|
@@ -427,7 +478,8 @@ by pointing `codebase.path` at the right directory).
|
|
|
427
478
|
Every command accepts `--help` (`metantel run --help`), and `metantel help` lists them all. Flags
|
|
428
479
|
take their value either way — `--budget 5` or `--budget=5`. Paths in `[config]` are optional; the
|
|
429
480
|
config is otherwise found from the current directory upwards. A mistyped command is answered with
|
|
430
|
-
the one that was probably meant
|
|
481
|
+
the one that was probably meant, and the apps answer to short names: `fc` for `flow-console`, `lite` (or
|
|
482
|
+
`artel`, `ui`) for `artel-lite`, `upgrade` for `update`.
|
|
431
483
|
|
|
432
484
|
Exit codes: `0` the command did what was asked — a run that files findings still exits `0`, the
|
|
433
485
|
findings are in the report; `1` a `selftest` rule failed; `2` it could not do what was asked — a
|
|
@@ -445,9 +497,16 @@ the binary, and where runs will be written. Exit code is non-zero if anything wo
|
|
|
445
497
|
Runs every rule in the binary offline, in about a second. No browser, no network.
|
|
446
498
|
|
|
447
499
|
#### `metantel version` · `metantel --version`
|
|
448
|
-
`--version` prints one line (`metantel 0.
|
|
500
|
+
`--version` prints one line (`metantel 0.3.0`) for scripts; `version` adds the platform the binary
|
|
449
501
|
was built for.
|
|
450
502
|
|
|
503
|
+
#### `metantel update` · `upgrade`
|
|
504
|
+
Asks for the newest version and installs it now (see [Install](#3-install)). Updates otherwise arrive by
|
|
505
|
+
themselves.
|
|
506
|
+
|
|
507
|
+
#### `metantel flow-console` · `fc` — `--port N --no-open`
|
|
508
|
+
Opens Flow Console, the local web app for your Claude Code sessions, on `127.0.0.1` at a free port.
|
|
509
|
+
|
|
451
510
|
#### `metantel where [config]`
|
|
452
511
|
Prints where this project's runs, caches and preferences live, before anything is written.
|
|
453
512
|
|
|
@@ -498,8 +557,8 @@ The main command. See [Running](#9-running).
|
|
|
498
557
|
| `--auto` | off | never stop to ask between waves (required without a terminal) |
|
|
499
558
|
| `--no-sweep` / `--resweep` | | skip the harness's walk, or force a fresh one |
|
|
500
559
|
|
|
501
|
-
#### `metantel
|
|
502
|
-
The local console. Binds `127.0.0.1` only. See [The console](#10-the-console).
|
|
560
|
+
#### `metantel artel-lite [config]` · `lite`, `ui` — `--port N --no-open --store DIR`
|
|
561
|
+
The local console, at `http://127.0.0.1:7788` by default. Binds `127.0.0.1` only. See [The console](#10-the-console).
|
|
503
562
|
|
|
504
563
|
#### `metantel report [config]` — `--run ID --open --config PATH`
|
|
505
564
|
Writes `report.html` and `report.md` into a run (the latest by default). Also done automatically
|
|
@@ -582,16 +641,17 @@ cache. A second run is therefore faster and reaches more, and its numbers are it
|
|
|
582
641
|
### 10. The console
|
|
583
642
|
|
|
584
643
|
```sh
|
|
585
|
-
metantel
|
|
644
|
+
metantel artel-lite
|
|
586
645
|
```
|
|
587
646
|
|
|
588
|
-
Opens `http://127.0.0.1
|
|
647
|
+
Opens `http://127.0.0.1:7788` in your browser: the stages of the current run animated from real
|
|
589
648
|
events, the board, findings as they are filed, coverage, and controls to start a run with the
|
|
590
649
|
preferences shown, set a priority, or stop a run the console started.
|
|
591
650
|
|
|
592
651
|
The console is local only. It binds the loopback address, refuses requests from other origins and
|
|
593
652
|
hosts, and accepts writes only from its own page. It never computes coverage itself; it shows the
|
|
594
|
-
numbers the run published.
|
|
653
|
+
numbers the run published. When a newer version is out, the header shows **Update to x.y.z**; one click
|
|
654
|
+
restarts the console on it (a run in progress stops first).
|
|
595
655
|
|
|
596
656
|
---
|
|
597
657
|
|
|
@@ -710,9 +770,10 @@ $0.04–0.07 per control assessed with the default model. Identification, the pl
|
|
|
710
770
|
### 14. Security and privacy
|
|
711
771
|
|
|
712
772
|
**What leaves your machine.** Only the prompts and tool results exchanged with Claude through Claude
|
|
713
|
-
Code, under your subscription and Anthropic's terms. Metantel receives
|
|
714
|
-
|
|
715
|
-
|
|
773
|
+
Code, under your subscription and Anthropic's terms. Metantel receives no source, no credentials, no
|
|
774
|
+
results and no telemetry. The QA binary contains no TLS library and cannot make an HTTPS connection to
|
|
775
|
+
anyone. The npm launcher asks Metantel, about hourly, which version is newest; that request carries the
|
|
776
|
+
version you run and nothing else.
|
|
716
777
|
|
|
717
778
|
**What an inspector can do.** Only what the browser tools this binary serves allow:
|
|
718
779
|
|
|
@@ -748,6 +809,7 @@ and upgrade routes are withheld from inspectors automatically.
|
|
|
748
809
|
| `PLAYWRIGHT_BROWSERS_PATH` | a Playwright browser directory to search |
|
|
749
810
|
| `METANTEL_CLAUDE_BIN` | the Claude Code executable, if not `claude` on your PATH |
|
|
750
811
|
| `METANTEL_BIN` | (launcher) run a specific `metantel` binary — for a build of your own |
|
|
812
|
+
| `METANTEL_NO_UPDATE` | (launcher) `1` turns automatic updates off (they are off under CI too) |
|
|
751
813
|
| `${NAME}` in config | any of `app.url`, `auth.username`, `auth.email`, `auth.password` may reference the environment |
|
|
752
814
|
|
|
753
815
|
---
|
package/package.json
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "artel-qa-lite",
|
|
3
|
-
"version": "0.
|
|
4
|
-
"description": "Artel QA Lite
|
|
3
|
+
"version": "0.3.0",
|
|
4
|
+
"description": "Artel QA Lite (experimental): agentic QA for web applications, installed as `artel`. The same product as metantel-cli: reads your source, tests in a real browser, writes a report a QA lead can act on.",
|
|
5
5
|
"type": "module",
|
|
6
6
|
"bin": {
|
|
7
7
|
"artel": "bin/artel.js"
|
|
@@ -15,7 +15,7 @@
|
|
|
15
15
|
"LICENSE"
|
|
16
16
|
],
|
|
17
17
|
"dependencies": {
|
|
18
|
-
"metantel-cli": "0.
|
|
18
|
+
"metantel-cli": "0.3.0"
|
|
19
19
|
},
|
|
20
20
|
"keywords": [
|
|
21
21
|
"qa",
|