@koda-sl/baker-cli 0.237.0 → 0.238.0-dev.43aacdb9e
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +36 -0
- package/dist/{chunk-EKLAHWSF.js → chunk-CMPAHYLB.js} +4 -4
- package/dist/chunk-CMPAHYLB.js.map +1 -0
- package/dist/cli.js +638 -322
- package/dist/cli.js.map +1 -1
- package/dist/engine/index.js +1 -1
- package/package.json +1 -1
- package/dist/chunk-EKLAHWSF.js.map +0 -1
package/README.md
CHANGED
|
@@ -1227,6 +1227,42 @@ Data is retained for 400 days; a window reaching further back comes back with a
|
|
|
1227
1227
|
|
|
1228
1228
|
---
|
|
1229
1229
|
|
|
1230
|
+
### A/B tests (`baker experiment`)
|
|
1231
|
+
|
|
1232
|
+
Two versions of one landing page, split 50/50 at the edge, decided by a verdict rather than by two rates somebody reads.
|
|
1233
|
+
|
|
1234
|
+
```bash
|
|
1235
|
+
baker experiment plan --landing oferta --variant oferta-b # FIRST — can this page settle the question at all?
|
|
1236
|
+
baker experiment plan --landing oferta --variant oferta-b --goal event:request_demo
|
|
1237
|
+
baker experiment start --landing oferta --variant oferta-b --hypothesis "Price above the fold converts better"
|
|
1238
|
+
baker experiment status # the verdict on every test
|
|
1239
|
+
baker experiment status --id a3f91c2b --full # one test, with the posteriors behind it
|
|
1240
|
+
baker experiment finish --id a3f91c2b # send all the traffic to whichever won
|
|
1241
|
+
baker experiment finish --id a3f91c2b --abandon # stop it, keep the original page, record no result
|
|
1242
|
+
```
|
|
1243
|
+
|
|
1244
|
+
The variant is an ordinary published landing with its own slug. Assignment happens while the HTML is served, so there is no flicker, no client JavaScript and nothing for an ad blocker to suppress — and the visitor's URL still reads `/oferta/`, because the split is a path rewrite and never a redirect. A direct visit to `/oferta-b/` is served that page with **no** assignment and stays out of the measurement, so a shared link cannot stuff one arm.
|
|
1245
|
+
|
|
1246
|
+
**`plan` before building anything.** At a 3% conversion rate a +20% lift needs roughly 14,000 visitors *per variant*; most landing pages will never get there, and `plan` refuses rather than letting a test run for three weeks and report a conclusion made on noise. `--lift` sets the smallest lift worth detecting (default `0.2`), and it is the most consequential flag here — halving it roughly quadruples the traffic needed.
|
|
1247
|
+
|
|
1248
|
+
**`--goal` decides what "better" means, and it is fixed for the life of the test.**
|
|
1249
|
+
|
|
1250
|
+
| `--goal` | Counts |
|
|
1251
|
+
|---|---|
|
|
1252
|
+
| `leads` (default) | Whatever this company already marks as a conversion |
|
|
1253
|
+
| `leads:<form>` | The same, one Form only |
|
|
1254
|
+
| `event:<name>` | An event the page declares for itself (`data-baker-click="request_demo"`) |
|
|
1255
|
+
| `event:<name>/<key>=<value>` | The same, narrowed by one of its own properties |
|
|
1256
|
+
| `click` / `click:<host>` | Leaving the site, optionally for one destination |
|
|
1257
|
+
|
|
1258
|
+
`baker analytics events` lists what a page already reports. A goal that has never fired on the page is **refused**, not run — it would return zero on both sides forever, and that reads as a tie rather than as "not measured".
|
|
1259
|
+
|
|
1260
|
+
**Read `verdict` and nothing else** to decide: `keep_running` | `winner` | `no_difference` | `invalid` | `stopped_early_harmful`. `summary` is one sentence fit to show a client. The numbers under `--full` are for printing — a test that says `keep_running` has not finished however good they look, and only `finish` on a concluded test can record a result.
|
|
1261
|
+
|
|
1262
|
+
**`--abandon` overrides the verdict.** It stops the test, keeps the original page and records no result — the only way to end one that has not concluded, and it applies even when the test *has*. That is deliberate: the only outcome it can disagree with is a variant win, so deferring to the verdict would mean a flag asking to keep the original page handed all the traffic to the alternative instead. The response reports `discardedVerdict` when a real finding was thrown away.
|
|
1263
|
+
|
|
1264
|
+
Nothing goes live until the session is published: starting stages onto the session, and the person publishing is the review of the variant page.
|
|
1265
|
+
|
|
1230
1266
|
### Google Analytics 4 (`baker ga4`)
|
|
1231
1267
|
|
|
1232
1268
|
GA4 commands for multi-channel audits **and** for configuring what the property measures. Playbook-aligned report presets, property health audits, free-form Data API queries, and staged Admin API writes.
|
|
@@ -16,9 +16,9 @@ import {
|
|
|
16
16
|
shouldEscalate
|
|
17
17
|
} from "./chunk-DZUVUGEP.js";
|
|
18
18
|
|
|
19
|
-
//
|
|
19
|
+
// ../../.pnpm-store/v10/links/@/safe-stable-stringify/2.5.0/810146e81bae4e3a061fe487864f2fde80c4b03b886877dc0f1fffbc6480b67e/node_modules/safe-stable-stringify/index.js
|
|
20
20
|
var require_safe_stable_stringify = __commonJS({
|
|
21
|
-
"
|
|
21
|
+
"../../.pnpm-store/v10/links/@/safe-stable-stringify/2.5.0/810146e81bae4e3a061fe487864f2fde80c4b03b886877dc0f1fffbc6480b67e/node_modules/safe-stable-stringify/index.js"(exports, module) {
|
|
22
22
|
"use strict";
|
|
23
23
|
var { hasOwnProperty } = Object.prototype;
|
|
24
24
|
var stringify = configure2();
|
|
@@ -1092,7 +1092,7 @@ function resolveAdaptFormats(params) {
|
|
|
1092
1092
|
return params.formats ?? [];
|
|
1093
1093
|
}
|
|
1094
1094
|
|
|
1095
|
-
//
|
|
1095
|
+
// ../../.pnpm-store/v10/links/@/safe-stable-stringify/2.5.0/810146e81bae4e3a061fe487864f2fde80c4b03b886877dc0f1fffbc6480b67e/node_modules/safe-stable-stringify/esm/wrapper.js
|
|
1096
1096
|
var import__ = __toESM(require_safe_stable_stringify(), 1);
|
|
1097
1097
|
var configure = import__.default.configure;
|
|
1098
1098
|
var wrapper_default = import__.default;
|
|
@@ -9074,4 +9074,4 @@ export {
|
|
|
9074
9074
|
defaultRegistry,
|
|
9075
9075
|
createEngineFromEnv
|
|
9076
9076
|
};
|
|
9077
|
-
//# sourceMappingURL=chunk-
|
|
9077
|
+
//# sourceMappingURL=chunk-CMPAHYLB.js.map
|