@wix/himalaya-cli 0.859.0 → 0.860.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/dist/cli.mjs CHANGED
@@ -5234,7 +5234,6 @@ function resolveTranslation(value, catalog, sourceCatalog) {
5234
5234
  var BINDING_SIGILS, BINDING_SIGIL_RE, TRANSLATION_PREFIX, TRANSLATION_KEY_RE;
5235
5235
  var init_bindings = __esm({
5236
5236
  "../../core/ts/src/bindings.ts"() {
5237
- "use strict";
5238
5237
  BINDING_SIGILS = ["service", "flag", "item", "t"];
5239
5238
  BINDING_SIGIL_RE = new RegExp(
5240
5239
  `^\\$(?:${BINDING_SIGILS.filter((s) => s !== "t").join("|")})\\b|^\\$t:`
@@ -315,11 +315,30 @@ the relations held.
315
315
 
316
316
  - **Measured, not asserted.** A committed kill-rate benchmark records what fraction of planted,
317
317
  realistic reducer bugs the crawl actually catches, per bug class, and every new check has to move
318
- that number. Today it is **13.6%** (11 of 81 planted bugs across 25 content dirs), and the table
319
- is as useful for what it misses as for what it catches: bugs that produce an *implausible* value
320
- — a crash, a stuck skeleton, a `NaN` — are caught, while bugs that produce a *plausible wrong
321
- value*, such as reading the wrong key off a response or a total off by one, are caught 0 of 34
322
- times. A green run means no invariant fired, not that the app is correct.
318
+ that number. It is **31 of 269 = 11.5%** across all 48 content dirs, and the table is as useful
319
+ for what it misses as for what it catches. Most of the checks judge a *single settled state* and
320
+ look there for an *implausible* value — a crash, a stuck skeleton, a `NaN` — so a bug that
321
+ produces a plausible wrong one walks straight past them: a total off by one is 0/32, the wrong
322
+ row dropped 0/27. What reaches a plausible wrong value is the smaller set of checks that compare
323
+ two states instead of judging one — the relational axis (an action against the action that
324
+ undoes it, a refresh against a fresh boot) and `typed-value-ignored`, which fires when a dispatch
325
+ carrying a real payload changes nothing at all. That last one is what moved `wrong-key` to 12/48,
326
+ by typing the value a UI control actually carries so the half of each reducer that reads its
327
+ payload finally runs. A green run means no invariant fired, not that the app is correct.
328
+
329
+ The benchmark also carries a `control-throw` row at 48/48, and it is **excluded from the rate on
330
+ purpose**: a planted `throw` is caught by construction, so counting it would inflate the figure
331
+ with a class that can never move. It is the harness checking itself — anything below 100% there
332
+ means the run stopped dispatching and no other number in the table should be believed. Read it as
333
+ the harness's self-test — never as evidence that the crawl catches crashes in your app.
334
+
335
+ Two things about that number are worth knowing, because both were learned the hard way. It was
336
+ published as 13.6% (11 of 81) until that denominator turned out to omit a whole bug class, and it
337
+ was measured over 25 sample apps until the starter templates `himi init --template` ships — the
338
+ 23 a customer actually adopts, and 97% of the benchmark's worker *files* (90% of its code) —
339
+ turned out never to have been in it at all. Measured over the code customers ship, the crawl is roughly half as effective
340
+ as the sample apps suggested. This page carries the current figure; treat one quoted anywhere
341
+ else, including in a dated release note, as the number on the day it was written.
323
342
  - **Zero false positives, corpus-proven.** Held across every sweep of the 40+ app corpus —
324
343
  except `poll-action-missing`, which ships at `error` without corpus evidence behind it
325
344
  (see the exception noted under "What it checks" above).
@@ -172,12 +172,19 @@ areas, always in the same order, so you can skim for the one you care about.
172
172
  the behavioural crawl over any error-level lint issue, and skipped typed journeys entirely while
173
173
  still reporting a pass. (#2392)
174
174
  - **The `himi test` reference now states what a green run does and does not prove.** A benchmark
175
- plants realistic reducer bugs and measures the fraction the crawl catches, per bug class — 13.6%
176
- today. The useful half is where it is zero: bugs that produce an *implausible* value (a crash, a
177
- stuck skeleton, a `NaN`) are caught, while bugs that produce a *plausible wrong value*, such as
178
- reading the wrong key off a response or a total off by one, are caught 0 of 34 times. A green run
179
- means no invariant fired, not that your app is correct. The figure comes from that benchmark, not
180
- from your own runs — `himi test` output is unchanged. (#2402)
175
+ plants realistic reducer bugs and measures the fraction the crawl catches, per bug class. The
176
+ useful half is where it is low: bugs that produce an *implausible* value (a crash, a stuck
177
+ skeleton, a `NaN`) are caught, while bugs that produce a *plausible wrong value* — a total off by
178
+ one, the wrong row dropped — largely are not. A green run means no invariant fired, not that your
179
+ app is correct. The figure comes from that benchmark, not from your own runs — `himi test` output
180
+ is unchanged. (#2402)
181
+
182
+ This entry no longer quotes the rate, and that is deliberate. It said "13.6% today", a figure
183
+ corrected shortly afterwards for omitting a whole bug class and moved several times since by
184
+ changes to the corpus and the oracles — so a reader calibrating how far to trust a green run was
185
+ reading a number that was both wrong and getting wronger. A dated note cannot stay right about a
186
+ live measurement. `himi docs himi-test` carries the current figure, how it was measured, and the
187
+ corrections behind it.
181
188
  - **`himi validate` no longer answers `ok: true` after a CMS check that never ran.** An unloadable
182
189
  `config.ts` was swallowed, the CMS pass returned nothing, and validation reported success. (#2389)
183
190
 
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "@wix/himalaya-cli",
3
- "version": "0.859.0",
3
+ "version": "0.860.0",
4
4
  "type": "module",
5
5
  "description": "himi — the Himalaya authoring CLI. Build a Tier-5 content package on your own machine, push it to the production serve as a draft, preview it on web + Himi Player, and read worker logs back — the remote dev loop. Wraps @himalaya/serve-cli for transport.",
6
6
  "keywords": [
@@ -63,5 +63,5 @@
63
63
  "artifactId": "himalaya-cli"
64
64
  }
65
65
  },
66
- "falconPackageHash": "d7b917e8cde66a4d5863631ca5f5de90316a307fb73e854c63310248"
66
+ "falconPackageHash": "6e5648ad5145fd23a5016b4c194db40fb00d71c22c7a0abaa2ed5020"
67
67
  }