saffron-ai 0.8.0 → 0.8.2

package/CHANGELOG.md

@@ -4,6 +4,92 @@ All notable changes to Saffron, in one place: the `saffron-ai` runner (npm),
 the VS Code extension (`ChathurangaJayasinghe.saffron-vscode`) and the
 JetBrains plugin (`ai.saffron.jetbrains`). Dates are publish dates.
 
+## 0.8.2
+
+Released 2026-09-22.
+
+Runner
+
+- **Split a suite across CI machines: `--shard 2/4` and
+  `saffron report --merge`.** `--workers` stops at one machine's cores;
+  sharding gives the suite to several. Each shard runs a fixed part, split
+  by scenario rather than by file, so one large feature file spreads over
+  every machine, and every scenario runs exactly once. `--shard-by file`
+  (or `"shardBy": "file"`) keeps each feature file on one machine instead,
+  for files whose scenarios share expensive or order-dependent state. A shard writes
+  `.saffron/reports/shard-2-of-4.json` instead of `latest.json` and leaves
+  `history.jsonl` alone, because part of a run would read as a run in the
+  trends. `saffron report --merge` finds the shard reports under `.saffron/`
+  (or the folders you name) and writes `latest.json`, `latest.html` and one
+  history line, with the same totals, scenario order and trends as an
+  unsharded run. It refuses a missing shard, the same shard twice, shards
+  that ran a different suite, and shards from different CI runs; merging
+  twice does not count the run twice. Setup and teardown run on each shard
+  and receive `SAFFRON_SHARD`. The docs have a GitHub Actions example.
+
+## 0.8.1
+
+Released 2026-09-22.
+
+Runner
+
+- **Google Chrome and Microsoft Edge: `--browser chrome` and
+  `--browser msedge`.** Run on the branded browser your users actually
+  have, not only the open-source Chromium build. Both speak CDP, so
+  everything works there: replay, recording and healing. Recordings are the
+  same files, so a scenario recorded on `chromium` replays on `chrome` and
+  `msedge` and the other way round. Saffron uses the copy installed on the
+  machine; when it is missing the run stops before the first scenario, exit
+  code 2, and names the browser (`npx playwright install chrome` adds it on
+  a CI image). Also accepted as `browser` in the config.
+- **Setup and teardown: `"setup"` and `"teardown"` in the config.** Shell
+  commands, one or a list, that Saffron runs once around a run, in the
+  project root: seed the data your scenarios read before any browser
+  opens, and clean up after the last scenario. A failed setup stops the
+  run with exit code 2 and no scenario runs. Teardown always runs: after
+  failures, after a failed setup, after Ctrl-C (which first stops a running
+  setup and waits for it, so nothing writes behind the cleanup). A failed teardown leaves
+  the verdicts alone and turns an otherwise green exit into 2, because what
+  it left behind is the next run's false red. The commands receive
+  `SAFFRON_BASE_URL` and `SAFFRON_ENV`. `--no-hooks` skips them,
+  `hookTimeoutMs` (default five minutes) bounds each one, and the report
+  lists every command with how it ended. With `{unique:name}` from 0.8.0
+  this makes a suite re-runnable and parallel-safe.
+
+Fixes
+
+- **Step reuse could bring back a stale data value.** When a `{data:...}`
+  value changed, the scenario's recording correctly went stale, but a new
+  recording could be seeded from that same recording's steps, putting the
+  old literal back under a fresh data snapshot, verified, at zero AI calls.
+  A step whose source recording still spells out a value that has since
+  changed is no longer reused.
+- **`every {data:list}` counted hidden content as shown.** A value sitting
+  in a `hidden` or `display: none` element satisfied the check. The target
+  must now be visible, and only text the page actually shows counts. A
+  native `<select>` keeps its exception, since its options are never
+  visible while it is closed, but only when the select itself is visible.
+  Text is still compared as written, so CSS `text-transform` does not
+  change the result.
+- **`{unique:name}` inside an Examples cell, a table cell or a doc string
+  reached the browser as the literal token.** Unique values were resolved
+  before parameters were substituted. They are now resolved in parameter
+  values too, with the same per-run seed, for values and locators alike.
+- **`saffron prune` could list the screenshots of a live scenario as
+  orphaned** when its feature file is outside the configured directory and
+  the scenario has only ever failed, so no cache or proposal named the
+  file. Each screenshot folder now records which feature and scenario it
+  belongs to, prune reads it before judging, and the listing names what
+  the pictures were of.
+
+Editors (VS Code extension 0.2.8)
+
+- **VS Code ignored environment-specific CSV files.** With environment
+  `staging` and `roles.staging.csv`, `Examples: {data:roles}` was reported
+  as not resolving, or described from the base `roles.csv`. Diagnostics,
+  hover and go-to-definition now follow the runner: the environment's CSV
+  replaces the base one, and the hover names the file it read.
+
 ## 0.8.0
 
 Released 2026-09-21.
@@ -56,7 +142,19 @@ Runner
   lists those folders with the caches and proposals and removes them with
   `--yes`; a live scenario's folder is kept, per Examples row. `saffron
   status --json` reports them as orphans of kind `artifact`, and both IDE
-  panels (VS Code 0.2.6, JetBrains 0.2.3) show them.
+  panels (VS Code 0.2.7, JetBrains 0.2.4) show them.
+
+Editors (VS Code extension 0.2.7, JetBrains plugin 0.2.4)
+
+- **`{data:...}` in the editor.** VS Code completes data files and keys with
+  their values, shows the current value (or a list's values, or an Examples
+  file's columns) on hover, jumps to the key, and underlines a reference
+  that does not resolve, reading the same files and environment overlay the
+  runner does. JetBrains gets the same through `saffron lsp`. Both highlight
+  `{data:...}` and `{unique:...}` like `{env:VAR}`, including on an
+  `Examples:` line.
+- Both Orphans lists show the screenshot folders of scenarios that no longer
+  exist, so "Remove All" never deletes something it did not show.
 
 ## 0.7.2
 
@@ -88,13 +186,6 @@ Runner
 
 Editors (VS Code extension 0.2.6, JetBrains plugin 0.2.3)
 
-- **`{data:...}` in the editor.** VS Code completes data files and keys with
-  their values, shows the current value (or a list's values, or an Examples
-  file's columns) on hover, jumps to the key, and underlines a reference
-  that does not resolve, reading the same files and environment overlay the
-  runner does. JetBrains gets the same through `saffron lsp`. Both highlight
-  `{data:...}` and `{unique:...}` like `{env:VAR}`, including on an
-  `Examples:` line.
 - **Last run, with the screenshot one click away.** Both IDEs list what the
   last run left to look at: failed scenarios, then healed ones, with the
   step that failed. VS Code opens the screenshot in its image preview on

package/README.md

@@ -72,7 +72,7 @@ node dist/cli/index.js -p examples accept --all
 
 | Command | What it does |
 |---|---|
-| `saffron run [paths] [--headed] [--filter @tags] [--rerecord] [--no-agent] [--strict] [--browser b] [--workers n] [--heal-model m] [--no-verify] [--no-reuse] [--model m] [--storage-state f]` | Run features. Cached replays are deterministic; misses/failures escalate to the agent (unless `--no-agent`). Replay cross-browser with `--browser firefox\|webkit`, parallelize with `--workers N`, heal on a cheaper model with `--heal-model`. Exit 1 on red (and on yellow with `--strict`). |
+| `saffron run [paths] [--headed] [--filter @tags] [--rerecord] [--no-agent] [--strict] [--browser b] [--no-hooks] [--workers n] [--heal-model m] [--no-verify] [--no-reuse] [--model m] [--storage-state f]` | Run features. Cached replays are deterministic; misses/failures escalate to the agent (unless `--no-agent`). Replay cross-browser with `--browser firefox\|webkit`, parallelize with `--workers N`, heal on a cheaper model with `--heal-model`. Exit 1 on red (and on yellow with `--strict`). |
 | `saffron accept [files... \| --all] [--include-unverified] [--with-feature-edit] [--propagate]` | Promote cache proposals to committed caches (`--all` skips UNVERIFIED ones unless `--include-unverified`); `--with-feature-edit` also rewrites the adapted steps in the `.feature` file (and keeps the cache in sync); `--propagate` applies the heal's locator fixes to every other cache using the same locator. One heal repairs N scenarios before they ever fail. No args: list pending proposals. |
 | `saffron reject [files... \| --all]` | Discard proposals; the agent will try again next run. |
 | `saffron status [--json]` | Project overview for people, IDE panels and dashboards: feature files and scenarios with cache state, tags, pending proposals, last run, history, vocabulary health (divergent steps, duplicate wordings proven by identical recordings), effective config. |