@walkeros/cli 4.7.0-next-1790245733116 → 4.7.0

package/CHANGELOG.md

@@ -1,6 +1,6 @@
 # @walkeros/cli
 
-## 4.7.0-next-1790245733116
+## 4.7.0
 
 ### Minor Changes
 
@@ -9,58 +9,146 @@
   `config.bundle.env`; they must be literal strings and supply `$env` in web
   bundles. Step packages, overrides and their dependencies must now come from
   the npm registry: git, file and URL specs are rejected.
-- 06b498a: `@walkeros/cli` no longer depends on `express`, `cors` or `p-limit`.
-  Nothing in the CLI imported them, so an install is smaller and pulls fewer
-  transitive packages into your project. Commands and options are unchanged.
-- ef02916: The `findExample` and `compareOutput` exports and the
-  `ExampleLookupResult` type were removed from `@walkeros/cli`.
-- f5a1cfd: `walkeros validate` now reports unknown route targets as
-  `UNKNOWN_ROUTE_TARGET` errors and warns about entries after an unconditional
-  `stop` and about arrays that only pick the first match.
-  `walkeros push --simulate collector.default` runs enrichment plus
-  `collector.next`, `--mock collector.next.<id>` mocks one of its steps, and
-  simulating a transformer now continues through its `next`.
-- ef02916: `walkeros validate` now reports a file path that does not exist or
-  does not contain valid JSON as an input error with exit code 3, instead of
-  validating the path string and failing the schema with exit code 1. Cross-step
-  example checks now include an object `out`, such as a source example that
-  produces a single walkerOS event, so incompatible connections are reported as
-  errors.
-- 06b498a: `walkeros run` is removed, with no alias. Build a flow with
-  `walkeros bundle`, then start the prebuilt artifact with
-  `runneros start dist/flow.mjs`. The new `@walkeros/runner` package ships the
-  `runneros` binary without esbuild, pacote, jsdom or nft, and the
-  `walkeros/flow` image now runs it.
+- 64b06de: A bundle's default release is now a content id of config, packages
+  and CLI version, so repeat builds hit the build cache. Env and secret values
+  are not part of it, only their names. `--release` now beats a flow's
+  `collector.release`. Rebuilt local `path` packages and CLI upgrades invalidate
+  the build caches, and `cache clear --builds` also clears compiled code.
+- 64b06de: Packages with several exports, such as the GCP and AWS sources and
+  destinations, now publish a settings schema per export. `walkeros validate`
+  and MCP `package_get` use the schema of the export a step imports. Pub/Sub,
+  BigQuery, SNS and SQS steps pinned to this release or later are checked
+  instead of skipped; older pins still report a skip.
+- 74821ed: The canonical `flow-complete.json` example is rewritten as one tested
+  ecommerce setup with web, server and warehouse flows and a 15-chapter guide.
+  The new `flowCompleteManifest` export from `@walkeros/cli/examples` names
+  every feature by a stable id with a JSON Pointer into the file, so docs and
+  tools can reference it.
+- 06b498a: `walkeros run` is removed. Build with `walkeros bundle`, then start
+  the artifact with `runneros start dist/flow.mjs` from the new
+  `@walkeros/runner` package, which the `walkeros/flow` image now runs. The CLI
+  no longer depends on `express`, `cors` or `p-limit`. New `@walkeros/core/node`
+  entry with the Node-only logger, redaction and temp-path helpers.
+- 74821ed: `walkeros push --simulate` prints each step's mapping and vendor
+  calls (`simulations` in `--json`) and reports init or push failures. New
+  flags: `--ingest`, `--consent` (MCP `state.consent`), `--command` for command
+  examples, `--simulate collector.default` and `--mock collector.next.<id>`. A
+  destination that sent nothing says why in `skipped`. `toPrintable` is
+  exported.
+- 74821ed: Simulate records every vendor call through one recorder, `observeEnv`
+  from `@walkeros/core`, and runs offline: BigQuery, Data Manager and the
+  Sheets, GCS and S3 stores reach the network through `env`. Client and `Env`
+  types of BigQuery, Firehose, PostHog, SQS and Pub/Sub are structural.
+  `@walkeros/cli` exports `resolveExportName` and `selectDevExamples` and drops
+  `findExample` and `compareOutput`.
+- 74821ed: Simulate starts only the simulated step, and a simulated transformer
+  continues through its `next`. Source simulations list the commands a source
+  issues as `elb` calls; `--page-url` sets the web page. Express flows need no
+  port. Packages with several exports use per-export examples and mocks, and a
+  destination without a mock env is refused instead of calling the vendor.
+- 4b4937f: Files that passed `walkeros validate` may now fail: it checks every
+  flow and every step's package settings unless you narrow it, and resolves each
+  flow as the bundler does, so an unresolvable `$flow` is an error. `--path`
+  checks the entry in every flow. Settings findings warn for one minor.
+  Named-export steps are skipped; `--offline` skips fetching.
+- 74821ed: `walkeros validate` reports a missing or non-JSON input as exit 3,
+  like `--path`, `--flow` or `--offline` with a non-flow `-t`. Unknown keys on
+  destinations and stores warn (`UNKNOWN_KEY`), as does
+  `@walkeros/store-memory`. `--path` ignores `uri` and email formats. The Flow
+  JSON Schema adds `config.observe` and drops step-level `validate`; the
+  Usercentrics schema lists `apiVersion` and `v3EventName`.
+- 74821ed: `walkeros validate` prints a `Scope:` line and returns
+  `details.scope` instead of `details.validatedFlow`, `details.skipped` for
+  checks that did not run and `details.deferred` for values known only at
+  runtime. Skips never read as passed. Every finding has a stable `code`.
+  `--strict` fails on warnings or skips (exit 2), and `validate()` and
+  `flow_validate` with `strict` return `valid: false`; `flow_validate` also
+  accepts `offline`.
+- 74821ed: An unknown `$var` or `$store` now fails `walkeros validate`, as it
+  fails the bundle. References resolve per flow, and `description` text is never
+  read as a reference. A dangling contract `extend`, an unknown `$contract` on a
+  validate step, or a contract cycle is an error. Contracts bind only on
+  validate steps. Malformed references and unknown or shadowed routes warn.
+- 4f89234: Web builds now assign the collector to the global named in
+  `config.settings.windowCollector`, default `walkerOS`. Before,
+  `walkeros bundle` ignored the setting. It accepts a name or a `$var`/`$env`
+  reference; the resolved name must be a valid, non-reserved JavaScript
+  identifier, or the build and `walkeros validate` report an error.
 
 ### Patch Changes
 
-- ef02916: `walkeros validate --path` no longer fails with
-  `unknown format "uri" ignored` for packages whose settings use URL or email
-  fields. Settings are still checked for structure, types and patterns; string
-  formats such as `uri` are not checked.
-- 8f8aea6: Every step field now survives bundling. A transformer with only
-  `state` or `mapping`, and inline code steps with `cache` or `state`, were
-  silently dropped from the bundle before and did nothing at runtime. `mapping`
-  is now a typed transformer field, and bundles no longer carry `variables`.
-- Updated dependencies [57788bc]
+- 786a860: AWS destinations now deliver in bundled flows without extra setup.
+  Firehose batches by default, ends records with a newline (`newline: false`
+  turns it off), sends mapped `data` and accepts `config.credentials`. Rejected
+  records now count as failed. SNS works with `topicArn` alone and no longer
+  creates topics at start. `walkeros setup` resolves `$secret` values; partial
+  batch failures log their causes.
+- 74821ed: Server builds served from the build cache now copy the root `include`
+  folders; web builds ignore `include` and log it. An unused package in
+  `bundle.packages` warns instead of failing the build. Cache entries are
+  written atomically, so an interrupt no longer leaves a broken entry, and
+  `walkeros cache clear` removes leftovers. Temp dirs are
+  `<tmp>/walkeros/<kind>/<id>`.
+- 5a210e1: `walkeros flows create` and `walkeros flows update` now read
+  `--content` from a file path or URL as well as an inline JSON string. Large
+  flows no longer need to fit on the command line: pass `--content ./flow.json`.
+- 74821ed: A flow's own log lines now go through the CLI logger: its debug lines
+  need `--verbose`, and they go to stderr with `--json`. Version numbers are no
+  longer masked as tokens, so `walkeros deploy` shows the image tag and
+  `bundle --stats` shows package versions. Paths under the system temp directory
+  print as `$TMPDIR/...`.
+- b1e5aa5: Manifest builds now survive short network blips: the manifest
+  download, skeleton downloads and uploads retry up to three times on network
+  errors, timeouts, 5xx and 429, while other statuses such as an expired link
+  fail at once. Each retry is logged, and errors name the cause, for example
+  `fetch failed (ECONNRESET)` or `HTTP 503`.
+- 74821ed: Simulate and push output, CLI and flow logs, and the MCP
+  `flow_simulate` and `flow_push` results mask the values of secrets a flow
+  references, also inside JSON strings, numbers and URLs. `scrubSecrets` takes
+  `known`, the CLI logger `knownSecrets`, and `scrubJson` replaces
+  `maskKnownNumbers`. MCP `flow_push` and `flow_simulate` read their config
+  once; a config that cannot be read stops the run.
+- 050d776: Simulated click and impression examples of the browser source carry
+  `source` and `globals` again. A page scope from another realm, such as an
+  iframe or a simulated page, is now recognized. Simulate also exposes `Node`,
+  `Element`, `HTMLElement`, `Document` and `ShadowRoot`, so `instanceof` checks
+  behave as in a browser.
+- 74821ed: `state` paths resolve against `{ event, ingest }` and need an
+  `event.` or `ingest.` prefix; a `get` can write into `ingest`, and an
+  unresolvable key warns. Every step field now survives bundling: transformers
+  with only `state` or `mapping`, and code steps with `cache` or `state`, were
+  silently dropped before. `buildCacheContext` is renamed `createMappingRoot`.
+- e860006: `state` gains `mapping` to shape what a lookup returns or a write
+  stores, merged into the target. An undeclared `state.store`, or a `file: true`
+  store, is now a validation error in `walkeros validate` and deploy preflight;
+  at runtime the entry logs an error or is skipped with a warning. The s3 and
+  gcs stores report their `file` mode.
+- Updated dependencies [786a860]
+- Updated dependencies [74821ed]
 - Updated dependencies [06b498a]
-- Updated dependencies [2aebc53]
-- Updated dependencies [f5a1cfd]
-- Updated dependencies [ef02916]
+- Updated dependencies [7e5e3de]
+- Updated dependencies [b9668bf]
+- Updated dependencies [74821ed]
+- Updated dependencies [64b06de]
+- Updated dependencies [4b4937f]
+- Updated dependencies [74821ed]
+- Updated dependencies [74821ed]
+- Updated dependencies [74821ed]
 - Updated dependencies [06b498a]
-- Updated dependencies [ef02916]
-- Updated dependencies [2aebc53]
-- Updated dependencies [f5a1cfd]
-- Updated dependencies [f5a1cfd]
-- Updated dependencies [2aebc53]
-- Updated dependencies [8f8aea6]
-- Updated dependencies [2aebc53]
-- Updated dependencies [2aebc53]
-  - @walkeros/core@4.7.0-next-1790245733116
-  - @walkeros/server-core@4.7.0-next-1790245733116
-  - @walkeros/collector@4.7.0-next-1790245733116
-  - @walkeros/transformer-validate@4.7.0-next-1790245733116
-  - @walkeros/server-destination-api@4.7.0-next-1790245733116
+- Updated dependencies [74821ed]
+- Updated dependencies [74821ed]
+- Updated dependencies [74821ed]
+- Updated dependencies [74821ed]
+- Updated dependencies [74821ed]
+- Updated dependencies [e860006]
+- Updated dependencies [74821ed]
+- Updated dependencies [74821ed]
+- Updated dependencies [4f89234]
+  - @walkeros/collector@4.7.0
+  - @walkeros/core@4.7.0
+  - @walkeros/server-core@4.7.0
+  - @walkeros/transformer-validate@4.7.0
+  - @walkeros/server-destination-api@4.7.0
 
 ## 4.6.1
 

package/README.md

@@ -22,14 +22,20 @@ npm install -g @walkeros/cli
 ## Quick start
 
 ```bash
-# Bundle a flow configuration
-walkeros bundle flow.json
-
 # Test with simulated events (no real API calls)
 walkeros push flow.json --event '{"name":"product view"}' --simulate destination.demo
 
-# Run a collection server locally
-walkeros run dist/flow.mjs --port 3000
+# Bundle a flow configuration into dist/
+walkeros bundle flow.json -o dist/
+```
+
+The CLI builds flows; it does not run them. Start a built server flow with
+`runneros` from
+[`@walkeros/runner`](https://www.npmjs.com/package/@walkeros/runner) (also the
+`walkeros/flow` Docker image):
+
+```bash
+npx --package=@walkeros/runner runneros start dist/flow.mjs --port 3000
 ```
 
 ## Documentation