@elaraai/east-c-cli 1.0.83 → 1.0.85

package/README.md

@@ -43,23 +43,43 @@ dict or fold it emits into), and where to write the output and a typed
 result: the outcome (`ok`, or `failed` with the message and its source
 locations), the peak memory, and the time spent loading, compiling, executing
 and writing. Paths in a unit may be relative to its file, so a unit and the
-files it names replay wherever they are moved together. It exits 0 when the
-outcome is `ok` and 1 when the result records a failure; `-v` prints where the
-time went and the peak memory.
+files it names replay wherever they are moved together. A run unit says how its
+inputs are read (`decode`, below). It exits 0 when the outcome is `ok` and 1
+when the result records a failure; `-v` prints where the time went and the peak
+memory.
+
+### How inputs are read
+
+A collection input opens lazily, whatever it weighs: an indexed beast2 file is
+mapped, and a read decodes only the segments it reaches — its size, a keyed
+read and the `$.for` loop decode a segment at a time, and an operation the
+pager cannot serve decodes the input whole, once, when it first needs it. A
+loop holds only the segment it walks. Keyed reads keep the segments they
+decode, up to 256 MiB of decoded weight per input (`EAST_PAGED_CACHE_BYTES`;
+`1` keeps one segment), and reads in key order keep about two.
+`--decode whole` decodes every input before the program runs instead, which
+suits a program that reads at random across more than that, or loops over an
+input more than once: lazily, a read beyond the segments the pager keeps
+decodes its segment again. `exec` reads the same choice from its unit's
+`decode`. A value that is not a collection, and a collection whose elements
+hold a Ref or a function, is decoded whole either way.
 
-### Large inputs
+```bash
+east-c run task.beast2 -i rows.beast2 --decode whole -o out.beast2
+```
 
-An indexed beast2 collection input of `EAST_LAZY_INPUT_BYTES` bytes or more
-(64 MiB unless set; `0` turns it off) opens lazily: the file is mapped, and a
-read decodes only the segments it reaches. With `-v` the runner says which
-inputs opened lazily and how many of their segments it decoded.
+With `-v` the runner says how each input opened, and what reading it came to:
+the segments a lazy input decoded, or what an input decoded whole holds in
+memory — the growth in resident memory across its decode, beside the size it
+weighs on disk, since a nested collection decodes at many times that size.
+Reads that decode segments again are said to, with what decoding the input
+whole would do instead.
 
 A collection input may also be a manifest directory, the form e3 stages a
 stored collection in: the input file holds a manifest, and each segment it
 names is a standalone blob in `<file>.segments/<sha256>.beast2`. It opens
 over those files — lazily, a read opening only the segments it reaches, or
-whole — and counts as the size of its segments when the runner decides
-whether to open it lazily.
+whole — and weighs its segments in the `-v` account.
 
 ### Exiting with the parent
 

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@elaraai/east-c-cli",
-  "version": "1.0.83",
+  "version": "1.0.85",
   "description": "Provides the `east-c` bin. A tiny launcher resolves the native binary for your platform from the matching per-platform package (@elaraai/east-c-cli-<target>), pulled in via optional dependencies.",
   "bin": {
     "east-c": "bin/east-c.mjs"
@@ -32,14 +32,14 @@
     "node": ">=18.0.0"
   },
   "devDependencies": {
-    "@elaraai/east": "1.0.83"
+    "@elaraai/east": "1.0.85"
   },
   "optionalDependencies": {
-    "@elaraai/east-c-cli-linux-x64": "1.0.83",
-    "@elaraai/east-c-cli-linux-arm64": "1.0.83",
-    "@elaraai/east-c-cli-darwin-arm64": "1.0.83",
-    "@elaraai/east-c-cli-darwin-x64": "1.0.83",
-    "@elaraai/east-c-cli-win32-x64": "1.0.83"
+    "@elaraai/east-c-cli-linux-x64": "1.0.85",
+    "@elaraai/east-c-cli-linux-arm64": "1.0.85",
+    "@elaraai/east-c-cli-darwin-arm64": "1.0.85",
+    "@elaraai/east-c-cli-darwin-x64": "1.0.85",
+    "@elaraai/east-c-cli-win32-x64": "1.0.85"
   },
   "scripts": {}
 }