@plurnk/plurnk-grammar 0.34.0 → 0.39.0

package/README.md

@@ -50,7 +50,7 @@ Exit `0` on clean parse, `1` on any error or unparsed tail.
 | FIND | tag filter       | matcher               | result-set range   |
 | READ | tag filter       | matcher               | per-entry lines    |
 | EDIT | tags             | content (empty=clear) | entry lines        |
-| COPY | tags-to-apply    | destination URI       | entry lines        |
+| COPY | tags-to-apply    | destination URI / fork prompt | entry lines        |
 | MOVE | tags-to-apply    | destination URI       | entry lines        |
 | OPEN | tag filter       | matcher               | result-set range   |
 | FOLD | tag filter       | matcher               | result-set range   |
@@ -194,10 +194,11 @@ Errors are JSON-serializable. Shape: `{ line, column, source, message }` where `
 
 ## gbnf
 
-Three generated [GBNF](https://github.com/ggml-org/llama.cpp/blob/master/grammars/README.md) grammars ship in the package for llama.cpp constrained sampling, most→least permissive. All dictate the canonical statement form (digit suffixes, comma line markers, three-digit SEND signals); free text can never contain a complete `<<OP` opener — emitting one commits the sampler into statement mode, so operations stay fully enforced everywhere.
+Four generated [GBNF](https://github.com/ggml-org/llama.cpp/blob/master/grammars/README.md) grammars ship in the package for llama.cpp constrained sampling. All dictate the canonical statement form (digit suffixes, comma line markers, three-digit SEND signals); operations are fully enforced everywhere.
 
-- **`plurnk.gbnf` (default, open)** — free reasoning text and statements interleave; EOS is admissible at any boundary, so termination is the model's own choice. The grammar filter sits below the reasoning/content split on llama.cpp; the open root lets reasoning-tuned models think — including reasoning *about* concluding without being forced to conclude.
-- **`plurnk-closed.gbnf`** — text allowed, but the turn must close with a final pathless `SEND[102]`/`SEND[200]` status update, after which nothing is admissible (forced EOS). For models that ramble past optional stopping points.
+- **`plurnk.gbnf` (default)** — free reasoning text and statements interleave, EOS at any boundary, **but `<<` is a hard commit**: prose may contain a lone `<` and never `<<`, so the only way to produce `<<` is to begin a real operation. Operation-lookalike garbage (`<<RANDOM`) can't exist even as text — at `<<` the sampler is forced into a valid op. Leanest text automaton (2 states). Tradeoff: a fumbled verb is coerced toward a real op, and `<<` is unwritable in prose.
+- **`plurnk-free.gbnf`** — free text and statements interleave with `<<` escapable to text: an opener-lookalike that never completes a real keyword stays inert text. The permissive fallback if the hard commit bites.
+- **`plurnk-closed.gbnf`** — free-style text, but the turn must close with a final pathless `SEND[102]`/`SEND[200]` (forced EOS). For models that ramble past optional stopping points.
 - **`plurnk-strict.gbnf`** — ops only, bounded newline separators. The tightest rail, for models that don't reason.
 
 The parser remains the permissive contract — everything any of the three can generate, the parser accepts (interstatement text surfaces as `kind: "text"` items).

package/dist/plurnk-closed.gbnf

@@ -769,8 +769,6 @@ plan-9-b3 ::= ("A" plan-9-b4 | ":" plan-9-b1 | [^\x00-\x08\x0B-\x0C\x0E-\x1F\x7F
 plan-9-b4 ::= ("N" plan-9-b5 | ":" plan-9-b1 | [^\x00-\x08\x0B-\x0C\x0E-\x1F\x7F:N] plan-9-b0)?
 plan-9-b5 ::= (":" plan-9-b1 | [^\x00-\x08\x0B-\x0C\x0E-\x1F\x7F:9] plan-9-b0)?
 plan-9 ::= "<<PLAN9" ":" plan-9-b0 ":PLAN9"
-root-open ::= text open-step*
-open-step ::= statement text-after?
 root-closed ::= text closed-step* send-final-any "\n"?
 closed-step ::= mid-statement text-after?
 text-after ::= "\n" text
@@ -810,14 +808,10 @@ text-s32 ::= ("A" text-s33 | "<" text-s1 | [^\x00-\x08\x0B-\x0C\x0E-\x1F\x7FA<]
 text-s33 ::= ("<" text-s1 | [^\x00-\x08\x0B-\x0C\x0E-\x1F\x7FN<] text-s0)?
 text-s34 ::= "F" text-s3 | "R" text-s6 | "E" text-s9 | "C" text-s12 | "M" text-s15 | "O" text-s18 | "S" text-s23 | "K" text-s28 | "P" text-s31 | "<" text-s2 | [^\x00-\x08\x0B-\x0C\x0E-\x1F\x7FFRECMOSKP<] text-s0
 text ::= text-s0
-root-strict ::= "\n"? batch-step* send-final-any "\n"?
-batch-step ::= mid-statement "\n" "\n"?
 mid-statement ::= op-statement | send-mid-any
 op-statement ::= find | find-1 | find-2 | find-3 | find-4 | find-5 | find-6 | find-7 | find-8 | find-9 | read | read-1 | read-2 | read-3 | read-4 | read-5 | read-6 | read-7 | read-8 | read-9 | edit | edit-1 | edit-2 | edit-3 | edit-4 | edit-5 | edit-6 | edit-7 | edit-8 | edit-9 | copy | copy-1 | copy-2 | copy-3 | copy-4 | copy-5 | copy-6 | copy-7 | copy-8 | copy-9 | move | move-1 | move-2 | move-3 | move-4 | move-5 | move-6 | move-7 | move-8 | move-9 | open | open-1 | open-2 | open-3 | open-4 | open-5 | open-6 | open-7 | open-8 | open-9 | fold | fold-1 | fold-2 | fold-3 | fold-4 | fold-5 | fold-6 | fold-7 | fold-8 | fold-9 | exec | exec-1 | exec-2 | exec-3 | exec-4 | exec-5 | exec-6 | exec-7 | exec-8 | exec-9 | kill | kill-1 | kill-2 | kill-3 | kill-4 | kill-5 | kill-6 | kill-7 | kill-8 | kill-9 | plan | plan-1 | plan-2 | plan-3 | plan-4 | plan-5 | plan-6 | plan-7 | plan-8 | plan-9
 send-mid-any ::= send-mid | send-1-mid | send-2-mid | send-3-mid | send-4-mid | send-5-mid | send-6-mid | send-7-mid | send-8-mid | send-9-mid
 send-final-any ::= send-final | send-1-final | send-2-final | send-3-final | send-4-final | send-5-final | send-6-final | send-7-final | send-8-final | send-9-final
-send-statement ::= send-mid-any | send-final-any
-statement ::= op-statement | send-statement
 status-final ::= "102" | "200"
 status-mid ::= "10" [0-13-9] | "1" [1-9] [0-9] | "20" [1-9] | "2" [1-9] [0-9] | [03-9] [0-9] [0-9]
 tags ::= "[" tag tag-rest* "]"