leptris 1.9.210.1 → 1.9.213.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 0c1fc68df458294f7d8a60b00db823558a71f9265f02bf09841587c9d329539b
-  data.tar.gz: 41b96817f9958f69ea83654e1361fcb7676c9e7d7c23f40dcc51aff992d23a3a
+  metadata.gz: 708246fd0d69af25b4257d67e0c22a62a818c5aa7e523eb914628c011b6065e3
+  data.tar.gz: 386676e6428cbb3aa09b9bb490516e438465570302ac0024a0b13ebafc545d4b
 SHA512:
-  metadata.gz: 88af9a2d94c05f79e0668c956d0207a4fb9e85a5b7823df392f2a735b72111a84896674892820a0e4b6c87893f7f2d2aed2f4dd25017d2bac12fbc8c3f2319b4
-  data.tar.gz: ac2966be7c1c0588cf4ebaf8e1a1a02702094b9a6d6b5a2fdff26e61ecfd31c0bdde5d4040e13ce779c70faf9fe389dc3d19b6bf4c33c9df1bfa8c7379061669
+  metadata.gz: 19826be07b804dca192cef9777f88f804b077c87a44cc0b24940509ae1db6787391c9e1db63acfad547fbeef910c03fc79ac345e064cb6b32a7ecedfdd9ec500
+  data.tar.gz: b24ae844a86ac307c39164b096cf5ba5fbb5a11cf981d9c1ca5573fdf9b6a0f14968074c73e47e1d9c3ba7143a57fa2e00ba616575750dbacf5c00be70ca3fef

data/CHANGELOG.md

@@ -5,6 +5,23 @@ All notable changes to Leptris will be documented in this file.
 The format is based on [Keep a Changelog](https://keepachangelog.com/1.0.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## [1.9.213.0] - 2026-09-21
+
+### Engine sync — 1.9.211–1.9.213 (perf + the QT3 date/time family)
+
+- 1.9.211: the **interleaved parse lane** landed behind
+  `LEPTRIS_INTERLEAVED=1` (engine-side opt-in; sentinel-discipline
+  scans, fused 48-byte SIMD probes, names as zero-copy views —
+  1633/1633 parity). The XSLT append-tail memo (single-slot
+  validated last-child hint) also rides.
+- 1.9.212/1.9.213: the **QT3 date/time function family** for
+  XPath/XSLT (extractors, timezone + `fn:parse-ietf-date`,
+  `op:date` arithmetic, the yearMonthDuration family — 17 test
+  sets, 782/782 engine-side) plus int64/`long long` portability
+  fixes for MSVC/ILP32.
+- No binding-facing surface changes: audit holds at 335/335,
+  suite 760/0.
+
 ## [Unreleased]
 
 ### Added — Descriptor typed scalars + the fused materialize entry (#230's consumer contract)

data/Rakefile

@@ -8,7 +8,7 @@ RSpec::Core::RakeTask.new(:spec)
 # Pin for `rake compile` and the platform-gem builds. Keep in lockstep
 # with .github/workflows/build.yml (which calls `rake compile`) and the
 # CHANGELOG when libleptris releases.
-LIBLEPTRIS_VERSION = "1.9.210"
+LIBLEPTRIS_VERSION = "1.9.213"
 # Vendored alongside libleptris for fn:normalize-unicode (TODO
 # .restructure/20): built per platform with a RELOCATABLE @rpath
 # install name, loaded by ffi.rb before libleptris so the

data/lib/leptris/version.rb

@@ -1,5 +1,5 @@
 # frozen_string_literal: true
 
 module Leptris
-  VERSION = "1.9.210.1"
+  VERSION = "1.9.213.0"
 end

data/vendor-src/README.md

@@ -1,7 +1,7 @@
 Sources vendored in this gem (recompile rights; the ruby
 variant builds them at install via extconf.rb):
 
-- libleptris v1.9.210
+- libleptris v1.9.213
 - utf8proc v2.11.0
 
 Rebuild by hand:

data/vendor-src/libleptris/CHANGELOG.md

@@ -1,5 +1,62 @@
 ## [Unreleased]
 
+## [1.9.213] - 2026-09-21
+
+### Added — the op:date and yearMonth families (#1182, lever 6)
+
+- **op-date arithmetic (#1265)**: date/time/dateTime +/- dayTimeDuration — 6 QT3 sets, 128/128. Shared lexical shifter (`leptris_dt_shift`), time arithmetic wrapping the day, ISO date-shaped string comparisons. Fixed two corpus-caught bugs: zoned times misclassified as dateTimes, and dateTime results printing the input's seconds instead of the shifted instant's.
+- **yearMonthDuration family (#1266)**: 11 QT3 sets, 264/264 — months arithmetic (PnYnM canonical, llrint tie rule), month-end clamping for date/dateTime shifts (leap-aware), negative-year printing. The lt/gt sets rode the existing months comparison hook untouched.
+
+Both batches survived the 32-bit-long portability classes (MSVC/ILP32): int64-range instant math and every %lld argument now use long long — the CI legs caught three occurrences of the width/specifier mismatch family.
+
+## [1.9.212] - 2026-09-21
+
+### Added — the QT3 date/time family (lever 6 stage-2, #1182)
+
+Three corpus-driven batches land the date/time surface with the
+W3C QT3 suite as the gate:
+
+- **Extractors (#1261)**: 12 vendored test-sets (300/300) —
+  year/month/day-from-date{,Time}, hours/minutes/seconds-from-
+  {time,dateTime} — plus five language fixes: function-call
+  operands for eq/ne/lt/le/gt/ge (unprefixed and fn:-prefixed),
+  the `idiv` operator, unary `+`, the timezone scan in date
+  parsing (zoned values were treated as naive), and the
+  empty-sequence/fractional-seconds extractor contracts.
+- **Timezone + RFC 5322 (#1262)**: 5 sets (90/90) —
+  timezone-from-* accessors and fn:parse-ietf-date (both lexical
+  orders, obsolete US zones, verbatim fractions). The QT3 harness
+  grew inline param environments and external-declaration
+  prepending.
+- **op:dayTimeDuration value model (#1263)**: 8 sets (287/287) —
+  duration arithmetic (+, -, *, div), comparisons, min/max over
+  duration sequences, canonical formatting, FODT0002 range errors
+  (including a fixed fortified-runtime abort on giant values), and
+  adjust-* attaching the implicit timezone to naive values.
+
+## [1.9.211] - 2026-09-20
+
+### Performance
+
+- **Interleaved parse lane, slices 1-3a (#1258).** The first
+  pugixml-style interleaved rewrite landed behind
+  `LEPTRIS_INTERLEAVED=1` (opt-in; every input outside the covered
+  surface bails to the classic parser before any state). The lane
+  streams `IlRec`/`IlAttr` records with buffer-relative views, then
+  replays the classic public stores in one linear post-pass:
+  sentinel-discipline scans (no per-byte bounds tests; fused 48-byte
+  quote/'&'/whitespace probes with SIMD tails), upfront stream
+  capacity from the input size, and element/attribute names as
+  NUL'd views into the parse scratch (no per-name copies). Parity is
+  gated by a dedicated spec plus running the FULL test suite with
+  the lane forced on: 1633/1633 identical. `LEPTRIS_IL_STATS=1`
+  prints an engagement canary for diagnosing whether the lane ran.
+- **XSLT append-tail memo (#1259).** `out_append_child` keeps a
+  validated single-slot (parent, last-child) hint and feeds
+  `leptris_element_append_child_tail` — result-tree placement no
+  longer re-walks sibling chains (the hottest dispatch-heavy
+  profile leaf, ~17% of samples).
+
 ## [1.9.210] - 2026-09-20
 
 ### Added

data/vendor-src/libleptris/CMakeLists.txt

@@ -3,7 +3,7 @@
 cmake_minimum_required(VERSION 3.20)
 
 project(leptris
-    VERSION 1.9.210
+    VERSION 1.9.213
     DESCRIPTION "Fast XML parser and XPath evaluator in pure C"
     LANGUAGES C CXX
 )

data/vendor-src/libleptris/TODO.max-perf/00-INDEX.md

@@ -24,3 +24,7 @@ Next portability gate: s390x big-endian (#1194, PR #1202).
 The node-layout fork (row 4 successor, owner green-lit 2026-09-20):
 TODO.max-perf/node-layout-fork.md — 5 slices, addresses #1222 +
 #1179 residual + #1238 parse side.
+
+The interleaved-parse rewrite (owner-directed 2026-09-20):
+TODO.max-perf/interleaved-parse.md — the #1222 step-change; slices 0-4,
+each CI-benchmark-gated.

data/vendor-src/libleptris/TODO.max-perf/interleaved-parse.md

@@ -0,0 +1,67 @@
+# The interleaved-parse rewrite (the pugixml-class lane)
+
+Status: PLAN (2026-09-20, owner directive). Supersedes the fork's
+remaining slices for the XML parse path. Target: close the #1222
+large-document gap (pugixml 2-5.9x ahead on CI) at the SOURCE.
+
+## Why the current lane can't get there
+
+The no-LTO dissection (2026-09-20) shows direct_parse is at its
+representation optimum: fused 48B probe + SIMD value scan, packed
+attr tail, O(1) wiring, offset edges, root-only registration. The
+remaining per-item cost is the representation itself: per-attr
+40B struct stores inline in the parse loop, the scratch
+NUL-terminate/restore dance, per-element ns/line bookkeeping, and
+the O(K) dup-detection walk.
+
+## The pugixml model (what we're adopting)
+
+One immutable input (already ours, #1125) + ONE node region + ONE
+stream region. The parse loop ONLY appends to streams; nothing is
+finalized inline:
+
+1. **SOA attr streams** — per element, attrs land in parallel
+   arrays: name_off[4B] / value_off[4B] / len8[len pairs] into the
+   string stream. ~12-16B per attr, sequential stores, no structs
+   built during parse.
+2. **Length-based views everywhere** — names and values are
+   (offset, len) into the pristine buffer. NO NUL-termination, NO
+   scratch mutation, NO restore pass (the current lane's biggest
+   hidden cost).
+3. **Element records as pure data** — a 32-48B record per element
+   (name view, first_attr index, parent/first/next indices, line)
+   bump-carved from the node region (doc_block, slice 1 landed).
+4. **Deferred passes** — dup detection, ns stamping, hash
+   sentinel: all become ONE linear post-pass sweep over the
+   streams (cache-sequential), building the public
+   leptris_attribute structs. The public API, DOM semantics, and
+   every consumer see IDENTICAL trees.
+
+## Slices (one PR each, CI-benchmark-gated)
+
+0. **A/B harness**: bench_parse_ab in benchmarks/ — the attr/text
+   shapes at 1.5/5/13MB, leptris vs pugixml vs libxml2, run by the
+   CI Benchmark legs on QUIET runners (the local Mac under load
+   343 produced 46-85 MB/s phantom numbers — measurements gate on
+   CI only). PR with this plan.
+1. **The dp_il lane skeleton** (flag off): streams + records +
+   post-pass building the public tree for well-formed, DTD-free
+   input. Gate: parity specs byte-identical to the current lane;
+   CI A/B numbers recorded.
+2. **Tokenizer port**: the SIMD scan helpers onto the stream
+   appends. Gate: attr shape ≤1.5x pugixml, text ≤1.25x on CI.
+3. **Feature coverage**: DTD/entity/namespace/CDATA/PI routes
+   through the lane (fall back to the classic lane per-feature,
+   never wrong). Gate: full ctest + html5lib-style parity for the
+   XML suite (W3C + libxml2 corpus green).
+4. **Default flip**: LEPTRIS_PARSE_INTERLEAVED=1 default, classic
+   lane behind an env escape hatch. Gate: all 24 CI legs + a
+   release cut with the CI A/B table in the notes.
+
+## Invariants (non-negotiable)
+
+- Public API/ABI unchanged; every existing spec passes unmodified.
+- The classic lane stays until slice 4 ships AND one full release
+  runs clean.
+- Zero-copy views remain primary; the pristine buffer is never
+  mutated by the interleaved lane.

data/vendor-src/libleptris/benchmarks/CMakeLists.txt

@@ -232,6 +232,19 @@ leptris_add_benchmark(bench_xslt_subtree_copy xslt/bench_subtree_copy.c utils.c)
 # ----------------------------------------------------------------------------
 leptris_add_benchmark(bench_iterparse   sax/bench_iterparse.c)
 
+# Interleaved-parse gate (#1222): leptris vs pugixml on identical
+# fixtures, run by the CI Benchmark legs (quiet runners).
+if(PUGIXML_AVAILABLE)
+    leptris_add_benchmark(bench_parse_ab CXX parse/bench_parse_ab.cpp)
+    target_compile_definitions(bench_parse_ab PRIVATE HAVE_PUGIXML=1)
+    if(PUGIXML_TARGET)
+        target_link_libraries(bench_parse_ab PRIVATE ${PUGIXML_TARGET})
+    else()
+        target_include_directories(bench_parse_ab PRIVATE ${PUGIXML_INCLUDE_DIR})
+        target_link_libraries(bench_parse_ab PRIVATE ${PUGIXML_LIBRARY})
+    endif()
+endif()
+
 # ----------------------------------------------------------------------------
 # SAX benchmarks (leptris vs libxml2).  TODO 101.
 # ----------------------------------------------------------------------------

data/vendor-src/libleptris/benchmarks/parse/bench_parse_ab.cpp

@@ -0,0 +1,83 @@
+/* bench_parse_ab.cpp — the interleaved-parse lane's gate (#1222).
+ *
+ * Same fixtures, sizes, and shapes for leptris and pugixml,
+ * best-of-5 each. The CI Benchmark legs run this on quiet
+ * runners; the interleaved lane's slices are gated on THESE
+ * numbers, never a loaded dev machine (2026-09-20: a Mac at load
+ * 340 measured a 472 MB/s build at 46-85).
+ */
+#include <stdio.h>
+#include <stdlib.h>
+#include <string.h>
+#include <time.h>
+#include "leptris.h"
+#ifdef HAVE_PUGIXML
+#include "pugixml.hpp"
+using namespace pugi;
+#endif
+
+static double now_us(void) {
+    struct timespec ts;
+    clock_gettime(CLOCK_MONOTONIC, &ts);
+    return ts.tv_sec * 1e6 + ts.tv_nsec / 1e3;
+}
+
+static size_t gen(char* out, size_t target, int text_shape) {
+    size_t len = 0;
+    len += (size_t)sprintf(out + len, "<root>");
+    int i = 0;
+    if (text_shape) {
+        while (len < target)
+            len += (size_t)sprintf(out + len,
+                "<p>The quick brown fox jumps over the lazy dog %d.</p>", i++);
+    } else {
+        while (len < target)
+            len += (size_t)sprintf(out + len,
+                "<item id=\"%d\" class=\"c%d\" state=\"on\" ref=\"%d\">v %d</item>",
+                i, i % 7, i * 3, i++);
+    }
+    len += (size_t)sprintf(out + len, "</root>");
+    return len;
+}
+
+int main(void) {
+    const size_t sizes[3] = {1500 * 1024, 5000 * 1024, 13000 * 1024};
+    const char* names[2] = {"attr", "text"};
+    printf("%-6s %9s %12s %12s\n", "shape", "bytes", "leptris", "pugixml");
+    for (int s = 0; s < 2; s++) {
+        for (size_t si = 0; si < 3; si++) {
+            char* doc = (char*)malloc(sizes[si] + 2048);
+            if (!doc) return 1;
+            size_t len = gen(doc, sizes[si], s);
+            double best = 1e18;
+            for (int r = 0; r < 5; r++) {
+                double a = now_us();
+                LeptrisStatus st = LEPTRIS_OK;
+                LeptrisDocument d = leptris_parse_string(doc, len, &st);
+                double b = now_us();
+                if (!d) { printf("PARSE FAILED\n"); return 1; }
+                leptris_document_free(d);
+                if (b - a < best) best = b - a;
+            }
+            double mbps = len / 1048576.0 / (best / 1e6);
+#ifdef HAVE_PUGIXML
+            double pbest = 1e18;
+            for (int r = 0; r < 5; r++) {
+                double a = now_us();
+                xml_document xdoc;
+                xml_parse_result res = xdoc.load_buffer(doc, len);
+                double b = now_us();
+                if (!res) { printf("PUGIXML FAILED: %s\n", res.description()); return 1; }
+                if (b - a < pbest) pbest = b - a;
+            }
+            double pmbps = len / 1048576.0 / (pbest / 1e6);
+            printf("%-6s %9zu %10.1f %10.1f  MB/s  (pugixml %.2fx)\n",
+                   names[s], len, mbps, pmbps, pmbps / mbps);
+#else
+            printf("%-6s %9zu %10.1f %10s\n", names[s], len, mbps, "-");
+#endif
+            free(doc);
+        }
+    }
+    return 0;
+}