arrolio 0.1.5 → 0.1.7

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: edfcfe9ff191c034c3702c111c0ac2a023d4290966f594be72b018940998584a
-  data.tar.gz: a724d7703f6893aea53756e0141bd43ab416809381c75ba61b434e57f07f47cf
+  metadata.gz: 6d2fb34e355fe255920ca92e339c7c2529db69b9668130d2f5c9f36319f2aa13
+  data.tar.gz: a591ae1001ae525c96d19a7321eee6840a105e3d9e6404a5b2a2454e68bd7b46
 SHA512:
-  metadata.gz: f2214e2fc97366287645096f3b2969caa1c879204039bc5cce2018171739e8a95a3c8753127c167faa377b8e0c8a5894687ad2ff99f5f289c0c97fd0d2af44bd
-  data.tar.gz: ddedc8d9ddc9449a582a781d8741b829f3d90268d6a1b55eea430c54e58781ce586996f3b1a041b26aab0ce25c2654092a542e8ead2aa6a080f933d7d8c5db12
+  metadata.gz: 3587a3bf6d2bebc2d66b4f990bccc365f8508a08ee75d191636c737a5d4c6eb31ff1cd8069175e010a40a38f17d2b98a8c788da3bb164dbb182aa632eb85fd99
+  data.tar.gz: deed9c49dc8e31bc26854c8dcb92b4f46214318da53a067786bdc1ac86329e6403d53bce132826a314b7e6876d28c51bd45ce6089ad8eb1d07eb61d0fb92e0b2

data/CLAUDE.md

@@ -53,16 +53,17 @@ PDF bytes (via Pdfrb)
 
 Each layer is independently testable. Keep layer boundaries airtight: Content knows nothing about pages or PDF; Engine knows nothing about PDF bytes; Renderer knows nothing about layout algorithms.
 
-## Project state (as of 2026-08-03)
+## Project state (as of 2026-09-01)
 
-Generic config-driven pipeline works end-to-end: the OIML r060/1 fixture renders to a 25-page A4 PDF (~194 KB) via `Arroolio::ConfigDrivenPipeline` pointed at `flavors/oiml/`. 232 specs pass.
+The generic config-driven pipeline renders the OIML r060/1 fixture to a 28-page A4 PDF matching the mn2pdf v2.55 reference at **68.92% text parity, 28/28 pages** (`bundle exec rake parity:check`). 452 specs, 0 rubocop offenses, 214 files.
 
 What's in the gem (core, flavor-agnostic):
 - `lib/arrolio/{content,style,layout_spec,font,font_metrics,glyph_measurer,inline_run,text_layout,flowable,flowables,frame,flow_context,engine,output,renderer,harness,flavor}/`
-- `lib/arrolio/generic_adapter.rb` — reads `adapter_rules.yml`, parses any flavor's XML into `Content::Document`.
-- `lib/arrolio/generic_flow_builder.rb` — reads `flow_rules.yml`, builds flowables for any flavor.
-- `lib/arrolio/config_driven_pipeline.rb` — orchestrates adapter + flow builder + engine + renderer + ToC.
-- `lib/arrolio/asset_resolver.rb`, `lib/arrolio/toc_builder.rb` — generic helpers.
+- `lib/arroolio/generic_adapter.rb` — dispatch + document glue; per-concern conversion lives in included seams under `lib/arroolio/generic_adapter/` (FootnoteExtraction, TableConversion, InlineRunCollection, HeadingExtraction, ListConversion, MetadataExtraction, DocumentExtraction). Adding an element family = a module + one include.
+- `lib/arroolio/generic_flow_builder.rb` — `build()` + dispatch; per-family emission seams under `lib/arroolio/generic_flow_builder/` (Sequences, Terms, Notes, Figures, Lists, Bibliography, Tables).
+- `lib/arroolio/config_driven_pipeline.rb` — orchestrates adapter + flow builder + engine + renderer + ToC; resolves fonts via fontist (`FontScanner`).
+- `lib/arroolio/renderer/pdf.rb` — page emission; Pdfrb coupling points in `lib/arroolio/renderer/pdf/` (FontEmbedding, Assets, Metadata). The renderer never measures glyph widths — `Line::PlacedRun` carries `chunk_widths` from the breakers.
+- `lib/arroolio/asset_resolver.rb`, `lib/arroolio/toc_builder.rb` — generic helpers (both with direct specs).
 - `exe/arrolio2pdf` — generic CLI taking a flavor directory argument.
 - `scripts/xsl_to_config.rb` — generates all three flavor YAML files from an XSL stylesheet.
 - `data/arrolio/` — AFM metrics + glyphlist for the 14 PDF standard fonts (core data, not flavor data).
@@ -71,18 +72,13 @@ What's outside the gem (flavor artifacts):
 - `flavors/oiml/{layout_spec,adapter_rules,flow_rules}.yml` — generated by `xsl_to_config.rb` from the authoritative XSL at `~/src/mn/metanorma-taste/data/oiml/oiml.xsl`.
 - `spec/fixtures/flavors/sample/` — synthetic flavor-neutral fixture for the gem's tests.
 
-What's deferred (intentionally — see `TODO.complete/`):
-- TODO 53: second flavor spike (proves the generic design works beyond OIML).
-- TODO 54: `flavors/<name>/manifest.yml` contract.
-- TODO 55: header/footer style in `layout_spec.yml` (currently hardcoded in renderer).
-- TODO 56: split `GenericAdapter` into MECE per-element converters.
-- TODO 57: strict `Content::Document#sections` typing (only `Section[]`).
-- TODO 58: flavor packaging convention (`arrolio-<flavor>` gems).
-- TODO 59: XSL converter profiles (metanorma, dita, docbook).
-- TODO 60: footnote / note-hanging-indent / example-body-margin fidelity.
-- TODO 61: typed error model + strict mode.
-- TODO 62: font resolution via fontist (currently absolute paths in YAML).
-- Plus the older TODO.implementation items (Knuth-Plass, PageSequenceMaster, table layout, etc.).
+What's open (intentionally — see `TODO.complete/`, frontmatter `status:` is authoritative):
+- TODO 87: odd/even page templates beyond header parity (headers mirror; templates don't).
+- TODO 88: hyphenation support.
+- TODO 90: MathML mfrac true stacking (the open piece).
+- TODO 93: figure text searchability (figures render as images; the reference's figure text extracts).
+- TODO 96: pagination drift parity — the master ledger: remaining region deficits, keep-rules negative results (the reference does NOT enforce widows; term entries are NOT atomic), the heading-gap coupled-landing recipe, and the C2 margin-unification decode (a dedicated re-tuning session, not a release-day change).
+- TODOs 53-62 are DONE (second flavor spike, manifest contract, header/footer config, adapter MECE, strict typing, packaging docs, XSL profiles, footnote fidelity, typed errors, fontist).
 
 The TODO files in `TODO.complete/` and `TODO.implementation/` are the roadmap. `TODO.complete/README.md` covers the parity roadmap; `TODO.implementation/README.md` covers the foundation phase plan.
 
@@ -137,8 +133,9 @@ When extending any layer, apply OCP/DRY/MECE strictly:
 ## Renderer/Pdfrb coupling notes
 
 - `Renderer::Pdf#render_page` deliberately points each pdfrb page's `Resources` Hash at the catalog's. Pdfrb's `Fonts#add` attaches fonts to the *catalog* Resources, but each Page shadows with its own empty Hash — without this workaround, fonts are invisible to readers.
-- `Renderer::FontRegistry` memoises font family name → Pdfrb resource Symbol per render pass. Falls back to Helvetica for unknown families so the render never crashes mid-document. TODO 62 makes this strict.
-- TODO 55 moves the header/footer visual style (Arial 9pt + 0.5pt border, currently hardcoded in the renderer) into `layout_spec.yml` so each flavor controls its own header/footer look.
+- Margin contract (see `Flowable`'s doc): TextFlowable (and HeadingFlowable) count `space_before/after` inside height/emit; List/Image/Table-based flowables do not — spacing around them travels as explicit Spacers. The engine collapses via `Engine::MarginCollapse`; do NOT unify without a dedicated re-tuning session (decoded in TODO 96).
+- Header/footer styling comes from `layout_spec.yml` (`header_footer:` block); font resolution goes through fontist (`FontScanner`) with AFM fallback for the 14 standard fonts.
+- Parity workflow: `bundle exec rake parity:check` / `parity:diff PAGE=N`; drift-map tooling and diagnostic cautions live in TODO 96.
 
 ## Key files to read first
 

data/TODO.complete/README.md

@@ -1,11 +1,13 @@
 # TODO.complete — Path to 100% mn2pdf parity
 
-## Current baseline (2026-08-09)
+## Current baseline (2026-09-01)
 
-`bundle exec rake parity:check` reports **62.7%** overall similarity
-on the OIML r060/1 fixture, **28 pages vs 28 reference** (all pages PARTIAL+).
+`bundle exec rake parity:check` reports **68.92%** overall similarity
+on the OIML r060/1 fixture, **28 pages vs 28 reference**.
 
-376 specs pass, 0 failures, 0 rubocop offenses across 174 files.
+452 specs pass, 0 failures, 0 rubocop offenses across 214 files.
+TODO 96 is the live ledger (region deficits, keep-rule negative
+results, the C2 margin decode).
 
 ## Status snapshot
 

data/lib/arrolio/flowables/table_flowable.rb

@@ -99,20 +99,15 @@ module Arrolio
         header, body = partition_rows
         header_count = header.length
 
-        head_groups = []
-        tail_groups = []
         # The head part also carries the caption and the repeated
         # header rows — they consume the same budget as body rows.
-        used = caption_height(width) + heights[0, header_count].sum
-        body_row_groups.each do |group|
-          group_h = heights[group.first, group.length].sum
-          if used + group_h <= remaining_height
-            head_groups << group
-            used += group_h
-          else
-            tail_groups << group
-          end
-        end
+        budget = remaining_height - caption_height(width) -
+                 heights[0, header_count].sum
+        result = Table::SplitPolicy.new(groups: body_row_groups,
+                                        group_heights: heights,
+                                        budget: budget).call
+        head_groups = result.head_groups
+        tail_groups = result.tail_groups
 
         head_rows = head_groups.flat_map { |g| body[g.first - header_count, g.length] }
         tail_rows = tail_groups.flat_map { |g| body[g.first - header_count, g.length] }

data/lib/arrolio/harness/text_extractor.rb

@@ -51,7 +51,11 @@ module Arrolio
       def split_by_page(text)
         return [text] unless text.include?("\f")
 
-        text.split("\f", -1)
+        pages = text.split("\f", -1)
+        # pdftotext ends output with a trailing form-feed for some
+        # writers; the empty string after it is not a page.
+        pages.pop if pages.last.to_s.strip.empty? && pages.length > 1
+        pages
       end
     end
   end

data/lib/arrolio/table/split_policy.rb

@@ -0,0 +1,52 @@
+# frozen_string_literal: true
+
+module Arrolio
+  module Table
+    # Pure table-split decision: which welded row groups fit the
+    # page budget. The budget is the remaining page height minus
+    # what travels with every part (the caption and the repeated
+    # header rows). Groups are greedily packed while they fit; an
+    # empty head means whole-move (the engine moves the entire
+    # table to the next page).
+    class SplitPolicy
+      Result = Struct.new(:head_groups, :tail_groups, keyword_init: true) do
+        def whole_move?
+          head_groups.empty?
+        end
+      end
+
+      # +groups+ Array of Arrays of row indexes (welded by rowspan).
+      # +group_heights+ parallel Array of Float heights per group.
+      # +budget+ Float height available for body groups.
+      def initialize(groups:, group_heights:, budget:)
+        @groups = groups
+        @group_heights = group_heights
+        @budget = budget.to_f
+      end
+
+      # Rows split IN ORDER: once a group does not fit, every
+      # later group goes to the tail (a fitting later group must
+      # never jump ahead of an overflowing earlier one - the
+      # original greedy loop allowed exactly that reordering).
+      def call
+        head = []
+        tail = []
+        used = 0.0
+        overflowing = false
+        @groups.each do |group|
+          height = group_height_for(group)
+          overflowing ||= used + height > @budget
+          (overflowing ? tail : head) << group
+          used += height unless overflowing
+        end
+        Result.new(head_groups: head, tail_groups: tail)
+      end
+
+      private
+
+      def group_height_for(group)
+        @group_heights[group.first, group.length].sum
+      end
+    end
+  end
+end

data/lib/arrolio/table.rb

@@ -6,5 +6,6 @@ module Arrolio
   module Table
     autoload :AutoLayout, 'arrolio/table/auto_layout'
     autoload :Grid, 'arrolio/table/grid'
+    autoload :SplitPolicy, 'arrolio/table/split_policy'
   end
 end

data/lib/arrolio/version.rb

@@ -1,5 +1,5 @@
 # frozen_string_literal: true
 
 module Arrolio
-  VERSION = '0.1.5'
+  VERSION = '0.1.7'
 end

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: arrolio
 version: !ruby/object:Gem::Version
-  version: 0.1.5
+  version: 0.1.7
 platform: ruby
 authors:
 - Ribose Inc.
 autorequire:
 bindir: exe
 cert_chain: []
-date: 2026-08-31 00:00:00.000000000 Z
+date: 2026-09-02 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: fontisan
@@ -432,6 +432,7 @@ files:
 - lib/arrolio/table.rb
 - lib/arrolio/table/auto_layout.rb
 - lib/arrolio/table/grid.rb
+- lib/arrolio/table/split_policy.rb
 - lib/arrolio/text_direction.rb
 - lib/arrolio/text_layout.rb
 - lib/arrolio/text_layout/break_opportunity.rb