yanagi 0.1.0

checksums.yaml

@@ -0,0 +1,7 @@
+---
+SHA256:
+  metadata.gz: 7d9c51329617c5af3c378c075b472bc750348149a804068ebe4fc83b70b43d43
+  data.tar.gz: a87fbe968fb608139db4c7cf4d59637fcb52d7e056f52b56d4ac4304798d34d2
+SHA512:
+  metadata.gz: 56b3ba1f958741308ad2ca52ac55a9965df0df4e101cd8f7af2e1725df4215f2f78081bc56608e7343593126eacd176e5f2b20515639802fd0123460217cf11f
+  data.tar.gz: 8b21ac53b568ab9a50fc71df6519cab2fcafbd945e4f40406d644b6632b1c99c10e779badbab953260bb16268e7c7eaad91641c4f1d6687764560047b0918408

data/CHANGELOG.md

@@ -0,0 +1,50 @@
+# Changelog
+
+All notable changes to this project are documented here.
+
+The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/),
+and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
+
+## [0.1.0] — 2026-08-29
+
+First release. Yanagi (柳) turns the Japanese→Ukrainian transliteration policy
+from prose into executable rules, so a violation fails a build instead of
+reaching print.
+
+### Added
+
+- **Mode A — generation.** `Yanagi.cyrillic` and `Yanagi.romaji` render kana
+  (or katakana, or a kanji + reading pair) into Ukrainian Cyrillic and Modified
+  Hepburn. Both derive from a single mora tokenizer, so they cannot disagree
+  about mora boundaries.
+- **Mode B — audit.** `Yanagi::Audit` scans existing Ukrainian prose in three
+  tiers. Only tokens anchored to a known Japanese lexical item are ever
+  rewritten; pattern matches merely rank what a human reviews. Findings are
+  reported by default and applied only from an approved findings file.
+- **`Yanagi::DocSync`.** Parses the authoritative policy document and asserts it
+  agrees with the rules data, so the doc and the engine cannot drift.
+- **CLI** (`yanagi`): `romaji`, `cyrillic`, `audit`, `apply`, `doc-sync`,
+  `lexicon`, `verify-gold`.
+- **Rules as data** in `data/`: the mora table with its forbidden variants,
+  combinatorial rules, exonyms, the lexicon, a native-Ukrainian allowlist, and
+  an exceptions table.
+
+### Policy encoded
+
+- Mora table rejecting Polivanov: ші, чі, цу, фу, джі, дз, ґ.
+- Palatalised syllables (yōon), including the soft sign before о: шьо, чьо, джьо.
+- い after a vowel renders as «і», never «ї».
+- ん renders as «м» before п and б, «н» elsewhere.
+- Long vowels are not doubled.
+- Sokuon っ doubles the following consonant before the plosives п and к, and is
+  not rendered before sibilants and affricates.
+- Established Ukrainian exonyms take precedence over derivation.
+
+### Verification
+
+- 377/377 hand-verified glossary pairs pass, with an empty exceptions table.
+- Romaji output is byte-identical across 1496 dictionary readings, confirming
+  the engine was extracted from its predecessor without behaviour change.
+- Zero runtime dependencies; stdlib only.
+
+[0.1.0]: https://github.com/shogi-dojo/yanagi/releases/tag/v0.1.0

data/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 shogi-dojo
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

data/README.md

@@ -0,0 +1,119 @@
+# Yanagi (柳)
+
+Deterministic Japanese → Ukrainian transliteration and policy enforcement gem.
+
+柳 (*yanagi* = willow / верба) — a symbol of Ukraine and a tree equally at home in Japanese poetry.
+
+## Features
+- **Zero runtime dependencies** — standard library only (`yaml`, `json`, `set`, `unicode_normalize`).
+- **Mode A (Generation)**: Deterministic kana and romaji to Ukrainian Cyrillic rendering.
+- **Mode B (Audit)**: Lexicon-anchored prose audit and policy violation detector:
+  - **Tier 1**: AUTOFIX-eligible (matches lexicon entry via forbidden Polivanov/anglicism substitution).
+  - **Tier 2**: High-confidence report for unknown Japanese terms (contains JP markers, unanchored in lexicon/allowlist).
+  - **Tier 3**: Polivanov markers check (off by default).
+- **Policy Synchronization (`DocSync`)**: Asserts agreement between markdown policy documents (`shared/transliteration.md`) and executable YAML rules.
+
+## Corpus data
+
+The gem ships the **policy rules** only: the mora table, combinatorial rules,
+exonyms and the exceptions table.
+
+Mode B additionally needs two files generated from a specific translation
+project — a lexicon of known Japanese terms and an allowlist of native
+Ukrainian vocabulary. These are **not distributed**, because they are one
+project's editorial research rather than transliteration policy.
+
+Mode A (`cyrillic`, `romaji`) needs neither and works out of the box. Without
+them Mode B simply reports nothing, since it only ever rewrites tokens anchored
+to a known lexical item.
+
+To use Mode B, generate the files and point the gem at them:
+
+```bash
+export YANAGI_DATA_DIR=/path/to/your/data
+yanagi lexicon build --glossary /path/to/glossary.org
+```
+
+
+## Installation
+
+Add this line to your application's Gemfile:
+
+```ruby
+gem 'yanagi'
+```
+
+Or reference via git repository:
+
+```ruby
+gem 'yanagi', git: 'https://github.com/shogi-dojo/yanagi.git', tag: 'v0.1.0'
+```
+
+## Ruby API Usage
+
+### Mode A: Transliteration
+
+```ruby
+require 'yanagi'
+
+# Kana to Cyrillic
+Yanagi.cyrillic("しゅうさい")
+# => #<Yanagi::Result text="шюсай" source=:derived confidence=1.0>
+
+Yanagi.cyrillic("シュウサイ")
+# => #<Yanagi::Result text="шюсай" source=:derived confidence=1.0>
+
+# Exonyms
+Yanagi.cyrillic("とうきょう")
+# => #<Yanagi::Result text="Токіо" source=:exonym confidence=1.0>
+
+# Kana to Modified Hepburn Romaji
+Yanagi.romaji("しゅうさい")
+# => "shuusai"
+
+# From Romaji to Cyrillic
+Yanagi.from_romaji("shuusai")
+# => "шюсай"
+```
+
+### Mode B: Prose Audit & Correction
+
+```ruby
+# Scan files or directories
+findings = Yanagi.audit(["path/to/chapter.org"], tier2: true, tier3: false)
+
+# Apply approved findings
+Yanagi::Audit.apply("audit/findings.yml")
+```
+
+### Policy Agreement Check
+
+```ruby
+sync = Yanagi.doc_sync(path: "shared/transliteration.md")
+sync.synced? # => true
+sync.diff    # => []
+```
+
+## CLI Usage
+
+```bash
+# Romaji & Cyrillic generation
+yanagi romaji しゅうさい
+yanagi cyrillic しゅうさい
+yanagi cyrillic しゅうさい --format json
+
+# Prose auditing
+yanagi audit books/meijin/translation/ua --format human
+yanagi audit books/meijin/translation/ua --out audit/findings.yml
+
+# Applying approved findings
+yanagi apply audit/findings.yml
+
+# Document synchronization & gold verification
+yanagi doc-sync shared/transliteration.md
+yanagi verify-gold
+```
+
+## License
+
+MIT License. Copyright (c) 2026 shogi-dojo.

data/data/combinatorial.yml

@@ -0,0 +1,59 @@
+# Combinatorial and contextual transliteration rules
+---
+sokuon:
+  rule: "っ (sokuon) doubles the following consonant before the plosives «п» and «к»; before sibilants and affricates it is not rendered"
+  geminating: ["п", "к"]
+  examples:
+    - { kana: "いっぺき", rendered: "іппекі" }
+    - { kana: "けっぺき", rendered: "кеппекі" }
+    - { kana: "ごじゅっぽ", rendered: "ґоджюппо" }
+    - { kana: "にっかい", rendered: "Ніккай" }
+    - { kana: "ほっけきょう", rendered: "Хоккекьо" }
+    - { kana: "がっかい", rendered: "Ґаккай" }
+    - { kana: "しっちゃく", rendered: "шічяку" }
+    - { kana: "てっしゅう", rendered: "Тешю" }
+    - { kana: "どうじんざっし", rendered: "доджін-дзаші" }
+
+moraic_n:
+  rule: "ん before labials (p, b) renders as 'м', and as 'н' elsewhere (including before m)"
+  labials: ["п", "б"]
+  default: "н"
+  examples:
+    - { kana: "もんぷく", rendered: "момпуку" }
+    - { kana: "さんぼう", rendered: "самбо" }
+    - { kana: "しんぶん", rendered: "шімбун" }
+    - { kana: "さんまいきょう", rendered: "санмайкьо" }
+    - { kana: "らんま", rendered: "ранма" }
+    - { kana: "しんしゅう", rendered: "шіншю" }
+
+i_after_vowel:
+  rule: "い (i) after any vowel within a Japanese stem renders as 'і', never 'ї'"
+  target: "і"
+  forbidden: "ї"
+  examples:
+    - { kana: "かるいざわ", rendered: "каруідзава" }
+    - { kana: "ごい", rendered: "ґоі" }
+    - { kana: "きいん", rendered: "кіін" }
+    - { kana: "ぬいもん", rendered: "нуімон" }
+    - { kana: "おてあい", rendered: "отеай" }
+
+apostrophe_i:
+  rule: "After apostrophe in Japanese names/words, write 'і', not 'ї'"
+  target: "і"
+  forbidden: "ї"
+  examples:
+    - { romaji: "Jun'ichi", rendered: "Джюн'ічі" }
+    - { romaji: "Kan'ichi", rendered: "Кан'ічі" }
+
+long_vowels:
+  rule: "Never double 'о'; double 'і' where morae genuinely collide; collapse long vowels always"
+  collapse: true
+  preserve_adjacent_i: true
+  examples:
+    - { kana: "おおさか", rendered: "осака" }
+    - { kana: "おおたけ", rendered: "отаке" }
+    - { kana: "おおしま", rendered: "ошіма" }
+    - { kana: "しゅうさい", rendered: "шюсай" }
+    - { kana: "きいん", rendered: "кіін" }
+    - { kana: "いいだ", rendered: "ііда" }
+    - { kana: "りいち", rendered: "ріічі" }

data/data/exceptions.yml

@@ -0,0 +1,15 @@
+# Exceptions table for underivable pairs and documented defects.
+#
+# status:
+#   accepted - a genuine, permanent exception to the regular rules
+#   pending  - a data defect awaiting correction; FAILS `yanagi verify-gold`
+#   wontfix  - an intentional divergence, deliberately not corrected
+#
+# A `pending` entry is a build failure by design, so unresolved defects stay
+# visible instead of silently accumulating. Correct the source data, or
+# reclassify the entry with a written reason.
+#
+# The 12 original entries (8 long-vowel `оо` violations plus 4 yōon/digraph
+# defects) were corrected in books/meijin/glossary.org rather than excepted.
+---
+[]

data/data/exonyms.yml

@@ -0,0 +1,14 @@
+# Established Ukrainian exonyms (pre-empt regular phonetic transliteration)
+---
+とうきょう:
+  romaji: "tokyo"
+  cyrillic: "Токіо"
+  note: "Standard Ukrainian geographical exonym"
+きょうと:
+  romaji: "kyoto"
+  cyrillic: "Кіото"
+  note: "Standard Ukrainian geographical exonym (pre-empts きょ -> кьо rule)"
+おおさか:
+  romaji: "osaka"
+  cyrillic: "Осака"
+  note: "Standard Ukrainian geographical exonym"