interscript 0.1.0 → 0.1.5

data/maps/un-mon-Mong-Latn-2013.yaml

@@ -0,0 +1,93 @@
+---
+authority_id: un
+id: 2013
+language: mon
+source_script: Mong
+destination_script: Latn
+name: Mongolian Romanization in China, Version 4.0
+url: http://www.eki.ee/wgrs/rom1_mnc.htm
+creation_date: 2013-09
+description: |
+  The United Nations resolution III/8 in 1977 recognized the Scheme for
+  a Chinese Phonetic Alphabet (Pinyin) as China’s official Roman alphabet
+  scheme and recommended the alphabet as the international system for the
+  romanization of Chinese geographical names. In China Mongolian
+  geographical names are transcribed directly from the Mongolian script
+  into Pinyin. The scheme was published in Toponymic Guidelines for Map
+  and Other Editors: China, 19821.
+
+  The system is used in China and in international cartographic
+  products.
+
+  Mongolian uses a vertical script. Transcription of Mongolian names is
+  made from their proper pronunciation based on the written form of the
+  Mongolian language and Qahar vernacular, with Zhenglan as its
+  representative pronunciation. Due to the complex nature of the script
+  the romanization scheme is not reversible, e.g. the name of the city
+  Hohhot is written ᠬᠥᠬᠡᠬᠣᠲᠠ but may be transliterated as kökeqota.
+
+notes:
+  - The long and short Mongolian vowels are not distinguished in the
+    spelling for general use, but in recording the pronunciation of
+    place-names, the long vowel is represented by duplication.
+  - Where two Roman equivalents are given, the second (in brackets) is
+    used for recording the pronunciation of place-names while the first
+    form is for general use.
+  - In the table only word-initial character variants are shown.
+    Depending on the position in the word many variants of the characters
+    are used as well as some ligatures. These features are not covered here.
+  - For technical reasons the characters of the Mongolian script are
+    turned 90˚ anti-clockwise.
+
+tests:
+  - source: "ᠬᠥᠬᠡᠬᠣᠲᠠ"
+    expected: "kökeqota"
+map:
+  characters:
+    "ᠠ": "a"
+    "ᠪ": "b"
+    "ᠼ": "c"
+    "ᠲ": "d"
+    "ᠳ": "d"
+    "ᠡ": "e"
+    "ᠹ": "f"
+    "ᠭ": "g"
+    "ᠺ": "g"
+    "ᠬ": "h"
+    "ᠾ": "h"
+    "ᠢ": "i"
+    "ᠵ": "j"
+    "ᠺ": "k"
+    "ᠯ": "l"
+    "ᠮ": "m"
+    "ᠨ": "n"
+    "ᠥ": "o"
+    "ᠫ": "p"
+    "ᠴ": "q"
+    "ᠷ": "r"
+    "ᠰ": "s"
+    "ᠲ": "t"
+    "ᠦ": "u"
+    "ᠸ": "w"
+    "ᠱ": "x"
+    "ᠶ": "y"
+    "ᠽ": "z"
+    "ᠣ": "o"
+      # - "o" # General use
+      # - "ô" # For place names
+    "ᠤ": "u"
+      # - "u" # General use
+      # - "û" # For place names
+
+
+    # @TODO Exceptional
+    #
+    # This is failing the whole test suite, but as far as I understood
+    # from the comment, this city name is exceptional, so we are temporarliy
+    # adding it as execeptional rules for now.
+    #
+    # But, we will need some natives attension to help us out here, and maybe
+    # come up with some basic rules for this exceptional pattern.
+    #
+
+    "ᠬᠥᠬᠡᠬᠣᠲᠠ": "kökeqota"

data/maps/un-rus-Cyrl-Latn-1987.yaml

@@ -0,0 +1,166 @@
+---
+authority_id: ungegn
+id: 1987
+language: rus
+source_script: Cyrl
+destination_script: Latn
+name: REPORT ON THE CURRENT STATUS OF UNITED NATIONS ROMANIZATION SYSTEMS FOR GEOGRAPHICAL NAMES -- Russian Romanization system
+url: http://www.eki.ee/wgrs/rom1_ru.htm
+creation_date: 1987
+confirmation_date: 2016
+description: |
+  The United Nations recommended system was approved in 1987 (V/18),
+  based on the official system of the Main Administration of Geodesy and
+  Cartography of the former Soviet Union, also known as the GOST 1983
+  system (GOST 16876-71). The table was published as an annex to the
+  resolution.
+
+  The system is used in the Russian Federation and increasingly in
+  international cartographic products.
+
+  Russian uses the Cyrillic script which is alphabetic. The
+  romanization table is unambiguous and can be applied automatically. The
+  system is reversible, although rarely there can be ambiguities.
+
+notes:
+  - "Cursive forms of some characters might be formed differently: Аа Бб
+    Вв Гг Дд Ее Ёё Жж Зз Ии Йй Кк Лл Мм Нн Оо Пп Рр Сс Тт Уу Фф Хх Цц Чч Шш
+    Щщ Ъъ Ыы Ьь Ээ Юю Яя."
+
+  - Fifth United Nations Conference on the Standardization of
+    Geographical Names. Montreal, 18–31 August 1987. Vol. I. Report of the
+    Conference, pp. 40–41.
+
+tests:
+  - source: Aнaпa
+    expected: Anapa
+
+  - source: Бaбушкин
+    expected: Babuškin
+
+  - source: Вaвилово
+    expected: Vavilovo
+
+  - source: Гaгaрин
+    expected: Gagarin
+
+  - source: Дудинкa
+    expected: Dudinka
+
+  - source: Елисeeвкa
+    expected: Eliseevka
+
+  - source: Ёлкино
+    expected: "\u00CBlkino"
+
+  - source: Псëл
+    expected: Psël
+
+  - source: Жужa
+    expected: Žuža
+
+  - source: Звëздный
+    expected: Zvëzdnyj
+
+  - source: Идрицa
+    expected: Idrica
+
+  - source: Зaрaйск
+    expected: Zarajsk
+
+  - source: Кокaнд
+    expected: Kokand
+
+  - source: Лaлвaр
+    expected: Lalvar
+
+  - source: Мaймaк
+    expected: Majmak
+
+  - source: Нeжин
+    expected: Nežin
+
+  - source: Обoдoвкa
+    expected: Obodovka
+
+  - source: Пaп
+    expected: Pap
+
+  - source: Рeбрихa
+    expected: Rebriha
+
+  - source: Сaсoвo
+    expected: Sasovo
+
+  - source: Тaттa
+    expected: Tatta
+
+  - source: Уржум
+    expected: Uržum
+
+  - source: Фoфaнoвo
+    expected: Fofanovo
+
+  - source: Хoхломa
+    expected: Hohloma
+
+  - source: Цвeткoвo
+    expected: Cvetkovo
+
+  - source: Чeчeльник
+    expected: Čečel’nik
+
+  - source: Шишкинo
+    expected: Šiškino
+
+  - source: Щукинo
+    expected: Ščukino
+
+  - source: Пoдъячeвo
+    expected: Pod”jačevo
+
+  - source: Ыныкчaнский
+    expected: Ynykčanskij
+
+  - source: Пaрaньгa
+    expected: Paran’ga
+
+  - source: Кaзaнь
+    expected: Kazan’
+
+  - source: Щучьe
+    expected: Ščuč’e
+
+  - source: Элистa
+    expected: Èlista
+
+  - source: Юринo
+    expected: Jurino
+
+  - source: Юхнoв
+    expected: Juhnov
+
+  - source: Юрюзaнь
+    expected: Jurjuzan’
+
+  - source: Ямaл
+    expected: Jamal
+
+  - source: Язъявaн
+    expected: Jaz”javan
+
+  - source: Яя
+    expected: Jaja
+
+  - source: Вязьмa
+    expected: Vjaz’ma
+
+
+map:
+  inherit: gost-rus-cyrl-latn-16876-71-1983
+
+  characters:
+    '\u042A' : '”'  # Ъ
+    '\u042C' : '’'  # Ь
+    '\u044A' : '”'  # ъ
+    '\u044C' : '’'  # ь

data/maps/un-ukr-cyrl-latn-1998.yaml

@@ -0,0 +1,30 @@
+---
+authority_id: un
+id: 1998
+language: ukr
+source_script: Cyrl
+destination_script: Latn
+name: ROMANIZATION SYSTEM FOR BELARUSIAN, RUSSIAN AND UKRAINIAN CYRILLIC
+url: https://unstats.un.org/unsd/geoinfo/UNGEGN/docs/7th-uncsgn-docs/econf/7th_UNCSGN_econf.91_3_Add1.pdf
+creation_date: 1998
+
+tests:
+
+map:
+  inherit: gost-rus-cyrl-latn-16876-71-1983
+
+  characters:
+    '\u0490' : '?'  # Ґ
+    '\u0491' : '?'  # ґ
+
+    '\u0404' : "Je" # Є
+    '\u0454' : "je" # є
+
+    '\u0406' : 'I'  # І
+    '\u0456' : 'i'  # і
+
+    '\u0407' : 'I'  # Ї
+    '\u0457' : 'i'  # ї
+
+    '\u2019' : '?'
+    "'" : '?'

data/maps/var-jpn-Hrkt-Latn-hepburn-1886.yaml

@@ -0,0 +1,406 @@
+---
+authority_id: var
+id: hepburn-1886
+language: jpn
+source_script: Hrkt
+destination_script: Latn
+name: Traditional Hepburn
+url: http://www.ab.cyberhome.ne.jp/~kaizu/roomazi/doc/hep3.html
+creation_date: 1886
+adoption_date:
+description:
+    This is a traditional version of Hepburn romanization.
+
+notes:
+    "
+    The book was published before the Japanese orthographic reform,
+    and this map takes the reformed orthography in Kana as the source
+    form.
+    https://en.wikipedia.org/wiki/Historical_kana_orthography
+
+    The distinction for long-vowel vs. repeating vowels has not been
+    implemented.
+    For example, the consecutive o's in these words are considered
+    a case of long vowel, and is transliterated as ō:
+
+        氷 (こおり) - kōri, 大阪（おおさか）- Ōsaka
+
+    If there are two consecutive o's in a string, but they belong to
+    different morpheme, then they should be transliterated separately.
+
+        小躍り（こおどり）- koodori
+
+    The same goes for the combinations o+u, u+u as well.
+
+    However, this cannot be easily determined from the Kana.
+    Lexical knowledge is needed, and sometimes the Kanji representation
+    will give more hints about morpheme boundary.
+
+    For now, this map will assume that all o+o, o+u, u+u combinations to
+    be instances of long vowels.
+    "
+
+tests:
+  - source: "ぐんま"
+    expected: "gumma"
+  - source: "しんよう"
+    expected: "shin-yō"
+  - source: "きんようび"
+    expected: "kin-yōbi"
+  - source: "とうきょう"
+    expected: "tōkyō"
+  - source: "しんばし"
+    expected: "shimbashi"
+
+map:
+
+  rules:
+    # Add a dash (-) between ん and a vowel sound or ya, yu, yo
+    - pattern: "([んン])(?=[あいうえおやゆよアイウエオヤユヨ])"
+      result: "\\1-"
+
+    # Convert ん into m before b, m, p
+    - pattern: "[んン](?=[ばびぶべぼまみむめもぱぴぷぺぽバビブベボマミムメモパピプペポ])"
+      result: "m"
+
+  postrules:
+    # Handling of っ/ッ
+    #
+    # The kana っ/ッ is a geminate marker.
+    # When followed by a consonant, repeat the first letter of
+    # the following syllable. Exception: the combination -cch-
+    # should be transliterated as -tch-
+    #
+    # If っ/ッ is not followed by a consonant, then it is usually
+    # phonetically realised as an abrupt stop or shorterning of
+    # the previous syllable. There is no documented or commonly
+    # accepted way to transliterate this sound.
+
+    - pattern: "[っッ]([BbDdFfGgHhJjKkLlMmNnPpQqRrSsTtVvWwXxYyZz])"
+      result: "\\1\\1"
+    - pattern: "[っッ]([Cc])" # ッ followed by ch-
+      result: "t\\1"
+    - pattern: "[っッ]" # drop all other っッ.
+      result: ""
+
+    # In Traditional Hepburn, long o (which can be o+o or o+u), and long u
+    # are transliterated as ō and ū.
+    #
+    # Macron should not be used if two repeating letters split across
+    # a morpheme boundary.
+    #
+    # Long vowels in loanwords are indicated with a macron instead
+    # of letter doubling.
+
+    - pattern: "a[ー]"
+      result: "ā"
+    - pattern: "i[ー]"
+      result: "ī"
+    - pattern: "u[ーu]"
+      result: "ū"
+    - pattern: "e[ー]"
+      result: "ē"
+    - pattern: "o[ーo]"
+      result: "ō"
+
+  characters:
+
+    # Hiragana
+
+    "あ": "a"
+    "い": "i"
+    "う": "u"
+    "え": "e"
+    "お": "o"
+    "おう": "ō"
+
+    "か": "ka"
+    "き": "ki"
+    "く": "ku"
+    "け": "ke"
+    "こ": "ko"
+    "きゃ": "kya"
+    "きゅ": "kyu"
+    "きょ": "kyo"
+    "きょう": "kyō"
+    "こう": "kō"
+
+    "さ": "sa"
+    "し": "shi"
+    "す": "su"
+    "せ": "se"
+    "そ": "so"
+    "しゃ": "sha"
+    "しゅ": "shu"
+    "しょ": "sho"
+    "しょう": "shō"
+    "そう": "sō"
+
+    "た": "ta"
+    "ち": "chi"
+    "つ": "tsu"
+    "て": "te"
+    "と": "to"
+    "ちゃ": "cha"
+    "ちゅ": "chu"
+    "ちょ": "cho"
+    "とう": "tō"
+    "ちょう": "chō"
+
+    "な": "na"
+    "に": "ni"
+    "ぬ": "nu"
+    "ね": "ne"
+    "の": "no"
+    "にゃ": "nya"
+    "にゅ": "nyu"
+    "にょ": "nyo"
+    "にょう": "nyō"
+    "のう": "nō"
+
+    "は": "ha"
+    "ひ": "hi"
+    "ふ": "fu"
+    "へ": "he"
+    "ほ": "ho"
+    "ひゃ": "hya"
+    "ひゅ": "hyu"
+    "ひょ": "hyo"
+    "ひょう": "hyō"
+    "ほう": "hō"
+
+    "ま": "ma"
+    "み": "mi"
+    "む": "mu"
+    "め": "me"
+    "も": "mo"
+    "みゃ": "mya"
+    "みゅ": "myu"
+    "みょ": "myo"
+    "みょう": "myō"
+    "もう": "mō"
+
+    "や": "ya"
+    "ゆ": "yu"
+    "よ": "yo"
+    "よう": "yō"
+
+    "ら": "ra"
+    "り": "ri"
+    "る": "ru"
+    "れ": "re"
+    "ろ": "ro"
+    "りゃ": "rya"
+    "りゅ": "ryu"
+    "りょ": "ryo"
+    "りょう": "ryō"
+    "ろう": "rō"
+
+    "わ": "wa"
+    "を": "wo"
+
+    "が": "ga"
+    "ぎ": "gi"
+    "ぐ": "gu"
+    "げ": "ge"
+    "ご": "go"
+    "ぎゃ": "gya"
+    "ぎゅ": "gyu"
+    "ぎょ": "gyo"
+    "ぎょう": "gyō"
+    "ごう": "gō"
+
+    "ざ": "za"
+    "じ": "ji"
+    "ず": "zu"
+    "ぜ": "ze"
+    "ぞ": "zo"
+    "じゃ": "ja"
+    "じゅ": "ju"
+    "じょ": "jo"
+    "じょう": "jō"
+    "ぞう": "zō"
+
+    "だ": "da"
+    "ぢ": "ji"
+    "づ": "zu"
+    "で": "de"
+    "ど": "do"
+    "ぢゃ": "ja"
+    "ぢゅ": "ju"
+    "ぢょ": "jo"
+    "どう": "dō"
+
+    "ば": "ba"
+    "び": "bi"
+    "ぶ": "bu"
+    "べ": "be"
+    "ぼ": "bo"
+    "びゃ": "bya"
+    "びゅ": "byu"
+    "びょ": "byo"
+    "びょう": "byō"
+    "ぼう": "bō"
+
+    "ぱ": "pa"
+    "ぴ": "pi"
+    "ぷ": "pu"
+    "ぺ": "pe"
+    "ぽ": "po"
+    "ぴゃ": "pya"
+    "ぴゅ": "pyu"
+    "ぴょ": "pyo"
+    "ぴょう": "pyō"
+    "ぽう": "pō"
+
+    "ん": "n"
+
+    # Katakana
+
+    "ア": "a"
+    "イ": "i"
+    "ウ": "u"
+    "エ": "e"
+    "オ": "o"
+    "オウ": "ō"
+
+    "カ": "ka"
+    "キ": "ki"
+    "ク": "ku"
+    "ケ": "ke"
+    "コ": "ko"
+    "キャ": "kya"
+    "キュ": "kyu"
+    "キョ": "kyo"
+    "キョウ": "kyō"
+    "コウ": "kō"
+
+    "サ": "sa"
+    "シ": "shi"
+    "ス": "su"
+    "セ": "se"
+    "ソ": "so"
+    "シャ": "sha"
+    "シュ": "shu"
+    "ショ": "sho"
+    "ショウ": "shō"
+    "ソウ": "sō"
+
+    "タ": "ta"
+    "チ": "chi"
+    "ツ": "tsu"
+    "テ": "te"
+    "ト": "to"
+    "チャ": "cha"
+    "チュ": "chu"
+    "チョ": "cho"
+    "チョウ": "chō"
+    "トウ": "tō"
+
+    "ナ": "na"
+    "ニ": "ni"
+    "ヌ": "nu"
+    "ネ": "ne"
+    "ノ": "no"
+    "ニャ": "nya"
+    "ニュ": "nyu"
+    "ニョ": "nyo"
+    "ニョウ": "nyō"
+    "ノウ": "nō"
+
+    "ハ": "ha"
+    "ヒ": "hi"
+    "フ": "fu"
+    "ヘ": "he"
+    "ホ": "ho"
+    "ヒャ": "hya"
+    "ヒュ": "hyu"
+    "ヒョ": "hyo"
+    "ヒョウ": "hyō"
+    "ホウ": "hō"
+
+    "マ": "ma"
+    "ミ": "mi"
+    "ム": "mu"
+    "メ": "me"
+    "モ": "mo"
+    "ミャ": "mya"
+    "ミュ": "myu"
+    "ミョ": "myo"
+    "ミョウ": "myō"
+    "モウ": "mō"
+
+    "ヤ": "ya"
+    "ユ": "yu"
+    "ヨ": "yo"
+    "ヨウ": "yō"
+
+    "ラ": "ra"
+    "リ": "ri"
+    "ル": "ru"
+    "レ": "re"
+    "ロ": "ro"
+    "リャ": "rya"
+    "リュ": "ryu"
+    "リョ": "ryo"
+    "リョウ": "ryō"
+    "ロウ": "rō"
+
+    "ワ": "wa"
+    "ヲ": "wo"
+
+    "ガ": "ga"
+    "ギ": "gi"
+    "グ": "gu"
+    "ゲ": "ge"
+    "ゴ": "go"
+    "ギャ": "gya"
+    "ギュ": "gyu"
+    "ギョ": "gyo"
+    "ギョウ": "gyō"
+    "ゴウ": "gō"
+
+    "ザ": "za"
+    "ジ": "ji"
+    "ズ": "zu"
+    "ゼ": "ze"
+    "ゾ": "zo"
+    "ジャ": "ja"
+    "ジュ": "ju"
+    "ジョ": "jo"
+    "ジョウ": "jō"
+    "ゾウ": "zō"
+
+    "ダ": "da"
+    "ヂ": "ji"
+    "ヅ": "zu"
+    "デ": "de"
+    "ド": "do"
+    "ヂャ": "ja"
+    "ヂュ": "ju"
+    "ヂョ": "jo"
+    "ドウ": "dō"
+
+    "バ": "ba"
+    "ビ": "bi"
+    "ブ": "bu"
+    "ベ": "be"
+    "ボ": "bo"
+    "ビャ": "bya"
+    "ビュ": "byu"
+    "ビョ": "byo"
+    "ビョウ": "byō"
+    "ボウ": "bō"
+
+    "パ": "pa"
+    "ピ": "pi"
+    "プ": "pu"
+    "ペ": "pe"
+    "ポ": "po"
+    "ピャ": "pya"
+    "ピュ": "pyu"
+    "ピョ": "pyo"
+    "ピョウ": "pyō"
+    "ポウ": "pō"
+
+    "ン": "n"