interscript 0.1.3 → 0.1.9

data/maps/bgnpcgn-pus-Arab-Latn-1968.yaml

@@ -0,0 +1,377 @@
+---
+authority_id: bgnpcgn
+id: 2007
+language: iso-639-3:prs
+source_script: Arab
+destination_script: Latn
+name: BGN/PCGN Romanization System -- Pashto (1968)
+url: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/693760/ROMANIZATION_OF_PASHTO.pdf
+creation_date: 1968
+confirmation_date: 2017-11
+description: |
+  Pashto is an Indo-Iranian language and is one of two
+  nationally official languages in Afghanistan and one of
+  five regionally recognised languages in Pakistan. The
+  romanization system presented here may be applied to all
+  Pashto geographical names. Although the BGN/PCGN policy for
+  geographical names in Afghanistan is to apply the BGN/PCGN
+  national system of romanization for Afghanistan (2007),
+  which incorporates Dari elements, when applied to a Pashto
+  geographical name, the romanized results of the BGN/PCGN
+  national system for Afghanistan are the same as those of
+  this Pashto romanization system1 . The Pashto alphabet uses
+  a modified form of the Perso-Arabic script, and contains
+  twelve additional consonants not present in standard
+  Arabic, as well as three additional vowel characters and an
+  additional vowel point. ڼ گ ښ ژ ږ ړ ډ ځ څ چ ټ پ :Consonants
+  ٙ :Point Vowel; ې ۍ ى :Vowels The points used in Arabic to
+  mark short vowels and certain other diacritical marks are
+  not written in Pashto. Consequently, a reference source may
+  sometimes be required to aid correct identification of the
+  standard spellings and proper vowels and elimination of
+  dialectal and idiosyncratic variations. In the interests of
+  clarity, a column showing vowel pointing from Arabic to
+  indicate short vowels has been included in the examples
+  below, alongside the unpointed form that will usually be
+  encountered. However it should be noted that the
+  pronunciation of short vowels will vary. (Note: it is
+  recommended that a font such as Scheherazade, available
+  from www.sil.org, which includes the Unicode extended
+  Arabic sub-range, be used to view this system2 .)
+
+notes:
+  - 1. Alif ( ‫ا‬ ) should be romanized as follows
+    a. Initially,it indicates that the word begins with a vowel or
+    diphthong; the alif itself is not romanized, but rather the
+    short vowel it “carries” is romanized; e.g., Aslam Zhrandah
+    ‫ه‬ َ‫د‬ ‫ن‬ ‫ژر‬ ‫سلَم‬ َ‫أ‬ ‫ميړ‬ → b. When it carries a
+    maddah (‫)آ‬ (see vowel table, row 3), it represents ā;
+    e.g., Band. Mīṟ ‫د‬ ‫ن‬ ‫ب‬ َ ‫آب‬ → Āb c. Medially and
+    finally it represents ā (see table 2, row 2); e.g., ‫ۍ‬
+    ‫ماڼ‬ → Māṉêy d. Medially and finally in words of Arabic
+    origin, alif may serve as the bearer of hamzah, e.g.
+    ‫رأس‬ → ra’s. See also note 4.
+
+  - 2. The characters tsē ( ‫څ‬ ) and dzē ( ‫ځ‬ ) may be
+    romanized t͡ s and d͡ z (the combining double breve (
+    Unicode 0361) appearing over the digraph) when for special
+    reasons it is desired that confusion be avoided between
+    ‫ت‬ (t) plus ‫س‬ (s) and between ‫د‬ (d) plus ‫ز‬ (z),
+    respectively.
+
+  - 3. Occasionally the character sequences ‫ه‬ ‫ك‬ , ‫ه‬ ‫ز‬ ,
+    ‫ه‬ ‫س‬ , and ‫ه‬ ‫گ‬ occur . They may be romanized k·h, z·
+    h, s·h, and g·h in order to differentiate these
+    romanizations from the digraphs kh, zh, sh, and gh, which
+    are used to represent the characters ‫خ‬ , ‫ژ‬, ‫ش‬ , and
+    ‫غ‬ respectively .
+
+  - 4. Hamzah ( ‫ء‬ ) should be romanized as follows a. In
+    word-initial position, where it will appear either above or
+    below alif ( indicates a short vowel and should not itself
+    be romanized. romanized by an apostrophe, e.g. ‫أ‬ or
+    ‫إ‬ ), it In other positions it should be ‫جُزء‬ → juz’. b.
+    Yeh with hamzah ( ‫ئ‬ ) should be romanized êy, unless it
+    represents the compound (iẕāfah) morpheme, in which case it
+    is romanized according to note 9 below.
+
+  - 5. The division of words utilized in Pashto writing is
+    followed in romanization, except that the elements –ābād, -
+    khwā, -shahr, -zādah, -zay and -ullāh are always romanized
+    as part of the preceding word, e.g. ‫آباد‬ ‫ت‬ ‫م‬ َ ْ‫ح‬
+    ‫ر‬ َ → Raḩmatābād and ‫الله‬ ‫ت‬ ‫م‬ َ ْ‫ح‬ ‫ر‬ َ →
+    Raḩmatullāh. However, when the word for God ( ‫الله‬ )
+    appears as a standalone word it should be written Allāh.
+    Note also the “dagger alif” ( ٙ) above the second ‫ل‬ (lām)
+    in the word ‫الله‬ ; this, like the short vowels, is not
+    written in Pashto but should be romanized ā, like a full-
+    size alif. Persian derivational endings such as –vand and
+    endings of Turkish origin such as –lar, -lī, -lū, -i, -u, -
+    si, and –su, should be written together with the preceding
+    word.
+
+  - 6. The Pashto preposition ‫د‬ should be romanized dê in
+    agreement with its pronunciation, despite the fact that
+    it is sometimes pointed with kasrah ( ٙ ).
+
+  - 7. In names of Arabic origin, the l of the definite article
+    al/ul is assimilated before the ‘sun letters’ t, s̄ , d,
+    z̄ , r, z, s, sh, ş, ẕ, ţ, z̧ , l and n. In romanization,
+    the article will be written al or its assimilated
+    equivalent in name-initial position but ul or its
+    assimilated equivalent elsewhere; the article should be
+    separated from the name it precedes and should not be
+    capitalized, except at the beginning of a name, e.g. جَبَل
+    السَرَاج → Jabal us Sarāj
+
+  - 8. In Arabic names, a shaddah, ٙ is used to denote the
+    doubling of a particular consonant character, e.g. ‫مَّد‬
+    َ‫ح‬ ‫م‬ ُ → Muḩammad. However, in Pashto this ‘doubling’
+    is frequently omitted in both Perso-Arabic script and the
+    resulting romanization. Guidance on doubling may be taken
+    from an authoritative names source, such as an Afghan
+    government source or Pashto dictionary; for example, it is
+    usual to see Ḩājī without and ‘Abbās with the doubled
+    consonant. The doubled y consonant is almost always
+    retained, as in Sayyid or Qayyūm
+
+  - 9. The iẕāfah morpheme is not a grammatical feature of
+    Pashto and, if encountered in a linguistically hybrid
+    geographical name (i.e. combining features of both Pashto
+    and Dari), it should be treated according to the BGN/PCGN
+    national system of romanization for Afghanistan, 2007, as –
+    e, unless the preceding word ends with a silent heh (‫)ه‬
+    or a vowel when it should be shown – ye, e.g. 10. The
+    character sequence ‫خو‬ , ‫صار‬ ‫ح‬ ِ ‫غر‬ → Ghar-e Ḩişār;
+    ‫و‬ ‫ن‬ َ ‫ه‬ ٔ ‫لع‬ َ ‫ق‬ َ → when followed by ‫ا‬ or
+    ‫ی‬ , Qal‘ah-ye Now.
+
+
+  - 10. The character sequence خو when followed by ‫ا‬ or
+    ‫ی‬ ,should be romanized khw, although the w is either not
+    pronounced, or only weakly pronounced; e.g. ‫خواجه‬ →
+    khwājah.
+
+  - 11. An inventory of letter-diacritic combinations in addition to the unmodified letters of the
+    basic Roman script is
+    ‘ (U+2018)
+    ʼ (U+2019)
+    Ā (U+0100)
+    ā (U+0101)
+    Á (U+00C1)
+    á (U+00E1)
+    Ḏ (U+0044+0031)
+    ḏ (U+0064+00031)
+    Ē (U+0112)
+    ē (U+0113)
+    Ê (U+00CA)
+    ê (U+00EA)
+    Ḩ (U+1E28)
+    ḩ (U+1E29)
+    Ī (U+012A)
+    ī (U+012B)
+    N̄ (U+004E+0304)
+    n̄ (U+004E+0304)
+    Ō (U+014C)
+    ō (U+014D)
+    Ṟ (U+0052+0031)
+    ṟ (U+0072+0031)
+    Ş (U+015E)
+    ş (U+015F)
+    S̄ (U+0053+0304)
+    s̄ (U+0073+0304)
+    Ṯ (U+0054+0031)
+    ṯ (U+0074+0031)
+    Ţ (U+0162)
+    ţ (U+0163)
+    Ū (U+016A)
+    ū (U+016B)
+    Z̧ (U+005A+0327)
+    z̧ (U+007A+0327)
+    Z̄ (U+005A+0304)
+    z̄ (U+007A+0304)
+    Ẕ (U+005A+0331)
+    ẕ (U+007A+0331)
+    Z͟ H (U+005A+0048+035F)
+    z͟ h (U+007A+0068+035F)
+
+tests:
+  - source: بَغْلان
+    expected: Baghlān
+
+  - source: پُوټَكَى
+    expected: Pōṯakay
+
+  - source: شِيرِين تَگَاب
+    expected: Shīrīn Tagāb
+
+  - source: کُوْټ
+    expected: Kōṯ
+
+  - source: ثَابِر
+    expected: S̄ābir
+
+  - source: جَلال آبَاد
+    expected: Jalālābād
+
+  - source: چَارِيكَار
+    expected: Chārīkār
+
+  - source: ځَدْرَاڼ
+    expected: Dzadrāṉ
+
+  - source: څَوکۍ
+    expected: Tsowkêy
+
+  - source: حَضْرَتِ إِمَام
+    expected: Ḩaẕrat-e Imām
+
+  - source: خُوْسْت
+    expected: Khōst
+
+  - source: سْپِين بُوْلْدَک
+    expected: Spīn Bōldak
+
+  - source: ډَنْډ وَ پَتَان
+    expected: Ḏanḏ Wa Patān
+
+  - source: كَنْدَهَار
+    expected: Kandahār
+
+  - source: أَنْدَړ
+    expected: Andaṟ
+
+  - source: كُنْدُز
+    expected: Kunduz
+
+  - source: مِير أَسْلَم ژْرَنْدَه
+    expected: Mīr Aslam Zhrandah
+
+  - source: ږِيرَه
+    expected: Z͟hīrah
+
+  - source: سَمَنْگَان
+    expected: Samangān
+
+  - source: كښٙتَه كَلا
+    expected: Ks͟hêtah Kalā
+
+  - source: قَيْصَار
+    expected: Qayşār
+
+  - source: فَيض آبَاد
+    expected: Faīẕābād
+
+  - source: حَضْرَتِ سُلْطَان
+    expected: Ḩaẕrat-e Sulţān
+
+  - source: ظَاهِر كَلا
+    expected: Z̧āhir Kalā
+
+  - source: پُلِ عَلَم
+    expected: Pul-e ‘Alam
+
+  - source: غَزْنِي
+    expected: Ghaznī
+
+  - source: مَزَارِ شَرِيف
+    expected: Mazār-e Sharīf
+
+  - source: قَيْصَار
+    expected: Qayşār
+
+  - source: كَنْدَهَار
+    expected: Kandahār
+
+  - source: گَرْدېز
+    expected: Gardēz
+
+  - source: کَابُل
+    expected: Kābul
+
+  - source: مَيمَنَه
+    expected: Maīmanah
+
+  - source: خَان آبَاد
+    expected: Khānābād
+
+  - source: مَاڼۍ
+    expected: Māṉêy
+
+  - source: وَاخَان
+    expected: Wākhān
+
+  - source: يَنْگِي قَلعَه
+    expected: Yangī Qal‘ah
+
+  - source: جَلال آبَاد
+    expected: Jalālābād
+
+  - source: مُرْغَاب کَابُل
+    expected: Murghāb Kābul
+
+  - source: گٙردُون
+    expected: Gêrdōn
+
+  - source: آب بَنْد
+    expected: Āb Band
+
+  - source: سْپِين بُوْلْدَک
+    expected: Spīn Bōldak
+
+  - source: جَوزجَان
+    expected: Jowzjān
+
+  - source: گَرْدېز
+    expected: Gardēz
+
+  - source: مَیدان شَهْر
+    expected: Maīdān Shahr
+
+  - source: ډَنْډِ سُفْلىٰ
+    expected: Ḏanḏ-e Suflá
+
+  - source: جَبَل السَرَاج
+    expected: Jabal us Sarāj
+map:
+  inherit: bgnpcgn-prs-Arab-Latn-2007
+  postrules:
+    - pattern: (?<=\b)(?<!\b[‘|’|'|-])[\u0061-\uFFFF]
+      result: "upcase"
+    # don't capitalize defined article in the middle of a sentence
+    - pattern : ' Ut T'  # الت
+      result: ' ut T'
+    - pattern : ' Us̄ S̄'  # الث
+      result: ' us̄ S̄'
+    - pattern : ' Ud D' # الد
+      result: ' ud D'
+    - pattern : ' Uz̄ Z̄'  # الذ
+      result: ' uz̄ Z̄'
+    - pattern : ' Ur R' # الر
+      result: ' ur R'
+    - pattern : ' Uz Z'  # الز
+      result: ' uz Z'
+    - pattern : ' Us S' # الس
+      result: ' us S'
+    - pattern : ' Ush Sh' # الش
+      result: ' ush Sh'
+    - pattern : ' Uş Ş'  # الص
+      result: ' uş Ş'
+    - pattern : ' Uẕ Ẕ'  # الض
+      result: ' uẕ Ẕ'
+    - pattern : ' Uţ Ţ'  # الط
+      result: ' uţ Ţ'
+    - pattern : ' Uz̧ Z̧' # الظ
+      result: ' uz̧ Z̧'
+    - pattern : ' Ul L'  # الل
+      result: ' ul L'
+    - pattern : ' Un n'  # الن
+      result: ' un N'
+  characters:
+
+    '\u0650': 'i' # ِ kasra
+    '\u064f': 'u' # ُ damma
+
+    '\u0650\b' : '-e' # ِ kasra
+
+    '\s\u0627\u0644\u0644\u0651\u064e\u0647' : 'ullāh' # Note5
+    '\u0652' : ''  # ْ sokoon
+    '\u0659': 'ê'
+
+    # Sun letters
+    '\b\u0627\u0644\u062a' : 'ut t'  # الت
+    '\b\u0627\u0644\u062b' : 'us̄ s̄'  # الث
+    '\b\u0627\u0644\u062f' : 'ud d' # الد
+    '\b\u0627\u0644\u0630' : 'uz̄ z̄'  # الذ
+    '\b\u0627\u0644\u0631' : 'ur r' # الر
+    '\b\u0627\u0644\u0632' : 'uz z'  # الز
+    '\b\u0627\u0644\u0633' : 'us s' # الس
+    '\b\u0627\u0644\u0634' : 'ush sh' # الش
+    '\b\u0627\u0644\u0635' : 'uş ş'  # الص
+    '\b\u0627\u0644\u0636' : 'uẕ ẕ'  # الض
+    '\b\u0627\u0644\u0637' : 'uţ ţ'  # الط
+    '\b\u0627\u0644\u0638' : 'uz̧ z̧' # الظ
+    '\b\u0627\u0644\u0644' : 'ul l'  # الل
+    '\b\u0627\u0644\u0646' : 'un n'  # الن
+
+    '\u0626': 'êy' # ئ

data/maps/bgnpcgn-rue-Cyrl-Latn-2016.yaml

@@ -0,0 +1,168 @@
+---
+authority_id: bgnpcgn
+id: 2016
+language: iso-639-2:rue
+source_script: Cyrl
+destination_script: Latn
+name: ROMANIZATION OF RUSYN, BGN/PCGN 2016 System
+alias:
+  ogc11122:
+    code: rue_Cyrl2Latn_BGN_2016
+    description: The BGN/PCGN system for Rusyn was designed for use in romanizing names written in the Rusyn alphabet.
+url: https://geonames.nga.mil/gns/html/Romanization/ROMANIZATION%20OF%20RUSYN.pdf
+creation_date: 2016
+confirmation_date: 2017
+description: |
+  The BGN/PCGN system for Rusyn was designed for use in romanizing names written in the Rusyn
+  alphabet. There are two primary dialects of the Rusyn language: Carpatho‐Rusyn and Pannonian Rusyn.
+  The Rusyn alphabet is almost identical to the Ukrainian alphabet, but contains three characters not
+  present in the Ukrainian alphabet: ё, ы, and ъ. These letters are also absent from the alphabet used by
+  Pannonian Rusyn. This table applies to both dialects of Rusyn.
+
+notes:
+  - |
+    The letters ё, ы, and ъ are present in the orthography of the Carpatho‐Rusyn variant of the Rusyn
+    language. This variant is predominant among Rusyn speakers in Ukraine, Poland, Slovakia, Hungary, and
+    Romania. The letters are absent from the orthography of Pannonian Rusyn, which is predominant in
+    Serbia and Croatia.
+
+  - |
+    Unicode for Latin‐script characters: Ž/ž (017D, 017E); Č/č (010C, 010D); Š/š (0160, 0161); ’ (0027).
+
+  - |
+    The Romanization columns show only lowercase forms but, when romanizing, uppercase and
+    lowercase Roman letters as appropriate should be used.
+
+tests:
+  # Based on https://ru.wikipedia.org/wiki/Русинский_язык#Примеры_текста
+  - source: русиньскый язык
+    expected: rusyn'skyj yazyk
+  - source: руська бисіда
+    expected: rus'ka bysida
+  - source: руснацькый язык
+    expected: rusnac'kyj yazyk
+  - source: руски язик
+    expected: rusky yazyk
+  - source: |
+      Чоловік найчастїше споминать на молоды часы. Є то цалком нормалне.
+      Тадь то рокы, кідь зазнаме всякого. І доброго, і планого. В тім часї ся чоловік находить, як кібы в скаралущі.
+      Розвивать ся, як цвіт на черешни. Выпхати ся мож з того обалу лем тогды, як прийде час, кідь цалком дозріє.
+      Даколи стачіть ся неограбаным способом дотулити білого домику, такой ся пораниш, што ті буде тякнути на цілый жывот.
+      А кідь ся народиш в теплї, обколесеный ласков, розвиваш ся в добрых условіях, выпадеш із скаралущі, як міцна істота.
+      Такым потім буде і твій далшый жывот. Із добрї заложеным фундаментом. Было бы смішно сі робити надїй, же жывот є лем єдна рівна путь…
+      Кібы то так чоловік знав… Кібы ся міг іщі раз народити і піти по тій істій пути…
+    expected: |
+      Čolovik najčastjiše spomynat' na molody časy. Je to calkom normalne.
+      Tad' to roky, kid' zazname vsyakogo. I dobrogo, i planogo. V tim časji sya čolovik nachodyt', yak kiby v skaralušči.
+      Rozvyvat' sya, yak cvit na čerešny. Vypchaty sya mož z togo obalu lem togdy, yak pryjde čas, kid' calkom dozrije.
+      Dakoly stačit' sya neograbanym sposobom dotulyty bilogo domyku, takoj sya poranyš, što ti bude tyaknuty na cilyj žyvot.
+      A kid' sya narodyš v teplji, obkolesenyj laskov, rozvyvaš sya v dobrych usloviyach, vypadeš iz skaralušči, yak micna istota.
+      Takym potim bude i tvij dalšyj žyvot. Iz dobrji založenym fundamentom. Bylo by smišno si robyty nadjij, že žyvot je lem jedna rivna put'…
+      Kiby to tak čolovik znav… Kiby sya mig išči raz narodyty i pity po tij istij puty…
+  # Based on http://www.philology.ru/linguistics3/suprun-89.htm
+  - source: |
+      Вишло слунко красне, ясне,
+      и цму швета розогнало -
+      жем желену, били хмарки
+      як зоз златом да обцагло.
+    expected: |
+      Vyšlo slunko krasne, yasne,
+      y cmu šveta rozognalo -
+      žem želenu, byly chmarky
+      yak zoz zlatom da obcaglo.
+  - source: шнїг
+    expected: šnjig
+  - source: жем
+    expected: žem
+  - source: дзень
+    expected: dzen'
+  - source: спомнуц
+    expected: spomnuc
+  - source: крава
+    expected: krava
+  # Based on https://lingvoforum.net/index.php?topic=43545.0
+  - source: дївка
+    expected: djivka
+  - source: дрыв
+    expected: dryv
+  - source: фёрд
+    expected: fjord
+  - source: Ёзеф
+    expected: Jozef
+  - source: пастырї
+    expected: pastyrji
+
+
+map:
+  characters:
+    "\u0410": "A"             # А
+    "\u0411": "B"             # Б
+    "\u0412": "V"             # В
+    "\u0413": "H"             # Г
+    "\u0414": "D"             # Д
+    "\u0415": "E"             # Е
+    "\u0404": "Je"            # Є
+    "\u0401": "Jo"            # Ё
+    "\u0416": "\u017D"        # Ж => Ž note[2]
+    "\u0417": "Z"             # З
+    "\u0418": "Y"             # И
+    "\u0406": "I"             # І
+    "\u042b": "Y"             # Ы
+    "\u0407": "Ji"            # Ї
+    "\u0419": "J"             # Й
+    "\u041a": "K"             # К
+    "\u041b": "L"             # Л
+    "\u041c": "M"             # М
+    "\u041d": "N"             # Н
+    "\u041e": "O"             # О
+    "\u041f": "P"             # П
+    "\u0420": "R"             # Р
+    "\u0421": "S"             # С
+    "\u0422": "T"             # Т
+    "\u0423": "U"             # У
+    "\u0424": "F"             # Ф
+    "\u0425": "Ch"            # Х
+    "\u0426": "C"             # Ц
+    "\u0427": "\u010C"        # Ч => Č note[2]
+    "\u0428": "\u0160"        # Ш => Š note[2]
+    "\u0429": "\u0160\u010C"  # Щ => ŠČ
+    "\u042e": "Yu"            # Ю
+    "\u042f": "Ya"            # Я
+    "\u042c": "\u0027"        # Ь => '
+    "\u042a": "\u0027"        # Ъ => '
+
+    "\u0430": "a"             # а
+    "\u0431": "b"             # б
+    "\u0432": "v"             # в
+    "\u0433": "g"             # г
+    "\u0434": "d"             # д
+    "\u0435": "e"             # е
+    "\u0454": "je"            # є
+    "\u0451": "jo"            # ё
+    "\u0436": "\u017E"        # ж => ž note[2]
+    "\u0437": "z"             # з
+    "\u0438": "y"             # и
+    "\u0456": "i"             # і
+    "\u044b": "y"             # ы
+    "\u0457": "ji"            # ї
+    "\u0439": "j"             # й
+    "\u043a": "k"             # к
+    "\u043b": "l"             # л
+    "\u043c": "m"             # м
+    "\u043d": "n"             # н
+    "\u043e": "o"             # о
+    "\u043f": "p"             # п
+    "\u0440": "r"             # р
+    "\u0441": "s"             # с
+    "\u0442": "t"             # т
+    "\u0443": "u"             # у
+    "\u0444": "f"             # ф
+    "\u0445": "ch"            # х
+    "\u0446": "c"             # ц
+    "\u0447": "\u010D"        # ч => č note[2]
+    "\u0448": "\u0161"        # ш => š note[2]
+    "\u0449": "\u0161\u010D"  # щ => šč
+    "\u044e": "yu"            # ю
+    "\u044f": "ya"            # я
+    "\u044c": "\u0027"        # ь => '
+    "\u044a": "\u0027"        # ъ => '