interscript 0.1.7 → 0.1.9

data/maps/bgnpcgn-pus-Arab-Latn-1968.yaml

@@ -0,0 +1,377 @@
+---
+authority_id: bgnpcgn
+id: 2007
+language: iso-639-3:prs
+source_script: Arab
+destination_script: Latn
+name: BGN/PCGN Romanization System -- Pashto (1968)
+url: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/693760/ROMANIZATION_OF_PASHTO.pdf
+creation_date: 1968
+confirmation_date: 2017-11
+description: |
+  Pashto is an Indo-Iranian language and is one of two
+  nationally official languages in Afghanistan and one of
+  five regionally recognised languages in Pakistan. The
+  romanization system presented here may be applied to all
+  Pashto geographical names. Although the BGN/PCGN policy for
+  geographical names in Afghanistan is to apply the BGN/PCGN
+  national system of romanization for Afghanistan (2007),
+  which incorporates Dari elements, when applied to a Pashto
+  geographical name, the romanized results of the BGN/PCGN
+  national system for Afghanistan are the same as those of
+  this Pashto romanization system1 . The Pashto alphabet uses
+  a modified form of the Perso-Arabic script, and contains
+  twelve additional consonants not present in standard
+  Arabic, as well as three additional vowel characters and an
+  additional vowel point. ڼ گ ښ ژ ږ ړ ډ ځ څ چ ټ پ :Consonants
+  ٙ :Point Vowel; ې ۍ ى :Vowels The points used in Arabic to
+  mark short vowels and certain other diacritical marks are
+  not written in Pashto. Consequently, a reference source may
+  sometimes be required to aid correct identification of the
+  standard spellings and proper vowels and elimination of
+  dialectal and idiosyncratic variations. In the interests of
+  clarity, a column showing vowel pointing from Arabic to
+  indicate short vowels has been included in the examples
+  below, alongside the unpointed form that will usually be
+  encountered. However it should be noted that the
+  pronunciation of short vowels will vary. (Note: it is
+  recommended that a font such as Scheherazade, available
+  from www.sil.org, which includes the Unicode extended
+  Arabic sub-range, be used to view this system2 .)
+
+notes:
+  - 1. Alif ( ‫ا‬ ) should be romanized as follows
+    a. Initially,it indicates that the word begins with a vowel or
+    diphthong; the alif itself is not romanized, but rather the
+    short vowel it “carries” is romanized; e.g., Aslam Zhrandah
+    ‫ه‬ َ‫د‬ ‫ن‬ ‫ژر‬ ‫سلَم‬ َ‫أ‬ ‫ميړ‬ → b. When it carries a
+    maddah (‫)آ‬ (see vowel table, row 3), it represents ā;
+    e.g., Band. Mīṟ ‫د‬ ‫ن‬ ‫ب‬ َ ‫آب‬ → Āb c. Medially and
+    finally it represents ā (see table 2, row 2); e.g., ‫ۍ‬
+    ‫ماڼ‬ → Māṉêy d. Medially and finally in words of Arabic
+    origin, alif may serve as the bearer of hamzah, e.g.
+    ‫رأس‬ → ra’s. See also note 4.
+
+  - 2. The characters tsē ( ‫څ‬ ) and dzē ( ‫ځ‬ ) may be
+    romanized t͡ s and d͡ z (the combining double breve (
+    Unicode 0361) appearing over the digraph) when for special
+    reasons it is desired that confusion be avoided between
+    ‫ت‬ (t) plus ‫س‬ (s) and between ‫د‬ (d) plus ‫ز‬ (z),
+    respectively.
+
+  - 3. Occasionally the character sequences ‫ه‬ ‫ك‬ , ‫ه‬ ‫ز‬ ,
+    ‫ه‬ ‫س‬ , and ‫ه‬ ‫گ‬ occur . They may be romanized k·h, z·
+    h, s·h, and g·h in order to differentiate these
+    romanizations from the digraphs kh, zh, sh, and gh, which
+    are used to represent the characters ‫خ‬ , ‫ژ‬, ‫ش‬ , and
+    ‫غ‬ respectively .
+
+  - 4. Hamzah ( ‫ء‬ ) should be romanized as follows a. In
+    word-initial position, where it will appear either above or
+    below alif ( indicates a short vowel and should not itself
+    be romanized. romanized by an apostrophe, e.g. ‫أ‬ or
+    ‫إ‬ ), it In other positions it should be ‫جُزء‬ → juz’. b.
+    Yeh with hamzah ( ‫ئ‬ ) should be romanized êy, unless it
+    represents the compound (iẕāfah) morpheme, in which case it
+    is romanized according to note 9 below.
+
+  - 5. The division of words utilized in Pashto writing is
+    followed in romanization, except that the elements –ābād, -
+    khwā, -shahr, -zādah, -zay and -ullāh are always romanized
+    as part of the preceding word, e.g. ‫آباد‬ ‫ت‬ ‫م‬ َ ْ‫ح‬
+    ‫ر‬ َ → Raḩmatābād and ‫الله‬ ‫ت‬ ‫م‬ َ ْ‫ح‬ ‫ر‬ َ →
+    Raḩmatullāh. However, when the word for God ( ‫الله‬ )
+    appears as a standalone word it should be written Allāh.
+    Note also the “dagger alif” ( ٙ) above the second ‫ل‬ (lām)
+    in the word ‫الله‬ ; this, like the short vowels, is not
+    written in Pashto but should be romanized ā, like a full-
+    size alif. Persian derivational endings such as –vand and
+    endings of Turkish origin such as –lar, -lī, -lū, -i, -u, -
+    si, and –su, should be written together with the preceding
+    word.
+
+  - 6. The Pashto preposition ‫د‬ should be romanized dê in
+    agreement with its pronunciation, despite the fact that
+    it is sometimes pointed with kasrah ( ٙ ).
+
+  - 7. In names of Arabic origin, the l of the definite article
+    al/ul is assimilated before the ‘sun letters’ t, s̄ , d,
+    z̄ , r, z, s, sh, ş, ẕ, ţ, z̧ , l and n. In romanization,
+    the article will be written al or its assimilated
+    equivalent in name-initial position but ul or its
+    assimilated equivalent elsewhere; the article should be
+    separated from the name it precedes and should not be
+    capitalized, except at the beginning of a name, e.g. جَبَل
+    السَرَاج → Jabal us Sarāj
+
+  - 8. In Arabic names, a shaddah, ٙ is used to denote the
+    doubling of a particular consonant character, e.g. ‫مَّد‬
+    َ‫ح‬ ‫م‬ ُ → Muḩammad. However, in Pashto this ‘doubling’
+    is frequently omitted in both Perso-Arabic script and the
+    resulting romanization. Guidance on doubling may be taken
+    from an authoritative names source, such as an Afghan
+    government source or Pashto dictionary; for example, it is
+    usual to see Ḩājī without and ‘Abbās with the doubled
+    consonant. The doubled y consonant is almost always
+    retained, as in Sayyid or Qayyūm
+
+  - 9. The iẕāfah morpheme is not a grammatical feature of
+    Pashto and, if encountered in a linguistically hybrid
+    geographical name (i.e. combining features of both Pashto
+    and Dari), it should be treated according to the BGN/PCGN
+    national system of romanization for Afghanistan, 2007, as –
+    e, unless the preceding word ends with a silent heh (‫)ه‬
+    or a vowel when it should be shown – ye, e.g. 10. The
+    character sequence ‫خو‬ , ‫صار‬ ‫ح‬ ِ ‫غر‬ → Ghar-e Ḩişār;
+    ‫و‬ ‫ن‬ َ ‫ه‬ ٔ ‫لع‬ َ ‫ق‬ َ → when followed by ‫ا‬ or
+    ‫ی‬ , Qal‘ah-ye Now.
+
+
+  - 10. The character sequence خو when followed by ‫ا‬ or
+    ‫ی‬ ,should be romanized khw, although the w is either not
+    pronounced, or only weakly pronounced; e.g. ‫خواجه‬ →
+    khwājah.
+
+  - 11. An inventory of letter-diacritic combinations in addition to the unmodified letters of the
+    basic Roman script is
+    ‘ (U+2018)
+    ʼ (U+2019)
+    Ā (U+0100)
+    ā (U+0101)
+    Á (U+00C1)
+    á (U+00E1)
+    Ḏ (U+0044+0031)
+    ḏ (U+0064+00031)
+    Ē (U+0112)
+    ē (U+0113)
+    Ê (U+00CA)
+    ê (U+00EA)
+    Ḩ (U+1E28)
+    ḩ (U+1E29)
+    Ī (U+012A)
+    ī (U+012B)
+    N̄ (U+004E+0304)
+    n̄ (U+004E+0304)
+    Ō (U+014C)
+    ō (U+014D)
+    Ṟ (U+0052+0031)
+    ṟ (U+0072+0031)
+    Ş (U+015E)
+    ş (U+015F)
+    S̄ (U+0053+0304)
+    s̄ (U+0073+0304)
+    Ṯ (U+0054+0031)
+    ṯ (U+0074+0031)
+    Ţ (U+0162)
+    ţ (U+0163)
+    Ū (U+016A)
+    ū (U+016B)
+    Z̧ (U+005A+0327)
+    z̧ (U+007A+0327)
+    Z̄ (U+005A+0304)
+    z̄ (U+007A+0304)
+    Ẕ (U+005A+0331)
+    ẕ (U+007A+0331)
+    Z͟ H (U+005A+0048+035F)
+    z͟ h (U+007A+0068+035F)
+
+tests:
+  - source: بَغْلان
+    expected: Baghlān
+
+  - source: پُوټَكَى
+    expected: Pōṯakay
+
+  - source: شِيرِين تَگَاب
+    expected: Shīrīn Tagāb
+
+  - source: کُوْټ
+    expected: Kōṯ
+
+  - source: ثَابِر
+    expected: S̄ābir
+
+  - source: جَلال آبَاد
+    expected: Jalālābād
+
+  - source: چَارِيكَار
+    expected: Chārīkār
+
+  - source: ځَدْرَاڼ
+    expected: Dzadrāṉ
+
+  - source: څَوکۍ
+    expected: Tsowkêy
+
+  - source: حَضْرَتِ إِمَام
+    expected: Ḩaẕrat-e Imām
+
+  - source: خُوْسْت
+    expected: Khōst
+
+  - source: سْپِين بُوْلْدَک
+    expected: Spīn Bōldak
+
+  - source: ډَنْډ وَ پَتَان
+    expected: Ḏanḏ Wa Patān
+
+  - source: كَنْدَهَار
+    expected: Kandahār
+
+  - source: أَنْدَړ
+    expected: Andaṟ
+
+  - source: كُنْدُز
+    expected: Kunduz
+
+  - source: مِير أَسْلَم ژْرَنْدَه
+    expected: Mīr Aslam Zhrandah
+
+  - source: ږِيرَه
+    expected: Z͟hīrah
+
+  - source: سَمَنْگَان
+    expected: Samangān
+
+  - source: كښٙتَه كَلا
+    expected: Ks͟hêtah Kalā
+
+  - source: قَيْصَار
+    expected: Qayşār
+
+  - source: فَيض آبَاد
+    expected: Faīẕābād
+
+  - source: حَضْرَتِ سُلْطَان
+    expected: Ḩaẕrat-e Sulţān
+
+  - source: ظَاهِر كَلا
+    expected: Z̧āhir Kalā
+
+  - source: پُلِ عَلَم
+    expected: Pul-e ‘Alam
+
+  - source: غَزْنِي
+    expected: Ghaznī
+
+  - source: مَزَارِ شَرِيف
+    expected: Mazār-e Sharīf
+
+  - source: قَيْصَار
+    expected: Qayşār
+
+  - source: كَنْدَهَار
+    expected: Kandahār
+
+  - source: گَرْدېز
+    expected: Gardēz
+
+  - source: کَابُل
+    expected: Kābul
+
+  - source: مَيمَنَه
+    expected: Maīmanah
+
+  - source: خَان آبَاد
+    expected: Khānābād
+
+  - source: مَاڼۍ
+    expected: Māṉêy
+
+  - source: وَاخَان
+    expected: Wākhān
+
+  - source: يَنْگِي قَلعَه
+    expected: Yangī Qal‘ah
+
+  - source: جَلال آبَاد
+    expected: Jalālābād
+
+  - source: مُرْغَاب کَابُل
+    expected: Murghāb Kābul
+
+  - source: گٙردُون
+    expected: Gêrdōn
+
+  - source: آب بَنْد
+    expected: Āb Band
+
+  - source: سْپِين بُوْلْدَک
+    expected: Spīn Bōldak
+
+  - source: جَوزجَان
+    expected: Jowzjān
+
+  - source: گَرْدېز
+    expected: Gardēz
+
+  - source: مَیدان شَهْر
+    expected: Maīdān Shahr
+
+  - source: ډَنْډِ سُفْلىٰ
+    expected: Ḏanḏ-e Suflá
+
+  - source: جَبَل السَرَاج
+    expected: Jabal us Sarāj
+map:
+  inherit: bgnpcgn-prs-Arab-Latn-2007
+  postrules:
+    - pattern: (?<=\b)(?<!\b[‘|’|'|-])[\u0061-\uFFFF]
+      result: "upcase"
+    # don't capitalize defined article in the middle of a sentence
+    - pattern : ' Ut T'  # الت
+      result: ' ut T'
+    - pattern : ' Us̄ S̄'  # الث
+      result: ' us̄ S̄'
+    - pattern : ' Ud D' # الد
+      result: ' ud D'
+    - pattern : ' Uz̄ Z̄'  # الذ
+      result: ' uz̄ Z̄'
+    - pattern : ' Ur R' # الر
+      result: ' ur R'
+    - pattern : ' Uz Z'  # الز
+      result: ' uz Z'
+    - pattern : ' Us S' # الس
+      result: ' us S'
+    - pattern : ' Ush Sh' # الش
+      result: ' ush Sh'
+    - pattern : ' Uş Ş'  # الص
+      result: ' uş Ş'
+    - pattern : ' Uẕ Ẕ'  # الض
+      result: ' uẕ Ẕ'
+    - pattern : ' Uţ Ţ'  # الط
+      result: ' uţ Ţ'
+    - pattern : ' Uz̧ Z̧' # الظ
+      result: ' uz̧ Z̧'
+    - pattern : ' Ul L'  # الل
+      result: ' ul L'
+    - pattern : ' Un n'  # الن
+      result: ' un N'
+  characters:
+
+    '\u0650': 'i' # ِ kasra
+    '\u064f': 'u' # ُ damma
+
+    '\u0650\b' : '-e' # ِ kasra
+
+    '\s\u0627\u0644\u0644\u0651\u064e\u0647' : 'ullāh' # Note5
+    '\u0652' : ''  # ْ sokoon
+    '\u0659': 'ê'
+
+    # Sun letters
+    '\b\u0627\u0644\u062a' : 'ut t'  # الت
+    '\b\u0627\u0644\u062b' : 'us̄ s̄'  # الث
+    '\b\u0627\u0644\u062f' : 'ud d' # الد
+    '\b\u0627\u0644\u0630' : 'uz̄ z̄'  # الذ
+    '\b\u0627\u0644\u0631' : 'ur r' # الر
+    '\b\u0627\u0644\u0632' : 'uz z'  # الز
+    '\b\u0627\u0644\u0633' : 'us s' # الس
+    '\b\u0627\u0644\u0634' : 'ush sh' # الش
+    '\b\u0627\u0644\u0635' : 'uş ş'  # الص
+    '\b\u0627\u0644\u0636' : 'uẕ ẕ'  # الض
+    '\b\u0627\u0644\u0637' : 'uţ ţ'  # الط
+    '\b\u0627\u0644\u0638' : 'uz̧ z̧' # الظ
+    '\b\u0627\u0644\u0644' : 'ul l'  # الل
+    '\b\u0627\u0644\u0646' : 'un n'  # الن
+
+    '\u0626': 'êy' # ئ

data/maps/bgnpcgn-srp-Cyrl-Latn-1962.yaml

@@ -0,0 +1,73 @@
+---
+authority_id: bgnpcgn
+id: 1962
+language: iso-639-2:srp
+source_script: Cyrl
+destination_script: Latn
+name: TRANSLITERATION OF SERBIAN CYRILLIC
+creation_date: 1962
+confirmation_date: 1962
+description: |
+  Serbo-Croatian, the official national language of Yugoslavia, is a single literary language.
+  In Serbian areas it is written in the cyrillic (Serbian) alphabet, while in Croatian areas it is
+  written in the roman (Croatian) alphabet.
+  Both the BGN and PCGN use the standard Croation equivalents for fomanizing the Serbian cyrillic
+  alphabet whenether romanized names are not available.
+
+notes:
+  - The digraph dj(Dj) will occasionally be found as the Croatian equivalent of ђ(Ђ),
+    but the use of dj should be limited to those instances where it is found in roman sources.
+
+tests:
+  - source: Шупља Стена
+    expected: Šuplja Stena
+  - source: Чукарица
+    expected: Čukarica
+  - source: Црна Трава
+    expected: Crna Trava
+  - source: Херцег Нови
+    expected: Herceg Novi
+  - source: Улцињ
+    expected: Ulcinj
+  - source: Ужице
+    expected: Užice
+  - source: Тресаначка Река
+    expected: Tresanačka Reka
+  - source: Сјеница
+    expected: Sjenica
+  - source: Рожаје
+    expected: Rožaje
+  - source: Пљевља
+    expected: Pljevlja
+  - source: Оџаци
+    expected: Odžaci
+  - source: Никшић
+    expected: Nikšić
+  - source: Медвеђа
+    expected: Medveđa
+  - source: Лозница
+    expected: Loznica
+  - source: Књажевац
+    expected: Knjaževac
+  - source: Зрењанин
+    expected: Zrenjanin
+  - source: Житорађа
+    expected: Žitorađa
+  - source: Ервеник
+    expected: Ervenik
+  - source: Доње Љупче
+    expected: Donje Ljupče
+  - source: Гусиње
+    expected: Gusinje
+  - source: ГУСИЊЕ
+    expected: GUSINJE
+  - source: Врњачка Бања
+    expected: Vrnjačka Banja
+  - source: Бијело Поље
+    expected: Bijelo Polje
+  - source: Алибунар
+    expected: Alibunar
+
+map:
+  inherit: bgnpcgn-srp-Cyrl-Latn-2005
+  postrules:

data/maps/bgnpcgn-urd-Arab-Latn-2007.yaml

@@ -0,0 +1,459 @@
+---
+authority_id: bgnpcgn
+id: 2007
+language: iso-639-2:urd
+source_script: Arab
+destination_script: Latn
+name: BGN/PCGN Romanization System -- Urdu (2007)
+alias:
+  ogc11122:
+    code: uas_Arab2Latn_BGN_2007
+    description: Unified Afghan Romanization System US Board on Geographic Names (BGN)/The Permanent Committee on Geographical Names (PCGN) 2007
+url: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/693788/ROMANIZATION_OF_URDU.pdf
+creation_date: 2007
+confirmation_date: 2017-11
+description: |
+  The following is the approved romanization system for
+  deriving standard spellings of Urdu geographical names for
+  Pakistan. It was jointly adopted by BGN and PCGN at the
+  23rd BGN/PCGN Conference in Washington, DC, in 2007 and it
+  is based on the Hunterian romanization system for Urdu,
+  which has been used by the Surveys of India and Pakistan
+  for romanizing Urdu geographical names for more than one
+  hundred years. The BGN/PCGN system laid out below includes
+  diacritical marks in order that the original script can be
+  derived from the romanized form (i.e. it is reversible).
+  For desk users requiring a diacritic-free form, these
+  diacritics can simply be removed. In every case the same
+  basic Roman-script characters are kept as are used in the
+  Hunterian system. The BGN/PCGN forms have further been
+  designed to harmonize with the BGN/PCGN Persian
+  romanization system.
+notes:
+  - 1. When the vowel sign zīr ( ِ) occurs word-finally in the
+    first element of a compound, it is assumed to mark the
+    Persian izafat
+    morpheme, and is romanized -e, not i.
+  - 2. The source of almost all example names is the 1951
+    Census of Pakistan, Village List, Northwest Frontier
+    Province, Chitral
+    State. Office of the Provincial Superintendant of Census,
+    North-West Frontier Province, Peshawar.
+  - 3. No examples of aspirated dental r (rh, رھ ( were found,
+    though this phoneme is assumed to be part of the phonology
+    of
+    Urdu, and was therefore left out of Table 2.
+  - 4. Note that the short vowels in the Urdu examples are not
+    pointed.
+  - 5. Occasionally, sequences of /z/ or /s/ plus /h/ may be
+    encountered, i.e. z·h, s·h. These may be romanized with the
+    Unicode
+    'center dot' (U+00B7) separating the two letters, to
+    distinguish them from the digraphs /zh/ and /sh/.
+  - Commented tests are blocked by this issue https://github.com/interscript/interscript/issues/572
+    depends on the different ways of handling ي to y or e AND و to u or o
+
+
+tests:
+  # - source: بوغدِی
+  #   expected: Boghdī
+
+  - source: پَالِير
+    expected: Pālīr
+
+  # - source: بیزوت كَلے
+  #   expected: Bezot Kale
+
+  # - source: عَمَل كوٹ
+  #   expected: ‘Amal Koṭ
+
+  - source: ثَابِر
+    expected: S̄ābir
+
+  - source: شَاه نَثَار ميلة
+    expected: Shāh Nas̄ār Mylah
+
+  # - source: بَرجُو ميلَه
+  #   expected: Barjū Melah
+
+  - source: چَپرِی
+    expected: Chaprī
+
+  - source: أَحمَد خَان كَلے
+    expected: Aḩmad Khān Kale
+
+  # - source: آكَا خيل
+  #   expected: Ākā Khel
+
+  - source: دُرَانِي
+    expected: Durānī
+
+  - source: ڈَنگِیلا
+    expected: Ḍangīlā
+
+  - source: ذَرَانِی
+    expected: Z̄arānī
+
+  - source: بُركِي
+    expected: Burkī
+
+  - source: گِیدَڑَه
+    expected: Gīdaṛah
+
+  - source: عَلِي زَائِي
+    expected: ‘Alī Zā’ī
+
+  # - source: ژوب
+  #   expected: Zhob
+
+  - source: بِسَاتُو
+    expected: Bisātū
+
+  - source: أَحمَدِي شَامَا
+    expected: Aḩmadī Shāmā
+
+  - source: اَصَالَت كَلے
+    expected: Aşālat Kale
+
+  - source: خَضَر خَان
+    expected: Khaẕar Khān
+
+  - source: سُلْطَان
+    expected: Sulţān
+
+  - source: عَزَم سَيِّد نُور كَلے
+    expected: ‘Azam Sayyid Nūr Kale
+
+  # - source: عَلَم شير
+  #   expected: ‘Alam Sher
+
+  - source: بغَاكِي
+    expected: Bghākī
+
+  # - source: مُظَفَر كوٹ
+  #   expected: Muz̧afar Koṭ
+
+  - source: حَقدَرَه
+    expected: Ḩaqdarah
+
+  - source: کَچکِینَہ
+    expected: Kachkīnah
+
+  - source: بَاگَن
+    expected: Bāgan
+
+  - source: بُلبَلَک
+    expected: Bulbalak
+
+  - source: بِلیَامِین
+    expected: Bilyāmīn
+
+  - source: نَہر
+    expected: Nahr
+
+  # - source: جوکَالِیَاں
+  #   expected: Jokālīāñ
+
+  - source: اَرَوْالِی
+    expected: Arawālī
+
+  # - source: هیروشاه
+  #   expected: Heroshāh
+
+  - source: مَہردِی
+    expected: Mahrdī
+
+  - source: بَڑھ
+    expected: Baṛh
+
+  # - source: شِیوَاؤ
+  #   expected: Shīwā’o
+
+  - source:  یَاردَا کَلے
+    expected: Yārdā Kale
+
+  - source: بهَائِي خَان
+    expected: Bhā’ī Khān
+
+  - source: پھاشک
+    expected: Phāshk
+
+  - source: تھَلّ
+    expected: Thall
+
+  - source: پَٹھان ريَا
+    expected: Paṭhān Ryā
+
+  - source: جھِیل
+    expected: Jhīl
+
+  - source:  غَزْنِي سْپِين
+    expected: Ghaznī Spīn
+
+  - source: بَادشَاه چھُم
+    expected: Bādshāh Chhum
+
+  - source:  سِندھ
+    expected: Sindh
+
+  - source: ڈھَنڈ
+    expected: Ḍhanḍ
+
+  # - source: غوزگَڑھِی
+  #   expected: Ghozgaṛhī
+
+  # - source: دوغَل گاکھَر
+  #   expected: Doghal Gākhar
+
+  - source: خَان گھَڑِی
+    expected: Khān Ghaṛī
+
+  - source: غُلَامَک كَلے
+    expected: Ghulāmak Kale
+
+  # - source: کاراخیل
+  #   expected: Kārākhel
+
+  - source: خَپیَنگا
+    expected: Khapyangā
+
+  - source: گَندَه كَلے
+    expected: Gandah Kale
+
+  # - source: گُلونَا ڈھيرِي
+  #   expected: Gulonā Ḍherī
+
+  # - source: خيرَه دِين
+  #   expected: Kherah Dīn
+
+  - source: مَورپِتھِی
+    expected: Maurpithī
+
+  - source: درے پلارِی
+    expected: Dre Plārī
+
+  - source: آگرَہ
+    expected: Āgrah
+
+  - source: ڈَنڈَر
+    expected: Ḍanḍar
+
+  # - source: گِیدو
+  #   expected: Gīdo
+
+  - source: گُبازانَہ
+    expected: Gubāzānah
+
+  # - source: اُوشو
+  #   expected: Ūsho
+
+  - source: حَےدَر عَلِی كَلے
+    expected: Ḩaidar ‘Alī Kale
+
+  - source: تَودَہ چِینَہ
+    expected: Taudah Chīnah
+
+  - source: مُوسى خَان كَلے
+    expected: Mūsá Khān Kale
+
+  - source: مُلَّا بَاغ
+    expected: Mullā Bāgh
+
+map:
+  postrules:
+    - pattern: (?<=\b)(?<!\b[‘|’|'|-])[\u0061-\uFFFF]
+      result: "upcase"
+    # don't capitalize defined article in the middle of a sentence
+    - pattern : ' At T'  # الت
+      result: ' at T'
+    - pattern : ' As̄ S̄'  # الث
+      result: ' as̄ S̄'
+    - pattern : ' Ad D' # الد
+      result: ' ad D'
+    - pattern : ' Az̄ Z̄'  # الذ
+      result: ' az̄ Z̄'
+    - pattern : ' Ar R' # الر
+      result: ' ar R'
+    - pattern : ' Az Z'  # الز
+      result: ' az Z'
+    - pattern : ' As S' # الس
+      result: ' as S'
+    - pattern : ' Ash Sh' # الش
+      result: ' ash Sh'
+    - pattern : ' Aş Ş'  # الص
+      result: ' aş Ş'
+    - pattern : ' Aẕ Ẕ'  # الض
+      result: ' aẕ Ẕ'
+    - pattern : ' Aţ Ţ'  # الط
+      result: ' aţ Ţ'
+    - pattern : ' Az̧ Z̧' # الظ
+      result: ' az̧ Z̧'
+    - pattern : ' Al L'  # الل
+      result: ' al L'
+    - pattern : ' An N'  # الن
+      result: ' an N'
+    - pattern: " Al " # ال
+      result: " al "
+  characters:
+    # special rules
+
+    '\s(?=\u0622\u0628\u064E\u0627\u062F)': '' # space followed by abad is removed
+    '\ufdf2': 'Allāh' # See note 5
+
+    # Vowels, Diphthongs, and Diacritical Marks
+    '\u064e' : 'a' # َ fatha
+    '\u064e(?=\u0629)' : '' # َ fatha followed by ta' marboota
+    '\u064e(?=a[h|t])' : '' # َ fatha followed by ta' marboota, handling different order of conversion
+
+    '\u0652' : ''  # ْ sokoon
+    '\u0659': 'ê'
+
+    '\u0650[\u064a|\u06cc]' : 'ī' # ـِي kasra followed by ي
+    '\u0650' : 'i' # karsra
+    '\u06d2' : 'e' # ـے
+
+    '\u0622' : 'ā'  # آ
+    '\u064e\u0627' : 'ā'  # ـَا fatha followed by ا
+    '\u0627' : 'ā'  # ا
+    '\b\u0627' : ''  # ا
+
+    '\u0648' : 'o'  # و # suspect
+    '\u064f' : 'u' # ُ damma
+    '\u064f\u0648' : 'ū'  # ـُو damma followed by و
+
+    '\u064e\u06d2' : 'ai' # ـے
+    '\u064e\u0648' : 'au'  # ـَو
+    '\u0670': 'á' # ىٰ
+    '\u0649': 'á' # ىٰ
+
+    # shadda
+    '\u0628\u0651' : 'bb'  # ب
+    '\u062a\u0651' : 'tt'  # ت
+    '\u062b\u0651' : 'thth'  # ث
+    '\u062c\u0651' : 'jj'  # ج
+    '\u062d\u0651' : 'ẖẖ' # ح
+    '\u062e\u0651' : 'khkh'  # خ
+    '\u062f\u0651' : 'dd'  # د
+    '\u0630\u0651' : 'z̄z̄'  # ذ
+    '\u0631\u0651' : 'rr'  # ر
+    '\u0632\u0651' : 'zz'  # ز
+    '\u0633\u0651' : 'ss'  # س
+    '\u0634\u0651' : 'sh'  # ش
+    '\u0635\u0651' : 'şş'  # ص
+    '\u0636\u0651' : 'ḏḏ'  # ض
+    '\u0637\u0651' : 'ţţ'  # ط
+    '\u0638\u0651' : 'z̧z̧'  # ظ
+    '\u063a\u0651' : 'ghgh'  # غ
+    '\u0641\u0651' : 'ff'  # ف
+    '\u0642\u0651' : 'qq'  # ق
+    '\u0643\u0651' : 'kk'  # ك
+    '\u0644\u0651' : 'll'  # ل
+    '\u0645\u0651' : 'mm'  # م
+    '\u0646\u0651' : 'nn'  # ن
+    '\u0647\u0651' : 'hh'  # ه
+    '\u0648\u0651' : 'ww'  # و
+    '[\u064a|\u06cc]\u0651' : 'yy'  # ي
+
+    # NOTE 1
+    '\u0650\b' : '-e' # ِ kasra
+    '\u0674' : '-e' # ٴ
+    '\u0654' : '-e' #  ٔ
+
+    '\u0650\u064a\u0651\u064e' : 'īy' # ـِيَّ
+    '\u0650\u064a(?=\u064e|u064f)' : 'iy' # ـِي kasra followed by ي
+    '\u064e\u0649' : 'ay'  # ـَى fatha followed by ى which is ا not ي
+    '\u064e\u0648\u0652' : 'aw'  # ـَوْ
+    '\u064e\u064a\u0652' : 'ay'  # ـَيْ
+    '\u0650\u06cc\u0651\u064e' : 'īy' # ـِيَّ
+    '\u064e\u064a' : 'aī'  # ـَي
+    '\u064e\u06cc' : 'aī'  # ـَي
+      # - '-ye'
+
+
+    # ta' marboota
+    '\u0629' : 'at' # ة in the middle of the sentence
+    '\u0629$' : 'ah'
+    '(?<=\b\u0627\u0644[\u0600-\u06ff]{2})\u0629' : 'ah'
+    '(?<=\b\u0627\u0644[\u0600-\u06ff]{3})\u0629' : 'ah'
+    '(?<=\b\u0627\u0644[\u0600-\u06ff]{4})\u0629' : 'ah'
+    '(?<=\b\u0627\u0644[\u0600-\u06ff]{5})\u0629' : 'ah'
+    '(?<=\b\u0627\u0644[\u0600-\u06ff]{6})\u0629' : 'ah'
+    '(?<=\b\u0627\u0644[\u0600-\u06ff]{7})\u0629' : 'ah'
+    '(?<=\b\u0627\u0644[\u0600-\u06ff]{8})\u0629' : 'ah'
+    '(?<=\b\u0627\u0644[\u0600-\u06ff]{9})\u0629' : 'ah'
+    '(?<=\b\u0627\u0644[\u0600-\u06ff]{10})\u0629' : 'ah'
+    '(?<=\b\u0627\u0644[\u0600-\u06ff]{11})\u0629' : 'ah'
+    '(?<=\b\u0627\u0644[\u0600-\u06ff]{12})\u0629' : 'ah'
+    '(?<=\b\u0627\u0644[\u0600-\u06ff]{13})\u0629' : 'ah'
+
+
+
+    '\u0621' : '’' # ء
+    '\u0624' : '’' # ؤ
+    '\u0624\b' : '’o' # ؤ
+    '\u0626' : '’' # ئ
+
+    '\u0623' : ''  # أ
+    '\u0625' : ''    # إ
+    # See note B
+    '\b\u0627\u0644' : 'al '  # ال
+    # '\uFE8E' : ''  # ﺎ
+
+    # Sun letters
+    '\b\u0627\u0644\u062a' : 'at t'  # الت
+    '\b\u0627\u0644\u062b' : 'as̄ s̄'  # الث
+    '\b\u0627\u0644\u062f' : 'ad d' # الد
+    '\b\u0627\u0644\u0630' : 'az̄ z̄'  # الذ
+    '\b\u0627\u0644\u0631' : 'ar r' # الر
+    '\b\u0627\u0644\u0632' : 'az z'  # الز
+    '\b\u0627\u0644\u0633' : 'as s' # الس
+    '\b\u0627\u0644\u0634' : 'ash sh' # الش
+    '\b\u0627\u0644\u0635' : 'aş ş'  # الص
+    '\b\u0627\u0644\u0636' : 'aẕ ẕ'  # الض
+    '\b\u0627\u0644\u0637' : 'aţ ţ'  # الط
+    '\b\u0627\u0644\u0638' : 'az̧ z̧' # الظ
+    '\b\u0627\u0644\u0644' : 'al l'  # الل
+    '\b\u0627\u0644\u0646' : 'an n'  # الن
+
+
+    # consonant characters
+
+    '\u0628' : 'b'  # ب
+    '\u067E' : 'p' # پ
+    '\u062a' : 't'  # ت
+    '\u0679' : 'ṭ'  # ٹ
+    '\u062B' : 's̄'   # ث
+    '\u062c' : 'j'  # ج
+    '\u0686' : 'ch'  # ‫چ‬
+    '\u062d' : 'ḩ' # ح
+    '\u062e' : 'kh'  # خ
+    '\u062f' : 'd'  # د
+    '\u0688' : 'ḍ' # ‫ڈ
+    '\u0630' : 'z̄'  # ذ
+    '\u0631' : 'r'  # ر
+    '\u0691' : 'ṛ'   # ڑ
+    '\u0632' : 'z'  # ز
+    '\u0698' : 'zh'  # ‫ژ‬
+    '\u0633' : 's'  # س
+    '\u0634' : 'sh'  # ش
+    '\u0635' : 'ş'  # ص
+    '\u0636' : 'ẕ'  # ض
+    '\u0637' : 'ţ'  # ط
+    '\u0638' : 'z̧'  # ظ
+    '\u0639' : '‘'  # ع
+    '\u063a' : 'gh'  # غ
+    '\u0641' : 'f'  # ف
+    '\u0642' : 'q'  # ق
+    '\u0643' : 'k'  # ك
+    '\u06A9' : 'k' # ک
+    '\u06AF' : 'g' # ‫گ‬
+    '\u0644' : 'l'  # ل
+    '\u0645' : 'm'  # م
+    '\u0646' : 'n'  # ن
+    '\u06BA' : 'ñ' # ڼ
+    '[\u0647|\u06c1|\u06be]' : 'h'  # ه
+    '\u0648' : 'w'  # و
+    '[\u064a|\u06cc]' : 'y'  # ي
+    # '\u0649' : 'y'  # ي
+    '\u06D0' : 'ē'   # ې
+    '\u06CD' : 'êy'  # ‫ۍ‬