interscript 0.1.3 → 0.1.9

data/maps/iso-hin-Deva-Latn-15919-2001.yaml

@@ -0,0 +1,87 @@
+---
+authority_id: iso
+id: 15919-2001
+language: iso-639-2:hin
+source_script: Deva
+destination_script: Latn
+name: "Information and documentation — Transliteration of Devanagari and related Indic scripts into Latin characters"
+url: https://www.chatranjali.fr/Scripts/Standards/ISO15919.pdf
+creation_date: 2001
+adoption_date: 2001
+description: |
+  Script conversion is often required for documents such as historical and literary texts, geographical texts (including
+  maps and atlases), bibliographies, catalogues, lists and passports (and other identification documents).
+
+  Text in Devanagari script or other Indic scripts sometimes needs to be shown in Latin script, where users, or
+  equipment that they are using, cannot read or write the text
+
+  This International Standard applies to transliteration of Devanagari, and to Indic scripts related to Devanagari,
+  independent of the period in which it is or was used.
+
+notes:
+
+  - All transliterations made using this International Standard shall be case-insensitive.
+  - Inherent a with a consonant shall always be transliterated.
+  - anusvara (including Vedic anusvara) shall be transliterated as ṁ
+  - candrabindu shall be transliterated as m̐
+  - When m̐, ṃ or ṁ are associated with a vowel, they shall be placed after the vowel. When m̐ is associated
+    with a semivowel, it shall be placed before the semivowel.
+  - Latin punctuation signs and Hindu-Arabic numerals shall remain unchanged in transliteration.
+    Indic punctuation is outside the scope of this International Standard.
+  - The Vedic accent Udatta shall be transliterated as an acute accent over the transliterated vowel, and the
+    independent Svarita as a grave accent over the transliterated vowel. In the case of the digraphs ai, au, the accent
+    shall be attached to the second vowel.
+  - |
+    A colon: before a Latin character shall be used to resolve ambiguity. Some normative cases are as
+    follows.
+     -  :’ for avagraha in modern text. (The apostrophe in modern text remains unchanged in accordance with previous rule.
+  - If a character in an Indic script is defined in such a way as to be equivalent to another character in any
+    script, where the second character has a transliteration in this International Standard, then the first character shall
+    be transliterated in the same way as the second character.
+  - Where it is desired to show the Vedic accent Anudatta, it should be transliterated as an underscore. In the case of
+    the digraphs ai, au, both Latin vowels should be underscored.
+    Where word boundaries are not shown in the original text (as happens commonly in Sanskrit) and a word ends in a
+    consonant, the transliteration should show word division by a space; but when phonological processes result in two
+    words sharing a common vowel, no attempt should be made to separate them. This will require a good knowledge
+    of the language in question.
+
+
+tests:
+  - source: "हम"
+    expected: "hama"
+  - source: "मीन"
+    expected: "maīna"
+  - source: "औसत"
+    expected: "ausata"
+  - source: "माँऽऽऽ!"
+    expected: "maām̐:’:’:’!"
+  - source: "आग़ा ख़ान"
+    expected: "āġaā k͟haāna"
+  - source: "पढ़ना"
+    expected: "paṛhanaā"
+  - source: "पेड़"
+    expected: "paeṛa"
+  - source: "अंग्रेज़ी"
+    expected: "aṁgaraezaī"
+  - source: "करोड़"
+    expected: "karaoṛa"
+  - source: "माँ"
+    expected: "maām̐"
+  - source: "गंभीर मरीजों के मामले में भारत दूसरे नंबर पर"
+    expected: "gaṁbhaīra maraījaoṁ kae maāmalae maeṁ bhaārata daūsarae naṁbara para"
+  - source: "कोरोना अपडेट्स"
+    expected: "kaoraonaā apaḍaeṭasa"
+  - source: "सीडीसी चीफ का बयान अहम"
+    expected: "saīḍaīsaī caīpha kaā bayaāna ahama"
+  - source: "गूगल प्ले स्टोर पर पेटीएम की वापसी"
+    expected: "gaūgala palae saṭaora para paeṭaīema kaī vaāpasaī"
+  - source: "भारत में गैंबलिंग की इजाजत नहीं"
+    expected: "bhaārata maeṁ gaaiṁbalaiṁga kaī ijaājata nahaīṁ"
+  - source: "कोरोना वैक्सीन मुद्दे पर घिरे राष्ट्रपति; जो बाइडेन बोले- मुझे और देश को वैज्ञानिकों पर भरोसा है, डोनाल्ड ट्रम्प पर नहीं"
+    expected: "kaoraonaā vaaikasaīna maudadae para ghairae raāṣaṭarapatai; jao baāiḍaena baolae- maujhae aura daeśa kao vaaijañaānaikaoṁ para bharaosaā haai, ḍaonaālaḍa ṭaramapa para nahaīṁ"
+  - source: "गूगल की कार्रवाई पर पेटीएम ने कहा था कि ऐप को अस्थायी तौर पर प्ले-स्टोर से हटाया गया है, आपके पैसे सुरक्षित हैं"
+    expected: "gaūgala kaī kaāraravaāī para paeṭaīema nae kahaā thaā kai aipa kao asathaāyaī taaura para palae-saṭaora sae haṭaāyaā gayaā haai, āpakae paaisae saurakaṣaita haaiṁ"
+
+map:
+
+  inherit: iso-san-Deva-Latn-15919-2001

data/maps/iso-inc-Deva-Latn-15919-2001.yaml

@@ -0,0 +1,61 @@
+---
+authority_id: iso
+id: 15919-2001
+language: iso-639-2:inc
+source_script: Deva
+destination_script: Latn
+name: "Information and documentation — Transliteration of Devanagari and related Indic scripts into Latin characters"
+url: https://www.chatranjali.fr/Scripts/Standards/ISO15919.pdf
+creation_date: 2001
+adoption_date: 2001
+description: |
+  Script conversion is often required for documents such as historical and literary texts, geographical texts (including
+  maps and atlases), bibliographies, catalogues, lists and passports (and other identification documents).
+
+  Text in Devanagari script or other Indic scripts sometimes needs to be shown in Latin script, where users, or
+  equipment that they are using, cannot read or write the text
+
+  This International Standard applies to transliteration of Devanagari, and to Indic scripts related to Devanagari,
+  independent of the period in which it is or was used.
+
+notes:
+
+  - All transliterations made using this International Standard shall be case-insensitive.
+  - Inherent a with a consonant shall always be transliterated.
+  - anusvara (including Vedic anusvara) shall be transliterated as ṁ
+  - candrabindu shall be transliterated as m̐
+  - When m̐, ṃ or ṁ are associated with a vowel, they shall be placed after the vowel. When m̐ is associated
+    with a semivowel, it shall be placed before the semivowel.
+  - Latin punctuation signs and Hindu-Arabic numerals shall remain unchanged in transliteration.
+    Indic punctuation is outside the scope of this International Standard.
+  - The Vedic accent Udatta shall be transliterated as an acute accent over the transliterated vowel, and the
+    independent Svarita as a grave accent over the transliterated vowel. In the case of the digraphs ai, au, the accent
+    shall be attached to the second vowel.
+  - |
+    A colon: before a Latin character shall be used to resolve ambiguity. Some normative cases are as
+    follows.
+     -  :’ for avagraha in modern text. (The apostrophe in modern text remains unchanged in accordance with previous rule.
+     -  Vowel hiatus, not digraph transliteration of diphthongs; as in Sanskrit pra:uga (not prauga), “yoke”;
+
+  - If a character in an Indic script is defined in such a way as to be equivalent to another character in any
+    script, where the second character has a transliteration in this International Standard, then the first character shall
+    be transliterated in the same way as the second character.
+  - Where it is desired to show the Vedic accent Anudatta, it should be transliterated as an underscore. In the case of
+    the digraphs ai, au, both Latin vowels should be underscored.
+    Where word boundaries are not shown in the original text (as happens commonly in Sanskrit) and a word ends in a
+    consonant, the transliteration should show word division by a space; but when phonological processes result in two
+    words sharing a common vowel, no attempt should be made to separate them. This will require a good knowledge
+    of the language in question.
+
+
+tests:
+  - source: "उपमुख्यमंत्र्यांची 'मोठी' घोषणा; राज्यात केंद्राच्या कृषी व कामगार विधेयकाची अंमलबजावणी नाही"
+    expected: "upamaukhayamaṁtarayaāṁcaī 'maoṭhaī' ghaoṣaṇaā; raājayaāta kaeṁdaraācayaā kaṛṣaī va kaāmagaāra vaidhaeyakaācaī aṁmalabajaāvaṇaī naāhaī"
+  - source: "ग्वालियर बन रहा देश का नया जामताड़ा, ऑनलाइन ठगी के कई गिरोह का पर्दाफाश"
+    expected: "gavaālaiyara bana rahaā daeśa kaā nayaā jaāmataāड़ā, ônalaāina ṭhagaī kae kaī gairaoha kaā paradaāphaāśa"
+  - source: "२४ घण्टामा कोरोनाबाट ६ जनाको मृत्यु, मृतककाे संख्या ४ सय ५९ पुग्यो"
+    expected: "24 ghaṇaṭaāmaā kaoraonaābaāṭa 6 janaākao maṛtayau, maṛtakakaāe saṁkhayaā 4 saya 59 paugayao"
+
+map:
+
+  inherit: iso-san-Deva-Latn-15919-2001

data/maps/iso-jpn-Hrkt-Latn-3602-1989.yaml

@@ -1,14 +1,18 @@
 ---
 authority_id: iso
 id: 3602-1989
-language: jpn
+language: iso-639-2:jpn
 source_script: Hrkt
 destination_script: Latn
-name: ISO 3602 Romanization of Japanese (Kana Script)
-url:
-creation_date:
-adoption_date:
-description:
+name: "ISO 3602:1989 Documentation — Romanization of Japanese (kana script)"
+url: https://www.iso.org/standard/9029.html
+creation_date: 1989
+adoption_date: 1989
+description: |
+  Establishes a system for the romanization of the present-day
+  Japanese written language. Unrestricted application for the system
+  requires that the romanizer possess a detailed knowledge of the
+  language in its present-day written form.
 
 notes:
 

data/maps/iso-kan-Kana-Latn-15919-2001.yaml

@@ -0,0 +1,220 @@
+---
+authority_id: iso
+id: 15919-2001
+language: iso-639-2:kan
+source_script: kana
+destination_script: Latn
+name: "Information and documentation — Transliteration of Devanagari and related Indic scripts into Latin characters"
+url: https://www.chatranjali.fr/Scripts/Standards/ISO15919.pdf
+creation_date: 2001
+adoption_date: 2001
+description: |
+  Script conversion is often required for documents such as historical and literary texts, geographical texts (including
+  maps and atlases), bibliographies, catalogues, lists and passports (and other identification documents).
+
+  Text in Devanagari script or other Indic scripts sometimes needs to be shown in Latin script, where users, or
+  equipment that they are using, cannot read or write the text
+
+  This International Standard applies to transliteration of Devanagari, and to Indic scripts related to Devanagari,
+  independent of the period in which it is or was used.
+
+notes:
+
+  - All transliterations made using this International Standard shall be case-insensitive.
+  - Inherent a with a consonant shall always be transliterated.
+  - anusvara (including Vedic anusvara) shall be transliterated as ṁ
+  - candrabindu shall be transliterated as m̐
+  - When m̐, ṃ or ṁ are associated with a vowel, they shall be placed after the vowel. When m̐ is associated
+    with a semivowel, it shall be placed before the semivowel.
+  - Latin punctuation signs and Hindu-Arabic numerals shall remain unchanged in transliteration.
+    Indic punctuation is outside the scope of this International Standard.
+  - The Vedic accent Udatta shall be transliterated as an acute accent over the transliterated vowel, and the
+    independent Svarita as a grave accent over the transliterated vowel. In the case of the digraphs ai, au, the accent
+    shall be attached to the second vowel.
+  - |
+    A colon: before a Latin character shall be used to resolve ambiguity. Some normative cases are as
+    follows.
+     -  :’ for avagraha in modern text. (The apostrophe in modern text remains unchanged in accordance with previous rule.
+  - If a character in an Indic script is defined in such a way as to be equivalent to another character in any
+    script, where the second character has a transliteration in this International Standard, then the first character shall
+    be transliterated in the same way as the second character.
+  - Where it is desired to show the Vedic accent Anudatta, it should be transliterated as an underscore. In the case of
+    the digraphs ai, au, both Latin vowels should be underscored.
+    Where word boundaries are not shown in the original text (as happens commonly in Sanskrit) and a word ends in a
+    consonant, the transliteration should show word division by a space; but when phonological processes result in two
+    words sharing a common vowel, no attempt should be made to separate them. This will require a good knowledge
+    of the language in question.
+
+
+
+tests:
+  - source: "ಈಗ ವೈರಲ್ ಆಗುತ್ತಿದೆ ಕಂಗನಾ ರಣಾವುತ್ ಹಳೇಯ ವಿಡಿಯೋ"
+    expected: "īga vaairala āgautataidae kaṁganaā raṇaāvauta haḷaēya vaiḍaiyaō"
+  - source: "ಸಂಕಷ್ಟ ಎದುರಾದರೆ ಬಿಎಸ್‌ವೈ ಬೆನ್ನಿಗೆ ಎಚ್‌ಡಿಕೆ ?"
+    expected: "saṁkaṣaṭa edauraādarae baiesavaai baenanaigae ecaḍaikae ?"
+  - source: "ಶಾಸಕರಿಂದಲೂ ಒತ್ತಡ?"
+    expected: "śaāsakaraiṁdalaū otataḍa?"
+  - source: "ಏಕೆಂದರೆ, ಇವರ ಹೆಸರೇ ಕೊರೊನಾ!"
+    expected: "ēkaeṁdarae, ivara haesaraē kaeūraonaā!"
+  - source: "ಕೊರೊನಾಕ್ಕಿಂತಲೂ ಮುಂಚೆಯೇ ಅವರು ಕೊರೊನಾ ಆಗಿದ್ದವರು!"
+    expected: "kaeūraonaākakaiṁtalaū mauṁcaeyaē avarau kaeūraonaā āgaidadavarau!"
+  - source: "ಕೇರಳದ ಕೊಟ್ಟಾಯಂನ ಮಹಿಳೆಯೊಬ್ಬರು ಈಗ ತಮ್ಮ ಹೆಸರು ಹೇಳಲು ಮುಜುಗರ ಪಡುವಂತಾಗಿದೆ"
+    expected: "kaēraḷada kaeūṭaṭaāyaṁna mahaiḷaeyaobabarau īga tamama haesarau haēḷalau maujaugara paḍauvaṁtaāgaidae"
+  - source: "ಬೇರೆ ಬೆಳವಣಿಗೆಗೆ ಸಾಕ್ಷಿ ಸಾಧ್ಯತೆ"
+    expected: "baērae baeḷavaṇaigaegae saākaṣai saādhayatae"
+  - source: "ಗುರು ಶನಿ ಗ್ರಹಗಳ ನಡುವೆ 3 ಜನರ ಪ್ರಯಾಣ"
+    expected: "gaurau śanai garahagaḷa naḍauvae 3 janara parayaāṇa"
+  - source: "ಕೊರೊನಾ ಬಿಕ್ಕಟ್ಟಿನ ಕಾಲದಲ್ಲಿ “ಮಿಸೆಸ್‌ ಕೊರೊನಾ’ಗೆ ಸಮಸ್ಯೆ!"
+    expected: "kaeūraonaā baikakaṭaṭaina kaāladalalai “maisaesa kaeūraonaā’gae samasayae!"
+  - source: "ಕೆಲವು ತಿಂಗಳಿಂದ ರಷ್ಯಾ ದೇಶದ ಏನಾಟೊಲಿ ಇವ್ಯಾನಿಶಿನ್‌ ಮತ್ತು ಇವಾನ್‌ ವ್ಯಾಗನರ್‌ ಹಾಗೂ ಅಮೆರಿಕಾದ ಕ್ರಿಸ್‌ ಕ್ಯಾಸಿಡಿ ಈ ಉಪಗ್ರಹದಲ್ಲಿ ವಾಸಿಸುತ್ತಿದ್ದಾರೆ"
+    expected: "kaelavau taiṁgaḷaiṁda raṣayaā daēśada ēnaāṭaeūlai ivayaānaiśaina matatau ivaāna vayaāganara haāgaū amaeraikaāda karaisa kayaāsaiḍai ī upagarahadalalai vaāsaisautataidadaārae"
+  - source: "ಹಾಂಗ್ ಕಾಂಗ್"
+    expected: "haāṁga kaāṁga"
+  - source: "೧೮೧೪೦"
+    expected: "18140"
+
+
+map:
+
+  characters:
+    'ಅ': 'a'
+    'ಆ': 'ā'
+    'ಇ': 'i'
+    'ಈ': 'ī'
+    'ಉ': 'u'
+    'ಊ': 'ū'
+    'ಋ': 'ṛ'
+    'ೠ': "ṝ"
+    'ಌ': 'ḻ'
+    'ೡ': 'ḹ'
+    'ಎ': 'e'
+    'ಏ': 'ē'
+    'ಐ': 'ai'
+
+    'ಒ': 'o'
+    'ಓ': 'ō'
+    'ಔ': 'au'
+
+    # II. Consonants (see Note 2)
+    # Gutturals
+    'ಕ': 'ka'
+    'ಖ': 'kha'
+    'ಗ': 'ga'
+    'ಘ': 'gha'
+    'ಙ': 'ṅa'
+
+    # Palatals
+    'ಚ': 'ca'
+    'ಛ': 'cha'
+    'ಜ': 'ja'
+    'ಝ': 'jha'
+    'ಞ': 'ña'
+
+    # Cerebrals
+    'ಟ': 'ṭa'
+    'ಠ': 'ṭha'
+    'ಡ': 'ḍa'
+    'ಢ': 'ḍha'
+    'ಣ': 'ṇa'
+
+    # Dentals
+    'ತ': 'ta'
+    'ಥ': 'tha'
+    'ದ': 'da'
+    'ಧ': 'dha'
+    'ನ': 'na'
+
+    # Labials
+    'ಪ': 'pa'
+    'ಫ': 'pha'
+    'ಬ': 'ba'
+    'ಭ': 'bha'
+    'ಮ': 'ma'
+
+    # Semivowels
+    'ಯ': 'ya'
+    'ರ': 'ra'
+    'ಱ': 'ṟa'
+    'ಲ': 'la'
+    'ಳ': 'ḷa'
+    'ವ': 'va'
+
+    # Sibilants
+    'ಶ': 'śa'
+    'ಷ': 'ṣa'
+    'ಸ': 'sa'
+
+
+    # Aspirate
+    'ಹ': 'ha'
+
+    'ಜ಼': 'za'
+    'ಫ಼': 'fa'
+
+    # Bisarga
+    'ಃ': 'ḥ'
+
+    'ೱ': 'ẖ'
+    'ೲ': 'ḫ'
+
+
+    # candrabindu
+    '\u0C80': 'm̐'
+    '\u0C81': 'm̐'
+
+    # Abagraha
+    'ಽ': ':’' # (apostrophe)
+
+    # Anusvāra
+    'ಂ': 'ṁ'
+
+    '಼': '' #nukta
+
+    # Medials # Needed for connecting constants
+    'ಾ': "ā"
+    'ಿ': "i"
+    'ೀ': "ī"
+    'ು': "u"
+    'ೂ': "ū"
+
+    'ೃ': "ṛ"
+    'ೄ': "ṝ"
+    ' ೢ': 'ḷ'
+    ' ೣ': 'ḹ'
+
+    'ೆ': "e"
+    'ೇ': "ē"
+    'ೈ': "ai"
+
+
+    'ೊ': 'o'
+    'ೋ': 'ō'
+    'ೌ': 'au'
+
+    '्': ''
+    '़': ''
+    '್': ''
+    "‍": '' # no need for zero with joiner
+    "‌": '' # no need for zero with non joiner ': 'ya'
+
+
+    # for semivowel rule no. 5
+    'ಯಀ': 'm̐ya'
+    'ರಀ': 'm̐ra'
+    'ಱಀ': 'm̐ṟa'
+    'ಲಀ': 'm̐la'
+    'ಳಀ': 'm̐ḷa'
+    'ವಀ': 'm̐va'
+
+    # numbers
+
+    '೧': '1'
+    '೨': '2'
+    '೩': '3'
+    '೪': '4'
+    '೫': '5'
+    '೬': '6'
+    '೭': '7'
+    '೮': '8'
+    '೯': '9'
+    '೦': '0'

data/maps/iso-kat-Geor-Latn-9984-1996.yaml

@@ -0,0 +1,145 @@
+---
+authority_id: iso
+id: 9984-1996
+language: iso-639-2:kat
+source_script: Geor
+destination_script: Latn
+name: "ISO 9984:1996 Information and documentation — Transliteration of Georgian characters into Latin characters"
+url: https://www.iso.org/standard/17892.html
+creation_date: 1996
+confirmation_date: 1996
+description: |
+  Establishes a system for the transliteration of Georgian characters
+  into Latin characters to permit international information exchange,
+  particularly by electronic means.
+
+notes:
+
+tests:
+
+  - source: ხაოფსე
+    expected: xaop̕se
+
+  - source: ჭლოუ
+    expected: člou
+
+  - source: ჩოხულდი
+    expected: č̕oxuldi
+
+  - source: ქვემო ლინდა
+    expected: k̕vemo linda
+
+  - source: ტამკვაჩ იგვავერა
+    expected: tamkvač̕ igvavera
+
+  - source: სვანეთი
+    expected: svanet̕i
+
+  - source: საცხვარისი
+    expected: sac̕xvarisi
+
+  - source: მუხრან-თელეთი
+    expected: muxran-t̕elet̕i
+
+  - source: მუცდი
+    expected: muc̕di
+
+  - source: ლეჩხუმი
+    expected: leč̕xumi
+
+  - source: ვერხნაია მწარა
+    expected: verxnaia mcara
+
+  - source: ეგრისის ქედი
+    expected: egrisis k̕edi
+
+  - source: დოჩარიფშა
+    expected: doč̕arip̕ša
+
+  - source: ბოლოკო
+    expected: boloko
+
+  - source: აჭანდარა
+    expected: ačandara
+
+  - source: აუალიცა
+    expected: aualic̕a
+
+  - source: აკალამრა
+    expected: akalamra
+
+  - source: ლასილი
+    expected: lasili
+
+  - source: გუბაზეული
+    expected: gubazeuli
+
+  - source: ბაყაყი
+    expected: baqaqi
+
+  - source: ძროხა
+    expected: jroxa
+
+  - source: ჰაერი
+    expected: haeri
+
+  - source: ჟოლო
+    expected: žolo
+
+  - source: ჯართი
+    expected: ǰart̕i
+
+  - source: ღრმაღელე
+    expected: ḡrmaḡele
+
+map:
+  characters:
+    '\u10d0' : 'a' # ა
+    '\u10d1' : 'b' # ბ
+    '\u10d2' : 'g' # გ
+    '\u10d3' : 'd' # დ
+    '\u10d4' : 'e' # ე
+    '\u10d5' : 'v' # ვ
+    '\u10d6' : 'z' # ზ
+
+    '\u10f1' : 'ē' # ჱ
+
+    '\u10d7' : 't̕' # თ
+    '\u10d8' : 'i' # ი
+    '\u10d9' : 'k' # კ
+    '\u10da' : 'l' # ლ
+    '\u10db' : 'm' # მ
+    '\u10dc' : 'n' # ნ
+
+    '\u10f2' : 'y' # ჲ
+
+    '\u10dd' : 'o' # ო
+    '\u10de' : 'p' # პ
+    '\u10df' : 'ž' # ჟ
+    '\u10e0' : 'r' # რ
+    '\u10e1' : 's' # ს
+    '\u10e2' : 't' # ტ
+
+    '\u10f3' : 'w' # ჳ
+
+    '\u10e3' : 'u' # უ
+    '\u10e4' : 'p̕' # ფ
+    '\u10e5' : 'k̕' # ქ
+    '\u10e6' : 'ḡ' # ღ
+    '\u10e7' : 'q' # ყ
+    '\u10e8' : 'š' # შ
+    '\u10e9' : 'č̕' # ჩ
+    '\u10ea' : 'c̕' # ც
+    '\u10eb' : 'j' # ძ
+    '\u10ec' : 'c' # წ
+    '\u10ed' : 'č' # ჭ
+    '\u10ee' : 'x' # ხ
+
+    '\u10f4' : 'ẖ' # ჴ
+
+    '\u10ef' : 'ǰ' # ჯ
+    '\u10f0' : 'h' # ჰ
+
+    '\u10f5' : 'ō' # ჵ
+
+    '\u10f6' : 'f' # ჶ