interscript 0.1.1 → 0.1.6

data/maps/odni-rus-Cyrl-Latn-2015.yaml

@@ -0,0 +1,77 @@
+---
+authority_id: odni
+id: 2015
+language: rus
+source_script: Cyrl
+destination_script: Latn
+name: Office of the Director Of National Intelligence Russian Personal Names 2015, ICS-630-01 Annex K
+# url:
+source: ICS-630-01 Annex K
+creation_date: 2015
+confirmation_date: 2015
+description: |
+  This system, adapted from the Board of Geographic Names (BGN) Romanization system for Russian
+  (1947), is the Intelligence Community (IC) standard for the transliteration of Russian names that will be
+  applied to all final written reports and products for IC consumers. It is not intended to eliminate variations
+  of a name that can contribute forensic information. Rather, it is to provide an IC standard Romanized
+  (English) transliteration from Russian that can then be linked to forensic information in ways that will
+  help identify the referent of the name.
+
+  In cases where an individual’s name has already been transliterated in a variant spelling, the IC Standard
+  spelling should appear first, followed by the variant spelling(s) in parentheses at the first usage. E.g.,
+  Sergey Nikolayevich Tyurin (Serguei Nicolaivitch Tiourine). In addition, if the original Cyrillic spelling
+  is known, that spelling should also appear in parentheses following the name, if possible, following best
+  practices of the issuing organization and taking into consideration information system capabilities. This
+  convention is designed to ensure that vital forensic information is not lost.
+
+  For non-Russian names, use the relevant IC transliteration standard for names from that language. A
+  translator’s note may be used to clarify the known origin of the person. Spell names of individuals from
+  languages that are written in Roman letters as they are spelled in those languages (e.g., George Clooney,
+  Jorge Garcia, Georges Pompidou).
+
+  In the case of active senior government officials in the on-line CIA World Factbook and the on-line
+  directory of Chiefs of State and Cabinet Members of Foreign Governments, the spellings given in these
+  on-line reference works should be used in place of the IC Standard. For any individual who has at one
+  time been listed in the Factbook or Chiefs of State directory but who no longer appears in those resources
+  (i.e. is no longer a government official), the IC Standard spelling should appear first, with the spelling, if
+  known, as it previously appeared in those resources listed within parentheses at the first usage.
+
+  The primary goal is to produce a consistent Romanized transcription of names that is specifically readable
+  to the English-speaking non-specialist. The system uses the 26 letters of the standard (English) Roman
+  alphabet. Some ambiguities in the Romanized form will occur without the use of diacritics. However,
+  within the context of a report, where additional information about the individual is provided, the referent
+  will be clearly identified. This system will be used in conjunction with on-line tools, name dictionaries,
+  and lists containing conventional spellings of names of well-known individuals.
+
+notes:
+
+tests:
+  - source: Ирина Ивановна Никитина
+    expected: Irina Ivanovna Nikitina
+  - source: Николай Римский-Корсаков
+    expected: Nikolay Rimskiy-Korsakov
+  - source: Михаил Тимофеевич Калашников
+    expected: Mikhail Timofeyevich Kalashnikov
+  - source: Корж Василий Захарович
+    expected: Korzh Vasiliy Zakharovich
+  - source: Циолковский Константин Эдуардович
+    expected: Tsiolkovskiy Konstantin Eduardovich
+  - source: Лобачевский Николай Иванович
+    expected: Lobachevskiy Nikolay Ivanovich
+  - source: Пушкин Александр Сергеевич
+    expected: Pushkin Aleksandr Sergeyevich
+  - source: Гоголь Николай Васильевич
+    expected: Gogol Nikolay Vasilyevich
+  - source: Ломоносов Михаил Васильевич
+    expected: Lomonosov Mikhail Vasilyevich
+
+map:
+  inherit: bgnpcgn-rus-Cyrl-Latn-1947
+
+  characters:
+    '\u042a': '' # Ъ
+    '\u042c': '' # Ь
+
+
+    '\u044a': '' # ъ
+    '\u044c': '' # ь

data/maps/odni-srp-Cyrl-Latn-2015.yaml

@@ -0,0 +1,129 @@
+---
+authority_id: odni
+id: 2015
+language: srp
+source_script: Cyrl
+destination_script: Latn
+name: Office of the Director Of National Intelligence Serbian Personal Names 2015, ICS-630-01 Annex L
+# url:
+source: ICS-630-01 Annex L
+creation_date: 2015
+confirmation_date: 2015
+description: |
+  This system is the Intelligence Community (IC) standard for the transliteration of Serbian names
+  written in Cyrillic that will be applied to all final written reports and products for IC consumers. It
+  is not intended to eliminate variations of a name that can contribute forensic information. Rather,
+  it is to provide an IC standard Romanized (English) transliteration from Serbian that can then be
+  linked to forensic information in ways that will help identify the referent of the name.
+
+  In cases where an individual’s name has already been transliterated in a variant spelling, the IC
+  Standard spelling should appear first, followed by the variant spelling(s) in parentheses at the first
+  usage. In addition, if the original Cyrillic spelling is known, that spelling should also appear in
+  parentheses following the name, if possible, following best practices of the issuing organization
+  and taking into consideration information system capabilities. This convention is designed to
+  ensure that vital forensic information is not lost.
+
+  For names of persons who are known to not be part of the Serbian-speaking community, use the
+  relevant IC transliteration standard for names from that language (e.g., Mikhail, Yitzhak). A
+  translator’s note may be used to clarify the known origin of the person. Spell names of
+  individuals from languages that are written in Roman letters as they are spelled in those
+  languages (e.g., George Clooney, Jorge Garcia, Georges Pompidou).
+
+  In the case of active senior government officials in the on-line CIA World Factbook and the online directory of Chiefs of State and Cabinet Members of Foreign Governments, the spellings
+  given in these on-line reference works should be used in place of the IC Standard. For any
+  individual who has at one time been listed in the Factbook or Chiefs of State directory but who no
+  longer appears in those resources (i.e. is no longer a government official), the IC Standard
+  spelling should appear first, with the spelling, if known, as it previously appeared in those
+  resources listed within parentheses at the first usage.
+
+  The primary goal is to produce a consistent Romanized transcription of names that is specifically
+  readable to the English-speaking non-specialist. The system uses the 26 letters of the standard
+  (English) Roman alphabet. Some ambiguities in the Romanized form will occur without the use
+  of diacritics. However, within the context of a report, where additional information about the
+  individual is provided, the referent will be clearly identified. This system will be used in
+  conjunction with on-line tools, name dictionaries, and lists containing conventional spellings of
+  names of well-known individuals.
+
+notes:
+
+tests:
+  - source: Гојко Митић
+    expected: Gojko Mitic
+  - source: Горња Ваганица
+    expected: Gornja Vaganica
+  - source: Довиђења
+    expected: Dovidjenja
+  - source: Ћао! Здраво!
+    expected: Cao! Zdravo!
+  - source: Кључ
+    expected: Kljuc
+  - source: Цигарете
+    expected: Cigarete
+  - source: Пролеће
+    expected: Prolece
+  - source: Понедељак
+    expected: Ponedeljak
+
+map:
+  characters:
+    '\u0410': 'A'  # А
+    '\u0411': 'B'  # Б
+    '\u0412': 'V'  # В
+    '\u0413': 'G'  # Г
+    '\u0414': 'D'  # Д
+    '\u0402': 'Dj' # Ђ
+    '\u0415': 'E'  # Е
+    '\u0416': 'Z'  # Ж
+    '\u0417': 'Z'  # З
+    '\u0418': 'I'  # И
+    '\u0408': 'J'  # Ј
+    '\u041A': 'K'  # К
+    '\u041B': 'L'  # Л
+    '\u0409': 'Lj' # Љ
+    '\u041C': 'M'  # М
+    '\u041D': 'N'  # Н
+    '\u040A':  Nj  # Њ
+    '\u041E': 'O'  # О
+    '\u041F': 'P'  # П
+    '\u0420': 'R'  # Р
+    '\u0421': 'S'  # С
+    '\u0422': 'T'  # Т
+    '\u040B': 'C'  # Ћ
+    '\u0423': 'U'  # У
+    '\u0424': 'F'  # Ф
+    '\u0425': 'H'  # Х
+    '\u0426': 'C'  # Ц
+    '\u0427': 'C'  # Ч
+    '\u040F': 'Dz' # Џ
+    '\u0428': 'S'  # Ш
+
+    '\u0430': 'a'  # а
+    '\u0431': 'b'  # б
+    '\u0432': 'v'  # в
+    '\u0433': 'g'  # г
+    '\u0434': 'd'  # д
+    '\u0452': 'dj' # ђ
+    '\u0435': 'e'  # e
+    '\u0436': 'z'  # ж
+    '\u0437': 'z'  # з
+    '\u0438': 'i'  # и
+    '\u0458': 'j'  # ј
+    '\u043A': 'k'  # к
+    '\u043B': 'l'  # л
+    '\u0459': 'lj' # љ
+    '\u043C': 'm'  # м
+    '\u043D': 'n'  # н
+    '\u045A': 'nj' # њ
+    '\u043E': 'o'  # о
+    '\u043F': 'p'  # п
+    '\u0440': 'r'  # р
+    '\u0441': 's'  # с
+    '\u0442': 't'  # т
+    '\u045B': 'c'  # ћ
+    '\u0443': 'u'  # у
+    '\u0444': 'f'  # ф
+    '\u0445': 'h'  # х
+    '\u0446': 'c'  # ц
+    '\u0447': 'c'  # ч
+    '\u045F': 'dz' # џ
+    '\u0448': 's'  # ш

data/maps/odni-tat-Cyrl-Latn-2015.yaml

@@ -0,0 +1,142 @@
+---
+authority_id: odni
+id: 2015
+language: tat
+source_script: Cyrl
+destination_script: Latn
+name: Standards for the transliteration of tatar personal names in written reports and products
+source: ICS-630-01 Annex S
+creation_date: 2015
+confirmation_date: 2015
+description: |
+  This system is the Intelligence Community standard for the transliteration of Tatar person names
+  that will be applied to all final written reports and products for IC consumers. It is not intended
+  to eliminate variations of a name that can contribute forensic information. Rather, it is to provide
+  an IC standard Romanized (English) transliteration from Tatar that can then be linked to forensic
+  information in ways that will help identify the referent of the name.
+
+  In cases where an individual’s name has already been transliterated in a variant spelling, the IC
+  Standard spelling should appear first, followed by the variant spelling(s) in parentheses at the
+  first usage. In addition, if the original Cyrillic-script spelling is known, that spelling should
+  also appear in parentheses following the name, if possible, following best practices of the
+  issuing organization and taking into consideration information system capabilities. For example:
+  Rustam Abdrashitov (also seen as Rustem Abdrashitov, Рустам Абдрашитов). This convention is
+  designed to ensure that vital forensic information is not lost.
+
+  For names of persons who are known to not be part of the Tatar-speaking community, use the
+  relevant IC transliteration standard for names from that language (e.g., Yitzhak). A translator’s
+  note may be used to clarify the known origin of the person. Spell names of individuals from
+  languages that are written in Roman letters as they are spelled in those languages (e.g.,
+  George Clooney, Jorge Garcia, Georges Pompidou).
+
+  In the case of active senior government officials in the on-line CIA World Factbook and the on-
+  line directory of Chiefs of State and Cabinet Members of Foreign Governments, the spellings given
+  in these on-line reference works should be used in place of the IC Standard. For any individual
+  who has at one time been listed in the Factbook or Chiefs of State directory but who no longer
+  appears in those resources (i.e. is no longer a government official), the IC Standard spelling
+  should appear first, with the spelling, if known, as it previously appeared in those resources
+  listed within parentheses at the first usage.
+
+  The primary goal is to produce a consistent Romanized transcription of names that is specifically
+  readable to the English-speaking non-specialist. The system uses the 26 letters of the standard
+  (English) Roman alphabet. Some ambiguities in the Romanized form will occur without the use of
+  diacritics. However, within the context of a report, where additional information about the
+  individual is provided, the referent will be clearly identified. This system will be used in
+  conjunction with on-line tools, name dictionaries, and lists containing conventional spellings of
+  names of well-known individuals.
+
+notes:
+  - Transliterate double digraphs as a single digraph, i.e. шш -> sh, not shsh
+  - In the Roman, no distinction is made between digraphs such as 'sh' and single contiguous letters,
+    (e.g. 's' followed by 'h').
+  - The Cyrillic ъ and ь are not transliterated, but instead are left out of the transliteration.
+
+tests:
+  - source: Рустам Абдрашитов
+    expected: Rustam Abdrashitov
+
+map:
+  rules:
+    # note[1]
+    - pattern: "(?i)(\u0401|\u0416|\u04A2|\u0425|\u0426|\u0427|\u0428|\u0429|\u042E|\u042F)\\1(?-i)"
+      result: "\\1"
+    # note[3]
+    - pattern: \u044A|\u044C
+      result: ""
+
+  characters:
+    '\u0410': 'A'      # А
+    '\u04D8': 'A'      # Ә
+    '\u0411': 'B'      # Б
+    '\u0412': 'V'      # В
+    '\u0413': 'G'      # Г
+    '\u0414': 'D'      # Д
+    '\u0415': 'E'      # Е
+    '\u0401': 'Yo'     # Ё
+    '\u0416': 'Zh'     # Ж
+    '\u0496': 'J'      # Җ
+    '\u0417': 'Z'      # З
+    '\u0418': 'I'      # И
+    '\u0419': 'Y'      # Й
+    '\u041A': 'K'      # К
+    '\u041B': 'L'      # Л
+    '\u041C': 'M'      # М
+    '\u041D': 'N'      # Н
+    '\u04A2': 'Ng'     # Ң
+    '\u041E': 'O'      # О
+    '\u04E8': 'O'      # Ө
+    '\u041F': 'P'      # П
+    '\u0420': 'R'      # Р
+    '\u0421': 'S'      # С
+    '\u0422': 'T'      # Т
+    '\u0423': 'U'      # У
+    '\u04AE': 'U'      # Ү
+    '\u0424': 'F'      # Ф
+    '\u0425': 'Kh'     # Х
+    '\u04BA': 'H'      # Һ
+    '\u0426': 'Ts'     # Ц
+    '\u0427': 'Ch'     # Ч
+    '\u0428': 'Sh'     # Ш
+    '\u0429': 'Shch'   # Щ
+    '\u042B': 'Y'      # Ы
+    '\u042D': 'E'      # Э
+    '\u042E': 'Yu'     # Ю
+    '\u042F': 'Ya'     # Я
+
+    '\u0430': 'a'      # а
+    '\u04D9': 'a'      # ә
+    '\u0431': 'b'      # б
+    '\u0432': 'v'      # в
+    '\u0433': 'g'      # г
+    '\u0434': 'd'      # д
+    '\u0435': 'e'      # e
+    '\u0451': 'yo'     # ё
+    '\u0436': 'zh'     # ж
+    '\u0497': 'j'      # җ
+    '\u0437': 'z'      # з
+    '\u0438': 'i'      # и
+    '\u0439': 'y'      # й
+    '\u043A': 'k'      # к
+    '\u043B': 'l'      # л
+    '\u043C': 'm'      # м
+    '\u043D': 'n'      # н
+    '\u04A3': 'ng'     # ң
+    '\u043E': 'o'      # о
+    '\u04E9': 'o'      # ө
+    '\u043F': 'p'      # п
+    '\u0440': 'r'      # р
+    '\u0441': 's'      # с
+    '\u0442': 't'      # т
+    '\u0443': 'u'      # у
+    '\u04AF': 'u'      # ү
+    '\u0444': 'f'      # ф
+    '\u0445': 'kh'     # х
+    '\u04BB': 'h'      # һ
+    '\u0446': 'ts'     # ц
+    '\u0447': 'ch'     # ч
+    '\u0448': 'sh'     # ш
+    '\u0449': 'shch'   # щ
+    '\u044B': 'y'      # ы
+    '\u044D': 'e'      # э
+    '\u044E': 'yu'     # ю
+    '\u044F': 'ya'     # я

data/maps/odni-tgk-Cyrl-Latn-2015.yaml

@@ -0,0 +1,148 @@
+---
+authority_id: odni
+id: 2015
+language: tgk
+source_script: Cyrl
+destination_script: Latn
+name: Standards for the transliteration of tajik personal names in written reports and products
+source: ICS-630-01 Annex N
+creation_date: 2015
+confirmation_date: 2015
+description: |
+  This system is the Intelligence Community standard for the transliteration of Tajik names that
+  will be applied to all final written reports and products for IC consumers. It is not intended to
+  eliminate variations of a name that can contribute forensic information. Rather, it is to provide
+  an IC standard Romanized (English) transliteration from Tajik that can then be linked to forensic
+  information in ways that will help identify the referent of the name.
+
+  In cases where an individual’s name has already been transliterated in a variant spelling, the IC
+  Standard spelling should appear first, followed by the variant spelling(s) in parentheses at the
+  first usage. In addition, if the original Cyrillic-script spelling is known, that spelling should
+  also appear in parentheses following the name, if possible, following best practices of the
+  issuing organization and taking into consideration information system capabilities. For example:
+  Parvona Jamshedov (also seen as Parvona Dzhamshedov, Парвона Ҷамшедов). This convention is
+  designed to ensure that vital forensic information is not lost.
+
+  For names of persons who are known to not be part of the Tajik-speaking community, use the
+  relevant IC transliteration standard for names from that language (e.g., Mikhail, Yitzhak).
+  A translator’s note may be used to clarify the known origin of the person. Spell names of
+  individuals from languages that are written in Roman letters as they are spelled in those
+  languages (e.g., George Clooney, Jorge Garcia, Georges Pompidou).
+
+  In the case of active senior government officials in the on-line CIA World Factbook and the on-
+  line directory of Chiefs of State and Cabinet Members of Foreign Governments, the spellings given
+  in these on-line reference works should be used in place of the IC Standard. For any individual
+  who has at one time been listed in the Factbook or Chiefs of State directory but who no longer
+  appears in those resources (i.e. is no longer a government official), the IC Standard spelling
+  should appear first, with the spelling, if known, as it previously appeared in those resources
+  listed within parentheses at the first usage.
+
+  The primary goal is to produce a consistent Romanized transcription of names that is specifically
+  readable to the English-speaking non-specialist. The system uses the 26 letters of the standard
+  (English) Roman alphabet. Some ambiguities in the Romanized form will occur without the use of
+  diacritics. However, within the context of a report, where additional information about the
+  individual is provided, the referent will be clearly identified. This system will be used in
+  conjunction with on-line tools, name dictionaries, and lists containing conventional spellings of
+  names of well-known individuals.
+
+notes:
+  - Transliterate double digraphs as a single digraph, i.e. шш -> sh, not shsh
+  - In the Roman, no distinction is made between digraphs such as 'sh' and single contiguous letters,
+    (e.g. 's' followed by 'h').
+  - The Cyrillic ъ and ь are not transliterated, but instead are left out of the transliteration.
+  - Transliterate ‘е‘ as ‘ye’ at beginning of words, ‘e’ elsewhere
+
+tests:
+  - source: Парвона Ҷамшедов
+    expected: Parvona Jamshedov
+
+map:
+  rules:
+    # note[1]
+    - pattern: "(?i)(\u0492|\u0401|\u0416|\u0425|\u0427|\u0428|\u042E|\u042F|\u0426|\u0429)\\1(?-i)"
+      result: "\\1"
+    # note[3]
+    - pattern: \u044A|\u044C
+      result: ""
+    # note[4]
+    - pattern: \b\u0415
+      result: Ye
+    - pattern: \b\u0435
+      result: ye
+
+  characters:
+    '\u0410': 'A'      # А
+    '\u0411': 'B'      # Б
+    '\u0412': 'V'      # В
+    '\u0413': 'G'      # Г
+    '\u0492': 'Gh'     # Ғ
+    '\u0414': 'D'      # Д
+    '\u0415': 'E'      # Е
+    '\u0401': 'Yo'     # Ё
+    '\u0416': 'Zh'     # Ж
+    '\u0417': 'Z'      # З
+    '\u0418': 'I'      # И
+    '\u04E2': 'I'      # Ӣ
+    '\u0419': 'Y'      # Й
+    '\u041A': 'K'      # К
+    '\u049A': 'Q'      # Қ
+    '\u041B': 'L'      # Л
+    '\u041C': 'M'      # М
+    '\u041D': 'N'      # Н
+    '\u041E': 'O'      # О
+    '\u041F': 'P'      # П
+    '\u0420': 'R'      # Р
+    '\u0421': 'S'      # С
+    '\u0422': 'T'      # Т
+    '\u0423': 'U'      # У
+    '\u04EE': 'U'      # Ӯ
+    '\u0424': 'F'      # Ф
+    '\u0425': 'Kh'     # Х
+    '\u04B2': 'H'      # Ҳ
+    '\u0427': 'Ch'     # Ч
+    '\u04B6': 'J'      # Ҷ
+    '\u0428': 'Sh'     # Ш
+    '\u042D': 'E'      # Э
+    '\u042E': 'Yu'     # Ю
+    '\u042F': 'Ya'     # Я
+    '\u0426': 'Ts'     # Ц
+    '\u0429': 'Shch'   # Щ
+    '\u042B': 'Y'      # Ы
+
+    '\u0430': 'a'      # а
+    '\u0431': 'b'      # б
+    '\u0432': 'v'      # в
+    '\u0433': 'g'      # г
+    '\u0493': 'gh'     # ғ
+    '\u0434': 'd'      # д
+    '\u0435': 'e'      # e
+    '\u0451': 'yo'     # ё
+    '\u0436': 'zh'     # ж
+    '\u0437': 'z'      # з
+    '\u0438': 'i'      # и
+    '\u04E3': 'i'      # ӣ
+    '\u0439': 'y'      # й
+    '\u043A': 'k'      # к
+    '\u049B': 'q'      # қ
+    '\u043B': 'l'      # л
+    '\u043C': 'm'      # м
+    '\u043D': 'n'      # н
+    '\u043E': 'o'      # о
+    '\u043F': 'p'      # п
+    '\u0440': 'r'      # р
+    '\u0441': 's'      # с
+    '\u0442': 't'      # т
+    '\u0443': 'u'      # у
+    '\u04EF': 'u'      # ӯ
+    '\u0444': 'f'      # ф
+    '\u0445': 'kh'     # х
+    '\u04B3': 'h'      # ҳ
+    '\u0447': 'ch'     # ч
+    '\u04B7': 'j'      # ҷ
+    '\u0448': 'sh'     # ш
+    '\u044D': 'e'      # э
+    '\u044E': 'yu'     # ю
+    '\u044F': 'ya'     # я
+    '\u0446': 'ts'     # ц
+    '\u0449': 'shch'   # щ
+    '\u044B': 'y'      # ы