RubyGems - rroonga - Versions diffs - 7.1.1-x64-mingw32 → 9.0.2-x64-mingw32 - Mend

rroonga 7.1.1-x64-mingw32 → 9.0.2-x64-mingw32

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Files changed (980) hide show

data/vendor/local/share/doc/groonga/en/html/reference/token_filters/token_filter_nfkc100.html ADDED Viewed

@@ -0,0 +1,626 @@
+<!DOCTYPE html>
+<html xmlns="http://www.w3.org/1999/xhtml" lang="en">
+  <head>
+    <meta charset="utf-8" />
+    <title>7.9.2. TokenFilterNFKC100 &#8212; Groonga v9.0.2 documentation</title>
+    <link rel="stylesheet" href="../../_static/groonga.css" type="text/css" />
+    <link rel="stylesheet" href="../../_static/pygments.css" type="text/css" />
+    <script type="text/javascript" id="documentation_options" data-url_root="../../" src="../../_static/documentation_options.js"></script>
+    <script type="text/javascript" src="../../_static/jquery.js"></script>
+    <script type="text/javascript" src="../../_static/underscore.js"></script>
+    <script type="text/javascript" src="../../_static/doctools.js"></script>
+    <script type="text/javascript" src="../../_static/language_data.js"></script>
+    <link rel="shortcut icon" href="../../_static/favicon.ico"/>
+    <link rel="index" title="Index" href="../../genindex.html" />
+    <link rel="search" title="Search" href="../../search.html" />
+    <link rel="next" title="7.9.3. TokenFilterStem" href="token_filter_stem.html" />
+    <link rel="prev" title="7.9.1. Summary" href="../token_filter/summary.html" />
+  </head><body>
+<div class="header">
+  <h1 class="title">
+    <a id="top-link" href="../../index.html">
+      <span class="project">groonga</span>
+      <span class="separator">-</span>
+      <span class="description">An open-source fulltext search engine and column store.</span>
+    </a>
+  </h1>
+  <div class="other-language-links">
+    <ul>
+      <li><a href="../../../../ja/html/reference/token_filters/token_filter_nfkc100.html">日本語</a></li>
+    </ul>
+  </div>
+</div>
+    <div class="related" role="navigation" aria-label="related navigation">
+      <h3>Navigation</h3>
+      <ul>
+        <li class="right" style="margin-right: 10px">
+          <a href="../../genindex.html" title="General Index"
+             accesskey="I">index</a></li>
+        <li class="right" >
+          <a href="token_filter_stem.html" title="7.9.3. TokenFilterStem"
+             accesskey="N">next</a> |</li>
+        <li class="right" >
+          <a href="../token_filter/summary.html" title="7.9.1. Summary"
+             accesskey="P">previous</a> |</li>
+        <li class="nav-item nav-item-0"><a href="../../index.html">Groonga v9.0.2 documentation</a> &#187;</li>
+          <li class="nav-item nav-item-1"><a href="../../reference.html" >7. Reference manual</a> &#187;</li>
+          <li class="nav-item nav-item-2"><a href="../token_filters.html" accesskey="U">7.9. Token filters</a> &#187;</li>
+      </ul>
+    </div>
+    <div class="document">
+      <div class="documentwrapper">
+        <div class="bodywrapper">
+          <div class="body" role="main">
+  <div class="section" id="tokenfilternfkc100">
+<h1>7.9.2. <code class="docutils literal notranslate"><span class="pre">TokenFilterNFKC100</span></code><a class="headerlink" href="#tokenfilternfkc100" title="Permalink to this headline">¶</a></h1>
+<div class="section" id="summary">
+<h2>7.9.2.1. Summary<a class="headerlink" href="#summary" title="Permalink to this headline">¶</a></h2>
+<div class="versionadded">
+<p><span class="versionmodified added">New in version 8.0.9.</span></p>
+</div>
+<p>This token filter can use the same option by <a class="reference internal" href="../normalizers/normalizer_nfkc100.html#normalizer-nfkc100"><span class="std std-ref">NormalizerNFKC100</span></a>.
+This token filter is used to normalize after tokenizing.
+Because, if you normalize before tokenizing with <code class="docutils literal notranslate"><span class="pre">TokenMecab</span></code> , the meaning of a token may be lost.</p>
+</div>
+<div class="section" id="syntax">
+<h2>7.9.2.2. Syntax<a class="headerlink" href="#syntax" title="Permalink to this headline">¶</a></h2>
+<p><code class="docutils literal notranslate"><span class="pre">TokenFilterNFKC100</span></code> has optional parameter.</p>
+<p>No options:</p>
+<div class="highlight-none notranslate"><div class="highlight"><pre><span></span>TokenFilterNFKC100
+</pre></div>
+</div>
+<p><code class="docutils literal notranslate"><span class="pre">TokenFilterNFKC100</span></code> normalizes text by Unicode NFKC (Normalization Form Compatibility Composition)
+for Unicode version 10.0.</p>
+<p>Specify option:</p>
+<div class="highlight-none notranslate"><div class="highlight"><pre><span></span>TokenFilterNFKC100(&quot;unify_kana&quot;, true)
+TokenFilterNFKC100(&quot;unify_kana_case&quot;, true)
+TokenFilterNFKC100(&quot;unify_kana_voiced_sound_mark&quot;, true)
+TokenFilterNFKC100(&quot;unify_hyphen&quot;, true)
+TokenFilterNFKC100(&quot;unify_prolonged_sound_mark&quot;, true)
+TokenFilterNFKC100(&quot;unify_hyphen_and_prolonged_sound_mark&quot;, true)
+TokenFilterNFKC100(&quot;unify_middle_dot&quot;, true)
+TokenFilterNFKC100(&quot;unify_katakana_v_sounds&quot;, true)
+TokenFilterNFKC100(&quot;unify_katakana_bu_sound&quot;, true)
+TokenFilterNFKC100(&quot;unify_to_romaji&quot;, true)
+</pre></div>
+</div>
+</div>
+<div class="section" id="usage">
+<h2>7.9.2.3. Usage<a class="headerlink" href="#usage" title="Permalink to this headline">¶</a></h2>
+</div>
+<div class="section" id="simple-usage">
+<h2>7.9.2.4. Simple usage<a class="headerlink" href="#simple-usage" title="Permalink to this headline">¶</a></h2>
+<p>Here is an example of <code class="docutils literal notranslate"><span class="pre">TokenFilterNFKC100</span></code>. <code class="docutils literal notranslate"><span class="pre">TokenFilterNFKC100</span></code> normalizes text by Unicode NFKC (Normalization Form Compatibility Composition) for Unicode version 10.0.</p>
+<p>Execution example:</p>
+<div class="highlight-none notranslate"><div class="highlight"><pre><span></span>tokenize TokenDelimit &quot;㎡&quot; --token_filters &#39;TokenFilterNFKC100&#39;
+# [
+#   [
+#     0,
+#     1546906509.304568,
+#     0.0002825260162353516
+#   ],
+#   [
+#     {
+#       &quot;value&quot;: &quot;m2&quot;,
+#       &quot;position&quot;: 0,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     }
+#   ]
+# ]
+</pre></div>
+</div>
+<p>Here is an example of <a class="reference internal" href="#token-filter-nfkc100-unify-kana"><span class="std std-ref">unify_kana</span></a> option.</p>
+<p>This option enables that same pronounced characters in all of full-width Hiragana, full-width Katakana and half-width Katakana are regarded as the same character as below.</p>
+<p>Execution example:</p>
+<div class="highlight-none notranslate"><div class="highlight"><pre><span></span>tokenize TokenDelimit &quot;あイｳｪおヽヾ&quot; --token_filters &#39;TokenFilterNFKC100(&quot;unify_kana&quot;, true)&#39;
+# [
+#   [
+#     0,
+#     1546906576.590515,
+#     0.0003581047058105469
+#   ],
+#   [
+#     {
+#       &quot;value&quot;: &quot;あいうぇおゝゞ&quot;,
+#       &quot;position&quot;: 0,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     }
+#   ]
+# ]
+</pre></div>
+</div>
+<p>Here is an example of <a class="reference internal" href="#token-filter-nfkc100-unify-kana-case"><span class="std std-ref">unify_kana_case</span></a> option.</p>
+<p>This option enables that large and small versions of same letters in all of full-width Hiragana, full-width Katakana and half-width Katakana are regarded as the same character as below.</p>
+<p>Execution example:</p>
+<div class="highlight-none notranslate"><div class="highlight"><pre><span></span>tokenize TokenDelimit &quot;ぁあぃいぅうぇえぉおゃやゅゆょよゎわゕかゖけ&quot; --token_filters &#39;TokenFilterNFKC100(&quot;unify_kana_case&quot;, true)&#39;
+# [
+#   [
+#     0,
+#     1546906658.116119,
+#     0.0003299713134765625
+#   ],
+#   [
+#     {
+#       &quot;value&quot;: &quot;ああいいううええおおややゆゆよよわわかかけけ&quot;,
+#       &quot;position&quot;: 0,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     }
+#   ]
+# ]
+</pre></div>
+</div>
+<p>Execution example:</p>
+<div class="highlight-none notranslate"><div class="highlight"><pre><span></span>tokenize TokenDelimit &quot;ァアィイゥウェエォオャヤュユョヨヮワヵカヶケ&quot; --token_filters &#39;TokenFilterNFKC100(&quot;unify_kana_case&quot;, true)&#39;
+# [
+#   [
+#     0,
+#     1546906730.305962,
+#     0.0003023147583007812
+#   ],
+#   [
+#     {
+#       &quot;value&quot;: &quot;アアイイウウエエオオヤヤユユヨヨワワカカケケ&quot;,
+#       &quot;position&quot;: 0,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     }
+#   ]
+# ]
+</pre></div>
+</div>
+<p>Here is an example of <a class="reference internal" href="#token-filter-nfkc100-unify-kana-voiced-sound-mark"><span class="std std-ref">unify_kana_voiced_sound_mark</span></a> option.</p>
+<p>This option enables that letters with/without voiced sound mark and semi voiced sound mark in all of full-width Hiragana, full-width Katakana and half-width Katakana are regarded as the same character as below.</p>
+<p>Execution example:</p>
+<div class="highlight-none notranslate"><div class="highlight"><pre><span></span>tokenize TokenDelimit &quot;かがきぎくぐけげこごさざしじすずせぜそぞただちぢつづてでとどはばぱひびぴふぶぷへべぺほぼぽ&quot; --token_filters &#39;TokenFilterNFKC100(&quot;unify_kana_voiced_sound_mark&quot;, true)&#39;
+# [
+#   [
+#     0,
+#     1546906812.423493,
+#     0.0003724098205566406
+#   ],
+#   [
+#     {
+#       &quot;value&quot;: &quot;かかききくくけけここささししすすせせそそたたちちつつててととはははひひひふふふへへへほほほ&quot;,
+#       &quot;position&quot;: 0,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     }
+#   ]
+# ]
+</pre></div>
+</div>
+<p>Execution example:</p>
+<div class="highlight-none notranslate"><div class="highlight"><pre><span></span>tokenize TokenDelimit &quot;カガキギクグケゲコゴサザシジスズセゼソゾタダチヂツヅテデトドハバパヒビピフブプヘベペホボポ&quot; --token_filters &#39;TokenFilterNFKC100(&quot;unify_kana_voiced_sound_mark&quot;, true)&#39;
+# [
+#   [
+#     0,
+#     1546906950.51529,
+#     0.0003533363342285156
+#   ],
+#   [
+#     {
+#       &quot;value&quot;: &quot;カカキキククケケココササシシススセセソソタタチチツツテテトトハハハヒヒヒフフフヘヘヘホホホ&quot;,
+#       &quot;position&quot;: 0,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     }
+#   ]
+# ]
+</pre></div>
+</div>
+<p>Here is an example of <a class="reference internal" href="#token-filter-nfkc100-unify-hyphen"><span class="std std-ref">unify_hyphen</span></a> option.
+This option enables normalize hyphen to “-” (U+002D HYPHEN-MINUS) as below.</p>
+<p>Execution example:</p>
+<div class="highlight-none notranslate"><div class="highlight"><pre><span></span>tokenize TokenDelimit &quot;-˗֊‐‑‒–⁃⁻₋−&quot; --token_filters &#39;TokenFilterNFKC100(&quot;unify_hyphen&quot;, true)&#39;
+# [
+#   [
+#     0,
+#     1546907023.849045,
+#     0.0003139972686767578
+#   ],
+#   [
+#     {
+#       &quot;value&quot;: &quot;-----------&quot;,
+#       &quot;position&quot;: 0,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     }
+#   ]
+# ]
+</pre></div>
+</div>
+<p>Here is an example of <a class="reference internal" href="#token-filter-nfkc100-unify-prolonged-sound-mark"><span class="std std-ref">unify_prolonged_sound_mark</span></a> option.
+This option enables normalize prolonged sound to “-” (U+30FC KATAKANA-HIRAGANA PROLONGED SOUND MARK) as below.</p>
+<p>Execution example:</p>
+<div class="highlight-none notranslate"><div class="highlight"><pre><span></span>tokenize TokenDelimit &quot;ー—―─━ｰ&quot; --token_filters &#39;TokenFilterNFKC100(&quot;unify_prolonged_sound_mark&quot;, true)&#39;
+# [
+#   [
+#     0,
+#     1546907076.575454,
+#     0.0003325939178466797
+#   ],
+#   [
+#     {
+#       &quot;value&quot;: &quot;ーーーーーー&quot;,
+#       &quot;position&quot;: 0,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     }
+#   ]
+# ]
+</pre></div>
+</div>
+<p>Here is an example of <a class="reference internal" href="#token-filter-nfkc100-unify-hyphen-and-prolonged-sound-mark"><span class="std std-ref">unify_hyphen_and_prolonged_sound_mark</span></a> option.
+This option enables normalize hyphen and prolonged sound to “-” (U+002D HYPHEN-MINUS) as below.</p>
+<p>Execution example:</p>
+<div class="highlight-none notranslate"><div class="highlight"><pre><span></span>tokenize TokenDelimit &quot;-˗֊‐‑‒–⁃⁻₋− ﹣－ ー—―─━ｰ&quot; --token_filters &#39;TokenFilterNFKC100(&quot;unify_hyphen_and_prolonged_sound_mark&quot;, true)&#39;
+# [
+#   [
+#     0,
+#     1546907138.989727,
+#     0.0003240108489990234
+#   ],
+#   [
+#     {
+#       &quot;value&quot;: &quot;-----------&quot;,
+#       &quot;position&quot;: 0,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     },
+#     {
+#       &quot;value&quot;: &quot;--&quot;,
+#       &quot;position&quot;: 1,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     },
+#     {
+#       &quot;value&quot;: &quot;------&quot;,
+#       &quot;position&quot;: 2,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     }
+#   ]
+# ]
+</pre></div>
+</div>
+<p>Here is an example of <a class="reference internal" href="#token-filter-nfkc100-unify-middle-dot"><span class="std std-ref">unify_middle_dot</span></a> option.
+This option enables normalize middle dot to “·” (U+00B7 MIDDLE DOT) as below.</p>
+<p>Execution example:</p>
+<div class="highlight-none notranslate"><div class="highlight"><pre><span></span>tokenize TokenDelimit &quot;·ᐧ•∙⋅⸱・･&quot; --token_filters &#39;TokenFilterNFKC100(&quot;unify_middle_dot&quot;, true)&#39;
+# [
+#   [
+#     0,
+#     1546907221.227195,
+#     0.0003573894500732422
+#   ],
+#   [
+#     {
+#       &quot;value&quot;: &quot;········&quot;,
+#       &quot;position&quot;: 0,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     }
+#   ]
+# ]
+</pre></div>
+</div>
+<p>Here is an example of <a class="reference internal" href="#token-filter-nfkc100-unify-katakana-v-sounds"><span class="std std-ref">unify_katakana_v_sounds</span></a> option.
+This option enables normalize “ヴァヴィヴヴェヴォ” to “バビブベボ” as below.</p>
+<p>Execution example:</p>
+<div class="highlight-none notranslate"><div class="highlight"><pre><span></span>tokenize TokenDelimit &quot;ヴァヴィヴヴェヴォヴ&quot; --token_filters &#39;TokenFilterNFKC100(&quot;unify_katakana_v_sounds&quot;, true)&#39;
+# [
+#   [
+#     0,
+#     1546907295.776949,
+#     0.0003447532653808594
+#   ],
+#   [
+#     {
+#       &quot;value&quot;: &quot;バビブベボブ&quot;,
+#       &quot;position&quot;: 0,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     }
+#   ]
+# ]
+</pre></div>
+</div>
+<p>Here is an example of <a class="reference internal" href="#token-filter-nfkc100-unify-katakana-bu-sounds"><span class="std std-ref">unify_katakana_bu_sound</span></a> option.
+This option enables normalize “ヴァヴィヴゥヴェヴォ” to “ブ” as below.</p>
+<p>Execution example:</p>
+<div class="highlight-none notranslate"><div class="highlight"><pre><span></span>tokenize TokenDelimit &quot;ヴァヴィヴヴェヴォヴ&quot; --token_filters &#39;TokenFilterNFKC100(&quot;unify_katakana_bu_sound&quot;, true)&#39;
+# [
+#   [
+#     0,
+#     1546907361.518968,
+#     0.0002958774566650391
+#   ],
+#   [
+#     {
+#       &quot;value&quot;: &quot;ブブブブブブ&quot;,
+#       &quot;position&quot;: 0,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     }
+#   ]
+# ]
+</pre></div>
+</div>
+<p>Here is an example of <a class="reference internal" href="#token-filter-nfkc100-unify-to-romaji"><span class="std std-ref">unify_to_romaji</span></a> option.
+This option enables normalize hiragana and katakana to romaji as below.</p>
+<p>Execution example:</p>
+<div class="highlight-none notranslate"><div class="highlight"><pre><span></span>tokenize TokenDelimit &quot;アァイィウゥエェオォ&quot; --token_filters  &#39;TokenFilterNFKC100(&quot;unify_to_romaji&quot;, true)&#39;
+# [
+#   [
+#     0,
+#     1546907415.47742,
+#     0.0003619194030761719
+#   ],
+#   [
+#     {
+#       &quot;value&quot;: &quot;axaixiuxuexeoxo&quot;,
+#       &quot;position&quot;: 0,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     }
+#   ]
+# ]
+</pre></div>
+</div>
+</div>
+<div class="section" id="advanced-usage">
+<h2>7.9.2.5. Advanced usage<a class="headerlink" href="#advanced-usage" title="Permalink to this headline">¶</a></h2>
+<p>You can output all input string as hiragana with cimbining <code class="docutils literal notranslate"><span class="pre">TokenFilterNFKC100</span></code> with <code class="docutils literal notranslate"><span class="pre">use_reading</span></code> option of <code class="docutils literal notranslate"><span class="pre">TokenMecab</span></code> as below.</p>
+<p>Execution example:</p>
+<div class="highlight-none notranslate"><div class="highlight"><pre><span></span>tokenize   &#39;TokenMecab(&quot;use_reading&quot;, true)&#39;   &quot;私は林檎を食べます。&quot;   --token_filters &#39;TokenFilterNFKC100(&quot;unify_kana&quot;, true)&#39;
+# [
+#   [
+#     0,
+#     1545901819.377275,
+#     0.0003833770751953125
+#   ],
+#   [
+#     {
+#       &quot;value&quot;: &quot;わたし&quot;,
+#       &quot;position&quot;: 0,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     },
+#     {
+#       &quot;value&quot;: &quot;は&quot;,
+#       &quot;position&quot;: 1,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     },
+#     {
+#       &quot;value&quot;: &quot;りんご&quot;,
+#       &quot;position&quot;: 2,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     },
+#     {
+#       &quot;value&quot;: &quot;を&quot;,
+#       &quot;position&quot;: 3,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     },
+#     {
+#       &quot;value&quot;: &quot;たべ&quot;,
+#       &quot;position&quot;: 4,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     },
+#     {
+#       &quot;value&quot;: &quot;ます&quot;,
+#       &quot;position&quot;: 5,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     },
+#     {
+#       &quot;value&quot;: &quot;。&quot;,
+#       &quot;position&quot;: 6,
+#       &quot;force_prefix&quot;: false,
+#       &quot;force_prefix_search&quot;: false
+#     }
+#   ]
+# ]
+</pre></div>
+</div>
+</div>
+<div class="section" id="parameters">
+<h2>7.9.2.6. Parameters<a class="headerlink" href="#parameters" title="Permalink to this headline">¶</a></h2>
+<div class="section" id="optional-parameter">
+<h3>7.9.2.6.1. Optional parameter<a class="headerlink" href="#optional-parameter" title="Permalink to this headline">¶</a></h3>
+<p>There are optional parameters as below.</p>
+<div class="section" id="unify-kana">
+<span id="token-filter-nfkc100-unify-kana"></span><h4>7.9.2.6.1.1. <code class="docutils literal notranslate"><span class="pre">unify_kana</span></code><a class="headerlink" href="#unify-kana" title="Permalink to this headline">¶</a></h4>
+<p>This option enables that same pronounced characters in all of full-width Hiragana, full-width Katakana and half-width Katakana are regarded as the same character.</p>
+</div>
+<div class="section" id="unify-kana-case">
+<span id="token-filter-nfkc100-unify-kana-case"></span><h4>7.9.2.6.1.2. <code class="docutils literal notranslate"><span class="pre">unify_kana_case</span></code><a class="headerlink" href="#unify-kana-case" title="Permalink to this headline">¶</a></h4>
+<p>This option enables that large and small versions of same letters in all of full-width Hiragana, full-width Katakana and half-width Katakana are regarded as the same character.</p>
+</div>
+<div class="section" id="unify-kana-voiced-sound-mark">
+<span id="token-filter-nfkc100-unify-kana-voiced-sound-mark"></span><h4>7.9.2.6.1.3. <code class="docutils literal notranslate"><span class="pre">unify_kana_voiced_sound_mark</span></code><a class="headerlink" href="#unify-kana-voiced-sound-mark" title="Permalink to this headline">¶</a></h4>
+<p>This option enables that letters with/without voiced sound mark and semi voiced sound mark in all of full-width Hiragana, full-width Katakana and half-width Katakana are regarded as the same character.</p>
+</div>
+<div class="section" id="unify-hyphen">
+<span id="token-filter-nfkc100-unify-hyphen"></span><h4>7.9.2.6.1.4. <code class="docutils literal notranslate"><span class="pre">unify_hyphen</span></code><a class="headerlink" href="#unify-hyphen" title="Permalink to this headline">¶</a></h4>
+<p>This option enables normalize hyphen to “-” (U+002D HYPHEN-MINUS).</p>
+<p>Hyphen of the target of normalizing is as below.</p>
+<ul class="simple">
+<li><p>“-” (U+002D HYPHEN-MINUS)</p></li>
+<li><p>“֊” (U+058A ARMENIAN HYPHEN)</p></li>
+<li><p>“˗” (U+02D7 MODIFIER LETTER MINUS SIGN)</p></li>
+<li><p>“‐” (U+2010 HYPHEN)</p></li>
+<li><p>“—” (U+2014 EM DASH)</p></li>
+<li><p>“⁃” (U+2043 HYPHEN BULLET)</p></li>
+<li><p>“⁻” (U+207B SUPERSCRIPT MINUS)</p></li>
+<li><p>“₋” (U+208B SUBSCRIPT MINUS)</p></li>
+<li><p>“−” (U+2212 MINUS SIGN)</p></li>
+</ul>
+</div>
+<div class="section" id="unify-prolonged-sound-mark">
+<span id="token-filter-nfkc100-unify-prolonged-sound-mark"></span><h4>7.9.2.6.1.5. <code class="docutils literal notranslate"><span class="pre">unify_prolonged_sound_mark</span></code><a class="headerlink" href="#unify-prolonged-sound-mark" title="Permalink to this headline">¶</a></h4>
+<p>This option enables normalize prolonged sound to “-” (U+30FC KATAKANA-HIRAGANA PROLONGED SOUND MARK).</p>
+<p>Prolonged sound of the target of normalizing is as below.</p>
+<ul class="simple">
+<li><p>“—” (U+2014 EM DASH)</p></li>
+<li><p>“―” (U+2015 HORIZONTAL BAR)</p></li>
+<li><p>“─” (U+2500 BOX DRAWINGS LIGHT HORIZONTAL)</p></li>
+<li><p>“━” (U+2501 BOX DRAWINGS HEAVY HORIZONTAL)</p></li>
+<li><p>“ー” (U+30FC KATAKANA-HIRAGANA PROLONGED SOUND MARK)</p></li>
+<li><p>“ｰ” (U+FF70 HALFWIDTH KATAKANA-HIRAGANA PROLONGED SOUND MARK)</p></li>
+</ul>
+</div>
+<div class="section" id="unify-hyphen-and-prolonged-sound-mark">
+<span id="token-filter-nfkc100-unify-hyphen-and-prolonged-sound-mark"></span><h4>7.9.2.6.1.6. <code class="docutils literal notranslate"><span class="pre">unify_hyphen_and_prolonged_sound_mark</span></code><a class="headerlink" href="#unify-hyphen-and-prolonged-sound-mark" title="Permalink to this headline">¶</a></h4>
+<p>This option enables normalize hyphen and prolonged sound to “-” (U+002D HYPHEN-MINUS).</p>
+<p>Hyphen and prolonged sound of the target normalizing is below.</p>
+<ul class="simple">
+<li><p>“-” (U+002D HYPHEN-MINUS)</p></li>
+<li><p>“֊” (U+058A ARMENIAN HYPHEN)</p></li>
+<li><p>“˗” (U+02D7 MODIFIER LETTER MINUS SIGN)</p></li>
+<li><p>“‐” (U+2010 HYPHEN)</p></li>
+<li><p>“—” (U+2014 EM DASH)</p></li>
+<li><p>“⁃” (U+2043 HYPHEN BULLET)</p></li>
+<li><p>“⁻” (U+207B SUPERSCRIPT MINUS)</p></li>
+<li><p>“₋” (U+208B SUBSCRIPT MINUS)</p></li>
+<li><p>“−” (U+2212 MINUS SIGN)</p></li>
+<li><p>“—” (U+2014 EM DASH)</p></li>
+<li><p>“―” (U+2015 HORIZONTAL BAR)</p></li>
+<li><p>“─” (U+2500 BOX DRAWINGS LIGHT HORIZONTAL)</p></li>
+<li><p>“━” (U+2501 BOX DRAWINGS HEAVY HORIZONTAL)</p></li>
+<li><p>“ー” (U+30FC KATAKANA-HIRAGANA PROLONGED SOUND MARK)</p></li>
+<li><p>“ｰ” (U+FF70 HALFWIDTH KATAKANA-HIRAGANA PROLONGED SOUND MARK)</p></li>
+</ul>
+</div>
+<div class="section" id="unify-middle-dot">
+<span id="token-filter-nfkc100-unify-middle-dot"></span><h4>7.9.2.6.1.7. <code class="docutils literal notranslate"><span class="pre">unify_middle_dot</span></code><a class="headerlink" href="#unify-middle-dot" title="Permalink to this headline">¶</a></h4>
+<p>This option enables normalize middle dot to “·” (U+00B7 MIDDLE DOT).</p>
+<p>Middle dot of the target of normalizing is as below.</p>
+<ul class="simple">
+<li><p>“·” (U+00B7 MIDDLE DOT)</p></li>
+<li><p>“ᐧ” (U+1427 CANADIAN SYLLABICS FINAL MIDDLE DOT)</p></li>
+<li><p>“•” (U+2022 BULLET)</p></li>
+<li><p>“∙” (U+2219 BULLET OPERATOR)</p></li>
+<li><p>“⋅” (U+22C5 DOT OPERATOR)</p></li>
+<li><p>“⸱” (U+2E31 WORD SEPARATOR MIDDLE DOT)</p></li>
+<li><p>“・” (U+30FB KATAKANA MIDDLE DOT)</p></li>
+<li><p>“･” (U+FF65 HALFWIDTH KATAKANA MIDDLE DOT)</p></li>
+</ul>
+</div>
+<div class="section" id="unify-katakana-v-sounds">
+<span id="token-filter-nfkc100-unify-katakana-v-sounds"></span><h4>7.9.2.6.1.8. <code class="docutils literal notranslate"><span class="pre">unify_katakana_v_sounds</span></code><a class="headerlink" href="#unify-katakana-v-sounds" title="Permalink to this headline">¶</a></h4>
+<p>This option enables normalize “ヴァヴィヴヴェヴォ” to “バビブベボ”.</p>
+</div>
+<div class="section" id="unify-katakana-bu-sound">
+<span id="token-filter-nfkc100-unify-katakana-bu-sounds"></span><h4>7.9.2.6.1.9. <code class="docutils literal notranslate"><span class="pre">unify_katakana_bu_sound</span></code><a class="headerlink" href="#unify-katakana-bu-sound" title="Permalink to this headline">¶</a></h4>
+<p>This option enables normalize “ヴァヴィヴゥヴェヴォ” to “ブ”.</p>
+</div>
+<div class="section" id="unify-to-romaji">
+<span id="token-filter-nfkc100-unify-to-romaji"></span><h4>7.9.2.6.1.10. <code class="docutils literal notranslate"><span class="pre">unify_to_romaji</span></code><a class="headerlink" href="#unify-to-romaji" title="Permalink to this headline">¶</a></h4>
+<p>This option enables normalize hiragana and katakana to romaji.</p>
+</div>
+</div>
+</div>
+</div>
+          </div>
+        </div>
+      </div>
+      <div class="sphinxsidebar" role="navigation" aria-label="main navigation">
+        <div class="sphinxsidebarwrapper">
+  <h3><a href="../../index.html">Table of Contents</a></h3>
+  <ul>
+<li><a class="reference internal" href="#">7.9.2. <code class="docutils literal notranslate"><span class="pre">TokenFilterNFKC100</span></code></a><ul>
+<li><a class="reference internal" href="#summary">7.9.2.1. Summary</a></li>
+<li><a class="reference internal" href="#syntax">7.9.2.2. Syntax</a></li>
+<li><a class="reference internal" href="#usage">7.9.2.3. Usage</a></li>
+<li><a class="reference internal" href="#simple-usage">7.9.2.4. Simple usage</a></li>
+<li><a class="reference internal" href="#advanced-usage">7.9.2.5. Advanced usage</a></li>
+<li><a class="reference internal" href="#parameters">7.9.2.6. Parameters</a><ul>
+<li><a class="reference internal" href="#optional-parameter">7.9.2.6.1. Optional parameter</a><ul>
+<li><a class="reference internal" href="#unify-kana">7.9.2.6.1.1. <code class="docutils literal notranslate"><span class="pre">unify_kana</span></code></a></li>
+<li><a class="reference internal" href="#unify-kana-case">7.9.2.6.1.2. <code class="docutils literal notranslate"><span class="pre">unify_kana_case</span></code></a></li>
+<li><a class="reference internal" href="#unify-kana-voiced-sound-mark">7.9.2.6.1.3. <code class="docutils literal notranslate"><span class="pre">unify_kana_voiced_sound_mark</span></code></a></li>
+<li><a class="reference internal" href="#unify-hyphen">7.9.2.6.1.4. <code class="docutils literal notranslate"><span class="pre">unify_hyphen</span></code></a></li>
+<li><a class="reference internal" href="#unify-prolonged-sound-mark">7.9.2.6.1.5. <code class="docutils literal notranslate"><span class="pre">unify_prolonged_sound_mark</span></code></a></li>
+<li><a class="reference internal" href="#unify-hyphen-and-prolonged-sound-mark">7.9.2.6.1.6. <code class="docutils literal notranslate"><span class="pre">unify_hyphen_and_prolonged_sound_mark</span></code></a></li>
+<li><a class="reference internal" href="#unify-middle-dot">7.9.2.6.1.7. <code class="docutils literal notranslate"><span class="pre">unify_middle_dot</span></code></a></li>
+<li><a class="reference internal" href="#unify-katakana-v-sounds">7.9.2.6.1.8. <code class="docutils literal notranslate"><span class="pre">unify_katakana_v_sounds</span></code></a></li>
+<li><a class="reference internal" href="#unify-katakana-bu-sound">7.9.2.6.1.9. <code class="docutils literal notranslate"><span class="pre">unify_katakana_bu_sound</span></code></a></li>
+<li><a class="reference internal" href="#unify-to-romaji">7.9.2.6.1.10. <code class="docutils literal notranslate"><span class="pre">unify_to_romaji</span></code></a></li>
+</ul>
+</li>
+</ul>
+</li>
+</ul>
+</li>
+</ul>
+  <h4>Previous topic</h4>
+  <p class="topless"><a href="../token_filter/summary.html"
+                        title="previous chapter">7.9.1. Summary</a></p>
+  <h4>Next topic</h4>
+  <p class="topless"><a href="token_filter_stem.html"
+                        title="next chapter">7.9.3. <code class="docutils literal notranslate"><span class="pre">TokenFilterStem</span></code></a></p>
+<div id="searchbox" style="display: none" role="search">
+  <h3>Quick search</h3>
+    <div class="searchformwrapper">
+    <form class="search" action="../../search.html" method="get">
+      <input type="text" name="q" />
+      <input type="submit" value="Go" />
+    </form>
+    </div>
+</div>
+<script type="text/javascript">$('#searchbox').show(0);</script>
+        </div>
+      </div>
+      <div class="clearer"></div>
+    </div>
+    <div class="related" role="navigation" aria-label="related navigation">
+      <h3>Navigation</h3>
+      <ul>
+        <li class="right" style="margin-right: 10px">
+          <a href="../../genindex.html" title="General Index"
+             >index</a></li>
+        <li class="right" >
+          <a href="token_filter_stem.html" title="7.9.3. TokenFilterStem"
+             >next</a> |</li>
+        <li class="right" >
+          <a href="../token_filter/summary.html" title="7.9.1. Summary"
+             >previous</a> |</li>
+        <li class="nav-item nav-item-0"><a href="../../index.html">Groonga v9.0.2 documentation</a> &#187;</li>
+          <li class="nav-item nav-item-1"><a href="../../reference.html" >7. Reference manual</a> &#187;</li>
+          <li class="nav-item nav-item-2"><a href="../token_filters.html" >7.9. Token filters</a> &#187;</li>
+      </ul>
+    </div>
+    <div class="footer" role="contentinfo">
+        &#169; Copyright 2009-2019, Brazil, Inc.
+    </div>
+  </body>
+</html>