RubyGems - rroonga - Versions diffs - 2.1.0-x86-mingw32 → 2.1.1-x86-mingw32 - Mend

rroonga 2.1.0-x86-mingw32 → 2.1.1-x86-mingw32

Files changed (376) hide show

data/vendor/local/share/doc/groonga/en/html/reference/indexing.html CHANGED Viewed

@@ -9,7 +9,7 @@
   <head>
     <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
-    <title>8.10. Indexing &mdash; groonga v2.1.0 documentation</title>
+    <title>8.12. Indexing &mdash; groonga v2.1.0-26-ge48bfb0 documentation</title>
     <link rel="stylesheet" href="../_static/groonga.css" type="text/css" />
     <link rel="stylesheet" href="../_static/pygments.css" type="text/css" />
@@ -17,7 +17,7 @@
     <script type="text/javascript">
       var DOCUMENTATION_OPTIONS = {
         URL_ROOT:    '../',
-        VERSION:     '2.1.0',
+        VERSION:     '2.1.0-26-ge48bfb0',
         COLLAPSE_INDEX: false,
         FILE_SUFFIX: '.html',
         HAS_SOURCE:  true
@@ -27,10 +27,10 @@
     <script type="text/javascript" src="../_static/underscore.js"></script>
     <script type="text/javascript" src="../_static/doctools.js"></script>
     <link rel="shortcut icon" href="../_static/favicon.ico"/>
-    <link rel="top" title="groonga v2.1.0 documentation" href="../index.html" />
+    <link rel="top" title="groonga v2.1.0-26-ge48bfb0 documentation" href="../index.html" />
     <link rel="up" title="8. リファレンスマニュアル" href="../reference.html" />
-    <link rel="next" title="8.11. Log" href="log.html" />
-    <link rel="prev" title="8.9.7. snippet_html" href="functions/snippet_html.html" />
+    <link rel="next" title="8.13. Log" href="log.html" />
+    <link rel="prev" title="8.11.7. snippet_html" href="functions/snippet_html.html" />
   </head>
   <body>
 <div class="header">
@@ -57,12 +57,12 @@
           <a href="../genindex.html" title="General Index"
              accesskey="I">index</a></li>
         <li class="right" >
-          <a href="log.html" title="8.11. Log"
+          <a href="log.html" title="8.13. Log"
              accesskey="N">next</a> |</li>
         <li class="right" >
-          <a href="functions/snippet_html.html" title="8.9.7. snippet_html"
+          <a href="functions/snippet_html.html" title="8.11.7. snippet_html"
              accesskey="P">previous</a> |</li>
-        <li><a href="../index.html">groonga v2.1.0 documentation</a> &raquo;</li>
+        <li><a href="../index.html">groonga v2.1.0-26-ge48bfb0 documentation</a> &raquo;</li>
           <li><a href="../reference.html" accesskey="U">8. リファレンスマニュアル</a> &raquo;</li>
       </ul>
     </div>
@@ -73,11 +73,11 @@
           <div class="body">
   <div class="section" id="indexing">
-<h1>8.10. Indexing<a class="headerlink" href="#indexing" title="Permalink to this headline">¶</a></h1>
+<h1>8.12. Indexing<a class="headerlink" href="#indexing" title="Permalink to this headline">¶</a></h1>
 <p>Groonga supports both online index construction and offline
 index construction since 2.0.0.</p>
 <div class="section" id="online-index-construction">
-<h2>8.10.1. Online index construction<a class="headerlink" href="#online-index-construction" title="Permalink to this headline">¶</a></h2>
+<h2>8.12.1. Online index construction<a class="headerlink" href="#online-index-construction" title="Permalink to this headline">¶</a></h2>
 <p>In online index construction, registered documents can be
 searchable quickly while indexing. But indexing requires
 more cost rather than indexing by offline index
@@ -89,7 +89,7 @@ freshness. Online index construction can make fresh
 documents searchable and keep searchable while indexing.</p>
 </div>
 <div class="section" id="offline-index-construction">
-<span id="id1"></span><h2>8.10.2. Offline index construction<a class="headerlink" href="#offline-index-construction" title="Permalink to this headline">¶</a></h2>
+<span id="id1"></span><h2>8.12.2. Offline index construction<a class="headerlink" href="#offline-index-construction" title="Permalink to this headline">¶</a></h2>
 <p>In offline index construction, indexing cost is less than
 indexing cost by online index construction. Indexing time
 will be shorter. Index will be smaller. Resources required
@@ -104,7 +104,7 @@ doesn't value freshness because a reference manual will be
 updated only at a release.</p>
 </div>
 <div class="section" id="how-to-use">
-<h2>8.10.3. How to use<a class="headerlink" href="#how-to-use" title="Permalink to this headline">¶</a></h2>
+<h2>8.12.3. How to use<a class="headerlink" href="#how-to-use" title="Permalink to this headline">¶</a></h2>
 <p>Groonga uses online index construction by default. We
 register a document, we can search it quickly.</p>
 <p>Groonga uses offline index construction by adding an index
@@ -259,20 +259,20 @@ construction:</p>
         <div class="sphinxsidebarwrapper">
   <h3><a href="../index.html">Table Of Contents</a></h3>
   <ul>
-<li><a class="reference internal" href="#">8.10. Indexing</a><ul>
-<li><a class="reference internal" href="#online-index-construction">8.10.1. Online index construction</a></li>
-<li><a class="reference internal" href="#offline-index-construction">8.10.2. Offline index construction</a></li>
-<li><a class="reference internal" href="#how-to-use">8.10.3. How to use</a></li>
+<li><a class="reference internal" href="#">8.12. Indexing</a><ul>
+<li><a class="reference internal" href="#online-index-construction">8.12.1. Online index construction</a></li>
+<li><a class="reference internal" href="#offline-index-construction">8.12.2. Offline index construction</a></li>
+<li><a class="reference internal" href="#how-to-use">8.12.3. How to use</a></li>
 </ul>
 </li>
 </ul>
   <h4>Previous topic</h4>
   <p class="topless"><a href="functions/snippet_html.html"
-                        title="previous chapter">8.9.7. snippet_html</a></p>
+                        title="previous chapter">8.11.7. snippet_html</a></p>
   <h4>Next topic</h4>
   <p class="topless"><a href="log.html"
-                        title="next chapter">8.11. Log</a></p>
+                        title="next chapter">8.13. Log</a></p>
   <h3>This Page</h3>
   <ul class="this-page-menu">
     <li><a href="../_sources/reference/indexing.txt"
@@ -302,12 +302,12 @@ construction:</p>
           <a href="../genindex.html" title="General Index"
              >index</a></li>
         <li class="right" >
-          <a href="log.html" title="8.11. Log"
+          <a href="log.html" title="8.13. Log"
              >next</a> |</li>
         <li class="right" >
-          <a href="functions/snippet_html.html" title="8.9.7. snippet_html"
+          <a href="functions/snippet_html.html" title="8.11.7. snippet_html"
              >previous</a> |</li>
-        <li><a href="../index.html">groonga v2.1.0 documentation</a> &raquo;</li>
+        <li><a href="../index.html">groonga v2.1.0-26-ge48bfb0 documentation</a> &raquo;</li>
           <li><a href="../reference.html" >8. リファレンスマニュアル</a> &raquo;</li>
       </ul>
     </div>

data/vendor/local/share/doc/groonga/en/html/reference/log.html CHANGED Viewed

@@ -9,7 +9,7 @@
   <head>
     <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
-    <title>8.11. Log &mdash; groonga v2.1.0 documentation</title>
+    <title>8.13. Log &mdash; groonga v2.1.0-26-ge48bfb0 documentation</title>
     <link rel="stylesheet" href="../_static/groonga.css" type="text/css" />
     <link rel="stylesheet" href="../_static/pygments.css" type="text/css" />
@@ -17,7 +17,7 @@
     <script type="text/javascript">
       var DOCUMENTATION_OPTIONS = {
         URL_ROOT:    '../',
-        VERSION:     '2.1.0',
+        VERSION:     '2.1.0-26-ge48bfb0',
         COLLAPSE_INDEX: false,
         FILE_SUFFIX: '.html',
         HAS_SOURCE:  true
@@ -27,10 +27,10 @@
     <script type="text/javascript" src="../_static/underscore.js"></script>
     <script type="text/javascript" src="../_static/doctools.js"></script>
     <link rel="shortcut icon" href="../_static/favicon.ico"/>
-    <link rel="top" title="groonga v2.1.0 documentation" href="../index.html" />
+    <link rel="top" title="groonga v2.1.0-26-ge48bfb0 documentation" href="../index.html" />
     <link rel="up" title="8. リファレンスマニュアル" href="../reference.html" />
-    <link rel="next" title="8.12. API" href="api.html" />
-    <link rel="prev" title="8.10. Indexing" href="indexing.html" />
+    <link rel="next" title="8.14. API" href="api.html" />
+    <link rel="prev" title="8.12. Indexing" href="indexing.html" />
   </head>
   <body>
 <div class="header">
@@ -57,12 +57,12 @@
           <a href="../genindex.html" title="General Index"
              accesskey="I">index</a></li>
         <li class="right" >
-          <a href="api.html" title="8.12. API"
+          <a href="api.html" title="8.14. API"
              accesskey="N">next</a> |</li>
         <li class="right" >
-          <a href="indexing.html" title="8.10. Indexing"
+          <a href="indexing.html" title="8.12. Indexing"
              accesskey="P">previous</a> |</li>
-        <li><a href="../index.html">groonga v2.1.0 documentation</a> &raquo;</li>
+        <li><a href="../index.html">groonga v2.1.0-26-ge48bfb0 documentation</a> &raquo;</li>
           <li><a href="../reference.html" accesskey="U">8. リファレンスマニュアル</a> &raquo;</li>
       </ul>
     </div>
@@ -73,19 +73,19 @@
           <div class="body">
   <div class="section" id="log">
-<h1>8.11. Log<a class="headerlink" href="#log" title="Permalink to this headline">¶</a></h1>
+<h1>8.13. Log<a class="headerlink" href="#log" title="Permalink to this headline">¶</a></h1>
 <p>Groonga has two log files. They are process log and query
 log. Process log is for all of <a class="reference internal" href="executables/groonga.html"><em>groonga command</em></a>
 works. Query log is just for query processing.</p>
 <div class="section" id="process-log">
-<h2>8.11.1. Process log<a class="headerlink" href="#process-log" title="Permalink to this headline">¶</a></h2>
+<h2>8.13.1. Process log<a class="headerlink" href="#process-log" title="Permalink to this headline">¶</a></h2>
 <p>Process log is enabled by default. Log path can be
 customized by <a class="reference internal" href="executables/groonga.html#cmdoption--log-path"><em class="xref std std-option">--log-path</em></a> option.  Each log has its
 log level. If a log is smaller than groonga process' log
 level, it's not logged. Log level can be customized by
 <a class="reference internal" href="executables/groonga.html#cmdoption-l"><em class="xref std std-option">-l</em></a> or <a class="reference internal" href="commands/log_level.html"><em>log_level</em></a>.</p>
 <div class="section" id="format">
-<h3>8.11.1.1. Format<a class="headerlink" href="#format" title="Permalink to this headline">¶</a></h3>
+<h3>8.13.1.1. Format<a class="headerlink" href="#format" title="Permalink to this headline">¶</a></h3>
 <p>Process log uses the following format:</p>
 <div class="highlight-none"><div class="highlight"><pre>#{TIME_STAMP}|#{L}| #{MESSAGE}
 </pre></div>
@@ -161,11 +161,11 @@ level map.</p>
 </div>
 </div>
 <div class="section" id="query-log">
-<h2>8.11.2. Query log<a class="headerlink" href="#query-log" title="Permalink to this headline">¶</a></h2>
+<h2>8.13.2. Query log<a class="headerlink" href="#query-log" title="Permalink to this headline">¶</a></h2>
 <p>Query log is disabled by default. It can be enabled by
 <a class="reference internal" href="executables/groonga.html#cmdoption--query-log-path"><em class="xref std std-option">--query-log-path</em></a> option.</p>
 <div class="section" id="id1">
-<h3>8.11.2.1. Format<a class="headerlink" href="#id1" title="Permalink to this headline">¶</a></h3>
+<h3>8.13.2.1. Format<a class="headerlink" href="#id1" title="Permalink to this headline">¶</a></h3>
 <p>Query log uses the following formats:</p>
 <div class="highlight-none"><div class="highlight"><pre>#{TIME_STAMP}|#{MESSAGE}
 #{TIME_STAMP}|#{ID}|&gt;#{QUERY}
@@ -281,13 +281,13 @@ a thread.</p>
         <div class="sphinxsidebarwrapper">
   <h3><a href="../index.html">Table Of Contents</a></h3>
   <ul>
-<li><a class="reference internal" href="#">8.11. Log</a><ul>
-<li><a class="reference internal" href="#process-log">8.11.1. Process log</a><ul>
-<li><a class="reference internal" href="#format">8.11.1.1. Format</a></li>
+<li><a class="reference internal" href="#">8.13. Log</a><ul>
+<li><a class="reference internal" href="#process-log">8.13.1. Process log</a><ul>
+<li><a class="reference internal" href="#format">8.13.1.1. Format</a></li>
 </ul>
 </li>
-<li><a class="reference internal" href="#query-log">8.11.2. Query log</a><ul>
-<li><a class="reference internal" href="#id1">8.11.2.1. Format</a></li>
+<li><a class="reference internal" href="#query-log">8.13.2. Query log</a><ul>
+<li><a class="reference internal" href="#id1">8.13.2.1. Format</a></li>
 </ul>
 </li>
 </ul>
@@ -296,10 +296,10 @@ a thread.</p>
   <h4>Previous topic</h4>
   <p class="topless"><a href="indexing.html"
-                        title="previous chapter">8.10. Indexing</a></p>
+                        title="previous chapter">8.12. Indexing</a></p>
   <h4>Next topic</h4>
   <p class="topless"><a href="api.html"
-                        title="next chapter">8.12. API</a></p>
+                        title="next chapter">8.14. API</a></p>
   <h3>This Page</h3>
   <ul class="this-page-menu">
     <li><a href="../_sources/reference/log.txt"
@@ -329,12 +329,12 @@ a thread.</p>
           <a href="../genindex.html" title="General Index"
              >index</a></li>
         <li class="right" >
-          <a href="api.html" title="8.12. API"
+          <a href="api.html" title="8.14. API"
              >next</a> |</li>
         <li class="right" >
-          <a href="indexing.html" title="8.10. Indexing"
+          <a href="indexing.html" title="8.12. Indexing"
              >previous</a> |</li>
-        <li><a href="../index.html">groonga v2.1.0 documentation</a> &raquo;</li>
+        <li><a href="../index.html">groonga v2.1.0-26-ge48bfb0 documentation</a> &raquo;</li>
           <li><a href="../reference.html" >8. リファレンスマニュアル</a> &raquo;</li>
       </ul>
     </div>

data/vendor/local/share/doc/groonga/en/html/reference/normalizers.html ADDED Viewed

@@ -0,0 +1,288 @@
+<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
+  "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
+<html xmlns="http://www.w3.org/1999/xhtml">
+  <head>
+    <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
+    <title>8.6. Normalizers &mdash; groonga v2.1.0-26-ge48bfb0 documentation</title>
+    <link rel="stylesheet" href="../_static/groonga.css" type="text/css" />
+    <link rel="stylesheet" href="../_static/pygments.css" type="text/css" />
+    <script type="text/javascript">
+      var DOCUMENTATION_OPTIONS = {
+        URL_ROOT:    '../',
+        VERSION:     '2.1.0-26-ge48bfb0',
+        COLLAPSE_INDEX: false,
+        FILE_SUFFIX: '.html',
+        HAS_SOURCE:  true
+      };
+    </script>
+    <script type="text/javascript" src="../_static/jquery.js"></script>
+    <script type="text/javascript" src="../_static/underscore.js"></script>
+    <script type="text/javascript" src="../_static/doctools.js"></script>
+    <link rel="shortcut icon" href="../_static/favicon.ico"/>
+    <link rel="top" title="groonga v2.1.0-26-ge48bfb0 documentation" href="../index.html" />
+    <link rel="up" title="8. リファレンスマニュアル" href="../reference.html" />
+    <link rel="next" title="8.7. Tokenizers" href="tokenizers.html" />
+    <link rel="prev" title="8.5. Tables" href="tables.html" />
+  </head>
+  <body>
+<div class="header">
+  <h1 class="title">
+    <a id="top-link" href="../index.html">
+      <span class="project">groonga</span>
+      <span class="separator">-</span>
+      <span class="description">An open-source fulltext search engine and column store.</span>
+    </a>
+  </h1>
+  <div class="other-language-links">
+    <ul>
+      <li><a href="../../../ja/html/reference/normalizers.html"><img src="../_static/jp.png" alt="日本語">日本語版はこちら</a></li>
+    </ul>
+  </div>
+</div>
+    <div class="related">
+      <h3>Navigation</h3>
+      <ul>
+        <li class="right" style="margin-right: 10px">
+          <a href="../genindex.html" title="General Index"
+             accesskey="I">index</a></li>
+        <li class="right" >
+          <a href="tokenizers.html" title="8.7. Tokenizers"
+             accesskey="N">next</a> |</li>
+        <li class="right" >
+          <a href="tables.html" title="8.5. Tables"
+             accesskey="P">previous</a> |</li>
+        <li><a href="../index.html">groonga v2.1.0-26-ge48bfb0 documentation</a> &raquo;</li>
+          <li><a href="../reference.html" accesskey="U">8. リファレンスマニュアル</a> &raquo;</li>
+      </ul>
+    </div>
+    <div class="document">
+      <div class="documentwrapper">
+        <div class="bodywrapper">
+          <div class="body">
+  <div class="section" id="normalizers">
+<h1>8.6. Normalizers<a class="headerlink" href="#normalizers" title="Permalink to this headline">¶</a></h1>
+<div class="section" id="summary">
+<h2>8.6.1. Summary<a class="headerlink" href="#summary" title="Permalink to this headline">¶</a></h2>
+<p>Groonga has normalizer module. It is used when tokenizing text and
+storing table key. For example, <tt class="docutils literal"><span class="pre">A</span></tt> and <tt class="docutils literal"><span class="pre">a</span></tt> are processed as the
+same character after normalization.</p>
+<p>Normalizer module can be added as a plugin. You can customize text
+normalization by registering your normalizer plugins to groonga.</p>
+<p>A normalizer module is attached to a table. A table can have zero or
+one normalizer module. You can attach a normalizer module to a table
+by <em class="xref std std-ref">table-create-normalizer</em> option in
+<a class="reference internal" href="commands/table_create.html"><em>table_create</em></a>.</p>
+<p>Here is an example <tt class="docutils literal"><span class="pre">table_create</span></tt> that uses <tt class="docutils literal"><span class="pre">NormalizerAuto</span></tt>
+normalizer module:</p>
+<p>Execution example:</p>
+<div class="highlight-none"><div class="highlight"><pre>table_create Dictionary TABLE_HASH_KEY ShortText --normalizer NormalizerAuto
+# [[0, 1337566253.89858, 0.000355720520019531], true]
+</pre></div>
+</div>
+<div class="admonition note">
+<p class="first admonition-title">Note</p>
+<p>Groonga 2.0.9 or earlier doesn't have <tt class="docutils literal"><span class="pre">--normalizer</span></tt> option in
+<tt class="docutils literal"><span class="pre">table_create</span></tt>. <tt class="docutils literal"><span class="pre">KEY_NORMALIZE</span></tt> flag was used instead.</p>
+<p class="last">You can open an old database by groonga 2.1.0 or later. An old
+database means that the database is created by groonga 2.0.9 or
+earlier. But you cannot open the opened old database by groonga
+2.0.9 or earlier. Once you open the old database by groonga 2.1.0
+or later, <tt class="docutils literal"><span class="pre">KEY_NORMALIZE</span></tt> flag information in the old database is
+converted to normalizer information. So groogna 2.0.9 or earlier
+cannot find <tt class="docutils literal"><span class="pre">KEY_NORMALIZE</span></tt> flag information in the opened old
+database.</p>
+</div>
+<p>Keys of a table that has a normalizer module are normalized:</p>
+<p>Execution example:</p>
+<div class="highlight-none"><div class="highlight"><pre>load --table Dictionary
+[
+{&quot;_key&quot;: &quot;Apple&quot;},
+{&quot;_key&quot;: &quot;black&quot;},
+{&quot;_key&quot;: &quot;COLOR&quot;}
+]
+# [[0, 1337566253.89858, 0.000355720520019531], 3]
+select Dictionary
+# [
+#   [
+#     0,
+#     1337566253.89858,
+#     0.000355720520019531
+#   ],
+#   [
+#     [
+#       [
+#         3
+#       ],
+#       [
+#         [
+#           &quot;_id&quot;,
+#           &quot;UInt32&quot;
+#         ],
+#         [
+#           &quot;_key&quot;,
+#           &quot;ShortText&quot;
+#         ]
+#       ],
+#       [
+#         1,
+#         &quot;apple&quot;
+#       ],
+#       [
+#         2,
+#         &quot;black&quot;
+#       ],
+#       [
+#         3,
+#         &quot;color&quot;
+#       ]
+#     ]
+#   ]
+# ]
+</pre></div>
+</div>
+<p><tt class="docutils literal"><span class="pre">NormalizerAuto</span></tt> normalizer normalizes a text as a downcased text.
+For example, <tt class="docutils literal"><span class="pre">&quot;Apple&quot;</span></tt> is normalized to <tt class="docutils literal"><span class="pre">&quot;apple&quot;</span></tt>, <tt class="docutils literal"><span class="pre">&quot;black&quot;</span></tt> is
+normalized to <tt class="docutils literal"><span class="pre">&quot;blank&quot;</span></tt> and <tt class="docutils literal"><span class="pre">&quot;COLOR&quot;</span></tt> is normalized to
+<tt class="docutils literal"><span class="pre">&quot;color&quot;</span></tt>.</p>
+<p>If a table is a lexicon for fulltext search, tokenized tokens are
+normalized. Because tokens are stored as table keys. Table keys are
+normalized as described above.</p>
+</div>
+<div class="section" id="built-in-normalizers">
+<h2>8.6.2. Built-in normalizers<a class="headerlink" href="#built-in-normalizers" title="Permalink to this headline">¶</a></h2>
+<p>Here is a list of built-in-normalizers:</p>
+<blockquote>
+<div><ul class="simple">
+<li><tt class="docutils literal"><span class="pre">NormalizerAuto</span></tt></li>
+<li><tt class="docutils literal"><span class="pre">NormalizerNFKC51</span></tt></li>
+</ul>
+</div></blockquote>
+<div class="section" id="normalizerauto">
+<h3>8.6.2.1. <tt class="docutils literal"><span class="pre">NormalizerAuto</span></tt><a class="headerlink" href="#normalizerauto" title="Permalink to this headline">¶</a></h3>
+<p>Normally you should use <tt class="docutils literal"><span class="pre">NormalizerAuto</span></tt>
+normalizer. <tt class="docutils literal"><span class="pre">NormalizerAuto</span></tt> was the normalizer for groonga 2.0.9 or
+earlier. <tt class="docutils literal"><span class="pre">KEY_NORMALIZE</span></tt> flag in <tt class="docutils literal"><span class="pre">table_create</span></tt> on groonga 2.0.9
+or earlier equals to <tt class="docutils literal"><span class="pre">--normalizer</span> <span class="pre">NormalizerAuto</span></tt> option in
+<tt class="docutils literal"><span class="pre">table</span></tt> on groonga 2.1.0 or later.</p>
+<p><tt class="docutils literal"><span class="pre">NormalizerAuto</span></tt> supports all encoding. It uses Unicode NFKC
+(Normalization Form Compatibility Composition) for UTF-8 encoding
+text. It uses encoding specific original normalization for other
+encodings. The results of those original normalization are similar to
+NFKC.</p>
+<p>For example, half-width katakana (such as U+FF76 HALFWIDTH KATAKANA
+LETTER KA) + half-width katakana voiced sound mark (U+FF9E HALFWIDTH
+KATAKANA VOICED SOUND MARK) is normalized to full-width katakana with
+voiced sound mark (U+30AC KATAKANA LETTER GA). The former is two
+chracters but the latter is one character.</p>
+<p>Here is an example that uses <tt class="docutils literal"><span class="pre">NormalizerAuto</span></tt> normalizer:</p>
+<p>Execution example:</p>
+<div class="highlight-none"><div class="highlight"><pre>table_create NormalLexicon TABLE_HASH_KEY ShortText --normalizer NormalizerAuto
+# [[0, 1337566253.89858, 0.000355720520019531], true]
+</pre></div>
+</div>
+</div>
+<div class="section" id="normalizernfkc51">
+<h3>8.6.2.2. <tt class="docutils literal"><span class="pre">NormalizerNFKC51</span></tt><a class="headerlink" href="#normalizernfkc51" title="Permalink to this headline">¶</a></h3>
+<p><tt class="docutils literal"><span class="pre">NormalizerNFKC51</span></tt> normalizes texts by Unicode NFKC (Normalization
+Form Compatibility Composition) for Unicode version 5.1. It supports
+only UTF-8 encoding.</p>
+<p>Normally you don't need to use <tt class="docutils literal"><span class="pre">NormalizerNFKC51</span></tt> explicitly. You can
+use <tt class="docutils literal"><span class="pre">NormalizerAuto</span></tt> instead.</p>
+<p>Here is an example that uses <tt class="docutils literal"><span class="pre">NormalizerNFKC51</span></tt> normalizer:</p>
+<p>Execution example:</p>
+<div class="highlight-none"><div class="highlight"><pre>table_create NFKC51Lexicon TABLE_HASH_KEY ShortText --normalizer NormalizerNFKC51
+# [[0, 1337566253.89858, 0.000355720520019531], true]
+</pre></div>
+</div>
+</div>
+</div>
+<div class="section" id="see-also">
+<h2>8.6.3. See also<a class="headerlink" href="#see-also" title="Permalink to this headline">¶</a></h2>
+<ul class="simple">
+<li><a class="reference internal" href="commands/table_create.html"><em>table_create</em></a></li>
+</ul>
+</div>
+</div>
+          </div>
+        </div>
+      </div>
+      <div class="sphinxsidebar">
+        <div class="sphinxsidebarwrapper">
+  <h3><a href="../index.html">Table Of Contents</a></h3>
+  <ul>
+<li><a class="reference internal" href="#">8.6. Normalizers</a><ul>
+<li><a class="reference internal" href="#summary">8.6.1. Summary</a></li>
+<li><a class="reference internal" href="#built-in-normalizers">8.6.2. Built-in normalizers</a><ul>
+<li><a class="reference internal" href="#normalizerauto">8.6.2.1. <tt class="docutils literal"><span class="pre">NormalizerAuto</span></tt></a></li>
+<li><a class="reference internal" href="#normalizernfkc51">8.6.2.2. <tt class="docutils literal"><span class="pre">NormalizerNFKC51</span></tt></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#see-also">8.6.3. See also</a></li>
+</ul>
+</li>
+</ul>
+  <h4>Previous topic</h4>
+  <p class="topless"><a href="tables.html"
+                        title="previous chapter">8.5. Tables</a></p>
+  <h4>Next topic</h4>
+  <p class="topless"><a href="tokenizers.html"
+                        title="next chapter">8.7. Tokenizers</a></p>
+  <h3>This Page</h3>
+  <ul class="this-page-menu">
+    <li><a href="../_sources/reference/normalizers.txt"
+           rel="nofollow">Show Source</a></li>
+  </ul>
+<div id="searchbox" style="display: none">
+  <h3>Quick search</h3>
+    <form class="search" action="../search.html" method="get">
+      <input type="text" name="q" />
+      <input type="submit" value="Go" />
+      <input type="hidden" name="check_keywords" value="yes" />
+      <input type="hidden" name="area" value="default" />
+    </form>
+    <p class="searchtip" style="font-size: 90%">
+    Enter search terms or a module, class or function name.
+    </p>
+</div>
+<script type="text/javascript">$('#searchbox').show(0);</script>
+        </div>
+      </div>
+      <div class="clearer"></div>
+    </div>
+    <div class="related">
+      <h3>Navigation</h3>
+      <ul>
+        <li class="right" style="margin-right: 10px">
+          <a href="../genindex.html" title="General Index"
+             >index</a></li>
+        <li class="right" >
+          <a href="tokenizers.html" title="8.7. Tokenizers"
+             >next</a> |</li>
+        <li class="right" >
+          <a href="tables.html" title="8.5. Tables"
+             >previous</a> |</li>
+        <li><a href="../index.html">groonga v2.1.0-26-ge48bfb0 documentation</a> &raquo;</li>
+          <li><a href="../reference.html" >8. リファレンスマニュアル</a> &raquo;</li>
+      </ul>
+    </div>
+    <div class="footer">
+        &copy; Copyright 2009-2012, Brazil, Inc.
+    </div>
+  </body>
+</html>