RubyGems - rroonga - Versions diffs - 4.0.5-x86-mingw32 → 4.0.6-x86-mingw32 - Mend

rroonga 4.0.5-x86-mingw32 → 4.0.6-x86-mingw32

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Files changed (545) hide show

data/vendor/local/share/doc/groonga/en/html/reference/commands/table_list.html CHANGED Viewed

@@ -7,7 +7,7 @@
   <head>
     <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
-    <title>8.3.30. table_list &mdash; Groonga v4.0.5-143-g3391c1d documentation</title>
+    <title>7.3.30. table_list &mdash; Groonga v4.0.6-211-g8c0bb0b documentation</title>
     <link rel="stylesheet" href="../../_static/groonga.css" type="text/css" />
     <link rel="stylesheet" href="../../_static/pygments.css" type="text/css" />
@@ -15,7 +15,7 @@
     <script type="text/javascript">
       var DOCUMENTATION_OPTIONS = {
         URL_ROOT:    '../../',
-        VERSION:     '4.0.5-143-g3391c1d',
+        VERSION:     '4.0.6-211-g8c0bb0b',
         COLLAPSE_INDEX: false,
         FILE_SUFFIX: '.html',
         HAS_SOURCE:  true
@@ -25,10 +25,10 @@
     <script type="text/javascript" src="../../_static/underscore.js"></script>
     <script type="text/javascript" src="../../_static/doctools.js"></script>
     <link rel="shortcut icon" href="../../_static/favicon.ico"/>
-    <link rel="top" title="Groonga v4.0.5-143-g3391c1d documentation" href="../../index.html" />
-    <link rel="up" title="8.3. Command" href="../command.html" />
-    <link rel="next" title="8.3.31. table_remove" href="table_remove.html" />
-    <link rel="prev" title="8.3.29. table_create" href="table_create.html" />
+    <link rel="top" title="Groonga v4.0.6-211-g8c0bb0b documentation" href="../../index.html" />
+    <link rel="up" title="7.3. Command" href="../command.html" />
+    <link rel="next" title="7.3.31. table_remove" href="table_remove.html" />
+    <link rel="prev" title="7.3.29. table_create" href="table_create.html" />
   </head>
   <body>
 <div class="header">
@@ -55,14 +55,14 @@
           <a href="../../genindex.html" title="General Index"
              accesskey="I">index</a></li>
         <li class="right" >
-          <a href="table_remove.html" title="8.3.31. table_remove"
+          <a href="table_remove.html" title="7.3.31. table_remove"
              accesskey="N">next</a> |</li>
         <li class="right" >
-          <a href="table_create.html" title="8.3.29. table_create"
+          <a href="table_create.html" title="7.3.29. table_create"
              accesskey="P">previous</a> |</li>
-        <li><a href="../../index.html">Groonga v4.0.5-143-g3391c1d documentation</a> &raquo;</li>
-          <li><a href="../../reference.html" >8. Reference manual</a> &raquo;</li>
-          <li><a href="../command.html" accesskey="U">8.3. Command</a> &raquo;</li>
+        <li><a href="../../index.html">Groonga v4.0.6-211-g8c0bb0b documentation</a> &raquo;</li>
+          <li><a href="../../reference.html" >7. Reference manual</a> &raquo;</li>
+          <li><a href="../command.html" accesskey="U">7.3. Command</a> &raquo;</li>
       </ul>
     </div>
@@ -72,22 +72,22 @@
           <div class="body">
   <div class="section" id="table-list">
-<h1>8.3.30. <tt class="docutils literal"><span class="pre">table_list</span></tt><a class="headerlink" href="#table-list" title="Permalink to this headline">¶</a></h1>
+<h1>7.3.30. <tt class="docutils literal"><span class="pre">table_list</span></tt><a class="headerlink" href="#table-list" title="Permalink to this headline">¶</a></h1>
 <div class="section" id="summary">
-<h2>8.3.30.1. Summary<a class="headerlink" href="#summary" title="Permalink to this headline">¶</a></h2>
+<h2>7.3.30.1. Summary<a class="headerlink" href="#summary" title="Permalink to this headline">¶</a></h2>
 <p>table_list - DBに定義されているテーブルをリスト表示</p>
 <p>Groonga組込コマンドの一つであるtable_listについて説明します。組込コマンドは、groonga実行ファイルの引数、標準
 入力、またはソケット経由でgroongaサーバにリクエストを送信することによって実行します。</p>
 <p>table_listは、DBに定義されているテーブルのリストを表示します。</p>
 </div>
 <div class="section" id="syntax">
-<h2>8.3.30.2. Syntax<a class="headerlink" href="#syntax" title="Permalink to this headline">¶</a></h2>
+<h2>7.3.30.2. Syntax<a class="headerlink" href="#syntax" title="Permalink to this headline">¶</a></h2>
 <div class="highlight-none"><div class="highlight"><pre>table_list
 </pre></div>
 </div>
 </div>
 <div class="section" id="usage">
-<h2>8.3.30.3. Usage<a class="headerlink" href="#usage" title="Permalink to this headline">¶</a></h2>
+<h2>7.3.30.3. Usage<a class="headerlink" href="#usage" title="Permalink to this headline">¶</a></h2>
 <p>Execution example:</p>
 <div class="highlight-none"><div class="highlight"><pre>table_list
 # [
@@ -177,11 +177,11 @@
 </div>
 </div>
 <div class="section" id="parameters">
-<h2>8.3.30.4. Parameters<a class="headerlink" href="#parameters" title="Permalink to this headline">¶</a></h2>
+<h2>7.3.30.4. Parameters<a class="headerlink" href="#parameters" title="Permalink to this headline">¶</a></h2>
 <p>ありません。</p>
 </div>
 <div class="section" id="return-value">
-<h2>8.3.30.5. Return value<a class="headerlink" href="#return-value" title="Permalink to this headline">¶</a></h2>
+<h2>7.3.30.5. Return value<a class="headerlink" href="#return-value" title="Permalink to this headline">¶</a></h2>
 <p>テーブル名一覧が以下の形式で返却されます。:</p>
 <div class="highlight-none"><div class="highlight"><pre>[[[テーブル情報名1,テーブル情報型1],...], テーブル情報1,...]
 </pre></div>
@@ -227,22 +227,22 @@
         <div class="sphinxsidebarwrapper">
   <h3><a href="../../index.html">Table Of Contents</a></h3>
   <ul>
-<li><a class="reference internal" href="#">8.3.30. <tt class="docutils literal"><span class="pre">table_list</span></tt></a><ul>
-<li><a class="reference internal" href="#summary">8.3.30.1. Summary</a></li>
-<li><a class="reference internal" href="#syntax">8.3.30.2. Syntax</a></li>
-<li><a class="reference internal" href="#usage">8.3.30.3. Usage</a></li>
-<li><a class="reference internal" href="#parameters">8.3.30.4. Parameters</a></li>
-<li><a class="reference internal" href="#return-value">8.3.30.5. Return value</a></li>
+<li><a class="reference internal" href="#">7.3.30. <tt class="docutils literal"><span class="pre">table_list</span></tt></a><ul>
+<li><a class="reference internal" href="#summary">7.3.30.1. Summary</a></li>
+<li><a class="reference internal" href="#syntax">7.3.30.2. Syntax</a></li>
+<li><a class="reference internal" href="#usage">7.3.30.3. Usage</a></li>
+<li><a class="reference internal" href="#parameters">7.3.30.4. Parameters</a></li>
+<li><a class="reference internal" href="#return-value">7.3.30.5. Return value</a></li>
 </ul>
 </li>
 </ul>
   <h4>Previous topic</h4>
   <p class="topless"><a href="table_create.html"
-                        title="previous chapter">8.3.29. <tt class="docutils literal"><span class="pre">table_create</span></tt></a></p>
+                        title="previous chapter">7.3.29. <tt class="docutils literal"><span class="pre">table_create</span></tt></a></p>
   <h4>Next topic</h4>
   <p class="topless"><a href="table_remove.html"
-                        title="next chapter">8.3.31. <tt class="docutils literal"><span class="pre">table_remove</span></tt></a></p>
+                        title="next chapter">7.3.31. <tt class="docutils literal"><span class="pre">table_remove</span></tt></a></p>
   <h3>This Page</h3>
   <ul class="this-page-menu">
     <li><a href="../../_sources/reference/commands/table_list.txt"
@@ -272,14 +272,14 @@
           <a href="../../genindex.html" title="General Index"
              >index</a></li>
         <li class="right" >
-          <a href="table_remove.html" title="8.3.31. table_remove"
+          <a href="table_remove.html" title="7.3.31. table_remove"
              >next</a> |</li>
         <li class="right" >
-          <a href="table_create.html" title="8.3.29. table_create"
+          <a href="table_create.html" title="7.3.29. table_create"
              >previous</a> |</li>
-        <li><a href="../../index.html">Groonga v4.0.5-143-g3391c1d documentation</a> &raquo;</li>
-          <li><a href="../../reference.html" >8. Reference manual</a> &raquo;</li>
-          <li><a href="../command.html" >8.3. Command</a> &raquo;</li>
+        <li><a href="../../index.html">Groonga v4.0.6-211-g8c0bb0b documentation</a> &raquo;</li>
+          <li><a href="../../reference.html" >7. Reference manual</a> &raquo;</li>
+          <li><a href="../command.html" >7.3. Command</a> &raquo;</li>
       </ul>
     </div>
     <div class="footer">

data/vendor/local/share/doc/groonga/en/html/reference/commands/table_remove.html CHANGED Viewed

@@ -7,7 +7,7 @@
   <head>
     <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
-    <title>8.3.31. table_remove &mdash; Groonga v4.0.5-143-g3391c1d documentation</title>
+    <title>7.3.31. table_remove &mdash; Groonga v4.0.6-211-g8c0bb0b documentation</title>
     <link rel="stylesheet" href="../../_static/groonga.css" type="text/css" />
     <link rel="stylesheet" href="../../_static/pygments.css" type="text/css" />
@@ -15,7 +15,7 @@
     <script type="text/javascript">
       var DOCUMENTATION_OPTIONS = {
         URL_ROOT:    '../../',
-        VERSION:     '4.0.5-143-g3391c1d',
+        VERSION:     '4.0.6-211-g8c0bb0b',
         COLLAPSE_INDEX: false,
         FILE_SUFFIX: '.html',
         HAS_SOURCE:  true
@@ -25,10 +25,10 @@
     <script type="text/javascript" src="../../_static/underscore.js"></script>
     <script type="text/javascript" src="../../_static/doctools.js"></script>
     <link rel="shortcut icon" href="../../_static/favicon.ico"/>
-    <link rel="top" title="Groonga v4.0.5-143-g3391c1d documentation" href="../../index.html" />
-    <link rel="up" title="8.3. Command" href="../command.html" />
-    <link rel="next" title="8.3.32. tokenize" href="tokenize.html" />
-    <link rel="prev" title="8.3.30. table_list" href="table_list.html" />
+    <link rel="top" title="Groonga v4.0.6-211-g8c0bb0b documentation" href="../../index.html" />
+    <link rel="up" title="7.3. Command" href="../command.html" />
+    <link rel="next" title="7.3.32. table_tokenize" href="table_tokenize.html" />
+    <link rel="prev" title="7.3.30. table_list" href="table_list.html" />
   </head>
   <body>
 <div class="header">
@@ -55,14 +55,14 @@
           <a href="../../genindex.html" title="General Index"
              accesskey="I">index</a></li>
         <li class="right" >
-          <a href="tokenize.html" title="8.3.32. tokenize"
+          <a href="table_tokenize.html" title="7.3.32. table_tokenize"
              accesskey="N">next</a> |</li>
         <li class="right" >
-          <a href="table_list.html" title="8.3.30. table_list"
+          <a href="table_list.html" title="7.3.30. table_list"
              accesskey="P">previous</a> |</li>
-        <li><a href="../../index.html">Groonga v4.0.5-143-g3391c1d documentation</a> &raquo;</li>
-          <li><a href="../../reference.html" >8. Reference manual</a> &raquo;</li>
-          <li><a href="../command.html" accesskey="U">8.3. Command</a> &raquo;</li>
+        <li><a href="../../index.html">Groonga v4.0.6-211-g8c0bb0b documentation</a> &raquo;</li>
+          <li><a href="../../reference.html" >7. Reference manual</a> &raquo;</li>
+          <li><a href="../command.html" accesskey="U">7.3. Command</a> &raquo;</li>
       </ul>
     </div>
@@ -72,21 +72,21 @@
           <div class="body">
   <div class="section" id="table-remove">
-<h1>8.3.31. <tt class="docutils literal"><span class="pre">table_remove</span></tt><a class="headerlink" href="#table-remove" title="Permalink to this headline">¶</a></h1>
+<h1>7.3.31. <tt class="docutils literal"><span class="pre">table_remove</span></tt><a class="headerlink" href="#table-remove" title="Permalink to this headline">¶</a></h1>
 <div class="section" id="summary">
-<h2>8.3.31.1. Summary<a class="headerlink" href="#summary" title="Permalink to this headline">¶</a></h2>
+<h2>7.3.31.1. Summary<a class="headerlink" href="#summary" title="Permalink to this headline">¶</a></h2>
 <p>table_remove - テーブルの削除</p>
 <p>groonga組込コマンドの一つであるtable_removeについて説明します。組込コマンドは、groonga実行ファイルの引数、標準入力、またはソケット経由でgroongaサーバにリクエストを送信することによって実行します。</p>
 <p>table_removeはテーブルと定義されているカラムを削除します。カラムに付随するインデックスも再帰的に削除されます。</p>
 </div>
 <div class="section" id="syntax">
-<h2>8.3.31.2. Syntax<a class="headerlink" href="#syntax" title="Permalink to this headline">¶</a></h2>
+<h2>7.3.31.2. Syntax<a class="headerlink" href="#syntax" title="Permalink to this headline">¶</a></h2>
 <div class="highlight-none"><div class="highlight"><pre>table_remove name
 </pre></div>
 </div>
 </div>
 <div class="section" id="usage">
-<h2>8.3.31.3. Usage<a class="headerlink" href="#usage" title="Permalink to this headline">¶</a></h2>
+<h2>7.3.31.3. Usage<a class="headerlink" href="#usage" title="Permalink to this headline">¶</a></h2>
 <div class="highlight-none"><div class="highlight"><pre>table_remove Entry
 [true]
@@ -94,14 +94,14 @@
 </div>
 </div>
 <div class="section" id="parameters">
-<h2>8.3.31.4. Parameters<a class="headerlink" href="#parameters" title="Permalink to this headline">¶</a></h2>
+<h2>7.3.31.4. Parameters<a class="headerlink" href="#parameters" title="Permalink to this headline">¶</a></h2>
 <dl class="docutils">
 <dt><tt class="docutils literal"><span class="pre">name</span></tt></dt>
 <dd>削除対象のカラムが定義されているテーブルの名前を指定します。</dd>
 </dl>
 </div>
 <div class="section" id="return-value">
-<h2>8.3.31.5. Return value<a class="headerlink" href="#return-value" title="Permalink to this headline">¶</a></h2>
+<h2>7.3.31.5. Return value<a class="headerlink" href="#return-value" title="Permalink to this headline">¶</a></h2>
 <div class="highlight-none"><div class="highlight"><pre>[成功かどうかのフラグ]
 </pre></div>
 </div>
@@ -119,22 +119,22 @@
         <div class="sphinxsidebarwrapper">
   <h3><a href="../../index.html">Table Of Contents</a></h3>
   <ul>
-<li><a class="reference internal" href="#">8.3.31. <tt class="docutils literal"><span class="pre">table_remove</span></tt></a><ul>
-<li><a class="reference internal" href="#summary">8.3.31.1. Summary</a></li>
-<li><a class="reference internal" href="#syntax">8.3.31.2. Syntax</a></li>
-<li><a class="reference internal" href="#usage">8.3.31.3. Usage</a></li>
-<li><a class="reference internal" href="#parameters">8.3.31.4. Parameters</a></li>
-<li><a class="reference internal" href="#return-value">8.3.31.5. Return value</a></li>
+<li><a class="reference internal" href="#">7.3.31. <tt class="docutils literal"><span class="pre">table_remove</span></tt></a><ul>
+<li><a class="reference internal" href="#summary">7.3.31.1. Summary</a></li>
+<li><a class="reference internal" href="#syntax">7.3.31.2. Syntax</a></li>
+<li><a class="reference internal" href="#usage">7.3.31.3. Usage</a></li>
+<li><a class="reference internal" href="#parameters">7.3.31.4. Parameters</a></li>
+<li><a class="reference internal" href="#return-value">7.3.31.5. Return value</a></li>
 </ul>
 </li>
 </ul>
   <h4>Previous topic</h4>
   <p class="topless"><a href="table_list.html"
-                        title="previous chapter">8.3.30. <tt class="docutils literal"><span class="pre">table_list</span></tt></a></p>
+                        title="previous chapter">7.3.30. <tt class="docutils literal"><span class="pre">table_list</span></tt></a></p>
   <h4>Next topic</h4>
-  <p class="topless"><a href="tokenize.html"
-                        title="next chapter">8.3.32. <tt class="docutils literal"><span class="pre">tokenize</span></tt></a></p>
+  <p class="topless"><a href="table_tokenize.html"
+                        title="next chapter">7.3.32. <tt class="docutils literal"><span class="pre">table_tokenize</span></tt></a></p>
   <h3>This Page</h3>
   <ul class="this-page-menu">
     <li><a href="../../_sources/reference/commands/table_remove.txt"
@@ -164,14 +164,14 @@
           <a href="../../genindex.html" title="General Index"
              >index</a></li>
         <li class="right" >
-          <a href="tokenize.html" title="8.3.32. tokenize"
+          <a href="table_tokenize.html" title="7.3.32. table_tokenize"
              >next</a> |</li>
         <li class="right" >
-          <a href="table_list.html" title="8.3.30. table_list"
+          <a href="table_list.html" title="7.3.30. table_list"
              >previous</a> |</li>
-        <li><a href="../../index.html">Groonga v4.0.5-143-g3391c1d documentation</a> &raquo;</li>
-          <li><a href="../../reference.html" >8. Reference manual</a> &raquo;</li>
-          <li><a href="../command.html" >8.3. Command</a> &raquo;</li>
+        <li><a href="../../index.html">Groonga v4.0.6-211-g8c0bb0b documentation</a> &raquo;</li>
+          <li><a href="../../reference.html" >7. Reference manual</a> &raquo;</li>
+          <li><a href="../command.html" >7.3. Command</a> &raquo;</li>
       </ul>
     </div>
     <div class="footer">

data/vendor/local/share/doc/groonga/en/html/reference/commands/tokenize.html CHANGED Viewed

@@ -7,7 +7,7 @@
   <head>
     <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
-    <title>8.3.32. tokenize &mdash; Groonga v4.0.5-143-g3391c1d documentation</title>
+    <title>7.3.33. tokenize &mdash; Groonga v4.0.6-211-g8c0bb0b documentation</title>
     <link rel="stylesheet" href="../../_static/groonga.css" type="text/css" />
     <link rel="stylesheet" href="../../_static/pygments.css" type="text/css" />
@@ -15,7 +15,7 @@
     <script type="text/javascript">
       var DOCUMENTATION_OPTIONS = {
         URL_ROOT:    '../../',
-        VERSION:     '4.0.5-143-g3391c1d',
+        VERSION:     '4.0.6-211-g8c0bb0b',
         COLLAPSE_INDEX: false,
         FILE_SUFFIX: '.html',
         HAS_SOURCE:  true
@@ -25,10 +25,10 @@
     <script type="text/javascript" src="../../_static/underscore.js"></script>
     <script type="text/javascript" src="../../_static/doctools.js"></script>
     <link rel="shortcut icon" href="../../_static/favicon.ico"/>
-    <link rel="top" title="Groonga v4.0.5-143-g3391c1d documentation" href="../../index.html" />
-    <link rel="up" title="8.3. Command" href="../command.html" />
-    <link rel="next" title="8.3.33. tokenizer_list" href="tokenizer_list.html" />
-    <link rel="prev" title="8.3.31. table_remove" href="table_remove.html" />
+    <link rel="top" title="Groonga v4.0.6-211-g8c0bb0b documentation" href="../../index.html" />
+    <link rel="up" title="7.3. Command" href="../command.html" />
+    <link rel="next" title="7.3.34. tokenizer_list" href="tokenizer_list.html" />
+    <link rel="prev" title="7.3.32. table_tokenize" href="table_tokenize.html" />
   </head>
   <body>
 <div class="header">
@@ -55,14 +55,14 @@
           <a href="../../genindex.html" title="General Index"
              accesskey="I">index</a></li>
         <li class="right" >
-          <a href="tokenizer_list.html" title="8.3.33. tokenizer_list"
+          <a href="tokenizer_list.html" title="7.3.34. tokenizer_list"
              accesskey="N">next</a> |</li>
         <li class="right" >
-          <a href="table_remove.html" title="8.3.31. table_remove"
+          <a href="table_tokenize.html" title="7.3.32. table_tokenize"
              accesskey="P">previous</a> |</li>
-        <li><a href="../../index.html">Groonga v4.0.5-143-g3391c1d documentation</a> &raquo;</li>
-          <li><a href="../../reference.html" >8. Reference manual</a> &raquo;</li>
-          <li><a href="../command.html" accesskey="U">8.3. Command</a> &raquo;</li>
+        <li><a href="../../index.html">Groonga v4.0.6-211-g8c0bb0b documentation</a> &raquo;</li>
+          <li><a href="../../reference.html" >7. Reference manual</a> &raquo;</li>
+          <li><a href="../command.html" accesskey="U">7.3. Command</a> &raquo;</li>
       </ul>
     </div>
@@ -72,14 +72,14 @@
           <div class="body">
   <div class="section" id="tokenize">
-<h1>8.3.32. <tt class="docutils literal"><span class="pre">tokenize</span></tt><a class="headerlink" href="#tokenize" title="Permalink to this headline">¶</a></h1>
+<h1>7.3.33. <tt class="docutils literal"><span class="pre">tokenize</span></tt><a class="headerlink" href="#tokenize" title="Permalink to this headline">¶</a></h1>
 <div class="section" id="summary">
-<h2>8.3.32.1. Summary<a class="headerlink" href="#summary" title="Permalink to this headline">¶</a></h2>
+<h2>7.3.33.1. Summary<a class="headerlink" href="#summary" title="Permalink to this headline">¶</a></h2>
 <p><tt class="docutils literal"><span class="pre">tokenize</span></tt> command tokenizes text by the specified tokenizer.
 It is useful to debug tokenization.</p>
 </div>
 <div class="section" id="syntax">
-<h2>8.3.32.2. Syntax<a class="headerlink" href="#syntax" title="Permalink to this headline">¶</a></h2>
+<h2>7.3.33.2. Syntax<a class="headerlink" href="#syntax" title="Permalink to this headline">¶</a></h2>
 <p><tt class="docutils literal"><span class="pre">tokenize</span></tt> command has required parameters and optional parameters.
 <tt class="docutils literal"><span class="pre">tokenizer</span></tt> and <tt class="docutils literal"><span class="pre">string</span></tt> are required parameters. Others are
 optional:</p>
@@ -88,11 +88,12 @@ optional:</p>
          [normalizer=null]
          [flags=NONE]
          [mode=ADD]
+         [token_filters=NONE]
 </pre></div>
 </div>
 </div>
 <div class="section" id="usage">
-<h2>8.3.32.3. Usage<a class="headerlink" href="#usage" title="Permalink to this headline">¶</a></h2>
+<h2>7.3.33.3. Usage<a class="headerlink" href="#usage" title="Permalink to this headline">¶</a></h2>
 <p>Here is a simple example.</p>
 <p>Execution example:</p>
 <div class="highlight-none"><div class="highlight"><pre>tokenize TokenBigram &quot;Fulltext Search&quot;
@@ -173,13 +174,13 @@ generated by tokenizing <tt class="docutils literal"><span class="pre">&quot;Ful
 tokenizer. It doesn't normalize <tt class="docutils literal"><span class="pre">&quot;Fulltext</span> <span class="pre">Search&quot;</span></tt>.</p>
 </div>
 <div class="section" id="parameters">
-<h2>8.3.32.4. Parameters<a class="headerlink" href="#parameters" title="Permalink to this headline">¶</a></h2>
+<h2>7.3.33.4. Parameters<a class="headerlink" href="#parameters" title="Permalink to this headline">¶</a></h2>
 <p>This section describes all parameters. Parameters are categorized.</p>
 <div class="section" id="required-parameters">
-<h3>8.3.32.4.1. Required parameters<a class="headerlink" href="#required-parameters" title="Permalink to this headline">¶</a></h3>
+<h3>7.3.33.4.1. Required parameters<a class="headerlink" href="#required-parameters" title="Permalink to this headline">¶</a></h3>
 <p>There are required parameters, <tt class="docutils literal"><span class="pre">tokenizer</span></tt> and <tt class="docutils literal"><span class="pre">string</span></tt>.</p>
 <div class="section" id="tokenizer">
-<h4>8.3.32.4.1.1. <tt class="docutils literal"><span class="pre">tokenizer</span></tt><a class="headerlink" href="#tokenizer" title="Permalink to this headline">¶</a></h4>
+<span id="tokenize-tokenizer"></span><h4>7.3.33.4.1.1. <tt class="docutils literal"><span class="pre">tokenizer</span></tt><a class="headerlink" href="#tokenizer" title="Permalink to this headline">¶</a></h4>
 <p>It specifies the tokenizer name. <tt class="docutils literal"><span class="pre">tokenize</span></tt> command uses the
 tokenizer that is named <tt class="docutils literal"><span class="pre">tokenizer</span></tt>.</p>
 <p>See <a class="reference internal" href="../tokenizers.html"><em>Tokenizers</em></a> about built-in tokenizers.</p>
@@ -263,7 +264,7 @@ tokenizer plugin by <a class="reference internal" href="register.html"><em>regis
 registering <tt class="docutils literal"><span class="pre">tokenizers/kytea</span></tt>.</p>
 </div>
 <div class="section" id="string">
-<h4>8.3.32.4.1.2. <tt class="docutils literal"><span class="pre">string</span></tt><a class="headerlink" href="#string" title="Permalink to this headline">¶</a></h4>
+<span id="tokenize-string"></span><h4>7.3.33.4.1.2. <tt class="docutils literal"><span class="pre">string</span></tt><a class="headerlink" href="#string" title="Permalink to this headline">¶</a></h4>
 <p>It specifies any string which you want to tokenize.</p>
 <p>If you want to include spaces in <tt class="docutils literal"><span class="pre">string</span></tt>, you need to quote
 <tt class="docutils literal"><span class="pre">string</span></tt> by single quotation (<tt class="docutils literal"><span class="pre">'</span></tt>) or double quotation (<tt class="docutils literal"><span class="pre">&quot;</span></tt>).</p>
@@ -444,10 +445,10 @@ registering <tt class="docutils literal"><span class="pre">tokenizers/kytea</spa
 </div>
 </div>
 <div class="section" id="optional-parameters">
-<h3>8.3.32.4.2. Optional parameters<a class="headerlink" href="#optional-parameters" title="Permalink to this headline">¶</a></h3>
+<h3>7.3.33.4.2. Optional parameters<a class="headerlink" href="#optional-parameters" title="Permalink to this headline">¶</a></h3>
 <p>There are optional parameters.</p>
 <div class="section" id="normalizer">
-<h4>8.3.32.4.2.1. <tt class="docutils literal"><span class="pre">normalizer</span></tt><a class="headerlink" href="#normalizer" title="Permalink to this headline">¶</a></h4>
+<span id="tokenize-normalizer"></span><h4>7.3.33.4.2.1. <tt class="docutils literal"><span class="pre">normalizer</span></tt><a class="headerlink" href="#normalizer" title="Permalink to this headline">¶</a></h4>
 <p>It specifies the normalizer name. <tt class="docutils literal"><span class="pre">tokenize</span></tt> command uses the
 normalizer that is named <tt class="docutils literal"><span class="pre">normalizer</span></tt>. Normalizer is important for
 N-gram family tokenizers such as <tt class="docutils literal"><span class="pre">TokenBigram</span></tt>.</p>
@@ -629,7 +630,7 @@ a token.</p>
 to lower case characters. For example, <tt class="docutils literal"><span class="pre">fu</span></tt> is a token.</p>
 </div>
 <div class="section" id="flags">
-<h4>8.3.32.4.2.2. <tt class="docutils literal"><span class="pre">flags</span></tt><a class="headerlink" href="#flags" title="Permalink to this headline">¶</a></h4>
+<span id="tokenize-flags"></span><h4>7.3.33.4.2.2. <tt class="docutils literal"><span class="pre">flags</span></tt><a class="headerlink" href="#flags" title="Permalink to this headline">¶</a></h4>
 <p>It specifies a tokenization customize options. You can specify
 multiple options separated by &quot;<tt class="docutils literal"><span class="pre">|</span></tt>&quot;. For example,
 <tt class="docutils literal"><span class="pre">NONE|ENABLE_TOKENIZED_DELIMITER</span></tt>.</p>
@@ -691,7 +692,7 @@ treated as already tokenized string. Tokenizer just tokenizes by
 tokenized delimiter.</p>
 </div>
 <div class="section" id="mode">
-<h4>8.3.32.4.2.3. <tt class="docutils literal"><span class="pre">mode</span></tt><a class="headerlink" href="#mode" title="Permalink to this headline">¶</a></h4>
+<span id="tokenize-mode"></span><h4>7.3.33.4.2.3. <tt class="docutils literal"><span class="pre">mode</span></tt><a class="headerlink" href="#mode" title="Permalink to this headline">¶</a></h4>
 <p>It specifies a tokenize mode. If the mode is specified <tt class="docutils literal"><span class="pre">ADD</span></tt>, the text
 is tokenized by the rule that adding a document. If the mode is specified
 <tt class="docutils literal"><span class="pre">GET</span></tt>, the text is tokenized by the rule that searching a document. If
@@ -844,10 +845,16 @@ the mode is omitted, the text is tokenized by the <tt class="docutils literal"><
 </div>
 <p>The last alphabet is tokenized by two characters.</p>
 </div>
+<div class="section" id="token-filters">
+<span id="tokenize-token-filters"></span><h4>7.3.33.4.2.4. <tt class="docutils literal"><span class="pre">token_filters</span></tt><a class="headerlink" href="#token-filters" title="Permalink to this headline">¶</a></h4>
+<p>It specifies the token filter names. <tt class="docutils literal"><span class="pre">tokenize</span></tt> command uses the
+tokenizer that is named <tt class="docutils literal"><span class="pre">token_filters</span></tt>.</p>
+<p>See <a class="reference internal" href="../token_filters.html"><em>Token filters</em></a> about token filters.</p>
+</div>
 </div>
 </div>
 <div class="section" id="return-value">
-<h2>8.3.32.5. Return value<a class="headerlink" href="#return-value" title="Permalink to this headline">¶</a></h2>
+<span id="tokenize-return-value"></span><h2>7.3.33.5. Return value<a class="headerlink" href="#return-value" title="Permalink to this headline">¶</a></h2>
 <p><tt class="docutils literal"><span class="pre">tokenize</span></tt> command returns tokenized tokens. Each token has some
 attributes except token itself. The attributes will be increased in
 the feature:</p>
@@ -883,7 +890,7 @@ attributes.</p>
 </div></blockquote>
 </div>
 <div class="section" id="see-also">
-<h2>8.3.32.6. See also<a class="headerlink" href="#see-also" title="Permalink to this headline">¶</a></h2>
+<h2>7.3.33.6. See also<a class="headerlink" href="#see-also" title="Permalink to this headline">¶</a></h2>
 <ul class="simple">
 <li><a class="reference internal" href="../tokenizers.html"><em>Tokenizers</em></a></li>
 </ul>
@@ -898,36 +905,37 @@ attributes.</p>
         <div class="sphinxsidebarwrapper">
   <h3><a href="../../index.html">Table Of Contents</a></h3>
   <ul>
-<li><a class="reference internal" href="#">8.3.32. <tt class="docutils literal"><span class="pre">tokenize</span></tt></a><ul>
-<li><a class="reference internal" href="#summary">8.3.32.1. Summary</a></li>
-<li><a class="reference internal" href="#syntax">8.3.32.2. Syntax</a></li>
-<li><a class="reference internal" href="#usage">8.3.32.3. Usage</a></li>
-<li><a class="reference internal" href="#parameters">8.3.32.4. Parameters</a><ul>
-<li><a class="reference internal" href="#required-parameters">8.3.32.4.1. Required parameters</a><ul>
-<li><a class="reference internal" href="#tokenizer">8.3.32.4.1.1. <tt class="docutils literal"><span class="pre">tokenizer</span></tt></a></li>
-<li><a class="reference internal" href="#string">8.3.32.4.1.2. <tt class="docutils literal"><span class="pre">string</span></tt></a></li>
+<li><a class="reference internal" href="#">7.3.33. <tt class="docutils literal"><span class="pre">tokenize</span></tt></a><ul>
+<li><a class="reference internal" href="#summary">7.3.33.1. Summary</a></li>
+<li><a class="reference internal" href="#syntax">7.3.33.2. Syntax</a></li>
+<li><a class="reference internal" href="#usage">7.3.33.3. Usage</a></li>
+<li><a class="reference internal" href="#parameters">7.3.33.4. Parameters</a><ul>
+<li><a class="reference internal" href="#required-parameters">7.3.33.4.1. Required parameters</a><ul>
+<li><a class="reference internal" href="#tokenizer">7.3.33.4.1.1. <tt class="docutils literal"><span class="pre">tokenizer</span></tt></a></li>
+<li><a class="reference internal" href="#string">7.3.33.4.1.2. <tt class="docutils literal"><span class="pre">string</span></tt></a></li>
 </ul>
 </li>
-<li><a class="reference internal" href="#optional-parameters">8.3.32.4.2. Optional parameters</a><ul>
-<li><a class="reference internal" href="#normalizer">8.3.32.4.2.1. <tt class="docutils literal"><span class="pre">normalizer</span></tt></a></li>
-<li><a class="reference internal" href="#flags">8.3.32.4.2.2. <tt class="docutils literal"><span class="pre">flags</span></tt></a></li>
-<li><a class="reference internal" href="#mode">8.3.32.4.2.3. <tt class="docutils literal"><span class="pre">mode</span></tt></a></li>
+<li><a class="reference internal" href="#optional-parameters">7.3.33.4.2. Optional parameters</a><ul>
+<li><a class="reference internal" href="#normalizer">7.3.33.4.2.1. <tt class="docutils literal"><span class="pre">normalizer</span></tt></a></li>
+<li><a class="reference internal" href="#flags">7.3.33.4.2.2. <tt class="docutils literal"><span class="pre">flags</span></tt></a></li>
+<li><a class="reference internal" href="#mode">7.3.33.4.2.3. <tt class="docutils literal"><span class="pre">mode</span></tt></a></li>
+<li><a class="reference internal" href="#token-filters">7.3.33.4.2.4. <tt class="docutils literal"><span class="pre">token_filters</span></tt></a></li>
 </ul>
 </li>
 </ul>
 </li>
-<li><a class="reference internal" href="#return-value">8.3.32.5. Return value</a></li>
-<li><a class="reference internal" href="#see-also">8.3.32.6. See also</a></li>
+<li><a class="reference internal" href="#return-value">7.3.33.5. Return value</a></li>
+<li><a class="reference internal" href="#see-also">7.3.33.6. See also</a></li>
 </ul>
 </li>
 </ul>
   <h4>Previous topic</h4>
-  <p class="topless"><a href="table_remove.html"
-                        title="previous chapter">8.3.31. <tt class="docutils literal"><span class="pre">table_remove</span></tt></a></p>
+  <p class="topless"><a href="table_tokenize.html"
+                        title="previous chapter">7.3.32. <tt class="docutils literal"><span class="pre">table_tokenize</span></tt></a></p>
   <h4>Next topic</h4>
   <p class="topless"><a href="tokenizer_list.html"
-                        title="next chapter">8.3.33. <tt class="docutils literal"><span class="pre">tokenizer_list</span></tt></a></p>
+                        title="next chapter">7.3.34. <tt class="docutils literal"><span class="pre">tokenizer_list</span></tt></a></p>
   <h3>This Page</h3>
   <ul class="this-page-menu">
     <li><a href="../../_sources/reference/commands/tokenize.txt"
@@ -957,14 +965,14 @@ attributes.</p>
           <a href="../../genindex.html" title="General Index"
              >index</a></li>
         <li class="right" >
-          <a href="tokenizer_list.html" title="8.3.33. tokenizer_list"
+          <a href="tokenizer_list.html" title="7.3.34. tokenizer_list"
              >next</a> |</li>
         <li class="right" >
-          <a href="table_remove.html" title="8.3.31. table_remove"
+          <a href="table_tokenize.html" title="7.3.32. table_tokenize"
              >previous</a> |</li>
-        <li><a href="../../index.html">Groonga v4.0.5-143-g3391c1d documentation</a> &raquo;</li>
-          <li><a href="../../reference.html" >8. Reference manual</a> &raquo;</li>
-          <li><a href="../command.html" >8.3. Command</a> &raquo;</li>
+        <li><a href="../../index.html">Groonga v4.0.6-211-g8c0bb0b documentation</a> &raquo;</li>
+          <li><a href="../../reference.html" >7. Reference manual</a> &raquo;</li>
+          <li><a href="../command.html" >7.3. Command</a> &raquo;</li>
       </ul>
     </div>
     <div class="footer">