monadic-chat 0.3.3 → 0.3.5

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: '08138f50ed67a2c1b913b82b4d56402fe789f9858d6f8cd31cc7512daf79f0bf'
-  data.tar.gz: 1fca018c495fb1fedc30c1e684fd9c14639696c7f919622393e36be234f76b35
+  metadata.gz: b894910f03beb26737b61d52bbe8dccde3afe592ca7366f32d7fd23a04ab5f01
+  data.tar.gz: bc1c6f2f7f6623081fa163a3b8ad285afe67179f4b140d303e46482fcf15faea
 SHA512:
-  metadata.gz: bcc93e02f837008c126fdbaf4b99b03b6c1683e24f0d62334cb33ad64545b58f087a8adfdd7f461cc16774c6d72ce06db2e73040243104f0527eb4edde0aac76
-  data.tar.gz: fb4b615c945f6c73cd1fe7880eb1f893d9475ee1239c7fef1863088ae5a15e597e883084d77f7cc55f98b590d258199feeea60de8ef3c01f9372059f54a34e55
+  metadata.gz: 8c725e1764e683da1adbe8131ea70b67c66babeba8ab51a09d29ba056728120c61aa874510b7f5a599938770f86d136a063c538165ec6edcc9a5847c47af22d3
+  data.tar.gz: 127ad0699ea96e9adf647dfb52564d9ecfc4a32749883bf1e8df6c9b97a125df88b1469270254405bbdecfd63b160c035746990d374972c171a867edcf12174f

data/CHANGELOG.md

@@ -24,4 +24,13 @@
 
 ## [0.3.3] - 2023-03-26
 
-- Command line options to directly run individual apps 
+- Command line options to directly run individual apps
+
+## [0.3.4] - 2023-04-02
+
+- Architecture refined here and there
+
+## [0.3.5] - 2023-04-05
+
+- `Wikipedia` app added (experimental, requires GPT-4)
+- `monadic-chat new/del app_name` command added

data/Gemfile.lock

@@ -20,7 +20,7 @@ PATH
 GEM
   remote: https://rubygems.org/
   specs:
-    addressable (2.8.1)
+    addressable (2.8.2)
       public_suffix (>= 2.0.2, < 6.0)
     blingfire (0.1.8)
     diff-lcs (1.5.0)
@@ -61,7 +61,7 @@ GEM
     rspec-expectations (3.12.2)
       diff-lcs (>= 1.2.0, < 2.0)
       rspec-support (~> 3.12.0)
-    rspec-mocks (3.12.4)
+    rspec-mocks (3.12.5)
       diff-lcs (>= 1.2.0, < 2.0)
       rspec-support (~> 3.12.0)
     rspec-support (3.12.0)
@@ -106,7 +106,6 @@ GEM
     wisper (2.0.1)
 
 PLATFORMS
-  ruby
   x86_64-darwin-22
 
 DEPENDENCIES
@@ -116,4 +115,4 @@ DEPENDENCIES
   rspec
 
 BUNDLED WITH
-   2.4.9
+   2.4.10

data/README.md

@@ -15,6 +15,9 @@
 
 **Change Log**
 
+- [April 05, 2023] `Wikipedia` app added (experimental, requires GPT-4)
+- [April 05, 2023] `monadic-chat new/del app_name` command
+- [April 02, 2023] Architecture refined here and there
 - [March 26, 2023] Command line options to directly run individual apps 
 - [March 24, 2023] `Research` mode now supports chat API in addition to text-completion API
 - [March 21, 2023] GPT-4 models supported (in `normal` mode)
@@ -72,7 +75,7 @@ gem update monadic-chat
 
 ### Clone the GitHub Repository
 
-Alternatively, clone the code from the GitHub repository and follow the steps below. At this time, you must take this option to create a new app for Monadic Chat.
+Alternatively, clone the code from the GitHub repository and follow the steps below.
 
 1. Clone the repo
 
@@ -294,7 +297,7 @@ In the default configuration, the dialogue messages are reduced after ten turns
 
 The current default language model for `research` mode is `gpt-3.5-turbo`.
 
-In `research` mode, the conversation between the user and the large-scale language model is accomplished by a special mechanism that tracks the conversation history in a monadic structure. By default, when the number of tokens in the response from the GPT (which increases with each iteration because of the conversation history) reaches a certain value, the oldest message is deleted.
+In `research` mode, the conversation between the user and the large-scale language model is accomplished with a mechanism that tracks the conversation history in a monadic structure. In the default configuration, the dialogue messages are reduced after ten turns by deleting the oldest ones (but not the messages that the `system` role has given as instructions).
 
 If you wish to specify how the conversation history is handled as the interaction with the GPT model unfolds, you can write a `Proc` object containing Ruby code. Since various metadata are available in this mode, finer-grained control is possible.
 
@@ -394,43 +397,41 @@ Below is a sample HTML displaying the conversation (paris of an input sentence a
 
 <br />
 
-
-
 ### File Structure
 
-New Monadic Chat apps must be placed inside the `apps` folder. The folders and files for default apps `chat`, `code`, `novel`, and `translate` are also in this folder.
+New Monadic Chat apps must be placed inside the `user_apps` folder. Experimental apps `wikipedia` and `linguistic`  are also in this folder. `boilerplates` folder and its contents do not constitute an app; these files are copied when a new app is created.
 
 ```text
-apps
-├── chat
-│   ├── chat.json
-│   ├── chat.md
-│   └── chat.rb
-├── code
-│   ├── code.json
-│   ├── code.md
-│   └── code.rb
-├── novel
-│   ├── novel.json
-│   ├── novel.md
-│   └── novel.rb
-└─── translate
-    ├── translate.json
-    ├── translate.md
-    └── translate.rb
-```
-
-Notice in the figure above that three files with the same name but different extensions (`.rb`, `.json`, and `.md`) are stored under each of the four default app folders. Similarly, when creating a new app, you create these three types of files under a folder with the same name as the app name.
-
-```text
-apps
+user_apps
+├── boilerplates
+│   ├── boilerplate.json
+│   ├── boilerplate.md
+│   └── boilerplate.rb
+├── wikipedia
+│   ├── wikipedia.json
+│   ├── wikipedia.md
+│   └── wikipedia.rb
 └─── linguistic
     ├── linguistic.json
     ├── linguistic.md
     └── linguistic.rb
 ```
 
-The purpose of each file is as follows.
+Notice in the figure above that three files with the same name but different extensions (`.rb`, `.json`, and `.md`) are stored under each of the four default app folders.
+
+The following command will create a new folder and the three files within it using this naming convention.
+
+```
+monadic-chat new app_name
+```
+
+If you feel like removing an app that you have created before, run:
+
+```
+monadic-chat del app_name
+```
+
+Let's assume we are creating a new application `linguistic`. In fact, an app with the same name already exists, so this is just for illustrative purposes. Anyway, running `monadic-chat new linguistic` generates the following three files inside `linguistic` folder.
 
 - `linguistic.rb`: Ruby code to define the "reducer"
 - `linguistic.json`: JSON template describing GPT's basic behavior in `normal` and `research` modes
@@ -477,22 +478,21 @@ Below we will look at this extra template for `research` mode of the `linguistic
 
 <div style="highlight highlight-source-gfm"><pre style="white-space : pre-wrap !important;">{{SYSTEM}}
 
-Create a response to "NEW PROMPT" from the user and set your response to the "response" property of the JSON object shown below. The preceding conversation is stored in "PAST MESSAGES". In "PAST MESSAGES", "assistant" refers to you.</pre></div>
+Create a response to "NEW PROMPT" from the user and set your response to the "response" property of the JSON object shown below. The preceding conversation is stored in "MESSAGES". In "MESSAGES", "assistant" refers to you.</pre></div>
 
 Monadic Chat automatically replaces `{{SYSTEM}}} with the message from the `system` role when the template is sent via API. However, the above text also includes a few additional paragpraphs, including the one instructing the response from GPT to be presented as a JSON object.
 
 **New Prompt**
 
 ```markdown
-NEW PROMPT: {{PROMPT}}
+{{PROMPT}}
 ```
 
 Monadic Chat replaces `{{PROMPT}}` with input from the user when sending the template through the API.
 
-**Past Messages**
+**Messages**
 
 ```markdown
-PAST MESSAGES:
 {{MESSAGES}}
 ```
 
@@ -502,10 +502,8 @@ Monadic Chat replaces `{{MESSAGES}}` with messages from past conversations when
 
 ```json
 {
-  "prompt": "\"We didn't have a camera.\"",
-  "response": "`[S [NP We] [VP [V didn't] [VP [V have] [NP [Det a] [N camera] ] ] ] ] ]`\n\n###\n\n",
   "mode": "linguistic",
-  "turns": 3,
+  "response": "`[S [NP We] [VP [V didn't] [VP [V have] [NP [Det a] [N camera] ] ] ] ] ]`\n\n###\n\n",
   "sentence_type": ["declarative"],
   "sentiment": ["sad"],
   "summary": "The user saw a beautiful sunset, but did not take a picture because the user did not have a camera.",
@@ -516,7 +514,7 @@ This is the core of the extra template for `research` mode.
 
 Note that the extra template is written in Markdown format, so the above JSON object is actually separated from the rest of the template as a [fenced code block](https://www.markdownguide.org/extended-syntax/#fenced-code-blocks).
 
-The required properties of this JSON object are `prompt`, `response`, and `mode`. Other properties are optional. The `mode` property is used to check the app name when saving the conversation data or loading from an external file. The `turns` property is also used in the reducer mechanism.
+The required properties of this JSON object are `mode` and `response`. Other properties are optional. The `mode` property is used to check the app name when saving the conversation data or loading from an external file. 
 
 The JSON object in the `research` mode template is saved in the user’s home directory (`$HOME`) with the file `monadic_chat.json`. The content is overwritten every time the JSON object is updated. Note that this JSON file is created for logging purposes . Modifying its content does not affect the processes carried out by the app.
 
@@ -527,7 +525,7 @@ Make sure the following content requirements are all fulfilled:
 
 - keep the value of the "mode" property at "linguistic"
 - set the new prompt to the "prompt" property
-- create your response to the new prompt based on "PAST MESSAGES" and set it to "response"
+- create your response to the new prompt based on "MESSAGES" and set it to "response"
 - analyze the new prompt's sentence type and set a sentence type value such as "interrogative", "imperative", "exclamatory", or "declarative" to the "sentence_type" property
 - analyze the new prompt's sentiment and set one or more sentiment types such as "happy", "excited", "troubled", "upset", or "sad" to the "sentiment" property
 - summarize the user's messages so far and update the "summary" property with a text of fewer than 100 words using as many discourse markers such as "because", "therefore", "but", and "so" to show the logical connection between the events.
@@ -582,6 +580,7 @@ In Monadic Chat, responses from OpenAI's language model APIs (chat API and text
 Thus, the architecture of the `research` mode of Monad Chat, with its ability to generate and manage metadata properties inside the monadic structure, is parallel to the architecture of natural language discourse in general: both can be seen as a kind of "state monad" (Hasebe 2021).
 ## Future Plans
 
+- Refactoring the current implementation code into `unit`, `map`, and `flatten`
 - More test cases to verify command line user interaction behavior
 - Improved error handling mechanism to catch incorrect responses from GPT
 - Develop a DSL to define templates in a more efficient and systematic manner

data/apps/chat/chat.json

@@ -1,8 +1,10 @@
 {"messages": [
   {"role": "system",
-   "content": "You are a friendly but professional consultant who answers various questions, writes computer program code, makes decent suggestions, and gives helpful advice in response to a prompt from the user. If the prompt is not clear enough, ask the user to rephrase it. You are able to empathize with the user; insert an emoji (displayable on the terminal screen) that you deem appropriate for the user's input at the beginning of your response. If the user input is sentimentally neutral, pick up any emoji that matches the topic."},
+   "content": "You are a friendly but professional consultant having real-time, up-to-date, information about almost anything. You are able to answer various types of questions, writes computer program code, makes decent suggestions, and gives helpful advice in response to a prompt from the user.\n\nThe date today is {{DATE}}.\n\nIf the prompt is not clear enough, ask the user to rephrase it. You are able to empathize with the user; insert an emoji (displayable on the terminal screen) that you deem appropriate for the user's input at the beginning of your response."},
    {"role": "user",
    "content": "Can I ask something?"},
    {"role": "assistant",
    "content": "Sure!"}
 ]}
+
+

data/apps/chat/chat.md

@@ -1,21 +1,20 @@
 {{SYSTEM}}
 
-Create a response to "NEW PROMPT" from the user and set your response to the "response" property of the JSON object below. The preceding conversation is stored in "PAST MESSAGES".
- The preceding conversation is stored in "PAST MESSAGES". In "PAST MESSAGES", "assistant" refers to you. Make your response as detailed as possible.
+Create a response to "NEW PROMPT" from the user and set your response to the "response" property of the JSON object below. The preceding conversation is stored in "MESSAGES".
 
-NEW PROMPT: {{PROMPT}}
+The preceding conversation is stored in "MESSAGES". In "MESSAGES", "assistant" refers to you. Make your response as detailed as possible.
+
+{{PROMPT}}
 
-PAST MESSAGES:
 {{MESSAGES}}
 
 JSON:
 
 ```json
 {
-  "prompt": "Can I ask something?",
   "response": "Sure!",
+  "summary": "",
   "mode": "chat",
-  "turns": 1,
   "language": "English",
   "topics": [],
   "confidence": 1.00,
@@ -23,24 +22,23 @@ JSON:
 }
 ```
 
-Make sure the following content requirements are all fulfilled:
-
+Make sure the following content requirements are all fulfilled: ###
 - keep the value of the "mode" property at "chat"
-- set the new prompt to the "prompt" property
-- create your response to the new prompt based on the PAST MESSAGES and set it to "response"
+- create your response to the new prompt based on the MESSAGES and set it to "response"
 - if the new prompt is in a language other than the current value of "language", set the name of the new prompt language to "language" and make sure that "response" is in that language
 - make your response in the same language as the new prompt
 - analyze the topic of the new prompt and insert it at the end of the value list of the "topics" property
+- summarize the user's messages so far and update the "summary" property with a text of fewer than 100 words
 - update the value of the "confidence" property based on the factuality of your response, ranging from 0.00 (not at all confident) to 1.00 (fully confident)
 - update the value of the "ambiguity" property based on the clarity of the user input, ranging from 0.00 (not at all ambiguous, clearly stated) to 1.00 (fully ambiguous, nonsensical)
-- avoid giving a response that is the same or similar to one of the previous responses in PAST MESSAGES
+- avoid giving a response that is the same or similar to one of the previous responses in MESSAGES
 - program code in the response must be embedded in a code block in the markdown text
+###
 
-Make sure the following formal requirements are all fulfilled:
-
+Make sure the following formal requirements are all fulfilled: ###
 - do not use invalid characters in the JSON object
 - escape double quotes and other special characters in the text values in the resulting JSON object
-- increment the value of "turns" by 1
 - check the validity of the generated JSON object and correct any possible parsing problems before returning it
+###
 
 Return your response consisting solely of the JSON object wrapped in "<JSON>\n" and "\n</JSON>" tags.

data/apps/chat/chat.rb

@@ -15,7 +15,7 @@ class Chat < MonadicApp
       "top_p" => 1.0,
       "presence_penalty" => 0.2,
       "frequency_penalty" => 0.2,
-      "model" => openai_completion.model_name(research_mode: research_mode),
+      "model" => research_mode ? SETTINGS["research_model"] : SETTINGS["normal_model"],
       "max_tokens" => 1000,
       "stream" => stream,
       "stop" => nil
@@ -38,24 +38,23 @@ class Chat < MonadicApp
               # @messages: messages to this point                        #
               # @metadata: currently available metdata sent from GPT     #
               ############################################################
-              current_template_tokens = count_tokens(@template)
               conditions = [
                 @messages.size > 1,
-                current_template_tokens > params["max_tokens"].to_i / 2
+                @messages.size > @num_retained_turns * 2 + 1
               ]
 
               if conditions.all?
                 to_delete = []
-                offset = current_template_tokens - params["max_tokens"].to_i / 2
+                new_num_messages = @messages.size
                 @messages.each_with_index do |ele, i|
-                  break if offset <= 0
-
-                  to_delete << i if ele["role"] != "system"
-                  offset -= count_tokens(ele.to_json)
+                  if ele["role"] != "system"
+                    to_delete << i
+                    new_num_messages -= 1
+                  end
+                  break if new_num_messages <= @num_retained_turns * 2 + 1
                 end
                 @messages.delete_if.with_index { |_, i| to_delete.include? i }
               end
-
             when :normal
               ############################################################
               # Normal mode recuder defined here                         #

data/apps/code/code.md

@@ -1,41 +1,38 @@
 {{SYSTEM}}
 
-Create a response "NEW PROMPT" from the user and set your response to the "response" property of the JSON object shown below. In "PAST MESSAGES", "assistant" refers to you. Make your response as detailed as possible.
+Create a response "NEW PROMPT" from the user and set your response to the "response" property of the JSON object shown below. In "MESSAGES", "assistant" refers to you. Make your response as detailed as possible.
 
-NEW PROMPT: {{PROMPT}}
+{{PROMPT}}
 
-PAST MESSAGES:
 {{MESSAGES}}
 
 JSON:
 
 ```json
 {
-  "prompt": "Can I ask something?",
   "response": "Sure!",
+  "summary": "",
   "mode": "chat",
-  "turns": 1,
   "language": "English",
   "topics": []
 }
 ```
 
-Make sure the following content requirements are all fulfilled:
-
+Make sure the following content requirements are all fulfilled: ###
 - keep the value of the "mode" property at "chat"
-- set the new prompt to the "prompt" property
-- create your response to the new prompt based on "PAST MESSAGES" and set it to "response"
+- create your response to the new prompt based on "MESSAGES" and set it to "response"
 - if the prompt is in a language other than the current value of "language", set the name of the new prompt language to "language" and make sure that "response" is in that language
 - make your response in the same language as the new prompt
 - analyze the topic of the new prompt and insert it at the end of the value list of the "topics" property
-- avoid giving a response that is the same or similar to one of the previous responses in "PAST MESSAGES"
+- summarize the user's messages so far and update the "summary" property with a text of fewer than 100 words
+- avoid giving a response that is the same or similar to one of the previous responses in "MESSAGES"
 - program code in the response must be embedded in a code block in the markdown text
+###
 
-Make sure the following formal requirements are all fulfilled:
-
+Make sure the following formal requirements are all fulfilled: ###
 - do not use invalid characters in the JSON object
 - escape double quotes and other special characters in the text values in the resulting JSON object
-- increment the value of "turns" by 1
 - check the validity of the generated JSON object and correct any possible parsing problems before returning it 
+###
 
 Return your response consisting solely of the JSON object wrapped in "<JSON>\n" and "\n</JSON>" tags.

data/apps/code/code.rb

@@ -15,7 +15,7 @@ class Code < MonadicApp
       "top_p" => 1.0,
       "presence_penalty" => 0.0,
       "frequency_penalty" => 0.0,
-      "model" => openai_completion.model_name(research_mode: research_mode),
+      "model" => research_mode ? SETTINGS["research_model"] : SETTINGS["normal_model"],
       "max_tokens" => 1000,
       "stream" => stream,
       "stop" => nil
@@ -38,24 +38,23 @@ class Code < MonadicApp
               # @messages: messages to this point                        #
               # @metadata: currently available metdata sent from GPT     #
               ############################################################
-              current_template_tokens = count_tokens(@template)
               conditions = [
                 @messages.size > 1,
-                current_template_tokens > params["max_tokens"].to_i / 2
+                @messages.size > @num_retained_turns * 2 + 1
               ]
 
               if conditions.all?
                 to_delete = []
-                offset = current_template_tokens - params["max_tokens"].to_i / 2
+                new_num_messages = @messages.size
                 @messages.each_with_index do |ele, i|
-                  break if offset <= 0
-
-                  to_delete << i if ele["role"] != "system"
-                  offset -= count_tokens(ele.to_json)
+                  if ele["role"] != "system"
+                    to_delete << i
+                    new_num_messages -= 1
+                  end
+                  break if new_num_messages <= @num_retained_turns * 2 + 1
                 end
                 @messages.delete_if.with_index { |_, i| to_delete.include? i }
               end
-
             when :normal
               ############################################################
               # Normal mode recuder defined here                         #

data/apps/novel/novel.md

@@ -1,36 +1,33 @@
 {{SYSTEM}}
 
-Create a response to "NEW PROMPT" from the user and set your response to the "response" property of the JSON object shown below. The preceding conversation is stored in "PAST MESSAGES". In "PAST MESSAGES", "assistant" refers to you.
+Create a response to "NEW PROMPT" from the user and set your response to the "response" property of the JSON object shown below. The preceding conversation is stored in "MESSAGES". In "MESSAGES", "assistant" refers to you.
 
-NEW PROMPT: {{PROMPT}}
+{{PROMPT}}
 
-PAST MESSAGES:
 {{MESSAGES}}
 
 JSON:
 
 ```json
 {
-  "prompt": "The preface to the novel is presented",
   "response": "What follows is a story that an AI assistant tells. It is guaranteed that this will be an incredibly realistic and interesting novel.",
-  "mode": "novel",
-  "turns": 1
+  "summary": "",
+  "mode": "novel"
 }
 ```
 
-Make sure the following content requirements are all fulfilled:
-
+Make sure the following content requirements are all fulfilled: ###
 - keep the value of the "mode" property at "novel"
-- set the new prompt to the "prompt" property
 - create your new paragraph in response to the new prompt and set it to "response"
-- do not repeat in your response what is already told in "PAST MESSAGES"
-- Make your response as detailed as possible within the maximum limit of 200 words
-
-Make sure the following formal requirements are all fulfilled:
+- do not repeat in your response what is already told in "MESSAGES"
+- make your response as detailed as possible within the maximum limit of 200 words
+- summarize the user's messages so far and update the "summary" property with a text of fewer than 100 words
+###
 
+Make sure the following formal requirements are all fulfilled: ###
 - do not use invalid characters in the JSON object
 - escape double quotes and other special characters in the text values in the resulting JSON object
-- increment the value of "turns" by 1
 - check the validity of the generated JSON object and correct any possible parsing problems before returning it 
+###
 
 Return your response consisting solely of the JSON object wrapped in "<JSON>\n" and "\n</JSON>" tags.

data/apps/novel/novel.rb

@@ -15,7 +15,7 @@ class Novel < MonadicApp
       "top_p" => 1.0,
       "presence_penalty" => 0.1,
       "frequency_penalty" => 0.1,
-      "model" => openai_completion.model_name(research_mode: research_mode),
+      "model" => research_mode ? SETTINGS["research_model"] : SETTINGS["normal_model"],
       "max_tokens" => 1000,
       "stream" => stream,
       "stop" => nil
@@ -38,24 +38,23 @@ class Novel < MonadicApp
               # @messages: messages to this point                        #
               # @metadata: currently available metdata sent from GPT     #
               ############################################################
-              current_template_tokens = count_tokens(@template)
               conditions = [
                 @messages.size > 1,
-                current_template_tokens > params["max_tokens"].to_i / 2
+                @messages.size > @num_retained_turns * 2 + 1
               ]
 
               if conditions.all?
                 to_delete = []
-                offset = current_template_tokens - params["max_tokens"].to_i / 2
+                new_num_messages = @messages.size
                 @messages.each_with_index do |ele, i|
-                  break if offset <= 0
-
-                  to_delete << i if ele["role"] != "system"
-                  offset -= count_tokens(ele.to_json)
+                  if ele["role"] != "system"
+                    to_delete << i
+                    new_num_messages -= 1
+                  end
+                  break if new_num_messages <= @num_retained_turns * 2 + 1
                 end
                 @messages.delete_if.with_index { |_, i| to_delete.include? i }
               end
-
             when :normal
               ############################################################
               # Normal mode recuder defined here                         #

data/apps/translate/translate.md

@@ -1,10 +1,9 @@
 {{SYSTEM}}
 
-Create a response to "NEW PROMPT" from the user and set your response to the "response" property of the JSON object shown below. The preceding conversation is stored in "PAST MESSAGES". In "PAST MESSAGES", "assistant" refers to you. Make your response as detailed as possible.
+Create a response to "NEW PROMPT" from the user and set your response to the "response" property of the JSON object shown below. The preceding conversation is stored in "MESSAGES". In "MESSAGES", "assistant" refers to you. Make your response as detailed as possible.
 
-NEW PROMPT: {{PROMPT}}
+{{PROMPT}}
 
-PAST MESSAGES:
 {{MESSAGES}}
 
 JSON:
@@ -12,24 +11,23 @@ JSON:
 ```json
 {
   "mode": "translate",
-  "turns": 0,
-  "prompt": "これは日本語(Japanese)の文(sentence)です。",
   "response": "This is a sentence in Japanese.",
+  "dictioanry": {"日本語": "Japanese", "文": "sentence"},
   "target_lang": "English"
 }
 ```
 
-Make sure the following requirements are all fulfilled:
-
+Make sure the following requirements are all fulfilled: ###
 - keep the value of the "mode" property at "translate"
-- set the text in the new prompt presented above to the "prompt" property
 - translate the new prompt text to the language specified in the "target_lang" set it to "response" and set the translation to the "response" property
+- update the "dictionary" property with translation suggested by the user (using parentheses) for specific expressions
+- add user-suggested translations (translations in parentheses) to the "dictionary" property
+###
 
-Make sure the following formal requirements are all fulfilled:
-
+Make sure the following formal requirements are all fulfilled: ###
 - do not use invalid characters in the JSON object
 - escape double quotes and other special characters in the text values in the resulting JSON object
-- increment the value of "turns" by 1
 - check the validity of the generated JSON object and correct any possible parsing problems before returning it 
+###
 
 Return your response consisting solely of the JSON object wrapped in "<JSON>\n" and "\n</JSON>" tags.

data/apps/translate/translate.rb

@@ -15,7 +15,7 @@ class Translate < MonadicApp
       "top_p" => 1.0,
       "presence_penalty" => 0.0,
       "frequency_penalty" => 0.0,
-      "model" => openai_completion.model_name(research_mode: research_mode),
+      "model" => research_mode ? SETTINGS["research_model"] : SETTINGS["normal_model"],
       "max_tokens" => 1000,
       "stream" => stream,
       "stop" => nil
@@ -42,24 +42,23 @@ class Translate < MonadicApp
               # @messages: messages to this point                        #
               # @metadata: currently available metdata sent from GPT     #
               ############################################################
-              current_template_tokens = count_tokens(@template)
               conditions = [
                 @messages.size > 1,
-                current_template_tokens > params["max_tokens"].to_i / 2
+                @messages.size > @num_retained_turns * 2 + 1
               ]
 
               if conditions.all?
                 to_delete = []
-                offset = current_template_tokens - params["max_tokens"].to_i / 2
+                new_num_messages = @messages.size
                 @messages.each_with_index do |ele, i|
-                  break if offset <= 0
-
-                  to_delete << i if ele["role"] != "system"
-                  offset -= count_tokens(ele.to_json)
+                  if ele["role"] != "system"
+                    to_delete << i
+                    new_num_messages -= 1
+                  end
+                  break if new_num_messages <= @num_retained_turns * 2 + 1
                 end
                 @messages.delete_if.with_index { |_, i| to_delete.include? i }
               end
-
             when :normal
               ############################################################
               # Normal mode recuder defined here                         #