ollama-ruby 0.0.1 → 0.1.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 327051092cef37a7fd95d6a5c3a5a13aa6e52df2314da5f4cfd28f2890ffa820
-  data.tar.gz: 86da0d23497f9717239abaa1830ac687562c8e9827a097781f0404e6b65e1e35
+  metadata.gz: 9f88e75feb900230387f4b960f5762daa8622af0f9562c0145d6b22c4a01fb3d
+  data.tar.gz: 4c6fea6ddc54c83ac6d003d4e5f3ccb6b90195b79a97aea6d98a95e32db36f99
 SHA512:
-  metadata.gz: f3a9324f11877b0772d1f4bcb1902ea905e7132d94d73fe8b6b7e11a567c2aea04431838fa2b534557e4e1e76ae1ee47b13832aebb71e144ac329b13d15ea111
-  data.tar.gz: d40adf27de7e7700158027f1c6bfec7e97189b4a6081a7da36758edc31b5229b6efef62ee5a192af19afa5b633224cf8e80666d38154a9d3c1cae974a98f2de5
+  metadata.gz: 9002b36cd15680f89c50d6f3ee34b3a4e5d77362cd4982d4ca41fc9abbd0bcd1d44483579686f3bf9f20f9e10b1309c28ae8da789ba8ada66c7b5f6384643f87
+  data.tar.gz: e2566f950aea15cf47d60381340db2b0e7a8e3a2fd79aaa8ee421f6cbd367baeae0f64b24e5d9baa801bd715695edf80c5a88d0ba41867c9358bc3076d1ed112

data/.envrc

@@ -0,0 +1 @@
+export REDIS_URL=redis://localhost:9736

data/README.md

@@ -28,7 +28,7 @@ to your Gemfile and run `bundle install` in your terminal.
 
 ## Executables
 
-### ollama_chat
+### ollama\_chat
 
 This a chat client, that can be used to connect to an ollama server and enter a
 chat converstation with a LLM. It can be called with the following arguments:
@@ -36,20 +36,59 @@ chat converstation with a LLM. It can be called with the following arguments:
 ```
 ollama_chat [OPTIONS]
 
-  -u URL     the ollama base url, OLLAMA_URL
-  -m MODEL   the ollama model to chat with, OLLAMA_MODEL
-  -M OPTIONS the model options as JSON file, see Ollama::Options
-  -s SYSTEM  the system prompt to use as a file
-  -c CHAT    a saved chat conversation to load
-  -v VOICE   use VOICE (e. g. Samantha) to speak with say command
-  -d         use markdown to display the chat messages
-  -h         this help
+  -f CONFIG      config file to read
+  -u URL         the ollama base url, OLLAMA_URL
+  -m MODEL       the ollama model to chat with, OLLAMA_CHAT_MODEL
+  -s SYSTEM      the system prompt to use as a file, OLLAMA_CHAT_SYSTEM
+  -c CHAT        a saved chat conversation to load
+  -C COLLECTION  name of the collection used in this conversation
+  -D DOCUMENT    load document and add to collection (multiple)
+  -d             use markdown to display the chat messages
+  -v             use voice output
+  -h             this help
 ```
 
 The base URL can be either set by the environment variable `OLLAMA_URL` or it
 is derived from the environment variable `OLLAMA_HOST`. The default model to
 connect can be configured in the environment variable `OLLAMA_MODEL`.
 
+The YAML config file in `$XDG_CONFIG_HOME/ollama_chat/config.yml`, that you can
+use for more complex settings, it looks like this:
+
+```
+---
+url: <%= ENV['OLLAMA_URL'] || 'http://%s' % ENV.fetch('OLLAMA_HOST') %>
+model:
+  name: <%= ENV.fetch('OLLAMA_CHAT_MODEL', 'llama3.1') %>
+  options:
+    num_ctx: 8192
+system: <%= ENV.fetch('OLLAMA_CHAT_SYSTEM', 'null') %>
+voice: Samantha
+markdown: true
+embedding:
+  enabled: true
+  model:
+    name: mxbai-embed-large
+    options: {}
+  collection: <%= ENV.fetch('OLLAMA_CHAT_COLLECTION', 'ollama_chat') %>
+  found_texts_size: 4096
+  splitter:
+    name: RecursiveCharacter
+    chunk_size: 1024
+cache: Ollama::Documents::RedisCache
+redis:
+  url: <%= ENV.fetch('REDIS_URL', 'null') %>
+debug: <%= ENV['OLLAMA_CHAT_DEBUG'].to_i == 1 ? true : false %>
+```
+
+If you want to store embeddings persistently, set an environment variable
+`REDIS_URL` or update the `redis.url` setting in your `config.yml` file to
+connect to a Redis server. Without this setup, embeddings will only be stored
+in process memory, which is less durable.
+
+Some settings can be passed as arguments as well, e. g. if you want to choose a
+specific system prompt:
+
 ```
 $ ollama_chat -s sherlock.txt
 Model with architecture llama found.
@@ -86,9 +125,7 @@ $ ollama_chat -m llava-llama3
 Model with architecture llama found.
 Connecting to llava-llama3@http://localhost:11434 now…
 Type /help to display the chat help.
-📨 user> /image spec/assets/kitten.jpg
-Attached image spec/assets/kitten.jpg to the next message.
-📸 user> What's on this image?
+📸 user> What's on this image? ./spec/assets/kitten.jpg
 📨 assistant:
 The image captures a moment of tranquility featuring a young cat. The cat,
 adorned with gray and white fur marked by black stripes on its face and legs,
@@ -116,19 +153,22 @@ subject - the young, blue-eyed cat.
 The following commands can be given inside the chat, if prefixed by a `/`:
 
 ```
-/paste          to paste content
-/list           list the messages of the conversation
-/clear          clear the conversation messages
-/pop n          pop the last n message, defaults to 1
-/regenerate     the last answer message
-/save filename  store conversation messages
-/load filename  load conversation messages
-/image filename attach image to the next message
-/quit           to quit.
-/help           to view this help.
+/paste                             to paste content
+/markdown                          toggle markdown output
+/list                              list the messages of the conversation
+/clear                             clear the conversation messages
+/pop [n]                           pop the last n exchanges, defaults to 1
+/model                             change the model
+/regenerate                        the last answer message
+/collection clear|stats|change|new clear or show stats of current collection
+/summarize source                  summarize the URL/file source's content
+/save filename                     store conversation messages
+/load filename                     load conversation messages
+/quit                              to quit
+/help                              to view this help
 ```
 
-### ollama_console
+### ollama\_console
 
 This is an interactive console, that can be used to try the different commands
 provided by an `Ollama::Client` instance. For example this command generate a

data/Rakefile

@@ -13,12 +13,12 @@ GemHadar do
   description 'Library that allows interacting with the Ollama API'
   test_dir    'spec'
   ignore      '.*.sw[pon]', 'pkg', 'Gemfile.lock', '.AppleDouble', '.bundle',
-    '.yardoc', 'tags', 'errors.lst', 'cscope.out', 'coverage', 'tmp'
+    '.yardoc', 'tags', 'errors.lst', 'cscope.out', 'coverage', 'tmp', 'corpus'
   package_ignore '.all_images.yml', '.tool-versions', '.gitignore', 'VERSION',
      '.utilsrc', '.rspec', *Dir.glob('.github/**/*', File::FNM_DOTMATCH)
   readme      'README.md'
 
-  executables << 'ollama_console' << 'ollama_chat'
+  executables << 'ollama_console' << 'ollama_chat' << 'ollama_update'
 
   required_ruby_version  '~> 3.1'
 
@@ -27,9 +27,21 @@ GemHadar do
   dependency             'term-ansicolor',        '~> 1.11'
   dependency             'kramdown-parser-gfm',   '~> 1.1'
   dependency             'terminal-table',        '~> 3.0'
-  development_dependency 'all_images',            '~>0.4'
-  development_dependency 'rspec',                 '~>3.2'
+  dependency             'redis',                 '~> 5.0'
+  dependency             'numo-narray',           '~> 0.9'
+  dependency             'more_math',             '~> 1.1'
+  dependency             'sorted_set',            '~> 1.0'
+  dependency             'mime-types',            '~> 3.0'
+  dependency             'reverse_markdown',      '~> 2.0'
+  dependency             'complex_config',        '~> 0.20'
+  dependency             'search_ui',             '~> 0.0'
+  dependency             'amatch',                '~> 0.4.1'
+  development_dependency 'all_images',            '~> 0.4'
+  development_dependency 'rspec',                 '~> 3.2'
   development_dependency 'utils'
+  development_dependency 'webmock'
 
   licenses << 'MIT'
+
+  clobber 'coverage'
 end