relay.app 0.6.0 → 0.7.1

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 51b2db665dd9baa7f6003b0cdd360d07ab3e1cba08f451400d7063f4bce234d5
-  data.tar.gz: e058de42d7416b06df5e35c605c734d8b7af9f93d7fda9015b81f576cca7d286
+  metadata.gz: 5496c45e309886d6da018a08c25a794226fa02f3f88133d338d9503e5b7f756a
+  data.tar.gz: ba68687dbe30954d16000ba1b9d0e3dd361b01c174c65fbc99eecc2dbbf4988a
 SHA512:
-  metadata.gz: 2efe61c19fb25fcbe28dfc94ad68bcae7fe6927950edf0ab617fe473166590491d465913d185ffa94f35d6e4458b2ed0534afddb71a160faba72445bcb36b674
-  data.tar.gz: 1185e1e81c2c8180ee17165579400a688fc146af4e40f2cb9d03ed2e149274ff2bbfd7fdd7125c638c995beab6e955b2c06ac63995bfb01d9d093d4bb9158e9d
+  metadata.gz: eba7c940580c7524494409c9e6ee4c21b82bfe835f8877fe1d7b5a2a928f537e90f1cb3d155333d345b153aa027e798c4e5803b9dd0970fb296eb2701463e9f2
+  data.tar.gz: 67b645677cdf7ef749cd03b8515ded7a26bcd47fbffdd447d3d912f685c16419750c06ade9608317bc4f527234fe068ce8e21913c868f99cb8fff496d562751e

data/CHANGELOG.md

@@ -2,6 +2,10 @@
 
 ## Unreleased
 
+## v0.6.0
+
+Changes since v0.5.0.
+
 ### Change
 
 * **Move the default Relay home to `~/.config/relay`** <br>

data/README.md

@@ -1,66 +1,64 @@
 ## About
 
-Relay is a self-hostable LLM environment with support for OpenAI, DeepSeek,
-Anthropic, xAI and zAI out of the box. It is incredibly simple to setup
-and get started. The application is distributed as a RubyGem. It has a minimal
-set of dependencies - built on Roda, Sequel, Falcon, [llm.rb](https://github.com/llmrb/llm.rb),
+Relay is a self-hostable, hackable LLM web environment that can be extended
+with your own tools and skills that live in your `${HOME}` directory.
+It is for programmers, AI engineers, hackers, and anyone who wants
+their own AI environment with the option to extend it with code.
+
+
+## Setup
+
+It is simple to setup and get started. The application is
+distributed as a RubyGem. It has a minimal set of dependencies -
+built on Roda, Sequel, Falcon, [llm.rb](https://github.com/llmrb/llm.rb),
 HTMX and web sockets.
 
-There is support for connecting to MCP servers too - both HTTP and stdio. You can
-add your own tools to `~/.config/relay/tools` which is a neat way to extend the
-environment with your own functionality. The database uses SQLite3 to keep things
-simple - the goal is to have something you can setup in under two minutes.
+![demo](./demo.gif)
 
-## Getting started
+## Appearance
 
-#### Install
+#### Sign-in
 
-Install the gem:
+![Relay screenshot](./relay3.png)
 
-```sh
-gem install relay.app
-```
+#### Chat
 
-Go through interactive setup, start the server, and visit
-http://localhost:9292.
+![Relay screenshot](./relay1.png)
 
-```sh
-relay setup
-relay start
-```
+#### MCP
 
-## Features
+![Relay screenshot](./relay2.png)
 
-* Install and setup in 2 minutes
-* Localize your chats and mcp settings to your user account
-* Connect to multiple providers (OpenAI, xAI, Anthropic, Google, DeepSeek, zAI)
-* Connect to MCP servers
-* Cancel in-flight requests and tool execution cleanly
-* Run tools concurrently
-* Make it yours: extend and customize with your own tools and system prompt
-* Lightweight architecture
 
-## Sounds cool, how does it look?
+## Getting started
 
-**Sign-in**
+#### Install
 
-![Relay screenshot](./relay3.png)
+Install the gem
 
-**Chat**
+```sh
+gem install relay.app
+```
 
-![Relay screenshot](./relay1.png)
+#### Configure
 
-**MCP**
+Interactive setup
 
-![Relay screenshot](./relay2.png)
+```sh
+relay setup
+```
 
-## How easy is it to setup?
+#### Serve
 
-Very easy.
+Start the server, and visit http://localhost:9292
 
-![demo](./demo.gif)
+```sh
+relay start
+```
 
-## How do I add my own tool?
+## Tools
+
+#### How do I add my own tool?
 
 Before running `relay start` you should add `~/.config/relay/tools/<yourtool>.rb`.
 The tool will be automatically made available to the LLM. This is how a tool
@@ -82,18 +80,18 @@ class Shell < LLM::Tool
 end
 ```
 
-## Wait, what is a tool?
+#### Wait, what is a tool?
 
 A tool contains a name, a description, and optional parameters. It is attached
 to a method, and that method that can be called. The model or LLM decides when
-and how to call a tool. A tool can do anything you can imagine, and it can extend
-the abilities of the LLM. Suddenly a LLM can search the web, run code, and anything
-you can think of. They're a powerful way to extend the capabilities of an LLM.
+and how to call a tool. A tool can extend the abilities of the LLM with
+your own code that could can search the web, read documentation, etc.
 
 An MCP server can also expose pre-packaged tools, and those can be especially
-powerful for talking to GitHub or your own Forgejo instance.
+useful for talking to GitHub, your own Forgejo instance or any other
+kind of MCP server. 
 
-## What are the default tools?
+#### What are the default tools?
 
 The `relay-knowledge` tool returns documentation for both Relay
 and [llm.rb](https://github.com/llmrb/llm.rb) - ask about either
@@ -106,14 +104,15 @@ can be played inline in the chat, and you can also add your own
 songs or remove existing ones through the same tools. The only
 requirement is that it is a YouTube URL.
 
-## What provider is the best value?
+## Costs
+
+#### What provider is the best value?
 
-DeepSeek. I highly recommend it. The context window is 1M. I have been using it
-all the time - especially for Relay development, and despite my heavy usage, it
-cost only 80 cents overall. It's almost free. I used it **a lot**. I'd estimate
-that a 1M context window costs 14 cents or so.
+DeepSeek. <br>
+Hard to beat it on price. <br>
+Recent models have a context window of 1M.
 
-## What about Ollama and friends?
+#### What about self-hosting with Ollama ?
 
 [llm.rb](https://github.com/llmrb/llm.rb#readme) provides support ollama, llama.cpp,
 and any OpenAI-compatible endpoint. But Relay does not surface it as a feature. I haven't

data/app/models/model_record.rb

@@ -21,7 +21,6 @@ module Relay::Models
     # @return [void]
     def self.refresh_all
       Relay.providers.each do |_, provider|
-        provider = provider.call
         refresh(provider)
       rescue LLM::Error
         next

data/app/routes/websocket/connection.rb

@@ -73,14 +73,14 @@ class Relay::Routes::Websocket
       file = attachment_from_payload(payload) || attachment.consume
       prompt = build_prompt(ctx, payload["message"], file)
       return if prompt.empty?
-      vars[:messages].concat [{role: :user, content: prompt}, {role: :assistant, content: +""}]
-      write(conn, fragment(:status, status_bar(status: "Thinking...", ctx:)))
-      write(conn, fragment(:remove_empty_state)) if vars[:messages].length == 2
-      write(conn, fragment(:append_message, message: vars[:messages][-2]))
-      write(conn, fragment(:append_message, message: vars[:messages][-1]))
-      write(conn, fragment(:input))
       yield_tools(ctx) do |tools|
         params[:tools] = tools
+        vars[:messages].concat [{role: :user, content: prompt}, {role: :assistant, content: +""}]
+        write(conn, fragment(:status, status_bar(status: "Thinking...", ctx:)))
+        write(conn, fragment(:remove_empty_state)) if vars[:messages].length == 2
+        write(conn, fragment(:append_message, message: vars[:messages][-2]))
+        write(conn, fragment(:append_message, message: vars[:messages][-1]))
+        write(conn, fragment(:input))
         wait_with_heartbeat(conn, proc { talk(ctx, prompt, params) })
         resolve_functions(ctx, conn, params)
       end
@@ -121,11 +121,11 @@ class Relay::Routes::Websocket
     #  The WebSocket connection object
     # @return [void]
     def resolve_functions(ctx, conn, params)
-      return if ctx.functions.empty?
-      returns = wait_with_heartbeat(conn, ctx.wait(:task))
-      wait_with_heartbeat(conn, proc { ctx.talk(returns, params) })
-      if ctx.functions.any?
-        resolve_functions(ctx, conn, params)
+      while ctx.functions?
+        returns = wait_with_heartbeat(conn, proc { ctx.wait(:task) })
+        break if returns.empty?
+        write(conn, fragment(:status, status_bar(status: tool_status(ctx.functions), ctx:))) if ctx.functions?
+        wait_with_heartbeat(conn, proc { ctx.talk(returns, params) })
       end
     end
 

data/app/tools/relay_knowledge.rb

@@ -10,24 +10,26 @@ module Relay::Tools
     include Relay::Tool
 
     name "relay-knowledge"
-    description "Returns Relay or llm.rb documentation so answers can cite project details"
-    param :topic, Enum["relay", "llm.rb"], "The knowledge topic", required: true
+    description "Returns Relay, llm.rb or mruby-llm documentation"
+    parameter :topic, Enum["relay", "llm.rb", "mruby-llm"], "The knowledge topic"
+    required %i[topic]
 
     ##
     # Provides the Relay documentation
     # @return [Hash]
     def call(topic:)
       case topic
-      when "relay" then {directions:, documentation: relay_documentation}
-      when "llm.rb" then {directions:, documentation: llmrb_documentation}
+      when "relay" then {directions:, documentation: fetch(relay_resources)}
+      when "llm.rb" then {directions:, documentation: fetch(llmrb_resources)}
+      when "mruby-llm" then {directions:, documentation: fetch(mruby_llm_resources)}
       else {error: "unknown topic: #{topic}"}
       end
     end
 
     private
 
-    def relay_documentation
-      relay_resources.each_with_object({}) do |(key, url), h|
+    def fetch(resources)
+      resources.each_with_object({}) do |(key, url), h|
         res = Net::HTTP.get_response URI.parse(url)
         h[key] = res.body
       end
@@ -37,13 +39,6 @@ module Relay::Tools
       {"readme" => "https://raw.githubusercontent.com/llmrb/relay/refs/heads/main/README.md"}
     end
 
-    def llmrb_documentation
-      llmrb_resources.each_with_object({}) do |(key, url), h|
-        res = Net::HTTP.get_response URI.parse(url)
-        h[key] = res.body
-      end
-    end
-
     def llmrb_resources
       {
         "readme"   => "https://raw.githubusercontent.com/llmrb/llm.rb/refs/heads/main/README.md",
@@ -52,6 +47,12 @@ module Relay::Tools
       }
     end
 
+    def mruby_llm_resources
+      {
+        "readme" => "https://raw.githubusercontent.com/llmrb/mruby-llm/refs/heads/main/README.md"
+      }
+    end
+
     def directions
       "Reference links from the associated document in your response"
     end

data/lib/relay/jukebox.rb

@@ -63,7 +63,8 @@ module Relay
     def extract_youtube_id(uri)
       path = uri.path.to_s
       return path.split("/").reject(&:empty?).last if path.start_with?("/embed/", "/shorts/")
-      CGI.parse(uri.query.to_s).fetch("v", []).first
+      form = URI.decode_www_form(uri.query.to_s)
+      (form.to_h["v"] || []).first
     end
 
     def songs

data/lib/relay/version.rb

@@ -1,5 +1,5 @@
 # frozen_string_literal: true
 
 module Relay
-  VERSION = "0.6.0"
+  VERSION = "0.7.1"
 end

data/lib/relay.rb

@@ -2,7 +2,7 @@
 
 module Relay
   require "fileutils"
-  gem "llm.rb", "= 8.1.0"
+  gem "llm.rb", "= 11.0.0"
 
   require_relative "relay/version"
   require_relative "relay/cache"
@@ -17,12 +17,16 @@ module Relay
   require_relative "relay/reloader"
 
   PROVIDERS = {
-    "anthropic" => -> { LLM.anthropic(key: ENV["ANTHROPIC_SECRET"]) },
-    "deepseek" => -> { LLM.deepseek(key: ENV["DEEPSEEK_SECRET"]) },
-    "google" => -> { LLM.google(key: ENV["GOOGLE_SECRET"]) },
-    "openai" => -> { LLM.openai(key: ENV["OPENAI_SECRET"]) },
-    "xai" => -> { LLM.xai(key: ENV["XAI_SECRET"]) },
-    "bedrock" => -> { LLM.bedrock(access_key_id: ENV["AWS_ACCESS_KEY_ID"], secret_access_key: ENV["AWS_SECRET_ACCESS_KEY"]) }
+    "anthropic" => -> { ENV["ANTHROPIC_SECRET"].nil? ? nil : LLM.anthropic(key: ENV["ANTHROPIC_SECRET"]) },
+    "deepseek" => -> { ENV["DEEPSEEK_SECRET"].nil? ? nil : LLM.deepseek(key: ENV["DEEPSEEK_SECRET"]) },
+    "google" => -> { ENV["GOOGLE_SECRET"].nil? ? nil : LLM.google(key: ENV["GOOGLE_SECRET"]) },
+    "openai" => -> { ENV["OPENAI_SECRET"].nil? ? nil : LLM.openai(key: ENV["OPENAI_SECRET"]) },
+    "xai" => -> { ENV["XAI_SECRET"].nil? ? nul : LLM.xai(key: ENV["XAI_SECRET"]) },
+    "bedrock" => -> do
+      (ENV["AWS_ACCESS_KEY_ID"].nil? || ENV["AWS_SECRET_ACCESS_KEY"].nil?) ?
+        nil :
+        LLM.bedrock(access_key_id: ENV["AWS_ACCESS_KEY_ID"], secret_access_key: ENV["AWS_SECRET_ACCESS_KEY"])
+    end
   }.freeze
   private_constant :PROVIDERS
 
@@ -41,7 +45,10 @@ module Relay
   # Returns all known providers
   # @return [LLM::Object]
   def self.providers
-    @providers ||= LLM::Object.from(PROVIDERS).transform_values!(&:call)
+    @providers ||= LLM::Object
+      .from(PROVIDERS)
+      .transform_values!(&:call)
+      .compact
   end
 
   ##

data/libexec/relay/configure

@@ -34,8 +34,8 @@ PROVIDERS = [
   ),
   LLM::Object.from(
     fields: [
-      LLM::Object.from(label: "AWS access key ID", key: "AWS_ACCESS_KEY_ID", aliases: [], secret: false),
-      LLM::Object.from(label: "AWS secret access key", key: "AWS_SECRET_ACCESS_KEY", aliases: [], secret: true)
+      LLM::Object.from(label: "[Bedrock] AWS access key ID", key: "AWS_ACCESS_KEY_ID", aliases: [], secret: false),
+      LLM::Object.from(label: "[Bedrock] AWS secret access key", key: "AWS_SECRET_ACCESS_KEY", aliases: [], secret: true)
     ]
   )
 ].freeze

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: relay.app
 version: !ruby/object:Gem::Version
-  version: 0.6.0
+  version: 0.7.1
 platform: ruby
 authors:
 - Antar Azri
@@ -86,14 +86,14 @@ dependencies:
     requirements:
     - - '='
       - !ruby/object:Gem::Version
-        version: 8.1.0
+        version: 11.0.0
   type: :runtime
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
     - - '='
       - !ruby/object:Gem::Version
-        version: 8.1.0
+        version: 11.0.0
 - !ruby/object:Gem::Dependency
   name: net-http-persistent
   requirement: !ruby/object:Gem::Requirement
@@ -318,9 +318,7 @@ dependencies:
     - - ">="
       - !ruby/object:Gem::Version
         version: '0'
-description: Relay is a self-hostable LLM environment built on llm.rb that you can
-  set up and get running in under 2 minutes. Extend it with your own tools, connect
-  MCP servers, and run an AI workspace on your own infrastructure.
+description: Ruby's hackable AI web environment
 email:
 - azantar@proton.me
 - 0x1eef@hardenedbsd.org
@@ -461,7 +459,7 @@ files:
 - public/js/relay.js.map
 - public/stylesheets/application.css
 - public/stylesheets/application.css.map
-homepage: https://github.com/llmrb/relay
+homepage: https://github.com/llmrb/relay.app
 licenses:
 - 0BSD
 metadata: {}
@@ -481,5 +479,5 @@ required_rubygems_version: !ruby/object:Gem::Requirement
 requirements: []
 rubygems_version: 4.0.6
 specification_version: 4
-summary: Self-hostable LLM environment you can run in under 2 minutes
+summary: Ruby's hackable AI web environment
 test_files: []