raix 0.8.2 → 0.8.3

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
checksums.yaml CHANGED
@@ -1,7 +1,7 @@
1
1
  ---
2
2
  SHA256:
3
- metadata.gz: 04e086a8f8f010507fef64ba8f2a1fa7c4508b34d85b39d8d045088410ba041c
4
- data.tar.gz: b6ddc5948d4d71a967321cfe664a6fb2ad6f38833c7067e0915216ce7fc64646
3
+ metadata.gz: 29fc354187c6971947ca178f55eae07ec23af8f2f3435dec89e58a9231de5a94
4
+ data.tar.gz: 70c5289b69f81f741b3e41fd1bb69d081f22e78aa65de34e8cb11c6190e700c3
5
5
  SHA512:
6
- metadata.gz: 1558de827080ea2fb1c0ab0a953ae4d4cb1a9f8ad1aaae0690942f78bfde31275739857948b064721aa83b0f9b963c91c4bcb8dc5be460283e88ee2294e10e64
7
- data.tar.gz: 001c63730739473375f0bff5c7e4edb78e4247000825799cff5cd98f9ae56bf6f2a5c436f1334b03e05de3257ef081498e2c456567a70e65417c19b70ab8918b
6
+ metadata.gz: 4fbeb53566e02702163055d966e4ed14e8bc4a76a2ebb76191bcfea6175e250943c55817e1cbe4325c42a890c261365231f984bf1ce3855af6929a640457ca15
7
+ data.tar.gz: 942185162e40960170e64c5c4d93edc58ba37429efb0b19ded2f997fa60d70d2aaafad1788694d964ba5173e0ef0dfbab781b6e61c17f6e996f7dad083984197
data/CHANGELOG.md CHANGED
@@ -1,3 +1,6 @@
1
+ ## [0.8.3] - 2025-04-30
2
+ - Adds optional ActiveSupport Cache parameter to `dispatch_tool_function` for caching tool calls
3
+
1
4
  ## [0.8.2] - 2025-04-29
2
5
  - Extracts function call dispatch into a public `dispatch_tool_function` that can be overridden in subclasses
3
6
  - Uses `public_send` instead of `send` for better security and explicitness
data/Gemfile.lock CHANGED
@@ -1,7 +1,7 @@
1
1
  PATH
2
2
  remote: .
3
3
  specs:
4
- raix (0.8.2)
4
+ raix (0.8.3)
5
5
  activesupport (>= 6.0)
6
6
  faraday-retry (~> 2.0)
7
7
  open_router (~> 0.2)
data/README.md CHANGED
@@ -226,8 +226,39 @@ class CustomDispatchExample
226
226
  result
227
227
  end
228
228
  end
229
+
230
+ #### Function Call Caching
231
+
232
+ You can use ActiveSupport's Cache to cache function call results, which can be particularly useful for expensive operations or external API calls that don't need to be repeated frequently.
233
+
234
+ ```ruby
235
+ class CachedFunctionExample
236
+ include Raix::ChatCompletion
237
+ include Raix::FunctionDispatch
238
+
239
+ function :expensive_operation do |arguments|
240
+ "Result of expensive operation with #{arguments}"
241
+ end
242
+
243
+ # Override dispatch_tool_function to enable caching for all functions
244
+ def dispatch_tool_function(function_name, arguments)
245
+ # Pass the cache to the superclass implementation
246
+ super(function_name, arguments, cache: Rails.cache)
247
+ end
248
+ end
229
249
  ```
230
250
 
251
+ The caching mechanism works by:
252
+ 1. Passing the cache object through `dispatch_tool_function` to the function implementation
253
+ 2. Using the function name and arguments as cache keys
254
+ 3. Automatically fetching from cache when available or executing the function when not cached
255
+
256
+ This is particularly useful for:
257
+ - Expensive database operations
258
+ - External API calls
259
+ - Resource-intensive computations
260
+ - Functions with deterministic outputs for the same inputs
261
+
231
262
  #### Manually Stopping a Loop
232
263
 
233
264
  To loop AI components that don't interact with end users, at least one function block should invoke `stop_looping!` whenever you're ready to stop processing.
@@ -194,9 +194,10 @@ module Raix
194
194
  #
195
195
  # @param function_name [String] The name of the function to call
196
196
  # @param arguments [Hash] The arguments to pass to the function
197
+ # @param cache [ActiveSupport::Cache] Optional cache object
197
198
  # @return [Object] The result of the function call
198
- def dispatch_tool_function(function_name, arguments)
199
- public_send(function_name, arguments)
199
+ def dispatch_tool_function(function_name, arguments, cache: nil)
200
+ public_send(function_name, arguments, cache)
200
201
  end
201
202
 
202
203
  private
@@ -54,35 +54,41 @@ module Raix
54
54
  end
55
55
  end
56
56
 
57
- define_method(name) do |arguments|
57
+ define_method(name) do |arguments, cache|
58
58
  id = SecureRandom.uuid[0, 23]
59
- instance_exec(arguments, &block).tap do |content|
60
- # add in one operation to prevent race condition and potential wrong
61
- # interleaving of tool calls in multi-threaded environments
62
- transcript << [
63
- {
64
- role: "assistant",
65
- content: nil,
66
- tool_calls: [
67
- {
68
- id:,
69
- type: "function",
70
- function: {
71
- name:,
72
- arguments: arguments.to_json
73
- }
59
+
60
+ content = if cache.present?
61
+ cache.fetch([name, arguments]) do
62
+ instance_exec(arguments, &block)
63
+ end
64
+ else
65
+ instance_exec(arguments, &block)
66
+ end
67
+
68
+ # add in one operation to prevent race condition and potential wrong
69
+ # interleaving of tool calls in multi-threaded environments
70
+ transcript << [
71
+ {
72
+ role: "assistant",
73
+ content: nil,
74
+ tool_calls: [
75
+ {
76
+ id:,
77
+ type: "function",
78
+ function: {
79
+ name:,
80
+ arguments: arguments.to_json
74
81
  }
75
- ]
76
- },
77
- {
78
- role: "tool",
79
- tool_call_id: id,
80
- name:,
81
- content: content.to_s
82
- }
83
- ]
84
- # TODO: add on_error handler as optional parameter to function
85
- end
82
+ }
83
+ ]
84
+ },
85
+ {
86
+ role: "tool",
87
+ tool_call_id: id,
88
+ name:,
89
+ content: content.to_s
90
+ }
91
+ ]
86
92
 
87
93
  chat_completion(**chat_completion_args) if loop
88
94
  end
data/lib/raix/version.rb CHANGED
@@ -1,5 +1,5 @@
1
1
  # frozen_string_literal: true
2
2
 
3
3
  module Raix
4
- VERSION = "0.8.2"
4
+ VERSION = "0.8.3"
5
5
  end
metadata CHANGED
@@ -1,13 +1,13 @@
1
1
  --- !ruby/object:Gem::Specification
2
2
  name: raix
3
3
  version: !ruby/object:Gem::Version
4
- version: 0.8.2
4
+ version: 0.8.3
5
5
  platform: ruby
6
6
  authors:
7
7
  - Obie Fernandez
8
8
  bindir: exe
9
9
  cert_chain: []
10
- date: 2025-04-30 00:00:00.000000000 Z
10
+ date: 2025-05-01 00:00:00.000000000 Z
11
11
  dependencies:
12
12
  - !ruby/object:Gem::Dependency
13
13
  name: activesupport