ru_token 0.1.16-arm64-darwin → 0.1.20-arm64-darwin

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 21f9cae9913e9effad93ad585963d8b5b73895f23c5d5f7a49408ddab71461c2
-  data.tar.gz: b5137ac42443f351abed701bae90dd2803d18b50c4e777e7bf64627cb9f413c9
+  metadata.gz: c15c74cf960c16470ab8ad3e3bddff35ea79ba13a16062d73c9b02b4689ce112
+  data.tar.gz: bdad83f84b44aed0fea8486e988a64e3615c97e423c454e5fbea944094a7f633
 SHA512:
-  metadata.gz: a3a0908f8fc45131cb564382c00009cbb98aeccee207240bd7ad24095e7f0feeb214850d398696062ca0b46a0c8bac3ee932ae17c72d48f72c8b091da8ee4bd8
-  data.tar.gz: 2aef6769909012ec6ae401d53a727a47bb33f52669e7626e3a951c7860a099ad927a23263ce73d5fa28235f8db66dfbe0123749befacf41d17a32696dd9beff5
+  metadata.gz: 56c311323ff1318d901dea18bad1f6dce245574a59c6484ccec68fb9a10c339f9277e9936b1086ba857050b6b816e875311602895259d128633371f0f2df32f5
+  data.tar.gz: 0d721cafeef3b7c0aa77bb7c9cd02b59b8bfd7405b7de1424465eaafedb2186b43cf7b2dd93e835e501dae4bcdae05a3ca802ae898f672dec126002611d72052

data/CHANGELOG.md

@@ -7,6 +7,28 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ## [Unreleased]
 
+---
+## [0.1.20] - 2025-07-31
+### Change
+- Remove x64-mingw32 from Gemfile.lock
+- Update README
+
+---
+## [0.1.19] - 2025-07-31
+### No Change
+- Bumping to retry RubyGems deploy
+
+---
+## [0.1.18] - 2025-07-31
+### Change
+- Update README
+
+---
+## [0.1.17] - 2025-07-31
+### Change
+- Update gemspec license entry
+- Remove platform x64-mingw-ucrt from Gemfile.lock
+
 ---
 ## [0.1.16] - 2025-07-31
 ### Change

data/README.md

@@ -1,16 +1,24 @@
-# RuToken 🦕
+# RuToken [🦕](https://youtu.be/0MX31NTNrho?si=NgLE4-UL3zgiUVd7)
+
 RuToken provides a high-performance, native Ruby interface for counting tokens using the powerful [tiktoken-rs](https://github.com/zurawiki/tiktoken-rs) library. It leverages the speed of Rust to offer a fast and efficient way to calculate token counts for various OpenAI models.
 
 The gem ships with pre-compiled native extensions for Linux and macOS, so your end-users don't need a Rust toolchain installed.
 
 Supports Ruby >= 2.7.0
 
-Features
-High Performance ⚡️: Uses a native Rust implementation for blazing-fast tokenization.
+Extensive Model Support: Includes tokenizers for all modern and legacy OpenAI models, recognizing dozens of model aliases automatically.
 
-Simple API: A clean and straightforward interface for counting tokens.
+[https://rubygems.org/gems/ru_token](https://rubygems.org/gems/ru_token)
 
-Extensive Model Support: Includes tokenizers for all modern and legacy OpenAI models, recognizing dozens of model aliases automatically.
+## Install
+
+#### Gemfile
+`gem 'ru_token', '~> 0.1.20'`
+
+#### Command Line
+`gem install ru_token -v '~> 0.1.20'`
+
+## Use
 
 ### Count tokens for a specific model (the model keyword is required)
 ```Ruby
@@ -19,7 +27,7 @@ count = RuToken::Tokenizer.count("hello world!", model: "gpt-4.1")
 
 ### The gem recognizes many aliases, including older models
 ```Ruby
-count = RuToken::Tokenizer.count(1234, model: "text-davinci-003")
+count = RuToken::Tokenizer.count("hello world!", model: "text-davinci-003")
 ```
 
 ### The count method calls .to_s on the argument if it is not a string
@@ -41,7 +49,9 @@ The gem automatically maps dozens of model names and prefixes to the correct und
 ## Developing RuToken Locally
 
 ### Install Ruby and Rust dependencies
-Ruby >= 2.7 required
+Ruby >= 2.7.0
+
+RubyGems >= 3.0.0
 
 Rust edtion 2021
 
@@ -55,10 +65,12 @@ Specs:
 Both:
 `bundle exec rake`
 
-You can open an interactive console for experimentation with bin/console.
+Interactive console for experimentation: `bin/console`
+
+## Contributing
 
-Contributing
 Bug reports and pull requests are welcome on GitHub at https://github.com/LoganBresnahan/ru_token.
 
-License
+## License
+
 The gem is available as open source under the terms of the MIT License.

data/lib/ru_token/version.rb

@@ -1,5 +1,5 @@
 # frozen_string_literal: true
 
 module RuToken
-  VERSION = "0.1.16"
+  VERSION = "0.1.20"
 end

data/ru_token.gemspec

@@ -11,7 +11,7 @@ Gem::Specification.new do |spec|
   spec.summary = "Ruby wrapper for the tiktoken Rust library, providing fast tokenization for OpenAI models."
   spec.description = "RuToken is a Ruby gem that wraps the tiktoken Rust library, enabling fast and efficient tokenization for OpenAI models. It supports multiple models including o200k_base, cl100k_base, p50k_base, and r50k_base."
   spec.homepage = "https://github.com/LoganBresnahan/ru_token"
-  spec.license = "GPL-3.0-or-later"
+  spec.license = "MIT"
   spec.required_ruby_version = ">= 2.7.0"
   spec.required_rubygems_version = ">= 3.0.0"
 

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: ru_token
 version: !ruby/object:Gem::Version
-  version: 0.1.16
+  version: 0.1.20
 platform: arm64-darwin
 authors:
 - Logan Bresnahan
 autorequire: 
 bindir: exe
 cert_chain: []
-date: 2025-07-31 00:00:00.000000000 Z
+date: 2025-08-01 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: bundler
@@ -78,7 +78,7 @@ files:
 - sig/ru_token.rbs
 homepage: https://github.com/LoganBresnahan/ru_token
 licenses:
-- GPL-3.0-or-later
+- MIT
 metadata:
   allowed_push_host: https://rubygems.org
   homepage_uri: https://github.com/LoganBresnahan/ru_token