tokenizers 0.5.0-arm64-darwin → 0.5.1-arm64-darwin

Sign up to get free protection for your applications and to get access to all the features.
Files changed (10) hide show
  1. checksums.yaml +4 -4
  2. data/CHANGELOG.md +5 -0
  3. data/Cargo.lock +162 -175
  4. data/LICENSE-THIRD-PARTY.txt +1677 -1607
  5. data/lib/tokenizers/3.1/tokenizers.bundle +0 -0
  6. data/lib/tokenizers/3.2/tokenizers.bundle +0 -0
  7. data/lib/tokenizers/3.3/tokenizers.bundle +0 -0
  8. data/lib/tokenizers/from_pretrained.rb +2 -2
  9. data/lib/tokenizers/version.rb +1 -1
  10. metadata +2 -2
checksums.yaml CHANGED
@@ -1,7 +1,7 @@
1
1
  ---
2
2
  SHA256:
3
- metadata.gz: 55411471aeb09dbf1b750230debf729e6a4c4c10bc7f0a4a9c3c928485521b5c
4
- data.tar.gz: b2a217139911aa0a2521b7713f41db74797daa550b1bed11c0a31941114f34eb
3
+ metadata.gz: '093efbc1e0f3a2595cd61ac799b3f8f781f85327bbc1b62324b5596fd6fb6ddb'
4
+ data.tar.gz: d5fc97c2986f31c9ef7ea365e485ec772a39999373bb1de245b7f8e8ac012efb
5
5
  SHA512:
6
- metadata.gz: c4874409d41935efe0df377c809879299bc38eecbf2fc15bf699108cead7eb48411cc9500ec40fc5cc0e59b3b4754cf27fdd4b4143b22f71f7a10621427a5bfb
7
- data.tar.gz: 14d308316afb82ad511f36b8d8c1b60e0043d7406fc0c1c31999119c2f67d86575bf11964a8bc4a6d4bf23899fe4101cb75a726dfa4aa64f33ec8f0247d44dc9
6
+ metadata.gz: 8e952a1e47759dd48802ae1c51ae74e912644031191e1d68495eb9da210824321287ae2cf9f100b9a916b9aff40397836c7faa1b9094752f9848b90f40ed5533
7
+ data.tar.gz: 04e5fa1df557ededeb44315239e1d4af8e31363e9971f3272b621801c389a502ff6fba1d0f1c904926cb987d79ef9a0d19c192896d25ad33fa7de4b51e179d61
data/CHANGELOG.md CHANGED
@@ -1,3 +1,8 @@
1
+ ## 0.5.1 (2024-08-13)
2
+
3
+ - Updated Tokenizers to 0.20.0
4
+ - Added precompiled gem for Linux ARM MUSL
5
+
1
6
  ## 0.5.0 (2024-05-21)
2
7
 
3
8
  - Updated Tokenizers to 0.19.1