tokenizers 0.5.0-aarch64-linux → 0.5.1-aarch64-linux

Sign up to get free protection for your applications and to get access to all the features.
Files changed (10) hide show
  1. checksums.yaml +4 -4
  2. data/CHANGELOG.md +5 -0
  3. data/Cargo.lock +162 -175
  4. data/LICENSE-THIRD-PARTY.txt +1677 -1607
  5. data/lib/tokenizers/3.1/tokenizers.so +0 -0
  6. data/lib/tokenizers/3.2/tokenizers.so +0 -0
  7. data/lib/tokenizers/3.3/tokenizers.so +0 -0
  8. data/lib/tokenizers/from_pretrained.rb +2 -2
  9. data/lib/tokenizers/version.rb +1 -1
  10. metadata +2 -2
checksums.yaml CHANGED
@@ -1,7 +1,7 @@
1
1
  ---
2
2
  SHA256:
3
- metadata.gz: f343c83ef64270252147522a393d94daa17c439559db685e2184c1beb03c4673
4
- data.tar.gz: 1ab6bd346e2d3143c5390dc774cd956b7d647998bf38ce080f0ee14d970b8020
3
+ metadata.gz: c1dd5881d17992979c172a0b3b06d819d4d7b37f44143bf3e35c0d9e6098de56
4
+ data.tar.gz: e031c6b86c37c315ac94f645e73f5aef28ef1a20d649dd443cc63ebde00ac69a
5
5
  SHA512:
6
- metadata.gz: e7667f0bb17a9518ae3f1b9b5ad309cc56ce7269983bb77bf117d07b8b13704092ee650c05eed3babab66b2a5b2f5fb6af0c553e785633faa2b7dab1b433b07b
7
- data.tar.gz: 4a90b06d10b365a24bc9c85f2a83b93f862c5675c8470785cb768cfe0b572950bcab920afaa24326e1f45dbe194de3f406a9765449f7b55c5ea0373d897954be
6
+ metadata.gz: d96f470e7c925bfd568db5d4ee094c9ed7ffd93d004a3f588d2596d1924deb8f38cc787459ba948909060a0395f40d93474c544920be0c974f9f4ead2d46ca0f
7
+ data.tar.gz: 30606972b0c329a0534304451b11a89e9f9fec4a35fb67700378aaec86186e0093c1d1b2fc3cb514eec30b3ca335442ff9c922ffe724390b335af6e24dd5901a
data/CHANGELOG.md CHANGED
@@ -1,3 +1,8 @@
1
+ ## 0.5.1 (2024-08-13)
2
+
3
+ - Updated Tokenizers to 0.20.0
4
+ - Added precompiled gem for Linux ARM MUSL
5
+
1
6
  ## 0.5.0 (2024-05-21)
2
7
 
3
8
  - Updated Tokenizers to 0.19.1