baran 0.1.0 → 0.1.2
Sign up to get free protection for your applications and to get access to all the features.
- checksums.yaml +4 -4
- data/CHANGELOG.md +9 -0
- data/Gemfile.lock +1 -1
- data/README.md +3 -3
- data/lib/baran/version.rb +1 -1
- metadata +1 -1
checksums.yaml
CHANGED
@@ -1,7 +1,7 @@
|
|
1
1
|
---
|
2
2
|
SHA256:
|
3
|
-
metadata.gz:
|
4
|
-
data.tar.gz:
|
3
|
+
metadata.gz: 1ba68ca754f6d94e7d9fa28970f025ecfb24f884bcfa80016949fb642b8eec2d
|
4
|
+
data.tar.gz: 63a03a1f15ae69be0c056677357c954980abdfb888b63bb19e0c581cff65b4a9
|
5
5
|
SHA512:
|
6
|
-
metadata.gz:
|
7
|
-
data.tar.gz:
|
6
|
+
metadata.gz: 7909200392f0b439666a0758875147f3fd4f5da55958e42a9db822ca9ef9b518d83d22d47d03609be68972a7e5bfbeaf500a845ac1ca4567513b1a11189bc8b4
|
7
|
+
data.tar.gz: e2371e892418e0eddcf09bc4a06b68299c207869ed1313a1150dc4e4341d9bb2feb80ef1a9c0831126a2f59b84b4dcd3c1fdf1df16d500efd485e52c7d5eebf9
|
data/CHANGELOG.md
CHANGED
data/Gemfile.lock
CHANGED
data/README.md
CHANGED
@@ -2,6 +2,8 @@
|
|
2
2
|
|
3
3
|
Text Splitter for Large Language Model datasets.
|
4
4
|
|
5
|
+
To avoid token constraints and improve the accuracy of vector search in the Large Language Model, it is necessary to divide the document. This gem supports splitting the text in the specified manner.
|
6
|
+
|
5
7
|
## Installation
|
6
8
|
|
7
9
|
Install the gem and add to the application's Gemfile by executing:
|
@@ -75,9 +77,7 @@ Split with the following priority.
|
|
75
77
|
|
76
78
|
## Development
|
77
79
|
|
78
|
-
After checking out the repo, run `bin/setup` to install dependencies. Then, run `rake
|
79
|
-
|
80
|
-
To install this gem onto your local machine, run `bundle exec rake install`. To release a new version, update the version number in `version.rb`, and then run `bundle exec rake release`, which will create a git tag for the version, push git commits and the created tag, and push the `.gem` file to [rubygems.org](https://rubygems.org).
|
80
|
+
After checking out the repo, run `bin/setup` to install dependencies. Then, run `bundle exec rake` to run the tests. You can also run `bin/console` for an interactive prompt that will allow you to experiment.
|
81
81
|
|
82
82
|
## Contributing
|
83
83
|
|
data/lib/baran/version.rb
CHANGED