sqlite-sparse 0.1.0.post1__tar.gz → 1.0.0__tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (21) hide show
  1. {sqlite_sparse-0.1.0.post1/sqlite_sparse.egg-info → sqlite_sparse-1.0.0}/PKG-INFO +8 -11
  2. {sqlite_sparse-0.1.0.post1 → sqlite_sparse-1.0.0}/README.md +3 -3
  3. {sqlite_sparse-0.1.0.post1 → sqlite_sparse-1.0.0}/pyproject.toml +2 -3
  4. {sqlite_sparse-0.1.0.post1 → sqlite_sparse-1.0.0}/sqlite_sparse/__init__.py +1 -1
  5. {sqlite_sparse-0.1.0.post1 → sqlite_sparse-1.0.0/sqlite_sparse.egg-info}/PKG-INFO +8 -11
  6. sqlite_sparse-1.0.0/sqlite_sparse.egg-info/requires.txt +9 -0
  7. sqlite_sparse-0.1.0.post1/sqlite_sparse.egg-info/requires.txt +0 -13
  8. {sqlite_sparse-0.1.0.post1 → sqlite_sparse-1.0.0}/LICENSE +0 -0
  9. {sqlite_sparse-0.1.0.post1 → sqlite_sparse-1.0.0}/setup.cfg +0 -0
  10. {sqlite_sparse-0.1.0.post1 → sqlite_sparse-1.0.0}/sqlite_sparse/api.py +0 -0
  11. {sqlite_sparse-0.1.0.post1 → sqlite_sparse-1.0.0}/sqlite_sparse/cli.py +0 -0
  12. {sqlite_sparse-0.1.0.post1 → sqlite_sparse-1.0.0}/sqlite_sparse/convert.py +0 -0
  13. {sqlite_sparse-0.1.0.post1 → sqlite_sparse-1.0.0}/sqlite_sparse/encoder.py +0 -0
  14. {sqlite_sparse-0.1.0.post1 → sqlite_sparse-1.0.0}/sqlite_sparse/loadable.py +0 -0
  15. {sqlite_sparse-0.1.0.post1 → sqlite_sparse-1.0.0}/sqlite_sparse/models.py +0 -0
  16. {sqlite_sparse-0.1.0.post1 → sqlite_sparse-1.0.0}/sqlite_sparse/search.py +0 -0
  17. {sqlite_sparse-0.1.0.post1 → sqlite_sparse-1.0.0}/sqlite_sparse/store.py +0 -0
  18. {sqlite_sparse-0.1.0.post1 → sqlite_sparse-1.0.0}/sqlite_sparse.egg-info/SOURCES.txt +0 -0
  19. {sqlite_sparse-0.1.0.post1 → sqlite_sparse-1.0.0}/sqlite_sparse.egg-info/dependency_links.txt +0 -0
  20. {sqlite_sparse-0.1.0.post1 → sqlite_sparse-1.0.0}/sqlite_sparse.egg-info/entry_points.txt +0 -0
  21. {sqlite_sparse-0.1.0.post1 → sqlite_sparse-1.0.0}/sqlite_sparse.egg-info/top_level.txt +0 -0
@@ -1,6 +1,6 @@
1
1
  Metadata-Version: 2.4
2
2
  Name: sqlite-sparse
3
- Version: 0.1.0.post1
3
+ Version: 1.0.0
4
4
  Summary: Semantic search in one SQLite file. No model, no server at query time.
5
5
  Author-email: Arbaz Siddiqui <arbaz00@gmail.com>
6
6
  License: MIT
@@ -18,13 +18,10 @@ Requires-Python: >=3.9
18
18
  Description-Content-Type: text/markdown
19
19
  License-File: LICENSE
20
20
  Requires-Dist: numpy>=1.24
21
- Provides-Extra: build
22
- Requires-Dist: onnxruntime>=1.17; extra == "build"
23
- Requires-Dist: tokenizers>=0.15; extra == "build"
24
- Requires-Dist: huggingface_hub>=0.20; extra == "build"
25
- Provides-Extra: build-torch
26
- Requires-Dist: sentence-transformers>=5.0; extra == "build-torch"
27
- Requires-Dist: torch; extra == "build-torch"
21
+ Provides-Extra: convert
22
+ Requires-Dist: sentence-transformers>=5.0; extra == "convert"
23
+ Requires-Dist: torch; extra == "convert"
24
+ Requires-Dist: transformers>=4.40; extra == "convert"
28
25
  Provides-Extra: dev
29
26
  Requires-Dist: pytest>=7; extra == "dev"
30
27
  Dynamic: license-file
@@ -90,7 +87,7 @@ Or take the binary from the [releases page](https://github.com/arbazsiddiqui/sql
90
87
  and use it from any language.
91
88
 
92
89
  ```
93
- tar xzf sparse0-0.1.0-loadable-linux-x86_64.tar.gz # or -macos-arm64
90
+ tar xzf sparse0-1.0.0-loadable-linux-x86_64.tar.gz # or -macos-arm64
94
91
  sqlite3 notes.db
95
92
  sqlite> .load ./sparse0
96
93
  ```
@@ -174,7 +171,7 @@ approximate index, and ties break on the lower rowid. Nothing from the GGUF or t
174
171
  sidecar is read at query time.
175
172
 
176
173
  The file layout is in [FORMAT.md](https://github.com/arbazsiddiqui/sqlite-sparse/blob/master/FORMAT.md). The format and the sidecar header carry
177
- version 1; format stability is not promised before 1.0.
174
+ version 1, and files written by any 1.x release stay readable by later 1.x releases.
178
175
 
179
176
  ## Benchmarks
180
177
 
@@ -254,7 +251,7 @@ vocabulary.
254
251
  git clone --depth 1 https://github.com/ggml-org/llama.cpp
255
252
  python llama.cpp/convert_hf_to_gguf.py <hf-model-id> --outfile model_f16.gguf --outtype f16
256
253
  llama.cpp/build/bin/llama-quantize model_f16.gguf model_q8.gguf q8_0 # optional
257
- pip install "sqlite-sparse[build-torch]"
254
+ pip install "sqlite-sparse[convert]" # torch and sentence-transformers, only for this step
258
255
  sqlite-sparse convert <hf-model-id> model.sprs # --double-log for v3 models
259
256
  ```
260
257
 
@@ -59,7 +59,7 @@ Or take the binary from the [releases page](https://github.com/arbazsiddiqui/sql
59
59
  and use it from any language.
60
60
 
61
61
  ```
62
- tar xzf sparse0-0.1.0-loadable-linux-x86_64.tar.gz # or -macos-arm64
62
+ tar xzf sparse0-1.0.0-loadable-linux-x86_64.tar.gz # or -macos-arm64
63
63
  sqlite3 notes.db
64
64
  sqlite> .load ./sparse0
65
65
  ```
@@ -143,7 +143,7 @@ approximate index, and ties break on the lower rowid. Nothing from the GGUF or t
143
143
  sidecar is read at query time.
144
144
 
145
145
  The file layout is in [FORMAT.md](https://github.com/arbazsiddiqui/sqlite-sparse/blob/master/FORMAT.md). The format and the sidecar header carry
146
- version 1; format stability is not promised before 1.0.
146
+ version 1, and files written by any 1.x release stay readable by later 1.x releases.
147
147
 
148
148
  ## Benchmarks
149
149
 
@@ -223,7 +223,7 @@ vocabulary.
223
223
  git clone --depth 1 https://github.com/ggml-org/llama.cpp
224
224
  python llama.cpp/convert_hf_to_gguf.py <hf-model-id> --outfile model_f16.gguf --outtype f16
225
225
  llama.cpp/build/bin/llama-quantize model_f16.gguf model_q8.gguf q8_0 # optional
226
- pip install "sqlite-sparse[build-torch]"
226
+ pip install "sqlite-sparse[convert]" # torch and sentence-transformers, only for this step
227
227
  sqlite-sparse convert <hf-model-id> model.sprs # --double-log for v3 models
228
228
  ```
229
229
 
@@ -1,6 +1,6 @@
1
1
  [project]
2
2
  name = "sqlite-sparse"
3
- version = "0.1.0.post1"
3
+ version = "1.0.0"
4
4
  description = "Semantic search in one SQLite file. No model, no server at query time."
5
5
  readme = "README.md"
6
6
  requires-python = ">=3.9"
@@ -24,8 +24,7 @@ Repository = "https://github.com/arbazsiddiqui/sqlite-sparse"
24
24
  Issues = "https://github.com/arbazsiddiqui/sqlite-sparse/issues"
25
25
 
26
26
  [project.optional-dependencies]
27
- build = ["onnxruntime>=1.17", "tokenizers>=0.15", "huggingface_hub>=0.20"]
28
- build-torch = ["sentence-transformers>=5.0", "torch"]
27
+ convert = ["sentence-transformers>=5.0", "torch", "transformers>=4.40"]
29
28
  dev = ["pytest>=7"]
30
29
 
31
30
  [project.scripts]
@@ -3,4 +3,4 @@ from .loadable import load, loadable_path
3
3
  from .models import MODELS, fetch, register
4
4
 
5
5
  __all__ = ["SparseIndex", "load", "loadable_path", "MODELS", "fetch", "register"]
6
- __version__ = "0.1.0.post1"
6
+ __version__ = "1.0.0"
@@ -1,6 +1,6 @@
1
1
  Metadata-Version: 2.4
2
2
  Name: sqlite-sparse
3
- Version: 0.1.0.post1
3
+ Version: 1.0.0
4
4
  Summary: Semantic search in one SQLite file. No model, no server at query time.
5
5
  Author-email: Arbaz Siddiqui <arbaz00@gmail.com>
6
6
  License: MIT
@@ -18,13 +18,10 @@ Requires-Python: >=3.9
18
18
  Description-Content-Type: text/markdown
19
19
  License-File: LICENSE
20
20
  Requires-Dist: numpy>=1.24
21
- Provides-Extra: build
22
- Requires-Dist: onnxruntime>=1.17; extra == "build"
23
- Requires-Dist: tokenizers>=0.15; extra == "build"
24
- Requires-Dist: huggingface_hub>=0.20; extra == "build"
25
- Provides-Extra: build-torch
26
- Requires-Dist: sentence-transformers>=5.0; extra == "build-torch"
27
- Requires-Dist: torch; extra == "build-torch"
21
+ Provides-Extra: convert
22
+ Requires-Dist: sentence-transformers>=5.0; extra == "convert"
23
+ Requires-Dist: torch; extra == "convert"
24
+ Requires-Dist: transformers>=4.40; extra == "convert"
28
25
  Provides-Extra: dev
29
26
  Requires-Dist: pytest>=7; extra == "dev"
30
27
  Dynamic: license-file
@@ -90,7 +87,7 @@ Or take the binary from the [releases page](https://github.com/arbazsiddiqui/sql
90
87
  and use it from any language.
91
88
 
92
89
  ```
93
- tar xzf sparse0-0.1.0-loadable-linux-x86_64.tar.gz # or -macos-arm64
90
+ tar xzf sparse0-1.0.0-loadable-linux-x86_64.tar.gz # or -macos-arm64
94
91
  sqlite3 notes.db
95
92
  sqlite> .load ./sparse0
96
93
  ```
@@ -174,7 +171,7 @@ approximate index, and ties break on the lower rowid. Nothing from the GGUF or t
174
171
  sidecar is read at query time.
175
172
 
176
173
  The file layout is in [FORMAT.md](https://github.com/arbazsiddiqui/sqlite-sparse/blob/master/FORMAT.md). The format and the sidecar header carry
177
- version 1; format stability is not promised before 1.0.
174
+ version 1, and files written by any 1.x release stay readable by later 1.x releases.
178
175
 
179
176
  ## Benchmarks
180
177
 
@@ -254,7 +251,7 @@ vocabulary.
254
251
  git clone --depth 1 https://github.com/ggml-org/llama.cpp
255
252
  python llama.cpp/convert_hf_to_gguf.py <hf-model-id> --outfile model_f16.gguf --outtype f16
256
253
  llama.cpp/build/bin/llama-quantize model_f16.gguf model_q8.gguf q8_0 # optional
257
- pip install "sqlite-sparse[build-torch]"
254
+ pip install "sqlite-sparse[convert]" # torch and sentence-transformers, only for this step
258
255
  sqlite-sparse convert <hf-model-id> model.sprs # --double-log for v3 models
259
256
  ```
260
257
 
@@ -0,0 +1,9 @@
1
+ numpy>=1.24
2
+
3
+ [convert]
4
+ sentence-transformers>=5.0
5
+ torch
6
+ transformers>=4.40
7
+
8
+ [dev]
9
+ pytest>=7
@@ -1,13 +0,0 @@
1
- numpy>=1.24
2
-
3
- [build]
4
- onnxruntime>=1.17
5
- tokenizers>=0.15
6
- huggingface_hub>=0.20
7
-
8
- [build-torch]
9
- sentence-transformers>=5.0
10
- torch
11
-
12
- [dev]
13
- pytest>=7