fastembed-gpu 0.2.7__py3-none-any.whl

fastembed_gpu-0.2.7.dist-info/METADATA

@@ -0,0 +1,145 @@
+Metadata-Version: 2.1
+Name: fastembed-gpu
+Version: 0.2.7
+Summary: Fast, light, accurate library built for retrieval embedding generation
+Home-page: https://github.com/qdrant/fastembed
+License: Apache License
+Keywords: vector,embedding,neural,search,qdrant,sentence-transformers
+Author: NirantK
+Author-email: nirant.bits@gmail.com
+Requires-Python: >=3.8.0,<3.13
+Classifier: License :: Other/Proprietary License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.8
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Requires-Dist: huggingface-hub (>=0.20,<0.21)
+Requires-Dist: loguru (>=0.7.2,<0.8.0)
+Requires-Dist: numpy (>=1.21) ; python_version < "3.12"
+Requires-Dist: numpy (>=1.26) ; python_version >= "3.12"
+Requires-Dist: onnxruntime-gpu (>=1.17.0,<2.0.0)
+Requires-Dist: requests (>=2.31,<3.0)
+Requires-Dist: tokenizers (>=0.15,<0.16)
+Requires-Dist: tqdm (>=4.66,<5.0)
+Project-URL: Repository, https://github.com/qdrant/fastembed
+Description-Content-Type: text/markdown
+
+# ⚡️ What is FastEmbed?
+
+FastEmbed is a lightweight, fast, Python library built for embedding generation. We [support popular text models](https://qdrant.github.io/fastembed/examples/Supported_Models/). Please [open a GitHub issue](https://github.com/qdrant/fastembed/issues/new) if you want us to add a new model.
+
+The default text embedding (`TextEmbedding`) model is Flag Embedding, presented in the [MTEB](https://huggingface.co/spaces/mteb/leaderboard) leaderboard. It supports "query" and "passage" prefixes for the input text. Here is an example for [Retrieval Embedding Generation](https://qdrant.github.io/fastembed/qdrant/Retrieval_with_FastEmbed/) and how to use [FastEmbed with Qdrant](https://qdrant.github.io/fastembed/qdrant/Usage_With_Qdrant/).
+
+## 📈 Why FastEmbed?
+
+1. Light: FastEmbed is a lightweight library with few external dependencies. We don't require a GPU and don't download GBs of PyTorch dependencies, and instead use the ONNX Runtime. This makes it a great candidate for serverless runtimes like AWS Lambda. 
+
+2. Fast: FastEmbed is designed for speed. We use the ONNX Runtime, which is faster than PyTorch. We also use data-parallelism for encoding large datasets.
+
+3. Accurate: FastEmbed is better than OpenAI Ada-002. We also [supported](https://qdrant.github.io/fastembed/examples/Supported_Models/) an ever expanding set of models, including a few multilingual models.
+
+## 🚀 Installation
+
+To install the FastEmbed library, pip works best. You can install it with or without GPU support:
+
+```bash
+pip install fastembed
+```
+
+### ⚡️ With GPU
+
+```bash
+pip install fastembed-gpu
+```
+
+## 📖 Quickstart
+
+```python
+from fastembed import TextEmbedding
+from typing import List
+
+# Example list of documents
+documents: List[str] = [
+    "This is built to be faster and lighter than other embedding libraries e.g. Transformers, Sentence-Transformers, etc.",
+    "fastembed is supported by and maintained by Qdrant.",
+]
+
+# This will trigger the model download and initialization
+embedding_model = TextEmbedding()
+print("The model BAAI/bge-small-en-v1.5 is ready to use.")
+
+embeddings_generator = embedding_model.embed(documents)  # reminder this is a generator
+embeddings_list = list(embedding_model.embed(documents))
+  # you can also convert the generator to a list, and that to a numpy array
+len(embeddings_list[0]) # Vector of 384 dimensions
+```
+
+### ⚡️ FastEmbed on a GPU
+
+FastEmbed supports running on GPU devices. It requires installation of the `fastembed-gpu` package.
+Make sure not to have the `fastembed` package installed, as it might interfere with the `fastembed-gpu` package.
+
+```bash
+pip install fastembed-gpu
+``` 
+
+```python
+from fastembed import TextEmbedding
+
+embedding_model = TextEmbedding(model_name="BAAI/bge-small-en-v1.5", providers=["CUDAExecutionProvider"])
+print("The model BAAI/bge-small-en-v1.5 is ready to use on a GPU.")
+
+```
+
+## Usage with Qdrant
+
+Installation with Qdrant Client in Python:
+
+```bash
+pip install qdrant-client[fastembed]
+```
+
+or 
+
+```bash
+pip install qdrant-client[fastembed-gpu]
+```
+
+You might have to use quotes ```pip install 'qdrant-client[fastembed]'``` on zsh.
+
+```python
+from qdrant_client import QdrantClient
+
+# Initialize the client
+client = QdrantClient("localhost", port=6333) # For production
+# client = QdrantClient(":memory:") # For small experiments
+
+# Prepare your documents, metadata, and IDs
+docs = ["Qdrant has Langchain integrations", "Qdrant also has Llama Index integrations"]
+metadata = [
+    {"source": "Langchain-docs"},
+    {"source": "Llama-index-docs"},
+]
+ids = [42, 2]
+
+# If you want to change the model:
+# client.set_model("sentence-transformers/all-MiniLM-L6-v2")
+# List of supported models: https://qdrant.github.io/fastembed/examples/Supported_Models
+
+# Use the new add() instead of upsert()
+# This internally calls embed() of the configured embedding model
+client.add(
+    collection_name="demo_collection",
+    documents=docs,
+    metadata=metadata,
+    ids=ids
+)
+
+search_result = client.query(
+    collection_name="demo_collection",
+    query_text="This is a query document"
+)
+print(search_result)
+```

fastembed_gpu-0.2.7.dist-info/RECORD

@@ -0,0 +1,23 @@
+fastembed/__init__.py,sha256=9xHkflFR7kG3MaY3mTTox4tMuISvIBO79HbesyxI3PU,398
+fastembed/common/__init__.py,sha256=rEIRzzSomx25bbFhNQBCPmuuFCtQsygqA6jx36MRoT4,81
+fastembed/common/model_management.py,sha256=Hfl2XWVY58EEqHTeeo08xLaFHZ59IiCrUlKxgisFRHw,8675
+fastembed/common/models.py,sha256=JjRKsco0rHrCVRiA3nVF0LkFgII2n93xX9xDoZd0Aqw,2030
+fastembed/common/onnx_model.py,sha256=2WjoZnp8Pbhp7InMq0EAuovvqCcdz2-YI19c_8sXh9M,5266
+fastembed/common/utils.py,sha256=Xa6JqwOsrSNM8Ti8DRH0PdTwjyqNJFiM7jVb_0qih64,890
+fastembed/embedding.py,sha256=HeG031cG03UebIstWRDxjYwCq3oqK_JHFHlyeMAroSw,604
+fastembed/image/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+fastembed/parallel_processor.py,sha256=TNhzVp056oVILRMOn5WrUuaVdNwTxSXuTJXiA4lKfts,7539
+fastembed/sparse/__init__.py,sha256=GeUoN_fpiBPoqkO1cOITxf8po0lVdcPV07CEfELsUI0,192
+fastembed/sparse/sparse_embedding_base.py,sha256=3--H1ZHRFXSksmEMnW9D24MDxjSEjF5MRfX4X1N_91A,1133
+fastembed/sparse/sparse_text_embedding.py,sha256=QkXRESUZkkN07qZemL-N6JC-Y2RKZAO0xosQjtkxZLg,3234
+fastembed/sparse/splade_pp.py,sha256=PflMeseKd3uxT6x4Od2t1Nqe0dMb_m1uYHDcd678qBM,4902
+fastembed/text/__init__.py,sha256=5_J8_ASHoG-LrVFvJ_F5ow56PHv5i9j4sziAyxMqKdk,85
+fastembed/text/e5_onnx_embedding.py,sha256=1DBKfybzLlRMXIjKn1lK4tvMcQ8Zt2NJdjz5FnqXLGQ,2049
+fastembed/text/jina_onnx_embedding.py,sha256=4ML25k-Tq3r0GoJRS9yXT7ELAIg30vPR8NhuFQPmhrE,2273
+fastembed/text/onnx_embedding.py,sha256=-mHpG5e_-G5AAnvV3J_grktTjSGD82V6cNvSkKYHU2Y,10151
+fastembed/text/text_embedding.py,sha256=EN3gfTP2A_Oljj1933qpU_rg0Ys19sngltkF7S_odW0,3570
+fastembed/text/text_embedding_base.py,sha256=dzcZSkXokuQ-sPigVB6hN3Xj4fW50teQK4OGZR3Jjv4,1890
+fastembed_gpu-0.2.7.dist-info/LICENSE,sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ,11357
+fastembed_gpu-0.2.7.dist-info/METADATA,sha256=8OT_j9htZFQ1ZZ3VcWQ3gGJ3jvW5xrnTFCLvYIGSziI,5299
+fastembed_gpu-0.2.7.dist-info/WHEEL,sha256=sP946D7jFCHeNz5Iq4fL4Lu-PrWrFsgfLXbbkciIZwg,88
+fastembed_gpu-0.2.7.dist-info/RECORD,,

fastembed_gpu-0.2.7.dist-info/WHEEL

@@ -0,0 +1,4 @@
+Wheel-Version: 1.0
+Generator: poetry-core 1.9.0
+Root-Is-Purelib: true
+Tag: py3-none-any