huri-module-rag 0.1.0__tar.gz
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- huri_module_rag-0.1.0/PKG-INFO +53 -0
- huri_module_rag-0.1.0/README.md +36 -0
- huri_module_rag-0.1.0/huri_module_rag.egg-info/PKG-INFO +53 -0
- huri_module_rag-0.1.0/huri_module_rag.egg-info/SOURCES.txt +19 -0
- huri_module_rag-0.1.0/huri_module_rag.egg-info/dependency_links.txt +1 -0
- huri_module_rag-0.1.0/huri_module_rag.egg-info/entry_points.txt +3 -0
- huri_module_rag-0.1.0/huri_module_rag.egg-info/requires.txt +11 -0
- huri_module_rag-0.1.0/huri_module_rag.egg-info/top_level.txt +1 -0
- huri_module_rag-0.1.0/huri_rag/__init__.py +0 -0
- huri_module_rag-0.1.0/huri_rag/ingestion.py +589 -0
- huri_module_rag-0.1.0/huri_rag/manifests/qag/huri_module.toml +7 -0
- huri_module_rag-0.1.0/huri_rag/manifests/rag/huri_module.toml +7 -0
- huri_module_rag-0.1.0/huri_rag/memory_inspect.py +114 -0
- huri_module_rag-0.1.0/huri_rag/memory_maintenance.py +154 -0
- huri_module_rag-0.1.0/huri_rag/qdrant_utils.py +29 -0
- huri_module_rag-0.1.0/huri_rag/question_aggregator.py +58 -0
- huri_module_rag-0.1.0/huri_rag/rag.py +901 -0
- huri_module_rag-0.1.0/huri_rag/semantic_chunker.py +251 -0
- huri_module_rag-0.1.0/pyproject.toml +44 -0
- huri_module_rag-0.1.0/setup.cfg +4 -0
- huri_module_rag-0.1.0/tests/test_rag.py +51 -0
|
@@ -0,0 +1,53 @@
|
|
|
1
|
+
Metadata-Version: 2.4
|
|
2
|
+
Name: huri-module-rag
|
|
3
|
+
Version: 0.1.0
|
|
4
|
+
Summary: HuRI module: Retrieval-augmented answers with long-term memory (Qdrant + an OpenAI-compatible LLM), and the question aggregator
|
|
5
|
+
Requires-Python: >=3.10
|
|
6
|
+
Description-Content-Type: text/markdown
|
|
7
|
+
Requires-Dist: huri-core[server]<0.5,>=0.4
|
|
8
|
+
Requires-Dist: huri-events<0.2,>=0.1
|
|
9
|
+
Provides-Extra: rag
|
|
10
|
+
Requires-Dist: numpy<2,>=1.26; extra == "rag"
|
|
11
|
+
Requires-Dist: httpx<0.28,>=0.27.2; extra == "rag"
|
|
12
|
+
Requires-Dist: qdrant-client<1.19,>=1.18; extra == "rag"
|
|
13
|
+
Requires-Dist: sentence-transformers<3.3,>=3.2.1; extra == "rag"
|
|
14
|
+
Requires-Dist: pypdf<5.2,>=5.1; extra == "rag"
|
|
15
|
+
Requires-Dist: semantic_chunker==0.2.0; extra == "rag"
|
|
16
|
+
Requires-Dist: pydantic>=2; extra == "rag"
|
|
17
|
+
|
|
18
|
+
# huri-module-rag
|
|
19
|
+
|
|
20
|
+
Retrieval-augmented answers with long-term memory (Qdrant + an OpenAI-compatible LLM), and the question aggregator.
|
|
21
|
+
|
|
22
|
+
| Module | Topics | What it does |
|
|
23
|
+
|---|---|---|
|
|
24
|
+
| `rag` | `huri.question` → `huri.token` | Answers questions from memory with an LLM, streaming tokens |
|
|
25
|
+
| `qag` | `huri.partial_question` → `huri.question` | Joins a transcript and its emotion into a question |
|
|
26
|
+
|
|
27
|
+
```sh
|
|
28
|
+
pip install -e 'packages/huri-module-rag[rag]' # from a huri-modules checkout, next to huri-core and huri-events
|
|
29
|
+
HURI_MODULES=rag,qag ... # enable it on the server
|
|
30
|
+
```
|
|
31
|
+
|
|
32
|
+
`rag` and the ingestion and memory tools (`python -m huri_rag.ingestion`,
|
|
33
|
+
`memory_inspect`, `memory_maintenance`) need the `rag` extra (Qdrant client,
|
|
34
|
+
sentence-transformers, httpx, pypdf, semantic_chunker); `qag` only joins events
|
|
35
|
+
and needs none of it, so a host that runs `qag` alone installs the package
|
|
36
|
+
without the extra (`[tool.huri-modules.extras]` in `pyproject.toml`; `huri hub
|
|
37
|
+
install` and `scripts/install_local.sh` add it). Hardware pins of `rag`:
|
|
38
|
+
`requirements-amd.rag.txt` (install it before the package).
|
|
39
|
+
|
|
40
|
+
A distribution of
|
|
41
|
+
[huri-modules](https://github.com/Lucy-Robotics/huri-modules), versioned in its
|
|
42
|
+
`pyproject.toml` (see RELEASING.md there). It depends on `huri-core` and
|
|
43
|
+
`huri-events`, which are not on PyPI: without a checkout, install them from git
|
|
44
|
+
in the same pip command, so pip never looks them up on an index:
|
|
45
|
+
|
|
46
|
+
```sh
|
|
47
|
+
ref=0.1.0 # a huri-modules release tag
|
|
48
|
+
core=0.4.0 # HURI_CORE_REF in that release's versions.env
|
|
49
|
+
pip install \
|
|
50
|
+
"huri-core[server] @ git+https://github.com/Lucy-Robotics/huri-core.git@$core" \
|
|
51
|
+
"huri-events @ git+https://github.com/Lucy-Robotics/huri-modules.git@$ref#subdirectory=packages/huri-events" \
|
|
52
|
+
"huri-module-rag[rag] @ git+https://github.com/Lucy-Robotics/huri-modules.git@$ref#subdirectory=packages/huri-module-rag"
|
|
53
|
+
```
|
|
@@ -0,0 +1,36 @@
|
|
|
1
|
+
# huri-module-rag
|
|
2
|
+
|
|
3
|
+
Retrieval-augmented answers with long-term memory (Qdrant + an OpenAI-compatible LLM), and the question aggregator.
|
|
4
|
+
|
|
5
|
+
| Module | Topics | What it does |
|
|
6
|
+
|---|---|---|
|
|
7
|
+
| `rag` | `huri.question` → `huri.token` | Answers questions from memory with an LLM, streaming tokens |
|
|
8
|
+
| `qag` | `huri.partial_question` → `huri.question` | Joins a transcript and its emotion into a question |
|
|
9
|
+
|
|
10
|
+
```sh
|
|
11
|
+
pip install -e 'packages/huri-module-rag[rag]' # from a huri-modules checkout, next to huri-core and huri-events
|
|
12
|
+
HURI_MODULES=rag,qag ... # enable it on the server
|
|
13
|
+
```
|
|
14
|
+
|
|
15
|
+
`rag` and the ingestion and memory tools (`python -m huri_rag.ingestion`,
|
|
16
|
+
`memory_inspect`, `memory_maintenance`) need the `rag` extra (Qdrant client,
|
|
17
|
+
sentence-transformers, httpx, pypdf, semantic_chunker); `qag` only joins events
|
|
18
|
+
and needs none of it, so a host that runs `qag` alone installs the package
|
|
19
|
+
without the extra (`[tool.huri-modules.extras]` in `pyproject.toml`; `huri hub
|
|
20
|
+
install` and `scripts/install_local.sh` add it). Hardware pins of `rag`:
|
|
21
|
+
`requirements-amd.rag.txt` (install it before the package).
|
|
22
|
+
|
|
23
|
+
A distribution of
|
|
24
|
+
[huri-modules](https://github.com/Lucy-Robotics/huri-modules), versioned in its
|
|
25
|
+
`pyproject.toml` (see RELEASING.md there). It depends on `huri-core` and
|
|
26
|
+
`huri-events`, which are not on PyPI: without a checkout, install them from git
|
|
27
|
+
in the same pip command, so pip never looks them up on an index:
|
|
28
|
+
|
|
29
|
+
```sh
|
|
30
|
+
ref=0.1.0 # a huri-modules release tag
|
|
31
|
+
core=0.4.0 # HURI_CORE_REF in that release's versions.env
|
|
32
|
+
pip install \
|
|
33
|
+
"huri-core[server] @ git+https://github.com/Lucy-Robotics/huri-core.git@$core" \
|
|
34
|
+
"huri-events @ git+https://github.com/Lucy-Robotics/huri-modules.git@$ref#subdirectory=packages/huri-events" \
|
|
35
|
+
"huri-module-rag[rag] @ git+https://github.com/Lucy-Robotics/huri-modules.git@$ref#subdirectory=packages/huri-module-rag"
|
|
36
|
+
```
|
|
@@ -0,0 +1,53 @@
|
|
|
1
|
+
Metadata-Version: 2.4
|
|
2
|
+
Name: huri-module-rag
|
|
3
|
+
Version: 0.1.0
|
|
4
|
+
Summary: HuRI module: Retrieval-augmented answers with long-term memory (Qdrant + an OpenAI-compatible LLM), and the question aggregator
|
|
5
|
+
Requires-Python: >=3.10
|
|
6
|
+
Description-Content-Type: text/markdown
|
|
7
|
+
Requires-Dist: huri-core[server]<0.5,>=0.4
|
|
8
|
+
Requires-Dist: huri-events<0.2,>=0.1
|
|
9
|
+
Provides-Extra: rag
|
|
10
|
+
Requires-Dist: numpy<2,>=1.26; extra == "rag"
|
|
11
|
+
Requires-Dist: httpx<0.28,>=0.27.2; extra == "rag"
|
|
12
|
+
Requires-Dist: qdrant-client<1.19,>=1.18; extra == "rag"
|
|
13
|
+
Requires-Dist: sentence-transformers<3.3,>=3.2.1; extra == "rag"
|
|
14
|
+
Requires-Dist: pypdf<5.2,>=5.1; extra == "rag"
|
|
15
|
+
Requires-Dist: semantic_chunker==0.2.0; extra == "rag"
|
|
16
|
+
Requires-Dist: pydantic>=2; extra == "rag"
|
|
17
|
+
|
|
18
|
+
# huri-module-rag
|
|
19
|
+
|
|
20
|
+
Retrieval-augmented answers with long-term memory (Qdrant + an OpenAI-compatible LLM), and the question aggregator.
|
|
21
|
+
|
|
22
|
+
| Module | Topics | What it does |
|
|
23
|
+
|---|---|---|
|
|
24
|
+
| `rag` | `huri.question` → `huri.token` | Answers questions from memory with an LLM, streaming tokens |
|
|
25
|
+
| `qag` | `huri.partial_question` → `huri.question` | Joins a transcript and its emotion into a question |
|
|
26
|
+
|
|
27
|
+
```sh
|
|
28
|
+
pip install -e 'packages/huri-module-rag[rag]' # from a huri-modules checkout, next to huri-core and huri-events
|
|
29
|
+
HURI_MODULES=rag,qag ... # enable it on the server
|
|
30
|
+
```
|
|
31
|
+
|
|
32
|
+
`rag` and the ingestion and memory tools (`python -m huri_rag.ingestion`,
|
|
33
|
+
`memory_inspect`, `memory_maintenance`) need the `rag` extra (Qdrant client,
|
|
34
|
+
sentence-transformers, httpx, pypdf, semantic_chunker); `qag` only joins events
|
|
35
|
+
and needs none of it, so a host that runs `qag` alone installs the package
|
|
36
|
+
without the extra (`[tool.huri-modules.extras]` in `pyproject.toml`; `huri hub
|
|
37
|
+
install` and `scripts/install_local.sh` add it). Hardware pins of `rag`:
|
|
38
|
+
`requirements-amd.rag.txt` (install it before the package).
|
|
39
|
+
|
|
40
|
+
A distribution of
|
|
41
|
+
[huri-modules](https://github.com/Lucy-Robotics/huri-modules), versioned in its
|
|
42
|
+
`pyproject.toml` (see RELEASING.md there). It depends on `huri-core` and
|
|
43
|
+
`huri-events`, which are not on PyPI: without a checkout, install them from git
|
|
44
|
+
in the same pip command, so pip never looks them up on an index:
|
|
45
|
+
|
|
46
|
+
```sh
|
|
47
|
+
ref=0.1.0 # a huri-modules release tag
|
|
48
|
+
core=0.4.0 # HURI_CORE_REF in that release's versions.env
|
|
49
|
+
pip install \
|
|
50
|
+
"huri-core[server] @ git+https://github.com/Lucy-Robotics/huri-core.git@$core" \
|
|
51
|
+
"huri-events @ git+https://github.com/Lucy-Robotics/huri-modules.git@$ref#subdirectory=packages/huri-events" \
|
|
52
|
+
"huri-module-rag[rag] @ git+https://github.com/Lucy-Robotics/huri-modules.git@$ref#subdirectory=packages/huri-module-rag"
|
|
53
|
+
```
|
|
@@ -0,0 +1,19 @@
|
|
|
1
|
+
README.md
|
|
2
|
+
pyproject.toml
|
|
3
|
+
huri_module_rag.egg-info/PKG-INFO
|
|
4
|
+
huri_module_rag.egg-info/SOURCES.txt
|
|
5
|
+
huri_module_rag.egg-info/dependency_links.txt
|
|
6
|
+
huri_module_rag.egg-info/entry_points.txt
|
|
7
|
+
huri_module_rag.egg-info/requires.txt
|
|
8
|
+
huri_module_rag.egg-info/top_level.txt
|
|
9
|
+
huri_rag/__init__.py
|
|
10
|
+
huri_rag/ingestion.py
|
|
11
|
+
huri_rag/memory_inspect.py
|
|
12
|
+
huri_rag/memory_maintenance.py
|
|
13
|
+
huri_rag/qdrant_utils.py
|
|
14
|
+
huri_rag/question_aggregator.py
|
|
15
|
+
huri_rag/rag.py
|
|
16
|
+
huri_rag/semantic_chunker.py
|
|
17
|
+
huri_rag/manifests/qag/huri_module.toml
|
|
18
|
+
huri_rag/manifests/rag/huri_module.toml
|
|
19
|
+
tests/test_rag.py
|
|
@@ -0,0 +1 @@
|
|
|
1
|
+
|
|
@@ -0,0 +1 @@
|
|
|
1
|
+
huri_rag
|
|
File without changes
|