ff-aitoolkit 0.2.0__py3-none-any.whl

ff_aitoolkit-0.2.0.dist-info/METADATA

@@ -0,0 +1,159 @@
+Metadata-Version: 2.4
+Name: ff-aitoolkit
+Version: 0.2.0
+Summary: Centralized AI clients (LLM, embeddings, STT, TTS, RAG) for self-hosted OpenAI-compatible GPU services.
+Project-URL: Homepage, https://github.com/CNIT-Organization/aitoolkit
+Project-URL: Repository, https://github.com/CNIT-Organization/aitoolkit
+Project-URL: Issues, https://github.com/CNIT-Organization/aitoolkit/issues
+Author: Faisal Fida
+License-Expression: MIT
+License-File: LICENSE
+Keywords: ai,embeddings,llm,openai,rag,self-hosted,stt,tts
+Classifier: Development Status :: 4 - Beta
+Classifier: Intended Audience :: Developers
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Classifier: Typing :: Typed
+Requires-Python: >=3.10
+Requires-Dist: httpx>=0.27
+Requires-Dist: loguru>=0.7
+Requires-Dist: openai>=1.50
+Requires-Dist: pydantic-settings>=2.3
+Requires-Dist: pydantic>=2.7
+Provides-Extra: all
+Requires-Dist: langchain-core>=0.3; extra == 'all'
+Requires-Dist: langchain-openai>=0.2; extra == 'all'
+Requires-Dist: qdrant-client>=1.12; extra == 'all'
+Requires-Dist: redis>=5.0; extra == 'all'
+Provides-Extra: cache
+Requires-Dist: redis>=5.0; extra == 'cache'
+Provides-Extra: langchain
+Requires-Dist: langchain-core>=0.3; extra == 'langchain'
+Requires-Dist: langchain-openai>=0.2; extra == 'langchain'
+Provides-Extra: rag
+Requires-Dist: qdrant-client>=1.12; extra == 'rag'
+Description-Content-Type: text/markdown
+
+# aitoolkit
+
+Centralized AI clients — **LLM, Embeddings, Speech-to-Text, Text-to-Speech, and
+RAG** — targeting self-hosted, OpenAI-compatible services. Reusable across
+projects via a single git install.
+
+## Why
+
+Replaces scattered, provider-specific AI code (cloud-LLM wrappers, local Whisper,
+ad-hoc LangChain) with one thin, stable, dependency-light package. The core is
+**100% LangChain-free**; LangChain is an opt-in extra used only where LangGraph
+orchestration needs it.
+
+## Design principles
+
+1. **Depend on stable interfaces, hide volatile implementations.** The public API
+   is a small set of clients + plain types; provider SDKs stay internal.
+2. **Core is dependency-light and LangChain-free.** Heavy/optional things (qdrant,
+   redis, langchain) live behind extras and import lazily.
+3. **No project specifics in the package.** Hosts, model ids, voices, collection
+   names, and keywords are parameters/config — never hardcoded.
+4. **OpenAI-compatible first.** LLM, embeddings and STT use the `openai` SDK; only
+   TTS is a small custom `httpx` client.
+5. **Async-first**, with sync convenience wrappers where ergonomics demand it.
+
+## Install
+
+```bash
+# core only (LLM, embeddings, STT, TTS)
+pip install "aitoolkit @ git+https://github.com/CNIT-Organization/aitoolkit.git@v0.2.0"
+
+# with RAG (Qdrant) + caching + LangChain bridge
+pip install "aitoolkit[all] @ git+https://github.com/CNIT-Organization/aitoolkit.git@v0.2.0"
+
+# pick exactly what a service needs
+pip install "aitoolkit[rag,cache] @ git+...@v0.2.0"
+pip install "aitoolkit[rag,langchain] @ git+...@v0.2.0"
+```
+
+Extras: `rag` (qdrant-client) · `cache` (redis) · `langchain` (langchain-core +
+langchain-openai) · `all`.
+
+## Configuration
+
+All config is environment-driven (`AITOOLKIT_*`, see [.env.example](.env.example)),
+but every client also accepts explicit overrides, so no env is strictly required.
+
+## Quick start
+
+```python
+import asyncio
+from aitoolkit import get_llm_client, get_embeddings_client, get_stt_client, get_tts_client
+
+async def main():
+    llm = get_llm_client()
+    print(await llm.chat("Say hello in one short sentence."))
+
+    async for tok in llm.stream("Count to five."):
+        print(tok, end="", flush=True)
+
+    emb = get_embeddings_client()
+    vecs = await emb.aembed_documents(["first document", "second document"])
+    print("dim:", emb.dimension)
+
+    stt = get_stt_client()
+    result = await stt.transcribe("audio.wav", language="en")
+    print(result.text)
+
+    tts = get_tts_client()
+    audio = await tts.synthesize("Hello world", voice="your-voice-id")
+    open("out.wav", "wb").write(audio)
+
+    # multi-speaker: synthesize each turn with its own voice and stitch to one WAV
+    dialogue = await tts.synthesize_dialogue([
+        {"voice_id": "voice-a", "text": "Welcome to the overview."},
+        {"voice_id": "voice-b", "text": "Let's dive in."},
+    ])
+    open("dialogue.wav", "wb").write(dialogue)
+
+asyncio.run(main())
+```
+
+### Structured output
+
+```python
+from pydantic import BaseModel
+class Flashcard(BaseModel):
+    question: str
+    answer: str
+
+card = await get_llm_client().chat_structured(Flashcard, "Make a flashcard about the water cycle.")
+```
+
+### RAG (`aitoolkit[rag]`)
+
+```python
+from aitoolkit.rag import get_rag_agent
+agent = get_rag_agent(collection_name="documents")
+await agent.add_documents(["chunk 1", "chunk 2"], file_id="doc-42")
+answer = await agent.answer_question("What does the document say about safety?")
+```
+
+### LangChain bridge (`aitoolkit[langchain]`)
+
+```python
+from aitoolkit.integrations.langchain import to_chat_model, LangChainEmbeddings
+chat_model = to_chat_model(temperature=0.3)   # a LangChain BaseChatModel for LangGraph
+embeddings = LangChainEmbeddings()            # a LangChain Embeddings
+```
+
+## Testing
+
+```bash
+pip install -e ".[all]" --group dev
+pytest                       # unit tests (mocked)
+AITOOLKIT_RUN_LIVE=1 pytest  # also run live smoke tests against your endpoints
+```
+
+Live tests auto-skip when the configured endpoints are unreachable.

ff_aitoolkit-0.2.0.dist-info/RECORD

@@ -0,0 +1,26 @@
+aitoolkit/__init__.py,sha256=eWgfulOl0Z2HqF8tt4OCFpvdlidBwFhDEEl8TK5At-Q,1639
+aitoolkit/config.py,sha256=Yu2CbR0xgjJ5RC13cmWhp0NZWhgTqqM2dh40PuXeVk0,4191
+aitoolkit/exceptions.py,sha256=WBkCTPcUTC-klYjoyhMl8TPdXjlDEu4PoP-NfbdNLq0,903
+aitoolkit/py.typed,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+aitoolkit/retry.py,sha256=iGNzowLcZu-ddgJjGJwM3H3tZ8Y584-OCLWHbLSUYQg,1805
+aitoolkit/types.py,sha256=iEbyE4Ci4Si6NyGiKmApOvNv2UM4x3j1esxk7SjYXbs,1670
+aitoolkit/embeddings/__init__.py,sha256=hdc4XgF4IfPyz5BKFQZkWL90F8yzZBKC3Wqeolne3Qw,211
+aitoolkit/embeddings/client.py,sha256=_Y_ePyXPN0YLtdq0aL6jX_TOHqPDOhWjcOdgiiI_JcM,5214
+aitoolkit/integrations/__init__.py,sha256=MJtAdOuWTh3wORjWMS2ymJ5z_gu6dQ6udKZkSaTZl0s,75
+aitoolkit/integrations/langchain.py,sha256=3YFf8VQ2JmpDWtyGHYajkIo4GI-YetWWRcfgFUpblUc,2408
+aitoolkit/llm/__init__.py,sha256=zCvyG6D5l6FaQmnfXUMc_zPHn0i4KLfTMpR5jN0olvc,186
+aitoolkit/llm/client.py,sha256=w0lupU6tc0zD_ER4REn47Uzn6_v2Wvz_CH4B3WLA6-Y,8561
+aitoolkit/rag/__init__.py,sha256=_kL9QJHufhtbsMkEekzzW_d2SbeqjdqOG-bt_SIYHbE,784
+aitoolkit/rag/agent.py,sha256=g1YroDZVCKypkjsJWO2nZv2vxpt1SN3jNl8o-xnnKjM,5585
+aitoolkit/rag/query_expansion.py,sha256=mKSgB83KXiAYtfp2xrMxiX2r_Vv4azZzN3hwWFStEkQ,5493
+aitoolkit/rag/retriever.py,sha256=UfeB4GhC-m3UUBBWvc6_pHCdBAzCZwAPp-gutZzpXFE,4930
+aitoolkit/rag/vector_store.py,sha256=y2zy4CAc1iuWKy1oiex4WKWo4XGvlkPo4XZA4LMTCsU,9017
+aitoolkit/stt/__init__.py,sha256=6msmtOtLBZRtgNTOCk35S-psM6Ymd-fGQoTf-ynQP6M,180
+aitoolkit/stt/client.py,sha256=PBnV-2AYtFV2HL869CFoG926O1rp0ZeupeGWqmmKwq4,5227
+aitoolkit/tts/__init__.py,sha256=YnRvBdoT47HvHpHYEOqDO26NZ0_pzWQHcBUcNFC16mM,397
+aitoolkit/tts/audio.py,sha256=duQOpdUw1XVaUycyESCaReVVHE-KATUGPz01_8UgBJQ,2606
+aitoolkit/tts/client.py,sha256=yMQD859fz9J50QeI4td8eBGX2w9ZSVxgann1DHGznCU,8466
+ff_aitoolkit-0.2.0.dist-info/METADATA,sha256=-8XfYbp_ARcFhD-69oAf2rcsSS4kCwO4RSeiVjvs6Es,5687
+ff_aitoolkit-0.2.0.dist-info/WHEEL,sha256=mffPy8wBnZQn2VnJUU5jE99KsxaSfiyMHV9Yt0aLVxs,87
+ff_aitoolkit-0.2.0.dist-info/licenses/LICENSE,sha256=Ez7zdj8WqKy4Em_RWPGp-cIX7PuHTk2yqh38ahms7KI,1068
+ff_aitoolkit-0.2.0.dist-info/RECORD,,

ff_aitoolkit-0.2.0.dist-info/WHEEL

@@ -0,0 +1,4 @@
+Wheel-Version: 1.0
+Generator: hatchling 1.30.1
+Root-Is-Purelib: true
+Tag: py3-none-any

ff_aitoolkit-0.2.0.dist-info/licenses/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Faisal Fida
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.