ragmint 0.2.1__py3-none-any.whl → 0.4.6__py3-none-any.whl

ragmint-0.4.6.dist-info/METADATA

@@ -0,0 +1,530 @@
+Metadata-Version: 2.4
+Name: ragmint
+Version: 0.4.6
+Summary: A modular framework for evaluating and optimizing RAG pipelines.
+Author-email: Andre Oliveira <oandreoliveira@outlook.com>
+License: Apache License 2.0
+Project-URL: Homepage, https://github.com/andyolivers/ragmint
+Project-URL: Documentation, https://andyolivers.com
+Project-URL: Issues, https://github.com/andyolivers/ragmint/issues
+Keywords: RAG,LLM,retrieval,optimization,AI,evaluation,chunking,autotuning
+Requires-Python: >=3.9
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: numpy<2.0.0
+Requires-Dist: pandas>=2.0
+Requires-Dist: scikit-learn>=1.3
+Requires-Dist: sentence-transformers>=2.2.2
+Requires-Dist: chromadb>=0.3.1
+Requires-Dist: faiss-cpu; sys_platform != "darwin"
+Requires-Dist: faiss-cpu==1.7.4; sys_platform == "darwin"
+Requires-Dist: rank-bm25>=0.2.2
+Requires-Dist: optuna>=3.0
+Requires-Dist: tqdm
+Requires-Dist: colorama
+Requires-Dist: pyyaml
+Requires-Dist: python-dotenv
+Requires-Dist: openai>=1.0.0
+Requires-Dist: google-generativeai>=0.8.0
+Requires-Dist: anthropic>=0.25.0
+Requires-Dist: pytest
+Requires-Dist: langchain>=0.2.5
+Requires-Dist: langchain-community>=0.2.5
+Requires-Dist: langchain-text-splitters>=0.2.1
+Requires-Dist: gradio>=4.38.0
+Requires-Dist: matplotlib>=3.8.0
+Provides-Extra: dev
+Requires-Dist: black; extra == "dev"
+Requires-Dist: flake8; extra == "dev"
+Requires-Dist: isort; extra == "dev"
+Requires-Dist: pytest-cov; extra == "dev"
+Provides-Extra: docs
+Requires-Dist: mkdocs; extra == "docs"
+Requires-Dist: mkdocs-material; extra == "docs"
+Dynamic: license-file
+
+# Ragmint
+
+<p align="center">
+  <img src="src/ragmint/assets/img/ragmint-banner.png" width="auto" height="70px" alt="Ragmint Banner">
+</p>
+
+![Python](https://img.shields.io/badge/python-3.9%2B-blue)
+![License](https://img.shields.io/badge/license-Apache%202.0-green)
+![Tests](https://github.com/andyolivers/ragmint/actions/workflows/tests.yml/badge.svg)
+![Optuna](https://img.shields.io/badge/Optuna-Integrated-orange)
+![Status](https://img.shields.io/badge/Status-Active-success)
+![PyPI](https://img.shields.io/pypi/v/ragmint?color=blue)
+![Docs](https://img.shields.io/badge/docs-latest-blueviolet)
+
+
+**Ragmint** (Retrieval-Augmented Generation Model Inspection & Tuning) is a modular, developer-friendly Python library for **evaluating, optimizing, and tuning RAG (Retrieval-Augmented Generation) pipelines**.
+
+It provides a complete toolkit for **retriever selection**, **embedding model tuning**, **automated RAG evaluation**, and **config-driven prebuilding** of pipelines with support for **Optuna-based Bayesian optimization**, **Auto-RAG tuning**, **chunking**, and **explainability** through Gemini or Claude.
+
+---
+
+## ✨ Features
+
+- ✅ **Automated hyperparameter optimization** (Grid, Random, Bayesian via Optuna).
+- 🤖 **Auto-RAG Tuner** — dynamically recommends retriever–embedding pairs based on corpus size and document statistics, **suggests multiple chunk sizes with overlaps**, and can **test configurations to identify the best-performing RAG setup**.
+- 🧮 **Validation QA Generator** — automatically creates QA datasets from a corpus for evaluating and tuning RAG pipelines when no labeled data is available.
+- 🧠 **Explainability Layer** — interprets RAG performance via Gemini or Claude APIs.
+- 🏆 **Leaderboard Tracking** — stores and ranks experiment runs via JSON or external DB.
+- 🔍 **Built-in RAG evaluation metrics** — faithfulness, recall, BLEU, ROUGE, latency.
+- 📦 **Chunking system** — automatic or configurable `chunk_size` and `overlap` for documents with multiple suggested pairs.  
+- ⚙️ **Retrievers** — FAISS, Chroma, scikit-learn.  
+- 🧩 **Embeddings** — Hugging Face.
+- 💾 **Caching, experiment tracking, and reproducibility** out of the box.
+- 🧰 **Clean modular structure** for easy integration in research and production setups.
+- 🏗️ **Langchain Prebuilder** — prepares pipelines, applies chunking, embeddings, and vector store creation automatically.
+- ⚙️ **Config Adapter (LangchainConfigAdapter)** — normalizes configuration, fills defaults, validates retrievers.
+
+---
+
+## 🚀 Quick Start
+
+### Installation
+
+```bash
+git clone https://github.com/andyolivers/ragmint.git
+cd ragmint
+pip install -e .
+python -m ragmint.app
+```
+
+> The `-e` flag installs Ragmint in editable (development) mode.  
+> Requires **Python ≥ 3.9**.
+
+### Installation via PyPI
+
+```bash
+pip install ragmint
+```
+
+---
+
+### 2️⃣ Run a RAG Optimization Experiment
+
+```bash
+python ragmint/main.py --config configs/default.yaml --search bayesian
+```
+
+Example `configs/default.yaml`:
+```yaml
+retriever: faiss
+embedding_model: text-embedding-3-small
+chunk_size: 500
+overlap: 100
+reranker:
+  mode: mmr
+  lambda_param: 0.5
+optimization:
+  search_method: bayesian
+  n_trials: 20
+```
+
+---
+
+### 3️⃣ Manual Pipeline Usage
+
+```python
+from ragmint.prebuilder import PreBuilder
+from ragmint.tuner import RAGMint
+
+# Prebuild pipeline (chunking, embeddings, vector store)
+prebuilder = PreBuilder(
+    docs_path="data/docs/",
+    config_path="configs/default.yaml"
+)
+pipeline = prebuilder.build_pipeline()
+
+# Initialize RAGMint with prebuilt components
+rag = RAGMint(pipeline=pipeline)
+
+# Run optimization
+best, results = rag.optimize(validation_set=None, metric="faithfulness", trials=3)
+print("Best configuration:", best)
+
+```
+---
+# 🧩 Embeddings and Retrievers
+
+**Ragmint** supports a flexible set of embeddings and retrievers, allowing you to adapt easily to various **RAG architectures**.
+
+---
+## 🧩 Chunking System
+
+* **Automatically splits documents** into chunks with `chunk_size` and `overlap` parameters.
+* **Supports default values** if not provided in configuration.
+* **Optimized** for downstream **retrieval and embeddings**.
+* **Enables adaptive chunking strategies** in future releases.
+---
+## 🧮 Validation QA Generator
+
+The **QA Generator** module automatically creates **question–answer (QA) validation datasets** from any corpus of `.txt` documents.  
+This dataset can be used to **evaluate and tune RAG pipelines** inside Ragmint when no labeled data is available.
+
+### ✨ Key Capabilities
+
+- 🔁 **Batch processing** — splits large corpora into batches to prevent token overflows and API timeouts.
+
+- 🧠 **Topic-aware question estimation** — dynamically determines how many questions to generate per document based on:
+  - Document length (logarithmic scaling)
+  - Topic diversity (via `SentenceTransformer` + `KMeans` clustering)
+
+- 🤖 **LLM-powered QA synthesis** — generates factual QA pairs using **Gemini** or **Claude** models.
+
+- 💾 **Automatic JSON export** — saves the generated dataset to `experiments/validation_qa.json` (configurable).
+
+### ⚙️ Usage
+
+You can run the generator directly from the command line:
+
+```bash
+python -m ragmint.qa_generator --density 0.005
+```
+
+### 💡 Example: Using in Python
+
+```python
+from ragmint.qa_generator import generate_validation_qa
+
+generate_validation_qa(
+    docs_path="data/docs",                          # Folder with .txt documents
+    output_path="experiments/validation_qa.json",   # Output JSON file
+    llm_model="gemini-2.5-flash-lite",              # or "claude-3-opus-20240229"
+    batch_size=5,                                   # Number of docs per LLM call
+    sleep_between_batches=2,                        # Wait time between calls (seconds)
+    min_q=3,                                        # Minimum questions per doc
+    max_q=25                                        # Maximum questions per doc
+)
+```
+✅ The generator supports both Gemini and Claude models.  
+Set your API key in a `.env` file or via environment variables:
+```
+export GOOGLE_API_KEY="your_gemini_key"
+export ANTHROPIC_API_KEY="your_claude_key"
+```
+
+---
+## 🧩 Langchain Config Adapter
+
+* **Ensures consistent configuration** across pipeline components.
+* **Normalizes retriever and embedding names** (e.g., `faiss`, `sentence-transformers/...`).
+* **Adds default chunk parameters** when missing.
+* **Validates retriever backends** and **raises clear errors** for unsupported options.
+
+---
+## 🧩 Langchain Prebuilder
+
+**Automates pipeline preparation:**
+1. Reads documents
+2. Applies chunking
+3. Creates embeddings
+4. Initializes retriever / vector store
+5. Returns ready-to-use pipeline** for RAGMint or custom usage.
+
+---
+
+## 🔤 Available Embeddings (Hugging Face)
+
+You can select from the following models:
+
+* `sentence-transformers/all-MiniLM-L6-v2` — **lightweight**, general-purpose
+* `sentence-transformers/all-mpnet-base-v2` — **higher accuracy**, slower
+* `BAAI/bge-base-en-v1.5` — **multilingual**, dense embeddings
+* `intfloat/multilingual-e5-base` — ideal for **multilingual corpora**
+
+
+
+### Configuration Example
+
+Use the following format in your config file to specify the embedding model:
+
+```yaml
+embedding_model: sentence-transformers/all-MiniLM-L6-v2
+```
+---
+
+## 🔍 Available Retrievers
+
+**Ragmint** integrates multiple **retrieval backends** to suit different needs:
+
+| Retriever | Description |
+| :--- | :--- |
+| **FAISS** | Fast vector similarity search; efficient for dense embeddings |
+| **Chroma** | Persistent vector DB; works well for incremental updates |
+| **scikit-learn (NearestNeighbors)** | Lightweight, zero-dependency local retriever |
+
+
+### Configuration Example
+
+To specify the retriever in your configuration file, use the following format:
+
+```yaml
+retriever: faiss
+```
+
+---
+
+## 🧪 Dataset Options
+
+Ragmint can automatically load evaluation datasets for your RAG pipeline:
+
+| Mode | Example | Description |
+|------|----------|-------------|
+| 🧱 **Default** | `validation_set=None` | Uses built-in `experiments/validation_qa.json` |
+| 📁 **Custom File** | `validation_set="data/my_eval.json"` | Load your own QA dataset (JSON or CSV) |
+| 🌐 **Hugging Face Dataset** | `validation_set="squad"` | Automatically downloads benchmark datasets (requires `pip install datasets`) |
+
+### Example
+
+```python
+from ragmint.tuner import RAGMint
+
+ragmint = RAGMint(
+    docs_path="data/docs/",
+    retrievers=["faiss", "chroma"],
+    embeddings=["text-embedding-3-small"],
+    rerankers=["mmr"],
+)
+
+# Use built-in default
+ragmint.optimize(validation_set=None)
+
+# Use Hugging Face benchmark
+ragmint.optimize(validation_set="squad")
+
+# Use your own dataset
+ragmint.optimize(validation_set="data/custom_qa.json")
+```
+
+---
+
+## 🧠 Auto-RAG Tuner
+
+The **AutoRAGTuner** automatically analyzes your corpus and recommends retriever–embedding combinations based on corpus statistics (size and average document length). It also **suggests multiple chunk sizes with overlaps** to improve retrieval performance.
+
+Beyond recommendations, it can **run full end-to-end testing** of the suggested configurations and **identify the best-performing RAG setup** for your dataset.
+
+
+```python
+from ragmint.autotuner import AutoRAGTuner
+
+# Initialize with your documents
+tuner = AutoRAGTuner(docs_path="data/docs/")
+
+# Recommend configurations and suggest chunk sizes
+recommendation = tuner.recommend(num_chunk_pairs=5)
+print("Initial recommendation:", recommendation)
+
+# Run full auto-tuning on validation set
+best_config, results = tuner.auto_tune(validation_set="data/validation.json", trials=5)
+print("Best configuration after testing:", best_config)
+print("All trial results:", results)
+```
+---
+## 🧠 Live Dashboard (Gradio)
+Ragmint includes a visual dashboard to AutoTune and analyze RAG pipelines.
+
+<p align="center">
+  <img src="/assets/images/dashboard-preview.png" width="80%" alt="Ragmint Gradio App Preview">
+</p>
+
+---
+
+## 🏆 Leaderboard Tracking
+
+Track and visualize your best experiments across runs.
+
+```python
+from ragmint.leaderboard import Leaderboard
+
+# Initialize local leaderboard
+leaderboard = Leaderboard(storage_path="leaderboard.jsonl")
+
+# Retrieve top 5 runs
+print("\n🏅 Top 5 Experiments:")
+for result in leaderboard.top_results(limit=5):
+    print(f"{result['run_id']} | Score: {result['best_score']:.2f} | Model: {result['model']}")
+```
+
+---
+
+## 🧠 Explainability with Gemini / Claude
+
+Compare RAG configurations and receive **natural language insights** on why one performs better.
+
+```python
+from ragmint.autotuner import AutoRAGTuner
+from ragmint.explainer import explain_results
+
+tuner = AutoRAGTuner(docs_path="data/docs/")
+best, results = tuner.auto_tune(
+    validation_set='data/docs/validation_qa.json',
+    metric="faithfulness",
+    trials=5,
+    search_type='bayesian'
+)
+
+analysis = explain_results(best, results, corpus_stats=tuner.corpus_stats)
+print(analysis)
+```
+
+> Set your API keys in a `.env` file or via environment variables:
+> ```
+> export GEMINI_API_KEY="your_gemini_key"
+> export ANTHROPIC_API_KEY="your_claude_key"
+> ```
+
+---
+
+## 🧩 Folder Structure
+
+```
+ragmint/
+├── core/
+│   ├── pipeline.py
+│   ├── retriever.py
+│   ├── reranker.py
+│   ├── embeddings.py
+│   ├── chunking.py
+│   └── evaluation.py
+├── integration/
+│   ├── config_adapter.py
+│   └── langchain_prebuilder.py
+├── autotuner.py
+├── explainer.py
+├── leaderboard.py
+├── tuner.py
+├── utils/
+├── configs/
+├── experiments/
+├── tests/
+└── main.py
+```
+
+---
+
+## 🧪 Running Tests
+
+```bash
+pytest -v
+```
+
+To include integration tests with Gemini or Claude APIs:
+```bash
+pytest -m integration
+```
+
+---
+
+## ⚙️ Configuration via `pyproject.toml`
+
+Your `pyproject.toml` includes all required dependencies:
+
+```toml
+[project]
+name = "ragmint"
+version = "0.1.0"
+dependencies = [
+  # Core ML + Embeddings
+  "numpy<2.0.0",
+  "pandas>=2.0",
+  "scikit-learn>=1.3",
+  "sentence-transformers>=2.2.2",
+
+  # Retrieval backends
+  "chromadb>=0.4",
+  "faiss-cpu; sys_platform != 'darwin'",       # For Linux/Windows
+  "faiss-cpu==1.7.4; sys_platform == 'darwin'", # Optional fix for macOS MPS
+  "rank-bm25>=0.2.2",                          # For BM25 retriever
+
+  # Optimization & evaluation
+  "optuna>=3.0",
+  "tqdm",
+  "colorama",
+
+  # RAG evaluation and data utils
+  "pyyaml",
+  "python-dotenv",
+
+  # Explainability and LLM APIs
+  "openai>=1.0.0",
+  "google-generativeai>=0.8.0",
+  "anthropic>=0.25.0",
+
+  # Integration / storage
+  "supabase>=2.4.0",
+
+  # Testing
+  "pytest",
+
+  # LangChain integration layer
+  "langchain>=0.2.5",
+  "langchain-community>=0.2.5",
+  "langchain-text-splitters>=0.2.1"
+]
+```
+
+---
+
+## 📊 Example Experiment Workflow
+
+1. Define your retriever, embedding, and reranker setup  
+2. Launch optimization (Grid, Random, Bayesian) or AutoTune  
+3. Compare performance with explainability  
+4. Persist results to leaderboard for later inspection  
+
+---
+
+## 🧬 Architecture Overview
+
+```mermaid
+flowchart TD
+    A[Query] --> B[Chunking / Preprocessing]
+    B --> C[Embedder]
+    C --> D[Retriever]
+    D --> E[Reranker]
+    E --> F[Generator]
+    F --> G[Evaluation]
+    G --> H[AutoRAGTuner / Optuna]
+    H --> I[Suggested Configs & Chunk Sizes]
+    I --> J[Best Configuration]
+    J -->|Update Params| C
+
+```
+
+---
+
+## 📘 Example Output
+
+```
+[INFO] Starting Auto-RAG Tuning
+[INFO] Suggested retriever=Chroma, embedding_model=sentence-transformers/all-MiniLM-L6-v2
+[INFO] Suggested chunk-size candidates: [(380, 80), (420, 100), (350, 70), (400, 90), (360, 75)]
+[INFO] Running full evaluation on validation set with 5 trials
+[INFO] Trial 1 finished: faithfulness=0.82, latency=0.40s
+[INFO] Trial 2 finished: faithfulness=0.85, latency=0.44s
+...
+[INFO] Best configuration after testing: {'retriever': 'Chroma', 'embedding_model': 'sentence-transformers/all-MiniLM-L6-v2', 'chunk_size': 400, 'overlap': 90, 'strategy': 'sentence'}
+```
+---
+## 🧾 Citation
+If you use **Ragmint** in your research, please cite:
+```markdown
+@software{oliveira2025ragmint,
+  author = {André Oliveira},
+  title = {Ragmint: Retrieval-Augmented Generation Model Inspection & Tuning},
+  year = {2025},
+  url = {https://github.com/andyolivers/ragmint},
+  license = {Apache-2.0}
+}
+```
+
+---
+
+<p align="center">
+  <sub>Built with ❤️ by <a href="https://andyolivers.com">André Oliveira</a> | Apache 2.0 License</sub>
+</p>

ragmint-0.4.6.dist-info/RECORD

@@ -0,0 +1,48 @@
+ragmint/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+ragmint/__main__.py,sha256=q7hBn56Z1xAckbs03i8ynsuOzJVUXmod2qHddX7gkpc,729
+ragmint/app.py,sha256=BGOI8h5JR9sb_6-8iO0iia1eDArTQ3OPw1E7DAPKJnU,18540
+ragmint/autotuner.py,sha256=GMwhc9gwSj1NLxBAT8wSp-yJl0MHoNDx_0eIv6vARys,7681
+ragmint/explainer.py,sha256=lU8EJcmk2x5_XFpKFwDT9q3yqauG-MTNLdFfOfRa-Ms,3097
+ragmint/leaderboard.py,sha256=VvJvJUReHtwPV4xeS1o_sqpI2YYKe01aW4j3VpcrWOQ,1778
+ragmint/qa_generator.py,sha256=0u7o0YVsFh7ASkwI8n_P0piZtyd1BVqCCNA6h-ZvDmE,6301
+ragmint/tuner.py,sha256=DWEdh0JBKTRdU1p5HDAGNRJeUrjAprwkcWZvb8Ifx_4,7261
+ragmint/core/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+ragmint/core/chunking.py,sha256=cwxRUTs1u8Pe4xQso0G5doA_9AFCMyxB5Hxe8GJUoE4,2711
+ragmint/core/embeddings.py,sha256=WOd58_Z-xir66Q7tLAldfDO_x-wAieMKKXsMfhw7OF4,1875
+ragmint/core/evaluation.py,sha256=aDjEPcbeRWChMOLy6tSXflvry4swxhPOpHYZRed8iCA,1882
+ragmint/core/pipeline.py,sha256=xqLE-NiMDoC5NYCP0O984-eoyQOD4nnCsu6nq4DQEdI,2058
+ragmint/core/reranker.py,sha256=B2-NDExqpd9jdXHkEHOXC0B_6-FMJm5vdi-_ZbxC3Os,2303
+ragmint/core/retriever.py,sha256=bKaJr9vfGPEMAjLBfRhCpAH1bzlJgjDKx0r6ZRWfyuY,6010
+ragmint/experiments/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+ragmint/experiments/validation_qa.json,sha256=T1PNoYwrqgwDVLtfmj7L5e0Sq02OEbqHPC8RFhICuUU,2
+ragmint/integrations/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+ragmint/integrations/config_adapter.py,sha256=gE6M4abT1cREDd648XaKR3qS11Nz-ULdtNgx9uCrjl4,3405
+ragmint/integrations/langchain_prebuilder.py,sha256=B0_ht1f3cWZ5NStRLypIGs0G2eUDs1tEZPAXtwBvGVM,3495
+ragmint/optimization/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+ragmint/optimization/search.py,sha256=uiLJeoO_jaLCQEw99L6uI1rnqHHx_rTY81WxfMmlALs,1623
+ragmint/tests/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+ragmint/tests/conftest.py,sha256=QhYPp5nrQ_DbZlsVH3nLjDgjPATAnLwzJkwl-Y-xrmM,488
+ragmint/tests/test_autotuner.py,sha256=ECfBzQaRrdmvJrCogORGd9rFaUK7hFLcCaTX7RXueXU,2340
+ragmint/tests/test_config_adapter.py,sha256=GlLlvVLQb2jMKTrLQgqzPiTsYvTGZZ8XOxCM9fdZhJI,1358
+ragmint/tests/test_embeddings.py,sha256=KSqxdMy8e8Ekjh_JID5-Eb9gVDXDjOwZUIh36DoWBTw,1354
+ragmint/tests/test_explainer.py,sha256=eI9YOHdC1wRcm04ksBJ0tTJA3wd7JI3SvfJSvCitLHI,1289
+ragmint/tests/test_integration_autotuner_ragmint.py,sha256=_WQRl7rvd_4GXSiqp0Virz-3f5YqS8X550u0613RMlM,1678
+ragmint/tests/test_langchain_prebuilder.py,sha256=5jjitN3muReqbdaD01sNl1h5GH8tfNjpj1UEq3XD5fo,3240
+ragmint/tests/test_leaderboard.py,sha256=MiEJnu4eDC_qsDxPaR8bF2OuAMILCPS8ji7VvpzzTWg,2656
+ragmint/tests/test_pipeline.py,sha256=wj7dEuqz6vnoMc-V05j0DifWsXfmO5xGzD5i24V8aQI,667
+ragmint/tests/test_qa_generator.py,sha256=6Dx85g51CoSp8InJTd73PKNGOz_VInlEWmohyQLuT88,2278
+ragmint/tests/test_retriever.py,sha256=eMXtnH7T5Sgf439iCF0zg_DSNxly9cGJuLFzjaiuGIA,473
+ragmint/tests/test_search.py,sha256=FcC-DEnw9veAEyMnFoRw9DAwzqJC9F6-r63Nqo2nO58,598
+ragmint/tests/test_tuner.py,sha256=CylYlE7yC-wCCZo5P_tqFDtjfIiAz-LOW4ZmWDYT0Z8,2316
+ragmint/utils/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+ragmint/utils/caching.py,sha256=LPE2JorOQ90BgVf6NUiS0-bdt-FGpNxDy7FnuwEHzy0,1060
+ragmint/utils/data_loader.py,sha256=GXU9Nc3o0UWxtBeRwiskD1aCjSiNNuRoAokIUODn7q8,2024
+ragmint/utils/logger.py,sha256=X7hTNb3st3fUeQIzSghuoV5B8FWXzm_O3DRkSfJvhmI,1033
+ragmint/utils/metrics.py,sha256=DR8mrdumHtQerK0VrugwYKIG1oNptEcsFqodXq3i2kY,717
+ragmint-0.4.6.data/data/LICENSE,sha256=ahkhYfFLI8tGrdxdO2_GaT6OJW2eNwyFT3kYi85QQhc,692
+ragmint-0.4.6.data/data/README.md,sha256=LRfAA3TN-U_uDDko9rp7_OTeRsxoumhsS0yA2mRFQ9I,14543
+ragmint-0.4.6.dist-info/licenses/LICENSE,sha256=ahkhYfFLI8tGrdxdO2_GaT6OJW2eNwyFT3kYi85QQhc,692
+ragmint-0.4.6.dist-info/METADATA,sha256=AAvKBKQXDvSfBbwVD6LP_Ub3hN8ipJx2mZlp7mD02x0,16135
+ragmint-0.4.6.dist-info/WHEEL,sha256=_zCd3N1l69ArxyTb8rzEoP9TpbYXkqRFSNOD5OuxnTs,91
+ragmint-0.4.6.dist-info/top_level.txt,sha256=K2ulzMHuvFm6xayvvJdGABeRJAvKDBn6M3EI-3SbYLw,8
+ragmint-0.4.6.dist-info/RECORD,,

ragmint-0.4.6.dist-info/licenses/LICENSE

@@ -0,0 +1,19 @@
+Apache License
+Version 2.0, January 2004
+http://www.apache.org/licenses/
+
+TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
+
+Copyright 2025 André Oliveira
+
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+    http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.

ragmint/tests/test_explainer_integration.py

@@ -1,18 +0,0 @@
-import os
-import pytest
-from ragmint.explainer import explain_results
-
-
-@pytest.mark.integration
-def test_real_gemini_explanation():
-    """Run real Gemini call if GOOGLE_API_KEY is set."""
-    if not os.getenv("GEMINI_API_KEY"):
-        pytest.skip("GOOGLE_API_KEY not set")
-
-    config_a = {"retriever": "FAISS", "embedding_model": "OpenAI"}
-    config_b = {"retriever": "Chroma", "embedding_model": "SentenceTransformers"}
-
-    result = explain_results(config_a, config_b, model="gemini-1.5-pro")
-    assert isinstance(result, str)
-    assert len(result) > 0
-    print("\n[Gemini explanation]:", result[:200], "...")

ragmint-0.2.1.dist-info/METADATA

@@ -1,27 +0,0 @@
-Metadata-Version: 2.4
-Name: ragmint
-Version: 0.2.1
-Summary: A modular framework for evaluating and optimizing RAG pipelines.
-Author-email: Andre Oliveira <oandreoliveira@outlook.com>
-License: Apache License 2.0
-Project-URL: Homepage, https://github.com/andyolivers/ragmint
-Project-URL: Documentation, https://andyolivers.com
-Project-URL: Issues, https://github.com/andyolivers/ragmint/issues
-Keywords: RAG,LLM,retrieval,optimization,AI,evaluation
-Requires-Python: >=3.9
-Description-Content-Type: text/markdown
-License-File: LICENSE
-Requires-Dist: numpy>=1.23
-Requires-Dist: pandas>=2.0
-Requires-Dist: scikit-learn>=1.3
-Requires-Dist: openai>=1.0
-Requires-Dist: tqdm
-Requires-Dist: pyyaml
-Requires-Dist: chromadb>=0.4
-Requires-Dist: faiss-cpu; sys_platform != "darwin"
-Requires-Dist: optuna>=3.0
-Requires-Dist: pytest
-Requires-Dist: colorama
-Requires-Dist: google-generativeai>=0.8.0
-Requires-Dist: supabase>=2.4.0
-Dynamic: license-file

ragmint-0.2.1.dist-info/RECORD

@@ -1,38 +0,0 @@
-ragmint/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-ragmint/__main__.py,sha256=q7hBn56Z1xAckbs03i8ynsuOzJVUXmod2qHddX7gkpc,729
-ragmint/autotuner.py,sha256=eXEH4e_3Os9FPX9y_0N7GnIQsmoHxmFbtjj7xanu17g,1064
-ragmint/explainer.py,sha256=1glGNdC4GlwR6Qs8Bj1oOol7f5_db7Ksnh07HAp-A2c,2077
-ragmint/leaderboard.py,sha256=nILQ5QR63RpZtCrZ__RFfwHXy4bkUIMUcSfH92OQ93Y,1628
-ragmint/tuner.py,sha256=BLPZ66sVk3dh3Wj-GVUYRVmVtgXYTzv3oTQtKJeDlgE,4442
-ragmint/core/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-ragmint/core/chunking.py,sha256=Dy9RYyapGSS6ik6Vg9lqbUPCFqSraU1JKpHbYUTkaFo,576
-ragmint/core/embeddings.py,sha256=6wJjfZ5ukr8G5bJJ1evjIqj0_FMbs_gq4xC-sBBqNlA,566
-ragmint/core/evaluation.py,sha256=3OFcZU2zZyaP53d9S2zdpknV0CYfTq0KoRB3a_dtjM4,1022
-ragmint/core/pipeline.py,sha256=2qwGKuG0Du7gtIpieLFn71h_RcwBpjcV-h9PQz2ZOsc,1169
-ragmint/core/reranker.py,sha256=B2-NDExqpd9jdXHkEHOXC0B_6-FMJm5vdi-_ZbxC3Os,2303
-ragmint/core/retriever.py,sha256=jbpKy_fGdDq736y0es_utQuLqY9eiWNd71Q8JbU0Sko,1259
-ragmint/experiments/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-ragmint/experiments/validation_qa.json,sha256=mQyGeMyvyAqN5yGjpjqW42JJ7FfhFYNki__paKVhQss,520
-ragmint/optimization/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-ragmint/optimization/search.py,sha256=uiLJeoO_jaLCQEw99L6uI1rnqHHx_rTY81WxfMmlALs,1623
-ragmint/tests/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-ragmint/tests/conftest.py,sha256=QhYPp5nrQ_DbZlsVH3nLjDgjPATAnLwzJkwl-Y-xrmM,488
-ragmint/tests/test_autotuner.py,sha256=k5nsIH6MYB5zaocR_Wn1wTX-QDYfhH6ugx2chZu9Q8U,1500
-ragmint/tests/test_explainer.py,sha256=K_DRnGGl34WcTA2yaQGmfzWkVi1uEkzjpsTPeZxXeIg,802
-ragmint/tests/test_explainer_integration.py,sha256=tYT62fYqk616bjQ1VxHADVRfJ9vdF_CiF3cz4A9BdbE,620
-ragmint/tests/test_integration_autotuner_ragmint.py,sha256=YCGge0_KOijAdB7VNDGHl2VRJjiOyl_-sJNRLjAXGLw,2182
-ragmint/tests/test_leaderboard.py,sha256=ay81YK6KxAUU6mcG6n1_xV8GPYkBgjzJj9iAIyAzIzA,1163
-ragmint/tests/test_pipeline.py,sha256=MIMkEKelh-POlbXzbCc4ClMk8XCGzfuj569xXltziic,615
-ragmint/tests/test_retriever.py,sha256=Ag0uGW8-iMzKA4nJNnsjuzlQHa79sN-T-K1g1cdin-A,421
-ragmint/tests/test_search.py,sha256=FcC-DEnw9veAEyMnFoRw9DAwzqJC9F6-r63Nqo2nO58,598
-ragmint/tests/test_tuner.py,sha256=LOvtIxAbUsoRHQudZ23UVr60FYAU0a1SBNvAN0mLpfU,2322
-ragmint/utils/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-ragmint/utils/caching.py,sha256=LPE2JorOQ90BgVf6NUiS0-bdt-FGpNxDy7FnuwEHzy0,1060
-ragmint/utils/data_loader.py,sha256=GXU9Nc3o0UWxtBeRwiskD1aCjSiNNuRoAokIUODn7q8,2024
-ragmint/utils/logger.py,sha256=X7hTNb3st3fUeQIzSghuoV5B8FWXzm_O3DRkSfJvhmI,1033
-ragmint/utils/metrics.py,sha256=DR8mrdumHtQerK0VrugwYKIG1oNptEcsFqodXq3i2kY,717
-ragmint-0.2.1.dist-info/licenses/LICENSE,sha256=ahkhYfFLI8tGrdxdO2_GaT6OJW2eNwyFT3kYi85QQhc,692
-ragmint-0.2.1.dist-info/METADATA,sha256=sR31_9qGCaarWLNqTc2uNjO4aklKq9nxaGEjtcy5ipU,936
-ragmint-0.2.1.dist-info/WHEEL,sha256=_zCd3N1l69ArxyTb8rzEoP9TpbYXkqRFSNOD5OuxnTs,91
-ragmint-0.2.1.dist-info/top_level.txt,sha256=K2ulzMHuvFm6xayvvJdGABeRJAvKDBn6M3EI-3SbYLw,8
-ragmint-0.2.1.dist-info/RECORD,,