rag-eval-kit-avan 0.1.0__tar.gz

rag_eval_kit_avan-0.1.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Avan Kumar J
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

rag_eval_kit_avan-0.1.0/PKG-INFO

@@ -0,0 +1,61 @@
+Metadata-Version: 2.4
+Name: rag-eval-kit-avan
+Version: 0.1.0
+Summary: A lightweight Python wrapper for evaluating RAG pipelines using Ragas.
+Author-email: Avan Kumar J <avankumar2025@gmail.com>
+License: MIT
+Project-URL: Homepage, https://github.com/avankumar2001/eval-rag-system
+Project-URL: Repository, https://github.com/avankumar2001/eval-rag-system
+Keywords: rag,llm,evaluation,ragas,langchain
+Requires-Python: >=3.9
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: ragas
+Requires-Dist: datasets
+Requires-Dist: langchain
+Dynamic: license-file
+
+# rag-eval-kit-avan
+
+A lightweight Python wrapper for evaluating RAG (Retrieval-Augmented Generation) pipelines using [Ragas](https://github.com/explodinggradients/ragas).
+
+If you've built a RAG system with LangChain, LlamaIndex, or plain Python, you know that "it works" is not enough. You need to measure **Faithfulness**, **Answer Relevancy**, **Context Precision**, and **Context Recall**. This package wraps those Ragas metrics into a single function call.
+
+## Installation
+
+```bash
+pip install rag-eval-kit-avan
+```
+
+## Usage
+
+```python
+from rag_eval_kit import evaluate_rag
+
+questions = ["What is RAG?", "What is a vector database?"]
+answers = [
+    "RAG stands for Retrieval-Augmented Generation.",
+    "A vector database stores embeddings for similarity search.",
+]
+contexts = [
+    ["RAG is a technique that combines retrieval with generation..."],
+    ["Vector databases like FAISS and ChromaDB store high-dimensional vectors..."],
+]
+ground_truths = [
+    "RAG stands for Retrieval-Augmented Generation.",
+    "A vector database stores embeddings and supports similarity search.",
+]
+
+results = evaluate_rag(questions, answers, contexts, ground_truths)
+print(results)
+```
+
+## Why This Exists
+
+Most RAG tutorials stop at "here's how to build a chain." Nobody tells you how to **prove** your RAG pipeline is actually working. This package makes it a one-liner.
+
+Built as part of an [Eval-First RAG System](https://eval-rag-system.streamlit.app) project.
+
+## License
+
+MIT

rag_eval_kit_avan-0.1.0/README.md

@@ -0,0 +1,44 @@
+# rag-eval-kit-avan
+
+A lightweight Python wrapper for evaluating RAG (Retrieval-Augmented Generation) pipelines using [Ragas](https://github.com/explodinggradients/ragas).
+
+If you've built a RAG system with LangChain, LlamaIndex, or plain Python, you know that "it works" is not enough. You need to measure **Faithfulness**, **Answer Relevancy**, **Context Precision**, and **Context Recall**. This package wraps those Ragas metrics into a single function call.
+
+## Installation
+
+```bash
+pip install rag-eval-kit-avan
+```
+
+## Usage
+
+```python
+from rag_eval_kit import evaluate_rag
+
+questions = ["What is RAG?", "What is a vector database?"]
+answers = [
+    "RAG stands for Retrieval-Augmented Generation.",
+    "A vector database stores embeddings for similarity search.",
+]
+contexts = [
+    ["RAG is a technique that combines retrieval with generation..."],
+    ["Vector databases like FAISS and ChromaDB store high-dimensional vectors..."],
+]
+ground_truths = [
+    "RAG stands for Retrieval-Augmented Generation.",
+    "A vector database stores embeddings and supports similarity search.",
+]
+
+results = evaluate_rag(questions, answers, contexts, ground_truths)
+print(results)
+```
+
+## Why This Exists
+
+Most RAG tutorials stop at "here's how to build a chain." Nobody tells you how to **prove** your RAG pipeline is actually working. This package makes it a one-liner.
+
+Built as part of an [Eval-First RAG System](https://eval-rag-system.streamlit.app) project.
+
+## License
+
+MIT

rag_eval_kit_avan-0.1.0/pyproject.toml

@@ -0,0 +1,24 @@
+[build-system]
+requires = ["setuptools>=61.0"]
+build-backend = "setuptools.build_meta"
+
+[project]
+name = "rag-eval-kit-avan"
+version = "0.1.0"
+description = "A lightweight Python wrapper for evaluating RAG pipelines using Ragas."
+readme = "README.md"
+requires-python = ">=3.9"
+license = {text = "MIT"}
+authors = [
+    {name = "Avan Kumar J", email = "avankumar2025@gmail.com"}
+]
+keywords = ["rag", "llm", "evaluation", "ragas", "langchain"]
+dependencies = [
+    "ragas",
+    "datasets",
+    "langchain",
+]
+
+[project.urls]
+Homepage = "https://github.com/avankumar2001/eval-rag-system"
+Repository = "https://github.com/avankumar2001/eval-rag-system"

rag_eval_kit_avan-0.1.0/rag_eval_kit/__init__.py

@@ -0,0 +1,4 @@
+from .evaluator import evaluate_rag
+
+__version__ = "0.1.0"
+__all__ = ["evaluate_rag"]

rag_eval_kit_avan-0.1.0/rag_eval_kit/evaluator.py

@@ -0,0 +1,32 @@
+from ragas import evaluate
+from ragas.metrics import faithfulness, answer_relevancy, context_precision, context_recall
+from datasets import Dataset
+
+
+def evaluate_rag(questions, answers, contexts, ground_truths):
+    """
+    Evaluate a RAG pipeline using Ragas.
+
+    Args:
+        questions (list): List of question strings.
+        answers (list): List of answer strings generated by your RAG pipeline.
+        contexts (list): List of lists of retrieved context strings.
+        ground_truths (list): List of ground truth answer strings.
+
+    Returns:
+        dict: A dictionary with Faithfulness, Answer Relevancy,
+              Context Precision, and Context Recall scores.
+    """
+    data = {
+        "question": questions,
+        "answer": answers,
+        "contexts": contexts,
+        "ground_truth": ground_truths,
+    }
+    dataset = Dataset.from_dict(data)
+
+    result = evaluate(
+        dataset=dataset,
+        metrics=[faithfulness, answer_relevancy, context_precision, context_recall],
+    )
+    return result

rag_eval_kit_avan-0.1.0/rag_eval_kit_avan.egg-info/PKG-INFO

@@ -0,0 +1,61 @@
+Metadata-Version: 2.4
+Name: rag-eval-kit-avan
+Version: 0.1.0
+Summary: A lightweight Python wrapper for evaluating RAG pipelines using Ragas.
+Author-email: Avan Kumar J <avankumar2025@gmail.com>
+License: MIT
+Project-URL: Homepage, https://github.com/avankumar2001/eval-rag-system
+Project-URL: Repository, https://github.com/avankumar2001/eval-rag-system
+Keywords: rag,llm,evaluation,ragas,langchain
+Requires-Python: >=3.9
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: ragas
+Requires-Dist: datasets
+Requires-Dist: langchain
+Dynamic: license-file
+
+# rag-eval-kit-avan
+
+A lightweight Python wrapper for evaluating RAG (Retrieval-Augmented Generation) pipelines using [Ragas](https://github.com/explodinggradients/ragas).
+
+If you've built a RAG system with LangChain, LlamaIndex, or plain Python, you know that "it works" is not enough. You need to measure **Faithfulness**, **Answer Relevancy**, **Context Precision**, and **Context Recall**. This package wraps those Ragas metrics into a single function call.
+
+## Installation
+
+```bash
+pip install rag-eval-kit-avan
+```
+
+## Usage
+
+```python
+from rag_eval_kit import evaluate_rag
+
+questions = ["What is RAG?", "What is a vector database?"]
+answers = [
+    "RAG stands for Retrieval-Augmented Generation.",
+    "A vector database stores embeddings for similarity search.",
+]
+contexts = [
+    ["RAG is a technique that combines retrieval with generation..."],
+    ["Vector databases like FAISS and ChromaDB store high-dimensional vectors..."],
+]
+ground_truths = [
+    "RAG stands for Retrieval-Augmented Generation.",
+    "A vector database stores embeddings and supports similarity search.",
+]
+
+results = evaluate_rag(questions, answers, contexts, ground_truths)
+print(results)
+```
+
+## Why This Exists
+
+Most RAG tutorials stop at "here's how to build a chain." Nobody tells you how to **prove** your RAG pipeline is actually working. This package makes it a one-liner.
+
+Built as part of an [Eval-First RAG System](https://eval-rag-system.streamlit.app) project.
+
+## License
+
+MIT

rag_eval_kit_avan-0.1.0/rag_eval_kit_avan.egg-info/SOURCES.txt

@@ -0,0 +1,10 @@
+LICENSE
+README.md
+pyproject.toml
+rag_eval_kit/__init__.py
+rag_eval_kit/evaluator.py
+rag_eval_kit_avan.egg-info/PKG-INFO
+rag_eval_kit_avan.egg-info/SOURCES.txt
+rag_eval_kit_avan.egg-info/dependency_links.txt
+rag_eval_kit_avan.egg-info/requires.txt
+rag_eval_kit_avan.egg-info/top_level.txt

rag_eval_kit_avan-0.1.0/rag_eval_kit_avan.egg-info/dependency_links.txt

@@ -0,0 +1 @@
+

rag_eval_kit_avan-0.1.0/rag_eval_kit_avan.egg-info/requires.txt

@@ -0,0 +1,3 @@
+ragas
+datasets
+langchain

rag_eval_kit_avan-0.1.0/rag_eval_kit_avan.egg-info/top_level.txt

@@ -0,0 +1 @@
+rag_eval_kit

rag_eval_kit_avan-0.1.0/setup.cfg

@@ -0,0 +1,4 @@
+[egg_info]
+tag_build = 
+tag_date = 0
+