ragaai-catalyst 2.1.3__py3-none-any.whl → 2.1.4__py3-none-any.whl

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (27) hide show
  1. ragaai_catalyst/tracers/agentic_tracing/data/data_structure.py +37 -11
  2. ragaai_catalyst/tracers/agentic_tracing/tracers/agent_tracer.py +240 -81
  3. ragaai_catalyst/tracers/agentic_tracing/tracers/base.py +632 -114
  4. ragaai_catalyst/tracers/agentic_tracing/tracers/custom_tracer.py +316 -0
  5. ragaai_catalyst/tracers/agentic_tracing/tracers/langgraph_tracer.py +0 -0
  6. ragaai_catalyst/tracers/agentic_tracing/tracers/llm_tracer.py +229 -82
  7. ragaai_catalyst/tracers/agentic_tracing/tracers/main_tracer.py +214 -59
  8. ragaai_catalyst/tracers/agentic_tracing/tracers/network_tracer.py +16 -14
  9. ragaai_catalyst/tracers/agentic_tracing/tracers/tool_tracer.py +147 -28
  10. ragaai_catalyst/tracers/agentic_tracing/tracers/user_interaction_tracer.py +88 -2
  11. ragaai_catalyst/tracers/agentic_tracing/upload/upload_agentic_traces.py +9 -51
  12. ragaai_catalyst/tracers/agentic_tracing/upload/upload_trace_metric.py +83 -0
  13. ragaai_catalyst/tracers/agentic_tracing/utils/create_dataset_schema.py +26 -0
  14. ragaai_catalyst/tracers/agentic_tracing/utils/get_user_trace_metrics.py +28 -0
  15. ragaai_catalyst/tracers/agentic_tracing/utils/llm_utils.py +45 -15
  16. ragaai_catalyst/tracers/agentic_tracing/utils/model_costs.json +2520 -2152
  17. ragaai_catalyst/tracers/agentic_tracing/utils/span_attributes.py +59 -0
  18. ragaai_catalyst/tracers/agentic_tracing/utils/trace_utils.py +23 -0
  19. ragaai_catalyst/tracers/agentic_tracing/utils/zip_list_of_unique_files.py +284 -15
  20. ragaai_catalyst/tracers/llamaindex_callback.py +5 -5
  21. ragaai_catalyst/tracers/tracer.py +83 -10
  22. ragaai_catalyst/tracers/upload_traces.py +1 -1
  23. ragaai_catalyst-2.1.4.dist-info/METADATA +431 -0
  24. {ragaai_catalyst-2.1.3.dist-info → ragaai_catalyst-2.1.4.dist-info}/RECORD +26 -20
  25. ragaai_catalyst-2.1.3.dist-info/METADATA +0 -43
  26. {ragaai_catalyst-2.1.3.dist-info → ragaai_catalyst-2.1.4.dist-info}/WHEEL +0 -0
  27. {ragaai_catalyst-2.1.3.dist-info → ragaai_catalyst-2.1.4.dist-info}/top_level.txt +0 -0
@@ -0,0 +1,431 @@
1
+ Metadata-Version: 2.2
2
+ Name: ragaai_catalyst
3
+ Version: 2.1.4
4
+ Summary: RAGA AI CATALYST
5
+ Author-email: Kiran Scaria <kiran.scaria@raga.ai>, Kedar Gaikwad <kedar.gaikwad@raga.ai>, Dushyant Mahajan <dushyant.mahajan@raga.ai>, Siddhartha Kosti <siddhartha.kosti@raga.ai>, Ritika Goel <ritika.goel@raga.ai>, Vijay Chaurasia <vijay.chaurasia@raga.ai>
6
+ Requires-Python: <3.13,>=3.9
7
+ Description-Content-Type: text/markdown
8
+ Requires-Dist: aiohttp>=3.10.2
9
+ Requires-Dist: opentelemetry-api==1.25.0
10
+ Requires-Dist: opentelemetry-sdk==1.25.0
11
+ Requires-Dist: opentelemetry-exporter-otlp-proto-grpc==1.25.0
12
+ Requires-Dist: opentelemetry-instrumentation==0.46b0
13
+ Requires-Dist: opentelemetry-instrumentation-fastapi==0.46b0
14
+ Requires-Dist: opentelemetry-instrumentation-asgi==0.46b0
15
+ Requires-Dist: opentelemetry-semantic-conventions==0.46b0
16
+ Requires-Dist: opentelemetry-util-http==0.46b0
17
+ Requires-Dist: opentelemetry-instrumentation-langchain~=0.24.0
18
+ Requires-Dist: opentelemetry-instrumentation-openai~=0.24.0
19
+ Requires-Dist: langchain-core>=0.2.11
20
+ Requires-Dist: langchain>=0.2.11
21
+ Requires-Dist: openai>=1.57.0
22
+ Requires-Dist: pandas
23
+ Requires-Dist: groq>=0.11.0
24
+ Requires-Dist: PyPDF2>=3.0.1
25
+ Requires-Dist: google-generativeai>=0.8.2
26
+ Requires-Dist: Markdown>=3.7
27
+ Requires-Dist: litellm==1.51.1
28
+ Requires-Dist: tenacity==8.3.0
29
+ Requires-Dist: tqdm>=4.66.5
30
+ Requires-Dist: llama-index<0.11.0,>=0.10.0
31
+ Requires-Dist: pyopenssl>=24.2.1
32
+ Requires-Dist: psutil~=6.0.0
33
+ Requires-Dist: py-cpuinfo~=9.0.0
34
+ Requires-Dist: requests~=2.32.3
35
+ Requires-Dist: GPUtil~=1.4.0
36
+ Requires-Dist: astor>=0.8.1
37
+ Requires-Dist: ipynbname
38
+ Provides-Extra: dev
39
+ Requires-Dist: pytest; extra == "dev"
40
+ Requires-Dist: pytest-cov; extra == "dev"
41
+ Requires-Dist: black; extra == "dev"
42
+ Requires-Dist: isort; extra == "dev"
43
+ Requires-Dist: mypy; extra == "dev"
44
+ Requires-Dist: flake8; extra == "dev"
45
+
46
+ # RagaAI Catalyst&nbsp; ![GitHub release (latest by date)](https://img.shields.io/github/v/release/raga-ai-hub/ragaai-catalyst) ![GitHub stars](https://img.shields.io/github/stars/raga-ai-hub/ragaai-catalyst?style=social) ![Issues](https://img.shields.io/github/issues/raga-ai-hub/ragaai-catalyst)
47
+
48
+ RagaAI Catalyst is a comprehensive platform designed to enhance the management and optimization of LLM projects. It offers a wide range of features, including project management, dataset management, evaluation management, trace management, prompt management, synthetic data generation, and guardrail management. These functionalities enable you to efficiently evaluate, and safeguard your LLM applications.
49
+
50
+ ## Table of Contents
51
+
52
+ - [RagaAI Catalyst](#ragaai-catalyst)
53
+ - [Table of Contents](#table-of-contents)
54
+ - [Installation](#installation)
55
+ - [Configuration](#configuration)
56
+ - [Usage](#usage)
57
+ - [Project Management](#project-management)
58
+ - [Dataset Management](#dataset-management)
59
+ - [Evaluation Management](#evaluation)
60
+ - [Trace Management](#trace-management)
61
+ - [Prompt Management](#prompt-management)
62
+ - [Synthetic Data Generation](#synthetic-data-generation)
63
+ - [Guardrail Management](#guardrail-management)
64
+ - [Agentic Tracing](#agentic-tracing)
65
+
66
+ ## Installation
67
+
68
+ To install RagaAI Catalyst, you can use pip:
69
+
70
+ ```bash
71
+ pip install ragaai-catalyst
72
+ ```
73
+
74
+ ## Configuration
75
+
76
+ Before using RagaAI Catalyst, you need to set up your credentials. You can do this by setting environment variables or passing them directly to the `RagaAICatalyst` class:
77
+
78
+ ```python
79
+ from ragaai_catalyst import RagaAICatalyst
80
+
81
+ catalyst = RagaAICatalyst(
82
+ access_key="YOUR_ACCESS_KEY",
83
+ secret_key="YOUR_SECRET_KEY",
84
+ base_url="BASE_URL"
85
+ )
86
+ ```
87
+ **Note**: Authetication to RagaAICatalyst is necessary to perform any operations below
88
+
89
+
90
+ ## Usage
91
+
92
+ ### Project Management
93
+
94
+ Create and manage projects using RagaAI Catalyst:
95
+
96
+ ```python
97
+ # Create a project
98
+ project = catalyst.create_project(
99
+ project_name="Test-RAG-App-1",
100
+ usecase="Chatbot"
101
+ )
102
+
103
+ # Get project usecases
104
+ catalyst.project_use_cases()
105
+
106
+ # List projects
107
+ projects = catalyst.list_projects()
108
+ print(projects)
109
+ ```
110
+
111
+ ### Dataset Management
112
+ Manage datasets efficiently for your projects:
113
+
114
+ ```py
115
+ from ragaai_catalyst import Dataset
116
+
117
+ # Initialize Dataset management for a specific project
118
+ dataset_manager = Dataset(project_name="project_name")
119
+
120
+ # List existing datasets
121
+ datasets = dataset_manager.list_datasets()
122
+ print("Existing Datasets:", datasets)
123
+
124
+ # Create a dataset from CSV
125
+ dataset_manager.create_from_csv(
126
+ csv_path='path/to/your.csv',
127
+ dataset_name='MyDataset',
128
+ schema_mapping={'column1': 'schema_element1', 'column2': 'schema_element2'}
129
+ )
130
+
131
+ # Get project schema mapping
132
+ dataset_manager.get_schema_mapping()
133
+
134
+ ```
135
+
136
+ For more detailed information on Dataset Management, including CSV schema handling and advanced usage, please refer to the [Dataset Management documentation](docs/dataset_management.md).
137
+
138
+
139
+ ### Evaluation
140
+
141
+ Create and manage metric evaluation of your RAG application:
142
+
143
+ ```python
144
+ from ragaai_catalyst import Evaluation
145
+
146
+ # Create an experiment
147
+ evaluation = Evaluation(
148
+ project_name="Test-RAG-App-1",
149
+ dataset_name="MyDataset",
150
+ )
151
+
152
+ # Get list of available metrics
153
+ evaluation.list_metrics()
154
+
155
+ # Add metrics to the experiment
156
+
157
+ schema_mapping={
158
+ 'Query': 'prompt',
159
+ 'response': 'response',
160
+ 'Context': 'context',
161
+ 'expectedResponse': 'expected_response'
162
+ }
163
+
164
+ # Add single metric
165
+ evaluation.add_metrics(
166
+ metrics=[
167
+ {"name": "Faithfulness", "config": {"model": "gpt-4o-mini", "provider": "openai", "threshold": {"gte": 0.232323}}, "column_name": "Faithfulness_v1", "schema_mapping": schema_mapping},
168
+
169
+ ]
170
+ )
171
+
172
+ # Add multiple metrics
173
+ evaluation.add_metrics(
174
+ metrics=[
175
+ {"name": "Faithfulness", "config": {"model": "gpt-4o-mini", "provider": "openai", "threshold": {"gte": 0.323}}, "column_name": "Faithfulness_gte", "schema_mapping": schema_mapping},
176
+ {"name": "Hallucination", "config": {"model": "gpt-4o-mini", "provider": "openai", "threshold": {"lte": 0.323}}, "column_name": "Hallucination_lte", "schema_mapping": schema_mapping},
177
+ {"name": "Hallucination", "config": {"model": "gpt-4o-mini", "provider": "openai", "threshold": {"eq": 0.323}}, "column_name": "Hallucination_eq", "schema_mapping": schema_mapping},
178
+ ]
179
+ )
180
+
181
+ # Get the status of the experiment
182
+ status = evaluation.get_status()
183
+ print("Experiment Status:", status)
184
+
185
+ # Get the results of the experiment
186
+ results = evaluation.get_results()
187
+ print("Experiment Results:", results)
188
+ ```
189
+
190
+
191
+
192
+ ### Trace Management
193
+
194
+ Record and analyze traces of your RAG application:
195
+
196
+ ```python
197
+ from ragaai_catalyst import Tracer
198
+
199
+ # Start a trace recording
200
+ tracer = Tracer(
201
+ project_name="Test-RAG-App-1",
202
+ dataset_name="tracer_dataset_name",
203
+ metadata={"key1": "value1", "key2": "value2"},
204
+ tracer_type="langchain",
205
+ pipeline={
206
+ "llm_model": "gpt-4o-mini",
207
+ "vector_store": "faiss",
208
+ "embed_model": "text-embedding-ada-002",
209
+ }
210
+ ).start()
211
+
212
+ # Your code here
213
+
214
+
215
+ # Stop the trace recording
216
+ tracer.stop()
217
+
218
+ # Get upload status
219
+ tracer.get_upload_status()
220
+ ```
221
+
222
+
223
+ ### Prompt Management
224
+
225
+ Manage and use prompts efficiently in your projects:
226
+
227
+ ```py
228
+ from ragaai_catalyst import PromptManager
229
+
230
+ # Initialize PromptManager
231
+ prompt_manager = PromptManager(project_name="Test-RAG-App-1")
232
+
233
+ # List available prompts
234
+ prompts = prompt_manager.list_prompts()
235
+ print("Available prompts:", prompts)
236
+
237
+ # Get default prompt by prompt_name
238
+ prompt_name = "your_prompt_name"
239
+ prompt = prompt_manager.get_prompt(prompt_name)
240
+
241
+ # Get specific version of prompt by prompt_name and version
242
+ prompt_name = "your_prompt_name"
243
+ version = "v1"
244
+ prompt = prompt_manager.get_prompt(prompt_name,version)
245
+
246
+ # Get variables in a prompt
247
+ variable = prompt.get_variables()
248
+ print("variable:",variable)
249
+
250
+ # Get prompt content
251
+ prompt_content = prompt.get_prompt_content()
252
+ print("prompt_content:", prompt_content)
253
+
254
+ # Compile the prompt with variables
255
+ compiled_prompt = prompt.compile(query="What's the weather?", context="sunny", llm_response="It's sunny today")
256
+ print("Compiled prompt:", compiled_prompt)
257
+
258
+ # implement compiled_prompt with openai
259
+ import openai
260
+ def get_openai_response(prompt):
261
+ client = openai.OpenAI()
262
+ response = client.chat.completions.create(
263
+ model="gpt-4o-mini",
264
+ messages=prompt
265
+ )
266
+ return response.choices[0].message.content
267
+ openai_response = get_openai_response(compiled_prompt)
268
+ print("openai_response:", openai_response)
269
+
270
+ # implement compiled_prompt with litellm
271
+ import litellm
272
+ def get_litellm_response(prompt):
273
+ response = litellm.completion(
274
+ model="gpt-4o-mini",
275
+ messages=prompt
276
+ )
277
+ return response.choices[0].message.content
278
+ litellm_response = get_litellm_response(compiled_prompt)
279
+ print("litellm_response:", litellm_response)
280
+
281
+ ```
282
+ For more detailed information on Prompt Management, please refer to the [Prompt Management documentation](docs/prompt_management.md).
283
+
284
+
285
+ ### Synthetic Data Generation
286
+
287
+ ```py
288
+ from ragaai_catalyst import SyntheticDataGeneration
289
+
290
+ # Initialize Synthetic Data Generation
291
+ sdg = SyntheticDataGeneration()
292
+
293
+ # Process your file
294
+ text = sdg.process_document(input_data="file_path")
295
+
296
+ # Generate results
297
+ result = sdg.generate_qna(text, question_type ='complex',model_config={"provider":"openai","model":"openai/gpt-3.5-turbo"},n=5)
298
+
299
+ print(result.head())
300
+
301
+ # Get supported Q&A types
302
+ sdg.get_supported_qna()
303
+
304
+ # Get supported providers
305
+ sdg.get_supported_providers()
306
+ ```
307
+
308
+
309
+
310
+ ### Guardrail Management
311
+
312
+ ```py
313
+ from ragaai_catalyst import GuardrailsManager
314
+
315
+ # Initialize Guardrails Manager
316
+ gdm = GuardrailsManager(project_name=project_name)
317
+
318
+ # Get list of Guardrails available
319
+ guardrails_list = gdm.list_guardrails()
320
+ print('guardrails_list:', guardrails_list)
321
+
322
+ # Get list of fail condition for guardrails
323
+ fail_conditions = gdm.list_fail_condition()
324
+ print('fail_conditions;', fail_conditions)
325
+
326
+ #Get list of deployment ids
327
+ deployment_list = gdm.list_deployment_ids()
328
+ print('deployment_list:', deployment_list)
329
+
330
+ # Get specific deployment id with guardrails information
331
+ deployment_id_detail = gdm.get_deployment(17)
332
+ print('deployment_id_detail:', deployment_id_detail)
333
+
334
+ # Add guardrails to a deployment id
335
+ guardrails_config = {"guardrailFailConditions": ["FAIL"],
336
+ "deploymentFailCondition": "ALL_FAIL",
337
+ "alternateResponse": "Your alternate response"}
338
+
339
+ guardrails = [
340
+ {
341
+ "displayName": "Response_Evaluator",
342
+ "name": "Response Evaluator",
343
+ "config":{
344
+ "mappings": [{
345
+ "schemaName": "Text",
346
+ "variableName": "Response"
347
+ }],
348
+ "params": {
349
+ "isActive": {"value": False},
350
+ "isHighRisk": {"value": True},
351
+ "threshold": {"eq": 0},
352
+ "competitors": {"value": ["Google","Amazon"]}
353
+ }
354
+ }
355
+ },
356
+ {
357
+ "displayName": "Regex_Check",
358
+ "name": "Regex Check",
359
+ "config":{
360
+ "mappings": [{
361
+ "schemaName": "Text",
362
+ "variableName": "Response"
363
+ }],
364
+ "params":{
365
+ "isActive": {"value": False},
366
+ "isHighRisk": {"value": True},
367
+ "threshold": {"lt1": 1}
368
+ }
369
+ }
370
+ }
371
+ ]
372
+
373
+ gdm.add_guardrails(deployment_id, guardrails, guardrails_config)
374
+
375
+
376
+ # Import GuardExecutor
377
+ from ragaai_catalyst import GuardExecutor
378
+
379
+ # Initialise GuardExecutor with required params and Evaluate
380
+ executor = GuardExecutor(deployment_id,gdm,field_map={'context':'document'})
381
+
382
+
383
+ message={'role':'user',
384
+ 'content':'What is the capital of France'
385
+ }
386
+ prompt_params={'document':' France'}
387
+
388
+ model_params = {'temperature':.7,'model':'gpt-4o-mini'}
389
+ llm_caller = 'litellm'
390
+
391
+ executor([message],prompt_params,model_params,llm_caller)
392
+
393
+ ```
394
+
395
+ ### Agentic Tracing
396
+
397
+ The Agentic Tracing module provides comprehensive monitoring and analysis capabilities for AI agent systems. It helps track various aspects of agent behavior including:
398
+
399
+ - LLM interactions and token usage
400
+ - Tool utilization and execution patterns
401
+ - Network activities and API calls
402
+ - User interactions and feedback
403
+ - Agent decision-making processes
404
+
405
+ The module includes utilities for cost tracking, performance monitoring, and debugging agent behavior. This helps in understanding and optimizing AI agent performance while maintaining transparency in agent operations.
406
+
407
+ ```python
408
+ from ragaai_catalyst import AgenticTracer
409
+
410
+ # Initialize tracer
411
+ tracer = AgenticTracer(
412
+ project_name="project_name",
413
+ dataset_name="dataset_name",
414
+ tracer_type="agentic",
415
+ )
416
+
417
+ # Define tracers
418
+ @tracer.trace_agents("agent_name")
419
+ # Agent Definition
420
+
421
+ @tracer.trace_llm("llm_name")
422
+ # LLM Definition
423
+
424
+ @tracer.trace_tool("tool_name")
425
+ # Tool Definition
426
+
427
+ # Perform tracing
428
+ with tracer:
429
+ # Agent execution code
430
+ pass
431
+
@@ -12,13 +12,13 @@ ragaai_catalyst/ragaai_catalyst.py,sha256=FdqMzwuQLqS2-3JJDsTQ8uh2itllOxfPrRUjb8
12
12
  ragaai_catalyst/synthetic_data_generation.py,sha256=uDV9tNwto2xSkWg5XHXUvjErW-4P34CTrxaJpRfezyA,19250
13
13
  ragaai_catalyst/utils.py,sha256=TlhEFwLyRU690HvANbyoRycR3nQ67lxVUQoUOfTPYQ0,3772
14
14
  ragaai_catalyst/tracers/__init__.py,sha256=yxepo7iVjTNI_wFdk3Z6Ghu64SazVyszCPEHYrX5WQk,50
15
- ragaai_catalyst/tracers/llamaindex_callback.py,sha256=vPE7MieKjfwLrLUnnPs20Df0xNYqoCCj-Mt2NbiuiKU,14023
16
- ragaai_catalyst/tracers/tracer.py,sha256=NgJrhC-nEbSYeFHYvWtzg73V1XokWVVoTs5z1n-xQUs,12716
17
- ragaai_catalyst/tracers/upload_traces.py,sha256=hs0PEmit3n3_uUqrdbwcBdyK5Nbkik3JQVwJMEwYTd4,4796
15
+ ragaai_catalyst/tracers/llamaindex_callback.py,sha256=ZY0BJrrlz-P9Mg2dX-ZkVKG3gSvzwqBtk7JL_05MiYA,14028
16
+ ragaai_catalyst/tracers/tracer.py,sha256=UX-01NYWcH2y4UW1W287Cn-jy760rgaFqu8llJbeMdg,15654
17
+ ragaai_catalyst/tracers/upload_traces.py,sha256=mT5rverNUL5Rcal9VR5_c75wHBAUrm2pvYetTZqP3ok,4796
18
18
  ragaai_catalyst/tracers/agentic_tracing/README.md,sha256=X4QwLb7-Jg7GQMIXj-SerZIgDETfw-7VgYlczOR8ZeQ,4508
19
19
  ragaai_catalyst/tracers/agentic_tracing/__init__.py,sha256=yf6SKvOPSpH-9LiKaoLKXwqj5sez8F_5wkOb91yp0oE,260
20
20
  ragaai_catalyst/tracers/agentic_tracing/data/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
21
- ragaai_catalyst/tracers/agentic_tracing/data/data_structure.py,sha256=SYRDLROjdS8FR1J_1o2h5Ydv92kcnDs_powrgFaMjaY,8235
21
+ ragaai_catalyst/tracers/agentic_tracing/data/data_structure.py,sha256=nFnwqL1-Uznwndi2ugDnhziUbIASlcBYnM6Dyq7pPt8,9243
22
22
  ragaai_catalyst/tracers/agentic_tracing/tests/FinancialAnalysisSystem.ipynb,sha256=0qZxjWqYCTAVvdo3Tsp544D8Am48wfeMQ9RKpKgAL8g,34291
23
23
  ragaai_catalyst/tracers/agentic_tracing/tests/GameActivityEventPlanner.ipynb,sha256=QCMFJYbGX0fd9eMW4PqyQLZjyWuTXo7n1nqO_hMLf0s,4225
24
24
  ragaai_catalyst/tracers/agentic_tracing/tests/TravelPlanner.ipynb,sha256=fU3inXoemJbdTkGAQl_N1UwVEZ10LrKv4gCEpbQ4ISg,43481
@@ -26,25 +26,31 @@ ragaai_catalyst/tracers/agentic_tracing/tests/__init__.py,sha256=47DEQpj8HBSa-_T
26
26
  ragaai_catalyst/tracers/agentic_tracing/tests/ai_travel_agent.py,sha256=S4rCcKzU_5SB62BYEbNn_1VbbTdG4396N8rdZ3ZNGcE,5654
27
27
  ragaai_catalyst/tracers/agentic_tracing/tests/unique_decorator_test.py,sha256=Xk1cLzs-2A3dgyBwRRnCWs7Eubki40FVonwd433hPN8,4805
28
28
  ragaai_catalyst/tracers/agentic_tracing/tracers/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
29
- ragaai_catalyst/tracers/agentic_tracing/tracers/agent_tracer.py,sha256=FOKJUMd48s8NFoTiZINeWBPA4IjMo5o1r9nuDEzIerA,20945
30
- ragaai_catalyst/tracers/agentic_tracing/tracers/base.py,sha256=liLdiHdqc6BHH4YyvrdmX_fprXoeJchOqBwmzMJPrCc,14075
31
- ragaai_catalyst/tracers/agentic_tracing/tracers/llm_tracer.py,sha256=EWcse5vJdOO5a3uSuEL6TKRsnvKIW_H9qbUVgRTxq1M,25449
32
- ragaai_catalyst/tracers/agentic_tracing/tracers/main_tracer.py,sha256=tdwkpWx_eSyXtbpWTo9RG_cF_6q1F8oB0XyF4OiRKh8,10363
33
- ragaai_catalyst/tracers/agentic_tracing/tracers/network_tracer.py,sha256=6FTA15xMnum9omM_0Jd9cMIuWdKu1gR5Tc8fOXAkP8E,10068
34
- ragaai_catalyst/tracers/agentic_tracing/tracers/tool_tracer.py,sha256=Rln82_4BEL_4ULOIhWwu2-qGQ8J1yEaf9qKsEBuj76o,8427
35
- ragaai_catalyst/tracers/agentic_tracing/tracers/user_interaction_tracer.py,sha256=wsCwTK7tM_L3mdNrcg5Mq3D1k07XCHZkhOB26kz_rLY,1472
29
+ ragaai_catalyst/tracers/agentic_tracing/tracers/agent_tracer.py,sha256=aLiq5nPie5TT61QYtvAtvErsxjPFYiUxjayn5aCX1_k,25543
30
+ ragaai_catalyst/tracers/agentic_tracing/tracers/base.py,sha256=u2DX_BsMGsuJkWqN6ucxboMO8GnvOcArKJe5L08y-YI,35014
31
+ ragaai_catalyst/tracers/agentic_tracing/tracers/custom_tracer.py,sha256=uay8lU7T-CKsVu8KvWX31qfMqufK9S3Ive7XKo2Ksmk,12252
32
+ ragaai_catalyst/tracers/agentic_tracing/tracers/langgraph_tracer.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
33
+ ragaai_catalyst/tracers/agentic_tracing/tracers/llm_tracer.py,sha256=fn5qxb365GmQkJy_yZAY5TiiWRMFKPNJdYk8KFr8uWA,29343
34
+ ragaai_catalyst/tracers/agentic_tracing/tracers/main_tracer.py,sha256=nxUOQSyWBTnbsZfxmr1lje2OggqNf9fwtGUb-sBo6mI,15215
35
+ ragaai_catalyst/tracers/agentic_tracing/tracers/network_tracer.py,sha256=CviGiAg0W0krJxORMBDTosQytIoJDQ5RwU6xt_U_mOg,10408
36
+ ragaai_catalyst/tracers/agentic_tracing/tracers/tool_tracer.py,sha256=4h6epgRHPVRfTrCznwc6KPK6xevwBaZwE-q0Zj-4Kkk,12160
37
+ ragaai_catalyst/tracers/agentic_tracing/tracers/user_interaction_tracer.py,sha256=bhSUhNQCuJXKjgJAXhjKEYjnHMpYN90FSZdR84fNIKU,4614
36
38
  ragaai_catalyst/tracers/agentic_tracing/upload/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
37
- ragaai_catalyst/tracers/agentic_tracing/upload/upload_agentic_traces.py,sha256=2Ab8odZXMpYFTh8a7tO53qx9RptF-xxyfgtFN0A6GzI,7690
39
+ ragaai_catalyst/tracers/agentic_tracing/upload/upload_agentic_traces.py,sha256=1MDKXAAPzOEdxFKWWQrRgrmM3kz--DGXSywGXQmR3lQ,6041
38
40
  ragaai_catalyst/tracers/agentic_tracing/upload/upload_code.py,sha256=HgpMgI-JTWZrizcM7GGUIaAgaZF4aRT3D0dJXVEkblY,4271
41
+ ragaai_catalyst/tracers/agentic_tracing/upload/upload_trace_metric.py,sha256=iFagpPltlg6aKvdyAFvXsuxyjUUjcHAMmvXlevL-uYM,3312
39
42
  ragaai_catalyst/tracers/agentic_tracing/utils/__init__.py,sha256=XdB3X_ufe4RVvGorxSqAiB9dYv4UD7Hvvuw3bsDUppY,60
40
43
  ragaai_catalyst/tracers/agentic_tracing/utils/api_utils.py,sha256=JyNCbfpW-w4O9CjtemTqmor2Rh1WGpQwhRaDSRmBxw8,689
44
+ ragaai_catalyst/tracers/agentic_tracing/utils/create_dataset_schema.py,sha256=lgvJL0cakJrX8WGsnU05YGvotequSj6HgSohyR4OJNE,804
41
45
  ragaai_catalyst/tracers/agentic_tracing/utils/file_name_tracker.py,sha256=515NNDQJTyy3O-2rdlUYUoWL9qSwLIfvV3sMB9BtHp8,1366
42
46
  ragaai_catalyst/tracers/agentic_tracing/utils/generic.py,sha256=WwXT01xmp8MSr7KinuDCSK9a1ifpLcT7ajFkvYviG_A,1190
43
- ragaai_catalyst/tracers/agentic_tracing/utils/llm_utils.py,sha256=F9J2K5RoHGploox51fxut0RI5KBPIuUhoJyLT0Lhv3Y,14085
44
- ragaai_catalyst/tracers/agentic_tracing/utils/model_costs.json,sha256=6wnDtkBH-uwJeZm9FtyeXuUWux8u-skT3lmrtFwsReI,286298
45
- ragaai_catalyst/tracers/agentic_tracing/utils/trace_utils.py,sha256=9cFzfFqIA968bUG7LNTjdN7zbdEXUtcvRKg883ade2c,2586
47
+ ragaai_catalyst/tracers/agentic_tracing/utils/get_user_trace_metrics.py,sha256=vPZ4dn4EHFW0kqd1GyRpsYXbfrRrd0DXCmh-pzsDBNE,1109
48
+ ragaai_catalyst/tracers/agentic_tracing/utils/llm_utils.py,sha256=wlXCuaRe81s-7FWdJ_MquXFGRZZfNrZxLIIxl-Ohbqk,15541
49
+ ragaai_catalyst/tracers/agentic_tracing/utils/model_costs.json,sha256=weznWpRd6N5X-O8lkzVA6nd5LSYJKa62s3GZL51NQpU,293833
50
+ ragaai_catalyst/tracers/agentic_tracing/utils/span_attributes.py,sha256=MqeRNGxzeuh9qTK0NbYMftl9V9Z0V7gMgBoHkrXP56k,1592
51
+ ragaai_catalyst/tracers/agentic_tracing/utils/trace_utils.py,sha256=RciiDdo2riibEoM8X0FKHaXi78y3bWwNkV8U0leqigk,3508
46
52
  ragaai_catalyst/tracers/agentic_tracing/utils/unique_decorator.py,sha256=DQHjcEuqEKsNSWaNs7SoOaq50yK4Jsl966S7mBnV-zA,5723
47
- ragaai_catalyst/tracers/agentic_tracing/utils/zip_list_of_unique_files.py,sha256=faFat_OAUnVJGnauMVo6yeHhTv-_njgyXGOtUwYJ8kE,7568
53
+ ragaai_catalyst/tracers/agentic_tracing/utils/zip_list_of_unique_files.py,sha256=fvL7SQSO1-FPQ3zT1ErAcj8cLCKn4rUSG0Ug-nL-By0,18824
48
54
  ragaai_catalyst/tracers/exporters/__init__.py,sha256=kVA8zp05h3phu4e-iHSlnznp_PzMRczB7LphSsZgUjg,138
49
55
  ragaai_catalyst/tracers/exporters/file_span_exporter.py,sha256=RgGteu-NVGprXKkynvyIO5yOjpbtA41R3W_NzCjnkwE,6445
50
56
  ragaai_catalyst/tracers/exporters/raga_exporter.py,sha256=6xvjWXyh8XPkHKSLLmAZUQSvwuyY17ov8pv2VdfI0qA,17875
@@ -54,7 +60,7 @@ ragaai_catalyst/tracers/instrumentators/llamaindex.py,sha256=SMrRlR4xM7k9HK43hak
54
60
  ragaai_catalyst/tracers/instrumentators/openai.py,sha256=14R4KW9wQCR1xysLfsP_nxS7cqXrTPoD8En4MBAaZUU,379
55
61
  ragaai_catalyst/tracers/utils/__init__.py,sha256=KeMaZtYaTojilpLv65qH08QmpYclfpacDA0U3wg6Ybw,64
56
62
  ragaai_catalyst/tracers/utils/utils.py,sha256=ViygfJ7vZ7U0CTSA1lbxVloHp4NSlmfDzBRNCJuMhis,2374
57
- ragaai_catalyst-2.1.3.dist-info/METADATA,sha256=H6mSUPhVI2PggdxVms8ggrA_0Y0J3v3TzbRewfDj5Rw,1802
58
- ragaai_catalyst-2.1.3.dist-info/WHEEL,sha256=In9FTNxeP60KnTkGw7wk6mJPYd_dQSjEZmXdBdMCI-8,91
59
- ragaai_catalyst-2.1.3.dist-info/top_level.txt,sha256=HpgsdRgEJMk8nqrU6qdCYk3di7MJkDL0B19lkc7dLfM,16
60
- ragaai_catalyst-2.1.3.dist-info/RECORD,,
63
+ ragaai_catalyst-2.1.4.dist-info/METADATA,sha256=By1IwhJBe1xda74avFDcyfDYDelcIF3yuyIohE1Lt-0,12768
64
+ ragaai_catalyst-2.1.4.dist-info/WHEEL,sha256=In9FTNxeP60KnTkGw7wk6mJPYd_dQSjEZmXdBdMCI-8,91
65
+ ragaai_catalyst-2.1.4.dist-info/top_level.txt,sha256=HpgsdRgEJMk8nqrU6qdCYk3di7MJkDL0B19lkc7dLfM,16
66
+ ragaai_catalyst-2.1.4.dist-info/RECORD,,
@@ -1,43 +0,0 @@
1
- Metadata-Version: 2.2
2
- Name: ragaai_catalyst
3
- Version: 2.1.3
4
- Summary: RAGA AI CATALYST
5
- Author-email: Kiran Scaria <kiran.scaria@raga.ai>, Kedar Gaikwad <kedar.gaikwad@raga.ai>, Dushyant Mahajan <dushyant.mahajan@raga.ai>, Siddhartha Kosti <siddhartha.kosti@raga.ai>, Ritika Goel <ritika.goel@raga.ai>, Vijay Chaurasia <vijay.chaurasia@raga.ai>
6
- Requires-Python: <3.13,>=3.9
7
- Description-Content-Type: text/markdown
8
- Requires-Dist: aiohttp>=3.10.2
9
- Requires-Dist: opentelemetry-api==1.25.0
10
- Requires-Dist: opentelemetry-sdk==1.25.0
11
- Requires-Dist: opentelemetry-exporter-otlp-proto-grpc==1.25.0
12
- Requires-Dist: opentelemetry-instrumentation==0.46b0
13
- Requires-Dist: opentelemetry-instrumentation-fastapi==0.46b0
14
- Requires-Dist: opentelemetry-instrumentation-asgi==0.46b0
15
- Requires-Dist: opentelemetry-semantic-conventions==0.46b0
16
- Requires-Dist: opentelemetry-util-http==0.46b0
17
- Requires-Dist: opentelemetry-instrumentation-langchain~=0.24.0
18
- Requires-Dist: opentelemetry-instrumentation-openai~=0.24.0
19
- Requires-Dist: langchain-core>=0.2.11
20
- Requires-Dist: langchain>=0.2.11
21
- Requires-Dist: openai>=1.57.0
22
- Requires-Dist: pandas
23
- Requires-Dist: groq>=0.11.0
24
- Requires-Dist: PyPDF2>=3.0.1
25
- Requires-Dist: google-generativeai>=0.8.2
26
- Requires-Dist: Markdown>=3.7
27
- Requires-Dist: litellm==1.51.1
28
- Requires-Dist: tenacity==8.3.0
29
- Requires-Dist: tqdm>=4.66.5
30
- Requires-Dist: llama-index<0.11.0,>=0.10.0
31
- Requires-Dist: pyopenssl>=24.2.1
32
- Requires-Dist: psutil~=6.0.0
33
- Requires-Dist: py-cpuinfo~=9.0.0
34
- Requires-Dist: requests~=2.32.3
35
- Requires-Dist: GPUtil~=1.4.0
36
- Requires-Dist: astor>=0.8.1
37
- Provides-Extra: dev
38
- Requires-Dist: pytest; extra == "dev"
39
- Requires-Dist: pytest-cov; extra == "dev"
40
- Requires-Dist: black; extra == "dev"
41
- Requires-Dist: isort; extra == "dev"
42
- Requires-Dist: mypy; extra == "dev"
43
- Requires-Dist: flake8; extra == "dev"