prompteval-core 0.1.0__py3-none-any.whl → 0.1.2__py3-none-any.whl

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
@@ -1,6 +1,6 @@
1
1
  Metadata-Version: 2.4
2
2
  Name: prompteval-core
3
- Version: 0.1.0
3
+ Version: 0.1.2
4
4
  Summary: Semantic Testing for LLMs - Test your AI outputs with semantic similarity validation
5
5
  Home-page: https://github.com/prompteval/prompteval-sdk
6
6
  Author: PromptEval Team
@@ -8,12 +8,11 @@ Author-email: PromptEval Team <hello@getprompteval.com>
8
8
  License: PromptEval
9
9
  Project-URL: Homepage, https://getprompteval.com
10
10
  Project-URL: Documentation, https://getprompteval.com/docs
11
- Project-URL: Repository, https://github.com/prompteval/prompteval-sdk
12
- Project-URL: Issues, https://github.com/prompteval/prompteval-sdk/issues
11
+ Project-URL: Repository, https://github.com/manuelledezma687/prompteval
12
+ Project-URL: Issues, https://github.com/manuelledezma687/prompteval/issues
13
13
  Keywords: llm,testing,semantic,ai,nlp,validation,prompt,gpt,openai,anthropic
14
14
  Classifier: Development Status :: 4 - Beta
15
15
  Classifier: Intended Audience :: Developers
16
- Classifier: License :: OSI Approved :: MIT License
17
16
  Classifier: Operating System :: OS Independent
18
17
  Classifier: Programming Language :: Python :: 3
19
18
  Classifier: Programming Language :: Python :: 3.8
@@ -25,7 +24,6 @@ Classifier: Topic :: Software Development :: Testing
25
24
  Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
26
25
  Requires-Python: >=3.8
27
26
  Description-Content-Type: text/markdown
28
- License-File: LICENSE
29
27
  Requires-Dist: requests>=2.25.0
30
28
  Requires-Dist: pyyaml>=5.4.0
31
29
  Provides-Extra: dev
@@ -35,23 +33,22 @@ Requires-Dist: black>=23.0.0; extra == "dev"
35
33
  Requires-Dist: mypy>=1.0.0; extra == "dev"
36
34
  Dynamic: author
37
35
  Dynamic: home-page
38
- Dynamic: license-file
39
36
  Dynamic: requires-python
40
37
 
41
38
  # 🧪 PromptEval
42
39
 
43
40
  **Semantic Testing for LLMs** - Test your AI outputs with semantic similarity validation.
44
41
 
45
- [![PyPI version](https://badge.fury.io/py/prompteval.svg)](https://badge.fury.io/py/prompteval)
46
- [![Python 3.8+](https://img.shields.io/badge/python-3.8+-blue.svg)](https://www.python.org/downloads/)
47
- [![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
42
+ ![Version](https://img.shields.io/badge/version-0.1.2-blue)
43
+ ![Python](https://img.shields.io/badge/python-3.10+-green)
44
+ ![License](https://img.shields.io/badge/license-PromptEval-yellow)
48
45
 
49
46
  ## 🚀 Quick Start
50
47
 
51
48
  ### Installation
52
49
 
53
50
  ```bash
54
- pip install prompteval
51
+ pip install prompteval-core
55
52
  ```
56
53
 
57
54
  ### CLI Usage
@@ -100,30 +97,39 @@ if not result.success:
100
97
  Define your LLM endpoint configuration:
101
98
 
102
99
  ```yaml
103
- name: my-llm-api
104
- description: My LLM Testing
100
+ name: fitness-llm-api
101
+ description: Fitness LLM Testing
105
102
 
103
+ # Endpoint
106
104
  endpoint:
107
- url: https://api.example.com/v1/chat
105
+ url: https://fitness-llm.com/v1/chat
108
106
  method: POST
109
- timeout: 30
107
+ timeout: 10
110
108
 
109
+ # Request template
111
110
  request:
112
111
  headers:
113
112
  Content-Type: application/json
114
- Authorization: Bearer ${ENV.API_KEY}
115
113
 
116
114
  template:
117
115
  prompt: "{{PROMPT}}"
116
+ type: "{{TYPE}}"
118
117
  max_tokens: 150
119
118
 
119
+ # Response extraction
120
120
  response:
121
121
  type: json
122
122
  path: choices.0.message.content
123
123
 
124
+ # Validation
124
125
  validation:
125
126
  ml_threshold: 0.75
126
127
  use_semantic: true
128
+
129
+ execution:
130
+ parallel_limit: 10
131
+ batch_delay: 0.3
132
+ output_dir: ./output
127
133
  ```
128
134
 
129
135
  ### Test Cases YAML
@@ -132,27 +138,22 @@ Define your test cases:
132
138
 
133
139
  ```yaml
134
140
  tests:
135
- - id: TEST-001
136
- description: Basic greeting test
141
+ - name: duration_basic
142
+ id: FIT-001
143
+ description: Pregunta sobre tiempo de entrenamiento
144
+ prompt: "Ask about training duration"
137
145
  context:
138
- PROMPT: "Say hello"
139
- expected: "Hello! How can I help you today?"
146
+ PROMPT: "Ask about training duration"
147
+ TYPE: "duration"
148
+ expected: "Desde cuando estas entrenando este ejercicio o rutina"
140
149
  variants:
141
- - "Hi there! How can I assist you?"
142
- - "Hello! What can I do for you?"
150
+ - "Hace cuanto tiempo empezaste con este entrenamiento"
151
+ - "Cuanto tiempo llevas entrenando este ejercicio"
152
+ - "Por favor, dime cuándo empezaste con este entrenamiento."
153
+ - "Cuéntame, ¿desde cuándo entrenas así?"
143
154
  threshold: 0.70
144
155
  tags:
145
- - greeting
146
- - basic
147
-
148
- - id: TEST-002
149
- description: Math question
150
- context:
151
- PROMPT: "What is 2+2?"
152
- expected: "4"
153
- threshold: 0.90
154
- tags:
155
- - math
156
+ - duration
156
157
  ```
157
158
 
158
159
  ## 🔧 SDK Reference
@@ -301,4 +302,13 @@ Threshold configuration:
301
302
 
302
303
  ## 📄 License
303
304
 
304
- MIT License - see [LICENSE](LICENSE) file for details.
305
+ Copyright (c) 2026 PromptEval. All Rights Reserved.
306
+
307
+ This source code is proprietary and confidential.
308
+ Unauthorized copying, distribution, or use is strictly prohibited.
309
+
310
+ ---
311
+
312
+ <p align="center">
313
+ Made with ❤️ by the PromptEval Team
314
+ </p>
@@ -1,8 +1,7 @@
1
- prompteval-core/__init__.py,sha256=MjH0SACMz-Pqylt1tTb_X1XadusKdSGpl26OCwxKdQg,1277
2
- prompteval-core/cli.py,sha256=0jAnqfdMh1xW7hFWHBfTYtsjzGDmgc-MpCTh0r1eh3E,20202
3
- prompteval-core/client.py,sha256=YsmULW26RhSiFpf9VORPmXEyWWJK07fjQXghdId_0UE,14204
4
- prompteval-core/exceptions.py,sha256=GdPYCZTA0ZYlLdI1aokLLilKN_0cq6TlhKHNM8hHQ3A,881
5
- prompteval_core-0.1.0.dist-info/licenses/LICENSE,sha256=jd3FciO4QZDFlr_5c6wu55_kjRSfF7flo5yAsiqWw0w,1067
1
+ prompteval/__init__.py,sha256=MjH0SACMz-Pqylt1tTb_X1XadusKdSGpl26OCwxKdQg,1277
2
+ prompteval/cli.py,sha256=0jAnqfdMh1xW7hFWHBfTYtsjzGDmgc-MpCTh0r1eh3E,20202
3
+ prompteval/client.py,sha256=YsmULW26RhSiFpf9VORPmXEyWWJK07fjQXghdId_0UE,14204
4
+ prompteval/exceptions.py,sha256=GdPYCZTA0ZYlLdI1aokLLilKN_0cq6TlhKHNM8hHQ3A,881
6
5
  venv/Lib/site-packages/__editable___prompteval_0_1_0_finder.py,sha256=QGgRjq78H8O8kPfq2eWHUr4duECmUAQ0vQA6fIENu5w,3839
7
6
  venv/Lib/site-packages/_yaml/__init__.py,sha256=04Ae_5osxahpJHa3XBZUAf4wi6XX32gR8D6X6p64GEA,1402
8
7
  venv/Lib/site-packages/build/__init__.py,sha256=t4umCWGa3xQF99hOJT5ezDpNig4RbFNg7v8qRgDP2eI,837
@@ -1377,8 +1376,8 @@ venv/Lib/site-packages/yaml/resolver.py,sha256=9L-VYfm4mWHxUD1Vg4X7rjDRK_7VZd6b9
1377
1376
  venv/Lib/site-packages/yaml/scanner.py,sha256=YEM3iLZSaQwXcQRg2l2R4MdT0zGP2F9eHkKGKnHyWQY,51279
1378
1377
  venv/Lib/site-packages/yaml/serializer.py,sha256=ChuFgmhU01hj4xgI8GaKv6vfM2Bujwa9i7d2FAHj7cA,4165
1379
1378
  venv/Lib/site-packages/yaml/tokens.py,sha256=lTQIzSVw8Mg9wv459-TjiOQe6wVziqaRlqX2_89rp54,2573
1380
- prompteval_core-0.1.0.dist-info/METADATA,sha256=W25J6Cl0tdugaoovrLQ0XmE84LPxFTR1I0yXGiNr-dM,8177
1381
- prompteval_core-0.1.0.dist-info/WHEEL,sha256=wUyA8OaulRlbfwMtmQsvNngGrxQHAvkKcvRmdizlJi0,92
1382
- prompteval_core-0.1.0.dist-info/entry_points.txt,sha256=jCK2NmAww2fdGqXKKkuRXWrvO8ekgZompxeXqEn0zPo,51
1383
- prompteval_core-0.1.0.dist-info/top_level.txt,sha256=XCyfOc33flEPv-l82IOIn24pyExrCZptdK7yYW9k6h0,21
1384
- prompteval_core-0.1.0.dist-info/RECORD,,
1379
+ prompteval_core-0.1.2.dist-info/METADATA,sha256=jTHwWOt00sqcOxHzLKjFNuhT8pnpdrfBNFZh1aFlSek,8436
1380
+ prompteval_core-0.1.2.dist-info/WHEEL,sha256=wUyA8OaulRlbfwMtmQsvNngGrxQHAvkKcvRmdizlJi0,92
1381
+ prompteval_core-0.1.2.dist-info/entry_points.txt,sha256=jCK2NmAww2fdGqXKKkuRXWrvO8ekgZompxeXqEn0zPo,51
1382
+ prompteval_core-0.1.2.dist-info/top_level.txt,sha256=YtChKk8S7-4EPoOCkvdVToUVq-Wuv9rzqT2VkeWk14U,16
1383
+ prompteval_core-0.1.2.dist-info/RECORD,,
@@ -0,0 +1,2 @@
1
+ prompteval
2
+ venv
@@ -1,21 +0,0 @@
1
- MIT License
2
-
3
- Copyright (c) 2024 PromptEval
4
-
5
- Permission is hereby granted, free of charge, to any person obtaining a copy
6
- of this software and associated documentation files (the "Software"), to deal
7
- in the Software without restriction, including without limitation the rights
8
- to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9
- copies of the Software, and to permit persons to whom the Software is
10
- furnished to do so, subject to the following conditions:
11
-
12
- The above copyright notice and this permission notice shall be included in all
13
- copies or substantial portions of the Software.
14
-
15
- THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
- IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
- FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
- AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
- LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
- OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21
- SOFTWARE.
@@ -1,2 +0,0 @@
1
- prompteval-core
2
- venv
File without changes
File without changes
File without changes
File without changes