@evalgate/sdk 2.0.0 → 2.1.2
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +13 -0
- package/README.md +20 -20
- package/dist/version.d.ts +2 -2
- package/dist/version.js +2 -2
- package/package.json +3 -2
package/CHANGELOG.md
CHANGED
|
@@ -5,6 +5,19 @@ All notable changes to the @evalgate/sdk package will be documented in this file
|
|
|
5
5
|
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
|
|
6
6
|
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
|
|
7
7
|
|
|
8
|
+
## [2.1.2] - 2026-03-02
|
|
9
|
+
|
|
10
|
+
### Fixed
|
|
11
|
+
|
|
12
|
+
- **Type safety** — aligned with platform 2.1.2; zero TypeScript errors across all integration points
|
|
13
|
+
- **CI gate** — all SDK tests, lint, and build checks passing
|
|
14
|
+
|
|
15
|
+
## [2.1.1] - 2026-03-02
|
|
16
|
+
|
|
17
|
+
### Fixed
|
|
18
|
+
|
|
19
|
+
- Version alignment with platform 2.1.1
|
|
20
|
+
|
|
8
21
|
## [2.0.0] - 2026-03-01
|
|
9
22
|
|
|
10
23
|
### Breaking — EvalGate Rebrand
|
package/README.md
CHANGED
|
@@ -15,13 +15,13 @@ Zero to production CI in 60 seconds. No infra. No lock-in. Remove anytime.
|
|
|
15
15
|
|
|
16
16
|
## Quick Start (60 seconds)
|
|
17
17
|
|
|
18
|
-
Add this to your `.github/workflows/
|
|
18
|
+
Add this to your `.github/workflows/evalgate.yml`:
|
|
19
19
|
|
|
20
20
|
```yaml
|
|
21
21
|
name: EvalGate CI
|
|
22
22
|
on: [push, pull_request]
|
|
23
23
|
jobs:
|
|
24
|
-
|
|
24
|
+
evalgate:
|
|
25
25
|
runs-on: ubuntu-latest
|
|
26
26
|
steps:
|
|
27
27
|
- uses: actions/checkout@v4
|
|
@@ -31,8 +31,8 @@ jobs:
|
|
|
31
31
|
- uses: actions/upload-artifact@v4
|
|
32
32
|
if: always()
|
|
33
33
|
with:
|
|
34
|
-
name:
|
|
35
|
-
path: .
|
|
34
|
+
name: evalgate-results
|
|
35
|
+
path: .evalgate/
|
|
36
36
|
```
|
|
37
37
|
|
|
38
38
|
Create `eval/your-spec.spec.ts`:
|
|
@@ -51,7 +51,7 @@ defineEval({
|
|
|
51
51
|
```
|
|
52
52
|
|
|
53
53
|
```bash
|
|
54
|
-
git add .github/workflows/
|
|
54
|
+
git add .github/workflows/evalgate.yml eval/
|
|
55
55
|
git commit -m "feat: add EvalGate CI pipeline"
|
|
56
56
|
git push
|
|
57
57
|
```
|
|
@@ -67,7 +67,7 @@ That's it! Your CI now:
|
|
|
67
67
|
|
|
68
68
|
## 🚀 New in v2.0.0: One-Command CI
|
|
69
69
|
|
|
70
|
-
### `
|
|
70
|
+
### `evalgate ci` - Complete CI Pipeline
|
|
71
71
|
|
|
72
72
|
```bash
|
|
73
73
|
npx @evalgate/sdk ci --format github --write-results --base main
|
|
@@ -108,8 +108,8 @@ Every failure prints a clear next step:
|
|
|
108
108
|
|
|
109
109
|
```
|
|
110
110
|
🔧 Next step for debugging:
|
|
111
|
-
Download base artifact and run:
|
|
112
|
-
Artifacts: .
|
|
111
|
+
Download base artifact and run: evalgate diff --base .evalgate/base-run.json --head .evalgate/last-run.json
|
|
112
|
+
Artifacts: .evalgate/runs/
|
|
113
113
|
```
|
|
114
114
|
|
|
115
115
|
---
|
|
@@ -181,23 +181,23 @@ Every failure prints a clear next step:
|
|
|
181
181
|
|
|
182
182
|
| Command | Description |
|
|
183
183
|
|---------|-------------|
|
|
184
|
-
| `npx evalgate migrate config --in
|
|
184
|
+
| `npx evalgate migrate config --in evalgate.config.json --out eval/migrated.spec.ts` | Convert legacy config to DSL |
|
|
185
185
|
|
|
186
186
|
**Guided failure flow:**
|
|
187
187
|
|
|
188
188
|
```
|
|
189
|
-
|
|
189
|
+
evalgate ci → fails → "Next: evalgate explain --report .evalgate/last-run.json"
|
|
190
190
|
↓
|
|
191
|
-
|
|
191
|
+
evalgate explain → root causes + fixes
|
|
192
192
|
```
|
|
193
193
|
|
|
194
194
|
**GitHub Actions step summary** — CI result at a glance with regressions and artifacts:
|
|
195
195
|
|
|
196
|
-

|
|
197
197
|
|
|
198
|
-
**`
|
|
198
|
+
**`evalgate explain` terminal output** — root causes + fix commands:
|
|
199
199
|
|
|
200
|
-

|
|
201
201
|
|
|
202
202
|
All commands automatically write artifacts so `explain` works with zero flags.
|
|
203
203
|
|
|
@@ -324,7 +324,7 @@ import type {
|
|
|
324
324
|
```typescript
|
|
325
325
|
import { AIEvalClient } from "@evalgate/sdk";
|
|
326
326
|
|
|
327
|
-
const client = AIEvalClient.init(); // from
|
|
327
|
+
const client = AIEvalClient.init(); // from EVALGATE_API_KEY env
|
|
328
328
|
// or
|
|
329
329
|
const client = new AIEvalClient({ apiKey: "...", organizationId: 123 });
|
|
330
330
|
```
|
|
@@ -367,7 +367,7 @@ npm install openai
|
|
|
367
367
|
## No Lock-in
|
|
368
368
|
|
|
369
369
|
```bash
|
|
370
|
-
rm
|
|
370
|
+
rm evalgate.config.json
|
|
371
371
|
```
|
|
372
372
|
|
|
373
373
|
Your local `openAIChatEval` runs continue to work. No account cancellation. No data export required.
|
|
@@ -376,17 +376,17 @@ Your local `openAIChatEval` runs continue to work. No account cancellation. No d
|
|
|
376
376
|
|
|
377
377
|
See [CHANGELOG.md](CHANGELOG.md) for the full release history.
|
|
378
378
|
|
|
379
|
-
**v1.8.0** — `
|
|
379
|
+
**v1.8.0** — `evalgate doctor` rewrite (9-check checklist), `evalgate explain` command, guided failure flow, CI template with doctor preflight
|
|
380
380
|
|
|
381
|
-
**v1.7.0** — `
|
|
381
|
+
**v1.7.0** — `evalgate init` scaffolder, `evalgate upgrade --full`, `detectRunner()`, machine-readable gate output, init test matrix
|
|
382
382
|
|
|
383
|
-
**v1.6.0** — `
|
|
383
|
+
**v1.6.0** — `evalgate gate`, `evalgate baseline`, regression gate constants & types
|
|
384
384
|
|
|
385
385
|
**v1.5.8** — secureRoute fix, test infra fixes, 304 handling fix
|
|
386
386
|
|
|
387
387
|
**v1.5.5** — PASS/WARN/FAIL semantics, flake intelligence, golden regression suite
|
|
388
388
|
|
|
389
|
-
**v1.5.0** — GitHub annotations, `--onFail import`, `
|
|
389
|
+
**v1.5.0** — GitHub annotations, `--onFail import`, `evalgate doctor`
|
|
390
390
|
|
|
391
391
|
## License
|
|
392
392
|
|
package/dist/version.d.ts
CHANGED
|
@@ -3,5 +3,5 @@
|
|
|
3
3
|
* X-EvalGate-SDK-Version: SDK package version
|
|
4
4
|
* X-EvalGate-Spec-Version: OpenAPI spec version (docs/openapi.json info.version)
|
|
5
5
|
*/
|
|
6
|
-
export declare const SDK_VERSION = "2.
|
|
7
|
-
export declare const SPEC_VERSION = "2.
|
|
6
|
+
export declare const SDK_VERSION = "2.1.0";
|
|
7
|
+
export declare const SPEC_VERSION = "2.1.0";
|
package/dist/version.js
CHANGED
|
@@ -6,5 +6,5 @@ exports.SPEC_VERSION = exports.SDK_VERSION = void 0;
|
|
|
6
6
|
* X-EvalGate-SDK-Version: SDK package version
|
|
7
7
|
* X-EvalGate-Spec-Version: OpenAPI spec version (docs/openapi.json info.version)
|
|
8
8
|
*/
|
|
9
|
-
exports.SDK_VERSION = "2.
|
|
10
|
-
exports.SPEC_VERSION = "2.
|
|
9
|
+
exports.SDK_VERSION = "2.1.0";
|
|
10
|
+
exports.SPEC_VERSION = "2.1.0";
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "@evalgate/sdk",
|
|
3
|
-
"version": "2.
|
|
3
|
+
"version": "2.1.2",
|
|
4
4
|
"publishConfig": {
|
|
5
5
|
"access": "public",
|
|
6
6
|
"registry": "https://registry.npmjs.org/"
|
|
@@ -24,7 +24,8 @@
|
|
|
24
24
|
"scripts": {
|
|
25
25
|
"build": "tsc",
|
|
26
26
|
"dev": "tsc --watch",
|
|
27
|
-
"test": "vitest"
|
|
27
|
+
"test": "vitest run",
|
|
28
|
+
"test:watch": "vitest"
|
|
28
29
|
},
|
|
29
30
|
"keywords": [
|
|
30
31
|
"ai",
|