@evalgate/sdk 2.1.0 → 2.1.2

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (3) hide show
  1. package/CHANGELOG.md +13 -0
  2. package/README.md +20 -20
  3. package/package.json +1 -1
package/CHANGELOG.md CHANGED
@@ -5,6 +5,19 @@ All notable changes to the @evalgate/sdk package will be documented in this file
5
5
  The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
6
6
  and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
7
7
 
8
+ ## [2.1.2] - 2026-03-02
9
+
10
+ ### Fixed
11
+
12
+ - **Type safety** — aligned with platform 2.1.2; zero TypeScript errors across all integration points
13
+ - **CI gate** — all SDK tests, lint, and build checks passing
14
+
15
+ ## [2.1.1] - 2026-03-02
16
+
17
+ ### Fixed
18
+
19
+ - Version alignment with platform 2.1.1
20
+
8
21
  ## [2.0.0] - 2026-03-01
9
22
 
10
23
  ### Breaking — EvalGate Rebrand
package/README.md CHANGED
@@ -15,13 +15,13 @@ Zero to production CI in 60 seconds. No infra. No lock-in. Remove anytime.
15
15
 
16
16
  ## Quick Start (60 seconds)
17
17
 
18
- Add this to your `.github/workflows/evalai.yml`:
18
+ Add this to your `.github/workflows/evalgate.yml`:
19
19
 
20
20
  ```yaml
21
21
  name: EvalGate CI
22
22
  on: [push, pull_request]
23
23
  jobs:
24
- evalai:
24
+ evalgate:
25
25
  runs-on: ubuntu-latest
26
26
  steps:
27
27
  - uses: actions/checkout@v4
@@ -31,8 +31,8 @@ jobs:
31
31
  - uses: actions/upload-artifact@v4
32
32
  if: always()
33
33
  with:
34
- name: evalai-results
35
- path: .evalai/
34
+ name: evalgate-results
35
+ path: .evalgate/
36
36
  ```
37
37
 
38
38
  Create `eval/your-spec.spec.ts`:
@@ -51,7 +51,7 @@ defineEval({
51
51
  ```
52
52
 
53
53
  ```bash
54
- git add .github/workflows/evalai.yml eval/
54
+ git add .github/workflows/evalgate.yml eval/
55
55
  git commit -m "feat: add EvalGate CI pipeline"
56
56
  git push
57
57
  ```
@@ -67,7 +67,7 @@ That's it! Your CI now:
67
67
 
68
68
  ## 🚀 New in v2.0.0: One-Command CI
69
69
 
70
- ### `evalai ci` - Complete CI Pipeline
70
+ ### `evalgate ci` - Complete CI Pipeline
71
71
 
72
72
  ```bash
73
73
  npx @evalgate/sdk ci --format github --write-results --base main
@@ -108,8 +108,8 @@ Every failure prints a clear next step:
108
108
 
109
109
  ```
110
110
  🔧 Next step for debugging:
111
- Download base artifact and run: evalai diff --base .evalai/base-run.json --head .evalai/last-run.json
112
- Artifacts: .evalai/runs/
111
+ Download base artifact and run: evalgate diff --base .evalgate/base-run.json --head .evalgate/last-run.json
112
+ Artifacts: .evalgate/runs/
113
113
  ```
114
114
 
115
115
  ---
@@ -181,23 +181,23 @@ Every failure prints a clear next step:
181
181
 
182
182
  | Command | Description |
183
183
  |---------|-------------|
184
- | `npx evalgate migrate config --in evalai.config.json --out eval/migrated.spec.ts` | Convert legacy config to DSL |
184
+ | `npx evalgate migrate config --in evalgate.config.json --out eval/migrated.spec.ts` | Convert legacy config to DSL |
185
185
 
186
186
  **Guided failure flow:**
187
187
 
188
188
  ```
189
- evalai ci → fails → "Next: evalai explain --report .evalai/last-run.json"
189
+ evalgate ci → fails → "Next: evalgate explain --report .evalgate/last-run.json"
190
190
 
191
- evalai explain → root causes + fixes
191
+ evalgate explain → root causes + fixes
192
192
  ```
193
193
 
194
194
  **GitHub Actions step summary** — CI result at a glance with regressions and artifacts:
195
195
 
196
- ![GitHub Actions step summary showing CI pass/fail with delta table](../../docs/images/evalai-gate-step-summary.svg)
196
+ ![GitHub Actions step summary showing CI pass/fail with delta table](../../docs/images/evalgate-gate-step-summary.svg)
197
197
 
198
- **`evalai explain` terminal output** — root causes + fix commands:
198
+ **`evalgate explain` terminal output** — root causes + fix commands:
199
199
 
200
- ![Terminal output of evalai explain showing top failures and suggested fixes](../../docs/images/evalai-explain-terminal.svg)
200
+ ![Terminal output of evalgate explain showing top failures and suggested fixes](../../docs/images/evalgate-explain-terminal.svg)
201
201
 
202
202
  All commands automatically write artifacts so `explain` works with zero flags.
203
203
 
@@ -324,7 +324,7 @@ import type {
324
324
  ```typescript
325
325
  import { AIEvalClient } from "@evalgate/sdk";
326
326
 
327
- const client = AIEvalClient.init(); // from EVALAI_API_KEY env
327
+ const client = AIEvalClient.init(); // from EVALGATE_API_KEY env
328
328
  // or
329
329
  const client = new AIEvalClient({ apiKey: "...", organizationId: 123 });
330
330
  ```
@@ -367,7 +367,7 @@ npm install openai
367
367
  ## No Lock-in
368
368
 
369
369
  ```bash
370
- rm evalai.config.json
370
+ rm evalgate.config.json
371
371
  ```
372
372
 
373
373
  Your local `openAIChatEval` runs continue to work. No account cancellation. No data export required.
@@ -376,17 +376,17 @@ Your local `openAIChatEval` runs continue to work. No account cancellation. No d
376
376
 
377
377
  See [CHANGELOG.md](CHANGELOG.md) for the full release history.
378
378
 
379
- **v1.8.0** — `evalai doctor` rewrite (9-check checklist), `evalai explain` command, guided failure flow, CI template with doctor preflight
379
+ **v1.8.0** — `evalgate doctor` rewrite (9-check checklist), `evalgate explain` command, guided failure flow, CI template with doctor preflight
380
380
 
381
- **v1.7.0** — `evalai init` scaffolder, `evalai upgrade --full`, `detectRunner()`, machine-readable gate output, init test matrix
381
+ **v1.7.0** — `evalgate init` scaffolder, `evalgate upgrade --full`, `detectRunner()`, machine-readable gate output, init test matrix
382
382
 
383
- **v1.6.0** — `evalai gate`, `evalai baseline`, regression gate constants & types
383
+ **v1.6.0** — `evalgate gate`, `evalgate baseline`, regression gate constants & types
384
384
 
385
385
  **v1.5.8** — secureRoute fix, test infra fixes, 304 handling fix
386
386
 
387
387
  **v1.5.5** — PASS/WARN/FAIL semantics, flake intelligence, golden regression suite
388
388
 
389
- **v1.5.0** — GitHub annotations, `--onFail import`, `evalai doctor`
389
+ **v1.5.0** — GitHub annotations, `--onFail import`, `evalgate doctor`
390
390
 
391
391
  ## License
392
392
 
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "@evalgate/sdk",
3
- "version": "2.1.0",
3
+ "version": "2.1.2",
4
4
  "publishConfig": {
5
5
  "access": "public",
6
6
  "registry": "https://registry.npmjs.org/"