@artemiskit/cli 0.2.3 → 0.2.4
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +44 -0
- package/dist/index.js +1075 -461
- package/dist/src/cli.d.ts.map +1 -1
- package/dist/src/commands/redteam.d.ts.map +1 -1
- package/dist/src/commands/run.d.ts.map +1 -1
- package/dist/src/commands/validate.d.ts +6 -0
- package/dist/src/commands/validate.d.ts.map +1 -0
- package/package.json +6 -6
- package/src/cli.ts +2 -0
- package/src/commands/redteam.ts +17 -8
- package/src/commands/run.ts +18 -10
- package/src/commands/validate.ts +254 -0
package/CHANGELOG.md
CHANGED
|
@@ -1,5 +1,49 @@
|
|
|
1
1
|
# @artemiskit/cli
|
|
2
2
|
|
|
3
|
+
## 0.2.4
|
|
4
|
+
|
|
5
|
+
### Patch Changes
|
|
6
|
+
|
|
7
|
+
- 16604a6: ## New Features
|
|
8
|
+
|
|
9
|
+
### Validate Command
|
|
10
|
+
|
|
11
|
+
New `artemiskit validate` command for validating scenario files without running them:
|
|
12
|
+
|
|
13
|
+
- **YAML syntax validation** - Catches formatting errors
|
|
14
|
+
- **Schema validation** - Validates against ArtemisKit schema using Zod
|
|
15
|
+
- **Semantic validation** - Detects duplicate case IDs, undefined variables
|
|
16
|
+
- **Warnings** - Identifies deprecated fields, missing descriptions, performance hints
|
|
17
|
+
|
|
18
|
+
Options:
|
|
19
|
+
|
|
20
|
+
- `--json` - Output results as JSON
|
|
21
|
+
- `--strict` - Treat warnings as errors
|
|
22
|
+
- `--quiet` - Only show errors
|
|
23
|
+
- `--export junit` - Export to JUnit XML for CI integration
|
|
24
|
+
|
|
25
|
+
### JUnit XML Export
|
|
26
|
+
|
|
27
|
+
Added JUnit XML export support for CI/CD integration with Jenkins, GitHub Actions, GitLab CI, and other systems:
|
|
28
|
+
|
|
29
|
+
- `akit run scenarios/ --export junit` - Export run results
|
|
30
|
+
- `akit redteam scenarios/chatbot.yaml --export junit` - Export security test results
|
|
31
|
+
- `akit validate scenarios/ --export junit` - Export validation results
|
|
32
|
+
|
|
33
|
+
JUnit reports include:
|
|
34
|
+
|
|
35
|
+
- Test suite metadata (run ID, provider, model, success rate)
|
|
36
|
+
- Individual test cases with pass/fail status
|
|
37
|
+
- Failure details with matcher type and expected values
|
|
38
|
+
- Timing information for each test
|
|
39
|
+
|
|
40
|
+
- Updated dependencies [16604a6]
|
|
41
|
+
- @artemiskit/core@0.2.4
|
|
42
|
+
- @artemiskit/reports@0.2.4
|
|
43
|
+
- @artemiskit/adapter-openai@0.1.11
|
|
44
|
+
- @artemiskit/adapter-vercel-ai@0.1.11
|
|
45
|
+
- @artemiskit/redteam@0.2.4
|
|
46
|
+
|
|
3
47
|
## 0.2.3
|
|
4
48
|
|
|
5
49
|
### Patch Changes
|