@artemiskit/cli 0.2.2 → 0.2.3
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +41 -0
- package/dist/index.js +751 -342
- package/dist/src/commands/history.d.ts.map +1 -1
- package/dist/src/commands/redteam.d.ts.map +1 -1
- package/dist/src/commands/run.d.ts.map +1 -1
- package/dist/src/commands/stress.d.ts.map +1 -1
- package/package.json +6 -6
- package/src/commands/history.ts +58 -9
- package/src/commands/redteam.ts +19 -1
- package/src/commands/run.ts +113 -3
- package/src/commands/stress.ts +28 -0
package/CHANGELOG.md
CHANGED
|
@@ -1,5 +1,46 @@
|
|
|
1
1
|
# @artemiskit/cli
|
|
2
2
|
|
|
3
|
+
## 0.2.3
|
|
4
|
+
|
|
5
|
+
### Patch Changes
|
|
6
|
+
|
|
7
|
+
- 37403aa: ## v0.2.3 - Cost Tracking & Compliance Features
|
|
8
|
+
|
|
9
|
+
### Cost Tracking
|
|
10
|
+
|
|
11
|
+
- **Automatic cost estimation**: Run results now include estimated API costs based on token usage and model pricing data
|
|
12
|
+
- **Cost display in output**: Summary output shows total tokens and estimated cost for each run
|
|
13
|
+
- **`--budget` flag**: Set a maximum budget in USD for `run`, `redteam`, and `stress` commands - the command fails (exit code 1) if the estimated cost exceeds the budget
|
|
14
|
+
|
|
15
|
+
### History Enhancements
|
|
16
|
+
|
|
17
|
+
- **`--show-cost` flag**: Display cost column and total in `history` command output
|
|
18
|
+
- Cost data is stored with each run for historical tracking
|
|
19
|
+
|
|
20
|
+
### Markdown Export
|
|
21
|
+
|
|
22
|
+
- **`--export markdown` flag**: Export run and redteam results to compliance-ready markdown format
|
|
23
|
+
- **`--export-output` flag**: Specify custom output directory for exports (default: `./artemis-exports`)
|
|
24
|
+
- Markdown reports include:
|
|
25
|
+
- Summary table with pass/fail rates, latency, token usage, and cost metrics
|
|
26
|
+
- Detailed results for failed test cases (run) or vulnerabilities found (redteam)
|
|
27
|
+
- Configuration used for the run
|
|
28
|
+
- Redaction summary (if enabled)
|
|
29
|
+
- Recommendations for remediation (redteam)
|
|
30
|
+
|
|
31
|
+
### CI/CD Integration
|
|
32
|
+
|
|
33
|
+
- Budget enforcement in pipelines: `akit run scenarios/ --ci --budget 5.00`
|
|
34
|
+
- Cost tracking in CI summary output with `ARTEMISKIT_COST_USD` variable
|
|
35
|
+
- Automatic markdown report generation for compliance documentation
|
|
36
|
+
|
|
37
|
+
- Updated dependencies [37403aa]
|
|
38
|
+
- @artemiskit/core@0.2.3
|
|
39
|
+
- @artemiskit/reports@0.2.3
|
|
40
|
+
- @artemiskit/adapter-openai@0.1.10
|
|
41
|
+
- @artemiskit/adapter-vercel-ai@0.1.10
|
|
42
|
+
- @artemiskit/redteam@0.2.3
|
|
43
|
+
|
|
3
44
|
## 0.2.2
|
|
4
45
|
|
|
5
46
|
### Patch Changes
|