@roarkanalytics/cli 0.33.0 → 0.35.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
@@ -32,6 +32,12 @@ Maximum duration in seconds for each simulation Required.
32
32
  \fB\-\-silence\-timeout\-seconds\fR \fI<value>\fR
33
33
  Timeout in seconds for silence detection Optional.
34
34
  .TP
35
+ \fB\-\-max\-no\-response\-retries\fR \fI<value>\fR
36
+ How many more times to run a test case when the agent under test never responds: it never speaks on a call or never replies in a chat (0\-10). 0 turns retries off. Failed checks and failures on Roark’s side are never retried. Each retry is a separate attempt, billed like any other, so a plan retrying N times can place up to N + 1 calls per test case. Every silent attempt stays on the run with its own call; the run settles once each test case has a final attempt, and the agent never spoke verdict is judged on each test case’s last attempt. Optional.
37
+ .TP
38
+ \fB\-\-no\-response\-retry\-backoff\-seconds\fR \fI<value>\fR
39
+ Seconds a retry waits before it dials (30\-600). Only used when `maxNoResponseRetries` is above 0. Optional.
40
+ .TP
35
41
  \fB\-\-end\-call\-phrases\fR \fI<value>\fR
36
42
  Phrases that trigger end of call. Empty array disables the feature. Repeatable. Optional.
37
43
  .TP
@@ -54,7 +60,7 @@ Personas to include in this run plan. Required with `scenarios`; ignored with `f
54
60
  Agent endpoints to include in this run plan Required.
55
61
  .TP
56
62
  \fB\-\-metrics\fR \fI<value>\fR
57
- Metric definitions to include in this run plan. Reference each by `id` (UUID) or `slug`. Required.
63
+ Metric definitions to include in this run plan. Reference each by `id` (UUID) or `slug`. Optional when the attached `flows` carry the grading: metrics a flow declares itself (with `includeFlowMetrics`), or the Agent Expectations and Keypad Entry metrics a run adds for flows with expectations or expected keypad entries (with `includeAutomaticMetrics`). A plan with nothing to grade is rejected with a 400. Optional.
58
64
  .TP
59
65
  \fB\-\-include\-flow\-metrics\fR
60
66
  Also collect each attached flow's own metrics, on top of the `metrics` named here. Default true, which is what you want when you brought your own flows and their graders. Set false for a run whose metric list is meant to be exhaustive: a template like Load Testing or Voicemail deliberately grades a narrow set, and inheriting every flow metric on top multiplies analysis cost across the volume without adding signal. GET /v1/simulation/template returns the value each template expects. Optional.
@@ -117,7 +123,7 @@ Send the stored credential to a base URL set by a project .roark.json. Refused b
117
123
  .PP
118
124
  .RS 4
119
125
  .nf
120
- roark simulation plan create \-\-name <value> \-\-direction <value> \-\-max\-simulation\-duration\-seconds <value> \-\-agent\-endpoints <value> \-\-metrics <value>
126
+ roark simulation plan create \-\-name <value> \-\-direction <value> \-\-max\-simulation\-duration\-seconds <value> \-\-agent\-endpoints <value>
121
127
  .fi
122
128
  .RE
123
129
  .SH "ENVIRONMENT"
@@ -39,6 +39,12 @@ Maximum duration in seconds for each simulation Optional.
39
39
  \fB\-\-silence\-timeout\-seconds\fR \fI<value>\fR
40
40
  Timeout in seconds for silence detection Optional.
41
41
  .TP
42
+ \fB\-\-max\-no\-response\-retries\fR \fI<value>\fR
43
+ How many more times to run a test case when the agent under test never responds: it never speaks on a call or never replies in a chat (0\-10). 0 turns retries off. Failed checks and failures on Roark’s side are never retried. Each retry is a separate attempt, billed like any other, so a plan retrying N times can place up to N + 1 calls per test case. Every silent attempt stays on the run with its own call; the run settles once each test case has a final attempt, and the agent never spoke verdict is judged on each test case’s last attempt. Optional.
44
+ .TP
45
+ \fB\-\-no\-response\-retry\-backoff\-seconds\fR \fI<value>\fR
46
+ Seconds a retry waits before it dials (30\-600). Only used when `maxNoResponseRetries` is above 0. Optional.
47
+ .TP
42
48
  \fB\-\-end\-call\-phrases\fR \fI<value>\fR
43
49
  Phrases that trigger end of call. Empty array disables the feature. Repeatable. Optional.
44
50
  .TP
@@ -1,12 +1,12 @@
1
1
  {
2
2
  "name": "@roarkanalytics/cli",
3
- "version": "0.33.0",
3
+ "version": "0.35.0",
4
4
  "lockfileVersion": 3,
5
5
  "requires": true,
6
6
  "packages": {
7
7
  "": {
8
8
  "name": "@roarkanalytics/cli",
9
- "version": "0.33.0",
9
+ "version": "0.35.0",
10
10
  "license": "Apache-2.0",
11
11
  "dependencies": {
12
12
  "@roarkanalytics/sdk": "^4.15.0",
@@ -21,9 +21,9 @@
21
21
  }
22
22
  },
23
23
  "node_modules/@roarkanalytics/sdk": {
24
- "version": "4.18.0",
25
- "resolved": "https://registry.npmjs.org/@roarkanalytics/sdk/-/sdk-4.18.0.tgz",
26
- "integrity": "sha512-+s6s6Owxqe/Mvh6/7TkNbYcVtsrdjYYciRrpinTSURliSnM+T63XWZW0lkEuIvn4d+Y/BTbNDtRtP14aCpw72A==",
24
+ "version": "4.20.0",
25
+ "resolved": "https://registry.npmjs.org/@roarkanalytics/sdk/-/sdk-4.20.0.tgz",
26
+ "integrity": "sha512-IclxkzUd8WpjX3W5yhI/rUFcMbCXaVqym67A91pXzb2woGOsYMbH58GIj3Xvd24EChL14wjcLrH1Ev8lVGoxUA==",
27
27
  "license": "Apache-2.0"
28
28
  },
29
29
  "node_modules/commander": {
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "@roarkanalytics/cli",
3
- "version": "0.33.0",
3
+ "version": "0.35.0",
4
4
  "description": "The official command line interface for the Roark API",
5
5
  "author": "Roark <james@roark.ai>",
6
6
  "type": "commonjs",
package/version.d.ts CHANGED
@@ -1 +1 @@
1
- export declare const version = "0.33.0";
1
+ export declare const version = "0.35.0";
package/version.js CHANGED
@@ -10,4 +10,4 @@ exports.version = void 0;
10
10
  //
11
11
  // Do not edit: an edit here is overwritten, and the published number is whatever
12
12
  // package.json says.
13
- exports.version = '0.33.0'; // x-release-please-version
13
+ exports.version = '0.35.0'; // x-release-please-version