create-orcha 0.3.1 → 0.4.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/package.json +1 -1
- package/template/orcha/AGENTS.md +38 -51
- package/template/orcha/index.ts +0 -3
- package/template/orcha/orderSupport/actions/lookupOrder/index.json +0 -1
- package/template/orcha/approvalAgent/evaluations/index.js +0 -5
- package/template/orcha/approvalAgent/skills/index.js +0 -5
- package/template/orcha/approvalAgent/tests/index.js +0 -5
- package/template/orcha/assistant/evaluations/index.js +0 -5
- package/template/orcha/assistant/skills/index.js +0 -5
- package/template/orcha/assistant/tests/index.js +0 -5
- package/template/orcha/orderSupport/evaluations/index.js +0 -5
- package/template/orcha/orderSupport/skills/index.js +0 -5
- package/template/orcha/orderSupport/tests/index.js +0 -5
package/package.json
CHANGED
package/template/orcha/AGENTS.md
CHANGED
|
@@ -7,14 +7,14 @@ files under `.orcha/`.
|
|
|
7
7
|
## Commands
|
|
8
8
|
|
|
9
9
|
- `orcha init` creates the initial Orcha files without overwriting files.
|
|
10
|
-
- `orcha dev` validates
|
|
10
|
+
- `orcha dev` validates agent source and watches `orcha/**` for changes.
|
|
11
11
|
- `orcha playground` opens the built-in local UI and hot reloads agent source.
|
|
12
12
|
- `orcha run <agent> --input "…"` executes one registered agent.
|
|
13
13
|
- `orcha run <agent> --input-file request.json` accepts structured input.
|
|
14
14
|
- `orcha run <agent> --session <id> --input "…"` continues a session.
|
|
15
15
|
- `orcha run <agent> --session <id> --tool-results results.json` submits
|
|
16
16
|
pending client-action results.
|
|
17
|
-
- `orcha test` runs every
|
|
17
|
+
- `orcha test` runs every enabled discovered agent test.
|
|
18
18
|
- `orcha test <agent>` or `orcha test <agent>/<case>` narrows the run.
|
|
19
19
|
- `orcha build` creates the production Orcha bundle without calling models.
|
|
20
20
|
- Add `--json` to `run` and `test` for machine-readable output.
|
|
@@ -35,17 +35,16 @@ orcha.init({
|
|
|
35
35
|
anthropic: process.env.ANTHROPIC_API_KEY ?? "",
|
|
36
36
|
openai: process.env.OPENAI_API_KEY ?? "",
|
|
37
37
|
},
|
|
38
|
-
actions: { runtime: "native" },
|
|
39
38
|
agents: {
|
|
40
39
|
supportBot: "./supportBot",
|
|
41
40
|
},
|
|
42
41
|
});
|
|
43
42
|
```
|
|
44
43
|
|
|
45
|
-
Only registered
|
|
46
|
-
such as `orcha.supportBot`.
|
|
47
|
-
|
|
48
|
-
|
|
44
|
+
Only registered agents are compiled. Agent keys become runtime properties
|
|
45
|
+
such as `orcha.supportBot`. Local actions use the native Node.js runtime by
|
|
46
|
+
default. Set `actions.runtime: "sandbox"` only when isolated execution is
|
|
47
|
+
required.
|
|
49
48
|
|
|
50
49
|
`orcha.init()` fields:
|
|
51
50
|
|
|
@@ -53,8 +52,8 @@ allows action modules to execute in its Node.js process.
|
|
|
53
52
|
name.
|
|
54
53
|
- `agents` (required): runtime property names mapped to folders relative to
|
|
55
54
|
`orcha/`. At least one agent is required.
|
|
56
|
-
- `actions` (
|
|
57
|
-
|
|
55
|
+
- `actions` (optional): overrides the native local-action runtime or configures
|
|
56
|
+
its environment and sandbox settings.
|
|
58
57
|
- `storage.strategy` (optional): currently only `"node-jsonl"`.
|
|
59
58
|
- `storage.directory` (optional): session directory relative to project
|
|
60
59
|
root; defaults to `.orcha/sessions`.
|
|
@@ -363,7 +362,6 @@ actions/
|
|
|
363
362
|
{
|
|
364
363
|
"name": "lookup_account",
|
|
365
364
|
"description": "Look up one account.",
|
|
366
|
-
"execution": "local",
|
|
367
365
|
"parameters": {
|
|
368
366
|
"type": "object",
|
|
369
367
|
"properties": {
|
|
@@ -402,8 +400,10 @@ Action `index.json` fields:
|
|
|
402
400
|
- `name` (required): model-facing tool name, 1–64 letters, numbers,
|
|
403
401
|
underscores, or hyphens. `load_skill` is reserved.
|
|
404
402
|
- `description` (required): tells the model when and why to call the action.
|
|
405
|
-
- `
|
|
406
|
-
|
|
403
|
+
- `enabled` (optional): defaults to `true`. Set to `false` to keep a WIP
|
|
404
|
+
action inactive without deleting its folder.
|
|
405
|
+
- `execution` (optional): defaults to `"local"`, which executes `index.js`.
|
|
406
|
+
Set to `"client"` to pause and delegate execution to the application.
|
|
407
407
|
- `parameters` (required): JSON Schema for model-generated arguments.
|
|
408
408
|
- `outputSchema` (optional): JSON Schema validated against local or submitted
|
|
409
409
|
client output before the model receives it.
|
|
@@ -432,7 +432,7 @@ Global local-action configuration:
|
|
|
432
432
|
|
|
433
433
|
```ts
|
|
434
434
|
actions: {
|
|
435
|
-
runtime: "sandbox", //
|
|
435
|
+
runtime: "sandbox", // optional; native is the default
|
|
436
436
|
env: {
|
|
437
437
|
BILLING_API_TOKEN: process.env.BILLING_API_TOKEN,
|
|
438
438
|
},
|
|
@@ -450,18 +450,9 @@ allowlisted `env`, guarded `fetch`, and prefixed `log`.
|
|
|
450
450
|
|
|
451
451
|
## Skills
|
|
452
452
|
|
|
453
|
-
Skills are lazy-loaded procedural instructions.
|
|
454
|
-
|
|
455
|
-
|
|
456
|
-
// skills/index.js
|
|
457
|
-
import { defineSkills } from "orchajs/skills";
|
|
458
|
-
|
|
459
|
-
export default defineSkills({
|
|
460
|
-
incidentTriage: "./incidentTriage",
|
|
461
|
-
});
|
|
462
|
-
```
|
|
463
|
-
|
|
464
|
-
Each skill folder contains `index.json` metadata and `instructions.md`.
|
|
453
|
+
Skills are lazy-loaded procedural instructions. Direct child folders under
|
|
454
|
+
`skills/` are discovered automatically. Each folder contains `index.json`
|
|
455
|
+
metadata and `instructions.md`.
|
|
465
456
|
The model receives a compact catalog and can call the internal `load_skill`
|
|
466
457
|
tool. Loaded instructions remain active for the durable session. Lifecycle
|
|
467
458
|
events are `skill.requested`, `skill.loaded`, and `skill.failed`.
|
|
@@ -471,27 +462,19 @@ Skill `index.json` fields:
|
|
|
471
462
|
- `name` (required): model-facing name, 1–64 letters, numbers, underscores,
|
|
472
463
|
or hyphens; unique within the agent.
|
|
473
464
|
- `description` (required): compact catalog description shown before loading.
|
|
465
|
+
- `enabled` (optional): defaults to `true`. Set to `false` to keep a WIP
|
|
466
|
+
skill inactive.
|
|
474
467
|
- `triggers` (optional): non-empty array of non-empty situations describing
|
|
475
468
|
when the model should load the skill.
|
|
476
469
|
|
|
477
|
-
`instructions.md` is required and cannot be empty
|
|
478
|
-
`
|
|
479
|
-
name used by the model and durable events. Unregistered folders are ignored.
|
|
470
|
+
`instructions.md` is required and cannot be empty for enabled skills.
|
|
471
|
+
`index.json.name` is the name used by the model and durable events.
|
|
480
472
|
|
|
481
473
|
## Tests
|
|
482
474
|
|
|
483
|
-
|
|
484
|
-
|
|
485
|
-
|
|
486
|
-
import { defineTests } from "orchajs/testing";
|
|
487
|
-
|
|
488
|
-
export default defineTests({
|
|
489
|
-
activeAccount: "./activeAccount",
|
|
490
|
-
});
|
|
491
|
-
```
|
|
492
|
-
|
|
493
|
-
Each case's `index.json` defines `input`, optional mocked action responses,
|
|
494
|
-
and `expect`. Tests run the real compiled agent and provider. Actions listed
|
|
475
|
+
Direct child folders under `tests/` are discovered automatically. Each
|
|
476
|
+
case's `index.json` defines `input`, optional mocked action responses, and
|
|
477
|
+
`expect`. Tests run the real compiled agent and provider. Actions listed
|
|
495
478
|
under `actions` are mocked; unlisted local actions execute live. Orcha reports
|
|
496
479
|
live action use in the terminal, test report, and session trace.
|
|
497
480
|
Client actions must always be mocked because no application client is attached
|
|
@@ -526,7 +509,11 @@ through action-argument assertions.
|
|
|
526
509
|
|
|
527
510
|
Test `index.json` fields:
|
|
528
511
|
|
|
512
|
+
- `name` (optional): friendly display name. The folder name remains the CLI
|
|
513
|
+
selector.
|
|
529
514
|
- `description` (optional): human-readable purpose.
|
|
515
|
+
- `enabled` (optional): defaults to `true`. Set to `false` to keep a WIP test
|
|
516
|
+
inactive.
|
|
530
517
|
- `input` (required): an inline agent input object or a path to a JSON file
|
|
531
518
|
containing that object. Relative paths resolve from the test case directory.
|
|
532
519
|
- `input.content` (required for inline input): string or multimodal content
|
|
@@ -548,15 +535,13 @@ Test `index.json` fields:
|
|
|
548
535
|
- `expect.actions` (optional): ordered expected calls. Each may assert
|
|
549
536
|
`arguments.equals` or `arguments.partial`.
|
|
550
537
|
|
|
551
|
-
The
|
|
552
|
-
`orcha test agent/testName`; its value resolves to the case folder.
|
|
538
|
+
The test folder name is the selector used by `orcha test agent/testName`.
|
|
553
539
|
|
|
554
540
|
## Evaluations
|
|
555
541
|
|
|
556
|
-
Evaluations are asynchronous LLM judges
|
|
557
|
-
`evaluations
|
|
558
|
-
|
|
559
|
-
model, metrics, and thresholds:
|
|
542
|
+
Evaluations are asynchronous LLM judges discovered from direct child folders
|
|
543
|
+
under `evaluations/`. Each folder's `index.json` defines its provider, model,
|
|
544
|
+
metrics, and thresholds:
|
|
560
545
|
|
|
561
546
|
```json
|
|
562
547
|
{
|
|
@@ -589,8 +574,8 @@ Evaluation `index.json` fields:
|
|
|
589
574
|
- `description` (optional): short human-facing summary of the evaluator.
|
|
590
575
|
- `instructions` (optional): detailed prompt supplied to the judge. When
|
|
591
576
|
omitted, `description` is used for backward compatibility.
|
|
592
|
-
- `enabled` (optional): defaults to `true`. Disabled evaluations are
|
|
593
|
-
|
|
577
|
+
- `enabled` (optional): defaults to `true`. Disabled evaluations are ignored
|
|
578
|
+
by compilation and runtime.
|
|
594
579
|
- `provider` and `model` (required): independently select the judge. The
|
|
595
580
|
provider must also exist in `orcha.init().providers`.
|
|
596
581
|
- `maxTokens` (optional): positive integer; defaults to 2000 for judges.
|
|
@@ -974,8 +959,9 @@ number. A conversational `resume(...content)` starts a new run number.
|
|
|
974
959
|
1. `orcha/index.ts` calls `orcha.init()` with explicit agent paths.
|
|
975
960
|
2. The compiler reads each registered agent's `index.json` and
|
|
976
961
|
`instructions.md`.
|
|
977
|
-
3.
|
|
978
|
-
evaluations are
|
|
962
|
+
3. Direct child folders under `actions/`, `skills/`, `tests/`, and
|
|
963
|
+
`evaluations/` are discovered automatically. Items with `"enabled": false`
|
|
964
|
+
remain inactive.
|
|
979
965
|
4. Local action source is bundled and SHA-256 hashed. Production bundles keep
|
|
980
966
|
only provider adapters required by agents and enabled evaluations.
|
|
981
967
|
5. Invalid paths, duplicate model-facing names, missing files, unsupported
|
|
@@ -1056,7 +1042,8 @@ needed for faithful continuation but are omitted from evaluation transcripts.
|
|
|
1056
1042
|
|
|
1057
1043
|
## Change rules
|
|
1058
1044
|
|
|
1059
|
-
- Register every new agent
|
|
1045
|
+
- Register every new agent and subagent explicitly. Agent-owned actions, skills,
|
|
1046
|
+
tests, and evaluations are auto-discovered; use `"enabled": false` for WIP.
|
|
1060
1047
|
- Keep runtime behavior provider-neutral.
|
|
1061
1048
|
- Mock actions when tests must avoid side effects; document intentional live
|
|
1062
1049
|
action coverage.
|
package/template/orcha/index.ts
CHANGED