@moda-ai/cli 1.55.39 → 1.55.41
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/dist/{agent-bhe95ae8.js → agent-ck6y31n2.js} +8 -8
- package/dist/{cli-qzag917n.js → cli-0xc5htv7.js} +1 -1
- package/dist/{cli-39617gab.js → cli-1z1sx8dg.js} +3 -3
- package/dist/{cli-jmbt1hf9.js → cli-4tg0hkbz.js} +8 -8
- package/dist/{cli-4hkesrkq.js → cli-77ekrx7d.js} +1 -1
- package/dist/{cli-6gtgm2gx.js → cli-7bn406mt.js} +4 -4
- package/dist/{cli-msgp78ag.js → cli-a8nxbtpk.js} +5 -5
- package/dist/{cli-c7vj8tq1.js → cli-azage7s0.js} +5 -5
- package/dist/{cli-2h2nvq6w.js → cli-daqkdnm1.js} +1 -1
- package/dist/{cli-k9se46y4.js → cli-f1jfrqgf.js} +21 -4
- package/dist/{cli-1vqq24qh.js → cli-gt3yq1y5.js} +2 -2
- package/dist/{cli-ptm7pwqg.js → cli-pmzh2qjy.js} +1 -1
- package/dist/{cli-wr6f0kyw.js → cli-t0pb7qbs.js} +1 -0
- package/dist/{cli-jkza0bj6.js → cli-xddtv3yn.js} +1 -1
- package/dist/{cli-as4c1xwm.js → cli-ypqwcf9n.js} +5 -5
- package/dist/cli.js +313 -26
- package/dist/{doctor-3v20hc26.js → doctor-p8sp6cbk.js} +7 -7
- package/dist/{fix-s3zkjt69.js → fix-0r974yge.js} +4 -4
- package/dist/{harness-n4569wbm.js → harness-72ejenza.js} +5 -5
- package/dist/{harness-github-actions-mcy21e4d.js → harness-github-actions-2qc4gg2w.js} +5 -5
- package/dist/{index-2qm3h7v2.js → index-w7v472w4.js} +11 -11
- package/dist/{production-intelligence-z2cad1hv.js → production-intelligence-e5vsc6cw.js} +143 -30
- package/dist/{profile-commands-7ck1tqfv.js → profile-commands-se9947c1.js} +3 -3
- package/dist/{prompt-attribution-dm50am6e.js → prompt-attribution-3987hhqz.js} +5 -5
- package/dist/prompt-source-mcp.js +5 -5
- package/dist/{prompts-ab-9e0dsmce.js → prompts-ab-gmd10n5d.js} +7 -7
- package/dist/{prompts-propose-91qrjpd0.js → prompts-propose-q626zmm4.js} +7 -7
- package/dist/{prompts-p9hhxx0c.js → prompts-ysm9ra72.js} +5 -5
- package/dist/{provision-x4wkyw60.js → provision-cya5rpxa.js} +5 -5
- package/dist/{registry-nq8qsqtv.js → registry-7xz09ry0.js} +3 -3
- package/dist/{skills-rk2pmwx8.js → skills-x6yszxxn.js} +5 -5
- package/dist/{sync-xxbfjcz5.js → sync-trjzvam9.js} +7 -7
- package/package.json +1 -1
- package/skills/integration/index.json +2 -2
- package/skills/moda-cli/SKILL.md +8 -4
- package/skills/moda-cli/references/commands.md +1 -0
- package/skills/moda-cli/references/detections.md +29 -0
- package/skills/moda-cli/references/production-intelligence.md +5 -1
package/skills/moda-cli/SKILL.md
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: moda-cli
|
|
3
|
-
version: 3.0.
|
|
3
|
+
version: 3.0.7
|
|
4
4
|
description: Investigate a production AI agent with the Moda CLI (`moda`) - find where something happened in real traces (traces search, then traces get), check agent health, rank what to fix (investigate, problems), and dig into tool failures, user frustration, and hallucinations. Also prompt registry sync/promote, replays, custom signals, and false-positive marking. Use when the user mentions Moda, production traces or conversations of their agent, agent failures, or asks what to fix.
|
|
5
5
|
---
|
|
6
6
|
|
|
@@ -60,13 +60,15 @@ Details: `references/output-protocol.md`.
|
|
|
60
60
|
| Where did X happen / traces about Y | `moda traces search "<words>"` (`--mode=keyword` for ids, error codes, exact strings; `--include-tool-io` for tool inputs/outputs) | `moda traces get <conversation_id> --msg-index=<message_index> --window=3` |
|
|
61
61
|
| Search returned nothing | Read `.warnings` (degraded mode, reason). Try a shorter phrase, `--mode=keyword`, a wider `--time-range` | `moda traces --search="<words>"` |
|
|
62
62
|
| Is the agent healthy? | `moda overview --days-back=7` | `moda investigate` |
|
|
63
|
-
| What to fix first? | `moda investigate` or `moda problems list` (free; the same list the dashboard shows) | `moda problems get <problem_id>` (`--view=dream` on a dream-grouped tenant), then `--evidence` / `--traces` |
|
|
63
|
+
| What to fix first? | `moda investigate` or `moda problems list` (free; both rank the same list the dashboard shows, `data.problemsView` names it) | `moda problems get <problem_id>` (`--view=dream` on a dream-grouped tenant), then `--evidence` / `--traces` |
|
|
64
64
|
| Why is tool T failing? | `moda detections tools` | `moda detections tools <T>` (use each row's `anchor`) |
|
|
65
65
|
| How often is tool T called / what is its schema? | `moda tools list` (every tool: calls, failed calls, success rate; `--sort=failure_rate`) | `moda tools get <T>` (registered schema, observed payload fields, usage over time, top failure categories) |
|
|
66
66
|
| What frustrates users? | `moda detections list --family=frustration --limit=10` | `moda traces get <anchor.conversation_id> --msg-index=<anchor.msg_index>` |
|
|
67
67
|
| Other emotions, laziness, hallucinations | `moda detections list --family=emotion:<f>`, `moda detections list --family=laziness`, `moda detections list --family=hallucination --kind=contradicted` | context on the row's anchor |
|
|
68
68
|
| Counts that match the dashboard, dashboard filters | `moda detections list --family=<f> --group-by=trace` (`--trajectory`, `--elicitor`, `--signal`, `--rule`, `--sort`, ...) | `references/detections.md` 5a |
|
|
69
69
|
| Is an empty result really clean? | `moda overview` → `detectors` (is the detector on?); `traces` rows → `processing_status` (pending = not fully processed; detections may be incomplete) | `references/detections.md` 5b |
|
|
70
|
+
| Everything flagged on one trace | `moda traces findings <id>` (every detector family plus its Problems, no time window; up to 25 ids, or `--ids-from=-`) | `moda traces get <id> --msg-index=<n> --window=2` from its `next_commands` |
|
|
71
|
+
| Cross-signal question over many traces (e.g. contradictions and frustration) | `moda traces findings <id1> <id2> ...` (all families per trace, 25 per call), or one family over up to 50 traces in one request: `moda detections list --family=hallucination --conversation-ids=<id1>,<id2>,...` (or `--ids-from=-`) | Never loop `--conversation-id` one trace at a time |
|
|
70
72
|
| Read one whole trace | `moda traces get <id> --all` (pages of up to 500 messages) | `moda traces spans <id>` for raw spans |
|
|
71
73
|
| Read several traces or turns | `moda traces get <id1>@<msg_index> <id2>@<msg_index> ...` (up to 25; or one per line via `--ids-from=-`) | Same for `moda traces spans <id1> <id2> ...` |
|
|
72
74
|
| One user's experience | `moda users`, `moda user <user_id>` | `moda traces search "<words>" --user-id=<id>` |
|
|
@@ -78,14 +80,16 @@ Details: `references/output-protocol.md`.
|
|
|
78
80
|
| Prompts, replays, registry push | Only on explicit request | `references/prompts.md`, `references/replays-and-registry.md` |
|
|
79
81
|
|
|
80
82
|
Time windows differ by command: `--days-back=N` (1-90) on overview,
|
|
81
|
-
investigate, problems, and detection commands
|
|
83
|
+
investigate, problems, and detection commands (`detections list
|
|
84
|
+
--conversation-id` is windowed too, so an older trace reads clean there; use
|
|
85
|
+
`moda traces findings`, which has no window); `--time-range=1h|24h|3d|7d|30d|90d|all`
|
|
82
86
|
on search, traces, and clusters. The other spelling works when it names the
|
|
83
87
|
same span (`--days-back=7` is `--time-range=7d`); anything else fails and
|
|
84
88
|
names the closest values. `moda <noun> <verb> --help` shows which.
|
|
85
89
|
|
|
86
90
|
## Fixing a Problem
|
|
87
91
|
|
|
88
|
-
1. `moda investigate` or `moda problems` to pick one; note its `problem_id`.
|
|
92
|
+
1. `moda investigate` or `moda problems list` to pick one (both show the dashboard's Problems in its order); note its `problem_id`.
|
|
89
93
|
2. `moda problems get <problem_id> --evidence` and open two or three anchors with
|
|
90
94
|
`moda traces get <id> --msg-index=<n>` before deciding on a cause.
|
|
91
95
|
3. Make the change in code; cite the problem id and trace ids in the commit or PR.
|
|
@@ -44,6 +44,7 @@ Loaded on demand from the moda-cli skill. This table can lag the CLI: `moda <com
|
|
|
44
44
|
| `moda signal <signal_id>` | One custom signal; `--detections` pages recent hits (`--days-back` 1–90, `--limit` 1–20, `--offset`) |
|
|
45
45
|
| `moda detections list --family=custom_signal --conversation-id=<conversation_id>` | Custom signal hits on one trace |
|
|
46
46
|
| `moda review custom-signal <signal_id>` | Write: `--conversation-id`, `--verdict=correct\|false_positive\|clear`, optional `--note`, `--msg-index`/`--msg-dedup-token` |
|
|
47
|
+
| `moda traces findings <conversation_id>...` | Everything flagged on a trace, no time window: per family a `state` (`found`/`none`/`not_run`/`unknown`), count and top rows with `msg_index`, plus its Problems; up to 25 ids or `--ids-from`; `--limit` rows per family |
|
|
47
48
|
| `moda traces state <conversation_id>` | Agent memory: slots/threads/events; `--summary-only`; `--snapshot --msg-index=N` (state at a turn); `--replay --message-count=N` (state over time) |
|
|
48
49
|
| `moda failures` | Tool failures only, ranked (no frustrations or Problems) |
|
|
49
50
|
| `moda tail` | Live tail: one JSON line per new trace/detection (`--signal=traces\|emotions\|all`, legacy alias `--signal=conversations`, `--interval=N`, `--once`, `--max-events=N`). **Emotions caveat:** `/emotions` is ranked by score with no time ordering or cursor, so the tail follows the *highest-scoring* detections rather than everything; each poll emits a `tail_coverage` line with `scanned`/`total`/`coverage_pct`/`complete`. Pass `--full-scan` for a complete window scan (many more requests, capped by the API's offset ceiling of 10000). |
|
|
@@ -10,8 +10,37 @@ moda detections list --family=frustration --days-back=14 --limit=20
|
|
|
10
10
|
moda detections list --family=frustration --include-window --window=1 --limit=5 # agent output omits windows unless asked
|
|
11
11
|
moda detections list --family=emotion:frustration --user-id=<id> # one end user
|
|
12
12
|
moda detections list --family=emotion --conversation-id=<id> # every family, one trace
|
|
13
|
+
moda detections list --family=frustration --conversation-ids=<id1>,<id2>,<id3> # several traces, one request
|
|
14
|
+
moda detections list --family=hallucination --ids-from=ids.txt --days-back=30 # ids one per line (or - for stdin)
|
|
13
15
|
```
|
|
14
16
|
|
|
17
|
+
Several traces: `--conversation-ids=a,b,c` (or a JSON array, or `--ids-from=-|<file>`,
|
|
18
|
+
one id per line) takes up to 50 trace ids on `emotion`, `frustration`, `laziness`
|
|
19
|
+
and `hallucination`, and the server filters them in one request. Every figure
|
|
20
|
+
(summary, list, total) then covers just those traces. `--days-back` still
|
|
21
|
+
applies. For `custom_signal` and `tool_failure` per trace, or for every family
|
|
22
|
+
of a trace with no window, use `moda traces findings <id> ...` (below).
|
|
23
|
+
|
|
24
|
+
### Everything flagged on one trace
|
|
25
|
+
|
|
26
|
+
```bash
|
|
27
|
+
moda traces findings <conversation_id> # every family + its Problems, no time window
|
|
28
|
+
moda traces findings <id1> <id2> <id3> # up to 25 ids, one envelope (or --ids-from=-|<file>)
|
|
29
|
+
moda traces findings <conversation_id> --limit=10 # more rows per family (default 3; counts cover all)
|
|
30
|
+
```
|
|
31
|
+
|
|
32
|
+
One read per trace returns emotion, laziness, hallucination (contradicted claims),
|
|
33
|
+
tool failure (with its category) and custom signal detections, each with the
|
|
34
|
+
`msg_index` it anchors to, plus the Problems the trace is evidence for (id, title,
|
|
35
|
+
attribution count, `in_book`). There is no time window, so a trace older than
|
|
36
|
+
`--days-back` does not read clean. Each family has a `state`:
|
|
37
|
+
`found`, `none` (its detector ran and found nothing), `not_run` (detector off for
|
|
38
|
+
the workspace, or the trace not processed yet) or `unknown` (nothing found, and the
|
|
39
|
+
detector records nothing for a clean trace, as laziness does). Only `none` means
|
|
40
|
+
clean. `next_commands` open each anchor with
|
|
41
|
+
`moda traces get <id> --msg-index=<n> --window=2`. `--json` returns the full
|
|
42
|
+
response (up to 50 rows per family).
|
|
43
|
+
|
|
15
44
|
In agent output, `frustrations` and `emotions` rows leave out the embedded
|
|
16
45
|
conversation window (most of each row) unless you pass `--include-window`;
|
|
17
46
|
each row keeps `anchor` and a `context_command` to read the turns around it.
|
|
@@ -55,7 +55,11 @@ Data API fallback. Abbreviated envelope:
|
|
|
55
55
|
narrows the tool-failure evidence to one tool, and `--trace` (legacy alias
|
|
56
56
|
`--conversation`) scopes only the frustration evidence (overview, tool
|
|
57
57
|
failures and Problems stay tenant-wide). Its findings include the top 1–3
|
|
58
|
-
Problems
|
|
58
|
+
Problems of the list `moda problems list` shows (the dream grouping when the
|
|
59
|
+
dashboard shows one, otherwise the Book), in the same order, with
|
|
60
|
+
`moda problems get <id>` as the next command. `data.problemsView` names the
|
|
61
|
+
view, the window its counts cover, and the `moda problems list` command that
|
|
62
|
+
lists the same Problems.
|
|
59
63
|
`moda failures` is the tool-failures-only view.
|
|
60
64
|
|
|
61
65
|
After reporting the top behavioral failure and the harness layer it routes to
|