@netlify/agent-runner-cli 2.15.0 → 2.15.1-id-setup-req.1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/README.md CHANGED
@@ -8,6 +8,11 @@ Everyone is a developer. `@netlify/agent-runner-cli` powers Netlify users to tur
8
8
 
9
9
  See [CONTRIBUTING.md](CONTRIBUTING.md) for dev setup, testing, and release process.
10
10
 
11
+ ## Evals
12
+
13
+ The quality and trajectory evals run as GitHub Actions. [EVALS.md](EVALS.md) covers how to run them, their inputs and
14
+ the valid values.
15
+
11
16
  ## Debugging a run
12
17
 
13
18
  Logs are in Humio under `$aro()`, the macro for `agent_runner=true | kvParse(msg)` — every orchestrator line, with the
@@ -27,7 +32,7 @@ group — the quickest way from "runs are failing" to which failures. A truncate
27
32
  Rates belong in Datadog, not here: `buildbot.dev_server.{start,error}{agent_runner:true}` carry the `stage`
28
33
  (`repo_prep` / `agent_runner` / `fetch_build_zip`), `cause` and `provider_error` tags. `cause` and `provider_error`
29
34
  exist nowhere in Humio — buildbot computes them for the metric only. This repo's own counters are
30
- `buildbot.agent_runner.*`.
35
+ `buildbot.agent_runner.*`
31
36
 
32
37
  See [Observability](https://app.notion.com/p/3e61da88359a81bcb2d8c9f58dbb32ef) for the rest and what each field means.
33
38