squally-mcp 0.6.1 → 0.8.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/README.md CHANGED
@@ -23,7 +23,7 @@ by the API, not by this client.
23
23
  Worth knowing before you hand a key to an assistant. Through this server an
24
24
  agent can read:
25
25
 
26
- - your **projects**, their names and stable branches;
26
+ - your **projects** and their names;
27
27
  - your **runs**, CI and local — commit SHA and message, branch, author, pull
28
28
  request, job key, a link to the CI run, timing, pass/fail counts;
29
29
  - **per-test results** for a run, including which shard ran what;
@@ -142,7 +142,7 @@ squally-mcp trusts your operating system's certificate store, like your browser
142
142
  | `squally-get-run` | One run with its per-test rows, across all shards. Which test is red. | cheap |
143
143
  | `squally-debug-failure` | Every attempt of one test in one run: error, stack, full-context prompt. | cheap |
144
144
  | `squally-get-test-metrics` | One test's stability, flaky rate and failure rate over a period. | cheap — one test |
145
- | `squally-list-tests` | Every test with a CI run in the period, ranked by stability, flaky rate or failures. | cheap — two queries, paged |
145
+ | `squally-list-tests` | Every test with a run in the period, ranked by stability, flaky rate or failures. | cheap — two queries, paged |
146
146
  | `squally-list-errors` | Error signatures in a period: what keeps failing, grouped, and how its runs ended. | cheap |
147
147
 
148
148
  For a single test use `squally-get-test-metrics`, not `squally-list-tests` —
@@ -169,15 +169,15 @@ has one linked repository).
169
169
 
170
170
  ### What the numbers mean
171
171
 
172
- The two test tools count **finished CI runs** in the period (7, 14, 30 or 90
172
+ The two test tools count **finished runs, CI and local,** in the period (7, 14, 30 or 90
173
173
  days; 30 by default), on every branch unless you name one. A run finishes when
174
174
  all its shards have - or, once the run timeout has passed, with the results its
175
175
  shards reported, like a cancelled run; a shard stopped by the monthly result
176
176
  limit counts like one that timed out. A sharded run counts once, placed in the period
177
177
  by its first shard's start; a run that was a mass failure as a whole is left
178
- out. Local runs count only
179
- when you ask for them: `source` is `ci` (the default), `local` or `all`, and
180
- the response's `population` names which runs it counted. Per test:
178
+ out. `source` is `all` (the default since read API 1.0.0-beta.18; `ci`
179
+ before), `ci` or `local` - send `source=ci` for CI runs only - and the
180
+ response's `population` names which runs it counted. Per test:
181
181
 
182
182
  - **stability** — runs that passed on the first try ÷ runs;
183
183
  - **flakyRate** — runs that passed only after a retry ÷ runs;
@@ -23,6 +23,9 @@
23
23
  //
24
24
  // THE SOURCE SINCE 0.4.0 (API 1.0.0-beta.8): CI runs by default; local runs
25
25
  // count only when the agent asks for them - they were never counted before.
26
+ // ALL BY DEFAULT SINCE 0.8.0 (API 1.0.0-beta.18, 23.10.2026): CI and local
27
+ // runs both count unless the agent sends source=ci or source=local - the
28
+ // API's default moved, and the sentence follows it.
26
29
  //
27
30
  // THE RUN TIMEOUT (API 1.0.0-beta.10, since 0.5.0): a run whose shard died or
28
31
  // never started counts once the run timeout has passed, with the shards that
@@ -50,9 +53,9 @@
50
53
  export const INSTRUCTIONS = [
51
54
  "Start with squally-list-projects; every other tool needs a projectId from it.",
52
55
  "For one test, use squally-get-test-metrics, not squally-list-tests.",
53
- "Test metrics count the finished CI runs of the period - a sharded run counts once -",
54
- "without runs that were a mass failure as a whole; pass source=local or source=all",
55
- "to count local runs or both. A run still in progress counts once all its shards have",
56
+ "Test metrics count the finished runs of the period, CI and local - a sharded run counts once -",
57
+ "without runs that were a mass failure as a whole; pass source=ci or source=local",
58
+ "to count only one of them. A run still in progress counts once all its shards have",
56
59
  "finished, or once the run timeout has passed, with the results its shards reported -",
57
60
  "also when a shard was stopped by the monthly result limit.",
58
61
  "stability = runs that passed on the",
@@ -3,7 +3,7 @@
3
3
  "jsonSchemaDialect": "https://json-schema.org/draft/2020-12/schema",
4
4
  "info": {
5
5
  "title": "Squally Read API",
6
- "version": "1.0.0-beta.16",
6
+ "version": "1.0.0-beta.18",
7
7
  "description": "Read access to a Squally organization's test results, for scripts, CI jobs and AI agents.\n\n**Authentication.** Every request carries an organization read key as `Authorization: Bearer sqly_ro_…`. A read key is organization-wide (every project), created by an organization admin in Organization › Read keys, and expires after 30, 60, 90, 180 days as chosen at creation. There is no renewal: create a new key and revoke the old one. Project ingest keys (`sqly_…`) are refused with `wrong_key_type`.\n\n**Expiry warning.** From 7 days before a key expires, every authenticated response carries `Squally-Key-Expires-At` with the expiry instant (ISO-8601).\n\n**Rate limit.** Currently 60 requests per 60 seconds per key, counted per `Authorization` header - a read key has its own budget, shared with nothing else. Over the limit the edge answers 429 without a JSON body.\n\n**Retries.** 429: wait 60 seconds, then retry. The edge counts requests per key in 60-second windows and sends no Retry-After header. 5xx: retry with exponential backoff, starting at 1 second and capped at 30 seconds. 400, 401, 403, 404: never retry - the same request gets the same answer.\n\n**Plans.** The read API is part of the Standard and Pro plans. A key of an organization on Free is answered 403 `tier_too_low`; keys are not revoked on a downgrade and work again after an upgrade.\n\n**Errors.** Every error is `{\"error\": \"<sentence>\", \"code\": \"<slug>\"}`. The sentence may be reworded; the slug may not. An id that does not exist and an id that belongs to another organization get the same 404, byte for byte.\n\n**Test names in paths.** Test names are Playwright title paths and often contain `/`: URL-encode them, including `/` as `%2F`.\n\n**Sharded runs** are returned as one logical run: /runs lists one row per logical run, and the run routes answer for all shards whichever shard's id you pass.\n\n**Stability.** v1, beta. The API may change until the beta ends; every change is listed in the changelog (docs/openapi/CHANGELOG.md)."
8
8
  },
9
9
  "servers": [
@@ -173,13 +173,11 @@
173
173
  {
174
174
  "id": "3f7c2a91-5b8e-4d0a-9c61-2e4b7f0d8a15",
175
175
  "name": "storefront-web",
176
- "stableBranch": "main",
177
176
  "createdAt": "2026-06-02T09:14:00.000Z"
178
177
  },
179
178
  {
180
179
  "id": "a8d4e1c7-6f20-4b93-8e5a-1c7d3b9f0e42",
181
180
  "name": "admin-console",
182
- "stableBranch": "develop",
183
181
  "createdAt": "2026-07-18T13:40:00.000Z"
184
182
  }
185
183
  ]
@@ -482,7 +480,6 @@
482
480
  "from": "2026-08-25T08:00:00.000Z",
483
481
  "to": "2026-09-24T08:00:00.000Z"
484
482
  },
485
- "stableBranch": "main",
486
483
  "runs": [
487
484
  {
488
485
  "id": "b1e0c6d2-7a43-4f19-8d5e-0c3a9e6f2b71",
@@ -1713,7 +1710,7 @@
1713
1710
  "get": {
1714
1711
  "operationId": "listTests",
1715
1712
  "summary": "List tests",
1716
- "description": "Every test with a run of the source (CI by default) in the period and its metrics - stability, flaky rate, failure rate, runs, time lost, its last 20 runs, the branches it ran on and where it fails most - ranked by the chosen sort. Counts finished runs of the source - CI by default - without mass-failure runs, on every branch unless branch names one (see population). Moderate: aggregate queries over the period's results of the source, paged in the database; use the metrics route for one test.",
1713
+ "description": "Every test with a run of the source (all by default) in the period and its metrics - stability, flaky rate, failure rate, runs, time lost, its last 20 runs, the branches it ran on and where it fails most - ranked by the chosen sort. Counts finished runs of the source - all by default - without mass-failure runs, on every branch unless branch names one (see population). Moderate: aggregate queries over the period's results of the source, paged in the database; use the metrics route for one test.",
1717
1714
  "tags": [
1718
1715
  "Tests"
1719
1716
  ],
@@ -1769,7 +1766,7 @@
1769
1766
  "name": "source",
1770
1767
  "in": "query",
1771
1768
  "required": false,
1772
- "description": "Which runs count, by where they ran: ci - runs a shard reported a CI provider for (the default); local - runs no shard did; all - both. The response's population names the one counted.",
1769
+ "description": "Which runs count, by where they ran: all - every run (the default since 1.0.0-beta.18; ci before); ci - runs a shard reported a CI provider for; local - runs no shard did. The response's population names the one counted.",
1773
1770
  "schema": {
1774
1771
  "type": "string",
1775
1772
  "enum": [
@@ -1777,7 +1774,7 @@
1777
1774
  "local",
1778
1775
  "all"
1779
1776
  ],
1780
- "default": "ci"
1777
+ "default": "all"
1781
1778
  }
1782
1779
  },
1783
1780
  {
@@ -2400,7 +2397,7 @@
2400
2397
  "name": "source",
2401
2398
  "in": "query",
2402
2399
  "required": false,
2403
- "description": "Which runs count, by where they ran: ci - runs a shard reported a CI provider for (the default); local - runs no shard did; all - both. The response's population names the one counted.",
2400
+ "description": "Which runs count, by where they ran: all - every run (the default since 1.0.0-beta.18; ci before); ci - runs a shard reported a CI provider for; local - runs no shard did. The response's population names the one counted.",
2404
2401
  "schema": {
2405
2402
  "type": "string",
2406
2403
  "enum": [
@@ -2408,7 +2405,7 @@
2408
2405
  "local",
2409
2406
  "all"
2410
2407
  ],
2411
- "default": "ci"
2408
+ "default": "all"
2412
2409
  }
2413
2410
  }
2414
2411
  ],
@@ -2815,7 +2812,7 @@
2815
2812
  "name": "source",
2816
2813
  "in": "query",
2817
2814
  "required": false,
2818
- "description": "Which runs count, by where they ran: ci - runs a shard reported a CI provider for (the default); local - runs no shard did; all - both. The response's population names the one counted.",
2815
+ "description": "Which runs count, by where they ran: all - every run (the default since 1.0.0-beta.18; ci before); ci - runs a shard reported a CI provider for; local - runs no shard did. The response's population names the one counted.",
2819
2816
  "schema": {
2820
2817
  "type": "string",
2821
2818
  "enum": [
@@ -2823,7 +2820,7 @@
2823
2820
  "local",
2824
2821
  "all"
2825
2822
  ],
2826
- "default": "ci"
2823
+ "default": "all"
2827
2824
  }
2828
2825
  }
2829
2826
  ],
@@ -3170,7 +3167,7 @@
3170
3167
  "name": "source",
3171
3168
  "in": "query",
3172
3169
  "required": false,
3173
- "description": "Which runs count, by where they ran: ci - runs a shard reported a CI provider for (the default); local - runs no shard did; all - both. The response's population names the one counted.",
3170
+ "description": "Which runs count, by where they ran: all - every run (the default since 1.0.0-beta.18; ci before); ci - runs a shard reported a CI provider for; local - runs no shard did. The response's population names the one counted.",
3174
3171
  "schema": {
3175
3172
  "type": "string",
3176
3173
  "enum": [
@@ -3178,7 +3175,7 @@
3178
3175
  "local",
3179
3176
  "all"
3180
3177
  ],
3181
- "default": "ci"
3178
+ "default": "all"
3182
3179
  }
3183
3180
  },
3184
3181
  {
@@ -3539,7 +3536,7 @@
3539
3536
  "name": "source",
3540
3537
  "in": "query",
3541
3538
  "required": false,
3542
- "description": "Which runs count, by where they ran: ci - runs a shard reported a CI provider for (the default); local - runs no shard did; all - both. The response's population names the one counted.",
3539
+ "description": "Which runs count, by where they ran: all - every run (the default since 1.0.0-beta.18; ci before); ci - runs a shard reported a CI provider for; local - runs no shard did. The response's population names the one counted.",
3543
3540
  "schema": {
3544
3541
  "type": "string",
3545
3542
  "enum": [
@@ -3547,7 +3544,7 @@
3547
3544
  "local",
3548
3545
  "all"
3549
3546
  ],
3550
- "default": "ci"
3547
+ "default": "all"
3551
3548
  }
3552
3549
  }
3553
3550
  ],
@@ -3861,7 +3858,7 @@
3861
3858
  "get": {
3862
3859
  "operationId": "getOverview",
3863
3860
  "summary": "Get dashboard figures",
3864
- "description": "The dashboard for a period: last run, suite stability, time lost, the two test-metric tiles (testMetrics), slowest tests, time sinks, recent runs. Every figure counts finished runs of the source - CI by default - and testMetrics.population names it. Moderate: aggregate queries over the period's finished runs, run in the database - no result rows are loaded.",
3861
+ "description": "The dashboard for a period: last run, suite stability, time lost, the two test-metric tiles (testMetrics), slowest tests, time sinks, recent runs. Every figure counts finished runs of the source - all by default - and testMetrics.population names it. Moderate: aggregate queries over the period's finished runs, run in the database - no result rows are loaded.",
3865
3862
  "tags": [
3866
3863
  "Project"
3867
3864
  ],
@@ -3895,21 +3892,18 @@
3895
3892
  "name": "branch",
3896
3893
  "in": "query",
3897
3894
  "required": false,
3898
- "description": "stable: the project's stable branch only; all: every branch.",
3895
+ "description": "Exact branch name: every figure counts that branch's runs. Every branch when absent or all (since 1.0.0-beta.17; it took stable or all, default stable, before - stable is now a 400).",
3899
3896
  "schema": {
3900
3897
  "type": "string",
3901
- "enum": [
3902
- "stable",
3903
- "all"
3904
- ],
3905
- "default": "stable"
3898
+ "minLength": 1,
3899
+ "maxLength": 200
3906
3900
  }
3907
3901
  },
3908
3902
  {
3909
3903
  "name": "source",
3910
3904
  "in": "query",
3911
3905
  "required": false,
3912
- "description": "Which runs count, by where they ran: ci - runs a shard reported a CI provider for (the default); local - runs no shard did; all - both. The response's population names the one counted.",
3906
+ "description": "Which runs count, by where they ran: all - every run (the default since 1.0.0-beta.18; ci before); ci - runs a shard reported a CI provider for; local - runs no shard did. The response's population names the one counted.",
3913
3907
  "schema": {
3914
3908
  "type": "string",
3915
3909
  "enum": [
@@ -3917,7 +3911,7 @@
3917
3911
  "local",
3918
3912
  "all"
3919
3913
  ],
3920
- "default": "ci"
3914
+ "default": "all"
3921
3915
  }
3922
3916
  }
3923
3917
  ],
@@ -3944,8 +3938,7 @@
3944
3938
  "from": "2026-08-25T08:00:00.000Z",
3945
3939
  "to": "2026-09-24T08:00:00.000Z"
3946
3940
  },
3947
- "branchScope": "stable",
3948
- "stableBranch": "main",
3941
+ "branch": "main",
3949
3942
  "lastRun": {
3950
3943
  "id": "b1e0c6d2-7a43-4f19-8d5e-0c3a9e6f2b71",
3951
3944
  "runNumber": 1284,
@@ -3957,8 +3950,7 @@
3957
3950
  "passed": 404,
3958
3951
  "flaky": 4,
3959
3952
  "failed": 0,
3960
- "skipped": 4,
3961
- "isFallbackBranch": false
3953
+ "skipped": 4
3962
3954
  },
3963
3955
  "runsInWindow": 11,
3964
3956
  "unfinishedRuns": 1,
@@ -4244,7 +4236,7 @@
4244
4236
  "get": {
4245
4237
  "operationId": "getSettings",
4246
4238
  "summary": "Get settings",
4247
- "description": "Get the project configuration. Stable branch, the plan's retention, Slack events, PR comments. Configuration only - never a key, token or webhook. Cheap.",
4239
+ "description": "Get the project configuration. The plan's retention, Slack events, PR comments. Configuration only - never a key, token or webhook. Cheap.",
4248
4240
  "tags": [
4249
4241
  "Project"
4250
4242
  ],
@@ -4278,7 +4270,6 @@
4278
4270
  "name": "storefront-web"
4279
4271
  },
4280
4272
  "settings": {
4281
- "stableBranch": "main",
4282
4273
  "retentionDays": 60,
4283
4274
  "slack": {
4284
4275
  "configured": true,
@@ -4510,9 +4501,6 @@
4510
4501
  "name": {
4511
4502
  "type": "string"
4512
4503
  },
4513
- "stableBranch": {
4514
- "type": "string"
4515
- },
4516
4504
  "createdAt": {
4517
4505
  "type": "string",
4518
4506
  "format": "date-time"
@@ -4521,7 +4509,6 @@
4521
4509
  "required": [
4522
4510
  "id",
4523
4511
  "name",
4524
- "stableBranch",
4525
4512
  "createdAt"
4526
4513
  ]
4527
4514
  }
@@ -4570,9 +4557,6 @@
4570
4557
  "to"
4571
4558
  ]
4572
4559
  },
4573
- "stableBranch": {
4574
- "type": "string"
4575
- },
4576
4560
  "runs": {
4577
4561
  "type": "array",
4578
4562
  "items": {
@@ -4635,7 +4619,7 @@
4635
4619
  "incomplete",
4636
4620
  "running"
4637
4621
  ],
4638
- "description": "How the run ended, the dashboard's own word: cancelled - the run was cancelled (for a sharded run, any shard recorded a cancel; cancellation says how and when); incomplete - a shard timed out, was stopped by the monthly result limit or never reported; running - a shard is still running; failed - every shard finished and a test failed; passed - every shard finished and none failed. In that order: the first that applies. Since 1.0.0-beta.14 - before it, a cancelled run reported the outcome beneath the cancel and a cancelled boolean."
4622
+ "description": "How the run ended, the dashboard's own word: cancelled - the run was cancelled (for a sharded run, any shard recorded a cancel; cancellation says how and when); incomplete - a shard timed out, was stopped by the monthly result limit, or never reported by the time the run is overdue by the project's run timeout, counted from its latest shard's start; running - a shard is still running, or the run still waits for a shard within that time; failed - every shard finished and a test failed; passed - every shard finished and none failed. In that order: the first that applies. Since 1.0.0-beta.14 - before it, a cancelled run reported the outcome beneath the cancel and a cancelled boolean. Waiting for a shard is running since 2026-10-20 - before it, incomplete."
4639
4623
  },
4640
4624
  "cancellation": {
4641
4625
  "anyOf": [
@@ -4688,7 +4672,7 @@
4688
4672
  },
4689
4673
  "settled": {
4690
4674
  "type": "boolean",
4691
- "description": "Whether the run is settled: its status and counts are final and it counts in the dashboard's figures. false while a shard is running, and while an incomplete run still waits for a shard within the run time limit - once that passes, the hourly check settles it as incomplete. The dashboard's unfinished runs are the ones not settled. Since 1.0.0-beta.15."
4675
+ "description": "Whether the run is settled: its status and counts are final and it counts in the dashboard's figures. false while a shard is running, and while the run still waits for a shard within the run time limit - once that passes, the hourly check settles it as incomplete. The dashboard's unfinished runs are the ones not settled. Since 1.0.0-beta.15."
4692
4676
  },
4693
4677
  "jobKey": {
4694
4678
  "anyOf": [
@@ -4886,7 +4870,6 @@
4886
4870
  "required": [
4887
4871
  "project",
4888
4872
  "window",
4889
- "stableBranch",
4890
4873
  "runs",
4891
4874
  "total",
4892
4875
  "nextCursor",
@@ -5011,7 +4994,7 @@
5011
4994
  "incomplete",
5012
4995
  "running"
5013
4996
  ],
5014
- "description": "How the run ended, the dashboard's own word: cancelled - the run was cancelled (for a sharded run, any shard recorded a cancel; cancellation says how and when); incomplete - a shard timed out, was stopped by the monthly result limit or never reported; running - a shard is still running; failed - every shard finished and a test failed; passed - every shard finished and none failed. In that order: the first that applies. Since 1.0.0-beta.14 - before it, a cancelled run reported the outcome beneath the cancel and a cancelled boolean."
4997
+ "description": "How the run ended, the dashboard's own word: cancelled - the run was cancelled (for a sharded run, any shard recorded a cancel; cancellation says how and when); incomplete - a shard timed out, was stopped by the monthly result limit, or never reported by the time the run is overdue by the project's run timeout, counted from its latest shard's start; running - a shard is still running, or the run still waits for a shard within that time; failed - every shard finished and a test failed; passed - every shard finished and none failed. In that order: the first that applies. Since 1.0.0-beta.14 - before it, a cancelled run reported the outcome beneath the cancel and a cancelled boolean. Waiting for a shard is running since 2026-10-20 - before it, incomplete."
5015
4998
  },
5016
4999
  "cancellation": {
5017
5000
  "anyOf": [
@@ -5064,7 +5047,7 @@
5064
5047
  },
5065
5048
  "settled": {
5066
5049
  "type": "boolean",
5067
- "description": "Whether the run is settled: its status and counts are final and it counts in the dashboard's figures. false while a shard is running, and while an incomplete run still waits for a shard within the run time limit - once that passes, the hourly check settles it as incomplete. The dashboard's unfinished runs are the ones not settled. Since 1.0.0-beta.15."
5050
+ "description": "Whether the run is settled: its status and counts are final and it counts in the dashboard's figures. false while a shard is running, and while the run still waits for a shard within the run time limit - once that passes, the hourly check settles it as incomplete. The dashboard's unfinished runs are the ones not settled. Since 1.0.0-beta.15."
5068
5051
  },
5069
5052
  "jobKey": {
5070
5053
  "anyOf": [
@@ -5738,7 +5721,7 @@
5738
5721
  "local_groups_finished_not_mass_failure",
5739
5722
  "all_groups_finished_not_mass_failure"
5740
5723
  ],
5741
- "description": "Which runs every number counts: runs whose shards all finished, each counted once however many shards it ran in, placed in the period by the start of their first shard - without runs that were a mass failure as a whole (at least 20 tests, over 80% of them failed). Every branch unless the branch parameter names one. A run finishes when all its shards have, or - once it is overdue by the project's run timeout, counted from its latest shard's start - when every shard that started has completed, timed out or been stopped by the monthly result limit; such a run counts like a cancelled one, with the results its shards reported (since 1.0.0-beta.10; the monthly result limit since 1.0.0-beta.11). Runs still running are not counted. The prefix names the source parameter: ci_ - CI runs (a shard reported a CI provider), the default; local_ - runs no shard reported a CI provider for; all_ - both (since 1.0.0-beta.8; before it, ci_groups_finished_not_mass_failure was the only value, and since 1.0.0-beta.6 - it was ci_completed_not_excluded, which counted every completed shard on its own)."
5724
+ "description": "Which runs every number counts: runs whose shards all finished, each counted once however many shards it ran in, placed in the period by the start of their first shard - without runs that were a mass failure as a whole (at least 20 tests, over 80% of them failed). Every branch unless the branch parameter names one. A run finishes when all its shards have, or - once it is overdue by the project's run timeout, counted from its latest shard's start - when every shard that started has completed, timed out or been stopped by the monthly result limit; such a run counts like a cancelled one, with the results its shards reported (since 1.0.0-beta.10; the monthly result limit since 1.0.0-beta.11). Runs still running are not counted. The prefix names the source parameter: ci_ - CI runs (a shard reported a CI provider); local_ - runs no shard reported a CI provider for; all_ - both, the default since 1.0.0-beta.18 (ci_ before it; since 1.0.0-beta.8; before it, ci_groups_finished_not_mass_failure was the only value, and since 1.0.0-beta.6 - it was ci_completed_not_excluded, which counted every completed shard on its own)."
5742
5725
  },
5743
5726
  "days": {
5744
5727
  "type": "integer",
@@ -6043,7 +6026,7 @@
6043
6026
  "local_groups_finished_not_mass_failure",
6044
6027
  "all_groups_finished_not_mass_failure"
6045
6028
  ],
6046
- "description": "Which runs every number counts: runs whose shards all finished, each counted once however many shards it ran in, placed in the period by the start of their first shard - without runs that were a mass failure as a whole (at least 20 tests, over 80% of them failed). Every branch unless the branch parameter names one. A run finishes when all its shards have, or - once it is overdue by the project's run timeout, counted from its latest shard's start - when every shard that started has completed, timed out or been stopped by the monthly result limit; such a run counts like a cancelled one, with the results its shards reported (since 1.0.0-beta.10; the monthly result limit since 1.0.0-beta.11). Runs still running are not counted. The prefix names the source parameter: ci_ - CI runs (a shard reported a CI provider), the default; local_ - runs no shard reported a CI provider for; all_ - both (since 1.0.0-beta.8; before it, ci_groups_finished_not_mass_failure was the only value, and since 1.0.0-beta.6 - it was ci_completed_not_excluded, which counted every completed shard on its own)."
6029
+ "description": "Which runs every number counts: runs whose shards all finished, each counted once however many shards it ran in, placed in the period by the start of their first shard - without runs that were a mass failure as a whole (at least 20 tests, over 80% of them failed). Every branch unless the branch parameter names one. A run finishes when all its shards have, or - once it is overdue by the project's run timeout, counted from its latest shard's start - when every shard that started has completed, timed out or been stopped by the monthly result limit; such a run counts like a cancelled one, with the results its shards reported (since 1.0.0-beta.10; the monthly result limit since 1.0.0-beta.11). Runs still running are not counted. The prefix names the source parameter: ci_ - CI runs (a shard reported a CI provider); local_ - runs no shard reported a CI provider for; all_ - both, the default since 1.0.0-beta.18 (ci_ before it; since 1.0.0-beta.8; before it, ci_groups_finished_not_mass_failure was the only value, and since 1.0.0-beta.6 - it was ci_completed_not_excluded, which counted every completed shard on its own)."
6047
6030
  },
6048
6031
  "days": {
6049
6032
  "type": "integer",
@@ -6351,7 +6334,7 @@
6351
6334
  },
6352
6335
  "counted": {
6353
6336
  "type": "boolean",
6354
- "description": "Whether the run is in the metrics' population (see population on the metrics endpoints): a run of the source parameter's kind - CI by default - that finished (all its shards, or overdue with every shard that started completed, timed out or stopped by the monthly result limit - since 1.0.0-beta.10, the limit since 1.0.0-beta.11), not a mass failure, and the test not just skipped by a cancellation (since 1.0.0-beta.6; the source since 1.0.0-beta.8)."
6337
+ "description": "Whether the run is in the metrics' population (see population on the metrics endpoints): a run of the source parameter's kind - all by default since 1.0.0-beta.18, CI before - that finished (all its shards, or overdue with every shard that started completed, timed out or stopped by the monthly result limit - since 1.0.0-beta.10, the limit since 1.0.0-beta.11), not a mass failure, and the test not just skipped by a cancellation (since 1.0.0-beta.6; the source since 1.0.0-beta.8)."
6355
6338
  },
6356
6339
  "branch": {
6357
6340
  "anyOf": [
@@ -6471,7 +6454,7 @@
6471
6454
  "local_groups_finished",
6472
6455
  "all_groups_finished"
6473
6456
  ],
6474
- "description": "Which runs every error figure counts: runs whose shards all finished, each counted once however many shards it ran in, placed in the period by the start of their first shard - runs that were a mass failure as a whole included (see massFailureRunCount). A run finishes when all its shards have, or - once it is overdue by the project's run timeout, counted from its latest shard's start - when every shard that started has completed, timed out or been stopped by the monthly result limit; such a run counts like a cancelled one, with the results its shards reported (since 1.0.0-beta.10; the monthly result limit since 1.0.0-beta.11). Runs still running are not counted. The prefix names the source parameter: ci_ - CI runs (a shard reported a CI provider), the default; local_ - runs no shard reported a CI provider for; all_ - both (since 1.0.0-beta.9)."
6457
+ "description": "Which runs every error figure counts: runs whose shards all finished, each counted once however many shards it ran in, placed in the period by the start of their first shard - runs that were a mass failure as a whole included (see massFailureRunCount). A run finishes when all its shards have, or - once it is overdue by the project's run timeout, counted from its latest shard's start - when every shard that started has completed, timed out or been stopped by the monthly result limit; such a run counts like a cancelled one, with the results its shards reported (since 1.0.0-beta.10; the monthly result limit since 1.0.0-beta.11). Runs still running are not counted. The prefix names the source parameter: ci_ - CI runs (a shard reported a CI provider); local_ - runs no shard reported a CI provider for; all_ - both, the default since 1.0.0-beta.18 (ci_ before it; since 1.0.0-beta.9)."
6475
6458
  },
6476
6459
  "window": {
6477
6460
  "type": "object",
@@ -6648,7 +6631,7 @@
6648
6631
  "local_groups_finished",
6649
6632
  "all_groups_finished"
6650
6633
  ],
6651
- "description": "Which runs every error figure counts: runs whose shards all finished, each counted once however many shards it ran in, placed in the period by the start of their first shard - runs that were a mass failure as a whole included (see massFailureRunCount). A run finishes when all its shards have, or - once it is overdue by the project's run timeout, counted from its latest shard's start - when every shard that started has completed, timed out or been stopped by the monthly result limit; such a run counts like a cancelled one, with the results its shards reported (since 1.0.0-beta.10; the monthly result limit since 1.0.0-beta.11). Runs still running are not counted. The prefix names the source parameter: ci_ - CI runs (a shard reported a CI provider), the default; local_ - runs no shard reported a CI provider for; all_ - both (since 1.0.0-beta.9)."
6634
+ "description": "Which runs every error figure counts: runs whose shards all finished, each counted once however many shards it ran in, placed in the period by the start of their first shard - runs that were a mass failure as a whole included (see massFailureRunCount). A run finishes when all its shards have, or - once it is overdue by the project's run timeout, counted from its latest shard's start - when every shard that started has completed, timed out or been stopped by the monthly result limit; such a run counts like a cancelled one, with the results its shards reported (since 1.0.0-beta.10; the monthly result limit since 1.0.0-beta.11). Runs still running are not counted. The prefix names the source parameter: ci_ - CI runs (a shard reported a CI provider); local_ - runs no shard reported a CI provider for; all_ - both, the default since 1.0.0-beta.18 (ci_ before it; since 1.0.0-beta.9)."
6652
6635
  },
6653
6636
  "window": {
6654
6637
  "type": "object",
@@ -6923,15 +6906,16 @@
6923
6906
  "to"
6924
6907
  ]
6925
6908
  },
6926
- "branchScope": {
6927
- "type": "string",
6928
- "enum": [
6929
- "stable",
6930
- "all"
6931
- ]
6932
- },
6933
- "stableBranch": {
6934
- "type": "string"
6909
+ "branch": {
6910
+ "anyOf": [
6911
+ {
6912
+ "type": "string"
6913
+ },
6914
+ {
6915
+ "type": "null"
6916
+ }
6917
+ ],
6918
+ "description": "The branch every figure counts - the branch parameter - or null for every branch (since 1.0.0-beta.17; branchScope and stableBranch until then)."
6935
6919
  },
6936
6920
  "lastRun": {
6937
6921
  "anyOf": [
@@ -7000,9 +6984,6 @@
7000
6984
  "skipped": {
7001
6985
  "type": "integer",
7002
6986
  "description": "Since 1.0.0-beta.7."
7003
- },
7004
- "isFallbackBranch": {
7005
- "type": "boolean"
7006
6987
  }
7007
6988
  },
7008
6989
  "required": [
@@ -7016,23 +6997,22 @@
7016
6997
  "passed",
7017
6998
  "flaky",
7018
6999
  "failed",
7019
- "skipped",
7020
- "isFallbackBranch"
7000
+ "skipped"
7021
7001
  ]
7022
7002
  },
7023
7003
  {
7024
7004
  "type": "null"
7025
7005
  }
7026
7006
  ],
7027
- "description": "The newest finished run of the source on branchScope, whatever the window - falling back to any branch when the stable branch has none (see the source parameter and testMetrics.population)."
7007
+ "description": "The newest finished run of the source on the branch, whatever the window (see the source parameter and testMetrics.population); null when there is none. No fallback to another branch since 1.0.0-beta.17, and no isFallbackBranch."
7028
7008
  },
7029
7009
  "runsInWindow": {
7030
7010
  "type": "integer",
7031
- "description": "Finished runs of the source in the window on branchScope (see the source parameter and testMetrics.population), each counted once however many shards it had, by the start of its first shard; mass-failure, cancelled and incomplete runs included (incomplete - finished by the run timeout - since 1.0.0-beta.10). The runs windowStability is counted over."
7011
+ "description": "Finished runs of the source in the window on the branch (see the source parameter and testMetrics.population), each counted once however many shards it had, by the start of its first shard; mass-failure, cancelled and incomplete runs included (incomplete - finished by the run timeout - since 1.0.0-beta.10). The runs windowStability is counted over."
7032
7012
  },
7033
7013
  "unfinishedRuns": {
7034
7014
  "type": "integer",
7035
- "description": "Runs of the source in the window on branchScope that have not finished - a shard still running, or one timed out, stopped by the monthly result limit or never reported while the run is not yet overdue (an overdue one is finished and counted since 1.0.0-beta.10; a limit-stopped one since 1.0.0-beta.11). In no other figure (since 1.0.0-beta.7; of the source since 1.0.0-beta.8)."
7015
+ "description": "Runs of the source in the window on the branch that have not finished - a shard still running, or one timed out, stopped by the monthly result limit or never reported while the run is not yet overdue (an overdue one is finished and counted since 1.0.0-beta.10; a limit-stopped one since 1.0.0-beta.11). In no other figure (since 1.0.0-beta.7; of the source since 1.0.0-beta.8)."
7036
7016
  },
7037
7017
  "suiteSize": {
7038
7018
  "type": "integer",
@@ -7047,7 +7027,7 @@
7047
7027
  "type": "null"
7048
7028
  }
7049
7029
  ],
7050
- "description": "Suite stability, 0-100: of the final test results in the window's finished runs of the source on branchScope (skipped results left out), the share that passed on the first try, rounded. Mass-failure runs count (since 1.0.0-beta.7). A result that passed only after a retry counts against it. null when no such result exists."
7030
+ "description": "Suite stability, 0-100: of the final test results in the window's finished runs of the source on the branch (skipped results left out), the share that passed on the first try, rounded. Mass-failure runs count (since 1.0.0-beta.7). A result that passed only after a retry counts against it. null when no such result exists."
7051
7031
  },
7052
7032
  "timeLost": {
7053
7033
  "type": "object",
@@ -7078,7 +7058,7 @@
7078
7058
  "wastedAttempts",
7079
7059
  "wallClockMs"
7080
7060
  ],
7081
- "description": "Time spent on attempts a later retry superseded, in the window's finished runs of the source on branchScope; wallClockMs is the time those runs used - each shard's own duration, summed - and lostPercent is lostMs of it."
7061
+ "description": "Time spent on attempts a later retry superseded, in the window's finished runs of the source on the branch; wallClockMs is the time those runs used - each shard's own duration, summed - and lostPercent is lostMs of it."
7082
7062
  },
7083
7063
  "failingTests": {
7084
7064
  "type": "object",
@@ -7094,7 +7074,7 @@
7094
7074
  "failing",
7095
7075
  "testsRun"
7096
7076
  ],
7097
- "description": "Tests whose final attempt failed in at least one of the window's finished runs of the source on branchScope, out of the tests those runs reported (a skipped test counts as reported)."
7077
+ "description": "Tests whose final attempt failed in at least one of the window's finished runs of the source on the branch, out of the tests those runs reported (a skipped test counts as reported)."
7098
7078
  },
7099
7079
  "testMetrics": {
7100
7080
  "type": "object",
@@ -7106,7 +7086,7 @@
7106
7086
  "local_groups_finished_not_mass_failure",
7107
7087
  "all_groups_finished_not_mass_failure"
7108
7088
  ],
7109
- "description": "Which runs every number counts: runs whose shards all finished, each counted once however many shards it ran in, placed in the period by the start of their first shard - without runs that were a mass failure as a whole (at least 20 tests, over 80% of them failed). Every branch unless the branch parameter names one. A run finishes when all its shards have, or - once it is overdue by the project's run timeout, counted from its latest shard's start - when every shard that started has completed, timed out or been stopped by the monthly result limit; such a run counts like a cancelled one, with the results its shards reported (since 1.0.0-beta.10; the monthly result limit since 1.0.0-beta.11). Runs still running are not counted. The prefix names the source parameter: ci_ - CI runs (a shard reported a CI provider), the default; local_ - runs no shard reported a CI provider for; all_ - both (since 1.0.0-beta.8; before it, ci_groups_finished_not_mass_failure was the only value, and since 1.0.0-beta.6 - it was ci_completed_not_excluded, which counted every completed shard on its own)."
7089
+ "description": "Which runs every number counts: runs whose shards all finished, each counted once however many shards it ran in, placed in the period by the start of their first shard - without runs that were a mass failure as a whole (at least 20 tests, over 80% of them failed). Every branch unless the branch parameter names one. A run finishes when all its shards have, or - once it is overdue by the project's run timeout, counted from its latest shard's start - when every shard that started has completed, timed out or been stopped by the monthly result limit; such a run counts like a cancelled one, with the results its shards reported (since 1.0.0-beta.10; the monthly result limit since 1.0.0-beta.11). Runs still running are not counted. The prefix names the source parameter: ci_ - CI runs (a shard reported a CI provider); local_ - runs no shard reported a CI provider for; all_ - both, the default since 1.0.0-beta.18 (ci_ before it; since 1.0.0-beta.8; before it, ci_groups_finished_not_mass_failure was the only value, and since 1.0.0-beta.6 - it was ci_completed_not_excluded, which counted every completed shard on its own)."
7110
7090
  },
7111
7091
  "days": {
7112
7092
  "type": "integer",
@@ -7132,7 +7112,7 @@
7132
7112
  "failingTests",
7133
7113
  "tests"
7134
7114
  ],
7135
- "description": "The dashboard's Flaky tests and Failing tests tiles and their denominator, counted like /tests on branchScope (since 1.0.0-beta.7; every branch before). Mass-failure runs are left out here, as in every per-test metric."
7115
+ "description": "The dashboard's Flaky tests and Failing tests tiles and their denominator, counted like /tests on the branch (since 1.0.0-beta.7; every branch before). Mass-failure runs are left out here, as in every per-test metric."
7136
7116
  },
7137
7117
  "slowestTests": {
7138
7118
  "type": "array",
@@ -7230,14 +7210,13 @@
7230
7210
  "durationMs"
7231
7211
  ]
7232
7212
  },
7233
- "description": "The last 30 finished runs of the source on branchScope, whatever the window, oldest first - one point per run, passed counting first-try passes, durationMs from its first shard's start to its last shard's finish. Cancelled and incomplete runs are left out (incomplete since 1.0.0-beta.10)."
7213
+ "description": "The last 30 finished runs of the source on the branch, whatever the window, oldest first - one point per run, passed counting first-try passes, durationMs from its first shard's start to its last shard's finish. Cancelled and incomplete runs are left out (incomplete since 1.0.0-beta.10)."
7234
7214
  }
7235
7215
  },
7236
7216
  "required": [
7237
7217
  "project",
7238
7218
  "window",
7239
- "branchScope",
7240
- "stableBranch",
7219
+ "branch",
7241
7220
  "lastRun",
7242
7221
  "runsInWindow",
7243
7222
  "unfinishedRuns",
@@ -7272,9 +7251,6 @@
7272
7251
  "settings": {
7273
7252
  "type": "object",
7274
7253
  "properties": {
7275
- "stableBranch": {
7276
- "type": "string"
7277
- },
7278
7254
  "retentionDays": {
7279
7255
  "type": "integer"
7280
7256
  },
@@ -7309,7 +7285,6 @@
7309
7285
  }
7310
7286
  },
7311
7287
  "required": [
7312
- "stableBranch",
7313
7288
  "retentionDays",
7314
7289
  "slack",
7315
7290
  "github"
package/dist/tools.js CHANGED
@@ -66,9 +66,9 @@ export const TOOLS = [
66
66
  "runs / runs), time lost to retries and failures, its last 20 runs (each with the run " +
67
67
  "id squally-find-run gives; runs it skipped included, as result \"skipped\" - shown, " +
68
68
  "never counted in runs or any rate) and the branches it ran on. Counts the finished " +
69
- "CI runs of the period - a sharded run counts once, by its first shard's start - " +
70
- "without runs that were a mass failure as a whole; source=local or source=all counts " +
71
- "local runs or both instead (population names which). A run still in progress counts " +
69
+ "runs of the period, CI and local - a sharded run counts once, by its first shard's start - " +
70
+ "without runs that were a mass failure as a whole; source=ci or source=local counts " +
71
+ "only those instead (population names which). A run still in progress counts " +
72
72
  "once all its shards have finished, or once the run timeout has passed, with the " +
73
73
  "results its shards reported - also when a shard was stopped by the monthly result " +
74
74
  "limit. There " +
@@ -82,12 +82,12 @@ export const TOOLS = [
82
82
  name: "squally-list-tests",
83
83
  title: "List tests",
84
84
  operationId: "listTests",
85
- description: "Every test with a counted CI run in the period (or local run, with source), with the same numbers per test as " +
85
+ description: "Every test with a counted run in the period, CI and local (source=ci or source=local narrows it), with the same numbers per test as " +
86
86
  "squally-get-test-metrics - runs, stability, flakyRate, failureRate, time lost - ranked " +
87
87
  "worst first by the chosen sort (default: lowest stability). There is no verdict and no " +
88
88
  "status - the tool labels no test; you judge the numbers. Moderate - two queries over " +
89
89
  "the period, paged; for a single test use squally-get-test-metrics.",
90
- answers: "Every test with a CI run in the period, ranked by stability, flaky rate or failures.",
90
+ answers: "Every test with a run in the period, ranked by stability, flaky rate or failures.",
91
91
  cost: "cheap",
92
92
  },
93
93
  {
@@ -97,7 +97,7 @@ export const TOOLS = [
97
97
  description: "The project's error signatures in a period: failures grouped by fingerprint, with how " +
98
98
  "often and how recently each occurred. Answers 'is this failure one instance of something " +
99
99
  "that keeps happening' - a grouping no agent can compute from the repository alone. " +
100
- "Counts finished CI runs by default (source=local or all for the others), a sharded run " +
100
+ "Counts finished runs, CI and local, by default (source=ci or source=local for one of them), a sharded run " +
101
101
  "once, mass-failure runs included; failedCount and flakyCount say how the runs ended " +
102
102
  "for the tests the error hit.",
103
103
  answers: "Error signatures in a period: what keeps failing, grouped, and how its runs ended.",
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "squally-mcp",
3
- "version": "0.6.1",
3
+ "version": "0.8.0",
4
4
  "description": "Local MCP server for Squally — read-only access to your Playwright test runs, flaky tests and failures.",
5
5
  "license": "MIT",
6
6
  "author": "Squally",