squally-mcp 0.8.3 → 0.9.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +41 -8
- package/dist/api.js +7 -0
- package/dist/instructions.js +17 -0
- package/dist/openapi/v1.json +1269 -221
- package/dist/openapi.d.ts +2 -1
- package/dist/openapi.js +39 -2
- package/dist/tools.js +30 -12
- package/dist/validate.js +5 -0
- package/package.json +1 -1
package/dist/openapi/v1.json
CHANGED
|
@@ -3,8 +3,8 @@
|
|
|
3
3
|
"jsonSchemaDialect": "https://json-schema.org/draft/2020-12/schema",
|
|
4
4
|
"info": {
|
|
5
5
|
"title": "Squally Read API",
|
|
6
|
-
"version": "1.0.0-beta.
|
|
7
|
-
"description": "Read access to a Squally organization's test results, for scripts, CI jobs and AI agents.\n\n**Authentication.** Every request carries an organization read key as `Authorization: Bearer sqly_ro_…`.
|
|
6
|
+
"version": "1.0.0-beta.19",
|
|
7
|
+
"description": "Read access to a Squally organization's test results, for scripts, CI jobs and AI agents.\n\n**Authentication.** Every request goes to `https://app.squally.dev/api/v1` plus the path and carries an organization read key as `Authorization: Bearer sqly_ro_…`. With the key in `SQUALLY_API_KEY` - the variable the MCP server reads too - the first request lists the organization's projects:\n```sh\ncurl -H \"Authorization: Bearer $SQUALLY_API_KEY\" https://app.squally.dev/api/v1/projects\n```\nA read key is organization-wide (every project), created by an organization admin in Organization › Read keys, and expires after 30, 60, 90, 180 days as chosen at creation. There is no renewal: create a new key and revoke the old one. Project ingest keys (`sqly_…`) are refused with `wrong_key_type`.\n\n**Expiry warning.** From 7 days before a key expires, every authenticated response carries `Squally-Key-Expires-At` with the expiry instant (ISO-8601). Once it has passed, every request with the key is answered 401 `key_expired` (\"This read key expired on <date>. Create a new one in Organization › Read keys.\"); an expired key is never extended. To rotate without a gap: create a new key, switch your callers to it, then revoke the old one - an organization may hold several active keys, and each works until it expires or is revoked.\n\n**Rate limit.** Currently 60 requests per 60 seconds per key - a read key has its own budget, shared with nothing else. Over the limit the API answers 429 with `Retry-After: 60` and the usual error body, `{\"error\": \"Too many requests with this read key. Wait 60 seconds, then retry.\", \"code\": \"rate_limited\"}`. A caller far beyond the limit can be stopped earlier by the edge firewall with a bare 429 - no body, no `Retry-After`: wait 60 seconds just the same.\n\n**Counts.** A run's `total`, `passed`, `failed`, `flaky` and `skipped` count tests, each test once over all the run's shards by its final attempt: `passed` on the first try, `flaky` after a retry, `failed` when the final attempt failed; `total` = `passed` + `failed` + `skipped` + `flaky`. Figures over a period - a test's runs, an error's occurrences - count finished runs of the `source` parameter's kind, as each field's description says.\n\n**Playwright projects.** A run counts like Playwright: one row and one count per project's variant of a test - the run routes. Anything collected across runs counts a test ONCE across its Playwright projects and names them - `/tests`, a test's metrics and history, `/errors`, `/overview`: a run failed for the test when it failed in any project, flaky when it passed only after a retry in some project and failed in none. Since 1.0.0-beta.19; each project's variant was its own test before.\n\n**Run numbers.** `runNumber` is the run's number in its project, the #12 the app shows: counted up from 1 per project, one number for all shards of a run, never given twice. Runs removed by the plan's retention leave gaps. The run routes take the run's `id`, not its number.\n\n**Paging.** `/projects` and `/projects/{projectId}/branches` answer with every item at once, no paging. `/runs` pages with a cursor (`cursor`, `direction`, `perPage`); `/tests` and `/errors` page by number (`page`, 1-based - a page past the end answers the last page - and `perPage`).\n\n**Retries.** 429: wait the seconds Retry-After names (60), then retry. Requests are counted per key in 60-second windows. 5xx: retry with exponential backoff, starting at 1 second and capped at 30 seconds. 400, 401, 403, 404: never retry - the same request gets the same answer.\n\n**Plans.** The read API is part of the Standard and Pro plans. A key of an organization on Free is answered 403 `tier_too_low`; keys are not revoked on a downgrade and work again after an upgrade.\n\n**Errors.** Every error is `{\"error\": \"<sentence>\", \"code\": \"<slug>\"}`. The sentence may be reworded; the slug may not. An id that does not exist and an id that belongs to another organization get the same 404, byte for byte.\n\n**Test names in paths.** Test names are Playwright title paths and often contain `/`: URL-encode them, including `/` as `%2F`. The /tests/{testName} routes take a test's name without its project, as /tests lists it; a run's attempts route takes the name the run lists, with its project.\n\n**Sharded runs** are returned as one logical run: /runs lists one row per logical run, and the run routes answer for all shards whichever shard's id you pass.\n\n**Stability.** v1, beta. The API may change until the beta ends; every change is listed in the changelog (docs/openapi/CHANGELOG.md)."
|
|
8
8
|
},
|
|
9
9
|
"servers": [
|
|
10
10
|
{
|
|
@@ -141,8 +141,8 @@
|
|
|
141
141
|
"code": "rate_limited",
|
|
142
142
|
"status": 429,
|
|
143
143
|
"when": "More than 60 requests within 60 seconds with one read key.",
|
|
144
|
-
"action": "Wait
|
|
145
|
-
"hasBody":
|
|
144
|
+
"action": "Wait the seconds Retry-After names (60), then retry. Requests are counted per key in 60-second windows.",
|
|
145
|
+
"hasBody": true
|
|
146
146
|
},
|
|
147
147
|
{
|
|
148
148
|
"code": "internal_error",
|
|
@@ -305,7 +305,44 @@
|
|
|
305
305
|
}
|
|
306
306
|
},
|
|
307
307
|
"429": {
|
|
308
|
-
"description": "Rate limited
|
|
308
|
+
"description": "Rate limited: more than 60 requests within 60 seconds with one read key. 429: wait the seconds Retry-After names (60), then retry. Requests are counted per key in 60-second windows. A caller far beyond the limit can be stopped earlier by the edge firewall with a bare 429 - no body, no Retry-After; wait 60 seconds just the same.",
|
|
309
|
+
"headers": {
|
|
310
|
+
"Retry-After": {
|
|
311
|
+
"description": "Seconds to wait before retrying: 60.",
|
|
312
|
+
"schema": {
|
|
313
|
+
"type": "integer",
|
|
314
|
+
"example": 60
|
|
315
|
+
}
|
|
316
|
+
}
|
|
317
|
+
},
|
|
318
|
+
"content": {
|
|
319
|
+
"application/json": {
|
|
320
|
+
"schema": {
|
|
321
|
+
"type": "object",
|
|
322
|
+
"properties": {
|
|
323
|
+
"error": {
|
|
324
|
+
"type": "string",
|
|
325
|
+
"description": "A sentence for a human. May be reworded."
|
|
326
|
+
},
|
|
327
|
+
"code": {
|
|
328
|
+
"type": "string",
|
|
329
|
+
"enum": [
|
|
330
|
+
"rate_limited"
|
|
331
|
+
],
|
|
332
|
+
"description": "Stable slug - match on this, not on the sentence."
|
|
333
|
+
}
|
|
334
|
+
},
|
|
335
|
+
"required": [
|
|
336
|
+
"error",
|
|
337
|
+
"code"
|
|
338
|
+
]
|
|
339
|
+
},
|
|
340
|
+
"example": {
|
|
341
|
+
"error": "Too many requests with this read key. Wait 60 seconds, then retry.",
|
|
342
|
+
"code": "rate_limited"
|
|
343
|
+
}
|
|
344
|
+
}
|
|
345
|
+
}
|
|
309
346
|
},
|
|
310
347
|
"500": {
|
|
311
348
|
"description": "Error: internal_error",
|
|
@@ -785,7 +822,44 @@
|
|
|
785
822
|
}
|
|
786
823
|
},
|
|
787
824
|
"429": {
|
|
788
|
-
"description": "Rate limited
|
|
825
|
+
"description": "Rate limited: more than 60 requests within 60 seconds with one read key. 429: wait the seconds Retry-After names (60), then retry. Requests are counted per key in 60-second windows. A caller far beyond the limit can be stopped earlier by the edge firewall with a bare 429 - no body, no Retry-After; wait 60 seconds just the same.",
|
|
826
|
+
"headers": {
|
|
827
|
+
"Retry-After": {
|
|
828
|
+
"description": "Seconds to wait before retrying: 60.",
|
|
829
|
+
"schema": {
|
|
830
|
+
"type": "integer",
|
|
831
|
+
"example": 60
|
|
832
|
+
}
|
|
833
|
+
}
|
|
834
|
+
},
|
|
835
|
+
"content": {
|
|
836
|
+
"application/json": {
|
|
837
|
+
"schema": {
|
|
838
|
+
"type": "object",
|
|
839
|
+
"properties": {
|
|
840
|
+
"error": {
|
|
841
|
+
"type": "string",
|
|
842
|
+
"description": "A sentence for a human. May be reworded."
|
|
843
|
+
},
|
|
844
|
+
"code": {
|
|
845
|
+
"type": "string",
|
|
846
|
+
"enum": [
|
|
847
|
+
"rate_limited"
|
|
848
|
+
],
|
|
849
|
+
"description": "Stable slug - match on this, not on the sentence."
|
|
850
|
+
}
|
|
851
|
+
},
|
|
852
|
+
"required": [
|
|
853
|
+
"error",
|
|
854
|
+
"code"
|
|
855
|
+
]
|
|
856
|
+
},
|
|
857
|
+
"example": {
|
|
858
|
+
"error": "Too many requests with this read key. Wait 60 seconds, then retry.",
|
|
859
|
+
"code": "rate_limited"
|
|
860
|
+
}
|
|
861
|
+
}
|
|
862
|
+
}
|
|
789
863
|
},
|
|
790
864
|
"500": {
|
|
791
865
|
"description": "Error: internal_error",
|
|
@@ -934,6 +1008,13 @@
|
|
|
934
1008
|
"shard": {
|
|
935
1009
|
"index": 1,
|
|
936
1010
|
"runId": "b1e0c6d2-7a43-4f19-8d5e-0c3a9e6f2b71"
|
|
1011
|
+
},
|
|
1012
|
+
"annotations": [
|
|
1013
|
+
"issue"
|
|
1014
|
+
],
|
|
1015
|
+
"location": {
|
|
1016
|
+
"line": 41,
|
|
1017
|
+
"column": 5
|
|
937
1018
|
}
|
|
938
1019
|
},
|
|
939
1020
|
{
|
|
@@ -950,6 +1031,11 @@
|
|
|
950
1031
|
"shard": {
|
|
951
1032
|
"index": 2,
|
|
952
1033
|
"runId": "e4a9d3f0-2b6c-4178-a5d1-9f0e3c7b8a26"
|
|
1034
|
+
},
|
|
1035
|
+
"annotations": [],
|
|
1036
|
+
"location": {
|
|
1037
|
+
"line": 18,
|
|
1038
|
+
"column": 3
|
|
953
1039
|
}
|
|
954
1040
|
}
|
|
955
1041
|
]
|
|
@@ -1114,7 +1200,44 @@
|
|
|
1114
1200
|
}
|
|
1115
1201
|
},
|
|
1116
1202
|
"429": {
|
|
1117
|
-
"description": "Rate limited
|
|
1203
|
+
"description": "Rate limited: more than 60 requests within 60 seconds with one read key. 429: wait the seconds Retry-After names (60), then retry. Requests are counted per key in 60-second windows. A caller far beyond the limit can be stopped earlier by the edge firewall with a bare 429 - no body, no Retry-After; wait 60 seconds just the same.",
|
|
1204
|
+
"headers": {
|
|
1205
|
+
"Retry-After": {
|
|
1206
|
+
"description": "Seconds to wait before retrying: 60.",
|
|
1207
|
+
"schema": {
|
|
1208
|
+
"type": "integer",
|
|
1209
|
+
"example": 60
|
|
1210
|
+
}
|
|
1211
|
+
}
|
|
1212
|
+
},
|
|
1213
|
+
"content": {
|
|
1214
|
+
"application/json": {
|
|
1215
|
+
"schema": {
|
|
1216
|
+
"type": "object",
|
|
1217
|
+
"properties": {
|
|
1218
|
+
"error": {
|
|
1219
|
+
"type": "string",
|
|
1220
|
+
"description": "A sentence for a human. May be reworded."
|
|
1221
|
+
},
|
|
1222
|
+
"code": {
|
|
1223
|
+
"type": "string",
|
|
1224
|
+
"enum": [
|
|
1225
|
+
"rate_limited"
|
|
1226
|
+
],
|
|
1227
|
+
"description": "Stable slug - match on this, not on the sentence."
|
|
1228
|
+
}
|
|
1229
|
+
},
|
|
1230
|
+
"required": [
|
|
1231
|
+
"error",
|
|
1232
|
+
"code"
|
|
1233
|
+
]
|
|
1234
|
+
},
|
|
1235
|
+
"example": {
|
|
1236
|
+
"error": "Too many requests with this read key. Wait 60 seconds, then retry.",
|
|
1237
|
+
"code": "rate_limited"
|
|
1238
|
+
}
|
|
1239
|
+
}
|
|
1240
|
+
}
|
|
1118
1241
|
},
|
|
1119
1242
|
"500": {
|
|
1120
1243
|
"description": "Error: internal_error",
|
|
@@ -1249,11 +1372,26 @@
|
|
|
1249
1372
|
}
|
|
1250
1373
|
}
|
|
1251
1374
|
],
|
|
1252
|
-
"copyPrompt": "You have the repository open. Find the test below, explain the failure and propose a fix.\n\nFailing test: chromium > checkout.spec.ts > Checkout > applies a coupon code\nFile: tests/checkout.spec.ts\
|
|
1375
|
+
"copyPrompt": "You have the repository open. Find the test below, explain the failure and propose a fix.\n\nFailing test: chromium > checkout.spec.ts > Checkout > applies a coupon code\nFile: tests/checkout.spec.ts\nProject: chromium\nRun branch: main\nAttempt: first try\nOutcome: a later retry of this test passed - a flaky run.\n\nError message:\nError: expect(locator).toHaveText(expected) failed\n\nLocator: getByTestId('order-total')\nExpected: \"€ 45.00\"\nReceived: \"€ 50.00\"\nTimeout: 5000ms\nStack (top frames):\nat /home/runner/work/storefront-web/tests/checkout.spec.ts:48:52\nAttempt duration: 6210 ms\nFailure category: Assertion\nLast 30 days on CI: flaky rate 50% (4/8), failure rate 0% (0/8)",
|
|
1253
1376
|
"shard": {
|
|
1254
1377
|
"index": 1,
|
|
1255
1378
|
"runId": "b1e0c6d2-7a43-4f19-8d5e-0c3a9e6f2b71"
|
|
1256
|
-
}
|
|
1379
|
+
},
|
|
1380
|
+
"annotations": [
|
|
1381
|
+
{
|
|
1382
|
+
"type": "issue",
|
|
1383
|
+
"description": "https://github.com/example-shop/storefront/issues/412",
|
|
1384
|
+
"location": "tests/checkout.spec.ts:41:5"
|
|
1385
|
+
}
|
|
1386
|
+
],
|
|
1387
|
+
"annotationsOmitted": 0,
|
|
1388
|
+
"location": {
|
|
1389
|
+
"line": 41,
|
|
1390
|
+
"column": 5
|
|
1391
|
+
},
|
|
1392
|
+
"workerIndex": 2,
|
|
1393
|
+
"parallelIndex": 2,
|
|
1394
|
+
"startedAt": "2026-10-30T09:14:07.412Z"
|
|
1257
1395
|
},
|
|
1258
1396
|
{
|
|
1259
1397
|
"retry": 1,
|
|
@@ -1268,7 +1406,22 @@
|
|
|
1268
1406
|
"shard": {
|
|
1269
1407
|
"index": 1,
|
|
1270
1408
|
"runId": "b1e0c6d2-7a43-4f19-8d5e-0c3a9e6f2b71"
|
|
1271
|
-
}
|
|
1409
|
+
},
|
|
1410
|
+
"annotations": [
|
|
1411
|
+
{
|
|
1412
|
+
"type": "issue",
|
|
1413
|
+
"description": "https://github.com/example-shop/storefront/issues/412",
|
|
1414
|
+
"location": "tests/checkout.spec.ts:41:5"
|
|
1415
|
+
}
|
|
1416
|
+
],
|
|
1417
|
+
"annotationsOmitted": 0,
|
|
1418
|
+
"location": {
|
|
1419
|
+
"line": 41,
|
|
1420
|
+
"column": 5
|
|
1421
|
+
},
|
|
1422
|
+
"workerIndex": 5,
|
|
1423
|
+
"parallelIndex": 2,
|
|
1424
|
+
"startedAt": "2026-10-30T09:14:14.180Z"
|
|
1272
1425
|
}
|
|
1273
1426
|
]
|
|
1274
1427
|
}
|
|
@@ -1476,7 +1629,44 @@
|
|
|
1476
1629
|
}
|
|
1477
1630
|
},
|
|
1478
1631
|
"429": {
|
|
1479
|
-
"description": "Rate limited
|
|
1632
|
+
"description": "Rate limited: more than 60 requests within 60 seconds with one read key. 429: wait the seconds Retry-After names (60), then retry. Requests are counted per key in 60-second windows. A caller far beyond the limit can be stopped earlier by the edge firewall with a bare 429 - no body, no Retry-After; wait 60 seconds just the same.",
|
|
1633
|
+
"headers": {
|
|
1634
|
+
"Retry-After": {
|
|
1635
|
+
"description": "Seconds to wait before retrying: 60.",
|
|
1636
|
+
"schema": {
|
|
1637
|
+
"type": "integer",
|
|
1638
|
+
"example": 60
|
|
1639
|
+
}
|
|
1640
|
+
}
|
|
1641
|
+
},
|
|
1642
|
+
"content": {
|
|
1643
|
+
"application/json": {
|
|
1644
|
+
"schema": {
|
|
1645
|
+
"type": "object",
|
|
1646
|
+
"properties": {
|
|
1647
|
+
"error": {
|
|
1648
|
+
"type": "string",
|
|
1649
|
+
"description": "A sentence for a human. May be reworded."
|
|
1650
|
+
},
|
|
1651
|
+
"code": {
|
|
1652
|
+
"type": "string",
|
|
1653
|
+
"enum": [
|
|
1654
|
+
"rate_limited"
|
|
1655
|
+
],
|
|
1656
|
+
"description": "Stable slug - match on this, not on the sentence."
|
|
1657
|
+
}
|
|
1658
|
+
},
|
|
1659
|
+
"required": [
|
|
1660
|
+
"error",
|
|
1661
|
+
"code"
|
|
1662
|
+
]
|
|
1663
|
+
},
|
|
1664
|
+
"example": {
|
|
1665
|
+
"error": "Too many requests with this read key. Wait 60 seconds, then retry.",
|
|
1666
|
+
"code": "rate_limited"
|
|
1667
|
+
}
|
|
1668
|
+
}
|
|
1669
|
+
}
|
|
1480
1670
|
},
|
|
1481
1671
|
"500": {
|
|
1482
1672
|
"description": "Error: internal_error",
|
|
@@ -1712,7 +1902,44 @@
|
|
|
1712
1902
|
}
|
|
1713
1903
|
},
|
|
1714
1904
|
"429": {
|
|
1715
|
-
"description": "Rate limited
|
|
1905
|
+
"description": "Rate limited: more than 60 requests within 60 seconds with one read key. 429: wait the seconds Retry-After names (60), then retry. Requests are counted per key in 60-second windows. A caller far beyond the limit can be stopped earlier by the edge firewall with a bare 429 - no body, no Retry-After; wait 60 seconds just the same.",
|
|
1906
|
+
"headers": {
|
|
1907
|
+
"Retry-After": {
|
|
1908
|
+
"description": "Seconds to wait before retrying: 60.",
|
|
1909
|
+
"schema": {
|
|
1910
|
+
"type": "integer",
|
|
1911
|
+
"example": 60
|
|
1912
|
+
}
|
|
1913
|
+
}
|
|
1914
|
+
},
|
|
1915
|
+
"content": {
|
|
1916
|
+
"application/json": {
|
|
1917
|
+
"schema": {
|
|
1918
|
+
"type": "object",
|
|
1919
|
+
"properties": {
|
|
1920
|
+
"error": {
|
|
1921
|
+
"type": "string",
|
|
1922
|
+
"description": "A sentence for a human. May be reworded."
|
|
1923
|
+
},
|
|
1924
|
+
"code": {
|
|
1925
|
+
"type": "string",
|
|
1926
|
+
"enum": [
|
|
1927
|
+
"rate_limited"
|
|
1928
|
+
],
|
|
1929
|
+
"description": "Stable slug - match on this, not on the sentence."
|
|
1930
|
+
}
|
|
1931
|
+
},
|
|
1932
|
+
"required": [
|
|
1933
|
+
"error",
|
|
1934
|
+
"code"
|
|
1935
|
+
]
|
|
1936
|
+
},
|
|
1937
|
+
"example": {
|
|
1938
|
+
"error": "Too many requests with this read key. Wait 60 seconds, then retry.",
|
|
1939
|
+
"code": "rate_limited"
|
|
1940
|
+
}
|
|
1941
|
+
}
|
|
1942
|
+
}
|
|
1716
1943
|
},
|
|
1717
1944
|
"500": {
|
|
1718
1945
|
"description": "Error: internal_error",
|
|
@@ -1757,7 +1984,7 @@
|
|
|
1757
1984
|
"get": {
|
|
1758
1985
|
"operationId": "listTests",
|
|
1759
1986
|
"summary": "List tests",
|
|
1760
|
-
"description": "Every test with a run of the source (all by default) in the period and its metrics - stability, flaky rate, failure rate, runs, time lost, its last 20 runs, the branches it ran on and where it fails most - ranked by the chosen sort. Counts finished runs of the source - all by default - without mass-failure runs, on every branch unless branch names one (see population). Moderate: aggregate queries over the period's results of the source, paged in the database; use the metrics route for one test.",
|
|
1987
|
+
"description": "Every test with a run of the source (all by default) in the period and its metrics - stability, flaky rate, failure rate, runs, time lost, its median duration, its last 20 runs, the branches it ran on and where it fails most - ranked by the chosen sort. Each test once across its Playwright projects, its projects named and each project's own numbers in variants (since 1.0.0-beta.19; one item per project before). Counts finished runs of the source - all by default - without mass-failure runs, on every branch unless branch names one (see population). Moderate: aggregate queries over the period's results of the source, paged in the database; use the metrics route for one test.",
|
|
1761
1988
|
"tags": [
|
|
1762
1989
|
"Tests"
|
|
1763
1990
|
],
|
|
@@ -1825,14 +2052,17 @@
|
|
|
1825
2052
|
}
|
|
1826
2053
|
},
|
|
1827
2054
|
{
|
|
1828
|
-
"name": "
|
|
2055
|
+
"name": "project",
|
|
1829
2056
|
"in": "query",
|
|
1830
2057
|
"required": false,
|
|
1831
|
-
"description": "Only
|
|
2058
|
+
"description": "Only these Playwright projects, exactly (e.g. chromium) - repeat the parameter for several: ?project=chromium&project=firefox. Each test then counts only those projects' variants. Every project when absent. Called browser, one value, until 1.0.0-beta.19 - browser is now a 400.",
|
|
1832
2059
|
"schema": {
|
|
1833
|
-
"type": "
|
|
1834
|
-
"
|
|
1835
|
-
|
|
2060
|
+
"type": "array",
|
|
2061
|
+
"items": {
|
|
2062
|
+
"type": "string",
|
|
2063
|
+
"minLength": 1,
|
|
2064
|
+
"maxLength": 200
|
|
2065
|
+
}
|
|
1836
2066
|
}
|
|
1837
2067
|
},
|
|
1838
2068
|
{
|
|
@@ -1899,17 +2129,20 @@
|
|
|
1899
2129
|
"since": "2026-08-25T08:00:00.000Z",
|
|
1900
2130
|
"until": "2026-09-24T08:00:00.000Z",
|
|
1901
2131
|
"branch": null,
|
|
1902
|
-
"
|
|
2132
|
+
"projectFilter": [],
|
|
1903
2133
|
"sort": "stability",
|
|
1904
2134
|
"page": 1,
|
|
1905
2135
|
"perPage": 3,
|
|
1906
|
-
"total":
|
|
1907
|
-
"pageCount":
|
|
2136
|
+
"total": 205,
|
|
2137
|
+
"pageCount": 69,
|
|
1908
2138
|
"items": [
|
|
1909
2139
|
{
|
|
1910
|
-
"testName": "
|
|
2140
|
+
"testName": "checkout.spec.ts > Checkout > applies a coupon code",
|
|
1911
2141
|
"filePath": "tests/checkout.spec.ts",
|
|
1912
|
-
"
|
|
2142
|
+
"projects": [
|
|
2143
|
+
"chromium",
|
|
2144
|
+
"firefox"
|
|
2145
|
+
],
|
|
1913
2146
|
"runs": 8,
|
|
1914
2147
|
"stableRuns": 4,
|
|
1915
2148
|
"flakyRuns": 4,
|
|
@@ -1918,6 +2151,7 @@
|
|
|
1918
2151
|
"flakyRate": 0.5,
|
|
1919
2152
|
"failureRate": 0,
|
|
1920
2153
|
"timeLostMs": 7361,
|
|
2154
|
+
"medianDurationMs": 1840,
|
|
1921
2155
|
"recentResults": [
|
|
1922
2156
|
{
|
|
1923
2157
|
"runId": "5c8e2a17-9d4b-4f60-b3a1-7e2d9c0f4b58",
|
|
@@ -1984,12 +2218,37 @@
|
|
|
1984
2218
|
"branch": "main",
|
|
1985
2219
|
"kind": "retries",
|
|
1986
2220
|
"count": 3
|
|
1987
|
-
}
|
|
2221
|
+
},
|
|
2222
|
+
"variants": [
|
|
2223
|
+
{
|
|
2224
|
+
"testName": "chromium > checkout.spec.ts > Checkout > applies a coupon code",
|
|
2225
|
+
"project": "chromium",
|
|
2226
|
+
"runs": 8,
|
|
2227
|
+
"stableRuns": 4,
|
|
2228
|
+
"flakyRuns": 4,
|
|
2229
|
+
"failedRuns": 0,
|
|
2230
|
+
"timeLostMs": 7361,
|
|
2231
|
+
"medianDurationMs": 1840
|
|
2232
|
+
},
|
|
2233
|
+
{
|
|
2234
|
+
"testName": "firefox > checkout.spec.ts > Checkout > applies a coupon code",
|
|
2235
|
+
"project": "firefox",
|
|
2236
|
+
"runs": 8,
|
|
2237
|
+
"stableRuns": 8,
|
|
2238
|
+
"flakyRuns": 0,
|
|
2239
|
+
"failedRuns": 0,
|
|
2240
|
+
"timeLostMs": 0,
|
|
2241
|
+
"medianDurationMs": 1795
|
|
2242
|
+
}
|
|
2243
|
+
]
|
|
1988
2244
|
},
|
|
1989
2245
|
{
|
|
1990
|
-
"testName": "
|
|
2246
|
+
"testName": "search.spec.ts > Search > filters by date",
|
|
1991
2247
|
"filePath": "tests/search.spec.ts",
|
|
1992
|
-
"
|
|
2248
|
+
"projects": [
|
|
2249
|
+
"chromium",
|
|
2250
|
+
"firefox"
|
|
2251
|
+
],
|
|
1993
2252
|
"runs": 8,
|
|
1994
2253
|
"stableRuns": 5,
|
|
1995
2254
|
"flakyRuns": 0,
|
|
@@ -1998,6 +2257,7 @@
|
|
|
1998
2257
|
"flakyRate": 0,
|
|
1999
2258
|
"failureRate": 0.375,
|
|
2000
2259
|
"timeLostMs": 14308,
|
|
2260
|
+
"medianDurationMs": 2385,
|
|
2001
2261
|
"recentResults": [
|
|
2002
2262
|
{
|
|
2003
2263
|
"runId": "5c8e2a17-9d4b-4f60-b3a1-7e2d9c0f4b58",
|
|
@@ -2064,12 +2324,37 @@
|
|
|
2064
2324
|
"branch": "main",
|
|
2065
2325
|
"kind": "failures",
|
|
2066
2326
|
"count": 2
|
|
2067
|
-
}
|
|
2327
|
+
},
|
|
2328
|
+
"variants": [
|
|
2329
|
+
{
|
|
2330
|
+
"testName": "chromium > search.spec.ts > Search > filters by date",
|
|
2331
|
+
"project": "chromium",
|
|
2332
|
+
"runs": 8,
|
|
2333
|
+
"stableRuns": 5,
|
|
2334
|
+
"flakyRuns": 0,
|
|
2335
|
+
"failedRuns": 3,
|
|
2336
|
+
"timeLostMs": 14308,
|
|
2337
|
+
"medianDurationMs": 2385
|
|
2338
|
+
},
|
|
2339
|
+
{
|
|
2340
|
+
"testName": "firefox > search.spec.ts > Search > filters by date",
|
|
2341
|
+
"project": "firefox",
|
|
2342
|
+
"runs": 8,
|
|
2343
|
+
"stableRuns": 8,
|
|
2344
|
+
"flakyRuns": 0,
|
|
2345
|
+
"failedRuns": 0,
|
|
2346
|
+
"timeLostMs": 0,
|
|
2347
|
+
"medianDurationMs": 2290
|
|
2348
|
+
}
|
|
2349
|
+
]
|
|
2068
2350
|
},
|
|
2069
2351
|
{
|
|
2070
|
-
"testName": "
|
|
2352
|
+
"testName": "auth.spec.ts > Login > remembers the device",
|
|
2071
2353
|
"filePath": "tests/auth.spec.ts",
|
|
2072
|
-
"
|
|
2354
|
+
"projects": [
|
|
2355
|
+
"chromium",
|
|
2356
|
+
"firefox"
|
|
2357
|
+
],
|
|
2073
2358
|
"runs": 7,
|
|
2074
2359
|
"stableRuns": 6,
|
|
2075
2360
|
"flakyRuns": 1,
|
|
@@ -2078,6 +2363,7 @@
|
|
|
2078
2363
|
"flakyRate": 0.14285714285714285,
|
|
2079
2364
|
"failureRate": 0,
|
|
2080
2365
|
"timeLostMs": 3071,
|
|
2366
|
+
"medianDurationMs": 3012,
|
|
2081
2367
|
"recentResults": [
|
|
2082
2368
|
{
|
|
2083
2369
|
"runId": "5c8e2a17-9d4b-4f60-b3a1-7e2d9c0f4b58",
|
|
@@ -2144,7 +2430,29 @@
|
|
|
2144
2430
|
"branch": "feature/saved-carts",
|
|
2145
2431
|
"kind": "retries",
|
|
2146
2432
|
"count": 1
|
|
2147
|
-
}
|
|
2433
|
+
},
|
|
2434
|
+
"variants": [
|
|
2435
|
+
{
|
|
2436
|
+
"testName": "chromium > auth.spec.ts > Login > remembers the device",
|
|
2437
|
+
"project": "chromium",
|
|
2438
|
+
"runs": 7,
|
|
2439
|
+
"stableRuns": 6,
|
|
2440
|
+
"flakyRuns": 1,
|
|
2441
|
+
"failedRuns": 0,
|
|
2442
|
+
"timeLostMs": 3071,
|
|
2443
|
+
"medianDurationMs": 3012
|
|
2444
|
+
},
|
|
2445
|
+
{
|
|
2446
|
+
"testName": "firefox > auth.spec.ts > Login > remembers the device",
|
|
2447
|
+
"project": "firefox",
|
|
2448
|
+
"runs": 7,
|
|
2449
|
+
"stableRuns": 7,
|
|
2450
|
+
"flakyRuns": 0,
|
|
2451
|
+
"failedRuns": 0,
|
|
2452
|
+
"timeLostMs": 0,
|
|
2453
|
+
"medianDurationMs": 2954
|
|
2454
|
+
}
|
|
2455
|
+
]
|
|
2148
2456
|
}
|
|
2149
2457
|
]
|
|
2150
2458
|
}
|
|
@@ -2344,7 +2652,44 @@
|
|
|
2344
2652
|
}
|
|
2345
2653
|
},
|
|
2346
2654
|
"429": {
|
|
2347
|
-
"description": "Rate limited
|
|
2655
|
+
"description": "Rate limited: more than 60 requests within 60 seconds with one read key. 429: wait the seconds Retry-After names (60), then retry. Requests are counted per key in 60-second windows. A caller far beyond the limit can be stopped earlier by the edge firewall with a bare 429 - no body, no Retry-After; wait 60 seconds just the same.",
|
|
2656
|
+
"headers": {
|
|
2657
|
+
"Retry-After": {
|
|
2658
|
+
"description": "Seconds to wait before retrying: 60.",
|
|
2659
|
+
"schema": {
|
|
2660
|
+
"type": "integer",
|
|
2661
|
+
"example": 60
|
|
2662
|
+
}
|
|
2663
|
+
}
|
|
2664
|
+
},
|
|
2665
|
+
"content": {
|
|
2666
|
+
"application/json": {
|
|
2667
|
+
"schema": {
|
|
2668
|
+
"type": "object",
|
|
2669
|
+
"properties": {
|
|
2670
|
+
"error": {
|
|
2671
|
+
"type": "string",
|
|
2672
|
+
"description": "A sentence for a human. May be reworded."
|
|
2673
|
+
},
|
|
2674
|
+
"code": {
|
|
2675
|
+
"type": "string",
|
|
2676
|
+
"enum": [
|
|
2677
|
+
"rate_limited"
|
|
2678
|
+
],
|
|
2679
|
+
"description": "Stable slug - match on this, not on the sentence."
|
|
2680
|
+
}
|
|
2681
|
+
},
|
|
2682
|
+
"required": [
|
|
2683
|
+
"error",
|
|
2684
|
+
"code"
|
|
2685
|
+
]
|
|
2686
|
+
},
|
|
2687
|
+
"example": {
|
|
2688
|
+
"error": "Too many requests with this read key. Wait 60 seconds, then retry.",
|
|
2689
|
+
"code": "rate_limited"
|
|
2690
|
+
}
|
|
2691
|
+
}
|
|
2692
|
+
}
|
|
2348
2693
|
},
|
|
2349
2694
|
"500": {
|
|
2350
2695
|
"description": "Error: internal_error",
|
|
@@ -2389,7 +2734,7 @@
|
|
|
2389
2734
|
"get": {
|
|
2390
2735
|
"operationId": "getTestMetrics",
|
|
2391
2736
|
"summary": "Get test metrics",
|
|
2392
|
-
"description": "One test's metrics over the period: the fields of its /tests row, flat, beside the same period. A test with results but no run of the source in the period answers zeros and null rates rather than 404. Cheap: the list's queries, narrowed to one test; prefer it to /tests when the question is about one test.",
|
|
2737
|
+
"description": "One test's metrics over the period: the fields of its /tests row, flat, beside the same period - across its Playwright projects, or one project's with project. A test with results but no run of the source in the period answers zeros and null rates rather than 404. Cheap: the list's queries, narrowed to one test; prefer it to /tests when the question is about one test.",
|
|
2393
2738
|
"tags": [
|
|
2394
2739
|
"Tests"
|
|
2395
2740
|
],
|
|
@@ -2407,7 +2752,7 @@
|
|
|
2407
2752
|
"name": "testName",
|
|
2408
2753
|
"in": "path",
|
|
2409
2754
|
"required": true,
|
|
2410
|
-
"description": "The
|
|
2755
|
+
"description": "The test's name WITHOUT its Playwright project, as /tests lists it (e.g. cart.spec.ts > adds an item): every project of the test. A stored name WITH its project (chromium > cart.spec.ts > adds an item, the identity before 1.0.0-beta.19) is that test in that project only. URL-encode it, including \"/\" as %2F. A name used in several spec files needs ?filePath=.",
|
|
2411
2756
|
"schema": {
|
|
2412
2757
|
"type": "string"
|
|
2413
2758
|
}
|
|
@@ -2421,6 +2766,17 @@
|
|
|
2421
2766
|
"type": "string"
|
|
2422
2767
|
}
|
|
2423
2768
|
},
|
|
2769
|
+
{
|
|
2770
|
+
"name": "project",
|
|
2771
|
+
"in": "query",
|
|
2772
|
+
"required": false,
|
|
2773
|
+
"description": "Only this Playwright project's variant of the test, exactly (e.g. chromium) - the numbers as they were per variant before 1.0.0-beta.19. Every project of the test when absent. A project the test did not run in is 404 test_not_found.",
|
|
2774
|
+
"schema": {
|
|
2775
|
+
"type": "string",
|
|
2776
|
+
"minLength": 1,
|
|
2777
|
+
"maxLength": 200
|
|
2778
|
+
}
|
|
2779
|
+
},
|
|
2424
2780
|
{
|
|
2425
2781
|
"name": "days",
|
|
2426
2782
|
"in": "query",
|
|
@@ -2487,9 +2843,13 @@
|
|
|
2487
2843
|
"since": "2026-08-25T08:00:00.000Z",
|
|
2488
2844
|
"until": "2026-09-24T08:00:00.000Z",
|
|
2489
2845
|
"branch": null,
|
|
2490
|
-
"
|
|
2846
|
+
"projectFilter": null,
|
|
2847
|
+
"testName": "checkout.spec.ts > Checkout > applies a coupon code",
|
|
2491
2848
|
"filePath": "tests/checkout.spec.ts",
|
|
2492
|
-
"
|
|
2849
|
+
"projects": [
|
|
2850
|
+
"chromium",
|
|
2851
|
+
"firefox"
|
|
2852
|
+
],
|
|
2493
2853
|
"runs": 8,
|
|
2494
2854
|
"stableRuns": 4,
|
|
2495
2855
|
"flakyRuns": 4,
|
|
@@ -2498,6 +2858,7 @@
|
|
|
2498
2858
|
"flakyRate": 0.5,
|
|
2499
2859
|
"failureRate": 0,
|
|
2500
2860
|
"timeLostMs": 7361,
|
|
2861
|
+
"medianDurationMs": 1840,
|
|
2501
2862
|
"recentResults": [
|
|
2502
2863
|
{
|
|
2503
2864
|
"runId": "5c8e2a17-9d4b-4f60-b3a1-7e2d9c0f4b58",
|
|
@@ -2564,13 +2925,35 @@
|
|
|
2564
2925
|
"branch": "main",
|
|
2565
2926
|
"kind": "retries",
|
|
2566
2927
|
"count": 3
|
|
2567
|
-
}
|
|
2568
|
-
|
|
2569
|
-
|
|
2570
|
-
|
|
2571
|
-
|
|
2572
|
-
|
|
2573
|
-
|
|
2928
|
+
},
|
|
2929
|
+
"variants": [
|
|
2930
|
+
{
|
|
2931
|
+
"testName": "chromium > checkout.spec.ts > Checkout > applies a coupon code",
|
|
2932
|
+
"project": "chromium",
|
|
2933
|
+
"runs": 8,
|
|
2934
|
+
"stableRuns": 4,
|
|
2935
|
+
"flakyRuns": 4,
|
|
2936
|
+
"failedRuns": 0,
|
|
2937
|
+
"timeLostMs": 7361,
|
|
2938
|
+
"medianDurationMs": 1840
|
|
2939
|
+
},
|
|
2940
|
+
{
|
|
2941
|
+
"testName": "firefox > checkout.spec.ts > Checkout > applies a coupon code",
|
|
2942
|
+
"project": "firefox",
|
|
2943
|
+
"runs": 8,
|
|
2944
|
+
"stableRuns": 8,
|
|
2945
|
+
"flakyRuns": 0,
|
|
2946
|
+
"failedRuns": 0,
|
|
2947
|
+
"timeLostMs": 0,
|
|
2948
|
+
"medianDurationMs": 1795
|
|
2949
|
+
}
|
|
2950
|
+
]
|
|
2951
|
+
}
|
|
2952
|
+
}
|
|
2953
|
+
}
|
|
2954
|
+
},
|
|
2955
|
+
"400": {
|
|
2956
|
+
"description": "Error: ambiguous_test, invalid_parameter, invalid_period",
|
|
2574
2957
|
"content": {
|
|
2575
2958
|
"application/json": {
|
|
2576
2959
|
"schema": {
|
|
@@ -2778,7 +3161,44 @@
|
|
|
2778
3161
|
}
|
|
2779
3162
|
},
|
|
2780
3163
|
"429": {
|
|
2781
|
-
"description": "Rate limited
|
|
3164
|
+
"description": "Rate limited: more than 60 requests within 60 seconds with one read key. 429: wait the seconds Retry-After names (60), then retry. Requests are counted per key in 60-second windows. A caller far beyond the limit can be stopped earlier by the edge firewall with a bare 429 - no body, no Retry-After; wait 60 seconds just the same.",
|
|
3165
|
+
"headers": {
|
|
3166
|
+
"Retry-After": {
|
|
3167
|
+
"description": "Seconds to wait before retrying: 60.",
|
|
3168
|
+
"schema": {
|
|
3169
|
+
"type": "integer",
|
|
3170
|
+
"example": 60
|
|
3171
|
+
}
|
|
3172
|
+
}
|
|
3173
|
+
},
|
|
3174
|
+
"content": {
|
|
3175
|
+
"application/json": {
|
|
3176
|
+
"schema": {
|
|
3177
|
+
"type": "object",
|
|
3178
|
+
"properties": {
|
|
3179
|
+
"error": {
|
|
3180
|
+
"type": "string",
|
|
3181
|
+
"description": "A sentence for a human. May be reworded."
|
|
3182
|
+
},
|
|
3183
|
+
"code": {
|
|
3184
|
+
"type": "string",
|
|
3185
|
+
"enum": [
|
|
3186
|
+
"rate_limited"
|
|
3187
|
+
],
|
|
3188
|
+
"description": "Stable slug - match on this, not on the sentence."
|
|
3189
|
+
}
|
|
3190
|
+
},
|
|
3191
|
+
"required": [
|
|
3192
|
+
"error",
|
|
3193
|
+
"code"
|
|
3194
|
+
]
|
|
3195
|
+
},
|
|
3196
|
+
"example": {
|
|
3197
|
+
"error": "Too many requests with this read key. Wait 60 seconds, then retry.",
|
|
3198
|
+
"code": "rate_limited"
|
|
3199
|
+
}
|
|
3200
|
+
}
|
|
3201
|
+
}
|
|
2782
3202
|
},
|
|
2783
3203
|
"500": {
|
|
2784
3204
|
"description": "Error: internal_error",
|
|
@@ -2823,7 +3243,7 @@
|
|
|
2823
3243
|
"get": {
|
|
2824
3244
|
"operationId": "getTestHistory",
|
|
2825
3245
|
"summary": "Get test history",
|
|
2826
|
-
"description": "Get a test's history across runs. One test in every run of a period, newest first: final status, duration, attempts and time spent on retries. Every run is listed; source decides which are counted. Moderate.",
|
|
3246
|
+
"description": "Get a test's history across runs. One test in every run of a period, newest first: final status, duration, attempts and time spent on retries - across its Playwright projects, each project's own result beside it, or one project's with project. Every run is listed; source decides which are counted. Moderate.",
|
|
2827
3247
|
"tags": [
|
|
2828
3248
|
"Tests"
|
|
2829
3249
|
],
|
|
@@ -2841,7 +3261,7 @@
|
|
|
2841
3261
|
"name": "testName",
|
|
2842
3262
|
"in": "path",
|
|
2843
3263
|
"required": true,
|
|
2844
|
-
"description": "The
|
|
3264
|
+
"description": "The test's name WITHOUT its Playwright project, as /tests lists it (e.g. cart.spec.ts > adds an item): every project of the test. A stored name WITH its project (chromium > cart.spec.ts > adds an item, the identity before 1.0.0-beta.19) is that test in that project only. URL-encode it, including \"/\" as %2F. A name used in several spec files needs ?filePath=.",
|
|
2845
3265
|
"schema": {
|
|
2846
3266
|
"type": "string"
|
|
2847
3267
|
}
|
|
@@ -2855,6 +3275,17 @@
|
|
|
2855
3275
|
"type": "string"
|
|
2856
3276
|
}
|
|
2857
3277
|
},
|
|
3278
|
+
{
|
|
3279
|
+
"name": "project",
|
|
3280
|
+
"in": "query",
|
|
3281
|
+
"required": false,
|
|
3282
|
+
"description": "Only this Playwright project's variant of the test, exactly (e.g. chromium) - the numbers as they were per variant before 1.0.0-beta.19. Every project of the test when absent. A project the test did not run in is 404 test_not_found.",
|
|
3283
|
+
"schema": {
|
|
3284
|
+
"type": "string",
|
|
3285
|
+
"minLength": 1,
|
|
3286
|
+
"maxLength": 200
|
|
3287
|
+
}
|
|
3288
|
+
},
|
|
2858
3289
|
{
|
|
2859
3290
|
"name": "days",
|
|
2860
3291
|
"in": "query",
|
|
@@ -2906,8 +3337,9 @@
|
|
|
2906
3337
|
"name": "storefront-web"
|
|
2907
3338
|
},
|
|
2908
3339
|
"test": {
|
|
2909
|
-
"name": "
|
|
2910
|
-
"filePath": "tests/checkout.spec.ts"
|
|
3340
|
+
"name": "checkout.spec.ts > Checkout > applies a coupon code",
|
|
3341
|
+
"filePath": "tests/checkout.spec.ts",
|
|
3342
|
+
"project": null
|
|
2911
3343
|
},
|
|
2912
3344
|
"window": {
|
|
2913
3345
|
"days": 30,
|
|
@@ -2927,14 +3359,26 @@
|
|
|
2927
3359
|
"durationMs": 1840,
|
|
2928
3360
|
"timedOut": false,
|
|
2929
3361
|
"timeoutMs": 30000,
|
|
2930
|
-
"attempts":
|
|
2931
|
-
"wastedMs": 6210
|
|
3362
|
+
"attempts": 3,
|
|
3363
|
+
"wastedMs": 6210,
|
|
3364
|
+
"projects": [
|
|
3365
|
+
{
|
|
3366
|
+
"project": "chromium",
|
|
3367
|
+
"status": "passed",
|
|
3368
|
+
"attempts": 2
|
|
3369
|
+
},
|
|
3370
|
+
{
|
|
3371
|
+
"project": "firefox",
|
|
3372
|
+
"status": "passed",
|
|
3373
|
+
"attempts": 1
|
|
3374
|
+
}
|
|
3375
|
+
]
|
|
2932
3376
|
},
|
|
2933
3377
|
{
|
|
2934
3378
|
"runId": "7d2f4b19-3c8e-4a61-9e07-5b1d8c2a6f34",
|
|
2935
3379
|
"runNumber": 1283,
|
|
2936
|
-
"local":
|
|
2937
|
-
"counted":
|
|
3380
|
+
"local": false,
|
|
3381
|
+
"counted": true,
|
|
2938
3382
|
"branch": "feature/saved-carts",
|
|
2939
3383
|
"testedRevision": "c4f7a1e9b3d5c8e2f0a6b4d9e1c7f3a5b8d2e0f6",
|
|
2940
3384
|
"startedAt": "2026-09-23T16:05:40.000Z",
|
|
@@ -2942,8 +3386,20 @@
|
|
|
2942
3386
|
"durationMs": 1795,
|
|
2943
3387
|
"timedOut": null,
|
|
2944
3388
|
"timeoutMs": null,
|
|
2945
|
-
"attempts":
|
|
2946
|
-
"wastedMs": 0
|
|
3389
|
+
"attempts": 2,
|
|
3390
|
+
"wastedMs": 0,
|
|
3391
|
+
"projects": [
|
|
3392
|
+
{
|
|
3393
|
+
"project": "chromium",
|
|
3394
|
+
"status": "passed",
|
|
3395
|
+
"attempts": 1
|
|
3396
|
+
},
|
|
3397
|
+
{
|
|
3398
|
+
"project": "firefox",
|
|
3399
|
+
"status": "passed",
|
|
3400
|
+
"attempts": 1
|
|
3401
|
+
}
|
|
3402
|
+
]
|
|
2947
3403
|
}
|
|
2948
3404
|
]
|
|
2949
3405
|
}
|
|
@@ -3159,7 +3615,44 @@
|
|
|
3159
3615
|
}
|
|
3160
3616
|
},
|
|
3161
3617
|
"429": {
|
|
3162
|
-
"description": "Rate limited
|
|
3618
|
+
"description": "Rate limited: more than 60 requests within 60 seconds with one read key. 429: wait the seconds Retry-After names (60), then retry. Requests are counted per key in 60-second windows. A caller far beyond the limit can be stopped earlier by the edge firewall with a bare 429 - no body, no Retry-After; wait 60 seconds just the same.",
|
|
3619
|
+
"headers": {
|
|
3620
|
+
"Retry-After": {
|
|
3621
|
+
"description": "Seconds to wait before retrying: 60.",
|
|
3622
|
+
"schema": {
|
|
3623
|
+
"type": "integer",
|
|
3624
|
+
"example": 60
|
|
3625
|
+
}
|
|
3626
|
+
}
|
|
3627
|
+
},
|
|
3628
|
+
"content": {
|
|
3629
|
+
"application/json": {
|
|
3630
|
+
"schema": {
|
|
3631
|
+
"type": "object",
|
|
3632
|
+
"properties": {
|
|
3633
|
+
"error": {
|
|
3634
|
+
"type": "string",
|
|
3635
|
+
"description": "A sentence for a human. May be reworded."
|
|
3636
|
+
},
|
|
3637
|
+
"code": {
|
|
3638
|
+
"type": "string",
|
|
3639
|
+
"enum": [
|
|
3640
|
+
"rate_limited"
|
|
3641
|
+
],
|
|
3642
|
+
"description": "Stable slug - match on this, not on the sentence."
|
|
3643
|
+
}
|
|
3644
|
+
},
|
|
3645
|
+
"required": [
|
|
3646
|
+
"error",
|
|
3647
|
+
"code"
|
|
3648
|
+
]
|
|
3649
|
+
},
|
|
3650
|
+
"example": {
|
|
3651
|
+
"error": "Too many requests with this read key. Wait 60 seconds, then retry.",
|
|
3652
|
+
"code": "rate_limited"
|
|
3653
|
+
}
|
|
3654
|
+
}
|
|
3655
|
+
}
|
|
3163
3656
|
},
|
|
3164
3657
|
"500": {
|
|
3165
3658
|
"description": "Error: internal_error",
|
|
@@ -3316,16 +3809,19 @@
|
|
|
3316
3809
|
"fileCount": 1,
|
|
3317
3810
|
"testCount": 1,
|
|
3318
3811
|
"testNames": [
|
|
3319
|
-
"
|
|
3812
|
+
"checkout.spec.ts > Checkout > applies a coupon code"
|
|
3813
|
+
],
|
|
3814
|
+
"projects": [
|
|
3815
|
+
"chromium"
|
|
3320
3816
|
],
|
|
3321
|
-
"occurrenceCount":
|
|
3322
|
-
"runCount":
|
|
3323
|
-
"failedCount":
|
|
3324
|
-
"flakyCount":
|
|
3325
|
-
"failedRunCount":
|
|
3326
|
-
"flakyRunCount":
|
|
3817
|
+
"occurrenceCount": 4,
|
|
3818
|
+
"runCount": 4,
|
|
3819
|
+
"failedCount": 0,
|
|
3820
|
+
"flakyCount": 4,
|
|
3821
|
+
"failedRunCount": 0,
|
|
3822
|
+
"flakyRunCount": 4,
|
|
3327
3823
|
"massFailureRunCount": 0,
|
|
3328
|
-
"firstSeen": "2026-09-
|
|
3824
|
+
"firstSeen": "2026-09-14T15:14:27.000Z",
|
|
3329
3825
|
"lastSeen": "2026-09-24T07:34:05.000Z"
|
|
3330
3826
|
}
|
|
3331
3827
|
],
|
|
@@ -3528,7 +4024,44 @@
|
|
|
3528
4024
|
}
|
|
3529
4025
|
},
|
|
3530
4026
|
"429": {
|
|
3531
|
-
"description": "Rate limited
|
|
4027
|
+
"description": "Rate limited: more than 60 requests within 60 seconds with one read key. 429: wait the seconds Retry-After names (60), then retry. Requests are counted per key in 60-second windows. A caller far beyond the limit can be stopped earlier by the edge firewall with a bare 429 - no body, no Retry-After; wait 60 seconds just the same.",
|
|
4028
|
+
"headers": {
|
|
4029
|
+
"Retry-After": {
|
|
4030
|
+
"description": "Seconds to wait before retrying: 60.",
|
|
4031
|
+
"schema": {
|
|
4032
|
+
"type": "integer",
|
|
4033
|
+
"example": 60
|
|
4034
|
+
}
|
|
4035
|
+
}
|
|
4036
|
+
},
|
|
4037
|
+
"content": {
|
|
4038
|
+
"application/json": {
|
|
4039
|
+
"schema": {
|
|
4040
|
+
"type": "object",
|
|
4041
|
+
"properties": {
|
|
4042
|
+
"error": {
|
|
4043
|
+
"type": "string",
|
|
4044
|
+
"description": "A sentence for a human. May be reworded."
|
|
4045
|
+
},
|
|
4046
|
+
"code": {
|
|
4047
|
+
"type": "string",
|
|
4048
|
+
"enum": [
|
|
4049
|
+
"rate_limited"
|
|
4050
|
+
],
|
|
4051
|
+
"description": "Stable slug - match on this, not on the sentence."
|
|
4052
|
+
}
|
|
4053
|
+
},
|
|
4054
|
+
"required": [
|
|
4055
|
+
"error",
|
|
4056
|
+
"code"
|
|
4057
|
+
]
|
|
4058
|
+
},
|
|
4059
|
+
"example": {
|
|
4060
|
+
"error": "Too many requests with this read key. Wait 60 seconds, then retry.",
|
|
4061
|
+
"code": "rate_limited"
|
|
4062
|
+
}
|
|
4063
|
+
}
|
|
4064
|
+
}
|
|
3532
4065
|
},
|
|
3533
4066
|
"500": {
|
|
3534
4067
|
"description": "Error: internal_error",
|
|
@@ -3662,27 +4195,33 @@
|
|
|
3662
4195
|
"fileCount": 1,
|
|
3663
4196
|
"testCount": 1,
|
|
3664
4197
|
"testNames": [
|
|
3665
|
-
"
|
|
4198
|
+
"checkout.spec.ts > Checkout > applies a coupon code"
|
|
4199
|
+
],
|
|
4200
|
+
"projects": [
|
|
4201
|
+
"chromium"
|
|
3666
4202
|
],
|
|
3667
|
-
"occurrenceCount":
|
|
3668
|
-
"runCount":
|
|
3669
|
-
"failedCount":
|
|
3670
|
-
"flakyCount":
|
|
3671
|
-
"failedRunCount":
|
|
3672
|
-
"flakyRunCount":
|
|
4203
|
+
"occurrenceCount": 4,
|
|
4204
|
+
"runCount": 4,
|
|
4205
|
+
"failedCount": 0,
|
|
4206
|
+
"flakyCount": 4,
|
|
4207
|
+
"failedRunCount": 0,
|
|
4208
|
+
"flakyRunCount": 4,
|
|
3673
4209
|
"massFailureRunCount": 0,
|
|
3674
|
-
"firstSeen": "2026-09-
|
|
4210
|
+
"firstSeen": "2026-09-14T15:14:27.000Z",
|
|
3675
4211
|
"lastSeen": "2026-09-24T07:34:05.000Z"
|
|
3676
4212
|
},
|
|
3677
4213
|
"windowEmpty": false,
|
|
3678
4214
|
"tests": [
|
|
3679
4215
|
{
|
|
3680
|
-
"testName": "
|
|
4216
|
+
"testName": "checkout.spec.ts > Checkout > applies a coupon code",
|
|
3681
4217
|
"filePath": "tests/checkout.spec.ts",
|
|
3682
|
-
"
|
|
3683
|
-
|
|
3684
|
-
|
|
3685
|
-
"
|
|
4218
|
+
"projects": [
|
|
4219
|
+
"chromium"
|
|
4220
|
+
],
|
|
4221
|
+
"occurrenceCount": 4,
|
|
4222
|
+
"runCount": 4,
|
|
4223
|
+
"failedCount": 0,
|
|
4224
|
+
"flakyCount": 4
|
|
3686
4225
|
}
|
|
3687
4226
|
],
|
|
3688
4227
|
"runs": [
|
|
@@ -3691,12 +4230,18 @@
|
|
|
3691
4230
|
"runNumber": 1284,
|
|
3692
4231
|
"branch": "main",
|
|
3693
4232
|
"startedAt": "2026-09-24T07:31:12.000Z",
|
|
3694
|
-
"
|
|
3695
|
-
"
|
|
3696
|
-
"
|
|
3697
|
-
|
|
3698
|
-
|
|
3699
|
-
|
|
4233
|
+
"status": "flaky",
|
|
4234
|
+
"massFailure": false,
|
|
4235
|
+
"tests": [
|
|
4236
|
+
{
|
|
4237
|
+
"testName": "checkout.spec.ts > Checkout > applies a coupon code",
|
|
4238
|
+
"filePath": "tests/checkout.spec.ts",
|
|
4239
|
+
"projects": [
|
|
4240
|
+
"chromium"
|
|
4241
|
+
],
|
|
4242
|
+
"finalStatus": "passed"
|
|
4243
|
+
}
|
|
4244
|
+
]
|
|
3700
4245
|
}
|
|
3701
4246
|
]
|
|
3702
4247
|
}
|
|
@@ -3904,7 +4449,44 @@
|
|
|
3904
4449
|
}
|
|
3905
4450
|
},
|
|
3906
4451
|
"429": {
|
|
3907
|
-
"description": "Rate limited
|
|
4452
|
+
"description": "Rate limited: more than 60 requests within 60 seconds with one read key. 429: wait the seconds Retry-After names (60), then retry. Requests are counted per key in 60-second windows. A caller far beyond the limit can be stopped earlier by the edge firewall with a bare 429 - no body, no Retry-After; wait 60 seconds just the same.",
|
|
4453
|
+
"headers": {
|
|
4454
|
+
"Retry-After": {
|
|
4455
|
+
"description": "Seconds to wait before retrying: 60.",
|
|
4456
|
+
"schema": {
|
|
4457
|
+
"type": "integer",
|
|
4458
|
+
"example": 60
|
|
4459
|
+
}
|
|
4460
|
+
}
|
|
4461
|
+
},
|
|
4462
|
+
"content": {
|
|
4463
|
+
"application/json": {
|
|
4464
|
+
"schema": {
|
|
4465
|
+
"type": "object",
|
|
4466
|
+
"properties": {
|
|
4467
|
+
"error": {
|
|
4468
|
+
"type": "string",
|
|
4469
|
+
"description": "A sentence for a human. May be reworded."
|
|
4470
|
+
},
|
|
4471
|
+
"code": {
|
|
4472
|
+
"type": "string",
|
|
4473
|
+
"enum": [
|
|
4474
|
+
"rate_limited"
|
|
4475
|
+
],
|
|
4476
|
+
"description": "Stable slug - match on this, not on the sentence."
|
|
4477
|
+
}
|
|
4478
|
+
},
|
|
4479
|
+
"required": [
|
|
4480
|
+
"error",
|
|
4481
|
+
"code"
|
|
4482
|
+
]
|
|
4483
|
+
},
|
|
4484
|
+
"example": {
|
|
4485
|
+
"error": "Too many requests with this read key. Wait 60 seconds, then retry.",
|
|
4486
|
+
"code": "rate_limited"
|
|
4487
|
+
}
|
|
4488
|
+
}
|
|
4489
|
+
}
|
|
3908
4490
|
},
|
|
3909
4491
|
"500": {
|
|
3910
4492
|
"description": "Error: internal_error",
|
|
@@ -4038,14 +4620,14 @@
|
|
|
4038
4620
|
"startedAt": "2026-09-24T07:31:12.000Z",
|
|
4039
4621
|
"finishedAt": "2026-09-24T07:39:47.000Z",
|
|
4040
4622
|
"total": 412,
|
|
4041
|
-
"passed":
|
|
4042
|
-
"flaky":
|
|
4623
|
+
"passed": 408,
|
|
4624
|
+
"flaky": 1,
|
|
4043
4625
|
"failed": 0,
|
|
4044
|
-
"skipped":
|
|
4626
|
+
"skipped": 3
|
|
4045
4627
|
},
|
|
4046
4628
|
"runsInWindow": 11,
|
|
4047
4629
|
"unfinishedRuns": 1,
|
|
4048
|
-
"suiteSize":
|
|
4630
|
+
"suiteSize": 206,
|
|
4049
4631
|
"windowStability": 99,
|
|
4050
4632
|
"timeLost": {
|
|
4051
4633
|
"lostMs": 5112000,
|
|
@@ -4053,30 +4635,33 @@
|
|
|
4053
4635
|
"wastedAttempts": 71,
|
|
4054
4636
|
"wallClockMs": 213000000
|
|
4055
4637
|
},
|
|
4056
|
-
"failingTests": {
|
|
4057
|
-
"failing": 1,
|
|
4058
|
-
"testsRun": 412
|
|
4059
|
-
},
|
|
4060
4638
|
"testMetrics": {
|
|
4061
4639
|
"population": "ci_groups_finished_not_mass_failure",
|
|
4062
4640
|
"days": 30,
|
|
4063
4641
|
"flakyTests": 7,
|
|
4064
4642
|
"failingTests": 2,
|
|
4065
|
-
"tests":
|
|
4643
|
+
"tests": 205
|
|
4066
4644
|
},
|
|
4067
4645
|
"slowestTests": [
|
|
4068
4646
|
{
|
|
4069
|
-
"testName": "
|
|
4647
|
+
"testName": "checkout.spec.ts > Checkout > pays with a saved card",
|
|
4070
4648
|
"filePath": "tests/checkout.spec.ts",
|
|
4649
|
+
"projects": [
|
|
4650
|
+
"chromium",
|
|
4651
|
+
"firefox"
|
|
4652
|
+
],
|
|
4071
4653
|
"medianMs": 14820,
|
|
4072
|
-
"runs":
|
|
4654
|
+
"runs": 11
|
|
4073
4655
|
}
|
|
4074
4656
|
],
|
|
4075
4657
|
"timeSinks": [
|
|
4076
4658
|
{
|
|
4077
|
-
"testName": "
|
|
4659
|
+
"testName": "checkout.spec.ts > Checkout > applies a coupon code",
|
|
4078
4660
|
"filePath": "tests/checkout.spec.ts",
|
|
4079
|
-
"
|
|
4661
|
+
"projects": [
|
|
4662
|
+
"chromium"
|
|
4663
|
+
],
|
|
4664
|
+
"lostMs": 18630
|
|
4080
4665
|
}
|
|
4081
4666
|
],
|
|
4082
4667
|
"runsSeries": [
|
|
@@ -4290,7 +4875,44 @@
|
|
|
4290
4875
|
}
|
|
4291
4876
|
},
|
|
4292
4877
|
"429": {
|
|
4293
|
-
"description": "Rate limited
|
|
4878
|
+
"description": "Rate limited: more than 60 requests within 60 seconds with one read key. 429: wait the seconds Retry-After names (60), then retry. Requests are counted per key in 60-second windows. A caller far beyond the limit can be stopped earlier by the edge firewall with a bare 429 - no body, no Retry-After; wait 60 seconds just the same.",
|
|
4879
|
+
"headers": {
|
|
4880
|
+
"Retry-After": {
|
|
4881
|
+
"description": "Seconds to wait before retrying: 60.",
|
|
4882
|
+
"schema": {
|
|
4883
|
+
"type": "integer",
|
|
4884
|
+
"example": 60
|
|
4885
|
+
}
|
|
4886
|
+
}
|
|
4887
|
+
},
|
|
4888
|
+
"content": {
|
|
4889
|
+
"application/json": {
|
|
4890
|
+
"schema": {
|
|
4891
|
+
"type": "object",
|
|
4892
|
+
"properties": {
|
|
4893
|
+
"error": {
|
|
4894
|
+
"type": "string",
|
|
4895
|
+
"description": "A sentence for a human. May be reworded."
|
|
4896
|
+
},
|
|
4897
|
+
"code": {
|
|
4898
|
+
"type": "string",
|
|
4899
|
+
"enum": [
|
|
4900
|
+
"rate_limited"
|
|
4901
|
+
],
|
|
4902
|
+
"description": "Stable slug - match on this, not on the sentence."
|
|
4903
|
+
}
|
|
4904
|
+
},
|
|
4905
|
+
"required": [
|
|
4906
|
+
"error",
|
|
4907
|
+
"code"
|
|
4908
|
+
]
|
|
4909
|
+
},
|
|
4910
|
+
"example": {
|
|
4911
|
+
"error": "Too many requests with this read key. Wait 60 seconds, then retry.",
|
|
4912
|
+
"code": "rate_limited"
|
|
4913
|
+
}
|
|
4914
|
+
}
|
|
4915
|
+
}
|
|
4294
4916
|
},
|
|
4295
4917
|
"500": {
|
|
4296
4918
|
"description": "Error: internal_error",
|
|
@@ -4533,7 +5155,44 @@
|
|
|
4533
5155
|
}
|
|
4534
5156
|
},
|
|
4535
5157
|
"429": {
|
|
4536
|
-
"description": "Rate limited
|
|
5158
|
+
"description": "Rate limited: more than 60 requests within 60 seconds with one read key. 429: wait the seconds Retry-After names (60), then retry. Requests are counted per key in 60-second windows. A caller far beyond the limit can be stopped earlier by the edge firewall with a bare 429 - no body, no Retry-After; wait 60 seconds just the same.",
|
|
5159
|
+
"headers": {
|
|
5160
|
+
"Retry-After": {
|
|
5161
|
+
"description": "Seconds to wait before retrying: 60.",
|
|
5162
|
+
"schema": {
|
|
5163
|
+
"type": "integer",
|
|
5164
|
+
"example": 60
|
|
5165
|
+
}
|
|
5166
|
+
}
|
|
5167
|
+
},
|
|
5168
|
+
"content": {
|
|
5169
|
+
"application/json": {
|
|
5170
|
+
"schema": {
|
|
5171
|
+
"type": "object",
|
|
5172
|
+
"properties": {
|
|
5173
|
+
"error": {
|
|
5174
|
+
"type": "string",
|
|
5175
|
+
"description": "A sentence for a human. May be reworded."
|
|
5176
|
+
},
|
|
5177
|
+
"code": {
|
|
5178
|
+
"type": "string",
|
|
5179
|
+
"enum": [
|
|
5180
|
+
"rate_limited"
|
|
5181
|
+
],
|
|
5182
|
+
"description": "Stable slug - match on this, not on the sentence."
|
|
5183
|
+
}
|
|
5184
|
+
},
|
|
5185
|
+
"required": [
|
|
5186
|
+
"error",
|
|
5187
|
+
"code"
|
|
5188
|
+
]
|
|
5189
|
+
},
|
|
5190
|
+
"example": {
|
|
5191
|
+
"error": "Too many requests with this read key. Wait 60 seconds, then retry.",
|
|
5192
|
+
"code": "rate_limited"
|
|
5193
|
+
}
|
|
5194
|
+
}
|
|
5195
|
+
}
|
|
4537
5196
|
},
|
|
4538
5197
|
"500": {
|
|
4539
5198
|
"description": "Error: internal_error",
|
|
@@ -4762,7 +5421,7 @@
|
|
|
4762
5421
|
"description": "Whether the run is settled: its status and counts are final and it counts in the dashboard's figures. false while a shard is running, and while the run still waits for a shard within the run time limit, counted from its shards' last activity - once that passes, the hourly check settles it as incomplete. The dashboard's unfinished runs are the ones not settled. Since 1.0.0-beta.15."
|
|
4763
5422
|
},
|
|
4764
5423
|
"jobKey": {
|
|
4765
|
-
"description": "The job key the reporter sent (SQUALLY_CI_JOB_KEY, squally-reporter 0.11.0): which job of a CI run this is, for example the browser of a matrix. Each job is its own run with its own GitHub check,
|
|
5424
|
+
"description": "The job key the reporter sent (SQUALLY_CI_JOB_KEY, squally-reporter 0.11.0): which job of a CI run this is, for example the browser of a matrix. Each job is its own run with its own GitHub check, <check name> · <key>: the check name of the linked repository, \"Squally\" for the first project that links a repository. null when the job set none. Since 1.0.0-beta.15.",
|
|
4766
5425
|
"type": [
|
|
4767
5426
|
"string",
|
|
4768
5427
|
"null"
|
|
@@ -5085,7 +5744,7 @@
|
|
|
5085
5744
|
"description": "Whether the run is settled: its status and counts are final and it counts in the dashboard's figures. false while a shard is running, and while the run still waits for a shard within the run time limit, counted from its shards' last activity - once that passes, the hourly check settles it as incomplete. The dashboard's unfinished runs are the ones not settled. Since 1.0.0-beta.15."
|
|
5086
5745
|
},
|
|
5087
5746
|
"jobKey": {
|
|
5088
|
-
"description": "The job key the reporter sent (SQUALLY_CI_JOB_KEY, squally-reporter 0.11.0): which job of a CI run this is, for example the browser of a matrix. Each job is its own run with its own GitHub check,
|
|
5747
|
+
"description": "The job key the reporter sent (SQUALLY_CI_JOB_KEY, squally-reporter 0.11.0): which job of a CI run this is, for example the browser of a matrix. Each job is its own run with its own GitHub check, <check name> · <key>: the check name of the linked repository, \"Squally\" for the first project that links a repository. null when the job set none. Since 1.0.0-beta.15.",
|
|
5089
5748
|
"type": [
|
|
5090
5749
|
"string",
|
|
5091
5750
|
"null"
|
|
@@ -5378,11 +6037,48 @@
|
|
|
5378
6037
|
}
|
|
5379
6038
|
],
|
|
5380
6039
|
"description": "The shard the test's final attempt ran in; null for an unsharded run. One row per test since 1.0.0-beta.12 - a test reported from two shards was one row per shard before."
|
|
5381
|
-
}
|
|
5382
|
-
|
|
5383
|
-
|
|
5384
|
-
|
|
5385
|
-
|
|
6040
|
+
},
|
|
6041
|
+
"annotations": {
|
|
6042
|
+
"type": "array",
|
|
6043
|
+
"items": {
|
|
6044
|
+
"type": "string"
|
|
6045
|
+
},
|
|
6046
|
+
"description": "The final attempt's annotation types (Playwright's test.info().annotations), in the order they were added - types only; descriptions are on the attempts endpoint. Empty when there are none, and for a result from a reporter before 0.19.0."
|
|
6047
|
+
},
|
|
6048
|
+
"location": {
|
|
6049
|
+
"anyOf": [
|
|
6050
|
+
{
|
|
6051
|
+
"type": "object",
|
|
6052
|
+
"properties": {
|
|
6053
|
+
"line": {
|
|
6054
|
+
"type": "integer"
|
|
6055
|
+
},
|
|
6056
|
+
"column": {
|
|
6057
|
+
"anyOf": [
|
|
6058
|
+
{
|
|
6059
|
+
"type": "integer"
|
|
6060
|
+
},
|
|
6061
|
+
{
|
|
6062
|
+
"type": "null"
|
|
6063
|
+
}
|
|
6064
|
+
]
|
|
6065
|
+
}
|
|
6066
|
+
},
|
|
6067
|
+
"required": [
|
|
6068
|
+
"line",
|
|
6069
|
+
"column"
|
|
6070
|
+
]
|
|
6071
|
+
},
|
|
6072
|
+
{
|
|
6073
|
+
"type": "null"
|
|
6074
|
+
}
|
|
6075
|
+
],
|
|
6076
|
+
"description": "Where the test is declared in its file (Playwright's TestCase.location) - the file is filePath. null for a result from a reporter before 0.19.0."
|
|
6077
|
+
}
|
|
6078
|
+
},
|
|
6079
|
+
"required": [
|
|
6080
|
+
"testName",
|
|
6081
|
+
"filePath",
|
|
5386
6082
|
"status",
|
|
5387
6083
|
"attempts",
|
|
5388
6084
|
"durationMs",
|
|
@@ -5391,7 +6087,9 @@
|
|
|
5391
6087
|
"browserName",
|
|
5392
6088
|
"timedOut",
|
|
5393
6089
|
"timeoutMs",
|
|
5394
|
-
"shard"
|
|
6090
|
+
"shard",
|
|
6091
|
+
"annotations",
|
|
6092
|
+
"location"
|
|
5395
6093
|
]
|
|
5396
6094
|
}
|
|
5397
6095
|
}
|
|
@@ -5617,6 +6315,105 @@
|
|
|
5617
6315
|
}
|
|
5618
6316
|
],
|
|
5619
6317
|
"description": "The shard this attempt ran in; null for an unsharded run."
|
|
6318
|
+
},
|
|
6319
|
+
"annotations": {
|
|
6320
|
+
"type": "array",
|
|
6321
|
+
"items": {
|
|
6322
|
+
"type": "object",
|
|
6323
|
+
"properties": {
|
|
6324
|
+
"type": {
|
|
6325
|
+
"type": "string"
|
|
6326
|
+
},
|
|
6327
|
+
"description": {
|
|
6328
|
+
"description": "As the test wrote it, with secrets masked the way error text is; at most 1000 characters.",
|
|
6329
|
+
"type": [
|
|
6330
|
+
"string",
|
|
6331
|
+
"null"
|
|
6332
|
+
]
|
|
6333
|
+
},
|
|
6334
|
+
"location": {
|
|
6335
|
+
"description": "Where the annotation was added, file:line[:column]; null when Playwright did not say.",
|
|
6336
|
+
"type": [
|
|
6337
|
+
"string",
|
|
6338
|
+
"null"
|
|
6339
|
+
]
|
|
6340
|
+
}
|
|
6341
|
+
},
|
|
6342
|
+
"required": [
|
|
6343
|
+
"type",
|
|
6344
|
+
"description",
|
|
6345
|
+
"location"
|
|
6346
|
+
]
|
|
6347
|
+
},
|
|
6348
|
+
"description": "This attempt's annotations (Playwright's test.info().annotations), in the order they were added - at most 20. Empty when there are none, and for a result from a reporter before 0.19.0."
|
|
6349
|
+
},
|
|
6350
|
+
"annotationsOmitted": {
|
|
6351
|
+
"type": "integer",
|
|
6352
|
+
"description": "How many annotations past the 20 the reporter did not send."
|
|
6353
|
+
},
|
|
6354
|
+
"location": {
|
|
6355
|
+
"anyOf": [
|
|
6356
|
+
{
|
|
6357
|
+
"type": "object",
|
|
6358
|
+
"properties": {
|
|
6359
|
+
"line": {
|
|
6360
|
+
"type": "integer"
|
|
6361
|
+
},
|
|
6362
|
+
"column": {
|
|
6363
|
+
"anyOf": [
|
|
6364
|
+
{
|
|
6365
|
+
"type": "integer"
|
|
6366
|
+
},
|
|
6367
|
+
{
|
|
6368
|
+
"type": "null"
|
|
6369
|
+
}
|
|
6370
|
+
]
|
|
6371
|
+
}
|
|
6372
|
+
},
|
|
6373
|
+
"required": [
|
|
6374
|
+
"line",
|
|
6375
|
+
"column"
|
|
6376
|
+
]
|
|
6377
|
+
},
|
|
6378
|
+
{
|
|
6379
|
+
"type": "null"
|
|
6380
|
+
}
|
|
6381
|
+
],
|
|
6382
|
+
"description": "Where the test is declared in its file (Playwright's TestCase.location) - the file is filePath. null for a result from a reporter before 0.19.0."
|
|
6383
|
+
},
|
|
6384
|
+
"workerIndex": {
|
|
6385
|
+
"anyOf": [
|
|
6386
|
+
{
|
|
6387
|
+
"type": "integer"
|
|
6388
|
+
},
|
|
6389
|
+
{
|
|
6390
|
+
"type": "null"
|
|
6391
|
+
}
|
|
6392
|
+
],
|
|
6393
|
+
"description": "The Playwright worker that ran this attempt (workerIndex). null for a result from a reporter before 0.19.0."
|
|
6394
|
+
},
|
|
6395
|
+
"parallelIndex": {
|
|
6396
|
+
"anyOf": [
|
|
6397
|
+
{
|
|
6398
|
+
"type": "integer"
|
|
6399
|
+
},
|
|
6400
|
+
{
|
|
6401
|
+
"type": "null"
|
|
6402
|
+
}
|
|
6403
|
+
],
|
|
6404
|
+
"description": "The worker's slot, 0 to workers - 1 (parallelIndex); a restarted worker keeps it. null for a result from a reporter before 0.19.0."
|
|
6405
|
+
},
|
|
6406
|
+
"startedAt": {
|
|
6407
|
+
"anyOf": [
|
|
6408
|
+
{
|
|
6409
|
+
"type": "string",
|
|
6410
|
+
"format": "date-time"
|
|
6411
|
+
},
|
|
6412
|
+
{
|
|
6413
|
+
"type": "null"
|
|
6414
|
+
}
|
|
6415
|
+
],
|
|
6416
|
+
"description": "When this attempt started. null for a result from a reporter before 0.19.0, and when the runner's clock put it more than a day before the run or in the future."
|
|
5620
6417
|
}
|
|
5621
6418
|
},
|
|
5622
6419
|
"required": [
|
|
@@ -5629,7 +6426,13 @@
|
|
|
5629
6426
|
"browserName",
|
|
5630
6427
|
"errors",
|
|
5631
6428
|
"copyPrompt",
|
|
5632
|
-
"shard"
|
|
6429
|
+
"shard",
|
|
6430
|
+
"annotations",
|
|
6431
|
+
"annotationsOmitted",
|
|
6432
|
+
"location",
|
|
6433
|
+
"workerIndex",
|
|
6434
|
+
"parallelIndex",
|
|
6435
|
+
"startedAt"
|
|
5633
6436
|
]
|
|
5634
6437
|
}
|
|
5635
6438
|
}
|
|
@@ -5719,12 +6522,12 @@
|
|
|
5719
6522
|
"null"
|
|
5720
6523
|
]
|
|
5721
6524
|
},
|
|
5722
|
-
"
|
|
5723
|
-
"
|
|
5724
|
-
"
|
|
5725
|
-
"string"
|
|
5726
|
-
|
|
5727
|
-
|
|
6525
|
+
"projectFilter": {
|
|
6526
|
+
"type": "array",
|
|
6527
|
+
"items": {
|
|
6528
|
+
"type": "string"
|
|
6529
|
+
},
|
|
6530
|
+
"description": "The project filter applied - the project parameter's values, code-point order; empty for every project. Each item then holds only those projects' variants (since 1.0.0-beta.19; browser, one value, before)."
|
|
5728
6531
|
},
|
|
5729
6532
|
"sort": {
|
|
5730
6533
|
"type": "string",
|
|
@@ -5744,7 +6547,7 @@
|
|
|
5744
6547
|
},
|
|
5745
6548
|
"total": {
|
|
5746
6549
|
"type": "integer",
|
|
5747
|
-
"description": "Tests matching the query across all pages: every test with at least one run of the population in the period, narrowed by search, branch and
|
|
6550
|
+
"description": "Tests matching the query across all pages - each test once across projects: every test with at least one run of the population in the period, narrowed by search, branch and project."
|
|
5748
6551
|
},
|
|
5749
6552
|
"pageCount": {
|
|
5750
6553
|
"type": "integer"
|
|
@@ -5756,7 +6559,7 @@
|
|
|
5756
6559
|
"properties": {
|
|
5757
6560
|
"testName": {
|
|
5758
6561
|
"type": "string",
|
|
5759
|
-
"description": "The
|
|
6562
|
+
"description": "The test's name WITHOUT its Playwright project (\"cart.spec.ts > adds an item\" for chromium's and firefox's \"<project> > cart.spec.ts > adds an item\") - the identity GET /tests/{testName} takes. Since 1.0.0-beta.19; the stored name with its project, one item per project, before."
|
|
5760
6563
|
},
|
|
5761
6564
|
"filePath": {
|
|
5762
6565
|
"type": [
|
|
@@ -5764,28 +6567,28 @@
|
|
|
5764
6567
|
"null"
|
|
5765
6568
|
]
|
|
5766
6569
|
},
|
|
5767
|
-
"
|
|
5768
|
-
"
|
|
5769
|
-
"
|
|
5770
|
-
"string"
|
|
5771
|
-
|
|
5772
|
-
|
|
6570
|
+
"projects": {
|
|
6571
|
+
"type": "array",
|
|
6572
|
+
"items": {
|
|
6573
|
+
"type": "string"
|
|
6574
|
+
},
|
|
6575
|
+
"description": "Every Playwright project the test ran in, code-point order; empty when it ran under none. Replaces browser (1.0.0-beta.19)."
|
|
5773
6576
|
},
|
|
5774
6577
|
"runs": {
|
|
5775
6578
|
"type": "integer",
|
|
5776
|
-
"description": "Runs of the population in which the test has a final attempt that did not skip: stableRuns + flakyRuns + failedRuns. A sharded run counts once; the final attempt is the one with the most retries, then from the lowest shard."
|
|
6579
|
+
"description": "Runs of the population in which the test has a final attempt that did not skip in any of its projects: stableRuns + flakyRuns + failedRuns. A sharded run counts once; per project, the final attempt is the one with the most retries, then from the lowest shard."
|
|
5777
6580
|
},
|
|
5778
6581
|
"stableRuns": {
|
|
5779
6582
|
"type": "integer",
|
|
5780
|
-
"description": "Of runs, those
|
|
6583
|
+
"description": "Of runs, those in which it passed on the first try wherever it ran."
|
|
5781
6584
|
},
|
|
5782
6585
|
"flakyRuns": {
|
|
5783
6586
|
"type": "integer",
|
|
5784
|
-
"description": "Of runs, those
|
|
6587
|
+
"description": "Of runs, those in which it passed only after a retry in some project and failed in none."
|
|
5785
6588
|
},
|
|
5786
6589
|
"failedRuns": {
|
|
5787
6590
|
"type": "integer",
|
|
5788
|
-
"description": "Of runs, those
|
|
6591
|
+
"description": "Of runs, those in which its final attempt failed in any project - failed wins over flaky."
|
|
5789
6592
|
},
|
|
5790
6593
|
"stability": {
|
|
5791
6594
|
"description": "stableRuns / runs, a fraction from 0 to 1. null only when runs is 0.",
|
|
@@ -5810,7 +6613,18 @@
|
|
|
5810
6613
|
},
|
|
5811
6614
|
"timeLostMs": {
|
|
5812
6615
|
"type": "integer",
|
|
5813
|
-
"description": "Time spent on attempts that did not count, in ms, summed over runs: a failed
|
|
6616
|
+
"description": "Time spent on attempts that did not count, in ms, summed over runs and projects: a failed final attempt loses every attempt it made, one rescued by a retry the attempts before the pass, each at the final attempt's duration. 0 when every run passed on the first try."
|
|
6617
|
+
},
|
|
6618
|
+
"medianDurationMs": {
|
|
6619
|
+
"anyOf": [
|
|
6620
|
+
{
|
|
6621
|
+
"type": "integer"
|
|
6622
|
+
},
|
|
6623
|
+
{
|
|
6624
|
+
"type": "null"
|
|
6625
|
+
}
|
|
6626
|
+
],
|
|
6627
|
+
"description": "Per run the slowest project's final attempt, the median over the runs (the lower middle); null when no run names a duration (since 1.0.0-beta.19)."
|
|
5814
6628
|
},
|
|
5815
6629
|
"recentResults": {
|
|
5816
6630
|
"type": "array",
|
|
@@ -5854,7 +6668,7 @@
|
|
|
5854
6668
|
"result"
|
|
5855
6669
|
]
|
|
5856
6670
|
},
|
|
5857
|
-
"description": "The test's last 20 runs in the period, oldest first,
|
|
6671
|
+
"description": "The test's last 20 runs in the period, oldest first, each over its projects: failed when it failed in any, flaky when it passed after a retry in one and failed in none, stable, or skipped when every project skipped. Empty when it has none."
|
|
5858
6672
|
},
|
|
5859
6673
|
"branches": {
|
|
5860
6674
|
"type": "array",
|
|
@@ -5899,12 +6713,70 @@
|
|
|
5899
6713
|
}
|
|
5900
6714
|
],
|
|
5901
6715
|
"description": "The branch with the most failed runs (kind failures, count = those runs); when no run failed, the branch with the most flaky runs (kind retries, count = those runs); null when neither. Ties go to the branch name in code-point order, a null branch last."
|
|
6716
|
+
},
|
|
6717
|
+
"variants": {
|
|
6718
|
+
"type": "array",
|
|
6719
|
+
"items": {
|
|
6720
|
+
"type": "object",
|
|
6721
|
+
"properties": {
|
|
6722
|
+
"testName": {
|
|
6723
|
+
"type": "string",
|
|
6724
|
+
"description": "The variant's stored name: Playwright's title path, its project first - the name GET /runs/{runId} and the attempts route carry."
|
|
6725
|
+
},
|
|
6726
|
+
"project": {
|
|
6727
|
+
"description": "Its Playwright project; null for a result that ran under no named project.",
|
|
6728
|
+
"type": [
|
|
6729
|
+
"string",
|
|
6730
|
+
"null"
|
|
6731
|
+
]
|
|
6732
|
+
},
|
|
6733
|
+
"runs": {
|
|
6734
|
+
"type": "integer",
|
|
6735
|
+
"description": "Runs of the population in which this project's final attempt did not skip."
|
|
6736
|
+
},
|
|
6737
|
+
"stableRuns": {
|
|
6738
|
+
"type": "integer"
|
|
6739
|
+
},
|
|
6740
|
+
"flakyRuns": {
|
|
6741
|
+
"type": "integer"
|
|
6742
|
+
},
|
|
6743
|
+
"failedRuns": {
|
|
6744
|
+
"type": "integer"
|
|
6745
|
+
},
|
|
6746
|
+
"timeLostMs": {
|
|
6747
|
+
"type": "integer",
|
|
6748
|
+
"description": "This project's time lost - see the test's timeLostMs."
|
|
6749
|
+
},
|
|
6750
|
+
"medianDurationMs": {
|
|
6751
|
+
"anyOf": [
|
|
6752
|
+
{
|
|
6753
|
+
"type": "integer"
|
|
6754
|
+
},
|
|
6755
|
+
{
|
|
6756
|
+
"type": "null"
|
|
6757
|
+
}
|
|
6758
|
+
],
|
|
6759
|
+
"description": "The median of this project's final-attempt durations over its runs, the lower middle; null when none names one."
|
|
6760
|
+
}
|
|
6761
|
+
},
|
|
6762
|
+
"required": [
|
|
6763
|
+
"testName",
|
|
6764
|
+
"project",
|
|
6765
|
+
"runs",
|
|
6766
|
+
"stableRuns",
|
|
6767
|
+
"flakyRuns",
|
|
6768
|
+
"failedRuns",
|
|
6769
|
+
"timeLostMs",
|
|
6770
|
+
"medianDurationMs"
|
|
6771
|
+
]
|
|
6772
|
+
},
|
|
6773
|
+
"description": "One item per project's variant, project in code-point order (none last), each with its own numbers - the Test explorer's breakdown (since 1.0.0-beta.19)."
|
|
5902
6774
|
}
|
|
5903
6775
|
},
|
|
5904
6776
|
"required": [
|
|
5905
6777
|
"testName",
|
|
5906
6778
|
"filePath",
|
|
5907
|
-
"
|
|
6779
|
+
"projects",
|
|
5908
6780
|
"runs",
|
|
5909
6781
|
"stableRuns",
|
|
5910
6782
|
"flakyRuns",
|
|
@@ -5913,9 +6785,11 @@
|
|
|
5913
6785
|
"flakyRate",
|
|
5914
6786
|
"failureRate",
|
|
5915
6787
|
"timeLostMs",
|
|
6788
|
+
"medianDurationMs",
|
|
5916
6789
|
"recentResults",
|
|
5917
6790
|
"branches",
|
|
5918
|
-
"topBranch"
|
|
6791
|
+
"topBranch",
|
|
6792
|
+
"variants"
|
|
5919
6793
|
]
|
|
5920
6794
|
}
|
|
5921
6795
|
}
|
|
@@ -5927,7 +6801,7 @@
|
|
|
5927
6801
|
"since",
|
|
5928
6802
|
"until",
|
|
5929
6803
|
"branch",
|
|
5930
|
-
"
|
|
6804
|
+
"projectFilter",
|
|
5931
6805
|
"sort",
|
|
5932
6806
|
"page",
|
|
5933
6807
|
"perPage",
|
|
@@ -5984,38 +6858,45 @@
|
|
|
5984
6858
|
"null"
|
|
5985
6859
|
]
|
|
5986
6860
|
},
|
|
5987
|
-
"
|
|
5988
|
-
"
|
|
5989
|
-
"description": "The stored name: Playwright's title path, the Playwright project first when there is one. The identity other test routes take."
|
|
5990
|
-
},
|
|
5991
|
-
"filePath": {
|
|
6861
|
+
"projectFilter": {
|
|
6862
|
+
"description": "The one project the numbers count - the project parameter, or the project of the variant name the path gave; null for every project of the test (since 1.0.0-beta.19).",
|
|
5992
6863
|
"type": [
|
|
5993
6864
|
"string",
|
|
5994
6865
|
"null"
|
|
5995
6866
|
]
|
|
5996
6867
|
},
|
|
5997
|
-
"
|
|
5998
|
-
"
|
|
6868
|
+
"testName": {
|
|
6869
|
+
"type": "string",
|
|
6870
|
+
"description": "The test's name WITHOUT its Playwright project (\"cart.spec.ts > adds an item\" for chromium's and firefox's \"<project> > cart.spec.ts > adds an item\") - the identity GET /tests/{testName} takes. Since 1.0.0-beta.19; the stored name with its project, one item per project, before."
|
|
6871
|
+
},
|
|
6872
|
+
"filePath": {
|
|
5999
6873
|
"type": [
|
|
6000
6874
|
"string",
|
|
6001
6875
|
"null"
|
|
6002
6876
|
]
|
|
6003
6877
|
},
|
|
6878
|
+
"projects": {
|
|
6879
|
+
"type": "array",
|
|
6880
|
+
"items": {
|
|
6881
|
+
"type": "string"
|
|
6882
|
+
},
|
|
6883
|
+
"description": "Every Playwright project the test ran in, code-point order; empty when it ran under none. Replaces browser (1.0.0-beta.19)."
|
|
6884
|
+
},
|
|
6004
6885
|
"runs": {
|
|
6005
6886
|
"type": "integer",
|
|
6006
|
-
"description": "Runs of the population in which the test has a final attempt that did not skip: stableRuns + flakyRuns + failedRuns. A sharded run counts once; the final attempt is the one with the most retries, then from the lowest shard."
|
|
6887
|
+
"description": "Runs of the population in which the test has a final attempt that did not skip in any of its projects: stableRuns + flakyRuns + failedRuns. A sharded run counts once; per project, the final attempt is the one with the most retries, then from the lowest shard."
|
|
6007
6888
|
},
|
|
6008
6889
|
"stableRuns": {
|
|
6009
6890
|
"type": "integer",
|
|
6010
|
-
"description": "Of runs, those
|
|
6891
|
+
"description": "Of runs, those in which it passed on the first try wherever it ran."
|
|
6011
6892
|
},
|
|
6012
6893
|
"flakyRuns": {
|
|
6013
6894
|
"type": "integer",
|
|
6014
|
-
"description": "Of runs, those
|
|
6895
|
+
"description": "Of runs, those in which it passed only after a retry in some project and failed in none."
|
|
6015
6896
|
},
|
|
6016
6897
|
"failedRuns": {
|
|
6017
6898
|
"type": "integer",
|
|
6018
|
-
"description": "Of runs, those
|
|
6899
|
+
"description": "Of runs, those in which its final attempt failed in any project - failed wins over flaky."
|
|
6019
6900
|
},
|
|
6020
6901
|
"stability": {
|
|
6021
6902
|
"description": "stableRuns / runs, a fraction from 0 to 1. null only when runs is 0.",
|
|
@@ -6040,7 +6921,18 @@
|
|
|
6040
6921
|
},
|
|
6041
6922
|
"timeLostMs": {
|
|
6042
6923
|
"type": "integer",
|
|
6043
|
-
"description": "Time spent on attempts that did not count, in ms, summed over runs: a failed
|
|
6924
|
+
"description": "Time spent on attempts that did not count, in ms, summed over runs and projects: a failed final attempt loses every attempt it made, one rescued by a retry the attempts before the pass, each at the final attempt's duration. 0 when every run passed on the first try."
|
|
6925
|
+
},
|
|
6926
|
+
"medianDurationMs": {
|
|
6927
|
+
"anyOf": [
|
|
6928
|
+
{
|
|
6929
|
+
"type": "integer"
|
|
6930
|
+
},
|
|
6931
|
+
{
|
|
6932
|
+
"type": "null"
|
|
6933
|
+
}
|
|
6934
|
+
],
|
|
6935
|
+
"description": "Per run the slowest project's final attempt, the median over the runs (the lower middle); null when no run names a duration (since 1.0.0-beta.19)."
|
|
6044
6936
|
},
|
|
6045
6937
|
"recentResults": {
|
|
6046
6938
|
"type": "array",
|
|
@@ -6084,7 +6976,7 @@
|
|
|
6084
6976
|
"result"
|
|
6085
6977
|
]
|
|
6086
6978
|
},
|
|
6087
|
-
"description": "The test's last 20 runs in the period, oldest first,
|
|
6979
|
+
"description": "The test's last 20 runs in the period, oldest first, each over its projects: failed when it failed in any, flaky when it passed after a retry in one and failed in none, stable, or skipped when every project skipped. Empty when it has none."
|
|
6088
6980
|
},
|
|
6089
6981
|
"branches": {
|
|
6090
6982
|
"type": "array",
|
|
@@ -6129,6 +7021,64 @@
|
|
|
6129
7021
|
}
|
|
6130
7022
|
],
|
|
6131
7023
|
"description": "The branch with the most failed runs (kind failures, count = those runs); when no run failed, the branch with the most flaky runs (kind retries, count = those runs); null when neither. Ties go to the branch name in code-point order, a null branch last."
|
|
7024
|
+
},
|
|
7025
|
+
"variants": {
|
|
7026
|
+
"type": "array",
|
|
7027
|
+
"items": {
|
|
7028
|
+
"type": "object",
|
|
7029
|
+
"properties": {
|
|
7030
|
+
"testName": {
|
|
7031
|
+
"type": "string",
|
|
7032
|
+
"description": "The variant's stored name: Playwright's title path, its project first - the name GET /runs/{runId} and the attempts route carry."
|
|
7033
|
+
},
|
|
7034
|
+
"project": {
|
|
7035
|
+
"description": "Its Playwright project; null for a result that ran under no named project.",
|
|
7036
|
+
"type": [
|
|
7037
|
+
"string",
|
|
7038
|
+
"null"
|
|
7039
|
+
]
|
|
7040
|
+
},
|
|
7041
|
+
"runs": {
|
|
7042
|
+
"type": "integer",
|
|
7043
|
+
"description": "Runs of the population in which this project's final attempt did not skip."
|
|
7044
|
+
},
|
|
7045
|
+
"stableRuns": {
|
|
7046
|
+
"type": "integer"
|
|
7047
|
+
},
|
|
7048
|
+
"flakyRuns": {
|
|
7049
|
+
"type": "integer"
|
|
7050
|
+
},
|
|
7051
|
+
"failedRuns": {
|
|
7052
|
+
"type": "integer"
|
|
7053
|
+
},
|
|
7054
|
+
"timeLostMs": {
|
|
7055
|
+
"type": "integer",
|
|
7056
|
+
"description": "This project's time lost - see the test's timeLostMs."
|
|
7057
|
+
},
|
|
7058
|
+
"medianDurationMs": {
|
|
7059
|
+
"anyOf": [
|
|
7060
|
+
{
|
|
7061
|
+
"type": "integer"
|
|
7062
|
+
},
|
|
7063
|
+
{
|
|
7064
|
+
"type": "null"
|
|
7065
|
+
}
|
|
7066
|
+
],
|
|
7067
|
+
"description": "The median of this project's final-attempt durations over its runs, the lower middle; null when none names one."
|
|
7068
|
+
}
|
|
7069
|
+
},
|
|
7070
|
+
"required": [
|
|
7071
|
+
"testName",
|
|
7072
|
+
"project",
|
|
7073
|
+
"runs",
|
|
7074
|
+
"stableRuns",
|
|
7075
|
+
"flakyRuns",
|
|
7076
|
+
"failedRuns",
|
|
7077
|
+
"timeLostMs",
|
|
7078
|
+
"medianDurationMs"
|
|
7079
|
+
]
|
|
7080
|
+
},
|
|
7081
|
+
"description": "One item per project's variant, project in code-point order (none last), each with its own numbers - the Test explorer's breakdown (since 1.0.0-beta.19)."
|
|
6132
7082
|
}
|
|
6133
7083
|
},
|
|
6134
7084
|
"required": [
|
|
@@ -6138,9 +7088,10 @@
|
|
|
6138
7088
|
"since",
|
|
6139
7089
|
"until",
|
|
6140
7090
|
"branch",
|
|
7091
|
+
"projectFilter",
|
|
6141
7092
|
"testName",
|
|
6142
7093
|
"filePath",
|
|
6143
|
-
"
|
|
7094
|
+
"projects",
|
|
6144
7095
|
"runs",
|
|
6145
7096
|
"stableRuns",
|
|
6146
7097
|
"flakyRuns",
|
|
@@ -6149,9 +7100,11 @@
|
|
|
6149
7100
|
"flakyRate",
|
|
6150
7101
|
"failureRate",
|
|
6151
7102
|
"timeLostMs",
|
|
7103
|
+
"medianDurationMs",
|
|
6152
7104
|
"recentResults",
|
|
6153
7105
|
"branches",
|
|
6154
|
-
"topBranch"
|
|
7106
|
+
"topBranch",
|
|
7107
|
+
"variants"
|
|
6155
7108
|
]
|
|
6156
7109
|
},
|
|
6157
7110
|
"TestHistoryResponse": {
|
|
@@ -6176,18 +7129,27 @@
|
|
|
6176
7129
|
"type": "object",
|
|
6177
7130
|
"properties": {
|
|
6178
7131
|
"name": {
|
|
6179
|
-
"type": "string"
|
|
7132
|
+
"type": "string",
|
|
7133
|
+
"description": "The test's name without its Playwright project (since 1.0.0-beta.19; the name as given before)."
|
|
6180
7134
|
},
|
|
6181
7135
|
"filePath": {
|
|
6182
7136
|
"type": [
|
|
6183
7137
|
"string",
|
|
6184
7138
|
"null"
|
|
6185
7139
|
]
|
|
7140
|
+
},
|
|
7141
|
+
"project": {
|
|
7142
|
+
"description": "The one project the history is of - the project parameter, or the project of the variant name the path gave; null for every project (since 1.0.0-beta.19).",
|
|
7143
|
+
"type": [
|
|
7144
|
+
"string",
|
|
7145
|
+
"null"
|
|
7146
|
+
]
|
|
6186
7147
|
}
|
|
6187
7148
|
},
|
|
6188
7149
|
"required": [
|
|
6189
7150
|
"name",
|
|
6190
|
-
"filePath"
|
|
7151
|
+
"filePath",
|
|
7152
|
+
"project"
|
|
6191
7153
|
]
|
|
6192
7154
|
},
|
|
6193
7155
|
"window": {
|
|
@@ -6250,7 +7212,7 @@
|
|
|
6250
7212
|
},
|
|
6251
7213
|
"status": {
|
|
6252
7214
|
"type": "string",
|
|
6253
|
-
"description": "The final attempt's status across the run's shards, read through test.fail()."
|
|
7215
|
+
"description": "The final attempt's status across the run's shards, read through test.fail() - over the test's projects: failed when it failed in any, passed when it passed in any, skipped otherwise (since 1.0.0-beta.19)."
|
|
6254
7216
|
},
|
|
6255
7217
|
"durationMs": {
|
|
6256
7218
|
"anyOf": [
|
|
@@ -6260,10 +7222,11 @@
|
|
|
6260
7222
|
{
|
|
6261
7223
|
"type": "null"
|
|
6262
7224
|
}
|
|
6263
|
-
]
|
|
7225
|
+
],
|
|
7226
|
+
"description": "The final attempt's duration - across projects, the slowest project's (since 1.0.0-beta.19)."
|
|
6264
7227
|
},
|
|
6265
7228
|
"timedOut": {
|
|
6266
|
-
"description": "The final attempt's. Whether the attempt ended by running into its time limit (Playwright's timedOut). null when the reporter did not say - every result from a reporter before 0.10.0.",
|
|
7229
|
+
"description": "The final attempt's - across projects, true when any project's was. Whether the attempt ended by running into its time limit (Playwright's timedOut). null when the reporter did not say - every result from a reporter before 0.10.0.",
|
|
6267
7230
|
"type": [
|
|
6268
7231
|
"boolean",
|
|
6269
7232
|
"null"
|
|
@@ -6278,13 +7241,43 @@
|
|
|
6278
7241
|
"type": "null"
|
|
6279
7242
|
}
|
|
6280
7243
|
],
|
|
6281
|
-
"description": "The final attempt's. The time limit Playwright applied to the attempt, in milliseconds; 0 means no limit. null when the reporter did not say."
|
|
7244
|
+
"description": "The final attempt's - across projects, the largest. The time limit Playwright applied to the attempt, in milliseconds; 0 means no limit. null when the reporter did not say."
|
|
6282
7245
|
},
|
|
6283
7246
|
"attempts": {
|
|
6284
|
-
"type": "integer"
|
|
7247
|
+
"type": "integer",
|
|
7248
|
+
"description": "Every attempt of the test in the run, every project's."
|
|
6285
7249
|
},
|
|
6286
7250
|
"wastedMs": {
|
|
6287
|
-
"type": "integer"
|
|
7251
|
+
"type": "integer",
|
|
7252
|
+
"description": "Duration of the attempts that did not count - every attempt but each project's final one."
|
|
7253
|
+
},
|
|
7254
|
+
"projects": {
|
|
7255
|
+
"type": "array",
|
|
7256
|
+
"items": {
|
|
7257
|
+
"type": "object",
|
|
7258
|
+
"properties": {
|
|
7259
|
+
"project": {
|
|
7260
|
+
"type": [
|
|
7261
|
+
"string",
|
|
7262
|
+
"null"
|
|
7263
|
+
]
|
|
7264
|
+
},
|
|
7265
|
+
"status": {
|
|
7266
|
+
"type": "string",
|
|
7267
|
+
"description": "This project's final attempt, through test.fail(): passed, failed or skipped."
|
|
7268
|
+
},
|
|
7269
|
+
"attempts": {
|
|
7270
|
+
"type": "integer",
|
|
7271
|
+
"description": "This project's attempts in the run."
|
|
7272
|
+
}
|
|
7273
|
+
},
|
|
7274
|
+
"required": [
|
|
7275
|
+
"project",
|
|
7276
|
+
"status",
|
|
7277
|
+
"attempts"
|
|
7278
|
+
]
|
|
7279
|
+
},
|
|
7280
|
+
"description": "Each project's own result in the run, project in code-point order (since 1.0.0-beta.19). One item under the project parameter."
|
|
6288
7281
|
}
|
|
6289
7282
|
},
|
|
6290
7283
|
"required": [
|
|
@@ -6300,7 +7293,8 @@
|
|
|
6300
7293
|
"timedOut",
|
|
6301
7294
|
"timeoutMs",
|
|
6302
7295
|
"attempts",
|
|
6303
|
-
"wastedMs"
|
|
7296
|
+
"wastedMs",
|
|
7297
|
+
"projects"
|
|
6304
7298
|
]
|
|
6305
7299
|
}
|
|
6306
7300
|
}
|
|
@@ -6410,13 +7404,22 @@
|
|
|
6410
7404
|
"type": "integer"
|
|
6411
7405
|
},
|
|
6412
7406
|
"testCount": {
|
|
6413
|
-
"type": "integer"
|
|
7407
|
+
"type": "integer",
|
|
7408
|
+
"description": "The tests the error hit, each once across Playwright projects - a name without its project and a file (since 1.0.0-beta.19; each project's variant its own before)."
|
|
6414
7409
|
},
|
|
6415
7410
|
"testNames": {
|
|
6416
7411
|
"type": "array",
|
|
6417
7412
|
"items": {
|
|
6418
7413
|
"type": "string"
|
|
6419
|
-
}
|
|
7414
|
+
},
|
|
7415
|
+
"description": "Their names without the project, code-point order (since 1.0.0-beta.19; the stored names with it before)."
|
|
7416
|
+
},
|
|
7417
|
+
"projects": {
|
|
7418
|
+
"type": "array",
|
|
7419
|
+
"items": {
|
|
7420
|
+
"type": "string"
|
|
7421
|
+
},
|
|
7422
|
+
"description": "The Playwright projects those tests ran in, code-point order; empty when none ran under a named project (since 1.0.0-beta.19)."
|
|
6420
7423
|
},
|
|
6421
7424
|
"occurrenceCount": {
|
|
6422
7425
|
"type": "integer"
|
|
@@ -6427,11 +7430,11 @@
|
|
|
6427
7430
|
},
|
|
6428
7431
|
"failedCount": {
|
|
6429
7432
|
"type": "integer",
|
|
6430
|
-
"description": "Of the (run, test) pairs the error hit
|
|
7433
|
+
"description": "Of the (run, test) pairs the error hit - a test once across its projects - how many ended failed: the test's final attempt across all the run's shards failed in any project the error hit (since 1.0.0-beta.9; across projects since 1.0.0-beta.19, each project's variant its own pair before)."
|
|
6431
7434
|
},
|
|
6432
7435
|
"flakyCount": {
|
|
6433
7436
|
"type": "integer",
|
|
6434
|
-
"description": "Of the same pairs, how many ended flaky: the final attempt passed after a retry. A pair whose final
|
|
7437
|
+
"description": "Of the same pairs, how many ended flaky: the final attempt passed after a retry in a project the error hit and failed in none. A pair whose final attempts skipped is neither (since 1.0.0-beta.9; across projects since 1.0.0-beta.19)."
|
|
6435
7438
|
},
|
|
6436
7439
|
"failedRunCount": {
|
|
6437
7440
|
"type": "integer",
|
|
@@ -6464,6 +7467,7 @@
|
|
|
6464
7467
|
"fileCount",
|
|
6465
7468
|
"testCount",
|
|
6466
7469
|
"testNames",
|
|
7470
|
+
"projects",
|
|
6467
7471
|
"occurrenceCount",
|
|
6468
7472
|
"runCount",
|
|
6469
7473
|
"failedCount",
|
|
@@ -6568,13 +7572,22 @@
|
|
|
6568
7572
|
"type": "integer"
|
|
6569
7573
|
},
|
|
6570
7574
|
"testCount": {
|
|
6571
|
-
"type": "integer"
|
|
7575
|
+
"type": "integer",
|
|
7576
|
+
"description": "The tests the error hit, each once across Playwright projects - a name without its project and a file (since 1.0.0-beta.19; each project's variant its own before)."
|
|
6572
7577
|
},
|
|
6573
7578
|
"testNames": {
|
|
6574
7579
|
"type": "array",
|
|
6575
7580
|
"items": {
|
|
6576
7581
|
"type": "string"
|
|
6577
|
-
}
|
|
7582
|
+
},
|
|
7583
|
+
"description": "Their names without the project, code-point order (since 1.0.0-beta.19; the stored names with it before)."
|
|
7584
|
+
},
|
|
7585
|
+
"projects": {
|
|
7586
|
+
"type": "array",
|
|
7587
|
+
"items": {
|
|
7588
|
+
"type": "string"
|
|
7589
|
+
},
|
|
7590
|
+
"description": "The Playwright projects those tests ran in, code-point order; empty when none ran under a named project (since 1.0.0-beta.19)."
|
|
6578
7591
|
},
|
|
6579
7592
|
"occurrenceCount": {
|
|
6580
7593
|
"type": "integer"
|
|
@@ -6585,11 +7598,11 @@
|
|
|
6585
7598
|
},
|
|
6586
7599
|
"failedCount": {
|
|
6587
7600
|
"type": "integer",
|
|
6588
|
-
"description": "Of the (run, test) pairs the error hit
|
|
7601
|
+
"description": "Of the (run, test) pairs the error hit - a test once across its projects - how many ended failed: the test's final attempt across all the run's shards failed in any project the error hit (since 1.0.0-beta.9; across projects since 1.0.0-beta.19, each project's variant its own pair before)."
|
|
6589
7602
|
},
|
|
6590
7603
|
"flakyCount": {
|
|
6591
7604
|
"type": "integer",
|
|
6592
|
-
"description": "Of the same pairs, how many ended flaky: the final attempt passed after a retry. A pair whose final
|
|
7605
|
+
"description": "Of the same pairs, how many ended flaky: the final attempt passed after a retry in a project the error hit and failed in none. A pair whose final attempts skipped is neither (since 1.0.0-beta.9; across projects since 1.0.0-beta.19)."
|
|
6593
7606
|
},
|
|
6594
7607
|
"failedRunCount": {
|
|
6595
7608
|
"type": "integer",
|
|
@@ -6622,6 +7635,7 @@
|
|
|
6622
7635
|
"fileCount",
|
|
6623
7636
|
"testCount",
|
|
6624
7637
|
"testNames",
|
|
7638
|
+
"projects",
|
|
6625
7639
|
"occurrenceCount",
|
|
6626
7640
|
"runCount",
|
|
6627
7641
|
"failedCount",
|
|
@@ -6643,7 +7657,8 @@
|
|
|
6643
7657
|
"type": "object",
|
|
6644
7658
|
"properties": {
|
|
6645
7659
|
"testName": {
|
|
6646
|
-
"type": "string"
|
|
7660
|
+
"type": "string",
|
|
7661
|
+
"description": "The test's name without its Playwright project (since 1.0.0-beta.19)."
|
|
6647
7662
|
},
|
|
6648
7663
|
"filePath": {
|
|
6649
7664
|
"type": [
|
|
@@ -6651,31 +7666,41 @@
|
|
|
6651
7666
|
"null"
|
|
6652
7667
|
]
|
|
6653
7668
|
},
|
|
7669
|
+
"projects": {
|
|
7670
|
+
"type": "array",
|
|
7671
|
+
"items": {
|
|
7672
|
+
"type": "string"
|
|
7673
|
+
},
|
|
7674
|
+
"description": "The projects it hit the error in, code-point order; empty when none is named (since 1.0.0-beta.19)."
|
|
7675
|
+
},
|
|
6654
7676
|
"occurrenceCount": {
|
|
6655
|
-
"type": "integer"
|
|
7677
|
+
"type": "integer",
|
|
7678
|
+
"description": "Attempts with this error, every project's."
|
|
6656
7679
|
},
|
|
6657
7680
|
"runCount": {
|
|
6658
7681
|
"type": "integer",
|
|
6659
|
-
"description": "Runs in which this test hit the error (since 1.0.0-beta.9)."
|
|
7682
|
+
"description": "Runs in which this test hit the error - a run once, however many of its projects (since 1.0.0-beta.9; across projects since 1.0.0-beta.19)."
|
|
6660
7683
|
},
|
|
6661
7684
|
"failedCount": {
|
|
6662
7685
|
"type": "integer",
|
|
6663
|
-
"description": "Of those runs, the ones the test ended failed (since 1.0.0-beta.9)."
|
|
7686
|
+
"description": "Of those runs, the ones the test ended failed in any project the error hit (since 1.0.0-beta.9)."
|
|
6664
7687
|
},
|
|
6665
7688
|
"flakyCount": {
|
|
6666
7689
|
"type": "integer",
|
|
6667
|
-
"description": "Of those runs, the ones
|
|
7690
|
+
"description": "Of those runs, the ones it ended flaky - passed after a retry in a project the error hit and failed in none (since 1.0.0-beta.9)."
|
|
6668
7691
|
}
|
|
6669
7692
|
},
|
|
6670
7693
|
"required": [
|
|
6671
7694
|
"testName",
|
|
6672
7695
|
"filePath",
|
|
7696
|
+
"projects",
|
|
6673
7697
|
"occurrenceCount",
|
|
6674
7698
|
"runCount",
|
|
6675
7699
|
"failedCount",
|
|
6676
7700
|
"flakyCount"
|
|
6677
7701
|
]
|
|
6678
|
-
}
|
|
7702
|
+
},
|
|
7703
|
+
"description": "One item per test the error hit, each once across Playwright projects - the error page's Affected tests (since 1.0.0-beta.19; one per project's variant before). Their failedCount and flakyCount sum to the signature's."
|
|
6679
7704
|
},
|
|
6680
7705
|
"runs": {
|
|
6681
7706
|
"type": "array",
|
|
@@ -6684,7 +7709,7 @@
|
|
|
6684
7709
|
"properties": {
|
|
6685
7710
|
"runId": {
|
|
6686
7711
|
"type": "string",
|
|
6687
|
-
"description": "The run, by the id GET /projects/{projectId}/runs gives it - one row per run
|
|
7712
|
+
"description": "The run, by the id GET /projects/{projectId}/runs gives it - one row per run, however many shards and tests (since 1.0.0-beta.19; one row per run and test before)."
|
|
6688
7713
|
},
|
|
6689
7714
|
"runNumber": {
|
|
6690
7715
|
"type": "integer"
|
|
@@ -6699,30 +7724,54 @@
|
|
|
6699
7724
|
"type": "string",
|
|
6700
7725
|
"format": "date-time"
|
|
6701
7726
|
},
|
|
6702
|
-
"
|
|
6703
|
-
"type": "string"
|
|
6704
|
-
},
|
|
6705
|
-
"filePath": {
|
|
6706
|
-
"type": [
|
|
6707
|
-
"string",
|
|
6708
|
-
"null"
|
|
6709
|
-
]
|
|
6710
|
-
},
|
|
6711
|
-
"attempts": {
|
|
6712
|
-
"type": "integer",
|
|
6713
|
-
"description": "Every attempt of the test in the run, retries and every shard included."
|
|
6714
|
-
},
|
|
6715
|
-
"occurrences": {
|
|
6716
|
-
"type": "integer",
|
|
6717
|
-
"description": "How many of those carry this error."
|
|
6718
|
-
},
|
|
6719
|
-
"finalStatus": {
|
|
7727
|
+
"status": {
|
|
6720
7728
|
"type": "string",
|
|
6721
|
-
"
|
|
7729
|
+
"enum": [
|
|
7730
|
+
"failed",
|
|
7731
|
+
"flaky",
|
|
7732
|
+
"skipped"
|
|
7733
|
+
],
|
|
7734
|
+
"description": "How the run ended for the tests the error hit - the error page's mark: failed when one ended failed, flaky when a retry rescued every one, skipped otherwise (since 1.0.0-beta.19)."
|
|
6722
7735
|
},
|
|
6723
7736
|
"massFailure": {
|
|
6724
7737
|
"type": "boolean",
|
|
6725
7738
|
"description": "The run was a mass failure as a whole (since 1.0.0-beta.9)."
|
|
7739
|
+
},
|
|
7740
|
+
"tests": {
|
|
7741
|
+
"type": "array",
|
|
7742
|
+
"items": {
|
|
7743
|
+
"type": "object",
|
|
7744
|
+
"properties": {
|
|
7745
|
+
"testName": {
|
|
7746
|
+
"type": "string",
|
|
7747
|
+
"description": "The test's name without its Playwright project."
|
|
7748
|
+
},
|
|
7749
|
+
"filePath": {
|
|
7750
|
+
"type": [
|
|
7751
|
+
"string",
|
|
7752
|
+
"null"
|
|
7753
|
+
]
|
|
7754
|
+
},
|
|
7755
|
+
"projects": {
|
|
7756
|
+
"type": "array",
|
|
7757
|
+
"items": {
|
|
7758
|
+
"type": "string"
|
|
7759
|
+
},
|
|
7760
|
+
"description": "The projects it hit the error in, in this run, code-point order."
|
|
7761
|
+
},
|
|
7762
|
+
"finalStatus": {
|
|
7763
|
+
"type": "string",
|
|
7764
|
+
"description": "The test's final attempt in the run, through test.fail(), over those projects: failed when any failed, passed when any passed, skipped otherwise."
|
|
7765
|
+
}
|
|
7766
|
+
},
|
|
7767
|
+
"required": [
|
|
7768
|
+
"testName",
|
|
7769
|
+
"filePath",
|
|
7770
|
+
"projects",
|
|
7771
|
+
"finalStatus"
|
|
7772
|
+
]
|
|
7773
|
+
},
|
|
7774
|
+
"description": "The tests the error hit in this run, each once across projects, by name then file (since 1.0.0-beta.19)."
|
|
6726
7775
|
}
|
|
6727
7776
|
},
|
|
6728
7777
|
"required": [
|
|
@@ -6730,14 +7779,12 @@
|
|
|
6730
7779
|
"runNumber",
|
|
6731
7780
|
"branch",
|
|
6732
7781
|
"startedAt",
|
|
6733
|
-
"
|
|
6734
|
-
"
|
|
6735
|
-
"
|
|
6736
|
-
"occurrences",
|
|
6737
|
-
"finalStatus",
|
|
6738
|
-
"massFailure"
|
|
7782
|
+
"status",
|
|
7783
|
+
"massFailure",
|
|
7784
|
+
"tests"
|
|
6739
7785
|
]
|
|
6740
|
-
}
|
|
7786
|
+
},
|
|
7787
|
+
"description": "The runs with this error, newest first, one row per run - the error page's runs list (since 1.0.0-beta.19)."
|
|
6741
7788
|
}
|
|
6742
7789
|
},
|
|
6743
7790
|
"required": [
|
|
@@ -6891,7 +7938,7 @@
|
|
|
6891
7938
|
},
|
|
6892
7939
|
"suiteSize": {
|
|
6893
7940
|
"type": "integer",
|
|
6894
|
-
"description": "The largest run in the window, every test once over all its shards."
|
|
7941
|
+
"description": "The largest run in the window, every test once over all its shards and across its Playwright projects - Analytics' Suite size (across projects since 1.0.0-beta.19; each project's variant its own before)."
|
|
6895
7942
|
},
|
|
6896
7943
|
"windowStability": {
|
|
6897
7944
|
"description": "Suite stability, 0-100: of the final test results in the window's finished runs of the source on the branch (skipped results left out), the share that passed on the first try, rounded. Mass-failure runs count (since 1.0.0-beta.7). A result that passed only after a retry counts against it. null when no such result exists.",
|
|
@@ -6927,22 +7974,6 @@
|
|
|
6927
7974
|
],
|
|
6928
7975
|
"description": "Time spent on attempts a later retry superseded, in the window's finished runs of the source on the branch; wallClockMs is the time those runs used - each shard's own duration, summed - and lostPercent is lostMs of it."
|
|
6929
7976
|
},
|
|
6930
|
-
"failingTests": {
|
|
6931
|
-
"type": "object",
|
|
6932
|
-
"properties": {
|
|
6933
|
-
"failing": {
|
|
6934
|
-
"type": "integer"
|
|
6935
|
-
},
|
|
6936
|
-
"testsRun": {
|
|
6937
|
-
"type": "integer"
|
|
6938
|
-
}
|
|
6939
|
-
},
|
|
6940
|
-
"required": [
|
|
6941
|
-
"failing",
|
|
6942
|
-
"testsRun"
|
|
6943
|
-
],
|
|
6944
|
-
"description": "Tests whose final attempt failed in at least one of the window's finished runs of the source on the branch, out of the tests those runs reported (a skipped test counts as reported)."
|
|
6945
|
-
},
|
|
6946
7977
|
"testMetrics": {
|
|
6947
7978
|
"type": "object",
|
|
6948
7979
|
"properties": {
|
|
@@ -6961,15 +7992,15 @@
|
|
|
6961
7992
|
},
|
|
6962
7993
|
"flakyTests": {
|
|
6963
7994
|
"type": "integer",
|
|
6964
|
-
"description": "Of tests, the tests with at least one flaky run in the period
|
|
7995
|
+
"description": "Of tests, the tests with at least one flaky run in the period - passed only after a retry in some project and failed in none - the dashboard's Flaky tests tile. Called testsWithRetries until 1.0.0-beta.15; across projects since 1.0.0-beta.19."
|
|
6965
7996
|
},
|
|
6966
7997
|
"failingTests": {
|
|
6967
7998
|
"type": "integer",
|
|
6968
|
-
"description": "Of tests, the tests with at least one failed run in the period."
|
|
7999
|
+
"description": "Of tests, the tests with at least one failed run in the period - failed in any project. The dashboard's Failing tests tile; the top-level failingTests went in 1.0.0-beta.19."
|
|
6969
8000
|
},
|
|
6970
8001
|
"tests": {
|
|
6971
8002
|
"type": "integer",
|
|
6972
|
-
"description": "Tests with at least one run of the population in the period -
|
|
8003
|
+
"description": "Tests with at least one run of the population in the period, each once across Playwright projects - runs of the source parameter's kind, all by default since 1.0.0-beta.18 (CI before). Called ciTests until 1.0.0-beta.15; across projects since 1.0.0-beta.19."
|
|
6973
8004
|
}
|
|
6974
8005
|
},
|
|
6975
8006
|
"required": [
|
|
@@ -6979,7 +8010,7 @@
|
|
|
6979
8010
|
"failingTests",
|
|
6980
8011
|
"tests"
|
|
6981
8012
|
],
|
|
6982
|
-
"description": "The dashboard's Flaky tests and Failing tests tiles and their denominator,
|
|
8013
|
+
"description": "The dashboard's Flaky tests and Failing tests tiles and their denominator - each test once across Playwright projects, a run once (since 1.0.0-beta.19; each project's variant its own before) - on the branch (since 1.0.0-beta.7; every branch before). Mass-failure runs are left out here, as in every per-test metric."
|
|
6983
8014
|
},
|
|
6984
8015
|
"slowestTests": {
|
|
6985
8016
|
"type": "array",
|
|
@@ -6987,7 +8018,8 @@
|
|
|
6987
8018
|
"type": "object",
|
|
6988
8019
|
"properties": {
|
|
6989
8020
|
"testName": {
|
|
6990
|
-
"type": "string"
|
|
8021
|
+
"type": "string",
|
|
8022
|
+
"description": "The test's name without its Playwright project (since 1.0.0-beta.19)."
|
|
6991
8023
|
},
|
|
6992
8024
|
"filePath": {
|
|
6993
8025
|
"type": [
|
|
@@ -6995,6 +8027,13 @@
|
|
|
6995
8027
|
"null"
|
|
6996
8028
|
]
|
|
6997
8029
|
},
|
|
8030
|
+
"projects": {
|
|
8031
|
+
"type": "array",
|
|
8032
|
+
"items": {
|
|
8033
|
+
"type": "string"
|
|
8034
|
+
},
|
|
8035
|
+
"description": "Every project it ran in, code-point order (since 1.0.0-beta.19)."
|
|
8036
|
+
},
|
|
6998
8037
|
"medianMs": {
|
|
6999
8038
|
"type": "number"
|
|
7000
8039
|
},
|
|
@@ -7005,11 +8044,12 @@
|
|
|
7005
8044
|
"required": [
|
|
7006
8045
|
"testName",
|
|
7007
8046
|
"filePath",
|
|
8047
|
+
"projects",
|
|
7008
8048
|
"medianMs",
|
|
7009
8049
|
"runs"
|
|
7010
8050
|
]
|
|
7011
8051
|
},
|
|
7012
|
-
"description": "Up to 5 tests by
|
|
8052
|
+
"description": "Up to 5 tests by their median duration - per run the slowest project's final attempt, the median over the runs - at least 3 runs; skipped results left out. Analytics' Slowest tests (across projects since 1.0.0-beta.19; per project's variant before)."
|
|
7013
8053
|
},
|
|
7014
8054
|
"timeSinks": {
|
|
7015
8055
|
"type": "array",
|
|
@@ -7017,7 +8057,8 @@
|
|
|
7017
8057
|
"type": "object",
|
|
7018
8058
|
"properties": {
|
|
7019
8059
|
"testName": {
|
|
7020
|
-
"type": "string"
|
|
8060
|
+
"type": "string",
|
|
8061
|
+
"description": "The test's name without its Playwright project (since 1.0.0-beta.19)."
|
|
7021
8062
|
},
|
|
7022
8063
|
"filePath": {
|
|
7023
8064
|
"type": [
|
|
@@ -7025,6 +8066,13 @@
|
|
|
7025
8066
|
"null"
|
|
7026
8067
|
]
|
|
7027
8068
|
},
|
|
8069
|
+
"projects": {
|
|
8070
|
+
"type": "array",
|
|
8071
|
+
"items": {
|
|
8072
|
+
"type": "string"
|
|
8073
|
+
},
|
|
8074
|
+
"description": "The projects whose attempts lost the time, code-point order (since 1.0.0-beta.19)."
|
|
8075
|
+
},
|
|
7028
8076
|
"lostMs": {
|
|
7029
8077
|
"type": "number"
|
|
7030
8078
|
}
|
|
@@ -7032,10 +8080,11 @@
|
|
|
7032
8080
|
"required": [
|
|
7033
8081
|
"testName",
|
|
7034
8082
|
"filePath",
|
|
8083
|
+
"projects",
|
|
7035
8084
|
"lostMs"
|
|
7036
8085
|
]
|
|
7037
8086
|
},
|
|
7038
|
-
"description": "Up to 5 tests by the time their superseded attempts cost in the window (at least a second each), worst first."
|
|
8087
|
+
"description": "Up to 5 tests by the time their superseded attempts cost in the window (at least a second each), worst first - each test once across projects, the Overview's Where the time goes (since 1.0.0-beta.19)."
|
|
7039
8088
|
},
|
|
7040
8089
|
"runsSeries": {
|
|
7041
8090
|
"type": "array",
|
|
@@ -7082,7 +8131,6 @@
|
|
|
7082
8131
|
"suiteSize",
|
|
7083
8132
|
"windowStability",
|
|
7084
8133
|
"timeLost",
|
|
7085
|
-
"failingTests",
|
|
7086
8134
|
"testMetrics",
|
|
7087
8135
|
"slowestTests",
|
|
7088
8136
|
"timeSinks",
|