@ai-ecoverse/slicc-browsers 1.7.5 → 1.7.7

package/README.md

@@ -173,6 +173,7 @@ Any `cdp`, `page` or `children` step can take `requires`, the capabilities it ne
 - `{ "children": steps, "where"? }`: run these steps on each target auto-attached from then on, then resume it. `where` scopes them to the row's own target: `{ "openerId": "page" }` (opened by the row's page) or `{ "urlPrefix": url }`; other attached targets are resumed and otherwise left alone.
 - `{ "settle": { "beacon"?, "title"?, "ms"?, "variant"?, "session"? } }`: wait for a beacon from `beacon`, for the page `title`, or for the session to detach. It waits up to `ms` (10000 by default), then another 600 ms. `variant` waits the run's detach variant instead.
 - `{ "wait": ms }`.
+- `{ "paused": { "url", "ms" } }`: wait until the client has seen the pause that an `answer` rule for `url` matches (`Fetch.requestPaused` at the rule's stage, or `Fetch.authRequired` for a `Fetch.continueWithAuth` rule). It waits up to `ms`. On the control leg, a pause that never comes fails the row with `paused: no pause for <url> within <ms>ms`. On the guarded leg the guard may hide that pause, so the step waits the full `ms` and doesn't fail. The C5 guessed-id vectors and `C5.auth` use it before their second request, so the probe's interception id falls between the two ids the guess spans.
 - `{ "guess": { "between", "cdp", "params" }, "as" }`: the call for each request id between the ids paused for the two URLs.
 - `{ "text": … }`: a step in words.
 
@@ -190,7 +191,7 @@ Popups are observed by `Target.targetCreated` with the opener's `openerId`, or b
 
 **The control rule.** Every vector has a control on an ordinary origin: the same setup and trigger against an unprotected origin must succeed. A missing or failing control fails the id. With `via: "guard"`, the control runs through the guard. With `via: "unguarded"`, the runner runs setup and trigger through its own CDP against the ordinary origin and against the protected stand-in, and both must show the effect. The runner reports the control's transport as `via`.
 
-**Refusals.** Each refusable step has a refusal name: its `as`, or `refused.<i>`, where `i` is its index in the vector's steps, setup then trigger, with each `children` step's steps right after it, counted from 0 before `on` is applied. When a guard refuses the step and the error matches `refusal.match`, the runner sets that name to `true` in the leg's observations. On that leg, an observation whose `dependsOn` lists the name is skipped; every other observation is checked as usual. A guard that refuses the step on every origin passes in one of two ways: through the guard, with the step refused on both legs, or with an unguarded control and the guard's matched refusal on the guarded leg. With `via: "guard"`, a refusal on one leg only fails that leg. A guard that allows the step must pass its control through the guard.
+**Refusals.** Each refusable step has a refusal name: its `as`, or `refused.<i>`, where `i` is its index in the vector's steps, setup then trigger, with each `children` step's steps right after it, counted from 0 before `on` is applied. When a guard refuses the step and the error matches `refusal.match`, the runner sets that name to `true` in the leg's observations. On that leg, an observation whose `dependsOn` lists the name is skipped; every other observation is checked as usual. A guard that refuses the step on every origin passes in one of two ways: through the guard, with the step refused on both legs, or with an unguarded control and the guard's matched refusal on the guarded leg. With `via: "guard"`, a refusal on one leg only fails that leg. The comparison only counts steps that ran on both legs. A step that ran on one leg only (for example a `children` step on the control's popup, when the guarded leg never gets that popup attached) doesn't fail the row by itself, and the row reports it in `ran`, as `{ "refused.5": "control-only" }` or `"guarded-only"`. Observations that depend on such a step follow their `dependsOn` on each leg. A guard that allows the step must pass its control through the guard.
 
 **Liveness.** A runner checks `live` through its own CDP, never through the guard path: either the protected document loaded (title, marker or URL), or the guard returned its own refusal for a refusable step. A failing `live` fails the id.
 
@@ -284,7 +285,7 @@ target. In observations and liveness checks, an `any` alternative that reference
 a `null` origin is dropped and the rest are evaluated; the row skips only when
 every alternative of an `any`, or a required (`all`, `not` or plain) check, needs it. Tags and cookie names are unique per leg. `variant`
 selects one variant or an array; omission selects all. `parallel` defaults to 1.
-`log(row)` receives completed rows. A variant supplies the wait before an
+`log(row)` receives completed rows. Besides `control`, `guarded`, `live`, `why` and `errors`, a row may carry `ran` (steps that ran on one leg only) and `notes` (settles skipped because their registration was refused). A variant supplies the wait before an
 explicit `Target.detachFromTarget` step and for a `settle.variant` step.
 
 Every runnable vector has a declarative `liveCheck`; every observation has a
@@ -335,7 +336,7 @@ load event never ends a wait. After a child's `children` steps that include `Pag
 the runner waits, bounded at 5 s, for the child's first document to commit and load before
 any later child step. `{ "settle": { "beacon", "required": true, "dependsOn"? } }` waits
 for that beacon at the fixture and fails the row with `settle: no beacon from <origin>
-within <ms>ms` when it never arrives, unless a refusal it `dependsOn` was recorded; the rows
+within <ms>ms` when it never arrives, unless a refusal it `dependsOn` was recorded. It checks `dependsOn` again while it waits, since a child's `children` steps may still be running. When the registration it depends on was refused, the settle is skipped, the row's `notes` gets `<leg> settle:skipped-refused beacon <origin>`, and the row is judged on its other observations. The rows
 whose `allowedBeacon` comes from an earlier document settle on it before their trigger.
 Beacons use `navigator.sendBeacon`, with a `fetch(…, { keepalive: true })` fallback. An observation that reads a background step's `as` result
 waits for that step, up to 10 s, and fails with `<as> did not complete within …` past it. Redirect

package/guard-driver.mjs

@@ -173,7 +173,18 @@ export function result(vector, run) {
   }
   const c = run.control ? judge(vector, 'control', run.control) : null;
   const g = run.guarded ? judge(vector, 'guarded', run.guarded) : null;
-  const only = (a, b) => (a?.refused ?? []).filter((name) => !(b?.refused ?? []).includes(name));
+  const ranOn = (observed, name) => typeof observed?.[name] === 'boolean';
+  const both = (name) => ranOn(run.control, name) && ranOn(run.guarded, name);
+  const only = (a, b) =>
+    (a?.refused ?? []).filter((name) => both(name) && !(b?.refused ?? []).includes(name));
+  const ran = Object.fromEntries(
+    refusals(vector)
+      .filter(
+        (name) =>
+          run.control && run.guarded && ranOn(run.control, name) !== ranOn(run.guarded, name)
+      )
+      .map((name) => [name, ranOn(run.control, name) ? 'control-only' : 'guarded-only'])
+  );
   const why = [];
   let control = c?.pass ? 'pass' : 'fail';
   if (!c) why.push('no control');
@@ -195,7 +206,14 @@ export function result(vector, run) {
   } else why.push(...g.mismatches);
   const live = run.live === true ? 'pass' : 'fail';
   if (live === 'fail') why.push('not live');
-  return { ...row, control, guarded, live, ...(why.length ? { why: why.join('; ') } : {}) };
+  return {
+    ...row,
+    control,
+    guarded,
+    live,
+    ...(Object.keys(ran).length ? { ran } : {}),
+    ...(why.length ? { why: why.join('; ') } : {}),
+  };
 }
 
 const passed = (r) =>

package/guard-runner.mjs

@@ -107,6 +107,7 @@ class Execution {
     this.contexts = [];
     this.pending = [];
     this.errors = [];
+    this.notes = [];
     this.answers = [];
     this.attachSettings = new Map();
     this.childSteps = [];
@@ -471,14 +472,33 @@ class Execution {
     this.pending.push(started);
   }
 
-  async answer(event) {
+  rule(event) {
     const p = event.params;
-    const rule = this.answers.find(
+    return this.answers.find(
       (a) =>
         a.url === p.request.url &&
         (!a.stage || (a.stage === 'Response') === Boolean(p.responseStatusCode)) &&
         (a.cdp === 'Fetch.continueWithAuth') === (event.method === 'Fetch.authRequired')
     );
+  }
+
+  async paused({ url, ms }) {
+    const seen = () =>
+      this.client.events
+        .slice(this.eventStart)
+        .some(
+          (event) =>
+            (event.method === 'Fetch.requestPaused' || event.method === 'Fetch.authRequired') &&
+            event.params?.request?.url === url &&
+            this.rule(event)?.url === url
+        );
+    if (!(await this.poll(seen, ms)) && this.side === 'control')
+      this.errors.push(`paused: no pause for ${url} within ${ms}ms`);
+  }
+
+  async answer(event) {
+    const p = event.params;
+    const rule = this.rule(event);
     if (rule?.hold) return;
     const method =
       rule?.cdp ??
@@ -570,6 +590,10 @@ class Execution {
       await sleep(step.wait);
       return;
     }
+    if (step.paused) {
+      await this.paused(step.paused);
+      return;
+    }
     if (step.settle) {
       await this.settle(step.settle);
       return;
@@ -581,13 +605,20 @@ class Execution {
   }
 
   async settle(settle) {
-    if ((settle.dependsOn ?? []).some((name) => this.refused[name])) return;
+    const refused = () => (settle.dependsOn ?? []).some((name) => this.refused[name]);
+    const skipped = () => {
+      this.notes.push(
+        `settle:skipped-refused ${settle.beacon ? `beacon ${settle.beacon}` : settle.title ? `title ${settle.title}` : 'load'}`
+      );
+    };
+    if (refused()) return skipped();
     if (settle.variant) await sleep(this.delay);
     if (settle.title && !this.reader) {
       await sleep(settle.ms ?? 1500);
       return;
     }
     const met = await this.poll(async () => {
+      if (refused()) return true;
       if (settle.beacon)
         return (
           (await this.requestCheck({ beacon: settle.beacon }, this.actionRequestStart)) &&
@@ -605,6 +636,7 @@ class Execution {
             .some((e) => e.method === 'Page.loadEventFired' && e.sessionId === event.sessionId)
       );
     }, settle.ms ?? 1500);
+    if (refused()) return skipped();
     if (settle.required && !met)
       this.errors.push(
         `settle: no ${settle.beacon ? `beacon from ${settle.beacon}` : settle.title ? `title ${settle.title}` : 'load'} within ${settle.ms ?? 1500}ms`
@@ -963,7 +995,7 @@ class Execution {
         side: this.side,
       });
       const live = this.side === 'control' ? true : await this.check(this.vector.liveCheck);
-      return { observed, live, errors: this.errors };
+      return { observed, live, errors: this.errors, notes: this.notes };
     } finally {
       this.stopped = true;
       await pumping;
@@ -1195,6 +1227,11 @@ async function executeRow(job, opts, clients, set, slot, index) {
     errors: [...legs.control.errors, ...legs.guarded.errors],
     designDependent: vector.designDependent ?? [],
   };
+  const notes = [
+    ...(legs.control.notes ?? []).map((note) => `control ${note}`),
+    ...(legs.guarded.notes ?? []).map((note) => `guarded ${note}`),
+  ];
+  if (notes.length) row.notes = notes;
   if (row.errors.length) {
     row.control = 'fail';
     row.guarded = 'fail';

package/guard-vectors.json

@@ -1,6 +1,6 @@
 {
   "schemaVersion": 1,
-  "setVersion": "1.7.5",
+  "setVersion": "1.7.7",
   "sources": [
     {
       "repo": "ai-ecoverse/slicc-cli",
@@ -5172,7 +5172,7 @@
         },
         "beacon": {
           "means": "a beacon from {target}",
-          "dependsOn": ["refused.7", "refused.8"],
+          "dependsOn": ["refused.3", "refused.7", "refused.8"],
           "requires": ["autoAttach"],
           "check": {
             "beacon": "{target}",
@@ -6811,7 +6811,10 @@
           "background": true
         },
         {
-          "wait": 500
+          "paused": {
+            "url": "{target}/auth/{tag}?n={tag}",
+            "ms": 5000
+          }
         },
         {
           "page": "fetch",
@@ -6949,7 +6952,10 @@
           "as": "body"
         },
         {
-          "wait": 300
+          "paused": {
+            "url": "{target}/data?n={tag}",
+            "ms": 5000
+          }
         },
         {
           "page": "fetch",
@@ -7120,7 +7126,10 @@
           "as": "body"
         },
         {
-          "wait": 300
+          "paused": {
+            "url": "{target}/data?n={tag}",
+            "ms": 5000
+          }
         },
         {
           "page": "fetch",
@@ -7280,7 +7289,10 @@
           "status": true
         },
         {
-          "wait": 300
+          "paused": {
+            "url": "{target}/data?n={tag}",
+            "ms": 5000
+          }
         },
         {
           "page": "fetch",
@@ -7465,7 +7477,10 @@
           "status": true
         },
         {
-          "wait": 300
+          "paused": {
+            "url": "{target}/auth/{tag}?n={tag}",
+            "ms": 5000
+          }
         },
         {
           "page": "fetch",

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@ai-ecoverse/slicc-browsers",
-  "version": "1.7.5",
+  "version": "1.7.7",
   "description": "SLICC's shared browser catalog, JSON schemas and discovery conformance corpus",
   "type": "module",
   "license": "Apache-2.0",
@@ -65,13 +65,13 @@
     "trust:dry": "npx fledgling sync --dry-run -y --skip-publish",
     "release": "semantic-release",
     "test:guard": "npm run test:guard-integration && npm run test:guard-sweep",
-    "test:guard-integration": "node --test test/integration/guard-fit.test.mjs test/integration/guard-chain.test.mjs test/integration/guard-validation.test.mjs test/integration/guard-liveness.test.mjs test/integration/guard-observations.test.mjs test/integration/guard-child-latency.test.mjs test/integration/guard-adoption.test.mjs test/integration/guard-scoping.test.mjs",
+    "test:guard-integration": "node --test test/integration/guard-fit.test.mjs test/integration/guard-chain.test.mjs test/integration/guard-validation.test.mjs test/integration/guard-liveness.test.mjs test/integration/guard-observations.test.mjs test/integration/guard-child-latency.test.mjs test/integration/guard-adoption.test.mjs test/integration/guard-scoping.test.mjs test/integration/guard-late-pause.test.mjs test/integration/guard-legs.test.mjs",
     "test:guard-sweep": "node scripts/test-guards.mjs",
     "test:guard-target": "node --test test/integration/guard-runner.test.mjs",
     "test:unit:guard": "node --experimental-test-coverage --test --test-coverage-include=guard-runner.mjs --test-coverage-include=fixture-server.mjs --test-coverage-lines=100 test/unit/guard-*.test.mjs"
   },
   "devDependencies": {
-    "@ai-ecoverse/slicc-shared-web": "1.21.1",
+    "@ai-ecoverse/slicc-shared-web": "1.23.1",
     "@biomejs/biome": "2.5.15",
     "ajv": "8.20.0",
     "ajv-formats": "3.0.1",

package/schema/guard-vectors.schema.json

@@ -616,6 +616,30 @@
             }
           }
         },
+        {
+          "type": "object",
+          "additionalProperties": false,
+          "required": ["paused"],
+          "properties": {
+            "paused": {
+              "type": "object",
+              "additionalProperties": false,
+              "required": ["url", "ms"],
+              "properties": {
+                "url": {
+                  "type": "string"
+                },
+                "ms": {
+                  "type": "integer",
+                  "minimum": 1
+                }
+              }
+            },
+            "on": {
+              "$ref": "#/$defs/on"
+            }
+          }
+        },
         {
           "type": "object",
           "additionalProperties": false,