testaro 60.5.1 → 60.6.0

package/README.md

@@ -140,7 +140,7 @@ All of the tests that Testaro can perform are free of cost, except those perform
 
 ## Jobs
 
-A _job_ is an object that specifies what Testaro is to do. As Testaro performs a job, Testaro reports results by adding data to the job and making that enhanced object available as a _report_.
+A _job_ is an object that specifies what Testaro is to do, and how. As Testaro performs a job, Testaro reports results by adding data to the job and making that enhanced object available as a _report_.
 
 ### Example of a job
 
@@ -192,7 +192,13 @@ Here is an example of a job:
     },
     {
       type: 'test',
-      launch: {},
+      launch: {
+        browserID: 'chromium',
+        target: {
+          what: 'Real Estate Management',
+          url: 'https://abccorp.com/mgmt/realproperty.html'
+        }
+      },
       which: 'qualWeb',
       withNewContent: false,
       rules: ['QW-BP25', 'QW-BP26']
@@ -204,7 +210,7 @@ Here is an example of a job:
 
 This job tells Testaro to perform two _acts_. One performs one test of the Axe tool wih reporting at detail level 2, and the other performs two tests of the QualWeb tool.
 
-Each act includes a `launch` property with a default value. That instructs Testaro, before performing those tests, to launch a new Webkit browser, open a context (window) with some properties of an iPhone 8 and without a reduced-motion setting, create a page (tab), and navigate to a particular page of the `abccorp.com` website.
+Each act includes a `launch` object property. In the first act it is an empty object, the browser ID and target URL specified by the job are used. In the second act it overrides the job values with per-act values.
 
 Job properties:
 
@@ -518,7 +524,18 @@ The target can be provided to QualWeb either as an existing page or as a URL. Ex
 
 The rules that Testaro can test for are implemented in files within the `testaro` directory.
 
-If you do not specify rules when using the `testaro` tool, Testaro will test for its default rules, namely the rules that have `true` values on the `defaultOn` property in the `allRules` array defined in the `tests/testaro.js` file. It will test for these rules in the order in which they appear in the array.
+The Testaro rules are classified by an `allRules` array defined in the `tests/testaro.js` file. Each item in that array is an object with these properties:
+
+- `id`: the rule ID.
+- `what`: a description of the rule.
+- `launchRole`: what a test for the rule does with respect to a browser launch:
+  - `sharer`: requires a browser and leaves it unchanged so the next test can safely reuse it
+  - `waster`: requires a browser and modifies it so the next test cannot safely reuse it
+  - `owner`: launches a custom browser itself and closes it at the end of the test
+- `defaultOn`: whether the rule is to be tested for by default.
+- `timeOut`: the maximum time in seconds allowed for a test for the rule.
+
+If you do not specify rules when using the `testaro` tool, Testaro will test for its default rules. It will test for these rules in the order in which they appear in the array.
 
 The optional `rules` argument for a `testaro` test act is an array whose first item is either `'y'` or `'n'` and whose remaining items are rule IDs. If `'y'`, then only the specified rules’ tests are performed. If `'n'`, then all the default rules are tested for, **except** for the specified rules.
 
@@ -882,12 +899,17 @@ The arguments and behaviors described above for execution by a module apply here
 
 In addition to their uses described above, environment variables can be used by acts of type `test`, as documented in the `actSpecs.js` file.
 
-Before making Testaro run a job, you can optionally also set `DEBUG` (to `'true'` or anything else) and/or `WAITS` (to a non-negative integer). The effects of these variables are described in the `run.js` file.
+Before making Testaro run a job, you can optionally also set `HEADED_BROWSER`, `DEBUG`, and/or `WAITS`. The effects of these variables are:
+
+- `HEADED_BROWSER`: whether to run the browser in headed mode instead of the default headless mode
+- `DEBUG`: whether to make logging verbose
+- `WAITS`: the number of milliseconds to wait between actions
 
 You may store environment variables in an untracked `.env` file if you wish, and Testaro will recognize them. Here is a template for a `.env` file:
 
 ```conf
 AGENT=agentabc
+HEADED_BROWSER=false
 DEBUG=false
 JOBDIR=../testing/jobs
 NETWATCH_URL_0_JOB=http://localhost:3000/api/assignJob/agentabc
@@ -974,9 +996,17 @@ Tools can become faulty. For example, Alfa stopped reporting any rule violations
 
 Testaro would become more reliable if the behavior of its tools were monitored for suspect changes.
 
+### Dependency deployment
+
+The behavior of Testaro as a dependency of an application deployed on a virtual private server has been observed to be vulnerable to slower performance and more frequent test failures than when Testaro is deployed as a stand-alone application on a workstation. The configuration of Testaro has been tuned for mitigation of such behaviors.
+
 ### Containerized deployment
 
-The experimental deployment of Testaro as a dependency in a containerized application has been unsuccessful. Playwnight errors have been thrown that are not thrown when the same application is deployed without containerization.
+The experimental deployment of Testaro as a dependency in a containerized application has been unsuccessful. Playwright errors have been thrown that are not thrown when the same application is deployed without containerization.
+
+### Headless browser fidelity
+
+Testaro normally performs tests with headless browsers. Some experiments appear to have shown that some test results are inaccurate with headless browsers, but this has not been replicated. The `launch` function in the `run` module accepts a `headEmulation` argument with `'high'` and `'low'` values. Its purpose is to permit optimizations of headless browsers to be turned off (`high`), at some performance cost, when making the browsers behave and appear more similar to headed browsers improves test accuracy. Observation has, however, failed to show any performance cost. Therefore, `'high'` is currently the default value.
 
 ## Repository exclusions
 

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "testaro",
-  "version": "60.5.1",
+  "version": "60.6.0",
   "description": "Run 1000 web accessibility tests from 11 tools and get a standardized report",
   "main": "index.js",
   "scripts": {

package/procs/doTestAct.js

@@ -39,9 +39,8 @@ const os = require('os');
 
 // CONSTANTS
 
-// Set DEBUG environment variable to 'true' to add debugging features.
+const headedBrowser = process.env.HEADED_BROWSER === 'true';
 const debug = process.env.DEBUG === 'true';
-// Set WAITS environment variable to a positive number to insert delays (in ms).
 const waits = Number.parseInt(process.env.WAITS) || 0;
 const tmpDir = os.tmpdir();
 
@@ -61,80 +60,85 @@ const doTestAct = async () => {
   const act = report.acts[actIndex];
   // Get the tool name.
   const {which} = act;
-  // Launch a browser, navigate to the URL, and update the page export of the run module.
-  await launch(
-    report,
-    debug,
-    waits,
-    act.launch && act.launch.browserID || report.browserID,
-    act.launch && act.launch.target && act.launch.target.url || report.target.url
-  );
-  // If the launch aborted the job:
-  if (report.jobData && report.jobData.aborted) {
-    // Close any existing browser.
-    await browserClose();
-    // Save the revised report.
-    const reportJSON = JSON.stringify(report);
-    await fs.writeFile(reportPath, reportJSON);
-    // Report this.
-    process.send('ERROR: Job aborted');
-  }
-  // Otherwise, i.e. if the launch did not abort the job:
-  else {
-    // Get the updated page.
-    const {page} = require('../run');
-    // If it exists:
-    if (page) {
-      try {
-        // Make the act reporter perform the specified tests of the tool.
-        const actReport = await require(`../tests/${which}`).reporter(page, report, actIndex, 65);
-        // Add the data and result to the act.
-        act.data = actReport.data;
-        act.result = actReport.result;
-        // If the tool reported that the page prevented testing:
-        if (act.data && act.data.prevented) {
-          // Add prevention data to the job data.
-          report.jobData.preventions[which] = act.data.error;
-        }
-        // Close any existing browser.
-        await browserClose();
-        const reportJSON = JSON.stringify(report);
-        // Save the revised report.
-        await fs.writeFile(reportPath, reportJSON);
-        // Send a completion message.
-        process.send('Act completed');
-      }
-      // If the tool invocation failed:
-      catch(error) {
-        // Close any existing browser.
-        await browserClose();
-        // Save the revised report.
-        const reportJSON = JSON.stringify(report);
-        await fs.writeFile(reportPath, reportJSON);
-        // Report the failure.
-        const message = error.message.slice(0, 400);
-        console.log(`ERROR: Test act ${act.which} failed (${message})`);
-        process.send('ERROR performing the act');
-      };
+  let page;
+  // If the tool is not Testaro:
+  if (which !== 'testaro') {
+    const browserID = act.launch && act.launch.browserID || report.browserID;
+    const targetURL = act.launch && act.launch.target && act.launch.target.url || report.target.url;
+    // Launch a browser, navigate to the URL, and update the run-module page export.
+    await launch(
+      report,
+      'high',
+      browserID,
+      targetURL
+    );
+    // If the launch aborted the job:
+    if (report.jobData && report.jobData.aborted) {
+      // Close any existing browser.
+      await browserClose();
+      // Save the revised report.
+      const reportJSON = JSON.stringify(report);
+      await fs.writeFile(reportPath, reportJSON);
+      // Report this.
+      process.send('ERROR: Job aborted');
     }
-    // Otherwise, i.e. if the page does not exist:
+    // Otherwise, i.e. if the launch did not abort the job:
     else {
-      // Add data to the act.
-      act.data ??= {};
-      act.data.prevented = true;
-      act.data.error = 'No page';
-      // Add prevention data to the job data.
-      report.jobData.preventions[which] = act.data.error;
+      // Get the updated page.
+      page = require('../run').page;
+    }
+  }
+  // If the page exists:
+  if (page || which === 'testaro') {
+    try {
+      // Make the act reporter perform the specified tests of the tool.
+      const actReport = await require(`../tests/${which}`).reporter(page, report, actIndex, 65);
+      // Add the data and result to the act.
+      act.data = actReport.data;
+      act.result = actReport.result;
+      // If the tool reported that the page prevented testing:
+      if (act.data && act.data.prevented) {
+        // Add prevention data to the job data.
+        report.jobData.preventions[which] = act.data.error;
+      }
       // Close any existing browser.
       await browserClose();
       const reportJSON = JSON.stringify(report);
       // Save the revised report.
       await fs.writeFile(reportPath, reportJSON);
-      // Report this.
-      const message = 'ERROR: No page';
-      console.log(message);
-      process.send(message);
+      // Send a completion message.
+      process.send('Act completed');
     }
+    // If the tool invocation failed:
+    catch(error) {
+      // Close any existing browser.
+      await browserClose();
+      // Save the revised report.
+      const reportJSON = JSON.stringify(report);
+      await fs.writeFile(reportPath, reportJSON);
+      // Report the failure.
+      const message = error.message.slice(0, 400);
+      console.log(`ERROR: Test act ${act.which} failed (${message})`);
+      process.send('ERROR performing the act');
+    };
+  }
+  // Otherwise, i.e. if the page does not exist:
+  else {
+    // Add data to the act.
+    act.data ??= {};
+    act.data.prevented = true;
+    act.data.error = 'No page';
+    // Add prevention data to the job data.
+    report.jobData.preventions[which] = act.data.error;
+    // Close any existing browser.
+    await browserClose();
+    const reportJSON = JSON.stringify(report);
+    // Save the revised report.
+    await fs.writeFile(reportPath, reportJSON);
+    // Report this.
+    const message = 'ERROR: No page';
+    console.log(message);
+    process.send(message);
   }
 };
 

package/run.js

@@ -58,9 +58,8 @@ const os = require('os');
 
 // CONSTANTS
 
-// Set DEBUG environment variable to 'true' to add debugging features.
+const headedBrowser = process.env.HEADED_BROWSER === 'true';
 const debug = process.env.DEBUG === 'true';
-// Set WAITS environment variable to a positive number to insert delays (in ms).
 const waits = Number.parseInt(process.env.WAITS) || 0;
 // CSS selectors for targets of moves.
 const moves = {
@@ -291,7 +290,7 @@ const browserClose = exports.browserClose = async () => {
 };
 // Launches a browser and navigates to a URL.
 const launch = exports.launch = async (
-  report, debug, waits, tempBrowserID, tempURL, retries = 2
+  report, headEmulation, tempBrowserID, tempURL, retries = 2
 ) => {
   const act = report.acts[actIndex];
   const {device} = report;
@@ -306,7 +305,37 @@ const launch = exports.launch = async (
     const browserType = playwrightBrowsers[browserID];
     // Close any current browser.
     await browserClose();
-    // Define browser options.
+    // Define the browser-option args, depending on the browser type and head-emulation level.
+    const browserOptionArgs = [];
+    if (browserID === 'chromium') {
+      browserOptionArgs.push(
+        '--disable-dev-shm-usage', '--disable-blink-features=AutomationControlled'
+      );
+      if (headEmulation === 'high') {
+        browserOptionArgs.push(
+          '--no-sandbox',
+          '--disable-setuid-sandbox',
+          '--disable-gpu',
+          '--disable-software-rasterizer',
+          '--force-device-scale-factor=1',
+          '--disable-default-apps',
+          '--disable-extensions',
+          '--disable-sync',
+          '--disable-background-timer-throttling',
+          '--disable-backgrounding-occluded-windows',
+          '--disable-renderer-backgrounding',
+          '--disable-background-networking',
+          '--force-color-profile=srgb',
+          '--disable-features=TranslateUI,VizDisplayCompositor',
+          '--disable-ipc-flooding-protection',
+          '--disable-logging',
+          '--disable-permissions-api',
+          '--disable-notifications',
+          '--disable-popup-blocking'
+        );
+      }
+    }
+    // Define the browser options.
     const browserOptions = {
       logger: {
         isEnabled: () => false,
@@ -316,11 +345,9 @@ const launch = exports.launch = async (
           }
         }
       },
-      headless: ! debug,
+      headless: ! headedBrowser,
       slowMo: waits || 0,
-      ...(browserID === 'chromium' && {
-        args: ['--disable-dev-shm-usage', '--disable-blink-features=AutomationControlled']
-      })
+      args: browserOptionArgs
     };
     try {
       // Replace the browser with a new one.
@@ -460,7 +487,7 @@ const launch = exports.launch = async (
         );
         await wait(1000 * waitSeconds + 100);
         // Then retry the launch and navigation.
-        return launch(report, debug, waits, tempBrowserID, tempURL, retries - 1);
+        return launch(report, headEmulation, tempBrowserID, tempURL, retries - 1);
       }
       // Otherwise, i.e. if no retries remain:
       else {
@@ -765,8 +792,7 @@ const doActs = async (report, opts = {}) => {
         // Launch a browser, navigate to a page, and add the result to the act.
         await launch(
           report,
-          debug,
-          waits,
+          'high',
           actLaunchSpecs[0],
           actLaunchSpecs[1]
         );
@@ -1516,8 +1542,7 @@ const doActs = async (report, opts = {}) => {
       // Replace the browser and navigate to the URL.
       await launch(
         report,
-        debug,
-        waits,
+        'high',
         specs[0],
         specs[1]
       );

package/tests/testaro.js

@@ -44,410 +44,413 @@ const allRules = [
   {
     id: 'shoot0',
     what: 'first page screenshot',
-    contaminator: false,
+    launchRole: 'owner',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'adbID',
     what: 'elements with ambiguous or missing referenced descriptions',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'allCaps',
     what: 'leaf elements with entirely upper-case text longer than 7 characters',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 10,
     defaultOn: true
   },
   {
     id: 'allHidden',
     what: 'page that is entirely or mostly hidden',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'allSlanted',
     what: 'leaf elements with entirely italic or oblique text longer than 39 characters',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'altScheme',
     what: 'img elements with alt attributes having URLs as their entire values',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'attVal',
     what: 'elements with attributes having illicit values',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: false
   },
   {
     id: 'dupAtt',
     what: 'duplicate attribute values',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'autocomplete',
     what: 'name and email inputs without autocomplete attributes',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'bulk',
     what: 'large count of visible elements',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'captionLoc',
     what: 'caption elements that are not first children of table elements',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'datalistRef',
     what: 'elements with ambiguous or missing referenced datalist elements',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'distortion',
     what: 'distorted text',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 10,
     defaultOn: true
   },
   {
     id: 'docType',
     what: 'document without a doctype property',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 10,
     defaultOn: true
   },
   {
     id: 'dupAtt',
     what: 'elements with duplicate attributes',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'embAc',
     what: 'active elements embedded in links or buttons',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'headEl',
     what: 'invalid elements within the head',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'headingAmb',
     what: 'same-level sibling headings with identical texts',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'hr',
     what: 'hr element instead of styles used for vertical segmentation',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'imageLink',
     what: 'links with image files as their destinations',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'labClash',
     what: 'labeling inconsistencies',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 10,
     defaultOn: true
   },
   {
     id: 'legendLoc',
     what: 'legend elements that are not first children of fieldset elements',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'lineHeight',
     what: 'text with a line height less than 1.5 times its font size',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 10,
     defaultOn: true
   },
   {
     id: 'linkAmb',
     what: 'links with identical texts but different destinations',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'linkExt',
     what: 'links that automatically open new windows',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'linkOldAtt',
     what: 'links with deprecated attributes',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'linkTitle',
     what: 'links with title attributes repeating text content',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'linkTo',
     what: 'links without destinations',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'linkUl',
     what: 'missing underlines on inline links',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 10,
     defaultOn: true
   },
   {
     id: 'miniText',
     what: 'text smaller than 11 pixels',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'nonTable',
     what: 'table elements used for layout',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'optRoleSel',
     what: 'Non-option elements with option roles that have no aria-selected attributes',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'phOnly',
     what: 'input elements with placeholders but no accessible names',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'pseudoP',
     what: 'adjacent br elements suspected of nonsemantically simulating p elements',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'radioSet',
     what: 'radio buttons not grouped into standard field sets',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'role',
     what: 'native-replacing explicit roles',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'secHeading',
     what: 'headings that violate the logical level order in their sectioning containers',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'styleDiff',
     what: 'style inconsistencies',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'targetSmall',
     what: 'buttons, inputs, and non-inline links smaller than 44 pixels wide and high',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'targetTiny',
     what: 'buttons, inputs, and non-inline links smaller than 24 pixels wide and high',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'textSem',
     what: 'semantically vague elements i, b, and/or small',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 10,
     defaultOn: true
   },
   {
     id: 'title',
     what: 'page title',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: false
   },
   {
     id: 'titledEl',
     what: 'title attributes on inappropriate elements',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'zIndex',
     what: 'non-default Z indexes',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'shoot1',
     what: 'second page screenshot',
-    contaminator: false,
+    launchRole: 'owner',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'motion',
     what: 'motion without user request, measured across tests',
-    contaminator: false,
+    launchRole: 'sharer',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'buttonMenu',
     what: 'nonstandard keyboard navigation between items of button-controlled menus',
-    contaminator: true,
+    launchRole: 'waster',
     timeOut: 15,
     defaultOn: true
   },
   {
     id: 'elements',
     what: 'data on specified elements',
-    contaminator: true,
+    launchRole: 'waster',
     timeOut: 10,
     defaultOn: false
   },
   {
     id: 'focAll',
     what: 'discrepancies between focusable and Tab-focused elements',
-    contaminator: true,
+    launchRole: 'waster',
     timeOut: 10,
     defaultOn: true
   },
   {
     id: 'focInd',
     what: 'missing and nonstandard focus indicators',
-    contaminator: true,
+    launchRole: 'waster',
     timeOut: 10,
     defaultOn: true
   },
   {
     id: 'focOp',
     what: 'Tab-focusable elements that are not operable',
-    contaminator: true,
+    launchRole: 'waster',
     timeOut: 5,
     defaultOn: true
   },
   {
     id: 'focVis',
     what: 'links that are not entirely visible when focused',
-    contaminator: true,
+    launchRole: 'waster',
     timeOut: 10,
     defaultOn: true
   },
   {
     id: 'hover',
     what: 'hover-caused content changes',
-    contaminator: true,
+    launchRole: 'waster',
     timeOut: 10,
     defaultOn: true
   },
   {
     id: 'hovInd',
     what: 'hover indication nonstandard',
-    contaminator: true,
+    launchRole: 'waster',
     timeOut: 10,
     defaultOn: true
   },
-  {
-    id: 'motionSolo',
-    what: 'motion without user request, measured within this test',
-    contaminator: true,
-    timeOut: 15,
-    defaultOn: false
-  },
   {
     id: 'opFoc',
     what: 'operable elements that are not Tab-focusable',
-    contaminator: true,
+    launchRole: 'waster',
     timeOut: 10,
     defaultOn: true
   },
   {
     id: 'tabNav',
     what: 'nonstandard keyboard navigation between elements with the tab role',
-    contaminator: true,
+    launchRole: 'waster',
     timeOut: 10,
     defaultOn: true
   },
+  {
+    id: 'motionSolo',
+    what: 'motion without user request, measured within this test',
+    launchRole: 'waster',
+    timeOut: 15,
+    defaultOn: false
+  },
   {
     id: 'textNodes',
     what: 'data on specified text nodes',
-    contaminator: true,
+    launchRole: 'waster',
     timeOut: 10,
     defaultOn: false
   }
 ];
+const headedBrowser = process.env.HEADED_BROWSER === 'true';
+const debug = process.env.DEBUG === 'true';
+const waits = Number.parseInt(process.env.WAITS) || 0;
 const timeoutMultiplier = Number.parseFloat(process.env.TIMEOUT_MULTIPLIER) || 1;
 
 // ERROR HANDLER
@@ -485,11 +488,11 @@ const wait = ms => {
 };
 // Conducts and reports Testaro tests.
 exports.reporter = async (page, report, actIndex) => {
-  const url = await page.url();
   const act = report.acts[actIndex];
   const {args, stopOnFail, withItems} = act;
-  const launchOptions = act.launch;
-  const browserID = launchOptions ? launchOptions.browserID || report.browserID : report.browserID;
+  const target = act.target || report.target;
+  const url = target.url;
+  const browserID = act.launch ? act.launch.browserID || report.browserID : report.browserID;
   const argRules = args ? Object.keys(args) : null;
   // Get the specification of rules to be tested for.
   const ruleSpec = act.rules
@@ -528,34 +531,36 @@ exports.reporter = async (page, report, actIndex) => {
   : allRules.filter(rule => rule.defaultOn && ! allRuleIDs.includes(rule.id));
   const jobRules = allRules.filter(rule => jobRuleIDs.includes(rule.id));
   const testTimes = [];
-  let contaminatorsStarted = false;
   // For each rule to be tested for:
-  for (const rule of jobRules) {
+  for (const ruleIndexString in jobRules) {
+    const ruleIndex = Number.parseInt(ruleIndexString);
+    const rule = jobRules[ruleIndex];
     const ruleID = rule.id;
     console.log(`Starting rule ${ruleID}`);
-    const pageClosed = page ? page.isClosed() : true;
-    const isContaminator = rule.contaminator;
-    // If it is a contaminator other than the first one or the page has closed:
-    if (contaminatorsStarted || pageClosed) {
-      // If the page has closed:
-      if (pageClosed) {
+    // Make the browser emulate headedness in all cases, because performance does not suffer.
+    const headEmulation = ruleID.startsWith('shoot') ? 'high' : 'high';
+    // Get whether it needs a new browser launched.
+    const needsLaunch = ruleIndex
+    && jobRules[ruleIndex - 1].launchRole !== 'sharer'
+    && rule.launchRole !== 'owner'
+    || ! ruleIndex;
+    const pageClosed = page && page.isClosed();
+    // If it does, or if the page has closed:
+    if (needsLaunch || pageClosed) {
+      // If the page has closed when it is expected to be open:
+      if (pageClosed && ! needsLaunch) {
         // Report this.
         console.log(`WARNING: Relaunching browser for test ${rule} after abnormal closure`);
       }
       // Replace the browser and the page and navigate to the target.
       await launch(
         report,
-        process.env.DEBUG === 'true',
-        Number.parseInt(process.env.WAITS) || 0,
+        headEmulation,
         browserID,
         url
       );
       page = require('../run').page;
     }
-    // If the rule is a contaminator, ensure that future tests use new browsers.
-    if (isContaminator) {
-      contaminatorsStarted = true;
-    }
     // Report crashes and disconnections during this test.
     let crashHandler;
     let disconnectHandler;
@@ -573,7 +578,7 @@ exports.reporter = async (page, report, actIndex) => {
       };
       browser.on('disconnected', disconnectHandler);
     }
-    // Initialize an argument array.
+    // Initialize an argument array for reporter or jsonTest.
     const ruleArgs = [page, withItems];
     const ruleFileNames = await fs.readdir(`${__dirname}/../testaro`);
     const isJS = ruleFileNames.includes(`${ruleID}.js`);
@@ -658,11 +663,10 @@ exports.reporter = async (page, report, actIndex) => {
               `WARNING: Retry ${3 - testRetries--} of test ${ruleID} starting after page closed`
             );
             await wait(2000);
-            // Replace the browser and the page and navigate to the target.
+            // Replace the browser and the page in the run module and navigate to the target.
             await launch(
               report,
-              process.env.DEBUG === 'true',
-              Number.parseInt(process.env.WAITS) || 0,
+              headEmulation,
               report.browserID,
               url
             );

package/validation/jobs/todo/240101T1200-simple-example.json

@@ -21,8 +21,7 @@
       ]
     }
   ],
-  "sources": {
-  },
+  "sources": {},
   "standard": "only",
   "observe": false,
   "sendReportTo": "http://localhost:3007/api",