testaro 17.0.0 → 18.0.0

package/README.md

@@ -2,6 +2,10 @@
 
 Ensemble testing for web accessibility
 
+## Notice: tool change
+
+As of this version 18.0.0, the 10 tools integrated by Testaro have been changed to 9 tools. One tool, Tenon, was withdrawn by its owner on 2023-08-06, so it was removed from Testaro.
+
 ## Introduction
 
 Testaro is an application for automated web accessibility testing.
@@ -48,13 +52,10 @@ Testaro performs tests of these tools:
 - [HTML CodeSniffer](https://www.npmjs.com/package/html_codesniffer) (Squiz Labs)
 - [Nu Html Checker](https://github.com/validator/validator) (World Wide Web Consortium)
 - [QualWeb core](https://www.npmjs.com/package/@qualweb/core) (University of Lisbon)
-- [Tenon](https://tenon.io/documentation/what-tenon-tests.php) (Tenon)
 - [Testaro](https://www.npmjs.com/package/testaro) (Testaro)
 - [WAVE API](https://wave.webaim.org/api/) (WebAIM)
 
-The [BBC Accessibility Standards Checker](https://github.com/bbc/bbc-a11y) is not a formal dependency, but some of the tests in the Testaro tool are adaptations of tests of that tool.
-
-Level Access has acquired Tenon and has announced that it will retire Tenon in August 2023. Thereafter one should expect that Testaro will report failures to perform Tenon tests. In anticipation of the retirement of Tenon, tests have been added to Testaro that approximate those Tenon tests that, empirically, have been found to report issues not reported by other tools.
+Some of the rules tested by Testaro are based on rules of the [BBC Accessibility Standards Checker](https://github.com/bbc/bbc-a11y) and of Tenon, a service that existed until August 2023.
 
 ## Rules
 
@@ -71,7 +72,6 @@ When you ask Testaro to run tests of a tool, you may specify a subset of the rul
 These tools always perform a fixed set of tests, and Testaro disregards irrelevant results when you specify a set of rules:
 - ibm
 - nuVal
-- tenon
 - wave
 
 ## Job data
@@ -126,7 +126,7 @@ To run Testaro after installation, provide the environment variables described b
 
 ## Payment
 
-All of the tests that Testaro can perform are free of cost, except those performed by the Tenon and WAVE tools. The owner of each of those tools gives new registrants a free allowance of credits before it becomes necessary to pay for use of the API of the tool. The required environment variables for authentication and payment are described below under “Environment variables”.
+All of the tests that Testaro can perform are free of cost, except those performed by the WAVE tool. The owner of that tool gives new registrants a free allowance of credits before it becomes necessary to pay for use of the API of the tool. The required environment variable for authentication and payment is described below under “Environment variables”.
 
 ## Process objects
 
@@ -402,7 +402,7 @@ That means that a test act (i.e. an act with a `type` property having the value
 
 If a particular test act either must have or may have any other properties, those properties are specified in the `tests` property in `actSpecs.js`.
 
-When you include a `rules` property, you limit the tests of the tool that are performed or reported. For some tools (`alfa`, `axe`, `continuum`, `htmlcs`, `qualWeb`, and `testaro`), only the specified tests are performed. Other tools (`ibm`, `nuVal`, `tenon`, and `wave`) do not allow such a limitation, so, for those tools, all tests are performed but results are reported from only the specified tests.
+When you include a `rules` property, you limit the tests of the tool that are performed or reported. For some tools (`alfa`, `axe`, `continuum`, `htmlcs`, `qualWeb`, and `testaro`), only the specified tests are performed. Other tools (`ibm`, `nuVal`, and `wave`) do not allow such a limitation, so, for those tools, all tests are performed but results are reported from only the specified tests.
 
 The `nuVal` and `testaro` tools require specific formats for the `rules` property. Those formats are described below in the sections about those tools.
 
@@ -555,48 +555,6 @@ Its `rules` argument is **not** an array of rule IDs, but instead is an array of
 
 The `qualWeb` tool performs the ACT rules, WCAG Techniques, and best-practices tests of QualWeb. Only failures and warnings are included in the report. The EARL report of QualWeb is not generated, because it is equivalent to the report of the ACT rules tests.
 
-###### Tenon
-
-Most tools require only one act, but the `tenon` tool requires two acts:
-- An act of type `tenonRequest`.
-- An act of type `test` with `tenon` as the value of `which`.
-
-Example:
-
-```json
-  {
-    "type": "tenonRequest",
-    "id": "a",
-    "withNewContent": true,
-    "what": "Tenon API version 2 test request"
-  }
-  ```
-
-  followed by
-
-```json
-  {
-    "type": "test",
-    "which": "tenon",
-    "id": "a",
-    "what": "Tenon API version 2 result retrieval"
-  }
-```
-
-The reason is that the Tenon API operates asynchronously. You ask it to perform a test, and it puts your request into a queue. To learn whether Tenon has completed your test, you make a status request. You can continue making status requests until Tenon replies that your test has been completed. Then you submit a request for the test result, and Tenon replies with the result. (As of May 2022, however, status requests were observed to misreport still-running tests as completed. The `tenon` test act works around that by requesting only the result and using the response to determine whether the tests have been completed.)
-
-Tenon says that tests are typically completed in 3 to 6 seconds but that the latency can be longer, depending on demand.
-
-Therefore, you can include a `tenonRequest` act early in your job, and a `tenon` test act late in your job. Tenon will move your request through its queue while Testaro is processing your job. When Testaro reaches your `tenon` test act, Tenon will most likely have completed your test. If not, the `tenon` test will wait and then make a second request before giving up.
-
-Thus, a `tenon` test act actually does not perform any test; it merely collects the result. The page that was active when the `tenonRequest` act was performed is the one that Tenon tests.
-
-In case you want to perform the Tenon tests more than once in the same job, you can do so. Just give each pair of acts a distinct `id` property, so each `tenon` test act will request the correct result.
-
-Tenon recommends giving it a public URL rather than giving it the content of a page, if possible. So, it is best to give the `withNewContent` property of the `tenonRequest` act the value `true`, unless the page is not public.
-
-If a `tenon` test act is included in a job, environment variables named `TENON_USER` and `TENON_PASSWORD` must exist, with your Tenon username and password, respectively, as their values. These could be obtained from [Tenon](https://tenon.io/documentation/overview) until Tenon was closed to new subscribers in or about October 2022.
-
 ###### Testaro
 
 If you do not specify rules when using the `testaro` tool, Testaro will test for the rules listed in the `evalRules` object of the `tests/testaro.js` file.
@@ -805,8 +763,6 @@ You may store environment variables in an untracked `.env` file if you wish, and
 
 ```conf
 URL_INJECT=yes
-TENON_USER=you@yourdomain.tld
-TENON_PASSWORD=yourTenonPassword
 WAVE_KEY=yourwavekey
 PROTOCOL=https
 JOB_URL=yourserver.tld/job

package/actSpecs.js

@@ -113,14 +113,6 @@ exports.actSpecs = {
         what: [false, 'string', 'hasLength', 'comment']
       }
     ],
-    tenonRequest: [
-      'Request a Tenon test',
-      {
-        id: [true, 'string', 'hasLength', 'ID for this test instance'],
-        withNewContent: [true, 'boolean', '', 'true: use a URL; false: use page content'],
-        what: [false, 'string', 'hasLength', 'comment']
-      }
-    ],
     test: [
       'Perform tests of a tool',
       {
@@ -174,12 +166,6 @@ exports.actSpecs = {
         withNewContent: [true, 'boolean', '', 'whether to use a URL instead of page content']
       }
     ],
-    tenon: [
-      'Perform Tenon tests',
-      {
-        id: [true, 'string', 'hasLength', 'ID of the requested test instance']
-      }
-    ],
     testaro: [
       'Perform Testaro tests',
       {

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "testaro",
-  "version": "17.0.0",
+  "version": "18.0.0",
   "description": "Automation of accessibility testing",
   "main": "index.js",
   "scripts": {

package/run.js

@@ -42,7 +42,6 @@ const tests = {
   ibm: 'IBM Accessibility Checker',
   nuVal: 'Nu Html Checker',
   qualWeb: 'QualWeb',
-  tenon: 'Tenon',
   testaro: 'Testaro',
   wave: 'WAVE',
 };
@@ -54,11 +53,6 @@ const browserTypeNames = {
 };
 // Items that may be waited for.
 const waitables = ['url', 'title', 'body'];
-// Tenon data.
-const tenonData = {
-  accessToken: '',
-  requestIDs: {}
-};
 // Strings in log messages indicating errors.
 const errorWords = [
   'but not used',
@@ -864,119 +858,6 @@ const doActs = async (report, actIndex, page) => {
                 success: true
               };
             }
-            // Otherwise, if the act is a tenon request:
-            else if (act.type === 'tenonRequest') {
-              const {id, withNewContent} = act;
-              const https = require('https');
-              // If a Tenon access token has not yet been obtained:
-              if (! tenonData.accessToken) {
-                // Authenticate with the Tenon API.
-                const authData = await new Promise(resolve => {
-                  const request = https.request(
-                    {
-                      host: 'tenon.io',
-                      path: '/api/v2/auth',
-                      port: 443,
-                      protocol: 'https:',
-                      method: 'POST',
-                      headers: {
-                        'Content-Type': 'application/json',
-                        'Cache-Control': 'no-cache'
-                      }
-                    },
-                    response => {
-                      let responseData = '';
-                      response.on('data', chunk => {
-                        responseData += chunk;
-                      });
-                      response.on('end', () => {
-                        try {
-                          const responseJSON = JSON.parse(responseData);
-                          return resolve(responseJSON);
-                        }
-                        catch(error) {
-                          return resolve({
-                            error: 'Tenon did not return JSON authentication data.',
-                            responseData
-                          });
-                        }
-                      });
-                    }
-                  );
-                  const tenonUser = process.env.TENON_USER;
-                  const tenonPassword = process.env.TENON_PASSWORD;
-                  const postData = JSON.stringify({
-                    username: tenonUser,
-                    password: tenonPassword
-                  });
-                  request.write(postData);
-                  request.end();
-                });
-                // If the authentication succeeded:
-                if (authData.access_token) {
-                  // Record the access token.
-                  tenonData.accessToken = authData.access_token;
-                }
-                // Otherwise, i.e. if the authentication failed:
-                else {
-                  console.log('ERROR: tenon authentication failed');
-                }
-              }
-              // If a Tenon access token exists:
-              if (tenonData.accessToken) {
-                // Request a Tenon test of the page and get a response ID.
-                const option = {};
-                // If Tenon is to be given the URL and not the content of the page:
-                if (withNewContent) {
-                  // Specify this.
-                  option.url = page.url();
-                }
-                // Otherwise, i.e. if Tenon is to be given the page content:
-                else {
-                  // Specify this.
-                  option.src = await page.content();
-                }
-                // Request a Tenon test and get a response ID.
-                const responseID = await new Promise(resolve => {
-                  const request = https.request(
-                    {
-                      host: 'tenon.io',
-                      path: '/api/v2/',
-                      port: 443,
-                      protocol: 'https:',
-                      method: 'POST',
-                      headers: {
-                        'Content-Type': 'application/json',
-                        'Cache-Control': 'no-cache',
-                        Authorization: `Bearer ${tenonData.accessToken}`
-                      }
-                    },
-                    response => {
-                      let resultJSON = '';
-                      response.on('data', chunk => {
-                        resultJSON += chunk;
-                      });
-                      // When the data arrive, return them as an object.
-                      response.on('end', () => {
-                        try {
-                          const result = JSON.parse(resultJSON);
-                          resolve(result.data.responseID || '');
-                        }
-                        catch (error) {
-                          console.log('ERROR: Tenon did not return JSON.');
-                          resolve('');
-                        }
-                      });
-                    }
-                  );
-                  const postData = JSON.stringify(option);
-                  request.write(postData);
-                  request.end();
-                });
-                // Record the response ID.
-                tenonData.requestIDs[id] = responseID || '';
-              }
-            }
             // Otherwise, if the act performs the tests of a tool:
             else if (act.type === 'test') {
               // Add a description of the test to the act.
@@ -997,7 +878,7 @@ const doActs = async (report, actIndex, page) => {
                 }
               };
               try {
-                const args = [act.which === 'tenon' ? tenonData : page, options];
+                const args = [page, options];
                 testReport = await require(`./tests/${act.which}`).reporter(... args);
                 testReport.result.success = true;
               }

package/standardize.js

@@ -381,40 +381,6 @@ const convert = (toolName, result, standardResult) => {
       doQualWeb(result, standardResult, 'best-practices');
     }
   }
-  // tenon
-  else if (toolName === 'tenon' && result.data && result.data.resultSet) {
-    result.data.resultSet.forEach(item => {
-      const identifiers = getIdentifiers(
-        item.errorSnippet.replace(/&lt;/g, '<').replace(/&gt;/g, '>')
-      );
-      if (! identifiers[0] && item.xpath) {
-        const tagNameArray = item.xpath.match(/^.+\/([^/[]+)/);
-        if (tagNameArray && tagNameArray.length === 2) {
-          identifiers[0] = tagNameArray[1].toUpperCase();
-        }
-      }
-      const instance = {
-        ruleID: item.tID ? item.tID.toString() : '',
-        what: item.errorTitle || '',
-        ordinalSeverity: Math.min(
-          3, Math.max(0, Math.round((item.certainty || 0) * (item.priority || 0) / 3333))
-        ),
-        tagName: identifiers[0],
-        id: identifiers[1],
-        location: {
-          doc: 'dom',
-          type: 'xpath',
-          spec: item.xpath || ''
-        },
-        excerpt: cap(item.errorSnippet || '').replace(/&lt;/g, '<').replace(/&gt;/g, '>')
-      };
-      standardResult.instances.push(instance);
-    });
-    standardResult.totals = [0, 0, 0, 0];
-    standardResult.instances.forEach(instance => {
-      standardResult.totals[instance.ordinalSeverity]++;
-    });
-  }
   // testaro
   else if (toolName === 'testaro') {
     const rules = result.rules ? Object.keys(result.rules) : [];

package/testaro/hovInd.js

@@ -140,88 +140,114 @@ exports.reporter = async (page, withItems, sampleSize = 20) => {
   for (const loc of sample) {
     // Get its style properties.
     const preStyles = await getHoverStyles(loc);
-    // Focus it.
-    await loc.focus();
-    // Get its style properties.
-    const focStyles = await getHoverStyles(loc);
-    // Hover over it.
-    await loc.hover();
-    // Get its style properties.
-    const fhStyles = await getHoverStyles(loc);
-    // Blur it.
-    await loc.blur({
-      timeout: 500
-    });
-    // Get its style properties.
-    const hovStyles = await getHoverStyles(loc);
-    // If all 4 style declarations belong to the same element:
-    if ([focStyles, fhStyles, hovStyles].every(style => style.code === preStyles.code)) {
-      // Get data on the element if itemization is required.
-      const elData = withItems ? await getLocatorData(loc) : null;
-      // If the hover cursor is nonstandard:
-      const cursorData = getCursorData(hovStyles);
-      if (! cursorData.ok) {
-        // Add to the totals.
-        totals[2] += psRatio;
-        data.typeTotals.badCursor += psRatio;
-        // If itemization is required:
-        if (withItems) {
-          // Add an instance to the result.
-          standardInstances.push({
-            ruleID: 'hovInd',
-            what: `Element has a nonstandard hover cursor (${cursorData.cursor})`,
-            ordinalSeverity: 2,
-            tagName: elData.tagName,
-            id: elData.id,
-            location: elData.location,
-            excerpt: elData.excerpt
-          });
+    // Try to focus it.
+    try {
+      await loc.focus({timeout: 500});
+      // If focusing succeeds, get its style properties.
+      const focStyles = await getHoverStyles(loc);
+      // Try to hover over it.
+      try {
+        await loc.hover({timeout: 500});
+        // If hovering succeeds, get its style properties.
+        const fhStyles = await getHoverStyles(loc);
+        // Try to blur it.
+        try {
+          await loc.blur({timeout: 500});
+          // If blurring succeeds, get its style properties.
+          const hovStyles = await getHoverStyles(loc);
+          // If all 4 style declarations belong to the same element:
+          if ([focStyles, fhStyles, hovStyles].every(style => style.code === preStyles.code)) {
+            // Get data on the element if itemization is required.
+            const elData = withItems ? await getLocatorData(loc) : null;
+            // If the hover cursor is nonstandard:
+            const cursorData = getCursorData(hovStyles);
+            if (! cursorData.ok) {
+              // Add to the totals.
+              totals[2] += psRatio;
+              data.typeTotals.badCursor += psRatio;
+              // If itemization is required:
+              if (withItems) {
+                // Add an instance to the result.
+                standardInstances.push({
+                  ruleID: 'hovInd',
+                  what: `Element has a nonstandard hover cursor (${cursorData.cursor})`,
+                  ordinalSeverity: 2,
+                  tagName: elData.tagName,
+                  id: elData.id,
+                  location: elData.location,
+                  excerpt: elData.excerpt
+                });
+              }
+            }
+            // If the element is a button and the hover and default states are not distinct:
+            if (hovStyles.tagName === 'BUTTON' && areAlike(preStyles, hovStyles)) {
+              // Add to the totals.
+              totals[1] += psRatio;
+              data.typeTotals.hoverLikeDefault += psRatio;
+              // If itemization is required:
+              if (withItems) {
+                // Add an instance to the result.
+                standardInstances.push({
+                  ruleID: 'hovInd',
+                  what: 'Element border, outline, and background color do not change when hovered over',
+                  ordinalSeverity: 1,
+                  tagName: elData.tagName,
+                  id: elData.id,
+                  location: elData.location,
+                  excerpt: elData.excerpt
+                });
+              }
+            }
+            // If the hover and focus-hover states are indistinct but differ from the default state:
+            if (areAlike(hovStyles, focStyles) && ! areAlike(hovStyles, preStyles)) {
+              // Add to the totals.
+              totals[1] += psRatio;
+              data.typeTotals.hoverLikeFocus += psRatio;
+              // If itemization is required:
+              if (withItems) {
+                // Add an instance to the result.
+                standardInstances.push({
+                  ruleID: 'hovInd',
+                  what: 'Element border, outline, and background color are alike on hover and focus',
+                  ordinalSeverity: 1,
+                  tagName: elData.tagName,
+                  id: elData.id,
+                  location: elData.location,
+                  excerpt: elData.excerpt
+                });
+              }
+            }
+          }
+          // Otherwise, i.e. if the style properties do not all belong to the same element:
+          else {
+            // Report this and quit.
+            data.prevented = true;
+            data.error = 'ERROR: Page changes on focus or hover prevent test';
+            break;
+          }
         }
-      }
-      // If the element is a button and the hover and default states are not distinct:
-      if (hovStyles.tagName === 'BUTTON' && areAlike(preStyles, hovStyles)) {
-        // Add to the totals.
-        totals[1] += psRatio;
-        data.typeTotals.hoverLikeDefault += psRatio;
-        // If itemization is required:
-        if (withItems) {
-          // Add an instance to the result.
-          standardInstances.push({
-            ruleID: 'hovInd',
-            what: 'Element border, outline, and background color do not change when hovered over',
-            ordinalSeverity: 1,
-            tagName: elData.tagName,
-            id: elData.id,
-            location: elData.location,
-            excerpt: elData.excerpt
-          });
+        // If blurring fails:
+        catch(error) {
+          // Report this.
+          data.prevented = true;
+          data.error = 'ERROR: Page changes on focus or hover prevent test';
+          break;
         }
       }
-      // If the hover and focus-hover states are indistinct but differ from the default state:
-      if (areAlike(hovStyles, focStyles) && ! areAlike(hovStyles, preStyles)) {
-        // Add to the totals.
-        totals[1] += psRatio;
-        data.typeTotals.hoverLikeFocus += psRatio;
-        // If itemization is required:
-        if (withItems) {
-          // Add an instance to the result.
-          standardInstances.push({
-            ruleID: 'hovInd',
-            what: 'Element border, outline, and background color are alike on hover and focus',
-            ordinalSeverity: 1,
-            tagName: elData.tagName,
-            id: elData.id,
-            location: elData.location,
-            excerpt: elData.excerpt
-          });
-        }
+      // If hovering fails:
+      catch(error) {
+        // Report this.
+        data.prevented = true;
+        data.error = 'ERROR: Page changes on focus or hover prevent test';
+        break;
       }
     }
-    // Otherwise, i.e. if the style properties do not all belong to the same element:
-    else {
+    // If focusing fails:
+    catch(error) {
       // Report this.
       data.prevented = true;
       data.error = 'ERROR: Page changes on focus or hover prevent test';
+      break;
     }
   }
   // Round the totals.

package/tests/testaro.js

@@ -30,7 +30,6 @@ const evalRules = {
   linkTitle: 'links with title attributes repeating text content',
   linkTo: 'links without destinations',
   linkUl: 'missing underlines on inline links',
-  menuNav: 'nonstandard keyboard navigation between focusable menu items',
   miniText: 'text smaller than 11 pixels',
   motion: 'motion without user request',
   nonTable: 'table elements used for layout',

package/validation/tests/jobs/allHidden.json

@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "entirely or mainly hidden page",
       "stopOnFail": true,
       "expect": [
         [
@@ -60,7 +59,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "entirely or mainly hidden page",
       "stopOnFail": true,
       "expect": [
         [

package/validation/tests/jobs/attVal.json

@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "attribute values",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -43,7 +42,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "attribute values",
       "withItems": false,
       "stopOnFail": true,
       "expect": [
@@ -149,7 +147,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "attribute values",
       "withItems": false,
       "stopOnFail": true,
       "expect": [

package/validation/tests/jobs/bulk.json

@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "visible element count",
       "stopOnFail": true,
       "expect": [
         [
@@ -45,7 +44,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "visible element count",
       "stopOnFail": true,
       "expect": [
         [

package/validation/tests/jobs/docType.json

@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "doctype",
       "stopOnFail": true,
       "expect": [
         [
@@ -45,7 +44,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "doctype",
       "stopOnFail": true,
       "expect": [
         [

package/validation/tests/jobs/dupAtt.json

@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "elements with duplicate attributes",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -45,7 +44,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "elements with duplicate attributes",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -108,7 +106,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "elements with duplicate attributes",
       "withItems": false,
       "stopOnFail": true,
       "expect": [

package/validation/tests/jobs/elements.json

@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "elements",
       "stopOnFail": true,
       "expect": [
         [
@@ -38,7 +37,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "elements",
       "stopOnFail": true,
       "expect": [
         [
@@ -59,7 +57,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "elements",
       "stopOnFail": true,
       "expect": [
         [

package/validation/tests/jobs/embAc.json

@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "embedded active elements",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -45,7 +44,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "embedded active elements",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -108,7 +106,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "embedded active elements",
       "withItems": false,
       "stopOnFail": true,
       "expect": [

package/validation/tests/jobs/filter.json

@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "filter",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -45,7 +44,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "filter",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -118,7 +116,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "filter",
       "withItems": false,
       "stopOnFail": true,
       "expect": [

package/validation/tests/jobs/focAll.json

@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "Tab-focusability",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -45,7 +44,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "Tab-focusability",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -93,7 +91,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "Tab-focusability",
       "withItems": true,
       "stopOnFail": true,
       "expect": [

package/validation/tests/jobs/focInd.json

@@ -18,7 +18,6 @@
       "type": "test",
       "which": "testaro",
       "withItems": true,
-      "what": "focus indication",
       "stopOnFail": true,
       "expect": [
         [
@@ -134,7 +133,6 @@
       "type": "test",
       "which": "testaro",
       "withItems": false,
-      "what": "focus indication",
       "stopOnFail": true,
       "expect": [
         [

package/validation/tests/jobs/focOp.json

@@ -6,8 +6,8 @@
   "acts": [
     {
       "type": "launch",
-      "which": "webkit",
-      "what": "sole focOp-compatible browser"
+      "which": "chromium",
+      "what": "usual browser"
     },
     {
       "type": "url",
@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "focusability and operability",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -50,7 +49,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "focusability and operability",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -158,7 +156,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "focusability and operability",
       "withItems": false,
       "stopOnFail": true,
       "expect": [

package/validation/tests/jobs/focVis.json

@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "off-display focused links",
       "withItems": true,
       "stopOnFail": true,
       "expect": [

package/validation/tests/jobs/labClash.json

@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "Labeling",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -50,7 +49,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "Labeling",
       "withItems": true,
       "stopOnFail": true,
       "expect": [

package/validation/tests/jobs/linkTo.json

@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "links without destinations",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -80,7 +79,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "links without destinations",
       "withItems": false,
       "stopOnFail": true,
       "expect": [

package/validation/tests/jobs/linkUl.json

@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "adjacent-link underlining",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -45,7 +44,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "adjacent-link underlining",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -78,7 +76,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "inline-link underlining",
       "withItems": true,
       "stopOnFail": true,
       "expect": [

package/validation/tests/jobs/miniText.json

@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "small text",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -95,7 +94,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "small text",
       "withItems": false,
       "stopOnFail": true,
       "expect": [

package/validation/tests/jobs/motion.json

@@ -59,7 +59,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "spontaneous change of content",
       "stopOnFail": true,
       "expect": [
         [

package/validation/tests/jobs/nonTable.json

@@ -104,7 +104,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "tables used for layout",
       "withItems": false,
       "stopOnFail": true,
       "expect": [

package/validation/tests/jobs/radioSet.json

@@ -45,7 +45,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "radioSet",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -148,7 +147,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "radioSet",
       "withItems": false,
       "stopOnFail": true,
       "expect": [

package/validation/tests/jobs/role.json

@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "role",
       "stopOnFail": true,
       "expect": [
         [
@@ -50,7 +49,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "role",
       "stopOnFail": true,
       "expect": [
         [

package/validation/tests/jobs/styleDiff.json

@@ -18,7 +18,6 @@
       "type": "test",
       "which": "testaro",
       "withItems": true,
-      "what": "styleDiff",
       "stopOnFail": true,
       "expect": [
         [
@@ -51,7 +50,6 @@
       "type": "test",
       "which": "testaro",
       "withItems": true,
-      "what": "styleDiff",
       "stopOnFail": true,
       "expect": [
         [

package/validation/tests/jobs/tabNav.json

@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "tab-list navigation",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -50,7 +49,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "tab-list navigation",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -138,7 +136,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "tab-list navigation",
       "withItems": false,
       "stopOnFail": true,
       "expect": [

package/validation/tests/jobs/textNodes.json

@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "text nodes",
       "stopOnFail": true,
       "expect": [
         [
@@ -38,7 +37,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "text nodes",
       "stopOnFail": true,
       "expect": [
         [
@@ -59,7 +57,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "text nodes",
       "stopOnFail": true,
       "expect": [
         [
@@ -85,7 +82,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "text nodes",
       "stopOnFail": true,
       "expect": [
         [
@@ -170,7 +166,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "text nodes",
       "stopOnFail": true,
       "expect": [
         [

package/validation/tests/jobs/title.json

@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "document title",
       "stopOnFail": true,
       "expect": [
         [
@@ -40,7 +39,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "document title",
       "stopOnFail": true,
       "expect": [
         [

package/validation/tests/jobs/titledEl.json

@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "title attributes on inappropriate elements",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -85,7 +84,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "title attributes on inappropriate elements",
       "withItems": false,
       "stopOnFail": true,
       "expect": [

package/validation/tests/jobs/zIndex.json

@@ -17,7 +17,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "zIndex",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -50,7 +49,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "zIndex",
       "withItems": true,
       "stopOnFail": true,
       "expect": [
@@ -108,7 +106,6 @@
     {
       "type": "test",
       "which": "testaro",
-      "what": "zIndex",
       "withItems": false,
       "stopOnFail": true,
       "expect": [

package/tests/tenon.js

@@ -1,144 +0,0 @@
-/*
-  tenon
-  This test processes a previously requested test by the Tenon API.
-*/
-const https = require('https');
-// Wait until a time limit in seconds expires.
-const wait = timeLimit => new Promise(resolve => setTimeout(resolve, 1000 * timeLimit));
-exports.reporter = async (tenonData, options) => {
-  const {id, rules} = options;
-  if (tenonData && tenonData.accessToken && tenonData.requestIDs && tenonData.requestIDs[id]) {
-    // Shared request options.
-    const requestOptions = {
-      host: 'tenon.io',
-      path: `/api/v2/${tenonData.requestIDs[id]}`,
-      port: 443,
-      protocol: 'https:',
-      headers: {
-        Authorization: `Bearer ${tenonData.accessToken}`,
-        'Cache-Control': 'no-cache'
-      }
-    };
-    // Gets the test status.
-    const getStatus = async () => {
-      const testStatus = await new Promise((resolve, reject) => {
-        requestOptions.method = 'HEAD';
-        const statusRequest = https.request(requestOptions, statusResponse => {
-          const {statusCode} = statusResponse;
-          resolve(statusCode);
-        });
-        statusRequest.on('error', error => {
-          console.log(`ERROR getting Tenon test status (${error.message})`);
-          reject(`ERROR getting Tenon test status (${error.message})`);
-        });
-        statusRequest.end();
-      });
-      return testStatus;
-    };
-    // Gets the test result.
-    const getResult = async () => {
-      const testResult = await new Promise(resolve => {
-        requestOptions.method = 'GET';
-        const resultRequest = https.request(requestOptions, resultResponse => {
-          let resultJSON = '';
-          resultResponse.on('data', chunk => {
-            resultJSON += chunk;
-          });
-          resultResponse.on('end', () => {
-            try {
-              const result = JSON.parse(resultJSON);
-              resolve(result);
-            }
-            catch(error) {
-              console.log(`ERROR getting Tenon test result (${resultJSON.slice(0, 80)} …)`);
-              resolve({
-                error: 'ERROR getting Tenon test result',
-                resultStart: resultJSON.slice(0, 80)
-              });
-            }
-          });
-        });
-        resultRequest.end();
-      });
-      // If any rules were specified and any test results exist:
-      if (
-        rules
-        && rules.length
-        && testResult.data
-        && testResult.data.resultSet
-        && testResult.data.resultSet.length
-      ) {
-        // Delete the results of tests of rules not specified.
-        testResult.data.resultSet = testResult.data.resultSet.filter(
-          result => rules.includes(result.tID.toString())
-        );
-      }
-      return testResult;
-    };
-    // Get the test status (not reliable: may say 200 instead of 202).
-    let testStatus = await getStatus();
-    // If the test is still in the Tenon queue:
-    if (testStatus === 202) {
-      // Wait 5 seconds.
-      await wait(5);
-      // Get the test status again.
-      testStatus = await getStatus();
-    }
-    // If the test has allegedly been completed:
-    if (testStatus ===  200) {
-      // Get the test result.
-      let testResult = await getResult();
-      // If the test is still in the Tenon queue:
-      let {status} = testResult;
-      if (status === 202) {
-        // Wait 5 seconds.
-        await wait(5);
-        // Get the test result again.
-        testResult = await getResult();
-        // If the test is still in the Tenon queue:
-        status = testResult.status;
-        if (status === 202) {
-          // Wait 15 more seconds.
-          await wait(15);
-          // Get the test result again.
-          testResult = await getResult();
-          status = testResult.status;
-        }
-      }
-      // If the test has really been completed:
-      if (status === 200) {
-        // Return its result.
-        return {result: testResult};
-      }
-      // Otherwise, i.e. if the test is still running or failed:
-      else {
-        return {
-          result: {
-            prevented: true,
-            error: 'ERROR: Tenon test stalled or crashed',
-            status
-          }
-        };
-      }
-    }
-    // Otherwise, if the test is still running after a wait for its status:
-    else {
-      // Report the test status.
-      return {
-        result: {
-          prevented: true,
-          error: 'ERROR: test status not completed',
-          testStatus
-        }
-      };
-    }
-  }
-  else {
-    return {
-      result: {
-        prevented: true,
-        error: 'ERROR: tenon authorization and test data incomplete'
-      }
-    };
-  }
-};