@jrpool/kilotest 44.0.0 → 44.1.2

package/aceconfig.js

@@ -10,7 +10,7 @@
 
 /*
   aceconfig
-  Configuration for the ibm tool.
+  Configuration for the ibm rule engine.
 */
 
 const os = require('os');

package/docs/AI-TOOLS.md

@@ -188,13 +188,13 @@ The [Perplexity documentation](https://www.perplexity.ai/help-center/en/articles
 
 Once the compatibility of Kilotest as a connector with AI platforms of two different vendors had been confirmed, the focus of work returned to completion of the missing endpoints of the API. The first was an endpoint that would let a model efficiently search for an available report about a particular web page.
 
-The new `summarizeQualityOfMatchingWebPages` tool provided inputs for fragments of a description and of a URL hostname of a web page and responds with summary data about all and only the available reports of pages that match at least one of those fragments, where matching means either including or being included by the provided fragment, case-insensitively.
+A new `summarizeQualityOfMatchingWebPages` tool provided inputs for fragments of a description and of a URL hostname of a web page and responds with summary data about all and only the available reports of pages that match at least one of those fragments, where matching means either including or being included by the provided fragment, case-insensitively.
 
 ### Increment 7
 
 Further experimentation made it clear that Increment 6 had been a detour. The problem with Increment 6 was that it does not improve efficiency by eliminating the need to get a list of all reports. Models must get a list of all reports in order to be confident that the answer to the question “Is a report available yet?” is correct. Any algorithm that matches a page description and a URL with those of existing reports is error-prone, organization names change, website designs change, URLs change, and organizations are related to one another. Typically, a desired report does not yet exist. In that case, the model needs the full list of reports in order to understand the naming convention for pages and to adhere to that convention when submitting a request to have the page of interest tested.
 
-For this reason, the tool being developed in increment 6 was deleted.
+For this reason, the tool developed in increment 6 was deleted.
 
 ### Increment 8
 

package/docs/SERVICE.md

@@ -332,17 +332,17 @@ In case Testaro again becomes a dependency of Kilotest, the notes below on secur
 
 ### Browser privileges
 
-Testaro uses Playwright to launch and control headless browsers, often `chromium`. Those browsers navigate to web pages that are tested by the rule engines that Testaro integrates. The `qualWeb` tool launches its own browser via Puppeteer as a dependency to perform its tests.
+Testaro uses Playwright to launch and control headless browsers, often `chromium`. Those browsers navigate to web pages that are tested by the rule engines that Testaro integrates.
 
-When either Playwright or Puppeteer launches a `chromium` browser, in most environments it is [sandboxed](https://www.geeksforgeeks.org/ethical-hacking/what-is-browser-sandboxing/). Sandboxing is a security feature that prevents the browser from accessing potentially unsafe system resources. But in the Ubuntu Linux operating system that was installed on the Vultr Cloud Compute host a sandboxed browser requires an [unprivileged user namespace](https://ubuntu.com/blog/ubuntu-23-10-restricted-unprivileged-user-namespaces), and when Ubuntu was installed its configuration disallowed such namespaces. The file `/etc/sysctl.d/99-kilotest-userns.conf` with the content `kernel.apparmor_restrict_unprivileged_userns = 1` prohibited unprivileged user namespaces and thereby made sandboxed browsers unlaunchable.
+When Playwright (or Puppeteer) launches a `chromium` browser, in most environments it is [sandboxed](https://www.geeksforgeeks.org/ethical-hacking/what-is-browser-sandboxing/). Sandboxing is a security feature that prevents the browser from accessing potentially unsafe system resources. But in the Ubuntu Linux operating system that was installed on the Vultr Cloud Compute host a sandboxed browser requires an [unprivileged user namespace](https://ubuntu.com/blog/ubuntu-23-10-restricted-unprivileged-user-namespaces), and when Ubuntu was installed its configuration disallowed such namespaces. The file `/etc/sysctl.d/99-kilotest-userns.conf` with the content `kernel.apparmor_restrict_unprivileged_userns = 1` prohibited unprivileged user namespaces and thereby made sandboxed browsers unlaunchable.
 
 #### Potential modification
 
 One modification to cope with this prohibition on the Vultr Cloud Compute host would be to configure Playwright and Puppeteer to launch `chromium` non-sandboxed. In both cases, launch arguments `'--no-sandbox'` and `'--disable-setuid-sandbox'` are available to specify this.
 
 - For Playwright, `'--no-sandbox'` and `'--disable-setuid-sandbox'` would be added to the arguments of `browserOptionArgs.push` in the Testaro `run.js` file.
-- For the `qualWeb` tool, this would be done in the Testaro `tests/qualweb.js` file, where the `qualWeb.start` method is called with an options argument. Its `args` array property would include `'--no-sandbox'` and `'--disable-setuid-sandbox'`.
-- The `ibm` tool, too, could launch a Puppeteer `chromium` browser, if page content instead of a Playwright page were passed to the `accessibilityChecker.getCompliance` method, or if the implementation of the tool were changed in the future. For anticipation of such a case, the Testaro `aceconfig.js` file, of which a copy has been created at the root of the Kilotest project, would be modified. That file defines a `module.exports` object with a `puppeteerArgs` property, and, `--no-sandbox` and `--disable-setuid-sandbox` would be added to its array value.
+- For the `qualWeb` rule engine, this would be done in the Testaro `tests/qualweb.js` file, where the `qualWeb.start` method is called with an options argument. Its `args` array property would include `'--no-sandbox'` and `'--disable-setuid-sandbox'`.
+- The `ibm` rule engine, too, could launch a Puppeteer `chromium` browser, if page content instead of a Playwright page were passed to the `accessibilityChecker.getCompliance` method, or if the implementation of the rule engine were changed in the future. For anticipation of such a case, the Testaro `aceconfig.js` file, of which a copy has been created at the root of the Kilotest project, would be modified. That file defines a `module.exports` object with a `puppeteerArgs` property, and, `--no-sandbox` and `--disable-setuid-sandbox` would be added to its array value.
 
 #### Current modification
 

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@jrpool/kilotest",
-  "version": "44.0.0",
+  "version": "44.1.2",
   "description": "Ensemble testing for front-end web quality",
   "main": "index.js",
   "engines": {

package/util.js

@@ -27,7 +27,7 @@ const hiddenReportsPath = exports.hiddenReportsPath = path.join(dbPath, 'hiddenR
 // Path of the reports data file.
 const reportsExtractPath = exports.reportsExtractPath = path.join(dbPath, 'reportsExtract.json');
 // IDs, names, and sponsors of Testaro rule engines.
-const tools = exports.tools = {
+const ruleEngines = exports.ruleEngines = {
   alfa: ['Alfa', 'Siteimprove'],
   aslint: ['ASLint', 'eSSENTIAL Accessibility'],
   axe: ['Axe', 'Deque'],
@@ -41,7 +41,6 @@ const tools = exports.tools = {
   wave: ['WAVE', 'Utah State University'],
   wax: ['WallyAX', 'Wally']
 };
-exports.ruleEngines = tools;
 exports.researchAgents = {
   'research-agent': 'Internal Research Agent'
 }
@@ -252,13 +251,14 @@ exports.getTextFragmentHref = (text, url) => {
   return `${url}#:~:text=${fragmentList}`;
 };
 // Returns a +-delimited list of sorted names of rule engines.
-exports.getToolList = toolIDs => Array.from(toolIDs)
-.map(toolID => tools[toolID][0])
+exports.getEngineList = engineIDs => Array.from(engineIDs)
+.map(engineID => ruleEngines[engineID][0])
 .sort((a, b) => a.localeCompare(b, 'en', {sensitivity: 'base'}))
 .join(' + ');
 // Returns a string of names of rule engines.
-exports.getToolNamesString = toolIDSet =>
-  alphaSort(Array.from(toolIDSet).map(toolID => tools[toolID]?.[0] || toolID)).join(' + ');
+exports.getEngineNamesString = engineIDSet => alphaSort(
+  Array.from(engineIDSet).map(engineID => ruleEngines[engineID]?.[0] || engineID)
+).join(' + ');
 // Gets the WCAG Understanding link for a numeric WCAG standard identifier.
 exports.getWCAGLink = numericID => {
   // Return the link.
@@ -444,7 +444,7 @@ const isValidReport = exports.isValidReport = report => {
   && report.acts.every(act =>
     typeof act === 'object'
     && typeof act.type === 'string'
-    && act.type === 'test' ? Object.keys(tools).includes(act.which) : true
+    && act.type === 'test' ? Object.keys(ruleEngines).includes(act.which) : true
   )
   && typeof report.jobData === 'object'
   && report.jobData.endTime
@@ -536,16 +536,16 @@ exports.getReportData = async (timeStamp, jobID) => {
     creationDate: getDateTime(timeStamp),
     daysAgo: getAgoDays(timeStamp),
     issueCount: 0,
-    toolNames: [],
-    toolCount: 0,
+    engineNames: [],
+    engineCount: 0,
     reporterNames: [],
     reporterCount: 0,
     violatorCount: 0,
-    preventedToolNames: [],
-    preventedToolCount: 0
+    preventedEngineNames: [],
+    preventedEngineCount: 0
   };
   const issueIDSet = new Set();
-  const toolNameSet = new Set();
+  const engineNameSet = new Set();
   const reporterIDSet = new Set();
   const violatorIndexSet = new Set();
   // For each act of the report:
@@ -553,15 +553,15 @@ exports.getReportData = async (timeStamp, jobID) => {
     // If it is a test act:
     if (act.type === 'test') {
       const {result, which} = act;
-      // Ensure that the tool is in the temporary data.
-      toolNameSet.add(tools[which][0]);
+      // Ensure that the rule engine is in the temporary data.
+      engineNameSet.add(ruleEngines[which][0]);
       const instances = result?.standardResult?.instances ?? [];
       // For each standard instance of the act:
       instances.forEach(instance => {
         const {catalogIndex, issueID} = instance;
         // If it has a non-ignorable classified issue ID:
         if (issueID && issueSpecs[issueID] && issueID !== 'ignorable') {
-          // Ensure that the tool is in the temporary data.
+          // Ensure that the rule engine is in the temporary data.
           reporterIDSet.add(which);
           // Ensure that the issue is in the temporary data.
           issueIDSet.add(issueID);
@@ -576,21 +576,21 @@ exports.getReportData = async (timeStamp, jobID) => {
   });
   // Populate the data with the act data.
   data.issueCount = issueIDSet.size;
-  data.toolNames = Array
-  .from(toolNameSet)
+  data.engineNames = Array
+  .from(engineNameSet)
   .sort((a, b) => a.localeCompare(b, 'en', {sensitivity: 'base'}));
-  data.toolCount = toolNameSet.size;
+  data.engineCount = engineNameSet.size;
   data.reporterNames = Array
   .from(reporterIDSet)
-  .map(id => tools[id][0])
+  .map(id => ruleEngines[id][0])
   .sort((a, b) => a.localeCompare(b, 'en', {sensitivity: 'base'}));
   data.reporterCount = data.reporterNames.length;
   data.violatorCount = violatorIndexSet.size;
   // Add the names of any prevented rule engines to the data.
-  data.preventedToolNames = Object.keys(report.jobData?.preventions || {})
-  .map(toolID => tools[toolID][0])
+  data.preventedEngineNames = Object.keys(report.jobData?.preventions || {})
+  .map(engineID => ruleEngines[engineID][0])
   .sort((a, b) => a.localeCompare(b, 'en', {sensitivity: 'base'}));
-  data.preventedToolCount = data.preventedToolNames.length;
+  data.preventedEngineCount = data.preventedEngineNames.length;
   // Return the data.
   return data;
 }

package/web/expungeReportsForm/index.js

@@ -54,7 +54,7 @@ exports.answer = async (_, search) => {
     const [timeStamp, jobID] = reportName.slice(0, -5).split('-');
     // Get a summary of it.
     const reportFacts = await getReportData(timeStamp, jobID);
-    const {error, issueCount, preventedToolCount, url} = reportFacts;
+    const {error, issueCount, preventedEngineCount, url} = reportFacts;
     // If this failed:
     if (error) {
       // Return why.
@@ -67,7 +67,7 @@ exports.answer = async (_, search) => {
       timeStamp,
       jobID,
       issueCount,
-      preventedToolCount,
+      preventedEngineCount,
       url
     });
   }
@@ -79,9 +79,9 @@ exports.answer = async (_, search) => {
   let anyDeletable = false;
   // For each summary:
   reportSpecs.forEach((spec, index) => {
-    const {timeStamp, jobID, issueCount, preventedToolCount, url} = spec;
+    const {timeStamp, jobID, issueCount, preventedEngineCount, url} = spec;
     const jobName = `${timeStamp}-${jobID}`;
-    const specString = `<code>${url}</code> (<code>${jobName}</code>): preventions ${preventedToolCount}, issues ${issueCount}`;
+    const specString = `<code>${url}</code> (<code>${jobName}</code>): preventions ${preventedEngineCount}, issues ${issueCount}`;
     // If its report is the sole report on a target:
     if (reportSpecs[index - 1]?.url !== url && reportSpecs[index + 1]?.url !== url) {
       // Add a line with a deletion checkbox.

package/web/listDiagnoses/index.js

@@ -13,7 +13,7 @@ const {
   getWeightName,
   htmlSafe,
   isHidden,
-  tools
+  ruleEngines
 } = require('../../util');
 const {issues: issueSpecs} = require('testaro-issues');
 const fs = require('fs/promises');
@@ -107,7 +107,7 @@ const populateQuery = async (issueID, timeStamp, jobID, catalogIndex, pathID, qu
       const {ruleID, what} = instance;
       // Add lines for it to the array.
       diagnoses.push({
-        toolID: which,
+        engineID: which,
         ruleID,
         what
       });
@@ -115,10 +115,12 @@ const populateQuery = async (issueID, timeStamp, jobID, catalogIndex, pathID, qu
   });
   // For each diagnosis:
   diagnoses.forEach(diagnosis => {
-    const {toolID, ruleID, what} = diagnosis;
+    const {engineID, ruleID, what} = diagnosis;
     // Add lines.
     lines.push(`${margin}<li>${htmlSafe(what)}`);
-    lines.push(`${margin}  <p>Tool: ${tools[toolID][0]} (${tools[toolID][1]})</p>`);
+    lines.push(
+      `${margin}  <p>Rule engine: ${ruleEngines[engineID][0]} (${ruleEngines[engineID][1]})</p>`
+    );
     if (ruleID !== what) {
       lines.push(`${margin}  <p>Rule: <code>${ruleID}</code></p>`);
     }

package/web/listIssues/index.js

@@ -9,14 +9,14 @@ const {
   getPageData,
   getPageDataStrings,
   getReport,
-  getToolList,
+  getEngineList,
   getWCAGLink,
   getWeightName,
   htmlSafe,
   isHidden,
   isValidReport,
   objectSort,
-  tools
+  ruleEngines
 } = require('../../util');
 const {issues: issueSpecs} = require('testaro-issues');
 const fs = require('fs/promises');
@@ -82,7 +82,7 @@ const getIssuesData = async (timeStamp, jobID) => {
                 reporterList: '',
                 violators: new Set()
               };
-              // Ensure the tool is in the temporary data.
+              // Ensure the rule engine is in the temporary data.
               temp.issues[issueID].reporters.add(which);
               temp.reporters.add(which);
               // If the instance has a catalog index:
@@ -97,7 +97,7 @@ const getIssuesData = async (timeStamp, jobID) => {
       }
     });
     // Finish populating the final data.
-    final.reporterList = getToolList(temp.reporters);
+    final.reporterList = getEngineList(temp.reporters);
     final.reporterCount = temp.reporters.size;
     final.violatorCount = temp.violators.size;
     Object.values(temp.issues).forEach(issue => {
@@ -109,7 +109,7 @@ const getIssuesData = async (timeStamp, jobID) => {
         why,
         weight
       };
-      finalIssue.reporterList = getToolList(issue.reporters);
+      finalIssue.reporterList = getEngineList(issue.reporters);
       finalIssue.reporterCount = issue.reporters.size;
       finalIssue.violatorCount = issue.violators.size;
       final.issues[issue.weight].push(finalIssue);
@@ -183,11 +183,11 @@ const populateQuery = async (timeStamp, jobID, query) => {
   // Initialize strings for the prevention notices query property.
   const preventionStrings = [];
   const margin = ' '.repeat(6);
-  Object.keys(preventions).forEach(preventedToolID => {
-    const toolName = tools[preventedToolID];
-    const toolNameString = `${toolName[0]} (${toolName[1]})`;
-    const causeString = htmlSafe(preventions[preventedToolID]);
-    const preventionString = `${margin}<li>Page not testable by ${toolNameString}: ${causeString}</li>`;
+  Object.keys(preventions).forEach(preventedEngineID => {
+    const engineName = ruleEngines[preventedEngineID];
+    const engineNameString = `${engineName[0]} (${engineName[1]})`;
+    const causeString = htmlSafe(preventions[preventedEngineID]);
+    const preventionString = `${margin}<li>Page not testable by ${engineNameString}: ${causeString}</li>`;
     preventionStrings.push(preventionString);
   });
   // Add prevention notices to the query.

package/web/listReports/index.js

@@ -90,8 +90,8 @@ const populateQuery = async query => {
     const {
       error,
       issueCount,
-      preventedToolCount,
-      preventedToolNames,
+      preventedEngineCount,
+      preventedEngineNames,
       reporterNames,
       reporterCount,
       violatorCount
@@ -117,11 +117,11 @@ const populateQuery = async query => {
     // Add facts about the report to the lines.
     lines.tested.push(`${margin}    <li>${testInfo}</li>`);
     // If the page prevented any rule engine from performing its tests:
-    if (preventedToolCount) {
+    if (preventedEngineCount) {
       // Add this to the lines.
-      const engineCountString = getCountString(preventedToolCount, 'rule engine', 'rule engines');
+      const engineCountString = getCountString(preventedEngineCount, 'rule engine', 'rule engines');
       lines.tested.push(
-        `${margin}    <li>Page not testable by ${engineCountString} (${preventedToolNames.join(' + ')})</li>`,
+        `${margin}    <li>Page not testable by ${engineCountString} (${preventedEngineNames.join(' + ')})</li>`,
       );
     }
     // Add facts about the test results to the lines.

package/web/listTopIssues/index.js

@@ -7,9 +7,9 @@
 
 const {sendAlert} = require('../../alerts');
 const {
+  getEngineNamesString,
   getLatestReportExtracts,
   getReport,
-  getToolNamesString,
   getWCAGLink,
   getWeightName,
   objectSort,
@@ -78,7 +78,7 @@ const getIssuesSummary = async () => {
         weight: issueSpecs[issueID].weight,
         count,
         percentage: 0,
-        reporters: getToolNamesString(reporters)
+        reporters: getEngineNamesString(reporters)
       });
     }
     // Otherwise, i.e. if it is no longer classified:

package/web/listViolators/index.js

@@ -9,7 +9,7 @@ const {
   getPageDataStrings,
   getPathID,
   getReport,
-  getToolNamesString,
+  getEngineNamesString,
   getTextFragmentHref,
   getWCAGLink,
   getWeightName,
@@ -92,7 +92,7 @@ const populateQuery = async (issueID, timeStamp, jobID, query) => {
         text: catalog[catalogIndex]?.text ?? '',
         reporters: new Set()
       };
-      // Ensure that the tool is in the sets of reporters of the violator and the issue.
+      // Ensure that the rule engine is in the sets of reporters of the violator and the issue.
       violators[catalogIndex].reporters.add(which);
       query.reporters.add(which);
     });
@@ -103,12 +103,12 @@ const populateQuery = async (issueID, timeStamp, jobID, query) => {
   // For each violator:
   Object.values(violators).forEach(violatorData => {
     // Convert the set of its reporters to a string.
-    violatorData.reporters = getToolNamesString(violatorData.reporters);
+    violatorData.reporters = getEngineNamesString(violatorData.reporters);
   });
   const reporterCount = query.reporters.size;
   query.reporterCount = reporterCount === 1 ? '1 rule engine' : `${reporterCount} rule engines`;
   // Convert the set of issue reporters to a string.
-  query.reporters = getToolNamesString(query.reporters);
+  query.reporters = getEngineNamesString(query.reporters);
   // Convert the violator data to an array.
   violators = Object.entries(violators).map(entry => ({
     catalogIndex: entry[0],

package/web/pruneReportsForm/index.js

@@ -55,7 +55,7 @@ exports.answer = async (_, search) => {
     const [timeStamp, jobID] = reportName.slice(0, -5).split('-');
     // Get a summary of it.
     const reportFacts = await getReportData(timeStamp, jobID);
-    const {error, issueCount, preventedToolCount, url} = reportFacts;
+    const {error, issueCount, preventedEngineCount, url} = reportFacts;
     // If this failed:
     if (error) {
       // Return why.
@@ -69,7 +69,7 @@ exports.answer = async (_, search) => {
       timeStamp,
       jobID,
       issueCount,
-      preventedToolCount,
+      preventedEngineCount,
       url
     });
   }
@@ -85,9 +85,9 @@ exports.answer = async (_, search) => {
   let anyDeletable = false;
   // For each summary:
   reportSpecs.forEach((spec, index) => {
-    const {timeStamp, jobID, issueCount, preventedToolCount, url} = spec;
+    const {timeStamp, jobID, issueCount, preventedEngineCount, url} = spec;
     const jobName = `${timeStamp}-${jobID}`;
-    const specString = `<code>${url}</code> (<code>${jobName}</code>): preventions ${preventedToolCount}, issues ${issueCount}`;
+    const specString = `<code>${url}</code> (<code>${jobName}</code>): preventions ${preventedEngineCount}, issues ${issueCount}`;
     // If its report is a non-latest report:
     if (reportSpecs[index + 1]?.url === url) {
       // Add a line with a deletion checkbox.

package/web/reannotateForm/index.js

@@ -62,27 +62,27 @@ const populateQuery = async query => {
   const stillUnclassifiedLines = [];
   const reClassifiedLines = [];
   const margin = ' '.repeat(6);
-  // For each tool reporting any violations of still unclassified rules:
-  Object.keys(stillUnclassified).forEach(toolID => {
+  // For each rule engine reporting any violations of still unclassified rules:
+  Object.keys(stillUnclassified).forEach(engineID => {
     // For each such rule:
-    Object.keys(stillUnclassified[toolID]).forEach(ruleID => {
-      const reportIDs = Array.from(stillUnclassified[toolID][ruleID]);
+    Object.keys(stillUnclassified[engineID]).forEach(ruleID => {
+      const reportIDs = Array.from(stillUnclassified[engineID][ruleID]);
       // Add a line to the lines on the rule.
       stillUnclassifiedLines.push(
-        `${margin}<li>${toolID}: ${ruleID} (${reportIDs.join(', ')})</li>`
+        `${margin}<li>${engineID}: ${ruleID} (${reportIDs.join(', ')})</li>`
       );
     });
   });
   // Add the lines to the query.
   query.stillUnclassified = stillUnclassifiedLines.join('\n');
-  // For each tool reporting any discrepancies in rule classification:
-  Object.keys(reClassified).forEach(toolID => {
+  // For each rule engine reporting any discrepancies in rule classification:
+  Object.keys(reClassified).forEach(engineID => {
     // For each such rule:
-    Object.keys(reClassified[toolID]).forEach(ruleID => {
-      const reportIDs = Array.from(reClassified[toolID][ruleID]);
+    Object.keys(reClassified[engineID]).forEach(ruleID => {
+      const reportIDs = Array.from(reClassified[engineID][ruleID]);
       // Add a line to the lines on the rule.
       reClassifiedLines.push(
-        `${margin}<li>${toolID}: ${ruleID} (${reportIDs.join(', ')})</li>`
+        `${margin}<li>${engineID}: ${ruleID} (${reportIDs.join(', ')})</li>`
       );
     });
   });

package/web/rewindReportsForm/index.js

@@ -52,7 +52,7 @@ exports.answer = async (_, search) => {
     const [timeStamp, jobID] = reportName.slice(0, -5).split('-');
     // Get a summary of it.
     const reportFacts = await getReportData(timeStamp, jobID);
-    const {error, issueCount, preventedToolCount, url} = reportFacts;
+    const {error, issueCount, preventedEngineCount, url} = reportFacts;
     // If this failed:
     if (error) {
       // Return why.
@@ -65,7 +65,7 @@ exports.answer = async (_, search) => {
       timeStamp,
       jobID,
       issueCount,
-      preventedToolCount,
+      preventedEngineCount,
       url
     });
   }
@@ -81,9 +81,9 @@ exports.answer = async (_, search) => {
   let anyDeletable = false;
   // For each summary:
   reportSpecs.forEach((spec, index) => {
-    const {timeStamp, jobID, issueCount, preventedToolCount, url} = spec;
+    const {timeStamp, jobID, issueCount, preventedEngineCount, url} = spec;
     const jobName = `${timeStamp}-${jobID}`;
-    const specString = `<code>${url}</code> (<code>${jobName}</code>): preventions ${preventedToolCount}, issues ${issueCount}`;
+    const specString = `<code>${url}</code> (<code>${jobName}</code>): preventions ${preventedEngineCount}, issues ${issueCount}`;
     // If its report is the latest report on a target with at least 2 reports:
     if (reportSpecs[index - 1]?.url === url && reportSpecs[index + 1]?.url !== url) {
       // Add a line with a deletion checkbox.

package/web/tutorial/index.html

@@ -419,7 +419,7 @@
               <p>In this practicum, which rule engines discovered both <code>autocomplete</code> defects?</p>
               <ol>
                 <li><label><input type="radio" name="q4" value="a"> All 10 rule engines</label></li>
-                <li><label><input type="radio" name="q4" value="b"> Six of the rule engines></li>
+                <li><label><input type="radio" name="q4" value="b"> Six of the rule engines</label></li>
                 <li><label><input type="radio" name="q4" value="c"> Only Testaro and HTML CodeSniffer</label></li>
                 <li><label><input type="radio" name="q4" value="d"> None of the rule engines</label></li>
               </ol>