testilo 3.12.3 → 3.13.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/package.json +1 -1
- package/procs/digest/dp16a/index.html +1 -1
- package/procs/digest/dp18a/index.html +80 -0
- package/procs/digest/dp18a/index.js +129 -0
- package/procs/score/sp16b.js +1 -1
- package/procs/score/sp18a.js +6378 -0
package/package.json
CHANGED
|
@@ -42,7 +42,7 @@
|
|
|
42
42
|
</ul>
|
|
43
43
|
<p>Testaro produced a report enumerating the test results.</p>
|
|
44
44
|
<p><a href="https://www.npmjs.com/package/testilo">Testilo</a> processed the report and used the <code>sp16a</code> scoring procedure to compute partial and total scores for the page. The total score is __totalScore__ (where 0 is the best possible score). The scored report is appended below.</p>
|
|
45
|
-
<p>Finally, Testilo used procedure <code>dp16a</code> to produce this digest, briefly explaining how <code>
|
|
45
|
+
<p>Finally, Testilo used procedure <code>dp16a</code> to produce this digest, briefly explaining how <code>sp16a</code> computed the scores.</p>
|
|
46
46
|
<h2>Score summary</h2>
|
|
47
47
|
<table class="allBorder secondCellRight">
|
|
48
48
|
<caption>Score components</caption>
|
|
@@ -0,0 +1,80 @@
|
|
|
1
|
+
<!DOCTYPE HTML>
|
|
2
|
+
<html lang="en-US">
|
|
3
|
+
<head>
|
|
4
|
+
<meta charset="UTF-8">
|
|
5
|
+
<meta name="viewport" content="width=device-width, initial-scale=1">
|
|
6
|
+
<meta name="author" content="Testilo">
|
|
7
|
+
<meta name="creator" content="Testilo">
|
|
8
|
+
<meta name="publisher" name="Testilo">
|
|
9
|
+
<meta name="description" content="report of accessibility testing of a web page">
|
|
10
|
+
<meta name="keywords" content="accessibility a11y web testing">
|
|
11
|
+
<title>Accessibility test digest</title>
|
|
12
|
+
<link rel="icon" href="favicon.png">
|
|
13
|
+
<link rel="stylesheet" href="style.css">
|
|
14
|
+
</head>
|
|
15
|
+
<body>
|
|
16
|
+
<main>
|
|
17
|
+
<header>
|
|
18
|
+
<h1>Accessibility test digest</h1>
|
|
19
|
+
<h2>Synopsis</h2>
|
|
20
|
+
<div id="synopsis">
|
|
21
|
+
<p><strong>Page</strong>: __org__</p>
|
|
22
|
+
<p><strong>URL</strong>: __url__</p>
|
|
23
|
+
<p><strong>Score</strong>: __totalScore__</p>
|
|
24
|
+
<p><strong>Tested by</strong>: Testaro, procedure <code>__tp__</code></p>
|
|
25
|
+
<p><strong>Scored by</strong>: Testilo, procedure <code>__sp__</code></p>
|
|
26
|
+
<p><strong>Digested by</strong>: Testilo, procedure <code>__dp__</code></p>
|
|
27
|
+
</div>
|
|
28
|
+
</header>
|
|
29
|
+
<h2>Introduction</h2>
|
|
30
|
+
<p>The <a href="https://www.npmjs.com/package/testaro">Testaro</a> application used its <code>__tp__</code> testing procedure to test the <a href="https://www.w3.org/WAI/fundamentals/accessibility-intro/"><dfn>accessibility</dfn></a> (barrier-free design and coding) of the __org__ web page at <a href="__url__">__url__</a> on __dateSlash__. The procedure performed 1230 tests. Of these, 24 are custom tests or <q>quasi-tests</q> by Testaro, and the others belong to these eight other packages (programs that perform collections of tests):</p>
|
|
31
|
+
<ul>
|
|
32
|
+
<li><a href="https://github.com/Siteimprove/alfa">Alfa</a> by Siteimprove</li>
|
|
33
|
+
<li><a href="https://www.npmjs.com/package/axe-core">Axe-core</a> by Deque</li>
|
|
34
|
+
<li><a href="https://www.webaccessibility.com/tools/">Continuum</a> by Level Access</li>
|
|
35
|
+
<li>
|
|
36
|
+
<a href="https://www.npmjs.com/package/html_codesniffer">HTML CodeSniffer</a> by Squiz Labs
|
|
37
|
+
</li>
|
|
38
|
+
<li><a href="https://github.com/IBMa/equal-access">Equal Access</a> by IBM</li>
|
|
39
|
+
<li><a href="https://github.com/validator/validator">Nu Html Checker</a></li>
|
|
40
|
+
<li><a href="https://tenon.io/documentation/apiv2.php">Tenon</a> by Level Access</li>
|
|
41
|
+
<li><a href="https://wave.webaim.org/api/">WAVE</a> by WebAIM</li>
|
|
42
|
+
</ul>
|
|
43
|
+
<p>Testaro produced a report enumerating the test results.</p>
|
|
44
|
+
<p><a href="https://www.npmjs.com/package/testilo">Testilo</a> processed the report and used the <code>__sp__</code> scoring procedure to compute partial and total scores for the page. The total score is __totalScore__ (where 0 is the best possible score). The scored report is appended below.</p>
|
|
45
|
+
<p>Finally, Testilo used procedure <code>__dp__</code> to produce this digest, briefly explaining how <code>__sp__</code> computed the scores.</p>
|
|
46
|
+
<h2>Score summary</h2>
|
|
47
|
+
<table class="allBorder secondCellRight">
|
|
48
|
+
<caption>Score components</caption>
|
|
49
|
+
<tbody class="headersLeft">
|
|
50
|
+
__scoreRows__
|
|
51
|
+
</tbody>
|
|
52
|
+
</table>
|
|
53
|
+
<h2>Issue summary</h2>
|
|
54
|
+
<h3>Special issues</h3>
|
|
55
|
+
__specialSummary__
|
|
56
|
+
<h3>Classified issues</h3>
|
|
57
|
+
__groupSummary__
|
|
58
|
+
<h2>Discussion</h2>
|
|
59
|
+
<p>Although there are widely accepted <a href="https://www.w3.org/WAI/standards-guidelines/">accessibility standards</a>, there is no unanimity about how to define, test, and quantify accessibility. The failures reported in this digest merit investigation as potential opportunities for improved accessibility. Investigation may lead you to conclude that some of the reported failures do not actually harm accessibility. Conversely, some substantial accessibility faults can escape detection by any of these tests. You may question the attempt to assign an accessibility score to a web page, or you may prefer weightings and formulas different from those used by <code>__sp__</code>. You can modify and extend Testaro and Testilo to fit other theories and priorities.</p>
|
|
60
|
+
<p>Here, in brief, is how <code>__sp__</code> computes a score for a page.</p>
|
|
61
|
+
<ul>
|
|
62
|
+
<li>It finds all the defects and warnings (let’s call them <q>issues</q>) recorded in the report.</li>
|
|
63
|
+
<li>It classifies them according to type. For example, a link that looks like the text around it is one issue category, while a video that has no captions is another issue category.</li>
|
|
64
|
+
<li>It also classifies the issues according to severity. For example, an issue that prevents a transaction is more severe than an issue that only complicates the transaction, and a warning about a possible issue is less severe than a definite finding of an issue. (Some packages rate the severity of each issue; for the other packages, <code>sp15c</code> assigns a severity weight to the issue type and uses that weight.)</li>
|
|
65
|
+
<li>It assigns quality ratings to particular tests that are judged abnormally reliable or unreliable.</li>
|
|
66
|
+
<li>It assigns a score to each issue reported by each test of each package.</li>
|
|
67
|
+
<li>It aggregates the issue scores, weighting them by severity, test quality, and redundancy. Redundancy occurs, and causes downweighting, when two or more packages contain tests that are designed to discover the same or mostly the same issues. So the score for a category is not simply the sum of the scores of the tests in that category.</li>
|
|
68
|
+
<li>It assigns a score for issues in the page logged by the browser.</li>
|
|
69
|
+
<li>It assigns an estimated score each time the page prevents one of the packages or one of the Testaro tests from being run on the page.</li>
|
|
70
|
+
<li>It adds the scores together to obtain a total score.</li>
|
|
71
|
+
</ul>
|
|
72
|
+
<p>The precise rules of <code>__sp__</code> are found in the <a href="https://github.com/jrpool/testilo/blob/main/procs/score/__sp__.js">code itself</a>.</p>
|
|
73
|
+
<h2>Report</h2>
|
|
74
|
+
<pre>__report__</pre>
|
|
75
|
+
<footer>
|
|
76
|
+
<p class="date">Produced <time itemprop="datePublished" datetime="__dateISO__">__dateSlash__</time></p>
|
|
77
|
+
</footer>
|
|
78
|
+
</main>
|
|
79
|
+
</body>
|
|
80
|
+
</html>
|
|
@@ -0,0 +1,129 @@
|
|
|
1
|
+
/*
|
|
2
|
+
index: digester for scoring procedure sp18a.
|
|
3
|
+
Creator of parameters for substitution into index.html.
|
|
4
|
+
Usage example for selected files in REPORTDIR_SCORED: node digest dp18a 35k1r
|
|
5
|
+
Usage example for all files in REPORTDIR_SCORED: node digest dp18a
|
|
6
|
+
*/
|
|
7
|
+
|
|
8
|
+
// CONSTANTS
|
|
9
|
+
|
|
10
|
+
// Newlines with indentations.
|
|
11
|
+
const joiner = '\n ';
|
|
12
|
+
const innerJoiner = '\n ';
|
|
13
|
+
const specialMessages = {
|
|
14
|
+
log: 'This is based on the amount of browser error logging and miscellaneous logging during the tests.',
|
|
15
|
+
preventions: 'This is based on tests that the page did not allow to be run. That impedes accessibility progress and risks interfering with tools that users with disabilities need.',
|
|
16
|
+
solos: 'This is based on issues reported by unclassified tests. Details are in the report.'
|
|
17
|
+
};
|
|
18
|
+
|
|
19
|
+
// FUNCTIONS
|
|
20
|
+
|
|
21
|
+
// Makes strings HTML-safe.
|
|
22
|
+
const htmlEscape = textOrNumber => textOrNumber
|
|
23
|
+
.toString()
|
|
24
|
+
.replace(/&/g, '&')
|
|
25
|
+
.replace(/</g, '<');
|
|
26
|
+
// Gets a row of the score-summary table.
|
|
27
|
+
const getScoreRow = (component, score) => `<tr><th>${component}</th><td>${score}</td></tr>`;
|
|
28
|
+
// Gets the start of a paragraph about a special score.
|
|
29
|
+
const getSpecialPStart = (summary, scoreID) =>
|
|
30
|
+
`<p><span class="componentID">${scoreID}</span>: Score ${summary[scoreID]}.`;
|
|
31
|
+
// Adds parameters to a query for a digest.
|
|
32
|
+
exports.makeQuery = (report, query) => {
|
|
33
|
+
// Add an HTML-safe copy of the host report to the query to be appended to the digest.
|
|
34
|
+
const {script, host, score} = report;
|
|
35
|
+
const reportJSON = JSON.stringify(report, null, 2);
|
|
36
|
+
const reportJSONSafe = htmlEscape(reportJSON);
|
|
37
|
+
query.report = reportJSONSafe;
|
|
38
|
+
query.tp = 'tp18';
|
|
39
|
+
query.sp = 'sp18a';
|
|
40
|
+
query.dp = 'dp18a';
|
|
41
|
+
// Add the job data to the query.
|
|
42
|
+
query.dateISO = report.endTime.slice(0, 10);
|
|
43
|
+
query.dateSlash = query.dateISO.replace(/-/g, '/');
|
|
44
|
+
if (host && host.what && host.which) {
|
|
45
|
+
query.org = host.what;
|
|
46
|
+
query.url = host.which;
|
|
47
|
+
}
|
|
48
|
+
else {
|
|
49
|
+
const firstURLCommand = script.commands.find(command => command.type === 'url');
|
|
50
|
+
if (firstURLCommand && firstURLCommand.what && firstURLCommand.which) {
|
|
51
|
+
query.org = firstURLCommand.what;
|
|
52
|
+
query.url = firstURLCommand.which;
|
|
53
|
+
}
|
|
54
|
+
else {
|
|
55
|
+
console.log('ERROR: host missing or invalid');
|
|
56
|
+
return;
|
|
57
|
+
}
|
|
58
|
+
}
|
|
59
|
+
const {groupDetails, summary} = score;
|
|
60
|
+
const {total, groups} = summary;
|
|
61
|
+
if (typeof total === 'number') {
|
|
62
|
+
query.totalScore = total;
|
|
63
|
+
}
|
|
64
|
+
else {
|
|
65
|
+
console.log('ERROR: missing or invalid total score');
|
|
66
|
+
return;
|
|
67
|
+
}
|
|
68
|
+
// Add the total and any special rows of the score-summary table to the query.
|
|
69
|
+
const scoreRows = [];
|
|
70
|
+
const specialComponentIDs = ['log', 'preventions', 'solos'];
|
|
71
|
+
['total'].concat(specialComponentIDs).forEach(item => {
|
|
72
|
+
if (summary[item]) {
|
|
73
|
+
scoreRows.push(getScoreRow(item, summary[item]));
|
|
74
|
+
}
|
|
75
|
+
});
|
|
76
|
+
// Add the group rows of the score-summary table to the query.
|
|
77
|
+
groups.forEach(group => {
|
|
78
|
+
scoreRows.push(getScoreRow(`${group.groupName}`, group.score));
|
|
79
|
+
});
|
|
80
|
+
query.scoreRows = scoreRows.join(innerJoiner);
|
|
81
|
+
// If the score has any special components:
|
|
82
|
+
const scoredSpecialIDs = specialComponentIDs.filter(item => summary[item]);
|
|
83
|
+
if (scoredSpecialIDs.length) {
|
|
84
|
+
// Add paragraphs about them for the issue summary to the query.
|
|
85
|
+
const specialPs = [];
|
|
86
|
+
scoredSpecialIDs.forEach(id => {
|
|
87
|
+
specialPs.push(`${getSpecialPStart(summary, id)} ${specialMessages[id]}`);
|
|
88
|
+
});
|
|
89
|
+
query.specialSummary = specialPs.join(joiner);
|
|
90
|
+
}
|
|
91
|
+
// Otherwise, i.e. if the score has no special components:
|
|
92
|
+
else {
|
|
93
|
+
// Add a paragraph stating this for the issue summary to the query.
|
|
94
|
+
query.specialSummary = '<p>No special issues contributed to the score.</p>'
|
|
95
|
+
}
|
|
96
|
+
// If the score has any classified issues as components:
|
|
97
|
+
if (groups.length) {
|
|
98
|
+
// Add paragraphs about them for the special summary to the query.
|
|
99
|
+
const groupSummaryItems = [];
|
|
100
|
+
groups.forEach(group => {
|
|
101
|
+
const {groupName, score} = group;
|
|
102
|
+
const groupP = `<p><span class="componentID">${groupName}</span>: Score ${score}. Issues reported by tests in this category:</p>`;
|
|
103
|
+
const groupListItems = [];
|
|
104
|
+
const groupData = groupDetails.groups[groupName];
|
|
105
|
+
const packageIDs = Object.keys(groupData);
|
|
106
|
+
packageIDs.forEach(packageID => {
|
|
107
|
+
const testIDs = Object.keys(groupData[packageID]);
|
|
108
|
+
testIDs.forEach(testID => {
|
|
109
|
+
const testData = groupData[packageID][testID];
|
|
110
|
+
const {score, what} = testData;
|
|
111
|
+
const listItem = `<li>Package <code>${packageID}</code>, test <code>${testID}</code>, score ${score} (${what})</li>`;
|
|
112
|
+
groupListItems.push(listItem);
|
|
113
|
+
});
|
|
114
|
+
});
|
|
115
|
+
const groupList = [
|
|
116
|
+
'<ul>',
|
|
117
|
+
groupListItems.join('\n '),
|
|
118
|
+
'</ul>'
|
|
119
|
+
].join(joiner);
|
|
120
|
+
groupSummaryItems.push(groupP, groupList);
|
|
121
|
+
});
|
|
122
|
+
query.groupSummary = groupSummaryItems.join(joiner);
|
|
123
|
+
}
|
|
124
|
+
// Otherwise, i.e. if the score has no classified issues as components:
|
|
125
|
+
else {
|
|
126
|
+
// Add a paragraph stating this for the group summary to the query.
|
|
127
|
+
query.groupSummary = '<p>No classified issues contributed to the score.</p>'
|
|
128
|
+
}
|
|
129
|
+
};
|
package/procs/score/sp16b.js
CHANGED