@jrpool/kilotest 59.1.0 → 59.1.1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/README.md CHANGED
@@ -10,7 +10,7 @@ An ensemble testing and reporting service for front-end web quality
10
10
 
11
11
  ## Features
12
12
 
13
- This application uses an ensemble of 12 rule engines to test web pages for front-end quality (i.e. accessibility, usability, and web standards).
13
+ This application uses an ensemble of 12 rule engines to test web pages for front-end quality (i.e. accessibility, usability, and web standards, including HTML, CSS, ARIA, and WCAG (HTML, CSS, ARIA, WCAG)).
14
14
 
15
15
  The testing paradigm employed by Kilotest is discussed in these papers:
16
16
 
@@ -18,11 +18,11 @@ The testing paradigm employed by Kilotest is discussed in these papers:
18
18
  - [Testaro: Efficient Ensemble Testing for Web Accessibility](https://arxiv.org/abs/2309.10167)
19
19
  - [Accessibility Metatesting: Comparing Nine Testing Tools](https://arxiv.org/abs/2304.07591)
20
20
 
21
- Kilotest acts as a web server for human users, an MCP server for AI platforms, and an API for programmatic access.
21
+ Kilotest acts as a web server for human users, an MCP server (streamable HTTP, no authentication) for AI platforms, and an API for programmatic access.
22
22
 
23
23
  Testing for Kilotest is performed by one or more workers (testing agents) that obtain jobs from Kilotest, perform them, and send reports of the results back to Kilotest. Those agents are instances of the [Testaro](https://www.npmjs.com/package/testaro) package. Thus, the pages that Kilotest tests need not be on the public Internet. They need only be reachable by the Testaro workers that do the testing for Kilotest. So, one or more Testaro workers running inside a private intranet can test internal pages, as well as any external ones reachable from inside the intranet.
24
24
 
25
- An active production instance of Kilotest may require multiple Testaro workers to handle the load, because testing one web page typically takes about 3 minutes and workers test only one page at a time.
25
+ An active production instance of Kilotest may require multiple Testaro workers to handle the load, because testing one web page typically takes 2 to 4 minutes and workers test only one page at a time.
26
26
 
27
27
  ## Getting started locally with 1 worker
28
28
 
package/api/util.ts CHANGED
@@ -51,7 +51,7 @@ export const getResponseMetadata = () => ({
51
51
  export const getToolsFacts = () => ({
52
52
  'name': 'Kilotest',
53
53
  'description': {
54
- 'what Kilotest does': 'Kilotest tools generate and make available findings about the front-end quality (i.e. accessibility, usability, and web standards) of web pages. A Kilotest job generates findings by using Testaro to test a page against about 1300 rules defined by an ensemble of twelve rule engines. Testaro produces a report of the job. The report describes violations of the rules. Kilotest uses Testilo to enhance the report with a classification of the rule violations into about 380 issues. Kilotest makes facts about the tested pages, the issues, and the violations retrievable at four levels of granularity.',
54
+ 'what Kilotest does': 'Kilotest tools generate and make available findings about the front-end quality (i.e. accessibility, usability, and web standards, including HTML, CSS, ARIA, and WCAG) of web pages. A Kilotest job generates findings by using Testaro to test a page against about 1300 rules defined by an ensemble of twelve rule engines. Testaro produces a report of the job. The report describes violations of the rules. Kilotest uses Testilo to enhance the report with a classification of the rule violations into about 380 issues. Kilotest makes facts about the tested pages, the issues, and the violations retrievable at four levels of granularity.',
55
55
  'how to retrieve findings': {
56
56
  'level 1': 'Use the listPages tool to get a list of tested pages, each with its latest report. The listIssues output about any report lists all reports about the same page.',
57
57
  'level 2': 'Use the listIssues tool to get a list of issues in one report.',
package/capability.md CHANGED
@@ -2,7 +2,7 @@
2
2
 
3
3
  ## Capability
4
4
 
5
- Web-page front-end quality audit. Kilotest tests web pages for front-end quality, namely accessibility, usability, and web standards, and makes structured findings available for retrieval.
5
+ Web-page front-end quality audit. Kilotest tests web pages for front-end quality, namely accessibility, usability, and web standards, including HTML, CSS, ARIA, and WCAG, and makes structured findings available for retrieval.
6
6
 
7
7
  ## Purpose
8
8
 
package/docs/AI-TOOLS.md CHANGED
@@ -4,7 +4,7 @@
4
4
 
5
5
  Until 2026 Kilotest was intended, and implemented, as a web application performing a service for human users.
6
6
 
7
- Beginning in May 2026, it [became evident](https://github.com/jrpool/kilotest/issues/2) that Kilotest could operate as a set of tools for language models to allow them to improve their answers to questions about the front-end quality (accessibility, usability, and web standards) of specific web pages.
7
+ Beginning in May 2026, it [became evident](https://github.com/jrpool/kilotest/issues/2) that Kilotest could operate as a set of tools for language models to allow them to improve their answers to questions about the front-end quality (accessibility, usability, and web standards, including HTML, CSS, ARIA, and WCAG) of specific web pages.
8
8
 
9
9
  A decision was made to **make Kilotest discoverable, usable, and, where appropriate, used as a provider of tools for language models**.
10
10
 
@@ -42,7 +42,7 @@ The external features that support the use of Kilotest as a collection of AI too
42
42
  - A [pull request](https://github.com/public-apis/public-apis/pull/6346/changes) to add Kilotest to the list of public APIs in the `public-apis` repository.
43
43
  - An [issue](https://github.com/APIs-guru/openapi-directory/issues/2677) to add Kilotest to `openapi-directory`.
44
44
  - A [pull request](https://github.com/w3c/wai-evaluation-tools-list/pull/1153) to add Kilotest to the WAI evaluation tools list.
45
- - Registration of Kilotest as an active server in the [official MCP Registry](https://registry.modelcontextprotocol.io) (`io.github.jrpool/kilotest`), maintained by the [Model Context Protocol](https://modelcontextprotocol.io/) project. The [PulseMCP](https://www.pulsemcp.com/servers) directory and the VS Code MCP gallery both crawl this registry, so Kilotest is discoverable through them with no separate submission.
45
+ - Registration of Kilotest as an active server in the [official MCP Registry](https://registry.modelcontextprotocol.io/v0.1/servers?search=io.github.jrpool/kilotest), maintained by the [Model Context Protocol](https://modelcontextprotocol.io/) project. The [PulseMCP](https://www.pulsemcp.com/servers) directory and the VS Code MCP gallery both crawl this registry, so Kilotest is discoverable through them with no separate submission.
46
46
  - Registration of Kilotest with the [Smithery](https://smithery.ai/servers/pool/kilotest) MCP server registry.
47
47
  - Registration of Kilotest with the [Glama](https://glama.ai/mcp/connectors/com.kilotest/kilotest) MCP server registry, including a claim of ownership of the MCP connector by the maintainer via a `TXT` DNS record for `_glama-claim.kilotest.com`, with the value `glama_claim_gVV4HrPdcXr9TEfj1p3icEUBJ3_OVJGX`.
48
48
  - Registration of Kilotest with [Awesome MCP Servers](https://www.tensorblock.co/mcp/servers/github-jrpool-kilotest-f518ba36).
package/docs/BACKLOG.md CHANGED
@@ -279,7 +279,7 @@ Update your package.json to feature dense, functional keywords:
279
279
 
280
280
  `{`
281
281
  `"name": "kilotest",`
282
- `"description": "Model Context Protocol (MCP) server for Kilotest ensemble web testing. Runs over 1,300 front-end tests across multiple rule engines covering WCAG accessibility, usability, performance, and web standards.",`
282
+ `"description": "Model Context Protocol (MCP) server for Kilotest ensemble web testing. Runs over 1,300 front-end tests across multiple rule engines covering WCAG accessibility, usability, performance, and web standards, including HTML, CSS, ARIA, and WCAG.",`
283
283
  `"keywords": [`
284
284
  `"mcp",`
285
285
  `"model-context-protocol",`
package/lhm.plugin.json CHANGED
@@ -1,7 +1,7 @@
1
1
  {
2
2
  "author": "Jonathan Robert Pool",
3
3
  "cloudEndpoint": "https://kilotest.com/mcp",
4
- "description": "Tools that test web pages for front-end quality (accessibility, usability, and web standards) and make test results available",
4
+ "description": "Tools that test web pages for front-end quality (accessibility, usability, and web standards, including HTML, CSS, ARIA, and WCAG) and make test results available",
5
5
  "homepage": "https://github.com/jrpool/kilotest",
6
6
  "identifier": "jrpool-kilotest",
7
7
  "name": "Kilotest",
@@ -18,7 +18,7 @@
18
18
  "tools": [
19
19
  {
20
20
  "name": "getKilotestOverview",
21
- "description": "Explains what Kilotest is, what its tools do, and how its results are structured. Use this before any other tool when the available tools or workflow are unclear. Returns a prose overview of the Kilotest domain, the tool workflow, and links to further documentation. Kilotest integrates an ensemble of 12 rule engines, with about 1,300 rules, to test web pages for front-end quality (accessibility, usability, and web standards). Each test session generates a standardized report describing which elements violated which rules and grouping the violations into about 380 issues. Kilotest can list the tested pages, the reports about each page, the issues in each report, the violators of each issue, and the diagnoses of each violation. Kilotest also accepts requests to test pages not yet tested and to retest already tested pages.",
21
+ "description": "Explains what Kilotest is, what its tools do, and how its results are structured. Use this before any other tool when the available tools or workflow are unclear. Returns a prose overview of the Kilotest domain, the tool workflow, and links to further documentation. Kilotest integrates an ensemble of 12 rule engines, with about 1,300 rules, to test web pages for front-end quality (accessibility, usability, and web standards, including HTML, CSS, ARIA, and WCAG). Each test session generates a standardized report describing which elements violated which rules and grouping the violations into about 380 issues. Kilotest can list the tested pages, the reports about each page, the issues in each report, the violators of each issue, and the diagnoses of each violation. Kilotest also accepts requests to test pages not yet tested and to retest already tested pages.",
22
22
  "inputSchema": {
23
23
  "type": "object",
24
24
  "properties": {},
package/llms-full.txt CHANGED
@@ -2,7 +2,7 @@
2
2
 
3
3
  ## What Kilotest is
4
4
 
5
- Kilotest is an application that performs ensemble testing of web pages for front-end quality (i.e. accessibility, usability, and standard conformance) and reports the test results.
5
+ Kilotest is an application that performs ensemble testing of web pages for front-end quality (i.e. accessibility, usability, and web standards, including HTML, CSS, ARIA, and WCAG) and reports the test results.
6
6
 
7
7
  ## What Kilotest does for language models
8
8
 
@@ -14,18 +14,12 @@ Without calling any tool, an LLM can, under some conditions, load web pages and
14
14
  - fragmentary, because of capability limitations, such as inability to run browsers and interact with web pages
15
15
  - inaccurate, because of the tendency to replace missing information with hallucinations
16
16
 
17
- To provide a more inexpensive, thorough, and accurate assessment, the agent could, in principle, ask an ensemble of specialized rule engines to test the page. However, selecting and running such rule engines and consolidating their results is itself expensive and difficult, and most available rule engines are not callable as MCP tools. Kilotest assumes responsibility for assembling, integrating, and running several rule engines. Kilotest:
18
-
19
- - defines an MCP tool that tests web pages for front-end quality
20
- - defines MCP tools that report the test results
21
- - defines connectors to those tools, compatible with major AI platforms
22
-
23
- The tool that tests web pages for front-end quality has attributes that no other such tool has. It:
17
+ To provide a more inexpensive, thorough, and accurate assessment, the agent could, in principle, ask an ensemble of specialized rule engines to test the page. However, selecting and running such rule engines and consolidating their results is itself expensive and difficult, and most available rule engines are not callable as MCP tools. Kilotest fills the gap between an LLM and rule engines. Kilotest:
24
18
 
25
19
  - selects an ensemble of 12 rule engines that implement tests for, in total, more than a thousand rules for front-end quality
26
20
  - runs the tests of the rule engines
27
21
  - combines the reports of the rule engines into a single integrated report
28
- - consolidates the 1000+ rules having 12 different naming systems into 300+ “issues” with a uniform naming system
22
+ - consolidates the rules into about 380 “issues” with a uniform naming system
29
23
 
30
24
  The tools that report test results extract from reports statistics and details at various levels of granularity, as required by an agent to fulfill particular user requests.
31
25
 
@@ -46,11 +40,13 @@ The rule engines in the Kilotest ensemble take responsibility for determining wh
46
40
 
47
41
  ## Kilotest versus other MCP servers
48
42
 
49
- In the marketplace for MCP servers that test for front-end quality, all servers other than that of Kilotest leverage at most 1 rule engine, most often `axe-core`. The Kilotest testing tool leverages `axe-core` plus 11 other rule engines. This has these main effects:
43
+ In the marketplace for MCP servers that test for front-end quality, all servers other than that of Kilotest leverage at most 3 rule engines, most often only `axe-core`. Most other MCP servers also require authentication. Kilotest leverages `axe-core` plus 11 other rule engines, and it does not require authentication.
44
+
45
+ For web pages that have not yet been tested, a single-rule-engine MCP can provide faster results than Kilotest. A tool running only the `axe-core` tests can complete its work in about 5 seconds. The testing tool of Kilotest usually completes its work in 2 to 4 minutes, because all 12 rule engines are run, and some of the tests involve navigation and interaction with the page and LLM inference.
46
+
47
+ For web pages about which reports are already available, Kilotest can provide faster results than a single-rule-engine MCP server, because Kilotest stores test results for subsequent retrieval. A retrieval from a Kilotest reporting tool can be completed in less than 2 seconds.
50
48
 
51
- - For web pages that have not yet been tested, a single-rule-engine MCP can provide faster results than Kilotest. A tool running only the `axe-core` tests can complete its work in about 5 seconds or less. The testing tool of Kilotest usually completes its work in 2 to 3 minutes, because all 12 rule engines are run, and some of the tests involve navigation and interaction with the page and LLM inference. Moreover, Kilotest currently allows users (both humans and models) to **recommend** new pages for testing but authorizes only Kilotest managers to make the tool proceed with the testing. The wait for manager action can take up to a day. A feature permitting immediate testing ordered by AI agents is planned, but, until it is implemented, Kilotest will be useful for not-yet-tested pages only in long-running (multi-day) workflows.
52
- - For web pages about which reports are already available, Kilotest can provide faster results than a single-rule-engine MCP server, because Kilotest stores test results for subsequent retrieval. A retrieval from a Kilotest reporting tool can be completed in less than 2 seconds.
53
- - Kilotest results are more comprehensive than single-rule-engine MCP server results. Every rule engine provides limited coverage of front-end quality, so false negatives (missed defects) are more common with single-rule-engine MCP servers. This difference [has been documented in research](https://arxiv.org/pdf/2304.07591).
49
+ Kilotest results are more comprehensive than single-rule-engine MCP server results. Every rule engine provides limited coverage of front-end quality, so false negatives (missed defects) are more common with single-rule-engine MCP servers. This difference [has been documented in research](https://arxiv.org/pdf/2304.07591).
54
50
 
55
51
  ## How to use Kilotest
56
52
 
@@ -63,12 +59,12 @@ Kilotest offers a comprehensive suite of capabilities to users via its web UI:
63
59
  - Get statistics about issues reported in one report, and a history of all reports about the same page: `https://kilotest.com/listIssues.html/{timeStamp}/{jobID}`
64
60
  - Get details about one issue reported in one report: `https://kilotest.com/listViolators.html/{issueID}/{timeStamp}/{jobID}`
65
61
  - Get diagnoses by rule engines of rule violations for one HTML element exhibiting one issue in one report: `https://kilotest.com/listDiagnoses.html/{issueID}/{timeStamp}/{jobID}/{catalogIndex}`
66
- - [Recommend the testing of a not-yet-tested page](https://kilotest.com/requestNewTestForm.html)
67
- - Recommend the retesting of a previously tested page: `https://kilotest.com/requestRetestForm.html/{timeStamp}/{jobID}`
62
+ - [Request the testing of a not-yet-tested page](https://kilotest.com/requestNewTestForm.html)
63
+ - Request the retesting of a previously tested page: `https://kilotest.com/requestRetestForm.html/{timeStamp}/{jobID}`
68
64
  - [Get statistics about frequently reported issues across all pages](https://kilotest.com/listTopIssues.html)
69
65
  - [Get a list of the operations that Kilotest managers are authorized to request](https://kilotest.com/manage.html)
70
- - [Tutorial, “Accessibility testing strategies”](https://kilotest.com/tutorial.html)
71
- - [Tutorial, “QAI tutorial”](https://kilotest.com/qai/)
66
+ - [Tutorial, “Accessibility testing strategies”](https://kilotest.com/tutorialWeb.html)
67
+ - [Tutorial, “Connect an AI Platform”](https://kilotest.com/tutorialAI.html)
72
68
 
73
69
  ### API
74
70
 
@@ -200,11 +196,11 @@ More information about Kilotest features and internals:
200
196
  ### General
201
197
 
202
198
  - [Introduction to Kilotest](https://kilotest.com/)
203
- - [Tutorial, “Accessibility testing strategies”](https://kilotest.com/tutorial.html)
204
- - [Tutorial on authorizing language models to use Kilotest](https://kilotest.com/qai/)
199
+ - [Tutorial, “Accessibility testing strategies”](https://kilotest.com/tutorialWeb.html)
200
+ - [Tutorial on authorizing language models to use Kilotest](https://kilotest.com/tutorialAI.html)
205
201
  - [README file](https://github.com/jrpool/kilotest/blob/main/README.md)
206
202
  - [Summary of Kilotest capabilities](https://kilotest.com/capability.md)
207
203
  - [Testaro rule-engine orchestrator](https://github.com/YRA-Tech/testaro)
208
- - [Testaro rule classifier](https://github.com/YRA-Tech/testaro-issues)
204
+ - [Testaro rule classifier](https://github.com/jrpool/testaro-issues)
209
205
  - [Research report on Testaro](https://arxiv.org/abs/2309.10167)
210
206
  - [Blog post on the Kilotest use case](https://medium.com/cvs-health-tech-blog/how-to-run-a-thousand-accessibility-tests-63692ad120c3)
package/llms.txt CHANGED
@@ -1,6 +1,6 @@
1
1
  # Kilotest
2
2
 
3
- Kilotest helps language models and AI platforms to give thorough, accurate and truthful answers when users ask about the front-end quality (i.e. accessibility, usability, and web standards) of web pages. Kilotest integrates an ensemble of twelve independent rule engines to test a web page. Kilotest creates a structured report of the results and saves the report for future reference. Kilotest API endpoints and MCP tools can provide multipage, single-page, and element-level test results.
3
+ Kilotest integrates an ensemble of 12 rule engines, with about 1,300 rules, to test web pages for front-end quality (accessibility, usability, and web standards, including HTML, CSS, ARIA, and WCAG, including HTML, CSS, ARIA, and WCAG). Each test job generates a standardized report describing which elements violated which rules and grouping the violations into about 380 issues. Kilotest can list the tested pages, the reports about each page, the issues in each report, the violators of each issue, and the diagnoses of each violation. Kilotest also accepts requests to test pages not yet tested and to retest already tested pages. Kilotest features are available via a web UI, an API, and an MCP server with streamable HTTP and no authentication.
4
4
 
5
5
  ## API
6
6
 
package/mcp.ts CHANGED
@@ -54,12 +54,12 @@ export const mcpPath = '/mcp';
54
54
  // instructions and in the getKilotestOverview tool description (but not in the other tool
55
55
  // descriptions, to avoid diluting how models read each tool), because some MCP clients do
56
56
  // not propagate server-level instructions or the server description to their models.
57
- const sharedContext = 'Kilotest integrates an ensemble of 12 rule engines, with about 1,300 rules, to test web pages for front-end quality (accessibility, usability, and web standards). Each test job generates a standardized report describing which elements violated which rules and grouping the violations into about 380 issues. Kilotest can list the tested pages, the reports about each page, the issues in each report, the violators of each issue, and the diagnoses of each violation. Kilotest also accepts requests to test pages not yet tested and to retest already tested pages.';
57
+ const sharedContext = 'Kilotest integrates an ensemble of 12 rule engines, with about 1,300 rules, to test web pages for front-end quality (accessibility, usability, and web standards, including HTML, CSS, ARIA, and WCAG). Each test job generates a standardized report describing which elements violated which rules and grouping the violations into about 380 issues. Kilotest can list the tested pages, the reports about each page, the issues in each report, the violators of each issue, and the diagnoses of each violation. Kilotest also accepts requests to test pages not yet tested and to retest already tested pages.';
58
58
 
59
59
  // Detailed overview of the Kilotest domain, data hierarchy, and tool workflow, returned by
60
60
  // the getKilotestOverview tool and served as the docs://kilotest/overview resource.
61
61
  const kilotestOverview = [
62
- 'Kilotest tests web pages for front-end quality: accessibility, usability, and web standards.',
62
+ 'Kilotest tests web pages for front-end quality: accessibility, usability, and web standards, including HTML, CSS, ARIA, and WCAG.',
63
63
  'Kilotest integrates an ensemble of twelve independent rule engines to test a web page and stores the results as a structured report.',
64
64
  'Results are organized as a hierarchy. A tested page has one or more reports, from oldest to latest. A report contains issues. An issue has violators: elements of the tested page reported as exhibiting the issue. A violator has diagnoses: explanations from rule engines of how the element exhibited the issue.',
65
65
  'Typical workflow: call the listPages tool to learn whether the page has been tested. If it has, drill down from its latest report with the listIssues, listViolators, and listDiagnoses tools, or retrieve the entire report with the getReport tool. The listIssues output also lists all reports about the same page, so you can examine earlier reports. If the page has not been tested, request a test with the requestNewTest tool. If the latest report is obsolete, request a retest with the requestRetest tool.',
@@ -74,7 +74,7 @@ export const createMCPServer = (): McpServer => {
74
74
  const server = new McpServer({
75
75
  name: 'Kilotest',
76
76
  version,
77
- description: 'Tools that test web pages for front-end quality (accessibility, usability, and web standards) and make test results available'
77
+ description: 'Tools that test web pages for front-end quality (accessibility, usability, and web standards, including HTML, CSS, ARIA, and WCAG) and make test results available'
78
78
  },
79
79
  {
80
80
  instructions: `${sharedContext} Use the listPages tool to start. If it shows that the page you want facts about has been tested, drill down from its latest report with the listIssues, listViolators, and listDiagnoses tools. If not, use the requestNewTest tool to request that the page be tested, or the orderNewTest tool for immediate, automatically approved testing. If the latest report about the page is obsolete, use the requestRetest tool to request that the page be retested, or the orderRetest tool for immediate, automatically approved retesting. For detailed documentation, call the getKilotestOverview tool.`
package/openapi.yaml CHANGED
@@ -1,7 +1,7 @@
1
1
  openapi: 3.1.0
2
2
  info:
3
3
  title: Kilotest API
4
- description: 'Kilotest is an ensemble testing and reporting service for front-end web quality. It uses an ensemble of 12 rule engines to test web pages for front-end quality (accessibility, usability, and web standards). Kilotest acts as a web server for human users, an MCP server for AI platforms, and an API for programmatic access. With this API you can request that a page be tested or retested, discover available reports, incrementally retrieve facts from a report: from what reports are available, to what issues were reported in one report, to what elements violated one issue, to what diagnoses rule engines gave for one violation.'
4
+ description: 'Kilotest is an ensemble testing and reporting service for front-end web quality. It uses an ensemble of 12 rule engines to test web pages for front-end quality (accessibility, usability, and web standards, including HTML, CSS, ARIA, and WCAG). Kilotest acts as a web server for human users, an MCP server for AI platforms, and an API for programmatic access. With this API you can request that a page be tested or retested, discover available reports, incrementally retrieve facts from a report: from what reports are available, to what issues were reported in one report, to what elements violated one issue, to what diagnoses rule engines gave for one violation.'
5
5
  version: 59.1.0
6
6
  license:
7
7
  name: MIT
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "@jrpool/kilotest",
3
- "version": "59.1.0",
3
+ "version": "59.1.1",
4
4
  "description": "Ensemble testing for front-end web quality",
5
5
  "type": "module",
6
6
  "main": "index.ts",
@@ -58,7 +58,7 @@ const generate = () => {
58
58
  openapi: '3.1.0',
59
59
  info: {
60
60
  title: 'Kilotest API',
61
- description: 'Kilotest is an ensemble testing and reporting service for front-end web quality. It uses an ensemble of 12 rule engines to test web pages for front-end quality (accessibility, usability, and web standards). Kilotest acts as a web server for human users, an MCP server for AI platforms, and an API for programmatic access. With this API you can request that a page be tested or retested, discover available reports, incrementally retrieve facts from a report: from what reports are available, to what issues were reported in one report, to what elements violated one issue, to what diagnoses rule engines gave for one violation.',
61
+ description: 'Kilotest is an ensemble testing and reporting service for front-end web quality. It uses an ensemble of 12 rule engines to test web pages for front-end quality (accessibility, usability, and web standards, including HTML, CSS, ARIA, and WCAG). Kilotest acts as a web server for human users, an MCP server for AI platforms, and an API for programmatic access. With this API you can request that a page be tested or retested, discover available reports, incrementally retrieve facts from a report: from what reports are available, to what issues were reported in one report, to what elements violated one issue, to what diagnoses rule engines gave for one violation.',
62
62
  version,
63
63
  license: {
64
64
  name: license,
@@ -16,15 +16,15 @@
16
16
  "sameAs": "https://github.com/jrpool/kilotest",
17
17
  "datePublished": "2025-10-14",
18
18
  "dateModified": "2026-08-26",
19
- "applicationCategory": "Front-end quality (i.e. accessibility, usability, and web standards) testing and reporting service",
19
+ "applicationCategory": "Front-end quality (i.e. accessibility, usability, and web standards, including HTML, CSS, ARIA, and WCAG) testing and reporting service",
20
20
  "isAccessibleForFree": true,
21
- "description": "Testing of web pages for front-end quality (i.e. accessibility, usability, and web standards) with an ensemble of 12 rule engines and provision of results at selectable levels of detail.",
21
+ "description": "Testing of web pages for front-end quality (i.e. accessibility, usability, and web standards, including HTML, CSS, ARIA, and WCAG) with an ensemble of 12 rule engines and provision of results at selectable levels of detail.",
22
22
  "softwareHelp": {
23
23
  "@type": "CreativeWork",
24
24
  "url": "https://kilotest.com/tutorialWeb.html"
25
25
  },
26
26
  "featureList": [
27
- "Automated testing of front-end quality (i.e. accessibility, usability, and web standards)",
27
+ "Automated testing of front-end quality (i.e. accessibility, usability, and web standards, including HTML, CSS, ARIA, and WCAG)",
28
28
  "WCAG 2.2 conformance evaluation",
29
29
  "HTML5 conformance evaluation",
30
30
  "CSS3 conformance evaluation",
@@ -62,7 +62,7 @@
62
62
  <details>
63
63
  <summary>More than a thousand? Really?</summary>
64
64
  <h2>Ensemble testing</h2>
65
- <p>Kilotest does <strong>ensemble testing</strong> of web pages for <a href="https://www.w3.org/mission/accessibility/">accessibility</a>, usability, and web standards.</p>
65
+ <p>Kilotest does <strong>ensemble testing</strong> of web pages for <a href="https://www.w3.org/mission/accessibility/">accessibility</a>, usability, and web standards, including HTML, CSS, ARIA, and WCAG.</p>
66
66
  <p>Efficient testing <strong>first</strong> leverages <strong>automated rule engines</strong> and corrects the defects that they discover, <strong>then</strong> employs human testers.</p>
67
67
  <p>Choosing among the <a href="https://www.w3.org/WAI/test-evaluate/tools/list/">many automated rule engines</a> is hard, because they <a href="https://arxiv.org/pdf/2304.07591">vary in what and how they test</a>.</p>
68
68
  <p><strong>Ensemble testing</strong>, instead of choosing only one, combines <strong>multiple rule engines</strong>. It can discover more issues than single-rule-engine testing, and the rule engines can check one another&rsquo;s quality.</p>
@@ -34,13 +34,10 @@
34
34
  <li>Expand the left sidebar to see the labels.</li>
35
35
  <li>Click the <q>Customize</q> button.</li>
36
36
  <li>Click the <q>Connectors</q> button.</li>
37
- <li>In the <q>Add</q> list, click the <q>Add custom connector</q> button.</li>
38
- <li>Enter <q>Kilotest</q> into the <q>Name</q> input.</li>
39
- <li>Enter <q>https://kilotest.com/mcp</q> into the <q>Remote MCP server URL</q> input.</li>
40
- <li>Leave the OAuth inputs empty.</li>
41
- <li>Click the <q>Add</q> button.</li>
42
- <li>For maximum autonomy, click <q>Always allow</q> for each tool.</li>
43
- <li>Click the <code>x</code> button or press the <code>Escape</code> key to close the dialog.</li>
37
+ <li>Enter <q>Kilotest</q> in the <q>Search</q> input.</li>
38
+ <li>Select <q>Kilotest</q> from the search results.</li>
39
+ <li>Click the <q>Connect to Claude</q> button.</li>
40
+ <li>If you wish, click the <q>Your tool permissions</q> button and adjust the settings for the Kilotest tools.</li>
44
41
  </ol>
45
42
  <h2 id="vibe">Mistral Vibe</h2>
46
43
  <ol>