@jrpool/kilotest 55.0.0 → 57.1.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (52) hide show
  1. package/README.md +1 -1
  2. package/api/awaitTest.test.ts +114 -0
  3. package/api/awaitTest.ts +108 -0
  4. package/api/listReports.ts +2 -2
  5. package/api/orderNewTest.test.ts +213 -0
  6. package/api/orderNewTest.ts +145 -0
  7. package/api/orderRetest.test.ts +179 -0
  8. package/api/orderRetest.ts +119 -0
  9. package/api/{requestTest.test.ts → requestNewTest.test.ts} +25 -25
  10. package/api/{requestTest.ts → requestNewTest.ts} +16 -39
  11. package/api/requestRetest.test.ts +6 -6
  12. package/api/requestRetest.ts +10 -33
  13. package/api/routes.test.ts +7 -4
  14. package/api/routes.ts +45 -7
  15. package/api/schemas.ts +120 -10
  16. package/api/util.ts +59 -2
  17. package/api/version.ts +6 -2
  18. package/capability.md +12 -5
  19. package/docs/SERVICE.md +6 -8
  20. package/env.example +15 -0
  21. package/index.html +1 -0
  22. package/index.test.ts +95 -24
  23. package/index.ts +83 -16
  24. package/lhm.plugin.json +1 -1
  25. package/linkValidation.test.ts +2 -2
  26. package/llms-full.txt +34 -3
  27. package/llms.txt +6 -2
  28. package/mcp.test.ts +72 -12
  29. package/mcp.ts +81 -11
  30. package/memory/MEMORY.md +1 -0
  31. package/memory/plan_issue_111_instant_test.md +198 -0
  32. package/openapi.yaml +451 -4
  33. package/package.json +1 -1
  34. package/routes.test.ts +1 -1
  35. package/routing.test.ts +2 -2
  36. package/server.json +1 -1
  37. package/sitemap.xml +2 -1
  38. package/smokeTest.ts +2 -2
  39. package/util.test.ts +214 -2
  40. package/util.ts +175 -7
  41. package/web/listReports/index.html +1 -1
  42. package/web/listReports/listReports.test.ts +1 -1
  43. package/web/privacy/index.html +37 -0
  44. package/web/privacy/index.ts +20 -0
  45. package/web/privacy/privacy.test.ts +18 -0
  46. package/web/{requestTest → requestNewTest}/index.ts +1 -1
  47. package/web/{requestTest/requestTest.test.ts → requestNewTest/requestNewTest.test.ts} +2 -2
  48. package/web/{requestTestForm → requestNewTestForm}/index.html +1 -1
  49. package/web/{requestTestForm/requestTestForm.test.ts → requestNewTestForm/requestNewTestForm.test.ts} +6 -6
  50. package/web/tutorialAI/index.html +26 -39
  51. /package/web/{requestTest → requestNewTest}/index.html +0 -0
  52. /package/web/{requestTestForm → requestNewTestForm}/index.ts +0 -0
@@ -14,52 +14,39 @@
14
14
  <body>
15
15
  <main>
16
16
  <h1>Connect an AI Platform to Kilotest</h1>
17
- <h2>What you can do here</h2>
17
+ <h2>Purpose</h2>
18
+ <p>This tutorial shows you how to make Kilotest available to AI assistants. Suppose:</p>
18
19
  <ul>
19
- <li>Do you ask questions to artificial intelligence (AI) assistants?</li>
20
- <li>Do some of your questions ask for technical information?</li>
20
+ <li>You use an AI platform, like Claude.ai, Claude Code, Claude Desktop, Perplexity, Cursor, Gemini, or ChatGPT.</li>
21
+ <li>You want to audit the quality of a web page.</li>
21
22
  </ul>
22
- <p>If you answered both of these questions with <q>yes</q>, this tutorial is designed for you.</p>
23
- <h2>AI needs your help</h2>
24
- <p>When you get AI help, you use AI platforms to interact with large language models (LLMs). LLMs are superb at understanding your questions, fetching information for you, and formulating answers from that information. But LLMs are <strong>not</strong> good at performing technical tasks to produce the accurate information they need. For those tasks, LLMs use <em>tools</em>. If you ask an LLM a question that requires a tool, you <strong>cannot assume</strong> that the LLM will know how to discover that tool. Typically, the LLM will try to answer you without the tool and will give you an inferior answer: superficial, vague, incomplete, inaccurate, or even fabricated. To ensure that the LLM uses the right tool, you can tell the AI platform to make the tool available to its LLMs.</p>
25
- <p>This tutorial shows you how to do that.</p>
26
- <h2>Let us begin with a concrete example</h2>
27
- <p>Suppose the AI platform you want to use is Claude, and you will use it in a web browser.</p>
28
- <p>Also suppose you will be asking an LLM on that platform to give you technical details about software quality: specifically, about the quality of a particular web page.</p>
29
- <p>For that task, the LLM will need a tool that can test a web page to discover quality defects and report those defects to the LLM.</p>
30
- <p>Finally, suppose you know about a tool that has that capability: Kilotest. You also know the URL that Kilotest makes available to LLMs: <code>https://kilotest.com/mcp</code>.</p>
31
- <h2>What to do</h2>
32
- <p>You can solve this problem with two steps.</p>
33
- <h3>Step 1: Become a user</h3>
34
- <p>If you are not already a user of the Claude AI platform, register yourself on it as a user. You can do this for free. Navigate to <a href="https://claude.ai/login">https://claude.ai/login</a> and use either Google or your email address to create an account. After you proceed through the substeps of creating a <q>Free plan</q> account, you are on the <a href="https://claude.ai/new">home page of a new task</a>.</p>
35
- <h3>Step 2: Add a connector</h3>
36
- <p>Now you are ready to add a connector to the Claude AI platform.</p>
37
- <p>The page has a toolbar on the left side. Click it to expand it, so you can see labels, not only icons.</p>
38
- <p>Now click the <q>Customize</q> tool.</p>
39
- <p>A dialog opens. In the <q>Customize</q> list, click <q>Connectors</q>.</p>
40
- <p>The dialog changes to a <q>Connectors</q> view.</p>
41
- <p>In the <q>Add</q> dropdown list, click <q>Add custom connector</q>.</p>
42
- <p>A subdialog opens, titled <q>Add custom connector</q>. It contains 4 inputs.</p>
23
+ <p>Then the models on your AI platform can use Kilotest <strong>if</strong> you make Kilotest available on the platform.</p>
24
+ <h2>What AI platform do you use?</h2>
43
25
  <ul>
26
+ <li><a href="#claude-ai">Claude.ai</a></li>
27
+ <li><a href="#claude-code">Claude Code</a></li>
28
+ <li><a href="#claude-desktop">Claude Desktop</a></li>
29
+ <li><a href="#perplexity">Perplexity</a></li>
30
+ <li><a href="#cursor">Cursor</a></li>
31
+ <li><a href="#gemini">Gemini</a></li>
32
+ <li><a href="#chatgpt">ChatGPT</a></li>
33
+ </ul>
34
+ <h2 id="claude-ai">Claude.ai</h2>
35
+ <p><a href="https://claude.ai/login">Claude.ai</a> is an AI platform that you can use for free in any web browser. To make Kilotest available on Claude.ai:</p>
36
+ <ul>
37
+ <li><a href="https://claude.ai/new">Start a new task</a>.</li>
38
+ <li>Expand the left sidebar to see the labels.</li>
39
+ <li>Click <q>Customize</q>.</li>
40
+ <li>Click <q>Connectors</q>.</li>
41
+ <li>In the <q>Add</q> list, click <q>Add custom connector</q>.</li>
44
42
  <li>Enter <q>Kilotest</q> into the <q>Name</q> input.</li>
45
43
  <li>Enter <q>https://kilotest.com/mcp</q> into the <q>Remote MCP server URL</q> input.</li>
46
44
  <li>Leave the OAuth inputs empty.</li>
47
- <li>Submit the form by clicking the <q>Add</q> button.</li>
48
- </ul>
49
- <p>The dialog changes to a tool permissions view for the Kilotest connector. You can decide whether an LLM needs your approval to use each of the tools that Kilotest makes available.</p>
50
- <p>Close the dialog by clicking the <code>x</code> button in the top-right corner or by pressing the <code>Escape</code> key.</p>
51
- <h2>Finished!</h2>
52
- <p>Now the platform will make the connector available to its LLMs.</p>
53
- <p>Here is a simple test for you to verify that your configuration works:</p>
54
- <ul>
55
- <li>In the <q>How can I help you today?</q> input, choose which model you want to use.</li>
56
- <li>Enter the question: <q>What quality issues exist on the World Wide Web Consortium home page?</q></li>
57
- <li>Click the <q>Send message</q> up-arrow button or press the <code>Enter</code> key to submit your question.</li>
58
- <li>From the answer that you get, determine whether the model used any Kilotest tools for this task.</li>
45
+ <li>Click <q>Add</q>.</li>
46
+ <li>Decide whether Claude.ai needs your approval to use each Kilotesw tool.</li>
47
+ <li>Clicking the <code>x</code> button or by press the <code>Escape</code> key to close the dialog.</li>
59
48
  </ul>
60
- <h2>Did this work?</h2>
61
- <p>If the model used any Kilotest tools, congratulations! You know how to add tool power to the LLMs on one of the major AI platforms.</p>
62
- <p>But what if it did <strong>not</strong> work? If an LLM fails to use the Kilotest connector when it should, or if you need to explicitly tell the LLM to use the connector, something is wrong, and we want to know about your experience. Please use the <a href="tutorialAIComment.html">comment form</a> to tell us about it.</p>
49
+ <p>What if this did not work? Use the comment form below to tell us about it.</p>
63
50
  <p>You can also submit an issue on the <a href="https://github.com/jrpool/kilotest/issues">Kilotest GitHub repository</a>.</p>
64
51
  <section id="suggest-improvement" class="main">
65
52
  <h2>Suggest improvements</h2>
File without changes