testeiya 0.2.1 → 0.3.9

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (414) hide show
  1. package/LICENSE +21 -0
  2. package/README.md +41 -213
  3. package/dist/prompt/context.js +79 -0
  4. package/dist/prompt/context.js.map +1 -0
  5. package/dist/prompt/index.js +56 -0
  6. package/dist/prompt/index.js.map +1 -0
  7. package/dist/prompt/print.js +22 -0
  8. package/dist/prompt/print.js.map +1 -0
  9. package/dist/prompt/project-info.js +2 -0
  10. package/dist/prompt/project-info.js.map +1 -0
  11. package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +24 -21
  12. package/dist/prompt/system-prompt.js.map +1 -0
  13. package/dist/prompt/testomatio.js +264 -0
  14. package/dist/prompt/testomatio.js.map +1 -0
  15. package/dist/prompt/tools.js +49 -0
  16. package/dist/prompt/tools.js.map +1 -0
  17. package/dist/prompt/vocab.js +8 -0
  18. package/dist/prompt/vocab.js.map +1 -0
  19. package/dist/src/args.js +72 -0
  20. package/dist/src/args.js.map +1 -0
  21. package/dist/src/cli.js +61 -0
  22. package/dist/src/cli.js.map +1 -0
  23. package/dist/src/env.js +69 -0
  24. package/dist/src/env.js.map +1 -0
  25. package/dist/src/mcp-extension.js +9 -0
  26. package/dist/src/mcp-extension.js.map +1 -0
  27. package/dist/src/mcp.js +139 -0
  28. package/dist/src/mcp.js.map +1 -0
  29. package/dist/src/model.js +66 -0
  30. package/dist/src/model.js.map +1 -0
  31. package/dist/src/result.js +41 -0
  32. package/dist/src/result.js.map +1 -0
  33. package/dist/src/run.js +199 -0
  34. package/dist/src/run.js.map +1 -0
  35. package/dist/src/session.js +77 -0
  36. package/dist/src/session.js.map +1 -0
  37. package/dist/vendor/mcp.js +14801 -0
  38. package/mcp-tools.json +2967 -0
  39. package/package.json +29 -42
  40. package/prompt/context.ts +101 -0
  41. package/prompt/index.ts +93 -0
  42. package/prompt/print.ts +23 -0
  43. package/prompt/project-info.ts +30 -0
  44. package/prompt/system-prompt.ts +173 -0
  45. package/{src/prompt → prompt}/testomatio.ts +119 -8
  46. package/{src/prompt → prompt}/tools.ts +30 -8
  47. package/prompt/vocab.ts +7 -0
  48. package/{skills.lock.json → skills/skills.lock.json} +11 -7
  49. package/skills/skills.yaml +34 -0
  50. package/assets/testeiya-logo-dark.svg +0 -16
  51. package/assets/testeiya-logo.svg +0 -15
  52. package/models.catalog.json +0 -6963
  53. package/skills/codeceptjs/ci-fix-tests/SKILL.md +0 -120
  54. package/skills/codeceptjs/codeceptjs-auth/SKILL.md +0 -158
  55. package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +0 -91
  56. package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +0 -158
  57. package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +0 -90
  58. package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +0 -234
  59. package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +0 -110
  60. package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +0 -306
  61. package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +0 -352
  62. package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +0 -472
  63. package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +0 -350
  64. package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +0 -81
  65. package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +0 -206
  66. package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
  67. package/skills/playwright-best-practices-skill/README.md +0 -147
  68. package/skills/playwright-best-practices-skill/SKILL.md +0 -303
  69. package/skills/playwright-best-practices-skill/advanced/authentication-flows.md +0 -360
  70. package/skills/playwright-best-practices-skill/advanced/authentication.md +0 -871
  71. package/skills/playwright-best-practices-skill/advanced/clock-mocking.md +0 -364
  72. package/skills/playwright-best-practices-skill/advanced/mobile-testing.md +0 -409
  73. package/skills/playwright-best-practices-skill/advanced/multi-context.md +0 -288
  74. package/skills/playwright-best-practices-skill/advanced/multi-user.md +0 -393
  75. package/skills/playwright-best-practices-skill/advanced/network-advanced.md +0 -452
  76. package/skills/playwright-best-practices-skill/advanced/third-party.md +0 -464
  77. package/skills/playwright-best-practices-skill/architecture/pom-vs-fixtures.md +0 -363
  78. package/skills/playwright-best-practices-skill/architecture/test-architecture.md +0 -369
  79. package/skills/playwright-best-practices-skill/architecture/when-to-mock.md +0 -383
  80. package/skills/playwright-best-practices-skill/browser-apis/browser-apis.md +0 -391
  81. package/skills/playwright-best-practices-skill/browser-apis/iframes.md +0 -403
  82. package/skills/playwright-best-practices-skill/browser-apis/service-workers.md +0 -504
  83. package/skills/playwright-best-practices-skill/browser-apis/websockets.md +0 -403
  84. package/skills/playwright-best-practices-skill/core/annotations.md +0 -424
  85. package/skills/playwright-best-practices-skill/core/assertions-waiting.md +0 -361
  86. package/skills/playwright-best-practices-skill/core/configuration.md +0 -452
  87. package/skills/playwright-best-practices-skill/core/fixtures-hooks.md +0 -417
  88. package/skills/playwright-best-practices-skill/core/global-setup.md +0 -434
  89. package/skills/playwright-best-practices-skill/core/locators.md +0 -242
  90. package/skills/playwright-best-practices-skill/core/page-object-model.md +0 -315
  91. package/skills/playwright-best-practices-skill/core/projects-dependencies.md +0 -453
  92. package/skills/playwright-best-practices-skill/core/test-data.md +0 -492
  93. package/skills/playwright-best-practices-skill/core/test-suite-structure.md +0 -361
  94. package/skills/playwright-best-practices-skill/core/test-tags.md +0 -298
  95. package/skills/playwright-best-practices-skill/debugging/console-errors.md +0 -420
  96. package/skills/playwright-best-practices-skill/debugging/debugging.md +0 -504
  97. package/skills/playwright-best-practices-skill/debugging/error-testing.md +0 -360
  98. package/skills/playwright-best-practices-skill/debugging/flaky-tests.md +0 -496
  99. package/skills/playwright-best-practices-skill/frameworks/angular.md +0 -530
  100. package/skills/playwright-best-practices-skill/frameworks/nextjs.md +0 -469
  101. package/skills/playwright-best-practices-skill/frameworks/react.md +0 -531
  102. package/skills/playwright-best-practices-skill/frameworks/vue.md +0 -574
  103. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/ci-cd.md +0 -468
  104. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/docker.md +0 -283
  105. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/github-actions.md +0 -546
  106. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/gitlab.md +0 -397
  107. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/other-providers.md +0 -521
  108. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/parallel-sharding.md +0 -371
  109. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/performance.md +0 -453
  110. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/reporting.md +0 -424
  111. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/test-coverage.md +0 -497
  112. package/skills/playwright-best-practices-skill/testing-patterns/accessibility.md +0 -359
  113. package/skills/playwright-best-practices-skill/testing-patterns/api-testing.md +0 -719
  114. package/skills/playwright-best-practices-skill/testing-patterns/browser-extensions.md +0 -506
  115. package/skills/playwright-best-practices-skill/testing-patterns/canvas-webgl.md +0 -493
  116. package/skills/playwright-best-practices-skill/testing-patterns/component-testing.md +0 -500
  117. package/skills/playwright-best-practices-skill/testing-patterns/drag-drop.md +0 -576
  118. package/skills/playwright-best-practices-skill/testing-patterns/electron.md +0 -509
  119. package/skills/playwright-best-practices-skill/testing-patterns/file-operations.md +0 -377
  120. package/skills/playwright-best-practices-skill/testing-patterns/file-upload-download.md +0 -562
  121. package/skills/playwright-best-practices-skill/testing-patterns/forms-validation.md +0 -561
  122. package/skills/playwright-best-practices-skill/testing-patterns/graphql-testing.md +0 -331
  123. package/skills/playwright-best-practices-skill/testing-patterns/i18n.md +0 -508
  124. package/skills/playwright-best-practices-skill/testing-patterns/performance-testing.md +0 -476
  125. package/skills/playwright-best-practices-skill/testing-patterns/security-testing.md +0 -430
  126. package/skills/playwright-best-practices-skill/testing-patterns/visual-regression.md +0 -634
  127. package/skills/playwright-cli/SKILL.md +0 -420
  128. package/skills/playwright-cli/references/element-attributes.md +0 -23
  129. package/skills/playwright-cli/references/playwright-tests.md +0 -39
  130. package/skills/playwright-cli/references/request-mocking.md +0 -87
  131. package/skills/playwright-cli/references/running-code.md +0 -241
  132. package/skills/playwright-cli/references/session-management.md +0 -225
  133. package/skills/playwright-cli/references/storage-state.md +0 -275
  134. package/skills/playwright-cli/references/test-generation.md +0 -433
  135. package/skills/playwright-cli/references/tracing.md +0 -139
  136. package/skills/playwright-cli/references/video-recording.md +0 -143
  137. package/skills/testeiya/README.md +0 -29
  138. package/skills/testeiya/answer-formatting/SKILL.md +0 -30
  139. package/skills/testeiya/check-cucumber/SKILL.md +0 -200
  140. package/skills/testeiya/check-tests/SKILL.md +0 -260
  141. package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
  142. package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
  143. package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
  144. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
  145. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
  146. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
  147. package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
  148. package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
  149. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
  150. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
  151. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
  152. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
  153. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
  154. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
  155. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
  156. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
  157. package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
  158. package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
  159. package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
  160. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
  161. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
  162. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
  163. package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
  164. package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
  165. package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
  166. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
  167. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
  168. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
  169. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
  170. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
  171. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
  172. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
  173. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
  174. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
  175. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
  176. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
  177. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
  178. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
  179. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
  180. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
  181. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
  182. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
  183. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
  184. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
  185. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
  186. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
  187. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
  188. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
  189. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
  190. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
  191. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
  192. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
  193. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
  194. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
  195. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
  196. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
  197. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
  198. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
  199. package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
  200. package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
  201. package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
  202. package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
  203. package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
  204. package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
  205. package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
  206. package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
  207. package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
  208. package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
  209. package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
  210. package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
  211. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
  212. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
  213. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
  214. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
  215. package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
  216. package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
  217. package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
  218. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
  219. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
  220. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
  221. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
  222. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
  223. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
  224. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
  225. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
  226. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
  227. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
  228. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
  229. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
  230. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
  231. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
  232. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
  233. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
  234. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
  235. package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
  236. package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
  237. package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
  238. package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
  239. package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
  240. package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
  241. package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
  242. package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
  243. package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
  244. package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
  245. package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
  246. package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
  247. package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
  248. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
  249. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
  250. package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
  251. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
  252. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
  253. package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
  254. package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
  255. package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
  256. package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
  257. package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
  258. package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
  259. package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
  260. package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
  261. package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
  262. package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
  263. package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
  264. package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
  265. package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
  266. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
  267. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
  268. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
  269. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
  270. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
  271. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
  272. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
  273. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
  274. package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
  275. package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
  276. package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
  277. package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
  278. package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
  279. package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
  280. package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
  281. package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
  282. package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
  283. package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
  284. package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
  285. package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
  286. package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +0 -88
  287. package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +0 -95
  288. package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +0 -334
  289. package/skills/testomatio/test-automation/automate-manual-test-cases/CLAUDE.md +0 -56
  290. package/skills/testomatio/test-automation/automate-manual-test-cases/SKILL.md +0 -242
  291. package/skills/testomatio/test-automation/automate-manual-test-cases/references/CODECEPTJS_BEST_PRACTICES.md +0 -182
  292. package/skills/testomatio/test-automation/automate-manual-test-cases/references/FINAL_SUMMARY_TEMPLATE.md +0 -22
  293. package/skills/testomatio/test-automation/automate-manual-test-cases/references/PLAYWRIGHT_BEST_PRACTICES.md +0 -90
  294. package/skills/testomatio/test-automation/automate-manual-test-cases/references/POM_BEST_PRACTICES.md +0 -53
  295. package/skills/testomatio/test-automation/automate-manual-test-cases/references/TEST_DATA_MANAGEMENT.md +0 -52
  296. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/SKILL.md +0 -107
  297. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/references/DEBUGGING_QUICK_REFERENCE.md +0 -113
  298. package/skills/testomatio/test-automation/qa-automation-test-consolidation/SKILL.md +0 -29
  299. package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +0 -151
  300. package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
  301. package/skills/testomatio/test-automation/testomat-allure-adapter/SKILL.md +0 -289
  302. package/skills/testomatio/test-management/detect-duplicate-test-cases/SKILL.md +0 -86
  303. package/skills/testomatio/test-management/detect-duplicate-test-cases/references/DUPLICATE_INSTRUCTIONS.md +0 -54
  304. package/skills/testomatio/test-management/improve-test-cases/SKILL.md +0 -114
  305. package/skills/testomatio/test-management/improve-test-cases/references/TESTOMAT_MARKDOWN_EXAMPLE.md +0 -66
  306. package/skills/testomatio/test-management/pull-request-diff-analyzer/SKILL.md +0 -141
  307. package/skills/testomatio/test-management/qa-e2e-tests-reporting/SKILL.md +0 -354
  308. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_ARTIFACTS.md +0 -82
  309. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_HTML_REPORT.md +0 -37
  310. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_REPORTERS_CONFIG.md +0 -118
  311. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/SKILL.md +0 -149
  312. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/references/summary-example.md +0 -54
  313. package/skills/testomatio/test-management/qa-requirement-reviewer/SKILL.md +0 -126
  314. package/skills/testomatio/test-management/qa-requirement-reviewer/references/requirements_reviewer_examples.md +0 -128
  315. package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +0 -174
  316. package/skills/testomatio/test-management/qa-test-code-coverage/references/COVERAGE_FILE_FORMAT.md +0 -138
  317. package/skills/testomatio/test-management/qa-test-code-coverage/references/E2E_FRAMEWORKS.md +0 -65
  318. package/skills/testomatio/test-management/qa-test-code-coverage/scripts/check-coverage.mjs +0 -40
  319. package/skills/testomatio/test-management/qa-thinking/SKILL.md +0 -36
  320. package/skills/testomatio/test-management/qa-write-test-cases/SKILL.md +0 -267
  321. package/skills/testomatio/test-management/qa-write-test-cases/references/test-case-format.md +0 -387
  322. package/skills/testomatio/test-management/qa-write-test-cases/references/testomat-tms-guide.md +0 -72
  323. package/skills/testomatio/test-management/qa-write-test-cases/references/writing-rule.md +0 -159
  324. package/skills/testomatio/test-management/scan-automation-project/SKILL.md +0 -152
  325. package/skills/testomatio/test-management/sync-test-cases-with-tms/SKILL.md +0 -107
  326. package/skills/testomatio/test-management/sync-test-cases-with-tms/references/TESTOMATIO_CLI.md +0 -140
  327. package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +0 -182
  328. package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +0 -169
  329. package/skills.yaml +0 -21
  330. package/src/ai-debug.ts +0 -188
  331. package/src/api/agent-get.ts +0 -22
  332. package/src/api/agent-start.ts +0 -384
  333. package/src/api/client-log.ts +0 -29
  334. package/src/api/context.ts +0 -332
  335. package/src/api/debug-layout.ts +0 -47
  336. package/src/api/debug-report.ts +0 -29
  337. package/src/api/debug-snapshot.ts +0 -30
  338. package/src/api/debug-stream.ts +0 -52
  339. package/src/api/files-delete.ts +0 -184
  340. package/src/api/files-read.ts +0 -41
  341. package/src/api/files-rename.ts +0 -99
  342. package/src/api/files-tree.ts +0 -292
  343. package/src/api/files-write.ts +0 -41
  344. package/src/api/mcp.ts +0 -603
  345. package/src/api/memory.ts +0 -69
  346. package/src/api/open-external.ts +0 -39
  347. package/src/api/playwright-cli.ts +0 -606
  348. package/src/api/providers.ts +0 -457
  349. package/src/api/read-env-token.ts +0 -33
  350. package/src/api/sessions.ts +0 -79
  351. package/src/api/settings.ts +0 -120
  352. package/src/api/skills.ts +0 -58
  353. package/src/api/testomatio-attachment.ts +0 -89
  354. package/src/api/testomatio-auth.ts +0 -284
  355. package/src/api/testomatio-proxy.ts +0 -197
  356. package/src/api/testomatio-run-stats.ts +0 -81
  357. package/src/api/testomatio-target.ts +0 -225
  358. package/src/api/testomatio-transcription.ts +0 -82
  359. package/src/api/workspace-search.ts +0 -96
  360. package/src/api/workspace-sync.ts +0 -151
  361. package/src/api/workspace.ts +0 -165
  362. package/src/app-server.ts +0 -556
  363. package/src/bridge.ts +0 -251
  364. package/src/check-tests.ts +0 -156
  365. package/src/cli.ts +0 -17
  366. package/src/commands.ts +0 -244
  367. package/src/config.ts +0 -183
  368. package/src/connection.ts +0 -658
  369. package/src/context-store.ts +0 -265
  370. package/src/debug-bus.ts +0 -405
  371. package/src/extensions/tool-gate.ts +0 -220
  372. package/src/extensions/webui/ask-channel.ts +0 -52
  373. package/src/extensions/webui/index.ts +0 -184
  374. package/src/extensions/webui/tools/ask-question.ts +0 -88
  375. package/src/extensions/webui/tools/query-result.ts +0 -79
  376. package/src/extensions/webui/tools/render-chart.ts +0 -53
  377. package/src/extensions/webui/tools/render-item.ts +0 -61
  378. package/src/extensions/webui/tools/render-list.ts +0 -170
  379. package/src/extensions/webui/tools/render-result.ts +0 -85
  380. package/src/extensions/webui/tools/render-tree.ts +0 -71
  381. package/src/extensions/webui/tools/ui-widget.ts +0 -54
  382. package/src/extensions/webui/tools/widget-result.ts +0 -13
  383. package/src/extensions/webui/widget-channel.ts +0 -50
  384. package/src/file-log.ts +0 -196
  385. package/src/git-tracked.ts +0 -68
  386. package/src/gitignore.ts +0 -53
  387. package/src/json-store.ts +0 -43
  388. package/src/load-env.ts +0 -70
  389. package/src/loader-style.ts +0 -96
  390. package/src/main.ts +0 -140
  391. package/src/mcp-catalog.ts +0 -96
  392. package/src/models-catalog.ts +0 -72
  393. package/src/permissions.ts +0 -120
  394. package/src/project-dir.ts +0 -189
  395. package/src/project-info.ts +0 -108
  396. package/src/prompt/app-ui.ts +0 -59
  397. package/src/prompt/browser.ts +0 -27
  398. package/src/prompt/index.ts +0 -62
  399. package/src/server-info.ts +0 -62
  400. package/src/session-factory.ts +0 -442
  401. package/src/session-store.ts +0 -115
  402. package/src/shell-env.ts +0 -45
  403. package/src/skills.ts +0 -163
  404. package/src/sync-snapshot.ts +0 -140
  405. package/src/telemetry.ts +0 -239
  406. package/src/testomatio-auth.ts +0 -299
  407. package/src/testomatio.ts +0 -98
  408. package/src/theme.ts +0 -30
  409. package/src/user-env.ts +0 -94
  410. package/src/welcome.ts +0 -194
  411. package/src/workspace/safe-path.ts +0 -85
  412. package/src/workspace/test-md.ts +0 -70
  413. package/src/workspace-model.ts +0 -440
  414. package/testeiya.config.json +0 -14
@@ -1,72 +0,0 @@
1
- ---
2
- title: Testomat.io TMS Integration Guide
3
- description: Essential reference for generating Testomat.io-compatible test cases. Covers structure, MCP tools, conventions, and best practices.
4
- ---
5
-
6
- # Testomat.io TMS Integration Guide
7
-
8
- Quick reference for generating test cases compatible with Testomat.io Test Management System.
9
-
10
- Follow this guide along with [Test Case Format](./test-case-format.md).
11
-
12
- ## Structure
13
-
14
- ```
15
- Folder (top-level)
16
- └── Suite {title} (@S{id})
17
- └── Test {title} (@T{id}) → has tags (e.g. @smoke), labels, priority (e.g. high)
18
- ```
19
-
20
- Priority values: `critical`, `high`, `normal`, `low`.
21
-
22
- ## Key MCP Tools
23
-
24
- | Purpose | Entities / tools |
25
- | --------------- | ------------------------------------------------------------------------------------------ |
26
- | **Structure** | `suites_list`, `suites_search`, `tests_list`, `tests_search`, `steps_list`, `steps_search` |
27
- | **Conventions** | `tags_list`, `labels_list` |
28
-
29
- **Key actions:**
30
-
31
- - `tests_search` - **Always use before creating new cases** to avoid duplicates
32
- - `steps_search` - Find reusable shared steps before writing new ones
33
-
34
- ## Use tags and labels
35
-
36
- Add them based on context, user prompt, existing tags and labels.
37
-
38
- Split tests by module, testing type, scope and other criteria which helps to organize and filter tests.
39
-
40
- ### When to use Tags vs Labels
41
-
42
- | Aspect | Tags | Labels |
43
- | --------------- | -------------------------------------- | ------------------------------------- |
44
- | **Best for** | Broad categorization | Specific metadata |
45
- | **Use for** | Test type (@smoke, @regression, @e2e) | Priority, severity, status, ownership |
46
- | **Flexibility** | Constant, embedded in code | Flexible, easy to change via UI |
47
- | **Values** | Single tag per category | Multiple values per label allowed |
48
- | **Examples** | `@smoke`, `@api`, `@auth`, `@checkout` | |
49
-
50
- **Rule of thumb:** Use tags for test categorization and automation; use labels for test metadata, workflow tracking, and manual test management.
51
-
52
- ## Deduplication Workflow
53
-
54
- ```
55
- 1. tests_search() → Find existing tests
56
- 2. Compare → Exact match? → Notify user, let user decide to skip or not
57
- 3. Partial overlap? → Ask user
58
- 4. No match? → Create new test cases
59
- ```
60
-
61
- ## Quality Checklist
62
-
63
- - [ ] Followed template format
64
- - [ ] Priority set
65
- - [ ] Tags/labels added
66
- - [ ] Clear steps
67
- - [ ] No duplicates
68
-
69
- ## References
70
-
71
- - [Testomat.io Docs](https://testomat.io/docs)
72
- - [Test Case Format](./test-case-format.md) - Full Markdown format reference
@@ -1,159 +0,0 @@
1
- # Test Writing Rules
2
-
3
- If the user provided example test cases, follow their style first; then apply these rules.
4
-
5
- ## Test Suites
6
-
7
- - Formulas, business rules, edge-case reasoning, and feature context live in the suite/test description.
8
- - Prerequisites common to all test cases go as bullet points in the suite description.
9
- - Formulas and diagrams relevant to all test cases can be included as code blocks in the suite description.
10
-
11
- ## Test Cases
12
-
13
- - A test case consists of a description and steps.
14
- - Golden rule: "why" in the description, "what" in the steps.
15
- - Add the intent to the description if the title is not enough to explain it.
16
- - Keep the description clear and concise.
17
- - Put preparations into preconditions/description, not into steps.
18
- - Focus on black-box testing: every action and observable result goes through public APIs or UI (unless the user specifies otherwise).
19
- - Prefer UI over public APIs when possible.
20
- - Add system checks only when it is not clear how to test via public APIs or UI. This is not a unit test; usually no direct server or code access is allowed.
21
- - Understand UI pages, components, or API endpoints from source code, design, or requirements.
22
- - If this is a web app, ask the user to help discover it:
23
- - by looking at its frontend source code
24
- - by accessing it on a non-production environment via browser (URLs and credentials)
25
- - by looking at screenshots of related pages
26
-
27
- ## Title
28
-
29
- Title states the behavior under test from the user's perspective.
30
-
31
- Title structure: `<role> <action> <object> <qualifier>`
32
-
33
- Examples:
34
-
35
- - Editor can change description of a blogpost in admin panel
36
- - User can report a bug using widget on a web page
37
- - Blocked user must not be able to log in to app workspace
38
- - Admin can invite up to 10 users to a project via Settings Page
39
- - User can not edit a comment it doesn't own
40
- - User can retry operation when NetworkError occurs
41
- - User can not retry operation when network connection is disabled
42
-
43
- Avoid:
44
-
45
- - Filler prefixes: `Verify that ...`, `Test that ...`, `Check ...`, `Should ...`
46
- - Multi-intent titles joined by `and` / `then`
47
- - Restating the suite name in every title
48
- - Embedding IDs or numbers: `TC-001: Login`
49
- - Vague outcomes: `Successful login`, `Login works`
50
-
51
- Good vs bad:
52
-
53
- - `Verify successful login` → `User can log in with valid email and password`
54
- - `Wrong password test` → `User cannot log in with invalid password`
55
- - `Login and update profile` → split into two tests
56
- - `Email validation` → `User sees error when email format is invalid`
57
-
58
- ## Preconditions
59
-
60
- - Add preconditions for setup that is required for the test to run but is not part of the test actions.
61
- - Define the preconditions and initial state of the system as bullet points.
62
- - If relevant, include the user role.
63
- - Skip preconditions that are not needed or repeat the suite description.
64
- - Do not include preconditions like "service is running" unless the user explicitly mentioned them or the test is about them.
65
-
66
- ## Steps
67
-
68
- A step consists of an action (with optional test data) and an expected result.
69
-
70
- Test steps use the `## Steps` header section with a nested markdown list format:
71
-
72
- ```markdown
73
- ## Steps
74
-
75
- - (Step Action)
76
- *Expected*: ... (Observable behavior)
77
- - ...
78
- *Expected*: ...
79
- ```
80
-
81
- e.g.
82
-
83
- ```markdown
84
- ## Steps
85
-
86
- - Navigate to the login page
87
- *Expected*: Login form is displayed with username and password fields
88
- - Enter a valid username and password
89
- *Expected*: Credentials are entered without errors
90
- - Click the "Login" button
91
- *Expected*: User is redirected to the dashboard
92
- ```
93
-
94
- Step format rules:
95
-
96
- - Steps must be under a `## Steps` heading.
97
- - Use nested markdown lists (bulleted `-`/`*` or numbered `1.`).
98
- - Top-level items describe the action to perform.
99
- - Nested items with `*Expected*` (or `*Expected*:`, `*Expected result*`) describe the observable behavior.
100
- - Expected results should be specific and verifiable.
101
-
102
- Step content rules:
103
-
104
- - Each step is a simple sentence. Avoid commas and sub-sentences.
105
- - Steps are mechanical: click, send, read, assert.
106
- - Each step includes exact instructions with concrete, realistic values a tester can act on directly.
107
- - Do NOT parametrize by default — first-pass test cases should read as executable manual steps, not templates.
108
- - Use a placeholder variable like `${domain}` only when the value is genuinely reused across steps or is data-driven (see the Examples section in the format reference). A plain UI/API acceptance step needs concrete values, not placeholders.
109
- - Do not turn data unrelated to the test into placeholders.
110
- - Do not add preconditions as placeholders.
111
- - Prefer URL paths over full URLs, e.g. `/auth/login`.
112
- - Use specific values when they are important for the scenario (boundary values, format validation, locale-specific input).
113
- - Avoid vague qualifiers like "small", "known", "around", "e.g.", "like", "(…)"; replace them with concrete, literal values.
114
- - Avoid general statements in steps. Move them to the description.
115
- - Do not chain multiple distinct actions or use unnecessary And / Or combinations in a single step.
116
- - All step actions must be clear to perform via public API or UI.
117
- - All checks/verifications/assertions belong in the expected result, not in the step action.
118
- - A code block may follow a step when needed: API request, SQL, shell command, pseudocode, etc.
119
-
120
- If an expected result has multiple conditions, split them into separate lines.
121
-
122
- Instead of:
123
-
124
- `*Expected*: Comment appears in the Run's comment list with the current user as author`
125
-
126
- Use:
127
-
128
- `*Expected*: Comment appears in the Run's comment list`
129
- `*Expected*: Current user is the author`
130
-
131
- ### Bold and italic in steps
132
-
133
- Use sparingly. Each style serves one purpose; otherwise write plain text.
134
-
135
- - **bold** — UI elements the user interacts with: buttons, links, fields, tabs, checkboxes, modals (e.g. `Click **Save**`, `Open **Settings** tab`).
136
- - *italic* — names of pages/screens/documents referenced as context (e.g. `Open the *Privacy Policy* page`).
137
-
138
- Avoid:
139
-
140
- - Bold/italic on full sentences or whole steps.
141
- - Combining bold and italic (`***...***`).
142
- - Emphasis for visual weight; rephrase or split the step instead.
143
- - Bold/italic in place of a placeholder (`[url]`) or a code block.
144
-
145
- ## AI Writing Patterns to Avoid
146
-
147
- Be specific, not grandiose. Say what it actually does. Avoid marketing language and emojis (unless explicitly intended).
148
-
149
- Avoid:
150
-
151
- - Puffery: pivotal, crucial, vital, testament, enduring legacy, indelible mark, deeply rooted, profound heritage, steadfast dedication, key turning point
152
- - Promotional adjectives: groundbreaking (figurative), seamless/seamlessly, robust, cutting-edge, vibrant, nuanced, multifaceted, intricate/intricacies, stunning natural beauty
153
- - Overused AI vocabulary: delve/delves, leverage/leveraging, foster/fostering, realm, tapestry, landscape, interplay, streamline, shed light on, garnered, notably, key (as adjective)
154
- - Empty "-ing" phrases: ensuring, showcasing, highlighting, emphasizing, reflecting, underscoring, aligning with, contributing to, enhancing, underpinning
155
- - Filler frames: stands/serves as, is a testament/reminder, plays a vital/significant/crucial/pivotal role, underscores/highlights its importance, reflects broader, symbolizing its ongoing/enduring/lasting impact, continues to captivate, nestled in the heart of, boasts a
156
- - Hedges and closers: it's important/critical/crucial to note/remember/consider, may vary, In summary, In conclusion, Overall
157
- - "Challenges/Legacy" framing: Despite its... faces several challenges, Despite these challenges, Challenges and Legacy, Future Outlook
158
- - Parallel "not/but/however" constructions: "Not only ... but ...", "It is not just about ..., it's ..." — common in LLM writing but unsuitable for a neutral tone
159
- - Formatting overuse: excessive bullets, emoji decorations, bold on every other word
@@ -1,152 +0,0 @@
1
- ---
2
- name: scan-automation-project
3
- description: Scan project source code to inventory languages, frameworks, and existing tests (manual `*.test.md` and automated test files). Use this skill whenever analyzing a codebase for test planning, detecting test frameworks, or preparing for test automation. Specifically, when the user mentions "scan project", "what tests exist", "analyze codebase", "detect frameworks", "test matrix", or needs a codebase inventory before a QA workflow.
4
- license: MIT
5
- metadata:
6
- author: Testomat.io
7
- version: 1.0.0
8
- ---
9
-
10
- # Scan Automation Project
11
-
12
- Scan project source code and return a QA-focused inventory: languages, frameworks, and existing tests.
13
-
14
- **Shallow scan only.** No full import resolution, no line-by-line parsing, no reading full test implementations. High-level structure only.
15
-
16
- ## Step 1: Locate Source Code
17
-
18
- - If the project root has non-empty source folders or files, go to Step 2.
19
- - If **no source** files are found, stop and ask the user:
20
-
21
- ```
22
- ❓ No application source code detected (folder may be empty or missing).
23
- Where is the source code?
24
- 1. Use local project from another folder (I will create a symlink)
25
- 2. Clone from Git repo
26
- 3. I don't know yet (stop here)
27
- ```
28
-
29
- - Wait for the user's reply.
30
- - If the user gives a Git repo or another folder, clone or symlink it into `.testeiya/code/`. No-op if it is already there.
31
-
32
- ### Rule for pulled data
33
-
34
- **When you need to pull external data** (manual test cases, app code, e2e tests from another repo) into this project:
35
-
36
- | This project has | Store pulled data in | Gitignored? |
37
- | ------------------ | ---------------------- | ----------- |
38
- | **Source code** (`src/` folder) or **big project** | `.testeiya/…` | **Yes** |
39
- | **Only test infrastructure** (e2e dirs like `tests/`, `playwright/`, `cypress/` but no `src/`) | `manual-tests/` or `e2e-tests/` | No |
40
- | **Empty / manual-only** | `manual-tests/` | No |
41
-
42
- Detection logic:
43
- 1. Has `src/` folder or is a monorepo? → Use `.testeiya/`
44
- 2. Has e2e test dirs (`tests/`, `playwright/`, `cypress/`, `e2e/`)? → Use tracked folder (`manual-tests/`, `e2e-tests/`)
45
- 3. Otherwise → Default to `manual-tests/`
46
-
47
- - Any skill that creates `.testeiya/...` must also add `.testeiya/` to the project's `.gitignore` — but only if it is not there yet. Never add it twice.
48
- - The rule covers *pulled* data only. Output a skill *produces* and the user wants — a `coverage.*.yml`, new `*.test.md` files — goes in the repo as normal.
49
- - On a source repo with no manual tests, this skill changes no tracked file: it only creates the gitignored `.testeiya/` directory and, if needed, adds one line to `.gitignore`.
50
- - **Only touch `.testeiya/` and tracked folders — never pollute the repo with cache in a wrong location.**
51
-
52
- ## Step 2: Project Analysis
53
-
54
- Collect source file paths only. **Do NOT read file contents.**
55
-
56
- Include:
57
- - Application source files.
58
- - View/template files: `.html`/`.htm`, `.vue`, `.svelte`, `.hbs`/`.handlebars`, `.ejs`, `.pug`/`.jade`, `.mustache`, `.liquid`, `.erb`, `.haml`, `.slim`, `.blade.php`, `.twig`, `.j2`/`.jinja`/`.jinja2`, `.cshtml`/`.razor`, `.jsp`. They are application source — coverage skills map UI changes through them.
59
-
60
- Exclude:
61
- - Dependencies, build output, coverage, reports, caches, config, lock, and environment files.
62
- - Paths ignored by `.gitignore` — but **not** `.testeiya/code/`. In a manual-tests repo the app code lives there; scan it as source.
63
- - Testeiya internal files (e.g. `session-factory.ts`, `system-prompt.ts`).
64
- - **If in doubt**, exclude.
65
-
66
- From the file list:
67
- - Detect languages and frameworks. Collect one `frameworks` list with ALL application and testing frameworks.
68
- - Extract the project name from a project config file (`package.json`, `Cargo.toml`, `pom.xml`, ...); fall back to the root directory name.
69
- - Rate complexity by source file count:
70
-
71
- | File Count | Complexity |
72
- |------------|--------------|
73
- | 1-30 | `small` |
74
- | 31-150 | `moderate` |
75
- | 151-500 | `large` |
76
- | 500+ | `very-large` |
77
-
78
- ## Step 3: Test Inventory (optional)
79
-
80
- Detect existing tests, automated and manual. Stay shallow.
81
-
82
- Automated tests:
83
- - Detect frameworks via config files (`jest.config.*`, `playwright.config.*`, `vitest.config.*`, `pytest.ini`, `pom.xml`, ...), project dependencies, and test file patterns (`*.test.*`, `*.spec.*`, `*_test.*`).
84
- - For each framework: identify its test file pattern and count matching files.
85
-
86
- Manual tests:
87
- - Find all `.test.md` files and parse test titles. `find .` also looks inside `.testeiya/manual-tests/`, so a re-run after a pull finds the cached cases instead of reporting "no manual tests":
88
-
89
- ```bash
90
- find . -name "*.test.md" -exec awk '
91
- /^<!-- test/ { in_block=1; kind="TEST"; next }
92
- /^<!-- suite/ { in_block=1; kind="SUITE"; next }
93
- in_block && /^-->/ { in_block=0; expect=1; next }
94
- expect && /^#+[[:space:]]+/ {
95
- title=$0; sub(/^#+[[:space:]]+/, "", title)
96
- if (kind == "SUITE") printf "SUITE: %s\n", title
97
- else printf "|- %s\n", title
98
- expect=0
99
- }
100
- ' {} +
101
- ```
102
-
103
- - If the only `.test.md` files are under `.testeiya/manual-tests/`, say so in the inventory: they came from Testomat.io, not from this repo.
104
-
105
- ## Step 4: Output
106
-
107
- Return one structured markdown result directly. **Do NOT save to a file.**
108
-
109
- ```markdown
110
- # Project Overview
111
-
112
- - **Project Name:** acme-web-app
113
- - **Description:** A React-based customer dashboard with an Express API.
114
- - **Languages:** TypeScript, SQL
115
- - **Frameworks:** React, Express, Jest, Playwright
116
- - **Complexity:** small (12 files)
117
-
118
- ## Test Inventory
119
-
120
- - **Automated Tests:** 10 files
121
- - **Manual Tests:** 37 cases
122
-
123
- ### Manual Tests (20 of 37 shown)
124
-
125
- - SUITE: Authentication
126
- |- User can login
127
- |- User can reset password
128
- - SUITE: Billing
129
- |- User can view invoice
130
- ...and 17 more
131
-
132
- ### Automated Tests (10 of 10 shown)
133
-
134
- - home.page.spec.ts
135
- ...
136
- ```
137
-
138
- Field rules:
139
- - **Description:** 1-2 sentences based only on detected source code and folder structure (include the domain area if that makes sense).
140
- - **Complexity:** one of `small` | `moderate` | `large` | `very-large`, plus the file count.
141
- - **Manual Tests:** preserve hierarchy as plain strings — SUITE items as parent bullets, test titles (`|-`) as nested children.
142
- - **Automated Tests:** list of detected test files.
143
- - All values must come from observable files. Do NOT guess missing data or add fields not shown above.
144
-
145
- Sections:
146
- - If Step 3 was skipped or found no tests, omit `## Test Inventory` and note that the project contains no tests; the `# Project Overview` section is still useful for next steps.
147
- - If one test type is absent, note it with a blockquote, e.g. ``> No manual tests (`.test.md`) found in the project.``
148
-
149
- Test listing truncation:
150
- - Show at most the first 20 entries per list, in original file order.
151
- - Mark truncation in the heading (`(20 of 37 shown)`) and with `...and N more`.
152
- - Do not print full test listings beyond that.
@@ -1,107 +0,0 @@
1
- ---
2
- name: sync-test-cases-with-tms
3
- description: Synchronize test scenarios and cases between a local project and Testomat.io. Use this skill whenever the user wants to pull/export/download tests from Testomat.io; or push/import/sync new or updated test cases back to the TMS in corresponding `*.test.md` format. Supports custom directories, markdown test format and advanced import/export workflows.
4
- inputs:
5
- testDir:
6
- description: "Target directory for pulled tests"
7
- required: false
8
- license: MIT
9
- metadata:
10
- author: Testomat.io
11
- version: 1.0.0
12
- ---
13
-
14
- # Sync Test Cases with TMS
15
-
16
- Sync Markdown test cases (`*.test.md`) between the local project and Testomat.io.
17
-
18
- Use when the user wants to:
19
- - Pull/export/download tests from Testomat.io to local Markdown files.
20
- - Push/upload/import local Markdown tests to Testomat.io.
21
- - Bulk edit: pull cases -> edit locally -> push back to TMS.
22
-
23
- ## Setup
24
-
25
- - Check for the `TESTOMATIO` token: skill input -> `.env` in project root -> ask the user.
26
- - Save the token to `.env`: `TESTOMATIO=tstmt_xxxxx`.
27
- - If the user has no key: get it in Testomat.io under **Settings → Project → Project Reporting API key** (`https://app.testomat.io/projects/<project-id>/settings/project`).
28
-
29
- ## Running the CLI
30
-
31
- - Run `check-tests` via `npx`. Do not install it as a project dependency.
32
- - **The first `check-tests` call in the session must be `npx check-tests@latest …`** to resolve the latest version. All later calls in the same session use plain `npx check-tests …`.
33
- - **Use only options documented here, in [TESTOMATIO_CLI.md](./references/TESTOMATIO_CLI.md), or listed by `npx check-tests --help`. Do not invent options** (e.g. `--pattern`, `--force`).
34
-
35
- ## Pull
36
-
37
- Downloads test scenarios from Testomat.io and saves them as local Markdown files.
38
-
39
- Directory selection — if the `testDir` input is provided or the user passes `-d <path>`, use that path. Otherwise:
40
- - Workspace is empty or for manual tests only: pull to root.
41
- - End-to-end testing project: pull to the `manual-tests` directory.
42
- - Any other case: pull to `.testeiya/manual-tests` (ensure `.testeiya/` exists and is gitignored).
43
-
44
- Cache-folder rules:
45
- - Default pull target is the gitignored cache `.testeiya/manual-tests/`. Add `.testeiya/` to the project `.gitignore` if it is not there yet.
46
- - **Pulled cases must never land in a tracked folder** (`manual-tests/`, etc.) — that pollutes the repo.
47
- - Being gitignored does not block editing the files or pushing them back.
48
- - If the repo already keeps its `*.test.md` files in a tracked folder, don't pull — work with them in place, or pass `-d <that folder>` for an in-place refresh.
49
- - This matches `scan-automation-project`, which pulls the *code* into `.testeiya/code/` when it runs inside a manual-tests repo.
50
-
51
- ```bash
52
- npx check-tests pull -d .testeiya/manual-tests
53
- ```
54
-
55
- - To pull only specific suites (user names a suite or gives suite IDs): `npx check-tests pull --suite-ids "@S12345678,@S87654321"`.
56
- - More pull options: [TESTOMATIO_CLI.md](./references/TESTOMATIO_CLI.md).
57
-
58
- ## Push
59
-
60
- Uploads local Markdown tests to Testomat.io.
61
-
62
- Pre-push file filtering — push only test case files, never project docs or requirements:
63
- - Include files matching `*.test.md`, or Markdown files with valid `<!-- test ... -->` blocks.
64
- - Ignore all other Markdown (`README.md`, `CHANGELOG.md`, documentation).
65
- - If test cases live alongside other files, copy or move the test files into `.testeiya/manual-tests/` first.
66
-
67
- Pre-push validation:
68
- 1. At least one `*.test.md` file exists.
69
- 2. Each file contains a valid test block:
70
-
71
- ```md
72
- <!-- test
73
- priority: ...
74
- creator: ...
75
- tags: ...
76
- labels: ...
77
- -->
78
- # ... (test case title)
79
-
80
- ... (test case description)
81
- ```
82
-
83
- ```bash
84
- # Specific files (preferred when known)
85
- npx check-tests push --files login.test.md checkout.test.md
86
-
87
- # Testeiya cache folder
88
- npx check-tests push -d .testeiya/manual-tests
89
- ```
90
-
91
- - **When the files to push are known** (e.g. just produced by `qa-write-test-cases` / `improve-test-cases`), **pass them explicitly via `--files`** (alias `-f`). Without `--files` the CLI falls back to the default glob `**/*.test.md`, which may pick up unrelated files.
92
- - Quote glob patterns. Paths resolve relative to `--dir`.
93
- - Use `-d` when `.testeiya` or `manual-tests` directories exist.
94
- - **Push only the test cases directory** (e.g. `.testeiya/manual-tests`, not `.testeiya/`).
95
- - More push options and examples: [TESTOMATIO_CLI.md](./references/TESTOMATIO_CLI.md).
96
-
97
- ## Summary Output
98
-
99
- After syncing, print a short log-style summary:
100
-
101
- ```
102
- Sync Complete:
103
- - Action: pull/push
104
- - Directory: <path>
105
- - Tests synced: 15
106
- - Status: Success
107
- ```
@@ -1,140 +0,0 @@
1
- # Testomat.io CLI Documentation
2
-
3
- This document provides comprehensive information about the `check-tests` CLI commands, which synchronizes test scenarios, and interacts with Testomat.io test cases from your local project with TMS.
4
-
5
- ---
6
-
7
- ## Prerequisites
8
-
9
- ### Run check-tests via npx (always latest)
10
-
11
- Invoke `check-tests` through `npx` so users automatically pick up the newest published version:
12
-
13
- ```bash
14
- # First invocation in the agent session — forces resolve of latest
15
- npx check-tests@latest <command>
16
-
17
- # Subsequent invocations in the same session could be used without @latest
18
- npx check-tests <command>
19
- ```
20
-
21
- Do not install `check-tests` as a project dependency. The first call (with `@latest` version specified) refreshes the npx cache; next calls in the same session reuse it without an extra registry round-trip. A new agent session re-triggers the `@latest` check so users use the latest version over time.
22
-
23
- ---
24
-
25
- ## Environment Variables
26
-
27
- The tool supports loading environment variables from `.env` files using dotenv.
28
-
29
- ### Testomat.io Configuration
30
-
31
- | Variable | Description | Required |
32
- | ------------------------ | ------------------------------------------------------ | ------------------------------------- |
33
- | `TESTOMATIO` | API key for Testomat.io (format: tstmt_xxxxx) | Yes (for sync operations) |
34
- | `TESTOMATIO_URL` | Testomat.io server URL | No (default: https://app.testomat.io) |
35
- | `TESTOMATIO_WORKDIR` | Working directory for relative file paths | No |
36
- | `TESTOMATIO_PREPEND_DIR` | Directory to prepend to test paths | No |
37
- | `TESTOMATIO_LABELS` | Comma-separated labels. Supports `label:value` | No |
38
-
39
- ### Configuration File
40
-
41
- Save credentials to `.env` file:
42
-
43
- ```env
44
- TESTOMATIO=tstmt_xxxxx
45
- TESTOMATIO_URL=https://app.testomat.io
46
- ...
47
- ```
48
-
49
- ---
50
-
51
- ## CLI Options
52
-
53
- ### Basic "check-tests" Options
54
-
55
- | Option | Description | Default |
56
- | --------------------- | ------------------------------------------- | ----------------------------|
57
- | `-h, --help` | Display help information | - |
58
- | `-d, --dir <dir>` | Test directory to scan | Current dir (default: `.`) |
59
- | `--suite-ids <ids>` | Comma-separated suite IDs to pull (e.g. `@S12345678, @S456r4342`) | - |
60
-
61
- ### Testomat.io Integration Specific Project Options
62
-
63
- | Option | Description | Default |
64
- | ----------------------------- | ------------------------------------------------------------- | ------- |
65
- | `--update-ids` | Update test and suite with Testomat.io IDs | false |
66
- | `--keep-structure` | Prefer structure of source code over structure in Testomat.io | false |
67
- | `--no-empty` | Remove empty suites after import | false |
68
- | `--clean-ids` | Remove Testomat.io IDs from test and suite | false |
69
-
70
- ---
71
-
72
- ## Commands
73
-
74
- ### Pull
75
-
76
- Retrieve the latest test scenarios from Testomat.io and save them as Markdown files locally.
77
-
78
- ```bash
79
- npx check-tests pull [options]
80
- ```
81
-
82
- **Examples:**
83
-
84
- ```bash
85
- # Export tests to current directory
86
- npx check-tests pull
87
-
88
- # Export tests to manual-tests folder
89
- npx check-tests pull -d manual-tests
90
-
91
- # Keep source structure
92
- npx check-tests pull -d manual-tests --keep-structure
93
-
94
- # Pull specific suites only
95
- npx check-tests pull --suite-ids "@S12345678,@S87654321"
96
- ```
97
-
98
- ### Push
99
-
100
- Send local Markdown test updates to Testomat.io. (Equivalent to `check-tests manual <files> --update-ids`.)
101
-
102
- ```bash
103
- npx check-tests push [options]
104
- ```
105
-
106
- `--files` (alias `-f`) accepts file paths, glob patterns, or a mix; defaults to `**/*.test.md`. Paths resolve relative to `--dir`. Quote globs.
107
-
108
- **Best practice:** when the files to push are known, list them explicitly via `--files` rather than relying on the default glob.
109
-
110
- **Examples:**
111
-
112
- ```bash
113
- # Default glob (**/*.test.md)
114
- npx check-tests push
115
-
116
- # Specific files
117
- npx check-tests push -f docs/login.test.md docs/checkout.test.md
118
-
119
- # Glob (quoted)
120
- npx check-tests push --files "manual-tests/**/*.test.md"
121
-
122
- # Multiple globs
123
- npx check-tests push -f "smoke/**/*.test.md" "regression/**/*.test.md"
124
-
125
- # With labels
126
- TESTOMATIO_LABELS=smoke,updated npx check-tests push
127
- ```
128
-
129
- ---
130
-
131
- ## Quick Reference
132
-
133
- | Action | Command |
134
- | --------------- | -------------------------------------------------------------- |
135
- | Pull tests | `npx check-tests pull -d <dir>` |
136
- | Push files | `npx check-tests push --files <file1.test.md> <file2.test.md>` |
137
- | Push glob | `npx check-tests push --files "<dir>/**/*.test.md"` |
138
- | Push directory | `npx check-tests push -d <dir>` (glob: `**/*.test.md`) |
139
- | With labels | `TESTOMATIO_LABELS=smoke npx check-tests push` |
140
- | Keep structure | `npx check-tests pull --keep-structure` |