testeiya 0.2.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (369) hide show
  1. package/README.md +212 -0
  2. package/models.catalog.json +6963 -0
  3. package/package.json +71 -0
  4. package/skills/codeceptjs/ci-fix-tests/SKILL.md +120 -0
  5. package/skills/codeceptjs/codeceptjs-auth/SKILL.md +158 -0
  6. package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +91 -0
  7. package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +158 -0
  8. package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +90 -0
  9. package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +234 -0
  10. package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +110 -0
  11. package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +306 -0
  12. package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +352 -0
  13. package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +472 -0
  14. package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +350 -0
  15. package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +81 -0
  16. package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +206 -0
  17. package/skills/playwright-best-practices-skill/LICENSE.md +7 -0
  18. package/skills/playwright-best-practices-skill/README.md +147 -0
  19. package/skills/playwright-best-practices-skill/SKILL.md +303 -0
  20. package/skills/playwright-best-practices-skill/advanced/authentication-flows.md +360 -0
  21. package/skills/playwright-best-practices-skill/advanced/authentication.md +871 -0
  22. package/skills/playwright-best-practices-skill/advanced/clock-mocking.md +364 -0
  23. package/skills/playwright-best-practices-skill/advanced/mobile-testing.md +409 -0
  24. package/skills/playwright-best-practices-skill/advanced/multi-context.md +288 -0
  25. package/skills/playwright-best-practices-skill/advanced/multi-user.md +393 -0
  26. package/skills/playwright-best-practices-skill/advanced/network-advanced.md +452 -0
  27. package/skills/playwright-best-practices-skill/advanced/third-party.md +464 -0
  28. package/skills/playwright-best-practices-skill/architecture/pom-vs-fixtures.md +363 -0
  29. package/skills/playwright-best-practices-skill/architecture/test-architecture.md +369 -0
  30. package/skills/playwright-best-practices-skill/architecture/when-to-mock.md +383 -0
  31. package/skills/playwright-best-practices-skill/browser-apis/browser-apis.md +391 -0
  32. package/skills/playwright-best-practices-skill/browser-apis/iframes.md +403 -0
  33. package/skills/playwright-best-practices-skill/browser-apis/service-workers.md +504 -0
  34. package/skills/playwright-best-practices-skill/browser-apis/websockets.md +403 -0
  35. package/skills/playwright-best-practices-skill/core/annotations.md +424 -0
  36. package/skills/playwright-best-practices-skill/core/assertions-waiting.md +361 -0
  37. package/skills/playwright-best-practices-skill/core/configuration.md +452 -0
  38. package/skills/playwright-best-practices-skill/core/fixtures-hooks.md +417 -0
  39. package/skills/playwright-best-practices-skill/core/global-setup.md +434 -0
  40. package/skills/playwright-best-practices-skill/core/locators.md +242 -0
  41. package/skills/playwright-best-practices-skill/core/page-object-model.md +315 -0
  42. package/skills/playwright-best-practices-skill/core/projects-dependencies.md +453 -0
  43. package/skills/playwright-best-practices-skill/core/test-data.md +492 -0
  44. package/skills/playwright-best-practices-skill/core/test-suite-structure.md +361 -0
  45. package/skills/playwright-best-practices-skill/core/test-tags.md +298 -0
  46. package/skills/playwright-best-practices-skill/debugging/console-errors.md +420 -0
  47. package/skills/playwright-best-practices-skill/debugging/debugging.md +504 -0
  48. package/skills/playwright-best-practices-skill/debugging/error-testing.md +360 -0
  49. package/skills/playwright-best-practices-skill/debugging/flaky-tests.md +496 -0
  50. package/skills/playwright-best-practices-skill/frameworks/angular.md +530 -0
  51. package/skills/playwright-best-practices-skill/frameworks/nextjs.md +469 -0
  52. package/skills/playwright-best-practices-skill/frameworks/react.md +531 -0
  53. package/skills/playwright-best-practices-skill/frameworks/vue.md +574 -0
  54. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/ci-cd.md +468 -0
  55. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/docker.md +283 -0
  56. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/github-actions.md +546 -0
  57. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/gitlab.md +397 -0
  58. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/other-providers.md +521 -0
  59. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/parallel-sharding.md +371 -0
  60. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/performance.md +453 -0
  61. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/reporting.md +424 -0
  62. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/test-coverage.md +497 -0
  63. package/skills/playwright-best-practices-skill/testing-patterns/accessibility.md +359 -0
  64. package/skills/playwright-best-practices-skill/testing-patterns/api-testing.md +719 -0
  65. package/skills/playwright-best-practices-skill/testing-patterns/browser-extensions.md +506 -0
  66. package/skills/playwright-best-practices-skill/testing-patterns/canvas-webgl.md +493 -0
  67. package/skills/playwright-best-practices-skill/testing-patterns/component-testing.md +500 -0
  68. package/skills/playwright-best-practices-skill/testing-patterns/drag-drop.md +576 -0
  69. package/skills/playwright-best-practices-skill/testing-patterns/electron.md +509 -0
  70. package/skills/playwright-best-practices-skill/testing-patterns/file-operations.md +377 -0
  71. package/skills/playwright-best-practices-skill/testing-patterns/file-upload-download.md +562 -0
  72. package/skills/playwright-best-practices-skill/testing-patterns/forms-validation.md +561 -0
  73. package/skills/playwright-best-practices-skill/testing-patterns/graphql-testing.md +331 -0
  74. package/skills/playwright-best-practices-skill/testing-patterns/i18n.md +508 -0
  75. package/skills/playwright-best-practices-skill/testing-patterns/performance-testing.md +476 -0
  76. package/skills/playwright-best-practices-skill/testing-patterns/security-testing.md +430 -0
  77. package/skills/playwright-best-practices-skill/testing-patterns/visual-regression.md +634 -0
  78. package/skills/playwright-cli/SKILL.md +420 -0
  79. package/skills/playwright-cli/references/element-attributes.md +23 -0
  80. package/skills/playwright-cli/references/playwright-tests.md +39 -0
  81. package/skills/playwright-cli/references/request-mocking.md +87 -0
  82. package/skills/playwright-cli/references/running-code.md +241 -0
  83. package/skills/playwright-cli/references/session-management.md +225 -0
  84. package/skills/playwright-cli/references/storage-state.md +275 -0
  85. package/skills/playwright-cli/references/test-generation.md +433 -0
  86. package/skills/playwright-cli/references/tracing.md +139 -0
  87. package/skills/playwright-cli/references/video-recording.md +143 -0
  88. package/skills/testeiya/README.md +29 -0
  89. package/skills/testeiya/answer-formatting/SKILL.md +30 -0
  90. package/skills/testeiya/check-cucumber/SKILL.md +200 -0
  91. package/skills/testeiya/check-tests/SKILL.md +260 -0
  92. package/skills/testeiya/manual-run-assistant/SKILL.md +61 -0
  93. package/skills/testeiya/testomatio-docs/INDEX.md +175 -0
  94. package/skills/testeiya/testomatio-docs/SKILL.md +102 -0
  95. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +144 -0
  96. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +531 -0
  97. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +437 -0
  98. package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +191 -0
  99. package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +277 -0
  100. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +39 -0
  101. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +122 -0
  102. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +170 -0
  103. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +53 -0
  104. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +98 -0
  105. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +151 -0
  106. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +377 -0
  107. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +267 -0
  108. package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +138 -0
  109. package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +220 -0
  110. package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +48 -0
  111. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +201 -0
  112. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +94 -0
  113. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +243 -0
  114. package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +135 -0
  115. package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +394 -0
  116. package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +290 -0
  117. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +96 -0
  118. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +94 -0
  119. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +106 -0
  120. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +115 -0
  121. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +120 -0
  122. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +88 -0
  123. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +151 -0
  124. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +121 -0
  125. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +96 -0
  126. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +31 -0
  127. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +54 -0
  128. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +34 -0
  129. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +31 -0
  130. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +93 -0
  131. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +131 -0
  132. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +164 -0
  133. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +29 -0
  134. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +67 -0
  135. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +94 -0
  136. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +53 -0
  137. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +71 -0
  138. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +52 -0
  139. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +60 -0
  140. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +267 -0
  141. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +82 -0
  142. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +73 -0
  143. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +207 -0
  144. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +204 -0
  145. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +95 -0
  146. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +75 -0
  147. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +33 -0
  148. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +108 -0
  149. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +66 -0
  150. package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +95 -0
  151. package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +94 -0
  152. package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +26 -0
  153. package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +32 -0
  154. package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +242 -0
  155. package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +140 -0
  156. package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +76 -0
  157. package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +363 -0
  158. package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +41 -0
  159. package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +240 -0
  160. package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +326 -0
  161. package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +75 -0
  162. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +49 -0
  163. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +285 -0
  164. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +67 -0
  165. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +138 -0
  166. package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +87 -0
  167. package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +546 -0
  168. package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +326 -0
  169. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +386 -0
  170. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +378 -0
  171. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +112 -0
  172. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +127 -0
  173. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +63 -0
  174. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +49 -0
  175. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +41 -0
  176. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +39 -0
  177. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +37 -0
  178. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +117 -0
  179. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +93 -0
  180. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +44 -0
  181. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +117 -0
  182. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +44 -0
  183. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +47 -0
  184. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +82 -0
  185. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +55 -0
  186. package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +334 -0
  187. package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +104 -0
  188. package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +176 -0
  189. package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +195 -0
  190. package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +203 -0
  191. package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +455 -0
  192. package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +137 -0
  193. package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +329 -0
  194. package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +342 -0
  195. package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +256 -0
  196. package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +331 -0
  197. package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +633 -0
  198. package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +223 -0
  199. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +68 -0
  200. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +181 -0
  201. package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +98 -0
  202. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +354 -0
  203. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +169 -0
  204. package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +156 -0
  205. package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +412 -0
  206. package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +527 -0
  207. package/skills/testeiya/testomatio-docs/docs/support/index.md +75 -0
  208. package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +388 -0
  209. package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +215 -0
  210. package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +247 -0
  211. package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +490 -0
  212. package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +144 -0
  213. package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +48 -0
  214. package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +248 -0
  215. package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +138 -0
  216. package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +77 -0
  217. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +72 -0
  218. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +23 -0
  219. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +18 -0
  220. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +63 -0
  221. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +29 -0
  222. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +80 -0
  223. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +57 -0
  224. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +331 -0
  225. package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +229 -0
  226. package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +325 -0
  227. package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +159 -0
  228. package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +164 -0
  229. package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +85 -0
  230. package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +163 -0
  231. package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +125 -0
  232. package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +478 -0
  233. package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +207 -0
  234. package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +218 -0
  235. package/skills/testeiya/testomatio-docs/docs.lock.json +6 -0
  236. package/skills/testeiya/testomatio-reporter/SKILL.md +307 -0
  237. package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +88 -0
  238. package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +95 -0
  239. package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +334 -0
  240. package/skills/testomatio/test-automation/automate-manual-test-cases/CLAUDE.md +56 -0
  241. package/skills/testomatio/test-automation/automate-manual-test-cases/SKILL.md +242 -0
  242. package/skills/testomatio/test-automation/automate-manual-test-cases/references/CODECEPTJS_BEST_PRACTICES.md +182 -0
  243. package/skills/testomatio/test-automation/automate-manual-test-cases/references/FINAL_SUMMARY_TEMPLATE.md +22 -0
  244. package/skills/testomatio/test-automation/automate-manual-test-cases/references/PLAYWRIGHT_BEST_PRACTICES.md +90 -0
  245. package/skills/testomatio/test-automation/automate-manual-test-cases/references/POM_BEST_PRACTICES.md +53 -0
  246. package/skills/testomatio/test-automation/automate-manual-test-cases/references/TEST_DATA_MANAGEMENT.md +52 -0
  247. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/SKILL.md +107 -0
  248. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/references/DEBUGGING_QUICK_REFERENCE.md +113 -0
  249. package/skills/testomatio/test-automation/qa-automation-test-consolidation/SKILL.md +29 -0
  250. package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +151 -0
  251. package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +199 -0
  252. package/skills/testomatio/test-automation/testomat-allure-adapter/SKILL.md +289 -0
  253. package/skills/testomatio/test-management/detect-duplicate-test-cases/SKILL.md +86 -0
  254. package/skills/testomatio/test-management/detect-duplicate-test-cases/references/DUPLICATE_INSTRUCTIONS.md +54 -0
  255. package/skills/testomatio/test-management/improve-test-cases/SKILL.md +114 -0
  256. package/skills/testomatio/test-management/improve-test-cases/references/TESTOMAT_MARKDOWN_EXAMPLE.md +66 -0
  257. package/skills/testomatio/test-management/pull-request-diff-analyzer/SKILL.md +141 -0
  258. package/skills/testomatio/test-management/qa-e2e-tests-reporting/SKILL.md +354 -0
  259. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_ARTIFACTS.md +82 -0
  260. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_HTML_REPORT.md +37 -0
  261. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_REPORTERS_CONFIG.md +118 -0
  262. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/SKILL.md +149 -0
  263. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/references/summary-example.md +54 -0
  264. package/skills/testomatio/test-management/qa-requirement-reviewer/SKILL.md +126 -0
  265. package/skills/testomatio/test-management/qa-requirement-reviewer/references/requirements_reviewer_examples.md +128 -0
  266. package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +174 -0
  267. package/skills/testomatio/test-management/qa-test-code-coverage/references/COVERAGE_FILE_FORMAT.md +138 -0
  268. package/skills/testomatio/test-management/qa-test-code-coverage/references/E2E_FRAMEWORKS.md +65 -0
  269. package/skills/testomatio/test-management/qa-test-code-coverage/scripts/check-coverage.mjs +40 -0
  270. package/skills/testomatio/test-management/qa-thinking/SKILL.md +36 -0
  271. package/skills/testomatio/test-management/qa-write-test-cases/SKILL.md +267 -0
  272. package/skills/testomatio/test-management/qa-write-test-cases/references/test-case-format.md +387 -0
  273. package/skills/testomatio/test-management/qa-write-test-cases/references/testomat-tms-guide.md +72 -0
  274. package/skills/testomatio/test-management/qa-write-test-cases/references/writing-rule.md +159 -0
  275. package/skills/testomatio/test-management/scan-automation-project/SKILL.md +152 -0
  276. package/skills/testomatio/test-management/sync-test-cases-with-tms/SKILL.md +107 -0
  277. package/skills/testomatio/test-management/sync-test-cases-with-tms/references/TESTOMATIO_CLI.md +140 -0
  278. package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +182 -0
  279. package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +169 -0
  280. package/skills.lock.json +72 -0
  281. package/skills.yaml +21 -0
  282. package/src/ai-debug.ts +188 -0
  283. package/src/api/agent-get.ts +22 -0
  284. package/src/api/agent-start.ts +384 -0
  285. package/src/api/client-log.ts +29 -0
  286. package/src/api/context.ts +332 -0
  287. package/src/api/debug-layout.ts +47 -0
  288. package/src/api/debug-report.ts +29 -0
  289. package/src/api/debug-snapshot.ts +30 -0
  290. package/src/api/debug-stream.ts +52 -0
  291. package/src/api/files-delete.ts +184 -0
  292. package/src/api/files-read.ts +41 -0
  293. package/src/api/files-rename.ts +99 -0
  294. package/src/api/files-tree.ts +292 -0
  295. package/src/api/files-write.ts +41 -0
  296. package/src/api/mcp.ts +603 -0
  297. package/src/api/memory.ts +69 -0
  298. package/src/api/open-external.ts +39 -0
  299. package/src/api/playwright-cli.ts +606 -0
  300. package/src/api/providers.ts +457 -0
  301. package/src/api/read-env-token.ts +33 -0
  302. package/src/api/sessions.ts +79 -0
  303. package/src/api/settings.ts +120 -0
  304. package/src/api/skills.ts +58 -0
  305. package/src/api/testomatio-attachment.ts +89 -0
  306. package/src/api/testomatio-auth.ts +284 -0
  307. package/src/api/testomatio-proxy.ts +197 -0
  308. package/src/api/testomatio-run-stats.ts +81 -0
  309. package/src/api/testomatio-target.ts +225 -0
  310. package/src/api/testomatio-transcription.ts +82 -0
  311. package/src/api/workspace-search.ts +96 -0
  312. package/src/api/workspace-sync.ts +151 -0
  313. package/src/api/workspace.ts +165 -0
  314. package/src/app-server.ts +556 -0
  315. package/src/bridge.ts +251 -0
  316. package/src/check-tests.ts +156 -0
  317. package/src/cli.ts +17 -0
  318. package/src/commands.ts +244 -0
  319. package/src/config.ts +183 -0
  320. package/src/connection.ts +658 -0
  321. package/src/context-store.ts +265 -0
  322. package/src/debug-bus.ts +405 -0
  323. package/src/extensions/tool-gate.ts +220 -0
  324. package/src/extensions/webui/ask-channel.ts +52 -0
  325. package/src/extensions/webui/index.ts +184 -0
  326. package/src/extensions/webui/tools/ask-question.ts +88 -0
  327. package/src/extensions/webui/tools/query-result.ts +79 -0
  328. package/src/extensions/webui/tools/render-chart.ts +53 -0
  329. package/src/extensions/webui/tools/render-item.ts +61 -0
  330. package/src/extensions/webui/tools/render-list.ts +170 -0
  331. package/src/extensions/webui/tools/render-result.ts +85 -0
  332. package/src/extensions/webui/tools/render-tree.ts +71 -0
  333. package/src/extensions/webui/tools/ui-widget.ts +54 -0
  334. package/src/extensions/webui/tools/widget-result.ts +13 -0
  335. package/src/extensions/webui/widget-channel.ts +50 -0
  336. package/src/file-log.ts +196 -0
  337. package/src/git-tracked.ts +68 -0
  338. package/src/gitignore.ts +53 -0
  339. package/src/json-store.ts +43 -0
  340. package/src/load-env.ts +70 -0
  341. package/src/loader-style.ts +96 -0
  342. package/src/main.ts +140 -0
  343. package/src/mcp-catalog.ts +96 -0
  344. package/src/models-catalog.ts +72 -0
  345. package/src/permissions.ts +120 -0
  346. package/src/project-dir.ts +189 -0
  347. package/src/project-info.ts +108 -0
  348. package/src/prompt/app-ui.ts +59 -0
  349. package/src/prompt/browser.ts +27 -0
  350. package/src/prompt/index.ts +62 -0
  351. package/src/prompt/system-prompt.ts +161 -0
  352. package/src/prompt/testomatio.ts +170 -0
  353. package/src/prompt/tools.ts +27 -0
  354. package/src/server-info.ts +62 -0
  355. package/src/session-factory.ts +442 -0
  356. package/src/session-store.ts +115 -0
  357. package/src/shell-env.ts +45 -0
  358. package/src/skills.ts +163 -0
  359. package/src/sync-snapshot.ts +140 -0
  360. package/src/telemetry.ts +239 -0
  361. package/src/testomatio-auth.ts +299 -0
  362. package/src/testomatio.ts +98 -0
  363. package/src/theme.ts +30 -0
  364. package/src/user-env.ts +94 -0
  365. package/src/welcome.ts +127 -0
  366. package/src/workspace/safe-path.ts +85 -0
  367. package/src/workspace/test-md.ts +70 -0
  368. package/src/workspace-model.ts +440 -0
  369. package/testeiya.config.json +14 -0
@@ -0,0 +1,72 @@
1
+ ---
2
+ title: Testomat.io TMS Integration Guide
3
+ description: Essential reference for generating Testomat.io-compatible test cases. Covers structure, MCP tools, conventions, and best practices.
4
+ ---
5
+
6
+ # Testomat.io TMS Integration Guide
7
+
8
+ Quick reference for generating test cases compatible with Testomat.io Test Management System.
9
+
10
+ Follow this guide along with [Test Case Format](./test-case-format.md).
11
+
12
+ ## Structure
13
+
14
+ ```
15
+ Folder (top-level)
16
+ └── Suite {title} (@S{id})
17
+ └── Test {title} (@T{id}) → has tags (e.g. @smoke), labels, priority (e.g. high)
18
+ ```
19
+
20
+ Priority values: `critical`, `high`, `normal`, `low`.
21
+
22
+ ## Key MCP Tools
23
+
24
+ | Purpose | Entities / tools |
25
+ | --------------- | ------------------------------------------------------------------------------------------ |
26
+ | **Structure** | `suites_list`, `suites_search`, `tests_list`, `tests_search`, `steps_list`, `steps_search` |
27
+ | **Conventions** | `tags_list`, `labels_list` |
28
+
29
+ **Key actions:**
30
+
31
+ - `tests_search` - **Always use before creating new cases** to avoid duplicates
32
+ - `steps_search` - Find reusable shared steps before writing new ones
33
+
34
+ ## Use tags and labels
35
+
36
+ Add them based on context, user prompt, existing tags and labels.
37
+
38
+ Split tests by module, testing type, scope and other criteria which helps to organize and filter tests.
39
+
40
+ ### When to use Tags vs Labels
41
+
42
+ | Aspect | Tags | Labels |
43
+ | --------------- | -------------------------------------- | ------------------------------------- |
44
+ | **Best for** | Broad categorization | Specific metadata |
45
+ | **Use for** | Test type (@smoke, @regression, @e2e) | Priority, severity, status, ownership |
46
+ | **Flexibility** | Constant, embedded in code | Flexible, easy to change via UI |
47
+ | **Values** | Single tag per category | Multiple values per label allowed |
48
+ | **Examples** | `@smoke`, `@api`, `@auth`, `@checkout` | |
49
+
50
+ **Rule of thumb:** Use tags for test categorization and automation; use labels for test metadata, workflow tracking, and manual test management.
51
+
52
+ ## Deduplication Workflow
53
+
54
+ ```
55
+ 1. tests_search() → Find existing tests
56
+ 2. Compare → Exact match? → Notify user, let user decide to skip or not
57
+ 3. Partial overlap? → Ask user
58
+ 4. No match? → Create new test cases
59
+ ```
60
+
61
+ ## Quality Checklist
62
+
63
+ - [ ] Followed template format
64
+ - [ ] Priority set
65
+ - [ ] Tags/labels added
66
+ - [ ] Clear steps
67
+ - [ ] No duplicates
68
+
69
+ ## References
70
+
71
+ - [Testomat.io Docs](https://testomat.io/docs)
72
+ - [Test Case Format](./test-case-format.md) - Full Markdown format reference
@@ -0,0 +1,159 @@
1
+ # Test Writing Rules
2
+
3
+ If the user provided example test cases, follow their style first; then apply these rules.
4
+
5
+ ## Test Suites
6
+
7
+ - Formulas, business rules, edge-case reasoning, and feature context live in the suite/test description.
8
+ - Prerequisites common to all test cases go as bullet points in the suite description.
9
+ - Formulas and diagrams relevant to all test cases can be included as code blocks in the suite description.
10
+
11
+ ## Test Cases
12
+
13
+ - A test case consists of a description and steps.
14
+ - Golden rule: "why" in the description, "what" in the steps.
15
+ - Add the intent to the description if the title is not enough to explain it.
16
+ - Keep the description clear and concise.
17
+ - Put preparations into preconditions/description, not into steps.
18
+ - Focus on black-box testing: every action and observable result goes through public APIs or UI (unless the user specifies otherwise).
19
+ - Prefer UI over public APIs when possible.
20
+ - Add system checks only when it is not clear how to test via public APIs or UI. This is not a unit test; usually no direct server or code access is allowed.
21
+ - Understand UI pages, components, or API endpoints from source code, design, or requirements.
22
+ - If this is a web app, ask the user to help discover it:
23
+ - by looking at its frontend source code
24
+ - by accessing it on a non-production environment via browser (URLs and credentials)
25
+ - by looking at screenshots of related pages
26
+
27
+ ## Title
28
+
29
+ Title states the behavior under test from the user's perspective.
30
+
31
+ Title structure: `<role> <action> <object> <qualifier>`
32
+
33
+ Examples:
34
+
35
+ - Editor can change description of a blogpost in admin panel
36
+ - User can report a bug using widget on a web page
37
+ - Blocked user must not be able to log in to app workspace
38
+ - Admin can invite up to 10 users to a project via Settings Page
39
+ - User can not edit a comment it doesn't own
40
+ - User can retry operation when NetworkError occurs
41
+ - User can not retry operation when network connection is disabled
42
+
43
+ Avoid:
44
+
45
+ - Filler prefixes: `Verify that ...`, `Test that ...`, `Check ...`, `Should ...`
46
+ - Multi-intent titles joined by `and` / `then`
47
+ - Restating the suite name in every title
48
+ - Embedding IDs or numbers: `TC-001: Login`
49
+ - Vague outcomes: `Successful login`, `Login works`
50
+
51
+ Good vs bad:
52
+
53
+ - `Verify successful login` → `User can log in with valid email and password`
54
+ - `Wrong password test` → `User cannot log in with invalid password`
55
+ - `Login and update profile` → split into two tests
56
+ - `Email validation` → `User sees error when email format is invalid`
57
+
58
+ ## Preconditions
59
+
60
+ - Add preconditions for setup that is required for the test to run but is not part of the test actions.
61
+ - Define the preconditions and initial state of the system as bullet points.
62
+ - If relevant, include the user role.
63
+ - Skip preconditions that are not needed or repeat the suite description.
64
+ - Do not include preconditions like "service is running" unless the user explicitly mentioned them or the test is about them.
65
+
66
+ ## Steps
67
+
68
+ A step consists of an action (with optional test data) and an expected result.
69
+
70
+ Test steps use the `## Steps` header section with a nested markdown list format:
71
+
72
+ ```markdown
73
+ ## Steps
74
+
75
+ - (Step Action)
76
+ *Expected*: ... (Observable behavior)
77
+ - ...
78
+ *Expected*: ...
79
+ ```
80
+
81
+ e.g.
82
+
83
+ ```markdown
84
+ ## Steps
85
+
86
+ - Navigate to the login page
87
+ *Expected*: Login form is displayed with username and password fields
88
+ - Enter a valid username and password
89
+ *Expected*: Credentials are entered without errors
90
+ - Click the "Login" button
91
+ *Expected*: User is redirected to the dashboard
92
+ ```
93
+
94
+ Step format rules:
95
+
96
+ - Steps must be under a `## Steps` heading.
97
+ - Use nested markdown lists (bulleted `-`/`*` or numbered `1.`).
98
+ - Top-level items describe the action to perform.
99
+ - Nested items with `*Expected*` (or `*Expected*:`, `*Expected result*`) describe the observable behavior.
100
+ - Expected results should be specific and verifiable.
101
+
102
+ Step content rules:
103
+
104
+ - Each step is a simple sentence. Avoid commas and sub-sentences.
105
+ - Steps are mechanical: click, send, read, assert.
106
+ - Each step includes exact instructions with concrete, realistic values a tester can act on directly.
107
+ - Do NOT parametrize by default — first-pass test cases should read as executable manual steps, not templates.
108
+ - Use a placeholder variable like `${domain}` only when the value is genuinely reused across steps or is data-driven (see the Examples section in the format reference). A plain UI/API acceptance step needs concrete values, not placeholders.
109
+ - Do not turn data unrelated to the test into placeholders.
110
+ - Do not add preconditions as placeholders.
111
+ - Prefer URL paths over full URLs, e.g. `/auth/login`.
112
+ - Use specific values when they are important for the scenario (boundary values, format validation, locale-specific input).
113
+ - Avoid vague qualifiers like "small", "known", "around", "e.g.", "like", "(…)"; replace them with concrete, literal values.
114
+ - Avoid general statements in steps. Move them to the description.
115
+ - Do not chain multiple distinct actions or use unnecessary And / Or combinations in a single step.
116
+ - All step actions must be clear to perform via public API or UI.
117
+ - All checks/verifications/assertions belong in the expected result, not in the step action.
118
+ - A code block may follow a step when needed: API request, SQL, shell command, pseudocode, etc.
119
+
120
+ If an expected result has multiple conditions, split them into separate lines.
121
+
122
+ Instead of:
123
+
124
+ `*Expected*: Comment appears in the Run's comment list with the current user as author`
125
+
126
+ Use:
127
+
128
+ `*Expected*: Comment appears in the Run's comment list`
129
+ `*Expected*: Current user is the author`
130
+
131
+ ### Bold and italic in steps
132
+
133
+ Use sparingly. Each style serves one purpose; otherwise write plain text.
134
+
135
+ - **bold** — UI elements the user interacts with: buttons, links, fields, tabs, checkboxes, modals (e.g. `Click **Save**`, `Open **Settings** tab`).
136
+ - *italic* — names of pages/screens/documents referenced as context (e.g. `Open the *Privacy Policy* page`).
137
+
138
+ Avoid:
139
+
140
+ - Bold/italic on full sentences or whole steps.
141
+ - Combining bold and italic (`***...***`).
142
+ - Emphasis for visual weight; rephrase or split the step instead.
143
+ - Bold/italic in place of a placeholder (`[url]`) or a code block.
144
+
145
+ ## AI Writing Patterns to Avoid
146
+
147
+ Be specific, not grandiose. Say what it actually does. Avoid marketing language and emojis (unless explicitly intended).
148
+
149
+ Avoid:
150
+
151
+ - Puffery: pivotal, crucial, vital, testament, enduring legacy, indelible mark, deeply rooted, profound heritage, steadfast dedication, key turning point
152
+ - Promotional adjectives: groundbreaking (figurative), seamless/seamlessly, robust, cutting-edge, vibrant, nuanced, multifaceted, intricate/intricacies, stunning natural beauty
153
+ - Overused AI vocabulary: delve/delves, leverage/leveraging, foster/fostering, realm, tapestry, landscape, interplay, streamline, shed light on, garnered, notably, key (as adjective)
154
+ - Empty "-ing" phrases: ensuring, showcasing, highlighting, emphasizing, reflecting, underscoring, aligning with, contributing to, enhancing, underpinning
155
+ - Filler frames: stands/serves as, is a testament/reminder, plays a vital/significant/crucial/pivotal role, underscores/highlights its importance, reflects broader, symbolizing its ongoing/enduring/lasting impact, continues to captivate, nestled in the heart of, boasts a
156
+ - Hedges and closers: it's important/critical/crucial to note/remember/consider, may vary, In summary, In conclusion, Overall
157
+ - "Challenges/Legacy" framing: Despite its... faces several challenges, Despite these challenges, Challenges and Legacy, Future Outlook
158
+ - Parallel "not/but/however" constructions: "Not only ... but ...", "It is not just about ..., it's ..." — common in LLM writing but unsuitable for a neutral tone
159
+ - Formatting overuse: excessive bullets, emoji decorations, bold on every other word
@@ -0,0 +1,152 @@
1
+ ---
2
+ name: scan-automation-project
3
+ description: Scan project source code to inventory languages, frameworks, and existing tests (manual `*.test.md` and automated test files). Use this skill whenever analyzing a codebase for test planning, detecting test frameworks, or preparing for test automation. Specifically, when the user mentions "scan project", "what tests exist", "analyze codebase", "detect frameworks", "test matrix", or needs a codebase inventory before a QA workflow.
4
+ license: MIT
5
+ metadata:
6
+ author: Testomat.io
7
+ version: 1.0.0
8
+ ---
9
+
10
+ # Scan Automation Project
11
+
12
+ Scan project source code and return a QA-focused inventory: languages, frameworks, and existing tests.
13
+
14
+ **Shallow scan only.** No full import resolution, no line-by-line parsing, no reading full test implementations. High-level structure only.
15
+
16
+ ## Step 1: Locate Source Code
17
+
18
+ - If the project root has non-empty source folders or files, go to Step 2.
19
+ - If **no source** files are found, stop and ask the user:
20
+
21
+ ```
22
+ ❓ No application source code detected (folder may be empty or missing).
23
+ Where is the source code?
24
+ 1. Use local project from another folder (I will create a symlink)
25
+ 2. Clone from Git repo
26
+ 3. I don't know yet (stop here)
27
+ ```
28
+
29
+ - Wait for the user's reply.
30
+ - If the user gives a Git repo or another folder, clone or symlink it into `.testeiya/code/`. No-op if it is already there.
31
+
32
+ ### Rule for pulled data
33
+
34
+ **When you need to pull external data** (manual test cases, app code, e2e tests from another repo) into this project:
35
+
36
+ | This project has | Store pulled data in | Gitignored? |
37
+ | ------------------ | ---------------------- | ----------- |
38
+ | **Source code** (`src/` folder) or **big project** | `.testeiya/…` | **Yes** |
39
+ | **Only test infrastructure** (e2e dirs like `tests/`, `playwright/`, `cypress/` but no `src/`) | `manual-tests/` or `e2e-tests/` | No |
40
+ | **Empty / manual-only** | `manual-tests/` | No |
41
+
42
+ Detection logic:
43
+ 1. Has `src/` folder or is a monorepo? → Use `.testeiya/`
44
+ 2. Has e2e test dirs (`tests/`, `playwright/`, `cypress/`, `e2e/`)? → Use tracked folder (`manual-tests/`, `e2e-tests/`)
45
+ 3. Otherwise → Default to `manual-tests/`
46
+
47
+ - Any skill that creates `.testeiya/...` must also add `.testeiya/` to the project's `.gitignore` — but only if it is not there yet. Never add it twice.
48
+ - The rule covers *pulled* data only. Output a skill *produces* and the user wants — a `coverage.*.yml`, new `*.test.md` files — goes in the repo as normal.
49
+ - On a source repo with no manual tests, this skill changes no tracked file: it only creates the gitignored `.testeiya/` directory and, if needed, adds one line to `.gitignore`.
50
+ - **Only touch `.testeiya/` and tracked folders — never pollute the repo with cache in a wrong location.**
51
+
52
+ ## Step 2: Project Analysis
53
+
54
+ Collect source file paths only. **Do NOT read file contents.**
55
+
56
+ Include:
57
+ - Application source files.
58
+ - View/template files: `.html`/`.htm`, `.vue`, `.svelte`, `.hbs`/`.handlebars`, `.ejs`, `.pug`/`.jade`, `.mustache`, `.liquid`, `.erb`, `.haml`, `.slim`, `.blade.php`, `.twig`, `.j2`/`.jinja`/`.jinja2`, `.cshtml`/`.razor`, `.jsp`. They are application source — coverage skills map UI changes through them.
59
+
60
+ Exclude:
61
+ - Dependencies, build output, coverage, reports, caches, config, lock, and environment files.
62
+ - Paths ignored by `.gitignore` — but **not** `.testeiya/code/`. In a manual-tests repo the app code lives there; scan it as source.
63
+ - Testeiya internal files (e.g. `session-factory.ts`, `system-prompt.ts`).
64
+ - **If in doubt**, exclude.
65
+
66
+ From the file list:
67
+ - Detect languages and frameworks. Collect one `frameworks` list with ALL application and testing frameworks.
68
+ - Extract the project name from a project config file (`package.json`, `Cargo.toml`, `pom.xml`, ...); fall back to the root directory name.
69
+ - Rate complexity by source file count:
70
+
71
+ | File Count | Complexity |
72
+ |------------|--------------|
73
+ | 1-30 | `small` |
74
+ | 31-150 | `moderate` |
75
+ | 151-500 | `large` |
76
+ | 500+ | `very-large` |
77
+
78
+ ## Step 3: Test Inventory (optional)
79
+
80
+ Detect existing tests, automated and manual. Stay shallow.
81
+
82
+ Automated tests:
83
+ - Detect frameworks via config files (`jest.config.*`, `playwright.config.*`, `vitest.config.*`, `pytest.ini`, `pom.xml`, ...), project dependencies, and test file patterns (`*.test.*`, `*.spec.*`, `*_test.*`).
84
+ - For each framework: identify its test file pattern and count matching files.
85
+
86
+ Manual tests:
87
+ - Find all `.test.md` files and parse test titles. `find .` also looks inside `.testeiya/manual-tests/`, so a re-run after a pull finds the cached cases instead of reporting "no manual tests":
88
+
89
+ ```bash
90
+ find . -name "*.test.md" -exec awk '
91
+ /^<!-- test/ { in_block=1; kind="TEST"; next }
92
+ /^<!-- suite/ { in_block=1; kind="SUITE"; next }
93
+ in_block && /^-->/ { in_block=0; expect=1; next }
94
+ expect && /^#+[[:space:]]+/ {
95
+ title=$0; sub(/^#+[[:space:]]+/, "", title)
96
+ if (kind == "SUITE") printf "SUITE: %s\n", title
97
+ else printf "|- %s\n", title
98
+ expect=0
99
+ }
100
+ ' {} +
101
+ ```
102
+
103
+ - If the only `.test.md` files are under `.testeiya/manual-tests/`, say so in the inventory: they came from Testomat.io, not from this repo.
104
+
105
+ ## Step 4: Output
106
+
107
+ Return one structured markdown result directly. **Do NOT save to a file.**
108
+
109
+ ```markdown
110
+ # Project Overview
111
+
112
+ - **Project Name:** acme-web-app
113
+ - **Description:** A React-based customer dashboard with an Express API.
114
+ - **Languages:** TypeScript, SQL
115
+ - **Frameworks:** React, Express, Jest, Playwright
116
+ - **Complexity:** small (12 files)
117
+
118
+ ## Test Inventory
119
+
120
+ - **Automated Tests:** 10 files
121
+ - **Manual Tests:** 37 cases
122
+
123
+ ### Manual Tests (20 of 37 shown)
124
+
125
+ - SUITE: Authentication
126
+ |- User can login
127
+ |- User can reset password
128
+ - SUITE: Billing
129
+ |- User can view invoice
130
+ ...and 17 more
131
+
132
+ ### Automated Tests (10 of 10 shown)
133
+
134
+ - home.page.spec.ts
135
+ ...
136
+ ```
137
+
138
+ Field rules:
139
+ - **Description:** 1-2 sentences based only on detected source code and folder structure (include the domain area if that makes sense).
140
+ - **Complexity:** one of `small` | `moderate` | `large` | `very-large`, plus the file count.
141
+ - **Manual Tests:** preserve hierarchy as plain strings — SUITE items as parent bullets, test titles (`|-`) as nested children.
142
+ - **Automated Tests:** list of detected test files.
143
+ - All values must come from observable files. Do NOT guess missing data or add fields not shown above.
144
+
145
+ Sections:
146
+ - If Step 3 was skipped or found no tests, omit `## Test Inventory` and note that the project contains no tests; the `# Project Overview` section is still useful for next steps.
147
+ - If one test type is absent, note it with a blockquote, e.g. ``> No manual tests (`.test.md`) found in the project.``
148
+
149
+ Test listing truncation:
150
+ - Show at most the first 20 entries per list, in original file order.
151
+ - Mark truncation in the heading (`(20 of 37 shown)`) and with `...and N more`.
152
+ - Do not print full test listings beyond that.
@@ -0,0 +1,107 @@
1
+ ---
2
+ name: sync-test-cases-with-tms
3
+ description: Synchronize test scenarios and cases between a local project and Testomat.io. Use this skill whenever the user wants to pull/export/download tests from Testomat.io; or push/import/sync new or updated test cases back to the TMS in corresponding `*.test.md` format. Supports custom directories, markdown test format and advanced import/export workflows.
4
+ inputs:
5
+ testDir:
6
+ description: "Target directory for pulled tests"
7
+ required: false
8
+ license: MIT
9
+ metadata:
10
+ author: Testomat.io
11
+ version: 1.0.0
12
+ ---
13
+
14
+ # Sync Test Cases with TMS
15
+
16
+ Sync Markdown test cases (`*.test.md`) between the local project and Testomat.io.
17
+
18
+ Use when the user wants to:
19
+ - Pull/export/download tests from Testomat.io to local Markdown files.
20
+ - Push/upload/import local Markdown tests to Testomat.io.
21
+ - Bulk edit: pull cases -> edit locally -> push back to TMS.
22
+
23
+ ## Setup
24
+
25
+ - Check for the `TESTOMATIO` token: skill input -> `.env` in project root -> ask the user.
26
+ - Save the token to `.env`: `TESTOMATIO=tstmt_xxxxx`.
27
+ - If the user has no key: get it in Testomat.io under **Settings → Project → Project Reporting API key** (`https://app.testomat.io/projects/<project-id>/settings/project`).
28
+
29
+ ## Running the CLI
30
+
31
+ - Run `check-tests` via `npx`. Do not install it as a project dependency.
32
+ - **The first `check-tests` call in the session must be `npx check-tests@latest …`** to resolve the latest version. All later calls in the same session use plain `npx check-tests …`.
33
+ - **Use only options documented here, in [TESTOMATIO_CLI.md](./references/TESTOMATIO_CLI.md), or listed by `npx check-tests --help`. Do not invent options** (e.g. `--pattern`, `--force`).
34
+
35
+ ## Pull
36
+
37
+ Downloads test scenarios from Testomat.io and saves them as local Markdown files.
38
+
39
+ Directory selection — if the `testDir` input is provided or the user passes `-d <path>`, use that path. Otherwise:
40
+ - Workspace is empty or for manual tests only: pull to root.
41
+ - End-to-end testing project: pull to the `manual-tests` directory.
42
+ - Any other case: pull to `.testeiya/manual-tests` (ensure `.testeiya/` exists and is gitignored).
43
+
44
+ Cache-folder rules:
45
+ - Default pull target is the gitignored cache `.testeiya/manual-tests/`. Add `.testeiya/` to the project `.gitignore` if it is not there yet.
46
+ - **Pulled cases must never land in a tracked folder** (`manual-tests/`, etc.) — that pollutes the repo.
47
+ - Being gitignored does not block editing the files or pushing them back.
48
+ - If the repo already keeps its `*.test.md` files in a tracked folder, don't pull — work with them in place, or pass `-d <that folder>` for an in-place refresh.
49
+ - This matches `scan-automation-project`, which pulls the *code* into `.testeiya/code/` when it runs inside a manual-tests repo.
50
+
51
+ ```bash
52
+ npx check-tests pull -d .testeiya/manual-tests
53
+ ```
54
+
55
+ - To pull only specific suites (user names a suite or gives suite IDs): `npx check-tests pull --suite-ids "@S12345678,@S87654321"`.
56
+ - More pull options: [TESTOMATIO_CLI.md](./references/TESTOMATIO_CLI.md).
57
+
58
+ ## Push
59
+
60
+ Uploads local Markdown tests to Testomat.io.
61
+
62
+ Pre-push file filtering — push only test case files, never project docs or requirements:
63
+ - Include files matching `*.test.md`, or Markdown files with valid `<!-- test ... -->` blocks.
64
+ - Ignore all other Markdown (`README.md`, `CHANGELOG.md`, documentation).
65
+ - If test cases live alongside other files, copy or move the test files into `.testeiya/manual-tests/` first.
66
+
67
+ Pre-push validation:
68
+ 1. At least one `*.test.md` file exists.
69
+ 2. Each file contains a valid test block:
70
+
71
+ ```md
72
+ <!-- test
73
+ priority: ...
74
+ creator: ...
75
+ tags: ...
76
+ labels: ...
77
+ -->
78
+ # ... (test case title)
79
+
80
+ ... (test case description)
81
+ ```
82
+
83
+ ```bash
84
+ # Specific files (preferred when known)
85
+ npx check-tests push --files login.test.md checkout.test.md
86
+
87
+ # Testeiya cache folder
88
+ npx check-tests push -d .testeiya/manual-tests
89
+ ```
90
+
91
+ - **When the files to push are known** (e.g. just produced by `qa-write-test-cases` / `improve-test-cases`), **pass them explicitly via `--files`** (alias `-f`). Without `--files` the CLI falls back to the default glob `**/*.test.md`, which may pick up unrelated files.
92
+ - Quote glob patterns. Paths resolve relative to `--dir`.
93
+ - Use `-d` when `.testeiya` or `manual-tests` directories exist.
94
+ - **Push only the test cases directory** (e.g. `.testeiya/manual-tests`, not `.testeiya/`).
95
+ - More push options and examples: [TESTOMATIO_CLI.md](./references/TESTOMATIO_CLI.md).
96
+
97
+ ## Summary Output
98
+
99
+ After syncing, print a short log-style summary:
100
+
101
+ ```
102
+ Sync Complete:
103
+ - Action: pull/push
104
+ - Directory: <path>
105
+ - Tests synced: 15
106
+ - Status: Success
107
+ ```
@@ -0,0 +1,140 @@
1
+ # Testomat.io CLI Documentation
2
+
3
+ This document provides comprehensive information about the `check-tests` CLI commands, which synchronizes test scenarios, and interacts with Testomat.io test cases from your local project with TMS.
4
+
5
+ ---
6
+
7
+ ## Prerequisites
8
+
9
+ ### Run check-tests via npx (always latest)
10
+
11
+ Invoke `check-tests` through `npx` so users automatically pick up the newest published version:
12
+
13
+ ```bash
14
+ # First invocation in the agent session — forces resolve of latest
15
+ npx check-tests@latest <command>
16
+
17
+ # Subsequent invocations in the same session could be used without @latest
18
+ npx check-tests <command>
19
+ ```
20
+
21
+ Do not install `check-tests` as a project dependency. The first call (with `@latest` version specified) refreshes the npx cache; next calls in the same session reuse it without an extra registry round-trip. A new agent session re-triggers the `@latest` check so users use the latest version over time.
22
+
23
+ ---
24
+
25
+ ## Environment Variables
26
+
27
+ The tool supports loading environment variables from `.env` files using dotenv.
28
+
29
+ ### Testomat.io Configuration
30
+
31
+ | Variable | Description | Required |
32
+ | ------------------------ | ------------------------------------------------------ | ------------------------------------- |
33
+ | `TESTOMATIO` | API key for Testomat.io (format: tstmt_xxxxx) | Yes (for sync operations) |
34
+ | `TESTOMATIO_URL` | Testomat.io server URL | No (default: https://app.testomat.io) |
35
+ | `TESTOMATIO_WORKDIR` | Working directory for relative file paths | No |
36
+ | `TESTOMATIO_PREPEND_DIR` | Directory to prepend to test paths | No |
37
+ | `TESTOMATIO_LABELS` | Comma-separated labels. Supports `label:value` | No |
38
+
39
+ ### Configuration File
40
+
41
+ Save credentials to `.env` file:
42
+
43
+ ```env
44
+ TESTOMATIO=tstmt_xxxxx
45
+ TESTOMATIO_URL=https://app.testomat.io
46
+ ...
47
+ ```
48
+
49
+ ---
50
+
51
+ ## CLI Options
52
+
53
+ ### Basic "check-tests" Options
54
+
55
+ | Option | Description | Default |
56
+ | --------------------- | ------------------------------------------- | ----------------------------|
57
+ | `-h, --help` | Display help information | - |
58
+ | `-d, --dir <dir>` | Test directory to scan | Current dir (default: `.`) |
59
+ | `--suite-ids <ids>` | Comma-separated suite IDs to pull (e.g. `@S12345678, @S456r4342`) | - |
60
+
61
+ ### Testomat.io Integration Specific Project Options
62
+
63
+ | Option | Description | Default |
64
+ | ----------------------------- | ------------------------------------------------------------- | ------- |
65
+ | `--update-ids` | Update test and suite with Testomat.io IDs | false |
66
+ | `--keep-structure` | Prefer structure of source code over structure in Testomat.io | false |
67
+ | `--no-empty` | Remove empty suites after import | false |
68
+ | `--clean-ids` | Remove Testomat.io IDs from test and suite | false |
69
+
70
+ ---
71
+
72
+ ## Commands
73
+
74
+ ### Pull
75
+
76
+ Retrieve the latest test scenarios from Testomat.io and save them as Markdown files locally.
77
+
78
+ ```bash
79
+ npx check-tests pull [options]
80
+ ```
81
+
82
+ **Examples:**
83
+
84
+ ```bash
85
+ # Export tests to current directory
86
+ npx check-tests pull
87
+
88
+ # Export tests to manual-tests folder
89
+ npx check-tests pull -d manual-tests
90
+
91
+ # Keep source structure
92
+ npx check-tests pull -d manual-tests --keep-structure
93
+
94
+ # Pull specific suites only
95
+ npx check-tests pull --suite-ids "@S12345678,@S87654321"
96
+ ```
97
+
98
+ ### Push
99
+
100
+ Send local Markdown test updates to Testomat.io. (Equivalent to `check-tests manual <files> --update-ids`.)
101
+
102
+ ```bash
103
+ npx check-tests push [options]
104
+ ```
105
+
106
+ `--files` (alias `-f`) accepts file paths, glob patterns, or a mix; defaults to `**/*.test.md`. Paths resolve relative to `--dir`. Quote globs.
107
+
108
+ **Best practice:** when the files to push are known, list them explicitly via `--files` rather than relying on the default glob.
109
+
110
+ **Examples:**
111
+
112
+ ```bash
113
+ # Default glob (**/*.test.md)
114
+ npx check-tests push
115
+
116
+ # Specific files
117
+ npx check-tests push -f docs/login.test.md docs/checkout.test.md
118
+
119
+ # Glob (quoted)
120
+ npx check-tests push --files "manual-tests/**/*.test.md"
121
+
122
+ # Multiple globs
123
+ npx check-tests push -f "smoke/**/*.test.md" "regression/**/*.test.md"
124
+
125
+ # With labels
126
+ TESTOMATIO_LABELS=smoke,updated npx check-tests push
127
+ ```
128
+
129
+ ---
130
+
131
+ ## Quick Reference
132
+
133
+ | Action | Command |
134
+ | --------------- | -------------------------------------------------------------- |
135
+ | Pull tests | `npx check-tests pull -d <dir>` |
136
+ | Push files | `npx check-tests push --files <file1.test.md> <file2.test.md>` |
137
+ | Push glob | `npx check-tests push --files "<dir>/**/*.test.md"` |
138
+ | Push directory | `npx check-tests push -d <dir>` (glob: `**/*.test.md`) |
139
+ | With labels | `TESTOMATIO_LABELS=smoke npx check-tests push` |
140
+ | Keep structure | `npx check-tests pull --keep-structure` |