testeiya 0.2.0 → 0.3.1-0.1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (402) hide show
  1. package/LICENSE +21 -0
  2. package/README.md +304 -132
  3. package/dist/prompt/context.js +79 -0
  4. package/dist/prompt/context.js.map +1 -0
  5. package/dist/prompt/index.js +60 -0
  6. package/dist/prompt/index.js.map +1 -0
  7. package/dist/prompt/print.js +30 -0
  8. package/dist/prompt/print.js.map +1 -0
  9. package/dist/prompt/project-info.js +2 -0
  10. package/dist/prompt/project-info.js.map +1 -0
  11. package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +38 -25
  12. package/dist/prompt/system-prompt.js.map +1 -0
  13. package/dist/prompt/testomatio.js +264 -0
  14. package/dist/prompt/testomatio.js.map +1 -0
  15. package/dist/prompt/tools.js +70 -0
  16. package/dist/prompt/tools.js.map +1 -0
  17. package/dist/prompt/vocab.js +8 -0
  18. package/dist/prompt/vocab.js.map +1 -0
  19. package/dist/src/args.js +207 -0
  20. package/dist/src/args.js.map +1 -0
  21. package/dist/src/cli.js +114 -0
  22. package/dist/src/cli.js.map +1 -0
  23. package/dist/src/doctor.js +171 -0
  24. package/dist/src/doctor.js.map +1 -0
  25. package/dist/src/env.js +93 -0
  26. package/dist/src/env.js.map +1 -0
  27. package/dist/src/mcp-extension.js +9 -0
  28. package/dist/src/mcp-extension.js.map +1 -0
  29. package/dist/src/mcp.js +139 -0
  30. package/dist/src/mcp.js.map +1 -0
  31. package/dist/src/model.js +71 -0
  32. package/dist/src/model.js.map +1 -0
  33. package/dist/src/models.js +38 -0
  34. package/dist/src/models.js.map +1 -0
  35. package/dist/src/output.js +194 -0
  36. package/dist/src/output.js.map +1 -0
  37. package/dist/src/result.js +41 -0
  38. package/dist/src/result.js.map +1 -0
  39. package/dist/src/run.js +295 -0
  40. package/dist/src/run.js.map +1 -0
  41. package/dist/src/session.js +98 -0
  42. package/dist/src/session.js.map +1 -0
  43. package/dist/src/sessions.js +72 -0
  44. package/dist/src/sessions.js.map +1 -0
  45. package/dist/src/skills.js +88 -0
  46. package/dist/src/skills.js.map +1 -0
  47. package/dist/vendor/mcp.js +14801 -0
  48. package/mcp-tools.json +2967 -0
  49. package/package.json +34 -42
  50. package/prompt/context.ts +101 -0
  51. package/prompt/index.ts +102 -0
  52. package/prompt/print.ts +32 -0
  53. package/prompt/project-info.ts +30 -0
  54. package/prompt/system-prompt.ts +187 -0
  55. package/{src/prompt → prompt}/testomatio.ts +120 -9
  56. package/prompt/tools.ts +72 -0
  57. package/prompt/vocab.ts +7 -0
  58. package/skills/codeceptjs/ci-fix-tests/SKILL.md +7 -8
  59. package/skills/codeceptjs/codeceptjs-auth/SKILL.md +47 -64
  60. package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +56 -47
  61. package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +144 -106
  62. package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +50 -57
  63. package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +88 -196
  64. package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +4 -5
  65. package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +25 -36
  66. package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +23 -36
  67. package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +23 -36
  68. package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +23 -35
  69. package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +50 -53
  70. package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +87 -191
  71. package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/SKILL.md +1 -1
  72. package/{skills.lock.json → skills/skills.lock.json} +43 -36
  73. package/skills/skills.yaml +34 -0
  74. package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +49 -61
  75. package/skills/testomatio/explorbot/explorbot-fundamentals/references/no-install.md +36 -0
  76. package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +20 -7
  77. package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +41 -289
  78. package/skills/testomatio/qa-process/qa-explain-behavior/SKILL.md +111 -0
  79. package/skills/testomatio/qa-process/qa-explain-behavior/references/answer-shapes.md +116 -0
  80. package/skills/testomatio/qa-process/qa-explain-behavior/references/examples.md +157 -0
  81. package/skills/testomatio/qa-process/qa-lead-strategy-advisor/SKILL.md +91 -0
  82. package/skills/testomatio/qa-process/qa-lead-strategy-advisor/references/output-format.md +71 -0
  83. package/skills/testomatio/qa-process/testing-workflow/SKILL.md +227 -0
  84. package/skills/testomatio/test-automation/qa-data-seeder/SKILL.md +83 -0
  85. package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +5 -3
  86. package/skills/testomatio/test-automation/setup-change-aware-pr-testing/SKILL.md +190 -0
  87. package/skills/testomatio/test-automation/setup-ci-automation/SKILL.md +76 -0
  88. package/skills/testomatio/test-management/qa-split-testing-levels-pyramid/SKILL.md +55 -0
  89. package/skills/testomatio/test-management/qa-sprint-report-by-testomatio/SKILL.md +220 -0
  90. package/skills/testomatio/test-management/qa-sprint-report-by-testomatio/references/qa-sprint-report.md +126 -0
  91. package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +1 -1
  92. package/skills/testomatio/test-management/qa-thinking/SKILL.md +25 -25
  93. package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +14 -1
  94. package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +8 -0
  95. package/models.catalog.json +0 -6963
  96. package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
  97. package/skills/playwright-best-practices-skill/README.md +0 -147
  98. package/skills/testeiya/README.md +0 -29
  99. package/skills/testeiya/answer-formatting/SKILL.md +0 -30
  100. package/skills/testeiya/check-cucumber/SKILL.md +0 -200
  101. package/skills/testeiya/check-tests/SKILL.md +0 -260
  102. package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
  103. package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
  104. package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
  105. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
  106. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
  107. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
  108. package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
  109. package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
  110. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
  111. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
  112. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
  113. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
  114. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
  115. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
  116. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
  117. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
  118. package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
  119. package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
  120. package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
  121. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
  122. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
  123. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
  124. package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
  125. package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
  126. package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
  127. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
  128. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
  129. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
  130. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
  131. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
  132. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
  133. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
  134. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
  135. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
  136. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
  137. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
  138. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
  139. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
  140. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
  141. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
  142. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
  143. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
  144. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
  145. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
  146. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
  147. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
  148. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
  149. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
  150. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
  151. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
  152. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
  153. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
  154. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
  155. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
  156. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
  157. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
  158. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
  159. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
  160. package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
  161. package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
  162. package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
  163. package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
  164. package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
  165. package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
  166. package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
  167. package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
  168. package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
  169. package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
  170. package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
  171. package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
  172. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
  173. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
  174. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
  175. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
  176. package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
  177. package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
  178. package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
  179. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
  180. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
  181. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
  182. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
  183. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
  184. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
  185. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
  186. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
  187. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
  188. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
  189. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
  190. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
  191. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
  192. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
  193. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
  194. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
  195. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
  196. package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
  197. package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
  198. package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
  199. package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
  200. package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
  201. package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
  202. package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
  203. package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
  204. package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
  205. package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
  206. package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
  207. package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
  208. package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
  209. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
  210. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
  211. package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
  212. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
  213. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
  214. package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
  215. package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
  216. package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
  217. package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
  218. package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
  219. package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
  220. package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
  221. package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
  222. package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
  223. package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
  224. package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
  225. package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
  226. package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
  227. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
  228. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
  229. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
  230. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
  231. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
  232. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
  233. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
  234. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
  235. package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
  236. package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
  237. package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
  238. package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
  239. package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
  240. package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
  241. package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
  242. package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
  243. package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
  244. package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
  245. package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
  246. package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
  247. package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
  248. package/skills.yaml +0 -21
  249. package/src/ai-debug.ts +0 -188
  250. package/src/api/agent-get.ts +0 -22
  251. package/src/api/agent-start.ts +0 -384
  252. package/src/api/client-log.ts +0 -29
  253. package/src/api/context.ts +0 -332
  254. package/src/api/debug-layout.ts +0 -47
  255. package/src/api/debug-report.ts +0 -29
  256. package/src/api/debug-snapshot.ts +0 -30
  257. package/src/api/debug-stream.ts +0 -52
  258. package/src/api/files-delete.ts +0 -184
  259. package/src/api/files-read.ts +0 -41
  260. package/src/api/files-rename.ts +0 -99
  261. package/src/api/files-tree.ts +0 -292
  262. package/src/api/files-write.ts +0 -41
  263. package/src/api/mcp.ts +0 -603
  264. package/src/api/memory.ts +0 -69
  265. package/src/api/open-external.ts +0 -39
  266. package/src/api/playwright-cli.ts +0 -606
  267. package/src/api/providers.ts +0 -457
  268. package/src/api/read-env-token.ts +0 -33
  269. package/src/api/sessions.ts +0 -79
  270. package/src/api/settings.ts +0 -120
  271. package/src/api/skills.ts +0 -58
  272. package/src/api/testomatio-attachment.ts +0 -89
  273. package/src/api/testomatio-auth.ts +0 -284
  274. package/src/api/testomatio-proxy.ts +0 -197
  275. package/src/api/testomatio-run-stats.ts +0 -81
  276. package/src/api/testomatio-target.ts +0 -225
  277. package/src/api/testomatio-transcription.ts +0 -82
  278. package/src/api/workspace-search.ts +0 -96
  279. package/src/api/workspace-sync.ts +0 -151
  280. package/src/api/workspace.ts +0 -165
  281. package/src/app-server.ts +0 -556
  282. package/src/bridge.ts +0 -251
  283. package/src/check-tests.ts +0 -156
  284. package/src/cli.ts +0 -17
  285. package/src/commands.ts +0 -244
  286. package/src/config.ts +0 -183
  287. package/src/connection.ts +0 -658
  288. package/src/context-store.ts +0 -265
  289. package/src/debug-bus.ts +0 -405
  290. package/src/extensions/tool-gate.ts +0 -220
  291. package/src/extensions/webui/ask-channel.ts +0 -52
  292. package/src/extensions/webui/index.ts +0 -184
  293. package/src/extensions/webui/tools/ask-question.ts +0 -88
  294. package/src/extensions/webui/tools/query-result.ts +0 -79
  295. package/src/extensions/webui/tools/render-chart.ts +0 -53
  296. package/src/extensions/webui/tools/render-item.ts +0 -61
  297. package/src/extensions/webui/tools/render-list.ts +0 -170
  298. package/src/extensions/webui/tools/render-result.ts +0 -85
  299. package/src/extensions/webui/tools/render-tree.ts +0 -71
  300. package/src/extensions/webui/tools/ui-widget.ts +0 -54
  301. package/src/extensions/webui/tools/widget-result.ts +0 -13
  302. package/src/extensions/webui/widget-channel.ts +0 -50
  303. package/src/file-log.ts +0 -196
  304. package/src/git-tracked.ts +0 -68
  305. package/src/gitignore.ts +0 -53
  306. package/src/json-store.ts +0 -43
  307. package/src/load-env.ts +0 -70
  308. package/src/loader-style.ts +0 -96
  309. package/src/main.ts +0 -140
  310. package/src/mcp-catalog.ts +0 -96
  311. package/src/models-catalog.ts +0 -72
  312. package/src/permissions.ts +0 -120
  313. package/src/project-dir.ts +0 -189
  314. package/src/project-info.ts +0 -108
  315. package/src/prompt/app-ui.ts +0 -59
  316. package/src/prompt/browser.ts +0 -27
  317. package/src/prompt/index.ts +0 -62
  318. package/src/prompt/tools.ts +0 -27
  319. package/src/server-info.ts +0 -62
  320. package/src/session-factory.ts +0 -442
  321. package/src/session-store.ts +0 -115
  322. package/src/shell-env.ts +0 -45
  323. package/src/skills.ts +0 -163
  324. package/src/sync-snapshot.ts +0 -140
  325. package/src/telemetry.ts +0 -239
  326. package/src/testomatio-auth.ts +0 -299
  327. package/src/testomatio.ts +0 -98
  328. package/src/theme.ts +0 -30
  329. package/src/user-env.ts +0 -94
  330. package/src/welcome.ts +0 -127
  331. package/src/workspace/safe-path.ts +0 -85
  332. package/src/workspace/test-md.ts +0 -70
  333. package/src/workspace-model.ts +0 -440
  334. package/testeiya.config.json +0 -14
  335. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/authentication-flows.md +0 -0
  336. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/authentication.md +0 -0
  337. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/clock-mocking.md +0 -0
  338. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/mobile-testing.md +0 -0
  339. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/multi-context.md +0 -0
  340. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/multi-user.md +0 -0
  341. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/network-advanced.md +0 -0
  342. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/third-party.md +0 -0
  343. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/pom-vs-fixtures.md +0 -0
  344. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/test-architecture.md +0 -0
  345. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/when-to-mock.md +0 -0
  346. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/browser-apis.md +0 -0
  347. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/iframes.md +0 -0
  348. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/service-workers.md +0 -0
  349. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/websockets.md +0 -0
  350. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/annotations.md +0 -0
  351. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/assertions-waiting.md +0 -0
  352. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/configuration.md +0 -0
  353. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/fixtures-hooks.md +0 -0
  354. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/global-setup.md +0 -0
  355. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/locators.md +0 -0
  356. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/page-object-model.md +0 -0
  357. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/projects-dependencies.md +0 -0
  358. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-data.md +0 -0
  359. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-suite-structure.md +0 -0
  360. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-tags.md +0 -0
  361. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/console-errors.md +0 -0
  362. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/debugging.md +0 -0
  363. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/error-testing.md +0 -0
  364. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/flaky-tests.md +0 -0
  365. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/angular.md +0 -0
  366. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/nextjs.md +0 -0
  367. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/react.md +0 -0
  368. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/vue.md +0 -0
  369. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/ci-cd.md +0 -0
  370. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/docker.md +0 -0
  371. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/github-actions.md +0 -0
  372. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/gitlab.md +0 -0
  373. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/other-providers.md +0 -0
  374. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/parallel-sharding.md +0 -0
  375. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/performance.md +0 -0
  376. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/reporting.md +0 -0
  377. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/test-coverage.md +0 -0
  378. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/accessibility.md +0 -0
  379. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/api-testing.md +0 -0
  380. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/browser-extensions.md +0 -0
  381. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/canvas-webgl.md +0 -0
  382. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/component-testing.md +0 -0
  383. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/drag-drop.md +0 -0
  384. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/electron.md +0 -0
  385. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/file-operations.md +0 -0
  386. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/file-upload-download.md +0 -0
  387. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/forms-validation.md +0 -0
  388. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/graphql-testing.md +0 -0
  389. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/i18n.md +0 -0
  390. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/performance-testing.md +0 -0
  391. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/security-testing.md +0 -0
  392. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/visual-regression.md +0 -0
  393. /package/skills/{playwright-cli → playwright/playwright-cli}/SKILL.md +0 -0
  394. /package/skills/{playwright-cli → playwright/playwright-cli}/references/element-attributes.md +0 -0
  395. /package/skills/{playwright-cli → playwright/playwright-cli}/references/playwright-tests.md +0 -0
  396. /package/skills/{playwright-cli → playwright/playwright-cli}/references/request-mocking.md +0 -0
  397. /package/skills/{playwright-cli → playwright/playwright-cli}/references/running-code.md +0 -0
  398. /package/skills/{playwright-cli → playwright/playwright-cli}/references/session-management.md +0 -0
  399. /package/skills/{playwright-cli → playwright/playwright-cli}/references/storage-state.md +0 -0
  400. /package/skills/{playwright-cli → playwright/playwright-cli}/references/test-generation.md +0 -0
  401. /package/skills/{playwright-cli → playwright/playwright-cli}/references/tracing.md +0 -0
  402. /package/skills/{playwright-cli → playwright/playwright-cli}/references/video-recording.md +0 -0
@@ -1,82 +0,0 @@
1
- ---
2
- title: Import Tests From TestRail
3
- description: Learn how to export tests from TestRail using three different methods CSV export, the built-in UI tool, and the migration script. This guide walks you through the process of exporting test cases from TestRail, whether you're using the CSV export feature for easy data transfer, the intuitive UI tool for streamlined export, or the migration script for more advanced needs. Each method is explained in detail, allowing you to choose the best option for exporting your test data efficiently.
4
- type: article
5
- url: https://docs.testomat.io/project/import-export/import-tests-from-testrail
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: og:image
10
- content: https://docs.testomat.io/_astro/import_from_testrail_button.CWNnrpnC_JhLel.webp
11
-
12
- - tag: meta
13
- attrs:
14
- name: keywords
15
- content: Testomat.io, CSV, TestRail, test import, TestRail migration, manual tests, automated tests, test management, custom XLS
16
- ---
17
-
18
- > If you have existing tests in TestRail and wish to migrate to Testomat.io, this guide will walk you through the process of importing your tests into Testomat.io.
19
-
20
- Currently, Testomat.io supports three methods for exporting tests from TestRail
21
-
22
- - Import via CSV
23
- - Built-in UI tool (via API)
24
- - API migration script
25
-
26
- ## How to Import Tests from CSV
27
-
28
- > Use CSV Import for quick imports without attachments. It’s ideal for straightforward migrations, especially when you don’t need to include test attachments or extra metadata.
29
-
30
- 1. Navigate to your project in Testomat.io.
31
- 2. Click on the **Imports** tab.
32
- 3. Select the **Import From TestRail** button.
33
-
34
- ![image Import from TestRail button](./images/import_from_testrail_button.png)
35
-
36
- 4. Click on the **Import tests from CSV file** link.
37
-
38
- ![image Import from CSV file](./images/import_tests_from_CSV_link.png)
39
-
40
- 5. From the dropdown menu, choose **TestRail**.
41
- 6. Select the CSV file containing your exported TestRail tests.
42
- 7. Click the **Create** button to complete the import.
43
-
44
- ![image Import from Testrail CSV](./images/import_testrail_csv.png)
45
-
46
- ## Example Files For Import
47
-
48
- Below is a sample of the supported format:
49
-
50
- [TestRail](https://testomatio-artifacts.ams3.cdn.digitaloceanspaces.com/documentation/TestRail.csv)
51
-
52
-
53
- ## Import TestRail Project via Build-in UI Tool (via API)
54
-
55
- >If you have a small or medium-sized TestRail project (up to 1000 tests) that you'd like to import into Testomat.io, you can easily use our intuitive built-in UI tool, which imports tests via the API.
56
-
57
- 1. Navigate to your project in Testomat.io.
58
- 2. Click on the **Imports** tab.
59
- 3. Select the **Import From TestRail** button.
60
- 4. Enter your valid TestRail credentials in the provided fields.
61
- 5. Click the **Import Tests** button to begin the import process.
62
-
63
- ![image Import from Testrail via API](./images/import_testrail_project_via_API.png)
64
-
65
- > Make sure that you have enabled API in the administration area in TestRail under Administration > Site Settings > API.
66
-
67
- ## Import TestRail Project via API Migration Script
68
-
69
- >Use the API Migration Script when migrating large TestRail projects (more than 1000 tests) that include attachments or require more customization than the built-in UI tool can handle. This method is ideal for transferring extensive datasets, ensuring that all test cases, including attachments, are accurately imported into Testomat.io.
70
-
71
- 1. Navigate to your project in Testomat.io.
72
- 2. Click on the **Imports** tab.
73
- 3. Select the **Import From TestRail** button.
74
- 4. Click on the **Import Locally** link to access the [migration script instructions](https://github.com/testomatio/migrate-testrail).
75
-
76
-
77
- ![image Import from Testrail via API](./images/testrail_migration_script_link.png)
78
-
79
-
80
-
81
-
82
-
@@ -1,55 +0,0 @@
1
- ---
2
- title: Import Tests From XRay
3
- description: Learn how to import tests from XRay into Testomat.io using the migration script that utilizes the XRay API.
4
- type: article
5
- url: https://docs.testomat.io/project/import-export/import-tests-from-xray
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Testomat.io, CSV, XRay, test import, XRay migration, manual tests, automated tests, test management
11
- ---
12
-
13
- > If you have existing tests in XRay and want to migrate to Testomat.io, you can use our migration script, which pulls test cases via the XRay API and converts them into Testomat.io’s format.
14
-
15
- ## Import XRay Project via Migration Script
16
-
17
- This method is ideal if you need to migrate test cases directly from XRay, including custom fields or complex structures.
18
-
19
- ### Steps:
20
-
21
- 1. Open your project in Testomat.io.
22
- 2. Go to the **Imports** tab.
23
- 3. Click the **Import from CSV** button.
24
-
25
- ![Import from CSV button](./images/import_fromcsv_button.png)
26
-
27
- 4. From the dropdown, select **XRay**.
28
- 5. Follow the instructions in the [advanced XRay migration script](https://github.com/testomatio/migrate-xray) to export your tests via API and convert them into a CSV format compatible with Testomat.io.
29
-
30
- ![Import from XRay Script](./images/XRay_script.png)
31
-
32
- ## How to Import Tests into Testomat.io
33
-
34
- 1. If you're creating a brand new project, the **Import from Spreadsheet** button will be available under the Test tab.
35
-
36
- ![image Import from Spreadsheet button](./images/import_from_spreadsheet_button.png)
37
-
38
- 2. If you're working in an existing project, open it in Testomat.io.
39
- 3. Click the **Imports** tab.
40
- 4. Click the **Import from CSV** button.
41
-
42
- ![image Import from CSV button](./images/import_from_csv_button.png)
43
-
44
- 5. From the dropdown menu, choose **Testomatio**.
45
- 6. Select the file generated by the migration script.
46
- 7. Click the **Create** button to complete the import.
47
-
48
- ![image Import Testomat](./images/import_testomat.png)
49
-
50
-
51
-
52
-
53
-
54
-
55
-
@@ -1,334 +0,0 @@
1
- ---
2
- title: Test Plans Overview
3
- description: Explore how to create and manage test plans in Testomat.io. This guide covers manual, automated, and mixed test plans, detailing how to organize test cases, run tests on CI, and combine manual and automated test reports. Learn how to configure Continuous Integration and use filters for efficient test management.
4
- type: article
5
- url: https://docs.testomat.io/project/plans
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: test plans, test plan creation, test plan execution, manual testing, automated testing, mixed test plans, CI/CD, CLI, continuous integration, test case management, QA, Testomat.io, testing strategy, test reports
11
- ---
12
-
13
- **Test Plan** defines the scope, structure, and execution model of a run. It helps teams clearly understand which tests will be executed, how they are grouped, and how results will be reported.
14
-
15
- In Testomat.io, Test Plans allow you to organize tests, control how they are executed (manually, automatically, or both), and keep test results consistent and transparent for all stakeholders.
16
-
17
- The **Plans** page is the central place where you create, manage, and organize all test plans. From here, you can:
18
-
19
- 1. **Filter by label** – Narrow down plans by labels for better organization
20
- 2. **Search** – Quickly find plans by name
21
- 3. **+ New plan** – Create Manual, Automated, or Mixed plans
22
- 4. **Multiselect** – Select multiple plans to apply bulk actions
23
- 5. **Filter by type** – Narrow down plans by types (Manual, Automated, Mixed, or Generated)
24
- 6. **Labels** – Assign or remove labels to one or multiple plans
25
- 7. **Link to Issue** – Link plans to issues individually or in bulk
26
- 8. **Delete** – Remove one or multiple plans using multiselect
27
-
28
- ![Overview Plans page](./images/att3_6256.png)
29
-
30
- This overview helps you quickly navigate, filter, and manage test plans before working with plan details and runs.
31
-
32
- ## Types of Test Plans
33
-
34
- Testomat.io supports three main types of test plans. Each type is designed for a specific testing goal and execution model. Choosing the right plan type depends on how your tests are executed and how results should be reported.
35
-
36
- - **Manual** – for executing tests manually and reporting results from the UI
37
- - **Automated** – for running automated tests via CI or CLI and reporting results automatically
38
- - **Mixed** – for combining manual and automated tests in a single plan and report
39
-
40
- Below, we’ll walk through each plan type and explain how and when to use it.
41
-
42
- ### Manual Plans
43
-
44
- **Manual Plans** are designed for tests that are executed manually by testers.
45
-
46
- They are typically used when:
47
-
48
- - Tests require human validation or judgment
49
- - Exploratory or usability testing is performed
50
- - Manual regression or acceptance testing is needed
51
-
52
- #### Add Automated Tests as Manual
53
-
54
- Manual Plans include an optional toggle: **Run Automated as Manual**.
55
-
56
- **When enabled:**
57
-
58
- - Automated tests can be added to a Manual Plan **using the same selection logic as manual tests** (test tree, folders/suites, or filters)
59
- - These tests are executed manually, and test run statuses (**Passed / Failed / Skipped**) are assigned manually during the run
60
-
61
- **When disabled:**
62
-
63
- - Automated tests are not selectable
64
-
65
- This toggle is the **only exception** to the strict plan-to-test-type mapping.
66
-
67
- ![Run Automated as Manual toggle](./images/gif4_5256.gif)
68
-
69
- ### Automated Plans
70
-
71
- **Automated Plans** are designed for running automated tests and sending their results to Testomat.io.
72
-
73
- They are typically used when you:
74
-
75
- - Want to run a fixed or predefined set of automated tests
76
- - Execute tests automatically via a **Continuous Integration (CI) service** or **from CLI**
77
- - Need tests to run regularly (e.g., nightly, on every commit, or before a release)
78
- - Want test results reported automatically, without manual intervention
79
-
80
- With Automated Plans:
81
-
82
- - Only **automated tests** can be added to the plan
83
- - Test execution is triggered via a CI pipeline or CLI command
84
- - Execution results are sent automatically to Testomat.io
85
-
86
- To use an Automated Plan:
87
-
88
- - Tests must have **IDs**
89
- - IDs can be generated using the `--update-ids` option during test import
90
- - Each plan has a **Plan ID**, which can be used to run this specific collection of tests
91
-
92
- For example,
93
-
94
- `TESTOMATIO={API_KEY} npx @testomatio/reporter run 'actual run command' --filter 'testomatio:plan={Plan_ID}'`
95
-
96
- - `{API_KEY}` – your Testomat.io Reporting API key
97
- - `{Plan_ID}` – ID of the plan you want to run
98
- - `'actual run command'` – your test framework command (e.g., `npx codeceptjs`)
99
-
100
- #### How to Launch an Automated Run from a Plan
101
-
102
- Once your Automated Plan is created, you can start an automated run from the **'Plans'** page.
103
-
104
- If you want to run tests automatically on a CI service:
105
-
106
- 1. Go to the **'Plans'** page
107
- 2. Open your Automated Plan
108
- 3. Click the **'Launch'** button → you will be redirected to the **Runs** page
109
- 4. A new run **'Run automated tests in CI'** will be triggered in the sidebar
110
-
111
- ![Launch from Automated Plan from Plan](./images/gif5_5256.gif)
112
-
113
- :::note
114
-
115
- The **'Launch'** button on the Plans page will **not be active** if Continuous Integration is not configured. Make sure CI is set up first. Learn more on the [Continuous Integration page](https://docs.testomat.io/usage/continuous-integration/).
116
-
117
- :::
118
-
119
- ### Mixed Plans
120
-
121
- **Mixed Plans** combine both manual and automated tests in a single plan.
122
-
123
- They are typically used when you:
124
-
125
- - Include automated tests that run via CI or via CLI
126
- - Have other tests that still require manual execution
127
- - Want a **single report** for the entire testing scope
128
-
129
- With Mixed Plans:
130
-
131
- - Both **manual and automated tests** can be added in the same plan
132
- - Automated tests can be executed via CI or triggered via CLI
133
- - Manual tests are executed manually
134
- - Results from both test types are combined into a single run report
135
-
136
- This makes Mixed Plans suitable for flexible or transitional testing strategies.
137
-
138
- #### How to Launch a Mixed Run from a Plan
139
-
140
- Once your Mixed Plan is created, you can start a run directly from the **'Plans'** page. When triggered:
141
-
142
- 1. Go to the **'Plans'** page
143
- 2. Open your Mixed Plan
144
- 3. Click the **'Launch'** button → you will be redirected to the **Runs** page
145
- 4. A new run **'New Mixed Run'** will be triggered in the sidebar
146
- 5. You can choose whether to **enable or disable CI build** for this run
147
-
148
- :::note
149
-
150
- The **'Launch'** button on the Plans page will **not be active** if Continuous Integration is not configured. Make sure CI is set up first. Learn more on the [Continuous Integration page](https://docs.testomat.io/usage/continuous-integration/).
151
-
152
- :::
153
-
154
- ![Launch from Mixed Plan from Plan](./images/gif6_5256.gif)
155
-
156
- ## How to Create a New Plan
157
-
158
- This section explains how to create a Test Plan in Testomat.io and configure its basic settings. You can create a plan from different parts of the application, depending on your workflow.
159
-
160
- ### Ways to Create a Test Plan
161
-
162
- There are two ways to create a Test Plan in Testomat.io:
163
-
164
- 1. **From the Plans page**
165
- This is the standard way to create and manage plans. It is suitable for all plan types and is described in detail below.
166
-
167
- 2. **From the Runs page**
168
- You can also create a plan directly while launching a run.
169
- In this case:
170
- - The plan creation settings are **identical** to creating a plan from the Plans page
171
- - The newly created plan is **automatically pre-selected** for the current run
172
- - This is the **only supported way** to create a plan during **Manual or Mixed run**
173
-
174
- ![Create Plan from Runs page](./images/gif1_7641.gif)
175
-
176
- Regardless of where you start — from the **Plans** page or directly from the **Runs** page — the plan creation and configuration flow remains the same.
177
-
178
- ### Common Flow for All Plan Types (Including All Tests)
179
-
180
- Before selecting test cases for any plan, the creation process follows the same initial steps for all plan types:
181
-
182
- 1. Go to the **'Plans'** page
183
- 2. Click the **'+ New plan'** dropdown
184
- 3. Choose one of the following options from the dropdown:
185
-
186
- - **Manual**
187
- - **Automated**
188
- - **Mixed**
189
-
190
- ![Type plan](./images/att1_6256.png)
191
-
192
- 4. Enter a **Title** (required)
193
- 5. Add a **Description** (optional)
194
-
195
- The description helps clarify the plan’s purpose, scope, and objectives. It can also be viewed later in the plan details or when inspecting Runs.
196
-
197
- 6. Enable the **'Run Automated as Manual'** toggle (optional)
198
- 7. Click the **'+ All tests'** button, then confirm
199
-
200
- :::note
201
-
202
- Clicking 'All tests' adds all tests to the collection and clears any other filters.
203
-
204
- :::
205
-
206
- 8. Click the **'Save'** button
207
-
208
- ![save New plan](./images/att2_6256.png)
209
-
210
- ## How to Work with Test Collections
211
-
212
- | Feature / Action | Description | Notes / Logic |
213
- | ----------------------------- | ------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
214
- | **Enable/Disable collection** | Toggle to show/hide tests in the collection | No restrictions |
215
- | **Add filter** | Adds filters within a collection | **AND** logic is applied between filters inside a single collection. <br> Cannot add any filters in a collection where **Tests** are already selected <br> To use filters, apply different filters or create another collection |
216
- | **Delete filters** | Removes filters from the collection | If the **last remaining filter** is removed while the collection toggle is enabled, <br> **all tests are included in the collection**.<br> Removing one of multiple filters works as expected |
217
- | **All tests** | Includes all tests in the collection | All tests are included in the collection; removes any active filters |
218
- | **Add collection** | Adds a new collection with its own filters | Allows combining different sets of filters across collections; **OR** logic applies between collections |
219
- | **Delete collection** | Deletes the collection | Removes the collection along with all its filters. The first (default) collection cannot be deleted |
220
-
221
- ### Filter-based selection
222
-
223
- Filters allow you to dynamically **include or exclude tests in a plan** based on metadata. Adding or removing tests via filters directly affects the plan, not just the collection.
224
-
225
- **Include Tests by Filters**
226
-
227
- - Adds tests to the collection **and the plan** that match any of the selected filters
228
- - Supported filters for Include:
229
- - Suites & folders
230
- - Tags
231
- - Priority
232
- - Assignees
233
- - Labels
234
- - Custom labels
235
- - Query
236
- - Logic: **AND** within a collection, **OR** between collections
237
- - All tests selected by the filters are displayed in the **Matched tests** tab
238
-
239
- **Exclude Tests by Filters**
240
-
241
- - Removes tests from the collection **and the plan** that match selected filters
242
- - Supported filters for Exclude:
243
- - Suites & folders
244
- - Query
245
- - Works in combination with **Include Tests by Filters**
246
- - Logic: **AND** within a collection
247
-
248
- :::note
249
-
250
- **Tests** is a chosen mode, not a filter. It cannot be combined with **supported filters** in the same collection.
251
-
252
- :::
253
-
254
- ![Collections & filters](./images/att8_5256.png)
255
-
256
- ## Managing Plans
257
-
258
- Efficient management of test plans is key to keeping your testing organized and transparent. In Testomat.io, you can group and organize plans using **Labels**, making it easy to filter, find, and manage multiple plans at once.
259
-
260
- ### Benefits of Using Labels for Plans
261
-
262
- By assigning labels to your plans, you can:
263
-
264
- - Organize plans by category, team, or purpose – e.g., 'Regression', 'Smoke', 'QA'
265
- - Filter plans quickly – instantly narrow down the list of plans by selecting specific labels
266
- - Maintain consistency across projects – ensure all plans follow a structured labeling system
267
- - Apply bulk actions easily – assign or remove labels from multiple plans at once using multi-selection
268
-
269
- Labels provide a flexible way to group and manage plans according to your workflow.
270
-
271
- ### How to Assign Labels to Plans
272
-
273
- 1. Go to the **Plans** page
274
- 2. Open a plan or select multiple plans using multi-selection mode
275
- 3. Click the **Labels**
276
- 4. Select the labels you want to assign
277
- 5. Click **Add** button
278
-
279
- ![Assign Labels to Plans](./images/gif1_518.gif)
280
-
281
- :::note
282
-
283
- You can create new labels or manage existing ones in [Settings → Labels & Fields](https://docs.testomat.io/advanced/tags-labels/labels-and-custom-fields/#how-to-add-labels--custom-fields). Make sure to set the Scope to Plans so labels are applied correctly.
284
-
285
- :::
286
-
287
- ### Filtering Plans by Labels
288
-
289
- Testomat.io offers two convenient ways to filter your plans using **labels**:
290
-
291
- 1. Using the **Filter Bar**:
292
-
293
- - Click the **filter** icon next to the search bar
294
- - Apply one or multiple labels
295
- - This method allows multi-label filtering, showing only plans that match all selected labels
296
-
297
- ![Filter Bar](./images/att2_7821.png)
298
-
299
- 2. Using the **Quick Filter Panel**
300
-
301
- - All labels currently in use are displayed
302
- - Select a single label from this list to quickly filter plans
303
- - This method is ideal for fast, one-label filtering
304
-
305
- ![Quick Filter Panel](./images/att3_7821.png)
306
-
307
- :::note
308
-
309
- Use the **Filter Bar** for more advanced multi-label filtering, and the **Quick Filter Panel** for fast access to frequently used labels.
310
-
311
- :::
312
-
313
- ### Tree View for Plans
314
-
315
- Plans can be displayed in a hierarchical tree structure that mirrors the test organization. To switch to tree view, open a plan and click the tree view icon in the top right corner of the test list.
316
-
317
- You can:
318
-
319
- * Expand folders
320
- * Collapse sections
321
- * Navigate large test sets faster
322
- * Focus on specific areas of a project
323
-
324
- :::note
325
-
326
- This is particularly useful for large projects containing hundreds or thousands of tests.
327
-
328
- :::
329
-
330
- ### Example Use Cases
331
-
332
- - QA lead wants to see only Regression plans – assign a 'Regression' label to all relevant plans and filter by it
333
- - A team working on Frontend tests can quickly access all their plans by using the 'Frontend' label
334
- - During release planning, project managers can filter plans by priority or milestone labels to focus on relevant test coverage
@@ -1,104 +0,0 @@
1
- ---
2
- title: Pulse
3
- description: Pulse in Testomat.io tracks all changes to tests, test suites, test plans, and test runs, providing transparency and control over project modifications. It tracks creation details, updates, and offers a history of changes. With its recovery feature, deleted items can be easily restored. The Bulk Restore option allows users to recover multiple deleted tests, suites, or plans simultaneously.
4
- type: article
5
- url: https://docs.testomat.io/project/pulse
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Pulse, Testomat.io, test tracking, test suite monitoring, test plan tracking, test run tracking, version history, change tracking, test recovery, Bulk Restore, test management, suite restoration, plan monitoring
11
- ---
12
-
13
- **Pulse** is a powerful feature in [Testomat.io](https://app.testomat.io) that brings full visibility, traceability, and control to your QA workflow. It tracks every change made within your projects — including **tests, suites, plans, and runs** — giving you a clear picture of how your testing assets evolve over time.
14
-
15
- Pulse provides instant visibility into team activity and testing progress. This helps **QA Leads** and **Project Managers** stay informed without manually requesting status updates.
16
-
17
- ## What is Pulse
18
-
19
- Pulse acts as your **project’s activity log** and **version history**, automatically recording all modifications across **tests, suites, plans, and runs**. It’s designed to ensure transparency, accountability, and easy recovery, so your team can work confidently knowing that every action is tracked and reversible.
20
-
21
- Every action related to these entities is recorded, providing full visibility into how your testing assets evolve over time.
22
-
23
- With Pulse, you can:
24
-
25
- - See **who made a change**, **what was changed**, and **when** it happened.
26
- - Review the history of edits, additions, or deletions for any test, suite, plan, or run.
27
- - **Restore deleted items** or roll back to previous versions with a single click.
28
-
29
- For **QA Engineers**, this means full control over versioned work. For **managers**, it offers a reliable audit trail and a clear view of project momentum over time.
30
-
31
- This ensures you’ll never lose important test data or struggle to understand how your project has evolved — Pulse keeps your QA process transparent and your history intact.
32
-
33
- ## How Pulse Works
34
-
35
- You can access Pulse directly from the **Pulse** tab in your Testomat.io project. There, you’ll find a chronological list of all activities recorded over the last **90 days**. Each entry contains detailed information about the change, including timestamps, item type, and the responsible team member.
36
-
37
- Pulse allows you to track every action across your QA workflow, giving you a clear picture of how tests, suites, plans, and runs evolve over time.
38
-
39
- ### Activity Types
40
-
41
- Activity tracking applies to all main QA entities in your project. For each entity, Pulse records **who performed the action** and **when it happened**:
42
-
43
- - **Suite** — tracking full **CRUD** activity for suites, with versioned changes, before/after diffs, including title and description updates, attachment changes, bulk edits within a suite, and suite restore.
44
- - **Test** — tracking full **CRUD** activity for tests, with versioned changes, before/after diffs, including title and description updates, attachment and priority changes, test state updates (manual, automated), and test restore.
45
- - **Run** — tracking activity for runs, with versioned changes, before/after diffs, including manual or automatic purge, run restore, and permanent removal.
46
- - **Plan** — tracking full **CRUD** activity for plans (manual, automated, mixed), with versioned changes, before/after diffs, including filter updates, included/excluded suites and tests, query changes, manual/automated state changes, and plan restore.
47
-
48
- **QA Leads** can use this overview to identify active contributors, while **PMs** can quickly assess whether recent changes align with sprint goals or release timelines.
49
-
50
- :::note
51
-
52
- Every recorded event provides a clear snapshot of the change and supports **rollback functionality**, so you can revert to a previous version or recover deleted items when needed.
53
-
54
- :::
55
-
56
- ## Filtering and Navigation
57
-
58
- Pulse includes powerful filters to help you quickly find the information you need. You can narrow down activities based on:
59
-
60
- - **Item Type** – filter logs by **Suite, Test, Run, or Plan**.
61
- - **Date Range** – filter changes within a specific time window.
62
- - **Changed By** – see actions performed by a particular user.
63
-
64
- ![Testomat.io - Pulse Activity Tabs](./images/Pulse_filters.gif)
65
-
66
- Each filter can be applied individually or in combination, enabling precise tracking of team activity and project evolution.
67
-
68
- ![Filters](./images/att1_7104.png)
69
-
70
- This makes it easy to monitor specific team members’ contributions or isolate changes from a given testing phase.
71
-
72
- In addition to filters, Pulse provides activity tabs that allow you to switch between:
73
-
74
- - **Created** — new tests, suites, or plans added to the project.
75
- - **Changed** — updates to existing items.
76
- - **Deleted** — items removed from the project, including tests, suites, plans, or runs.
77
-
78
- These tabs instantly filter the activity feed by action type, making navigation faster and more intuitive.
79
-
80
- ![Testomat.io - Pulse Activity Tabs](./images/Pulse_activity_tabs.gif)
81
-
82
- ## Diff
83
-
84
- Pulse provides a Diff view for items with the **Changed** action. It allows you to compare different versions of the same item and clearly see what was modified between them.
85
-
86
- ![Diff](./images/att2_7104.png)
87
-
88
- ## Bulk Restore
89
-
90
- Bulk Restore is a great extension for Pulse. It is designed to save you time and effort by allowing you to restore multiple deleted tests and suites at once.
91
-
92
- With Bulk Restore, you can:
93
-
94
- - **Batch Restore:** Quickly and efficiently recover multiple deleted tests and suites at once, eliminating the need to restore each item individually.
95
-
96
- - **Multi-Selection Mode:** Easily activate multi-select mode, choose the tests and suites you wish to restore, and bring them all back with a single action.
97
-
98
- ![Testomat.io - Bulk Restore](./images/New_85QaXaUI_2024-07-30.gif)
99
-
100
- :::note
101
-
102
- **Runs activity in Pulse** tracks all purge actions for transparency. Permanently deleted Runs cannot be restored. Full details: [Runs Activity Tracked in Pulse](https://docs.testomat.io/project/runs/managing-runs/#runs-activity-tracked-in-pulse).
103
-
104
- :::