testeiya 0.2.1 → 0.3.9

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (414) hide show
  1. package/LICENSE +21 -0
  2. package/README.md +41 -213
  3. package/dist/prompt/context.js +79 -0
  4. package/dist/prompt/context.js.map +1 -0
  5. package/dist/prompt/index.js +56 -0
  6. package/dist/prompt/index.js.map +1 -0
  7. package/dist/prompt/print.js +22 -0
  8. package/dist/prompt/print.js.map +1 -0
  9. package/dist/prompt/project-info.js +2 -0
  10. package/dist/prompt/project-info.js.map +1 -0
  11. package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +24 -21
  12. package/dist/prompt/system-prompt.js.map +1 -0
  13. package/dist/prompt/testomatio.js +264 -0
  14. package/dist/prompt/testomatio.js.map +1 -0
  15. package/dist/prompt/tools.js +49 -0
  16. package/dist/prompt/tools.js.map +1 -0
  17. package/dist/prompt/vocab.js +8 -0
  18. package/dist/prompt/vocab.js.map +1 -0
  19. package/dist/src/args.js +72 -0
  20. package/dist/src/args.js.map +1 -0
  21. package/dist/src/cli.js +61 -0
  22. package/dist/src/cli.js.map +1 -0
  23. package/dist/src/env.js +69 -0
  24. package/dist/src/env.js.map +1 -0
  25. package/dist/src/mcp-extension.js +9 -0
  26. package/dist/src/mcp-extension.js.map +1 -0
  27. package/dist/src/mcp.js +139 -0
  28. package/dist/src/mcp.js.map +1 -0
  29. package/dist/src/model.js +66 -0
  30. package/dist/src/model.js.map +1 -0
  31. package/dist/src/result.js +41 -0
  32. package/dist/src/result.js.map +1 -0
  33. package/dist/src/run.js +199 -0
  34. package/dist/src/run.js.map +1 -0
  35. package/dist/src/session.js +77 -0
  36. package/dist/src/session.js.map +1 -0
  37. package/dist/vendor/mcp.js +14801 -0
  38. package/mcp-tools.json +2967 -0
  39. package/package.json +29 -42
  40. package/prompt/context.ts +101 -0
  41. package/prompt/index.ts +93 -0
  42. package/prompt/print.ts +23 -0
  43. package/prompt/project-info.ts +30 -0
  44. package/prompt/system-prompt.ts +173 -0
  45. package/{src/prompt → prompt}/testomatio.ts +119 -8
  46. package/{src/prompt → prompt}/tools.ts +30 -8
  47. package/prompt/vocab.ts +7 -0
  48. package/{skills.lock.json → skills/skills.lock.json} +11 -7
  49. package/skills/skills.yaml +34 -0
  50. package/assets/testeiya-logo-dark.svg +0 -16
  51. package/assets/testeiya-logo.svg +0 -15
  52. package/models.catalog.json +0 -6963
  53. package/skills/codeceptjs/ci-fix-tests/SKILL.md +0 -120
  54. package/skills/codeceptjs/codeceptjs-auth/SKILL.md +0 -158
  55. package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +0 -91
  56. package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +0 -158
  57. package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +0 -90
  58. package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +0 -234
  59. package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +0 -110
  60. package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +0 -306
  61. package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +0 -352
  62. package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +0 -472
  63. package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +0 -350
  64. package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +0 -81
  65. package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +0 -206
  66. package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
  67. package/skills/playwright-best-practices-skill/README.md +0 -147
  68. package/skills/playwright-best-practices-skill/SKILL.md +0 -303
  69. package/skills/playwright-best-practices-skill/advanced/authentication-flows.md +0 -360
  70. package/skills/playwright-best-practices-skill/advanced/authentication.md +0 -871
  71. package/skills/playwright-best-practices-skill/advanced/clock-mocking.md +0 -364
  72. package/skills/playwright-best-practices-skill/advanced/mobile-testing.md +0 -409
  73. package/skills/playwright-best-practices-skill/advanced/multi-context.md +0 -288
  74. package/skills/playwright-best-practices-skill/advanced/multi-user.md +0 -393
  75. package/skills/playwright-best-practices-skill/advanced/network-advanced.md +0 -452
  76. package/skills/playwright-best-practices-skill/advanced/third-party.md +0 -464
  77. package/skills/playwright-best-practices-skill/architecture/pom-vs-fixtures.md +0 -363
  78. package/skills/playwright-best-practices-skill/architecture/test-architecture.md +0 -369
  79. package/skills/playwright-best-practices-skill/architecture/when-to-mock.md +0 -383
  80. package/skills/playwright-best-practices-skill/browser-apis/browser-apis.md +0 -391
  81. package/skills/playwright-best-practices-skill/browser-apis/iframes.md +0 -403
  82. package/skills/playwright-best-practices-skill/browser-apis/service-workers.md +0 -504
  83. package/skills/playwright-best-practices-skill/browser-apis/websockets.md +0 -403
  84. package/skills/playwright-best-practices-skill/core/annotations.md +0 -424
  85. package/skills/playwright-best-practices-skill/core/assertions-waiting.md +0 -361
  86. package/skills/playwright-best-practices-skill/core/configuration.md +0 -452
  87. package/skills/playwright-best-practices-skill/core/fixtures-hooks.md +0 -417
  88. package/skills/playwright-best-practices-skill/core/global-setup.md +0 -434
  89. package/skills/playwright-best-practices-skill/core/locators.md +0 -242
  90. package/skills/playwright-best-practices-skill/core/page-object-model.md +0 -315
  91. package/skills/playwright-best-practices-skill/core/projects-dependencies.md +0 -453
  92. package/skills/playwright-best-practices-skill/core/test-data.md +0 -492
  93. package/skills/playwright-best-practices-skill/core/test-suite-structure.md +0 -361
  94. package/skills/playwright-best-practices-skill/core/test-tags.md +0 -298
  95. package/skills/playwright-best-practices-skill/debugging/console-errors.md +0 -420
  96. package/skills/playwright-best-practices-skill/debugging/debugging.md +0 -504
  97. package/skills/playwright-best-practices-skill/debugging/error-testing.md +0 -360
  98. package/skills/playwright-best-practices-skill/debugging/flaky-tests.md +0 -496
  99. package/skills/playwright-best-practices-skill/frameworks/angular.md +0 -530
  100. package/skills/playwright-best-practices-skill/frameworks/nextjs.md +0 -469
  101. package/skills/playwright-best-practices-skill/frameworks/react.md +0 -531
  102. package/skills/playwright-best-practices-skill/frameworks/vue.md +0 -574
  103. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/ci-cd.md +0 -468
  104. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/docker.md +0 -283
  105. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/github-actions.md +0 -546
  106. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/gitlab.md +0 -397
  107. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/other-providers.md +0 -521
  108. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/parallel-sharding.md +0 -371
  109. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/performance.md +0 -453
  110. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/reporting.md +0 -424
  111. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/test-coverage.md +0 -497
  112. package/skills/playwright-best-practices-skill/testing-patterns/accessibility.md +0 -359
  113. package/skills/playwright-best-practices-skill/testing-patterns/api-testing.md +0 -719
  114. package/skills/playwright-best-practices-skill/testing-patterns/browser-extensions.md +0 -506
  115. package/skills/playwright-best-practices-skill/testing-patterns/canvas-webgl.md +0 -493
  116. package/skills/playwright-best-practices-skill/testing-patterns/component-testing.md +0 -500
  117. package/skills/playwright-best-practices-skill/testing-patterns/drag-drop.md +0 -576
  118. package/skills/playwright-best-practices-skill/testing-patterns/electron.md +0 -509
  119. package/skills/playwright-best-practices-skill/testing-patterns/file-operations.md +0 -377
  120. package/skills/playwright-best-practices-skill/testing-patterns/file-upload-download.md +0 -562
  121. package/skills/playwright-best-practices-skill/testing-patterns/forms-validation.md +0 -561
  122. package/skills/playwright-best-practices-skill/testing-patterns/graphql-testing.md +0 -331
  123. package/skills/playwright-best-practices-skill/testing-patterns/i18n.md +0 -508
  124. package/skills/playwright-best-practices-skill/testing-patterns/performance-testing.md +0 -476
  125. package/skills/playwright-best-practices-skill/testing-patterns/security-testing.md +0 -430
  126. package/skills/playwright-best-practices-skill/testing-patterns/visual-regression.md +0 -634
  127. package/skills/playwright-cli/SKILL.md +0 -420
  128. package/skills/playwright-cli/references/element-attributes.md +0 -23
  129. package/skills/playwright-cli/references/playwright-tests.md +0 -39
  130. package/skills/playwright-cli/references/request-mocking.md +0 -87
  131. package/skills/playwright-cli/references/running-code.md +0 -241
  132. package/skills/playwright-cli/references/session-management.md +0 -225
  133. package/skills/playwright-cli/references/storage-state.md +0 -275
  134. package/skills/playwright-cli/references/test-generation.md +0 -433
  135. package/skills/playwright-cli/references/tracing.md +0 -139
  136. package/skills/playwright-cli/references/video-recording.md +0 -143
  137. package/skills/testeiya/README.md +0 -29
  138. package/skills/testeiya/answer-formatting/SKILL.md +0 -30
  139. package/skills/testeiya/check-cucumber/SKILL.md +0 -200
  140. package/skills/testeiya/check-tests/SKILL.md +0 -260
  141. package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
  142. package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
  143. package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
  144. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
  145. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
  146. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
  147. package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
  148. package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
  149. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
  150. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
  151. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
  152. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
  153. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
  154. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
  155. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
  156. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
  157. package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
  158. package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
  159. package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
  160. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
  161. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
  162. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
  163. package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
  164. package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
  165. package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
  166. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
  167. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
  168. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
  169. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
  170. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
  171. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
  172. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
  173. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
  174. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
  175. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
  176. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
  177. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
  178. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
  179. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
  180. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
  181. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
  182. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
  183. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
  184. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
  185. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
  186. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
  187. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
  188. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
  189. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
  190. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
  191. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
  192. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
  193. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
  194. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
  195. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
  196. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
  197. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
  198. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
  199. package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
  200. package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
  201. package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
  202. package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
  203. package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
  204. package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
  205. package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
  206. package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
  207. package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
  208. package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
  209. package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
  210. package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
  211. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
  212. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
  213. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
  214. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
  215. package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
  216. package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
  217. package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
  218. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
  219. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
  220. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
  221. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
  222. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
  223. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
  224. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
  225. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
  226. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
  227. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
  228. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
  229. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
  230. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
  231. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
  232. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
  233. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
  234. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
  235. package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
  236. package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
  237. package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
  238. package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
  239. package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
  240. package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
  241. package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
  242. package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
  243. package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
  244. package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
  245. package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
  246. package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
  247. package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
  248. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
  249. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
  250. package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
  251. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
  252. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
  253. package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
  254. package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
  255. package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
  256. package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
  257. package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
  258. package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
  259. package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
  260. package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
  261. package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
  262. package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
  263. package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
  264. package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
  265. package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
  266. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
  267. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
  268. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
  269. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
  270. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
  271. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
  272. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
  273. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
  274. package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
  275. package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
  276. package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
  277. package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
  278. package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
  279. package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
  280. package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
  281. package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
  282. package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
  283. package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
  284. package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
  285. package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
  286. package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +0 -88
  287. package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +0 -95
  288. package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +0 -334
  289. package/skills/testomatio/test-automation/automate-manual-test-cases/CLAUDE.md +0 -56
  290. package/skills/testomatio/test-automation/automate-manual-test-cases/SKILL.md +0 -242
  291. package/skills/testomatio/test-automation/automate-manual-test-cases/references/CODECEPTJS_BEST_PRACTICES.md +0 -182
  292. package/skills/testomatio/test-automation/automate-manual-test-cases/references/FINAL_SUMMARY_TEMPLATE.md +0 -22
  293. package/skills/testomatio/test-automation/automate-manual-test-cases/references/PLAYWRIGHT_BEST_PRACTICES.md +0 -90
  294. package/skills/testomatio/test-automation/automate-manual-test-cases/references/POM_BEST_PRACTICES.md +0 -53
  295. package/skills/testomatio/test-automation/automate-manual-test-cases/references/TEST_DATA_MANAGEMENT.md +0 -52
  296. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/SKILL.md +0 -107
  297. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/references/DEBUGGING_QUICK_REFERENCE.md +0 -113
  298. package/skills/testomatio/test-automation/qa-automation-test-consolidation/SKILL.md +0 -29
  299. package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +0 -151
  300. package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
  301. package/skills/testomatio/test-automation/testomat-allure-adapter/SKILL.md +0 -289
  302. package/skills/testomatio/test-management/detect-duplicate-test-cases/SKILL.md +0 -86
  303. package/skills/testomatio/test-management/detect-duplicate-test-cases/references/DUPLICATE_INSTRUCTIONS.md +0 -54
  304. package/skills/testomatio/test-management/improve-test-cases/SKILL.md +0 -114
  305. package/skills/testomatio/test-management/improve-test-cases/references/TESTOMAT_MARKDOWN_EXAMPLE.md +0 -66
  306. package/skills/testomatio/test-management/pull-request-diff-analyzer/SKILL.md +0 -141
  307. package/skills/testomatio/test-management/qa-e2e-tests-reporting/SKILL.md +0 -354
  308. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_ARTIFACTS.md +0 -82
  309. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_HTML_REPORT.md +0 -37
  310. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_REPORTERS_CONFIG.md +0 -118
  311. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/SKILL.md +0 -149
  312. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/references/summary-example.md +0 -54
  313. package/skills/testomatio/test-management/qa-requirement-reviewer/SKILL.md +0 -126
  314. package/skills/testomatio/test-management/qa-requirement-reviewer/references/requirements_reviewer_examples.md +0 -128
  315. package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +0 -174
  316. package/skills/testomatio/test-management/qa-test-code-coverage/references/COVERAGE_FILE_FORMAT.md +0 -138
  317. package/skills/testomatio/test-management/qa-test-code-coverage/references/E2E_FRAMEWORKS.md +0 -65
  318. package/skills/testomatio/test-management/qa-test-code-coverage/scripts/check-coverage.mjs +0 -40
  319. package/skills/testomatio/test-management/qa-thinking/SKILL.md +0 -36
  320. package/skills/testomatio/test-management/qa-write-test-cases/SKILL.md +0 -267
  321. package/skills/testomatio/test-management/qa-write-test-cases/references/test-case-format.md +0 -387
  322. package/skills/testomatio/test-management/qa-write-test-cases/references/testomat-tms-guide.md +0 -72
  323. package/skills/testomatio/test-management/qa-write-test-cases/references/writing-rule.md +0 -159
  324. package/skills/testomatio/test-management/scan-automation-project/SKILL.md +0 -152
  325. package/skills/testomatio/test-management/sync-test-cases-with-tms/SKILL.md +0 -107
  326. package/skills/testomatio/test-management/sync-test-cases-with-tms/references/TESTOMATIO_CLI.md +0 -140
  327. package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +0 -182
  328. package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +0 -169
  329. package/skills.yaml +0 -21
  330. package/src/ai-debug.ts +0 -188
  331. package/src/api/agent-get.ts +0 -22
  332. package/src/api/agent-start.ts +0 -384
  333. package/src/api/client-log.ts +0 -29
  334. package/src/api/context.ts +0 -332
  335. package/src/api/debug-layout.ts +0 -47
  336. package/src/api/debug-report.ts +0 -29
  337. package/src/api/debug-snapshot.ts +0 -30
  338. package/src/api/debug-stream.ts +0 -52
  339. package/src/api/files-delete.ts +0 -184
  340. package/src/api/files-read.ts +0 -41
  341. package/src/api/files-rename.ts +0 -99
  342. package/src/api/files-tree.ts +0 -292
  343. package/src/api/files-write.ts +0 -41
  344. package/src/api/mcp.ts +0 -603
  345. package/src/api/memory.ts +0 -69
  346. package/src/api/open-external.ts +0 -39
  347. package/src/api/playwright-cli.ts +0 -606
  348. package/src/api/providers.ts +0 -457
  349. package/src/api/read-env-token.ts +0 -33
  350. package/src/api/sessions.ts +0 -79
  351. package/src/api/settings.ts +0 -120
  352. package/src/api/skills.ts +0 -58
  353. package/src/api/testomatio-attachment.ts +0 -89
  354. package/src/api/testomatio-auth.ts +0 -284
  355. package/src/api/testomatio-proxy.ts +0 -197
  356. package/src/api/testomatio-run-stats.ts +0 -81
  357. package/src/api/testomatio-target.ts +0 -225
  358. package/src/api/testomatio-transcription.ts +0 -82
  359. package/src/api/workspace-search.ts +0 -96
  360. package/src/api/workspace-sync.ts +0 -151
  361. package/src/api/workspace.ts +0 -165
  362. package/src/app-server.ts +0 -556
  363. package/src/bridge.ts +0 -251
  364. package/src/check-tests.ts +0 -156
  365. package/src/cli.ts +0 -17
  366. package/src/commands.ts +0 -244
  367. package/src/config.ts +0 -183
  368. package/src/connection.ts +0 -658
  369. package/src/context-store.ts +0 -265
  370. package/src/debug-bus.ts +0 -405
  371. package/src/extensions/tool-gate.ts +0 -220
  372. package/src/extensions/webui/ask-channel.ts +0 -52
  373. package/src/extensions/webui/index.ts +0 -184
  374. package/src/extensions/webui/tools/ask-question.ts +0 -88
  375. package/src/extensions/webui/tools/query-result.ts +0 -79
  376. package/src/extensions/webui/tools/render-chart.ts +0 -53
  377. package/src/extensions/webui/tools/render-item.ts +0 -61
  378. package/src/extensions/webui/tools/render-list.ts +0 -170
  379. package/src/extensions/webui/tools/render-result.ts +0 -85
  380. package/src/extensions/webui/tools/render-tree.ts +0 -71
  381. package/src/extensions/webui/tools/ui-widget.ts +0 -54
  382. package/src/extensions/webui/tools/widget-result.ts +0 -13
  383. package/src/extensions/webui/widget-channel.ts +0 -50
  384. package/src/file-log.ts +0 -196
  385. package/src/git-tracked.ts +0 -68
  386. package/src/gitignore.ts +0 -53
  387. package/src/json-store.ts +0 -43
  388. package/src/load-env.ts +0 -70
  389. package/src/loader-style.ts +0 -96
  390. package/src/main.ts +0 -140
  391. package/src/mcp-catalog.ts +0 -96
  392. package/src/models-catalog.ts +0 -72
  393. package/src/permissions.ts +0 -120
  394. package/src/project-dir.ts +0 -189
  395. package/src/project-info.ts +0 -108
  396. package/src/prompt/app-ui.ts +0 -59
  397. package/src/prompt/browser.ts +0 -27
  398. package/src/prompt/index.ts +0 -62
  399. package/src/server-info.ts +0 -62
  400. package/src/session-factory.ts +0 -442
  401. package/src/session-store.ts +0 -115
  402. package/src/shell-env.ts +0 -45
  403. package/src/skills.ts +0 -163
  404. package/src/sync-snapshot.ts +0 -140
  405. package/src/telemetry.ts +0 -239
  406. package/src/testomatio-auth.ts +0 -299
  407. package/src/testomatio.ts +0 -98
  408. package/src/theme.ts +0 -30
  409. package/src/user-env.ts +0 -94
  410. package/src/welcome.ts +0 -194
  411. package/src/workspace/safe-path.ts +0 -85
  412. package/src/workspace/test-md.ts +0 -70
  413. package/src/workspace-model.ts +0 -440
  414. package/testeiya.config.json +0 -14
@@ -1,633 +0,0 @@
1
- ---
2
- title: Running Tests Manually
3
- description: Learn how to execute manual tests using Testomat.io. This guide covers creating test plans, running multi-environment tests, and executing manual tests as checklists. It also provides instructions for editing launched test runs and running automated tests manually with full test reporting and tracking.
4
- type: article
5
- url: https://docs.testomat.io/project/runs/running-tests-manually
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: og:image
10
- content: https://docs.testomat.io/_astro/170301515-667bf871-6c49-4059-ae3e-3e561ef92a01.CyiV0dJU_tdLPA.webp
11
-
12
- - tag: meta
13
- attrs:
14
- name: keywords
15
- content: manual testing, test plans, test environment, checklist mode, manual test execution, multi-environment testing, Testomat.io, QA testing, test management, automated tests manually
16
- ---
17
-
18
- In Testomat.io, manual test runs allow QA Engineers to execute tests that are not automated (yet) or to run automated tests in manual mode.
19
- During a manual run, testers can mark each test as **Passed**, **Failed**, or **Skipped**, add messages, attach evidence (screenshots, logs, etc.), and assign tests to specific team members.
20
-
21
- There are **two main ways** to start a manual run:
22
-
23
- 1. From the **'Tests'** page – quick launch for selected tests or suites, or adding tests to an already ongoing run without leaving the Tests view
24
- 2. From the **'Runs'** page – the classic way to create and manage full runs with complete configuration options
25
-
26
- ## How to Launch from the Tests Page
27
-
28
- From the **'Tests'** page, you can quickly start a run or add tests to an existing run without opening the Runs view. Available options include:
29
-
30
- - Add single test case to ongoing run
31
- - Add multiple test cases to ongoing run
32
- - Run a single suite
33
- - Run multiple suites at once
34
- - Launch **manual**, **automated**, or **mixed** suites if CI is configured
35
-
36
- ### How to Add a Test Case to the Run from Tests Page
37
-
38
- Add a test case to your unfinished run directly from **'Tests'** page.
39
-
40
- 1. Go to the **'Tests'** page.
41
- 2. Click on the Test Case that you want to add.
42
- 3. Click the **Extra menu** button on test case page.
43
- 4. Select **'Add to Run'** option from the dropdown menu.
44
-
45
- ![Testomat.io - add test case from Tests page](./images/Add_Test_1.png)
46
-
47
- 5. Select the unfinished run to which you want to add this test.
48
- 6. Click the **'Add to Run'** button.
49
-
50
- ![Testomat.io - add test case from Tests page](./images/Add_Test_2.png)
51
-
52
- The test case is successfully added to the selected ongoing run:
53
-
54
- ![Testomat.io - add test case from Tests page](./images/Add_Test_3.png)
55
-
56
- As well you can use **Multi-select** option to add several tests to a run simultaneously.
57
-
58
- 1. Go to the **'Tests'** page.
59
- 2. Enable **'Multi-select'** option.
60
- 3. Select a few test cases.
61
- 4. Click the **'Extra menu'** button in the multi-select menu panel.
62
- 5. Select **'Add to Run'** option.
63
-
64
- ![Testomat.io - add a few tests from Tests page](./images/Add_Multiple_Tests_1.png)
65
-
66
- The selected tests will be immediately added to the ongoing test run, helping you to keep your execution plan up-to-date even while a run is already in progress.
67
-
68
- ### How to Run a Suite from Tests Page
69
-
70
- Testomat.io allows you to launch a run of a single suite or multiple suites directly from the **'Tests'** page.
71
-
72
- #### Run a Single Suite
73
-
74
- 1. Go to the **'Tests'** page.
75
- 2. Click on the Suite that you want to Launch.
76
- 3. Click the **'Extra menu'** button on suite page.
77
- 4. Select **'Run Tests'** option from the dropdown menu.
78
-
79
- ![Testomat.io - add suite from Tests page](./images/Add_Suite_1.png)
80
-
81
- 5. Click the **'Launch'** button on the displayed modal.
82
-
83
- ![Testomat.io - add suite from Tests page](./images/Add_Suite_2.png)
84
-
85
- The Run window, displaying all test cases within the selected Suite, will appear automatically.
86
-
87
- ![Testomat.io - add suite from Tests page](./images/Add_Suite_3.png)
88
-
89
- #### Run Several Suites
90
-
91
- Use the **'Multi-select'** option to launch multiple suites in a single run.
92
-
93
- 1. Go to the **'Tests'** page.
94
- 2. Enable **'Multi-select'** option.
95
- 3. Select a few suites.
96
- 4. Click the **'Run'** button.
97
-
98
- ![Testomat.io - add several suites from Tests page](./images/Add_Suite_4.png)
99
-
100
- 5. Click the **'Launch'** button on the displayed modal.
101
-
102
- ![Testomat.io - add several suites from Tests page](./images/Add_Suite_5.png)
103
-
104
- If you need to configure additional run settings (such as RunGroup or environment), click the **'Additional Settings'** link on the displayed modal.
105
-
106
- :::note
107
-
108
- You can Launch not only **manual** suites but also **automated** or **mixed** suites from **'Tests'** page, if Continuous Integration for your project is set up. Learn more about it on the relevant page on [Continuous Integration](https://docs.testomat.io/integrations/continuous-integration/) section.
109
-
110
- ![Testomat.io - run automated suite Tests page](./images/Automated_Suite_1.gif)
111
-
112
- :::
113
-
114
- ## How to Launch from the Runs Page
115
-
116
- From the **Runs** page, you can create and manage runs with flexible configuration options and full execution control. You can launch runs immediately or prepare and save them for later execution. Runs can include all tests in the project or predefined test plans, allowing you to organize testing according to your workflow.
117
-
118
- ### How to Configure a Manual Run
119
-
120
- When creating a manual run from the Runs page, the following options are available for configuration:
121
-
122
- Options Overview:
123
-
124
- - **All tests** – launch all manual tests available in the project
125
- - **Test plan** – select from existing test plans
126
-
127
- - Supports bulk selection
128
- - You can also create a new test plan if needed (Learn more [here](https://docs.testomat.io/project/plans/#ways-to-create-a-test-plan))
129
-
130
- - **Select tests** – manually select tests from the tree structure, use search, or apply filters to narrow down your selection
131
-
132
- - Supports bulk selection
133
- - Filters and collections allow for advanced selection and grouping of tests
134
- - Learn more about working with test collections & filters [here](https://docs.testomat.io/project/plans/#how-to-work-with-test-collections)
135
-
136
- - **Without tests** – create the run structure first and populate it later
137
-
138
- :::note
139
-
140
- These options are mutually exclusive — you can select only one at a time — but you can still use bulk actions within 'Test plan' and 'Select tests' options.
141
-
142
- :::
143
-
144
- Additional Configurations:
145
-
146
- - **Assign to** – define who will execute the tests (See: [How to Assign Users to the Run](https://docs.testomat.io/project/runs/running-tests-manually/#how-to-assign-users-to-the-run))
147
- - **Title** (optional) – give your run a descriptive name
148
- - **Rungroup** – group the run within a specific RunGroup for better organization (See: [How to Run Tests in RunGroups](https://docs.testomat.io/project/runs/running-tests-manually/#how-to-run-tests-in-rungroups))
149
- - **Set environment for execution** – choose one or multiple environments for the run (See: [How to Run Environments](https://docs.testomat.io/project/runs/environments/#how-to-run-with-multi-environments))
150
- - **Description** (optional) – provide context for this run
151
- - **Run as checklist** – hides test descriptions for faster execution, ideal for experienced testers (See: [How to Run Tests As Checklist](https://docs.testomat.io/project/runs/running-tests-manually/#how-to-run-tests-as-checklist))
152
- - **Launch** button – immediately start the run with the configured settings
153
- - **Save** button – store the configured run without launching it, so it can be executed later
154
- - **Cancel** - exit without saving; all changes will be lost
155
-
156
- ![Run configuration](./images/att1_7641.png)
157
-
158
- ### How to Set up Additional Manual Run options
159
-
160
- When manual run is launched, the following set up options are available:
161
-
162
- 1. **Collapse/Expand all** - expands or collapses test suites within the run structure
163
- 2. **Tree view/list view** - displays tests as a hierarchical tree or a flat list
164
- 3. **Extra options menu** - displays the list of additional set up options
165
- 4. **Refresh structure** - updates the test list to reflect any structural changes made during the run, such as moving, adding or removing tests
166
- 5. **Show/Hide Test Creation** - enables or disables the visibility of the button used to create and add new test cases during the run
167
- 6. **Show/Hide Labels** - shows or hides labels applicable to individual test cases
168
- 7. **Show/Hide Tags** - shows or hides tags applicable to individual test cases
169
-
170
- ![Manual Run Additional Options](./images/additional_manual_run_options.png)
171
-
172
- ### How to Run All Tests
173
-
174
- To launch a Manual Run you need:
175
-
176
- 1. Go to the **Runs** page
177
- 2. Click the **Manual Run** button
178
-
179
- ![Launch Manual Run](./images/att2_362.png)
180
-
181
- 3. Add additional configuration if needed (See: [How set up additional configurations](https://docs.testomat.io/project/runs/running-tests-manually/#how-to-configure-a-manual-run))
182
-
183
- The **'All tests'** tab is selected by default, meaning that **all manual tests in the project will be included in this run**.
184
-
185
- 4. Click **Launch** to start the run
186
-
187
- ![Launch all tests](./images/att2_7641.png)
188
-
189
- ### How to Set Test Case Results in Manual Run
190
-
191
- Once a manual test run is launched, you need to set a Result for each test case. The available options are:
192
-
193
- - **PASSED** – The test case was successfully executed;
194
- - **FAILED** – The test case did not meet the expected result;
195
- - **SKIPPED** – The test case was not executed;
196
-
197
- **Steps to Set Test Case Results, Messages, and Attach Files**:
198
-
199
- 1. Click on a test case
200
- 2. Select the appropriate result: PASSED, FAILED, or SKIPPED
201
-
202
- ![Appropriate results](./images/att1_301.png)
203
-
204
- 3. Once the result is selected, you have the following options for the Test Result message field:
205
-
206
- - Type your own message manually;
207
- - Leave the field empty;
208
- - Select a custom status from the available options and also type your own message in the field (as shown in the example below);
209
-
210
- ![Test Result message](./images/att2_301.png)
211
-
212
- :::note
213
-
214
- If you need to configure different custom statuses, click here: <a href="https://docs.testomat.io/project/runs/custom-statuses/" target="_blank">Custom Statuses</a>
215
-
216
- :::
217
-
218
- 4. Once the **'Attaching a file'** field appears, allowing you to browse or drag-and-drop a file (e.g., screenshot, log file) to provide additional context for the result. This can help document evidence related to the test case, such as error logs or screenshots of the issue.
219
-
220
- ![Attaching a file field](./images/att3_301.png)
221
-
222
- 5. You can also configure the view of attached files with the following options:
223
-
224
- - Large Thumbnails;
225
- - Small Thumbnails;
226
- - Grid View;
227
- - List View;
228
-
229
- ![Configuration view](./images/att4_301.png)
230
-
231
- 6. Additionally, there are also two ways to view the specific file:
232
-
233
- - **Open and fit to width**;
234
-
235
- ![Open and fit to width](./images/att8_301.png)
236
-
237
- - Open and view a **Full screen** of the specific file;
238
-
239
- ![Full screen](./images/att7_301.png)
240
-
241
- 7. To delete an attached file, click on the **trash** icon
242
- 8. After warning message **'Are you sure?'** appears, click **OK** button to confirm deletion
243
-
244
- ![Delete attachments](./images/att5_301.png)
245
-
246
- 9. Once all test cases are completed, click the **Finish Run** button to end the process
247
-
248
- ![Finish Run button](./images/att6_301.png)
249
-
250
- ### How to Assign Users to the Run
251
-
252
- By default, only the user who created the Run is added to it. However, Testomat.io allows you to assign multiple users to one Run:
253
-
254
- 1. Click on **'Manual Run'** button.
255
-
256
- ![Testomat.io - Assign Users](./images/Assign_users_1.png)
257
-
258
- 2. Click on **'Assign users'** option.
259
-
260
- ![Testomat.io - Assign Users](./images/Assign_users_2.png)
261
-
262
- 3. Click on **'Assign to'** dropdown list and select users.
263
-
264
- ![Testomat.io - Assign Users](./images/Assign_users_3.png)
265
-
266
- After selecting users, you can choose an assignment strategy, add a description, select/create a test plan, select an environment, etc., and then launch the test run.
267
-
268
- **Test Assignment Strategies:**
269
-
270
- - **None:** Users won't be automatically assigned to tests within this run. All users in the run can pick any test to assign, or you, as a manager, can manually assign users when run is started.
271
-
272
- - **Prefer test assignee:** The system respects assignments made at the test and suite levels. Tests within this run will be automatically assigned to users responsible for them.
273
-
274
- - **Randomly distribute tests between team members:** Tests within this run will be equally split between assigned team members. Manager won't be assigned to any test.
275
-
276
- To select Test Assignment Strategies:
277
-
278
- 1. Assign at least one user to a Run.
279
- 2. Click on **'Auto-Assign Users'** button.
280
- 3. Select a strategy from the list.
281
-
282
- ![Testomat.io - Assignment Strategy](./images/Assign_strategy.png)
283
-
284
- ### How to Assign Users to Specific Test Cases or Suites
285
-
286
- During the Run you can assign different users to specific Test Cases, Suites or Folders within one Run.
287
-
288
- :::note
289
-
290
- First, you need to assign users to the Run, and only after this you can assign them to specific Test Cases, Suites and Folders.
291
-
292
- :::
293
-
294
- **To Assign a User to a Suite/Folder:**
295
-
296
- 1. Open Run with assigned users.
297
- 2. Click on **'Continue'** button.
298
-
299
- ![Testomat.io - Assign Suite](./images/Assign_suite.png)
300
-
301
- 3. Click on **'Assign to'** icon for specific Suite/Folder.
302
- 4. Select a user for assignment from the list.
303
-
304
- ![Testomat.io - Assign Suite](./images/Assign_suite_2.png)
305
-
306
- **To Assign a User to Test Cases:**
307
-
308
- You can assign specific Test Cases only via **Multi-Select** button.
309
-
310
- 1. Open Run with assigned users.
311
- 2. Click **‘Continue’** button.
312
-
313
- ![Testomat.io - Assign Suite](./images/Assign_suite.png)
314
-
315
- 3. Click **‘Multi-Select’** button.
316
- 4. Select the Test Cases you would like to assign.
317
- 5. Click the **'Assign to'** button at the bottom.
318
- 6. Select a user for assignment from the list.
319
-
320
- ![Testomat.io - Assign TC](./images/Assign_TC.png)
321
-
322
- 7. Click **'OK'** in the **'Are you sure you want to assign (username) to all selected tests?'** pop-up window.
323
-
324
- Your Test Cases and Suites are now successfully assigned to different users.
325
-
326
- ![Testomat.io - Assign TC](./images/Assign_TC_1.png)
327
-
328
- ### How to Select a Test Environment
329
-
330
- To select a testing environment you need:
331
-
332
- 1. Click on Environment field
333
- 2. Choose one or more environments from the dropdown list
334
- 3. Click **Save** to apply your selection
335
-
336
- ![Select Environment](./images/att3_355.png)
337
-
338
- Testomat.io supports multiple strategies for running tests across different environments such as browsers, operating systems, devices, and deployment stages. You can run tests in single or multiple environments — sequentially or in parallel — depending on your project needs and infrastructure.
339
-
340
- To learn more about configuring, managing, and running tests with environments, including multi-environment execution modes and CI/CD integration, please see the full guide here: [How to Run Environments](https://docs.testomat.io/project/runs/environments/).
341
-
342
- ### How to Run Tests in RunGroups
343
-
344
- RunGroups allow you to organize test runs into structured folders, making it easier to manage and analyze test execution. By grouping related runs, you can maintain better visibility over different testing phases, environments, or specific test suites.
345
-
346
- Before proceeding, make sure you have created a RunGroup. For detailed instructions on how to create and manage RunGroups, refer to this [guide](https://docs.testomat.io/project/runs/managing-runs/#rungroups) for more details.
347
-
348
- **Enabling RunGroups for New Runs** (Optional Setting)
349
-
350
- This setting is optional and can be enabled if you need it. Overall, you can freely create runs inside and out of groups.
351
-
352
- 1. Navigate to the **Settings** in the sidebar
353
- 2. Click on the **Project** tab
354
- 3. In the **Runs settings**, enable the option to require a RunGroup for new runs
355
-
356
- ![Enable Run Settings](images/att1_214.png)
357
-
358
- Once the RunGroup is enabled, you can start your runs within folders. Make sure the **RunGroup Structure** is also enabled.
359
-
360
- :::note
361
-
362
- This setting applies to all new run types — manual, automated, and mixed.
363
-
364
- :::
365
-
366
- **Launching Runs in a Folder**
367
-
368
- 1. Navigate to the **Runs** tab
369
- 2. Click the **Manual Run** button
370
-
371
- ![Manual Run button](images/att2_214.png)
372
-
373
- 3. Select the required **RunGroup** from the dropdown
374
- 4. Click the **Launch** button
375
-
376
- ![Launch button](images/att4_214.png)
377
-
378
- **Important:** If no RunGroup is selected, the field will be highlighted in red, and a warning message will appear, prompting you to choose a group before proceeding.
379
-
380
- ![Group field is required](images/att3_214.png)
381
-
382
- :::note
383
-
384
- If you relaunch an existing run as a copy and the original run belongs to a RunGroup, the copy is placed in the same group. No manual selection is needed.
385
-
386
- :::
387
-
388
- By following these steps, you can organize test runs within RunGroups, ensuring a structured and manageable testing workflow. See the result below:
389
-
390
- ![Runs into Folders](images/att5_214.png)
391
-
392
- ## How to Run Tests As Checklist
393
-
394
- Checklists are commonly used in manual testing to quickly execute a set of tests without distractions from additional details. In this mode, test descriptions are hidden by default, but you can still view them by clicking the Toggle Description button.
395
-
396
- In the **New Manual Run** sidebar,
397
-
398
- 1. Select a **Test Plan** or **All Manual Tests**
399
- 2. Enable **Run as checklist**
400
- 3. Click the **Launch** button
401
-
402
- ![Checklist toggle](./images/att4_355.png)
403
-
404
- Once the manual run is launched, test descriptions will be hidden. To view a description for any test:
405
-
406
- 4. Click the extra menu -> Toggle Description
407
-
408
- ![Toggle Description](./images/att5_355.png)
409
-
410
- ## How to Run Test With Steps Execution
411
-
412
- Test execution by steps is a feature that enhances manual testing by allowing testers to track and manage the results of individual test steps. This ensures better traceability, improved defect detection, and a structured approach to test execution. By marking each step separately, QA teams gain deeper insights into the testing process and can effectively address issues as they arise.
413
-
414
- 1. Click the **Runs** in the sidebar
415
- 2. Launch a new manual run
416
-
417
- ![Launch a new run](images/att1_306.png)
418
-
419
- 3. Select the test with detailed steps you want to execute
420
- 4. Mark steps according to the results:
421
-
422
- - Click a step once to mark it as **Passed**
423
- - Click a step twice to mark it as **Failed**
424
- - Click a step three times to mark it as **Skipped**
425
-
426
- 5. Add a result with a message (optionally) for the test
427
- 6. Click **Finish Run** to complete the test execution
428
-
429
- ![Finish run](images/gif1_306.gif)
430
-
431
- Test execution by steps introduces a structured, transparent, and efficient way to conduct manual testing. By breaking down test results into individual actions, QA teams can improve accuracy, streamline defect resolution, and optimize their testing workflow. This feature plays a crucial role in ensuring high-quality software delivery by providing detailed insights into each phase of test execution.
432
-
433
- Take a look at how the test result with step execution looks:
434
-
435
- ![Test execution](images/att2_306.png)
436
-
437
- ## How to Run Automated Tests Manually
438
-
439
- Automated tests can be run manually in two ways:
440
-
441
- - **Using a Test Plan** – create a test plan and enable the **Run Automated as Manual** toggle. This method allows you to include automated tests in a plan. Learn more about creating plans [here.](https://docs.testomat.io/project/plans/#add-automated-tests-as-manual)
442
-
443
- - **Directly from the Runs page** – enable the **Run Automated as Manual** toggle during the run setup and select tests from the test tree.
444
-
445
- ### How to Run Automated Tests Manually from the Runs Page
446
-
447
- 1. Go to the **Runs** page
448
- 2. Click the **Manual Run** button
449
- 3. Switch to the **Select tests** tab
450
- 4. Enable the **Run Automated as Manual** toggle
451
- 5. Use the search, filters, or expand suites to select the automated tests you want to run
452
- 6. Click **Launch** to start the run
453
-
454
- ![Running Automated Tests from the Runs Page](./images/gif2_7641.gif)
455
-
456
- ## How to Make Changes in a Launched Run
457
-
458
- During testing, you might encounter new scenarios that need to be added immediately. Testomat.io allows you to easily add tests to a run that’s already started. This way, you can cover unexpected cases without stopping your ongoing testing process.
459
-
460
- This ensures flexibility, smooth testing workflow, and that no important scenarios are missed.
461
-
462
- 1. Go to the **Runs** page
463
- 2. Open the unfinished run you want to edit
464
- 3. Click the **Edit** button (or open the '...' menu and select **Edit**)
465
-
466
- ![Edit button](./images/att3_7641.png)
467
-
468
- Once the **Edit manual run** view is opened, here’s what you can do:
469
-
470
- - **Assign to** - Remove existing users or assign more to the run
471
- - **Title** - Enter or change the run title
472
- - **Environment** - Add or remove testing environments
473
- - **Description** - Add or update the run description
474
- - **details** link - Check configuration details of the run
475
- - **Current tests** – Shows all tests currently included in the run. Remove unnecessary tests by clicking the **trash** icon
476
- - **+ Tests** – Similar to the [Select tests](https://docs.testomat.io/project/runs/running-tests-manually/#how-to-configure-a-manual-run) tab in a new manual run. You can browse the test tree, use search or filters, or expand suites to select manual tests to add to this run
477
- - **+ Plans** – Select tests from existing test plans. You can include one or multiple plans in the current run
478
-
479
- :::note
480
-
481
- You can add tests from plans and additional tests at the same time. For example: select one or more plans, then select specific suites or individual tests — everything will be added to the run instantly.
482
-
483
- :::
484
-
485
- ![Edit existing run](./images/gif1-7865.gif)
486
-
487
- ## How to Remove and Re-add a Test in a Run
488
-
489
- Removing a test does not delete it. You can remove a test from a running test run and bring it back later. Testomat.io marks the test as excluded and keeps it in the run configuration.
490
-
491
- ### How to Return a Test to the Run
492
-
493
- If you remove a test and then add the same test again, the run holds two statuses at once, excluded and included. The excluded status has higher priority, so the test stays out of the run's test list, even though Testomat.io confirms it was added.
494
-
495
- If you only removed the test:
496
-
497
- 1. Open the run and go to configuration **details**.
498
- 2. Find the removed test and cancel the deletion.
499
- 3. The test returns to the run.
500
-
501
- ![Test configuration details](./images/574-test-config.png)
502
-
503
- If you removed the test and then added it again, it now shows both a removed and an added status:
504
-
505
- 1. Open configuration **details** and find the test.
506
- 2. Click the `x` next to the removed status to clear the exclusion.
507
-
508
- The added status then takes effect, and the test appears in the run.
509
-
510
- ![Removing a deleted test from test configuration](./images/574-remove-from-test-config.png)
511
-
512
- ## How to Adjust Test Case Description Block
513
-
514
- In case you want to adjust the size of the test description block to see more details without scrolling or to minimize it, you can easily resize it by following these steps:
515
-
516
- 1. Locate the vertical bar at the bottom of the test description block.
517
- 2. Hover your cursor over the bar until it changes to a resize indicator (an up-and-down arrow).
518
- 3. Click and hold the left mouse button on the bar.
519
- 4. Drag the bar up to decrease the block size or down to increase it.
520
- 5. Release the mouse button once you've adjusted the size to your preference.
521
-
522
- ![Testomat.io - Test Case Description Block Adjustment](./images/Testcase_block_adjustment.png)
523
-
524
- This way, you can customize the view to match your workflow.
525
-
526
- ## Bulk Actions in Runs
527
-
528
- Managing test cases efficiently is crucial for smooth test execution. With bulk actions, you can perform multiple operations at once, reducing manual effort and saving time. Below are the available bulk actions you can use within test runs.
529
-
530
- ### How to Reassign Multiple Test Cases
531
-
532
- If you need to reassign test cases to a different user, you no longer have to update each test case separately. Instead, follow these easy steps:
533
-
534
- 1. Click **‘Runs’** button on the sidebar
535
- 2. Open the test run you’re working on
536
- 3. Click **‘Continue’** button
537
-
538
- ![reassign test cases](./images/att1_1054.png)
539
-
540
- 4. Click **‘Multi-Select’** button
541
- 5. Select the specific tests you would like to reassign
542
- 6. Click the **'Assign to'** button at the bottom
543
- 7. Select a user you would like to reassign
544
- 8. Click **'OK'** in the **'Are you sure you want to assign (username) to all selected tests?'** pop-up window
545
-
546
- This feature significantly reduces manual effort and speeds up the reassignment process during test run.
547
-
548
- Let’s check how tests look like after changes.
549
-
550
- ![reassign test cases](./images/att3_1054.png)
551
-
552
- ### How to Multi-Select Result Messages for Test Cases
553
-
554
- While running tests and selecting the appropriate status with a result message, you can multi-select result messages for test cases. Follow these steps to complete the process:
555
-
556
- 1. Click **‘Runs’** button on the sidebar
557
- 2. Open a test run you’re working on
558
- 3. Click **‘Continue’** button
559
-
560
- ![Run a test](./images/att1_878.png)
561
-
562
- 4. Click **‘Multi-Select’** button
563
- 5. Select the specific tests
564
- 6. Click the **‘Result message’** button at the bottom
565
-
566
- ![Result Message appears](./images/att2_878.png)
567
-
568
- 7. Select an appropriate status, e.g., **‘PASSED’**
569
- 8. Choose a result message, e.g., **‘Expected behaviour’**
570
- 9. Also, type a result message in the provided field
571
- 10. Click the **‘Apply’** button
572
-
573
- ![Apply changes](./images/att3_878.png)
574
-
575
- This feature allows testers to update multiple test cases efficiently, ensuring consistency in reporting results.
576
-
577
- By using bulk actions, you streamline test management, improve workflow efficiency, and maintain consistency across test runs.
578
-
579
- Let’s verify the multiple message results in these test cases:
580
-
581
- ![Bulk result message](./images/gif1_878.gif)
582
-
583
- ## How to Track Test Time
584
-
585
- You may find it useful to track the time spent on runs and specific test cases. For this purpose, Testomat.io has developed flexible time tracking.
586
-
587
- The first thing you need to do is start a run. Сlick on the button with the stopwatch icon **(1)** and then click on the **Track** button **(2)**. Every 10 seconds will be displayed in the time record. The time is also displayed next to the title of each test case.
588
-
589
- ![Testomat.io - Track Test Time](./images/New_0VGArmlZ_2024-11-26.png)
590
-
591
- You can stop the tracking time if you need to leave during the testing process. And continue in the same way when you are ready.
592
-
593
- ![Testomat.io - Pause Tracking](./images/New_Ul6KGUJk_2024-11-26.png)
594
-
595
- If necessary, you can set the time manually. Сlick on the button with the stopwatch icon **(1)**, enter the time **(2)** using arrows or enter it from the keyboard and then click on the **Set Time** button **(2)**.
596
-
597
- ![Testomat.io - Set Time](./images/New_LRNFE60W_2024-11-26.png)
598
-
599
- What's more, you can use the **Auto-Track** feature to automatically start the tracking process when you move on to the next test.
600
-
601
- ![Testomat.io - Auto-Track](./images/New_Iul3pWTV_2024-11-26.png)
602
-
603
- At the end of the run, the report will show you the time spent on a particular test case and the total time spent on all the test cases.
604
-
605
- ![Testomat.io - Run Tracked Time](./images/New_3gSGeoy2_2024-11-26.png)
606
-
607
- This can be useful for spreading the workload across all team members in future test runs.
608
-
609
- ## How to Track Test Case History During One Run
610
-
611
- During a test run, the state or status of a test case may change multiple times. In some situations it can be important to review the history of all state changes, comments, and statuses for a specific test case before finishing the test run.
612
-
613
- For this purpose, Testomat.io provides the test case history feature within the test run, displayed in chronological order beneath the selected test case.
614
-
615
- To check the test case history, follow these steps:
616
-
617
- 1. Open the test run
618
- 2. Click 'Continue' button
619
-
620
- ![Testomat.io - Test Case History](./images/test_run.png)
621
-
622
- 3. Click on the test case to see last 3 changes
623
- 4. Click the arrow to expand the whole history, if needed
624
-
625
- ![Testomat.io - Test Case History](./images/test_case_history_1.png)
626
-
627
- Now you can see the whole test case history
628
-
629
- ![Testomat.io - Test Case History](./images/test_case_history_2.png)
630
-
631
- ## Search in Manual Runs
632
- Search functionality is available in manual runs, allowing users to quickly find specific tests and suites within a run.
633
- This makes it easier to navigate large manual runs by filtering items based on names or keywords, without scrolling through the full list.