testeiya 0.2.0 → 0.3.9

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (412) hide show
  1. package/LICENSE +21 -0
  2. package/README.md +37 -175
  3. package/dist/prompt/context.js +79 -0
  4. package/dist/prompt/context.js.map +1 -0
  5. package/dist/prompt/index.js +56 -0
  6. package/dist/prompt/index.js.map +1 -0
  7. package/dist/prompt/print.js +22 -0
  8. package/dist/prompt/print.js.map +1 -0
  9. package/dist/prompt/project-info.js +2 -0
  10. package/dist/prompt/project-info.js.map +1 -0
  11. package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +24 -21
  12. package/dist/prompt/system-prompt.js.map +1 -0
  13. package/dist/prompt/testomatio.js +264 -0
  14. package/dist/prompt/testomatio.js.map +1 -0
  15. package/dist/prompt/tools.js +49 -0
  16. package/dist/prompt/tools.js.map +1 -0
  17. package/dist/prompt/vocab.js +8 -0
  18. package/dist/prompt/vocab.js.map +1 -0
  19. package/dist/src/args.js +72 -0
  20. package/dist/src/args.js.map +1 -0
  21. package/dist/src/cli.js +61 -0
  22. package/dist/src/cli.js.map +1 -0
  23. package/dist/src/env.js +69 -0
  24. package/dist/src/env.js.map +1 -0
  25. package/dist/src/mcp-extension.js +9 -0
  26. package/dist/src/mcp-extension.js.map +1 -0
  27. package/dist/src/mcp.js +139 -0
  28. package/dist/src/mcp.js.map +1 -0
  29. package/dist/src/model.js +66 -0
  30. package/dist/src/model.js.map +1 -0
  31. package/dist/src/result.js +41 -0
  32. package/dist/src/result.js.map +1 -0
  33. package/dist/src/run.js +199 -0
  34. package/dist/src/run.js.map +1 -0
  35. package/dist/src/session.js +77 -0
  36. package/dist/src/session.js.map +1 -0
  37. package/dist/vendor/mcp.js +14801 -0
  38. package/mcp-tools.json +2967 -0
  39. package/package.json +29 -41
  40. package/prompt/context.ts +101 -0
  41. package/prompt/index.ts +93 -0
  42. package/prompt/print.ts +23 -0
  43. package/prompt/project-info.ts +30 -0
  44. package/prompt/system-prompt.ts +173 -0
  45. package/{src/prompt → prompt}/testomatio.ts +119 -8
  46. package/{src/prompt → prompt}/tools.ts +30 -8
  47. package/prompt/vocab.ts +7 -0
  48. package/{skills.lock.json → skills/skills.lock.json} +11 -7
  49. package/skills/skills.yaml +34 -0
  50. package/models.catalog.json +0 -6963
  51. package/skills/codeceptjs/ci-fix-tests/SKILL.md +0 -120
  52. package/skills/codeceptjs/codeceptjs-auth/SKILL.md +0 -158
  53. package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +0 -91
  54. package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +0 -158
  55. package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +0 -90
  56. package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +0 -234
  57. package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +0 -110
  58. package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +0 -306
  59. package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +0 -352
  60. package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +0 -472
  61. package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +0 -350
  62. package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +0 -81
  63. package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +0 -206
  64. package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
  65. package/skills/playwright-best-practices-skill/README.md +0 -147
  66. package/skills/playwright-best-practices-skill/SKILL.md +0 -303
  67. package/skills/playwright-best-practices-skill/advanced/authentication-flows.md +0 -360
  68. package/skills/playwright-best-practices-skill/advanced/authentication.md +0 -871
  69. package/skills/playwright-best-practices-skill/advanced/clock-mocking.md +0 -364
  70. package/skills/playwright-best-practices-skill/advanced/mobile-testing.md +0 -409
  71. package/skills/playwright-best-practices-skill/advanced/multi-context.md +0 -288
  72. package/skills/playwright-best-practices-skill/advanced/multi-user.md +0 -393
  73. package/skills/playwright-best-practices-skill/advanced/network-advanced.md +0 -452
  74. package/skills/playwright-best-practices-skill/advanced/third-party.md +0 -464
  75. package/skills/playwright-best-practices-skill/architecture/pom-vs-fixtures.md +0 -363
  76. package/skills/playwright-best-practices-skill/architecture/test-architecture.md +0 -369
  77. package/skills/playwright-best-practices-skill/architecture/when-to-mock.md +0 -383
  78. package/skills/playwright-best-practices-skill/browser-apis/browser-apis.md +0 -391
  79. package/skills/playwright-best-practices-skill/browser-apis/iframes.md +0 -403
  80. package/skills/playwright-best-practices-skill/browser-apis/service-workers.md +0 -504
  81. package/skills/playwright-best-practices-skill/browser-apis/websockets.md +0 -403
  82. package/skills/playwright-best-practices-skill/core/annotations.md +0 -424
  83. package/skills/playwright-best-practices-skill/core/assertions-waiting.md +0 -361
  84. package/skills/playwright-best-practices-skill/core/configuration.md +0 -452
  85. package/skills/playwright-best-practices-skill/core/fixtures-hooks.md +0 -417
  86. package/skills/playwright-best-practices-skill/core/global-setup.md +0 -434
  87. package/skills/playwright-best-practices-skill/core/locators.md +0 -242
  88. package/skills/playwright-best-practices-skill/core/page-object-model.md +0 -315
  89. package/skills/playwright-best-practices-skill/core/projects-dependencies.md +0 -453
  90. package/skills/playwright-best-practices-skill/core/test-data.md +0 -492
  91. package/skills/playwright-best-practices-skill/core/test-suite-structure.md +0 -361
  92. package/skills/playwright-best-practices-skill/core/test-tags.md +0 -298
  93. package/skills/playwright-best-practices-skill/debugging/console-errors.md +0 -420
  94. package/skills/playwright-best-practices-skill/debugging/debugging.md +0 -504
  95. package/skills/playwright-best-practices-skill/debugging/error-testing.md +0 -360
  96. package/skills/playwright-best-practices-skill/debugging/flaky-tests.md +0 -496
  97. package/skills/playwright-best-practices-skill/frameworks/angular.md +0 -530
  98. package/skills/playwright-best-practices-skill/frameworks/nextjs.md +0 -469
  99. package/skills/playwright-best-practices-skill/frameworks/react.md +0 -531
  100. package/skills/playwright-best-practices-skill/frameworks/vue.md +0 -574
  101. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/ci-cd.md +0 -468
  102. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/docker.md +0 -283
  103. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/github-actions.md +0 -546
  104. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/gitlab.md +0 -397
  105. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/other-providers.md +0 -521
  106. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/parallel-sharding.md +0 -371
  107. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/performance.md +0 -453
  108. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/reporting.md +0 -424
  109. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/test-coverage.md +0 -497
  110. package/skills/playwright-best-practices-skill/testing-patterns/accessibility.md +0 -359
  111. package/skills/playwright-best-practices-skill/testing-patterns/api-testing.md +0 -719
  112. package/skills/playwright-best-practices-skill/testing-patterns/browser-extensions.md +0 -506
  113. package/skills/playwright-best-practices-skill/testing-patterns/canvas-webgl.md +0 -493
  114. package/skills/playwright-best-practices-skill/testing-patterns/component-testing.md +0 -500
  115. package/skills/playwright-best-practices-skill/testing-patterns/drag-drop.md +0 -576
  116. package/skills/playwright-best-practices-skill/testing-patterns/electron.md +0 -509
  117. package/skills/playwright-best-practices-skill/testing-patterns/file-operations.md +0 -377
  118. package/skills/playwright-best-practices-skill/testing-patterns/file-upload-download.md +0 -562
  119. package/skills/playwright-best-practices-skill/testing-patterns/forms-validation.md +0 -561
  120. package/skills/playwright-best-practices-skill/testing-patterns/graphql-testing.md +0 -331
  121. package/skills/playwright-best-practices-skill/testing-patterns/i18n.md +0 -508
  122. package/skills/playwright-best-practices-skill/testing-patterns/performance-testing.md +0 -476
  123. package/skills/playwright-best-practices-skill/testing-patterns/security-testing.md +0 -430
  124. package/skills/playwright-best-practices-skill/testing-patterns/visual-regression.md +0 -634
  125. package/skills/playwright-cli/SKILL.md +0 -420
  126. package/skills/playwright-cli/references/element-attributes.md +0 -23
  127. package/skills/playwright-cli/references/playwright-tests.md +0 -39
  128. package/skills/playwright-cli/references/request-mocking.md +0 -87
  129. package/skills/playwright-cli/references/running-code.md +0 -241
  130. package/skills/playwright-cli/references/session-management.md +0 -225
  131. package/skills/playwright-cli/references/storage-state.md +0 -275
  132. package/skills/playwright-cli/references/test-generation.md +0 -433
  133. package/skills/playwright-cli/references/tracing.md +0 -139
  134. package/skills/playwright-cli/references/video-recording.md +0 -143
  135. package/skills/testeiya/README.md +0 -29
  136. package/skills/testeiya/answer-formatting/SKILL.md +0 -30
  137. package/skills/testeiya/check-cucumber/SKILL.md +0 -200
  138. package/skills/testeiya/check-tests/SKILL.md +0 -260
  139. package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
  140. package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
  141. package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
  142. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
  143. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
  144. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
  145. package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
  146. package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
  147. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
  148. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
  149. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
  150. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
  151. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
  152. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
  153. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
  154. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
  155. package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
  156. package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
  157. package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
  158. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
  159. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
  160. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
  161. package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
  162. package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
  163. package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
  164. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
  165. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
  166. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
  167. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
  168. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
  169. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
  170. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
  171. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
  172. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
  173. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
  174. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
  175. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
  176. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
  177. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
  178. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
  179. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
  180. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
  181. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
  182. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
  183. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
  184. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
  185. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
  186. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
  187. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
  188. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
  189. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
  190. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
  191. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
  192. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
  193. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
  194. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
  195. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
  196. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
  197. package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
  198. package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
  199. package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
  200. package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
  201. package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
  202. package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
  203. package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
  204. package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
  205. package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
  206. package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
  207. package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
  208. package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
  209. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
  210. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
  211. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
  212. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
  213. package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
  214. package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
  215. package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
  216. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
  217. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
  218. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
  219. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
  220. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
  221. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
  222. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
  223. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
  224. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
  225. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
  226. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
  227. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
  228. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
  229. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
  230. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
  231. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
  232. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
  233. package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
  234. package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
  235. package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
  236. package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
  237. package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
  238. package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
  239. package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
  240. package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
  241. package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
  242. package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
  243. package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
  244. package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
  245. package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
  246. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
  247. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
  248. package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
  249. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
  250. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
  251. package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
  252. package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
  253. package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
  254. package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
  255. package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
  256. package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
  257. package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
  258. package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
  259. package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
  260. package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
  261. package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
  262. package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
  263. package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
  264. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
  265. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
  266. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
  267. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
  268. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
  269. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
  270. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
  271. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
  272. package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
  273. package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
  274. package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
  275. package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
  276. package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
  277. package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
  278. package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
  279. package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
  280. package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
  281. package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
  282. package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
  283. package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
  284. package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +0 -88
  285. package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +0 -95
  286. package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +0 -334
  287. package/skills/testomatio/test-automation/automate-manual-test-cases/CLAUDE.md +0 -56
  288. package/skills/testomatio/test-automation/automate-manual-test-cases/SKILL.md +0 -242
  289. package/skills/testomatio/test-automation/automate-manual-test-cases/references/CODECEPTJS_BEST_PRACTICES.md +0 -182
  290. package/skills/testomatio/test-automation/automate-manual-test-cases/references/FINAL_SUMMARY_TEMPLATE.md +0 -22
  291. package/skills/testomatio/test-automation/automate-manual-test-cases/references/PLAYWRIGHT_BEST_PRACTICES.md +0 -90
  292. package/skills/testomatio/test-automation/automate-manual-test-cases/references/POM_BEST_PRACTICES.md +0 -53
  293. package/skills/testomatio/test-automation/automate-manual-test-cases/references/TEST_DATA_MANAGEMENT.md +0 -52
  294. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/SKILL.md +0 -107
  295. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/references/DEBUGGING_QUICK_REFERENCE.md +0 -113
  296. package/skills/testomatio/test-automation/qa-automation-test-consolidation/SKILL.md +0 -29
  297. package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +0 -151
  298. package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
  299. package/skills/testomatio/test-automation/testomat-allure-adapter/SKILL.md +0 -289
  300. package/skills/testomatio/test-management/detect-duplicate-test-cases/SKILL.md +0 -86
  301. package/skills/testomatio/test-management/detect-duplicate-test-cases/references/DUPLICATE_INSTRUCTIONS.md +0 -54
  302. package/skills/testomatio/test-management/improve-test-cases/SKILL.md +0 -114
  303. package/skills/testomatio/test-management/improve-test-cases/references/TESTOMAT_MARKDOWN_EXAMPLE.md +0 -66
  304. package/skills/testomatio/test-management/pull-request-diff-analyzer/SKILL.md +0 -141
  305. package/skills/testomatio/test-management/qa-e2e-tests-reporting/SKILL.md +0 -354
  306. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_ARTIFACTS.md +0 -82
  307. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_HTML_REPORT.md +0 -37
  308. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_REPORTERS_CONFIG.md +0 -118
  309. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/SKILL.md +0 -149
  310. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/references/summary-example.md +0 -54
  311. package/skills/testomatio/test-management/qa-requirement-reviewer/SKILL.md +0 -126
  312. package/skills/testomatio/test-management/qa-requirement-reviewer/references/requirements_reviewer_examples.md +0 -128
  313. package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +0 -174
  314. package/skills/testomatio/test-management/qa-test-code-coverage/references/COVERAGE_FILE_FORMAT.md +0 -138
  315. package/skills/testomatio/test-management/qa-test-code-coverage/references/E2E_FRAMEWORKS.md +0 -65
  316. package/skills/testomatio/test-management/qa-test-code-coverage/scripts/check-coverage.mjs +0 -40
  317. package/skills/testomatio/test-management/qa-thinking/SKILL.md +0 -36
  318. package/skills/testomatio/test-management/qa-write-test-cases/SKILL.md +0 -267
  319. package/skills/testomatio/test-management/qa-write-test-cases/references/test-case-format.md +0 -387
  320. package/skills/testomatio/test-management/qa-write-test-cases/references/testomat-tms-guide.md +0 -72
  321. package/skills/testomatio/test-management/qa-write-test-cases/references/writing-rule.md +0 -159
  322. package/skills/testomatio/test-management/scan-automation-project/SKILL.md +0 -152
  323. package/skills/testomatio/test-management/sync-test-cases-with-tms/SKILL.md +0 -107
  324. package/skills/testomatio/test-management/sync-test-cases-with-tms/references/TESTOMATIO_CLI.md +0 -140
  325. package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +0 -182
  326. package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +0 -169
  327. package/skills.yaml +0 -21
  328. package/src/ai-debug.ts +0 -188
  329. package/src/api/agent-get.ts +0 -22
  330. package/src/api/agent-start.ts +0 -384
  331. package/src/api/client-log.ts +0 -29
  332. package/src/api/context.ts +0 -332
  333. package/src/api/debug-layout.ts +0 -47
  334. package/src/api/debug-report.ts +0 -29
  335. package/src/api/debug-snapshot.ts +0 -30
  336. package/src/api/debug-stream.ts +0 -52
  337. package/src/api/files-delete.ts +0 -184
  338. package/src/api/files-read.ts +0 -41
  339. package/src/api/files-rename.ts +0 -99
  340. package/src/api/files-tree.ts +0 -292
  341. package/src/api/files-write.ts +0 -41
  342. package/src/api/mcp.ts +0 -603
  343. package/src/api/memory.ts +0 -69
  344. package/src/api/open-external.ts +0 -39
  345. package/src/api/playwright-cli.ts +0 -606
  346. package/src/api/providers.ts +0 -457
  347. package/src/api/read-env-token.ts +0 -33
  348. package/src/api/sessions.ts +0 -79
  349. package/src/api/settings.ts +0 -120
  350. package/src/api/skills.ts +0 -58
  351. package/src/api/testomatio-attachment.ts +0 -89
  352. package/src/api/testomatio-auth.ts +0 -284
  353. package/src/api/testomatio-proxy.ts +0 -197
  354. package/src/api/testomatio-run-stats.ts +0 -81
  355. package/src/api/testomatio-target.ts +0 -225
  356. package/src/api/testomatio-transcription.ts +0 -82
  357. package/src/api/workspace-search.ts +0 -96
  358. package/src/api/workspace-sync.ts +0 -151
  359. package/src/api/workspace.ts +0 -165
  360. package/src/app-server.ts +0 -556
  361. package/src/bridge.ts +0 -251
  362. package/src/check-tests.ts +0 -156
  363. package/src/cli.ts +0 -17
  364. package/src/commands.ts +0 -244
  365. package/src/config.ts +0 -183
  366. package/src/connection.ts +0 -658
  367. package/src/context-store.ts +0 -265
  368. package/src/debug-bus.ts +0 -405
  369. package/src/extensions/tool-gate.ts +0 -220
  370. package/src/extensions/webui/ask-channel.ts +0 -52
  371. package/src/extensions/webui/index.ts +0 -184
  372. package/src/extensions/webui/tools/ask-question.ts +0 -88
  373. package/src/extensions/webui/tools/query-result.ts +0 -79
  374. package/src/extensions/webui/tools/render-chart.ts +0 -53
  375. package/src/extensions/webui/tools/render-item.ts +0 -61
  376. package/src/extensions/webui/tools/render-list.ts +0 -170
  377. package/src/extensions/webui/tools/render-result.ts +0 -85
  378. package/src/extensions/webui/tools/render-tree.ts +0 -71
  379. package/src/extensions/webui/tools/ui-widget.ts +0 -54
  380. package/src/extensions/webui/tools/widget-result.ts +0 -13
  381. package/src/extensions/webui/widget-channel.ts +0 -50
  382. package/src/file-log.ts +0 -196
  383. package/src/git-tracked.ts +0 -68
  384. package/src/gitignore.ts +0 -53
  385. package/src/json-store.ts +0 -43
  386. package/src/load-env.ts +0 -70
  387. package/src/loader-style.ts +0 -96
  388. package/src/main.ts +0 -140
  389. package/src/mcp-catalog.ts +0 -96
  390. package/src/models-catalog.ts +0 -72
  391. package/src/permissions.ts +0 -120
  392. package/src/project-dir.ts +0 -189
  393. package/src/project-info.ts +0 -108
  394. package/src/prompt/app-ui.ts +0 -59
  395. package/src/prompt/browser.ts +0 -27
  396. package/src/prompt/index.ts +0 -62
  397. package/src/server-info.ts +0 -62
  398. package/src/session-factory.ts +0 -442
  399. package/src/session-store.ts +0 -115
  400. package/src/shell-env.ts +0 -45
  401. package/src/skills.ts +0 -163
  402. package/src/sync-snapshot.ts +0 -140
  403. package/src/telemetry.ts +0 -239
  404. package/src/testomatio-auth.ts +0 -299
  405. package/src/testomatio.ts +0 -98
  406. package/src/theme.ts +0 -30
  407. package/src/user-env.ts +0 -94
  408. package/src/welcome.ts +0 -127
  409. package/src/workspace/safe-path.ts +0 -85
  410. package/src/workspace/test-md.ts +0 -70
  411. package/src/workspace-model.ts +0 -440
  412. package/testeiya.config.json +0 -14
@@ -1,633 +0,0 @@
1
- ---
2
- title: Running Tests Manually
3
- description: Learn how to execute manual tests using Testomat.io. This guide covers creating test plans, running multi-environment tests, and executing manual tests as checklists. It also provides instructions for editing launched test runs and running automated tests manually with full test reporting and tracking.
4
- type: article
5
- url: https://docs.testomat.io/project/runs/running-tests-manually
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: og:image
10
- content: https://docs.testomat.io/_astro/170301515-667bf871-6c49-4059-ae3e-3e561ef92a01.CyiV0dJU_tdLPA.webp
11
-
12
- - tag: meta
13
- attrs:
14
- name: keywords
15
- content: manual testing, test plans, test environment, checklist mode, manual test execution, multi-environment testing, Testomat.io, QA testing, test management, automated tests manually
16
- ---
17
-
18
- In Testomat.io, manual test runs allow QA Engineers to execute tests that are not automated (yet) or to run automated tests in manual mode.
19
- During a manual run, testers can mark each test as **Passed**, **Failed**, or **Skipped**, add messages, attach evidence (screenshots, logs, etc.), and assign tests to specific team members.
20
-
21
- There are **two main ways** to start a manual run:
22
-
23
- 1. From the **'Tests'** page – quick launch for selected tests or suites, or adding tests to an already ongoing run without leaving the Tests view
24
- 2. From the **'Runs'** page – the classic way to create and manage full runs with complete configuration options
25
-
26
- ## How to Launch from the Tests Page
27
-
28
- From the **'Tests'** page, you can quickly start a run or add tests to an existing run without opening the Runs view. Available options include:
29
-
30
- - Add single test case to ongoing run
31
- - Add multiple test cases to ongoing run
32
- - Run a single suite
33
- - Run multiple suites at once
34
- - Launch **manual**, **automated**, or **mixed** suites if CI is configured
35
-
36
- ### How to Add a Test Case to the Run from Tests Page
37
-
38
- Add a test case to your unfinished run directly from **'Tests'** page.
39
-
40
- 1. Go to the **'Tests'** page.
41
- 2. Click on the Test Case that you want to add.
42
- 3. Click the **Extra menu** button on test case page.
43
- 4. Select **'Add to Run'** option from the dropdown menu.
44
-
45
- ![Testomat.io - add test case from Tests page](./images/Add_Test_1.png)
46
-
47
- 5. Select the unfinished run to which you want to add this test.
48
- 6. Click the **'Add to Run'** button.
49
-
50
- ![Testomat.io - add test case from Tests page](./images/Add_Test_2.png)
51
-
52
- The test case is successfully added to the selected ongoing run:
53
-
54
- ![Testomat.io - add test case from Tests page](./images/Add_Test_3.png)
55
-
56
- As well you can use **Multi-select** option to add several tests to a run simultaneously.
57
-
58
- 1. Go to the **'Tests'** page.
59
- 2. Enable **'Multi-select'** option.
60
- 3. Select a few test cases.
61
- 4. Click the **'Extra menu'** button in the multi-select menu panel.
62
- 5. Select **'Add to Run'** option.
63
-
64
- ![Testomat.io - add a few tests from Tests page](./images/Add_Multiple_Tests_1.png)
65
-
66
- The selected tests will be immediately added to the ongoing test run, helping you to keep your execution plan up-to-date even while a run is already in progress.
67
-
68
- ### How to Run a Suite from Tests Page
69
-
70
- Testomat.io allows you to launch a run of a single suite or multiple suites directly from the **'Tests'** page.
71
-
72
- #### Run a Single Suite
73
-
74
- 1. Go to the **'Tests'** page.
75
- 2. Click on the Suite that you want to Launch.
76
- 3. Click the **'Extra menu'** button on suite page.
77
- 4. Select **'Run Tests'** option from the dropdown menu.
78
-
79
- ![Testomat.io - add suite from Tests page](./images/Add_Suite_1.png)
80
-
81
- 5. Click the **'Launch'** button on the displayed modal.
82
-
83
- ![Testomat.io - add suite from Tests page](./images/Add_Suite_2.png)
84
-
85
- The Run window, displaying all test cases within the selected Suite, will appear automatically.
86
-
87
- ![Testomat.io - add suite from Tests page](./images/Add_Suite_3.png)
88
-
89
- #### Run Several Suites
90
-
91
- Use the **'Multi-select'** option to launch multiple suites in a single run.
92
-
93
- 1. Go to the **'Tests'** page.
94
- 2. Enable **'Multi-select'** option.
95
- 3. Select a few suites.
96
- 4. Click the **'Run'** button.
97
-
98
- ![Testomat.io - add several suites from Tests page](./images/Add_Suite_4.png)
99
-
100
- 5. Click the **'Launch'** button on the displayed modal.
101
-
102
- ![Testomat.io - add several suites from Tests page](./images/Add_Suite_5.png)
103
-
104
- If you need to configure additional run settings (such as RunGroup or environment), click the **'Additional Settings'** link on the displayed modal.
105
-
106
- :::note
107
-
108
- You can Launch not only **manual** suites but also **automated** or **mixed** suites from **'Tests'** page, if Continuous Integration for your project is set up. Learn more about it on the relevant page on [Continuous Integration](https://docs.testomat.io/integrations/continuous-integration/) section.
109
-
110
- ![Testomat.io - run automated suite Tests page](./images/Automated_Suite_1.gif)
111
-
112
- :::
113
-
114
- ## How to Launch from the Runs Page
115
-
116
- From the **Runs** page, you can create and manage runs with flexible configuration options and full execution control. You can launch runs immediately or prepare and save them for later execution. Runs can include all tests in the project or predefined test plans, allowing you to organize testing according to your workflow.
117
-
118
- ### How to Configure a Manual Run
119
-
120
- When creating a manual run from the Runs page, the following options are available for configuration:
121
-
122
- Options Overview:
123
-
124
- - **All tests** – launch all manual tests available in the project
125
- - **Test plan** – select from existing test plans
126
-
127
- - Supports bulk selection
128
- - You can also create a new test plan if needed (Learn more [here](https://docs.testomat.io/project/plans/#ways-to-create-a-test-plan))
129
-
130
- - **Select tests** – manually select tests from the tree structure, use search, or apply filters to narrow down your selection
131
-
132
- - Supports bulk selection
133
- - Filters and collections allow for advanced selection and grouping of tests
134
- - Learn more about working with test collections & filters [here](https://docs.testomat.io/project/plans/#how-to-work-with-test-collections)
135
-
136
- - **Without tests** – create the run structure first and populate it later
137
-
138
- :::note
139
-
140
- These options are mutually exclusive — you can select only one at a time — but you can still use bulk actions within 'Test plan' and 'Select tests' options.
141
-
142
- :::
143
-
144
- Additional Configurations:
145
-
146
- - **Assign to** – define who will execute the tests (See: [How to Assign Users to the Run](https://docs.testomat.io/project/runs/running-tests-manually/#how-to-assign-users-to-the-run))
147
- - **Title** (optional) – give your run a descriptive name
148
- - **Rungroup** – group the run within a specific RunGroup for better organization (See: [How to Run Tests in RunGroups](https://docs.testomat.io/project/runs/running-tests-manually/#how-to-run-tests-in-rungroups))
149
- - **Set environment for execution** – choose one or multiple environments for the run (See: [How to Run Environments](https://docs.testomat.io/project/runs/environments/#how-to-run-with-multi-environments))
150
- - **Description** (optional) – provide context for this run
151
- - **Run as checklist** – hides test descriptions for faster execution, ideal for experienced testers (See: [How to Run Tests As Checklist](https://docs.testomat.io/project/runs/running-tests-manually/#how-to-run-tests-as-checklist))
152
- - **Launch** button – immediately start the run with the configured settings
153
- - **Save** button – store the configured run without launching it, so it can be executed later
154
- - **Cancel** - exit without saving; all changes will be lost
155
-
156
- ![Run configuration](./images/att1_7641.png)
157
-
158
- ### How to Set up Additional Manual Run options
159
-
160
- When manual run is launched, the following set up options are available:
161
-
162
- 1. **Collapse/Expand all** - expands or collapses test suites within the run structure
163
- 2. **Tree view/list view** - displays tests as a hierarchical tree or a flat list
164
- 3. **Extra options menu** - displays the list of additional set up options
165
- 4. **Refresh structure** - updates the test list to reflect any structural changes made during the run, such as moving, adding or removing tests
166
- 5. **Show/Hide Test Creation** - enables or disables the visibility of the button used to create and add new test cases during the run
167
- 6. **Show/Hide Labels** - shows or hides labels applicable to individual test cases
168
- 7. **Show/Hide Tags** - shows or hides tags applicable to individual test cases
169
-
170
- ![Manual Run Additional Options](./images/additional_manual_run_options.png)
171
-
172
- ### How to Run All Tests
173
-
174
- To launch a Manual Run you need:
175
-
176
- 1. Go to the **Runs** page
177
- 2. Click the **Manual Run** button
178
-
179
- ![Launch Manual Run](./images/att2_362.png)
180
-
181
- 3. Add additional configuration if needed (See: [How set up additional configurations](https://docs.testomat.io/project/runs/running-tests-manually/#how-to-configure-a-manual-run))
182
-
183
- The **'All tests'** tab is selected by default, meaning that **all manual tests in the project will be included in this run**.
184
-
185
- 4. Click **Launch** to start the run
186
-
187
- ![Launch all tests](./images/att2_7641.png)
188
-
189
- ### How to Set Test Case Results in Manual Run
190
-
191
- Once a manual test run is launched, you need to set a Result for each test case. The available options are:
192
-
193
- - **PASSED** – The test case was successfully executed;
194
- - **FAILED** – The test case did not meet the expected result;
195
- - **SKIPPED** – The test case was not executed;
196
-
197
- **Steps to Set Test Case Results, Messages, and Attach Files**:
198
-
199
- 1. Click on a test case
200
- 2. Select the appropriate result: PASSED, FAILED, or SKIPPED
201
-
202
- ![Appropriate results](./images/att1_301.png)
203
-
204
- 3. Once the result is selected, you have the following options for the Test Result message field:
205
-
206
- - Type your own message manually;
207
- - Leave the field empty;
208
- - Select a custom status from the available options and also type your own message in the field (as shown in the example below);
209
-
210
- ![Test Result message](./images/att2_301.png)
211
-
212
- :::note
213
-
214
- If you need to configure different custom statuses, click here: <a href="https://docs.testomat.io/project/runs/custom-statuses/" target="_blank">Custom Statuses</a>
215
-
216
- :::
217
-
218
- 4. Once the **'Attaching a file'** field appears, allowing you to browse or drag-and-drop a file (e.g., screenshot, log file) to provide additional context for the result. This can help document evidence related to the test case, such as error logs or screenshots of the issue.
219
-
220
- ![Attaching a file field](./images/att3_301.png)
221
-
222
- 5. You can also configure the view of attached files with the following options:
223
-
224
- - Large Thumbnails;
225
- - Small Thumbnails;
226
- - Grid View;
227
- - List View;
228
-
229
- ![Configuration view](./images/att4_301.png)
230
-
231
- 6. Additionally, there are also two ways to view the specific file:
232
-
233
- - **Open and fit to width**;
234
-
235
- ![Open and fit to width](./images/att8_301.png)
236
-
237
- - Open and view a **Full screen** of the specific file;
238
-
239
- ![Full screen](./images/att7_301.png)
240
-
241
- 7. To delete an attached file, click on the **trash** icon
242
- 8. After warning message **'Are you sure?'** appears, click **OK** button to confirm deletion
243
-
244
- ![Delete attachments](./images/att5_301.png)
245
-
246
- 9. Once all test cases are completed, click the **Finish Run** button to end the process
247
-
248
- ![Finish Run button](./images/att6_301.png)
249
-
250
- ### How to Assign Users to the Run
251
-
252
- By default, only the user who created the Run is added to it. However, Testomat.io allows you to assign multiple users to one Run:
253
-
254
- 1. Click on **'Manual Run'** button.
255
-
256
- ![Testomat.io - Assign Users](./images/Assign_users_1.png)
257
-
258
- 2. Click on **'Assign users'** option.
259
-
260
- ![Testomat.io - Assign Users](./images/Assign_users_2.png)
261
-
262
- 3. Click on **'Assign to'** dropdown list and select users.
263
-
264
- ![Testomat.io - Assign Users](./images/Assign_users_3.png)
265
-
266
- After selecting users, you can choose an assignment strategy, add a description, select/create a test plan, select an environment, etc., and then launch the test run.
267
-
268
- **Test Assignment Strategies:**
269
-
270
- - **None:** Users won't be automatically assigned to tests within this run. All users in the run can pick any test to assign, or you, as a manager, can manually assign users when run is started.
271
-
272
- - **Prefer test assignee:** The system respects assignments made at the test and suite levels. Tests within this run will be automatically assigned to users responsible for them.
273
-
274
- - **Randomly distribute tests between team members:** Tests within this run will be equally split between assigned team members. Manager won't be assigned to any test.
275
-
276
- To select Test Assignment Strategies:
277
-
278
- 1. Assign at least one user to a Run.
279
- 2. Click on **'Auto-Assign Users'** button.
280
- 3. Select a strategy from the list.
281
-
282
- ![Testomat.io - Assignment Strategy](./images/Assign_strategy.png)
283
-
284
- ### How to Assign Users to Specific Test Cases or Suites
285
-
286
- During the Run you can assign different users to specific Test Cases, Suites or Folders within one Run.
287
-
288
- :::note
289
-
290
- First, you need to assign users to the Run, and only after this you can assign them to specific Test Cases, Suites and Folders.
291
-
292
- :::
293
-
294
- **To Assign a User to a Suite/Folder:**
295
-
296
- 1. Open Run with assigned users.
297
- 2. Click on **'Continue'** button.
298
-
299
- ![Testomat.io - Assign Suite](./images/Assign_suite.png)
300
-
301
- 3. Click on **'Assign to'** icon for specific Suite/Folder.
302
- 4. Select a user for assignment from the list.
303
-
304
- ![Testomat.io - Assign Suite](./images/Assign_suite_2.png)
305
-
306
- **To Assign a User to Test Cases:**
307
-
308
- You can assign specific Test Cases only via **Multi-Select** button.
309
-
310
- 1. Open Run with assigned users.
311
- 2. Click **‘Continue’** button.
312
-
313
- ![Testomat.io - Assign Suite](./images/Assign_suite.png)
314
-
315
- 3. Click **‘Multi-Select’** button.
316
- 4. Select the Test Cases you would like to assign.
317
- 5. Click the **'Assign to'** button at the bottom.
318
- 6. Select a user for assignment from the list.
319
-
320
- ![Testomat.io - Assign TC](./images/Assign_TC.png)
321
-
322
- 7. Click **'OK'** in the **'Are you sure you want to assign (username) to all selected tests?'** pop-up window.
323
-
324
- Your Test Cases and Suites are now successfully assigned to different users.
325
-
326
- ![Testomat.io - Assign TC](./images/Assign_TC_1.png)
327
-
328
- ### How to Select a Test Environment
329
-
330
- To select a testing environment you need:
331
-
332
- 1. Click on Environment field
333
- 2. Choose one or more environments from the dropdown list
334
- 3. Click **Save** to apply your selection
335
-
336
- ![Select Environment](./images/att3_355.png)
337
-
338
- Testomat.io supports multiple strategies for running tests across different environments such as browsers, operating systems, devices, and deployment stages. You can run tests in single or multiple environments — sequentially or in parallel — depending on your project needs and infrastructure.
339
-
340
- To learn more about configuring, managing, and running tests with environments, including multi-environment execution modes and CI/CD integration, please see the full guide here: [How to Run Environments](https://docs.testomat.io/project/runs/environments/).
341
-
342
- ### How to Run Tests in RunGroups
343
-
344
- RunGroups allow you to organize test runs into structured folders, making it easier to manage and analyze test execution. By grouping related runs, you can maintain better visibility over different testing phases, environments, or specific test suites.
345
-
346
- Before proceeding, make sure you have created a RunGroup. For detailed instructions on how to create and manage RunGroups, refer to this [guide](https://docs.testomat.io/project/runs/managing-runs/#rungroups) for more details.
347
-
348
- **Enabling RunGroups for New Runs** (Optional Setting)
349
-
350
- This setting is optional and can be enabled if you need it. Overall, you can freely create runs inside and out of groups.
351
-
352
- 1. Navigate to the **Settings** in the sidebar
353
- 2. Click on the **Project** tab
354
- 3. In the **Runs settings**, enable the option to require a RunGroup for new runs
355
-
356
- ![Enable Run Settings](images/att1_214.png)
357
-
358
- Once the RunGroup is enabled, you can start your runs within folders. Make sure the **RunGroup Structure** is also enabled.
359
-
360
- :::note
361
-
362
- This setting applies to all new run types — manual, automated, and mixed.
363
-
364
- :::
365
-
366
- **Launching Runs in a Folder**
367
-
368
- 1. Navigate to the **Runs** tab
369
- 2. Click the **Manual Run** button
370
-
371
- ![Manual Run button](images/att2_214.png)
372
-
373
- 3. Select the required **RunGroup** from the dropdown
374
- 4. Click the **Launch** button
375
-
376
- ![Launch button](images/att4_214.png)
377
-
378
- **Important:** If no RunGroup is selected, the field will be highlighted in red, and a warning message will appear, prompting you to choose a group before proceeding.
379
-
380
- ![Group field is required](images/att3_214.png)
381
-
382
- :::note
383
-
384
- If you relaunch an existing run as a copy and the original run belongs to a RunGroup, the copy is placed in the same group. No manual selection is needed.
385
-
386
- :::
387
-
388
- By following these steps, you can organize test runs within RunGroups, ensuring a structured and manageable testing workflow. See the result below:
389
-
390
- ![Runs into Folders](images/att5_214.png)
391
-
392
- ## How to Run Tests As Checklist
393
-
394
- Checklists are commonly used in manual testing to quickly execute a set of tests without distractions from additional details. In this mode, test descriptions are hidden by default, but you can still view them by clicking the Toggle Description button.
395
-
396
- In the **New Manual Run** sidebar,
397
-
398
- 1. Select a **Test Plan** or **All Manual Tests**
399
- 2. Enable **Run as checklist**
400
- 3. Click the **Launch** button
401
-
402
- ![Checklist toggle](./images/att4_355.png)
403
-
404
- Once the manual run is launched, test descriptions will be hidden. To view a description for any test:
405
-
406
- 4. Click the extra menu -> Toggle Description
407
-
408
- ![Toggle Description](./images/att5_355.png)
409
-
410
- ## How to Run Test With Steps Execution
411
-
412
- Test execution by steps is a feature that enhances manual testing by allowing testers to track and manage the results of individual test steps. This ensures better traceability, improved defect detection, and a structured approach to test execution. By marking each step separately, QA teams gain deeper insights into the testing process and can effectively address issues as they arise.
413
-
414
- 1. Click the **Runs** in the sidebar
415
- 2. Launch a new manual run
416
-
417
- ![Launch a new run](images/att1_306.png)
418
-
419
- 3. Select the test with detailed steps you want to execute
420
- 4. Mark steps according to the results:
421
-
422
- - Click a step once to mark it as **Passed**
423
- - Click a step twice to mark it as **Failed**
424
- - Click a step three times to mark it as **Skipped**
425
-
426
- 5. Add a result with a message (optionally) for the test
427
- 6. Click **Finish Run** to complete the test execution
428
-
429
- ![Finish run](images/gif1_306.gif)
430
-
431
- Test execution by steps introduces a structured, transparent, and efficient way to conduct manual testing. By breaking down test results into individual actions, QA teams can improve accuracy, streamline defect resolution, and optimize their testing workflow. This feature plays a crucial role in ensuring high-quality software delivery by providing detailed insights into each phase of test execution.
432
-
433
- Take a look at how the test result with step execution looks:
434
-
435
- ![Test execution](images/att2_306.png)
436
-
437
- ## How to Run Automated Tests Manually
438
-
439
- Automated tests can be run manually in two ways:
440
-
441
- - **Using a Test Plan** – create a test plan and enable the **Run Automated as Manual** toggle. This method allows you to include automated tests in a plan. Learn more about creating plans [here.](https://docs.testomat.io/project/plans/#add-automated-tests-as-manual)
442
-
443
- - **Directly from the Runs page** – enable the **Run Automated as Manual** toggle during the run setup and select tests from the test tree.
444
-
445
- ### How to Run Automated Tests Manually from the Runs Page
446
-
447
- 1. Go to the **Runs** page
448
- 2. Click the **Manual Run** button
449
- 3. Switch to the **Select tests** tab
450
- 4. Enable the **Run Automated as Manual** toggle
451
- 5. Use the search, filters, or expand suites to select the automated tests you want to run
452
- 6. Click **Launch** to start the run
453
-
454
- ![Running Automated Tests from the Runs Page](./images/gif2_7641.gif)
455
-
456
- ## How to Make Changes in a Launched Run
457
-
458
- During testing, you might encounter new scenarios that need to be added immediately. Testomat.io allows you to easily add tests to a run that’s already started. This way, you can cover unexpected cases without stopping your ongoing testing process.
459
-
460
- This ensures flexibility, smooth testing workflow, and that no important scenarios are missed.
461
-
462
- 1. Go to the **Runs** page
463
- 2. Open the unfinished run you want to edit
464
- 3. Click the **Edit** button (or open the '...' menu and select **Edit**)
465
-
466
- ![Edit button](./images/att3_7641.png)
467
-
468
- Once the **Edit manual run** view is opened, here’s what you can do:
469
-
470
- - **Assign to** - Remove existing users or assign more to the run
471
- - **Title** - Enter or change the run title
472
- - **Environment** - Add or remove testing environments
473
- - **Description** - Add or update the run description
474
- - **details** link - Check configuration details of the run
475
- - **Current tests** – Shows all tests currently included in the run. Remove unnecessary tests by clicking the **trash** icon
476
- - **+ Tests** – Similar to the [Select tests](https://docs.testomat.io/project/runs/running-tests-manually/#how-to-configure-a-manual-run) tab in a new manual run. You can browse the test tree, use search or filters, or expand suites to select manual tests to add to this run
477
- - **+ Plans** – Select tests from existing test plans. You can include one or multiple plans in the current run
478
-
479
- :::note
480
-
481
- You can add tests from plans and additional tests at the same time. For example: select one or more plans, then select specific suites or individual tests — everything will be added to the run instantly.
482
-
483
- :::
484
-
485
- ![Edit existing run](./images/gif1-7865.gif)
486
-
487
- ## How to Remove and Re-add a Test in a Run
488
-
489
- Removing a test does not delete it. You can remove a test from a running test run and bring it back later. Testomat.io marks the test as excluded and keeps it in the run configuration.
490
-
491
- ### How to Return a Test to the Run
492
-
493
- If you remove a test and then add the same test again, the run holds two statuses at once, excluded and included. The excluded status has higher priority, so the test stays out of the run's test list, even though Testomat.io confirms it was added.
494
-
495
- If you only removed the test:
496
-
497
- 1. Open the run and go to configuration **details**.
498
- 2. Find the removed test and cancel the deletion.
499
- 3. The test returns to the run.
500
-
501
- ![Test configuration details](./images/574-test-config.png)
502
-
503
- If you removed the test and then added it again, it now shows both a removed and an added status:
504
-
505
- 1. Open configuration **details** and find the test.
506
- 2. Click the `x` next to the removed status to clear the exclusion.
507
-
508
- The added status then takes effect, and the test appears in the run.
509
-
510
- ![Removing a deleted test from test configuration](./images/574-remove-from-test-config.png)
511
-
512
- ## How to Adjust Test Case Description Block
513
-
514
- In case you want to adjust the size of the test description block to see more details without scrolling or to minimize it, you can easily resize it by following these steps:
515
-
516
- 1. Locate the vertical bar at the bottom of the test description block.
517
- 2. Hover your cursor over the bar until it changes to a resize indicator (an up-and-down arrow).
518
- 3. Click and hold the left mouse button on the bar.
519
- 4. Drag the bar up to decrease the block size or down to increase it.
520
- 5. Release the mouse button once you've adjusted the size to your preference.
521
-
522
- ![Testomat.io - Test Case Description Block Adjustment](./images/Testcase_block_adjustment.png)
523
-
524
- This way, you can customize the view to match your workflow.
525
-
526
- ## Bulk Actions in Runs
527
-
528
- Managing test cases efficiently is crucial for smooth test execution. With bulk actions, you can perform multiple operations at once, reducing manual effort and saving time. Below are the available bulk actions you can use within test runs.
529
-
530
- ### How to Reassign Multiple Test Cases
531
-
532
- If you need to reassign test cases to a different user, you no longer have to update each test case separately. Instead, follow these easy steps:
533
-
534
- 1. Click **‘Runs’** button on the sidebar
535
- 2. Open the test run you’re working on
536
- 3. Click **‘Continue’** button
537
-
538
- ![reassign test cases](./images/att1_1054.png)
539
-
540
- 4. Click **‘Multi-Select’** button
541
- 5. Select the specific tests you would like to reassign
542
- 6. Click the **'Assign to'** button at the bottom
543
- 7. Select a user you would like to reassign
544
- 8. Click **'OK'** in the **'Are you sure you want to assign (username) to all selected tests?'** pop-up window
545
-
546
- This feature significantly reduces manual effort and speeds up the reassignment process during test run.
547
-
548
- Let’s check how tests look like after changes.
549
-
550
- ![reassign test cases](./images/att3_1054.png)
551
-
552
- ### How to Multi-Select Result Messages for Test Cases
553
-
554
- While running tests and selecting the appropriate status with a result message, you can multi-select result messages for test cases. Follow these steps to complete the process:
555
-
556
- 1. Click **‘Runs’** button on the sidebar
557
- 2. Open a test run you’re working on
558
- 3. Click **‘Continue’** button
559
-
560
- ![Run a test](./images/att1_878.png)
561
-
562
- 4. Click **‘Multi-Select’** button
563
- 5. Select the specific tests
564
- 6. Click the **‘Result message’** button at the bottom
565
-
566
- ![Result Message appears](./images/att2_878.png)
567
-
568
- 7. Select an appropriate status, e.g., **‘PASSED’**
569
- 8. Choose a result message, e.g., **‘Expected behaviour’**
570
- 9. Also, type a result message in the provided field
571
- 10. Click the **‘Apply’** button
572
-
573
- ![Apply changes](./images/att3_878.png)
574
-
575
- This feature allows testers to update multiple test cases efficiently, ensuring consistency in reporting results.
576
-
577
- By using bulk actions, you streamline test management, improve workflow efficiency, and maintain consistency across test runs.
578
-
579
- Let’s verify the multiple message results in these test cases:
580
-
581
- ![Bulk result message](./images/gif1_878.gif)
582
-
583
- ## How to Track Test Time
584
-
585
- You may find it useful to track the time spent on runs and specific test cases. For this purpose, Testomat.io has developed flexible time tracking.
586
-
587
- The first thing you need to do is start a run. Сlick on the button with the stopwatch icon **(1)** and then click on the **Track** button **(2)**. Every 10 seconds will be displayed in the time record. The time is also displayed next to the title of each test case.
588
-
589
- ![Testomat.io - Track Test Time](./images/New_0VGArmlZ_2024-11-26.png)
590
-
591
- You can stop the tracking time if you need to leave during the testing process. And continue in the same way when you are ready.
592
-
593
- ![Testomat.io - Pause Tracking](./images/New_Ul6KGUJk_2024-11-26.png)
594
-
595
- If necessary, you can set the time manually. Сlick on the button with the stopwatch icon **(1)**, enter the time **(2)** using arrows or enter it from the keyboard and then click on the **Set Time** button **(2)**.
596
-
597
- ![Testomat.io - Set Time](./images/New_LRNFE60W_2024-11-26.png)
598
-
599
- What's more, you can use the **Auto-Track** feature to automatically start the tracking process when you move on to the next test.
600
-
601
- ![Testomat.io - Auto-Track](./images/New_Iul3pWTV_2024-11-26.png)
602
-
603
- At the end of the run, the report will show you the time spent on a particular test case and the total time spent on all the test cases.
604
-
605
- ![Testomat.io - Run Tracked Time](./images/New_3gSGeoy2_2024-11-26.png)
606
-
607
- This can be useful for spreading the workload across all team members in future test runs.
608
-
609
- ## How to Track Test Case History During One Run
610
-
611
- During a test run, the state or status of a test case may change multiple times. In some situations it can be important to review the history of all state changes, comments, and statuses for a specific test case before finishing the test run.
612
-
613
- For this purpose, Testomat.io provides the test case history feature within the test run, displayed in chronological order beneath the selected test case.
614
-
615
- To check the test case history, follow these steps:
616
-
617
- 1. Open the test run
618
- 2. Click 'Continue' button
619
-
620
- ![Testomat.io - Test Case History](./images/test_run.png)
621
-
622
- 3. Click on the test case to see last 3 changes
623
- 4. Click the arrow to expand the whole history, if needed
624
-
625
- ![Testomat.io - Test Case History](./images/test_case_history_1.png)
626
-
627
- Now you can see the whole test case history
628
-
629
- ![Testomat.io - Test Case History](./images/test_case_history_2.png)
630
-
631
- ## Search in Manual Runs
632
- Search functionality is available in manual runs, allowing users to quickly find specific tests and suites within a run.
633
- This makes it easier to navigate large manual runs by filtering items based on names or keywords, without scrolling through the full list.