testeiya 0.2.1 → 0.3.10

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (402) hide show
  1. package/LICENSE +21 -0
  2. package/README.md +284 -171
  3. package/dist/prompt/context.js +79 -0
  4. package/dist/prompt/context.js.map +1 -0
  5. package/dist/prompt/index.js +60 -0
  6. package/dist/prompt/index.js.map +1 -0
  7. package/dist/prompt/print.js +30 -0
  8. package/dist/prompt/print.js.map +1 -0
  9. package/dist/prompt/project-info.js +2 -0
  10. package/dist/prompt/project-info.js.map +1 -0
  11. package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +38 -25
  12. package/dist/prompt/system-prompt.js.map +1 -0
  13. package/dist/prompt/testomatio.js +264 -0
  14. package/dist/prompt/testomatio.js.map +1 -0
  15. package/dist/prompt/tools.js +57 -0
  16. package/dist/prompt/tools.js.map +1 -0
  17. package/dist/prompt/vocab.js +8 -0
  18. package/dist/prompt/vocab.js.map +1 -0
  19. package/dist/src/args.js +172 -0
  20. package/dist/src/args.js.map +1 -0
  21. package/dist/src/cli.js +97 -0
  22. package/dist/src/cli.js.map +1 -0
  23. package/dist/src/doctor.js +186 -0
  24. package/dist/src/doctor.js.map +1 -0
  25. package/dist/src/env.js +93 -0
  26. package/dist/src/env.js.map +1 -0
  27. package/dist/src/mcp-extension.js +9 -0
  28. package/dist/src/mcp-extension.js.map +1 -0
  29. package/dist/src/mcp.js +139 -0
  30. package/dist/src/mcp.js.map +1 -0
  31. package/dist/src/model.js +71 -0
  32. package/dist/src/model.js.map +1 -0
  33. package/dist/src/models.js +38 -0
  34. package/dist/src/models.js.map +1 -0
  35. package/dist/src/output.js +185 -0
  36. package/dist/src/output.js.map +1 -0
  37. package/dist/src/result.js +41 -0
  38. package/dist/src/result.js.map +1 -0
  39. package/dist/src/run.js +291 -0
  40. package/dist/src/run.js.map +1 -0
  41. package/dist/src/session.js +92 -0
  42. package/dist/src/session.js.map +1 -0
  43. package/dist/src/sessions.js +61 -0
  44. package/dist/src/sessions.js.map +1 -0
  45. package/dist/vendor/mcp.js +14801 -0
  46. package/mcp-tools.json +2967 -0
  47. package/package.json +34 -43
  48. package/prompt/context.ts +101 -0
  49. package/prompt/index.ts +102 -0
  50. package/prompt/print.ts +32 -0
  51. package/prompt/project-info.ts +30 -0
  52. package/prompt/system-prompt.ts +187 -0
  53. package/{src/prompt → prompt}/testomatio.ts +120 -9
  54. package/prompt/tools.ts +57 -0
  55. package/prompt/vocab.ts +7 -0
  56. package/skills/codeceptjs/ci-fix-tests/SKILL.md +7 -8
  57. package/skills/codeceptjs/codeceptjs-auth/SKILL.md +47 -64
  58. package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +56 -47
  59. package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +144 -106
  60. package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +50 -57
  61. package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +88 -196
  62. package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +4 -5
  63. package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +25 -36
  64. package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +23 -36
  65. package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +23 -36
  66. package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +23 -35
  67. package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +50 -53
  68. package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +87 -191
  69. package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/SKILL.md +1 -1
  70. package/{skills.lock.json → skills/skills.lock.json} +43 -36
  71. package/skills/skills.yaml +34 -0
  72. package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +49 -61
  73. package/skills/testomatio/explorbot/explorbot-fundamentals/references/no-install.md +36 -0
  74. package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +20 -7
  75. package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +41 -289
  76. package/skills/testomatio/qa-process/qa-explain-behavior/SKILL.md +111 -0
  77. package/skills/testomatio/qa-process/qa-explain-behavior/references/answer-shapes.md +116 -0
  78. package/skills/testomatio/qa-process/qa-explain-behavior/references/examples.md +157 -0
  79. package/skills/testomatio/qa-process/qa-lead-strategy-advisor/SKILL.md +91 -0
  80. package/skills/testomatio/qa-process/qa-lead-strategy-advisor/references/output-format.md +71 -0
  81. package/skills/testomatio/qa-process/testing-workflow/SKILL.md +227 -0
  82. package/skills/testomatio/test-automation/qa-data-seeder/SKILL.md +83 -0
  83. package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +5 -3
  84. package/skills/testomatio/test-automation/setup-change-aware-pr-testing/SKILL.md +190 -0
  85. package/skills/testomatio/test-automation/setup-ci-automation/SKILL.md +76 -0
  86. package/skills/testomatio/test-management/qa-split-testing-levels-pyramid/SKILL.md +55 -0
  87. package/skills/testomatio/test-management/qa-sprint-report-by-testomatio/SKILL.md +220 -0
  88. package/skills/testomatio/test-management/qa-sprint-report-by-testomatio/references/qa-sprint-report.md +126 -0
  89. package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +1 -1
  90. package/skills/testomatio/test-management/qa-thinking/SKILL.md +25 -25
  91. package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +14 -1
  92. package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +8 -0
  93. package/assets/testeiya-logo-dark.svg +0 -16
  94. package/assets/testeiya-logo.svg +0 -15
  95. package/models.catalog.json +0 -6963
  96. package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
  97. package/skills/playwright-best-practices-skill/README.md +0 -147
  98. package/skills/testeiya/README.md +0 -29
  99. package/skills/testeiya/answer-formatting/SKILL.md +0 -30
  100. package/skills/testeiya/check-cucumber/SKILL.md +0 -200
  101. package/skills/testeiya/check-tests/SKILL.md +0 -260
  102. package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
  103. package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
  104. package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
  105. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
  106. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
  107. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
  108. package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
  109. package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
  110. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
  111. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
  112. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
  113. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
  114. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
  115. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
  116. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
  117. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
  118. package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
  119. package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
  120. package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
  121. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
  122. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
  123. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
  124. package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
  125. package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
  126. package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
  127. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
  128. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
  129. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
  130. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
  131. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
  132. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
  133. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
  134. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
  135. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
  136. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
  137. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
  138. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
  139. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
  140. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
  141. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
  142. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
  143. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
  144. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
  145. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
  146. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
  147. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
  148. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
  149. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
  150. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
  151. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
  152. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
  153. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
  154. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
  155. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
  156. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
  157. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
  158. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
  159. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
  160. package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
  161. package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
  162. package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
  163. package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
  164. package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
  165. package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
  166. package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
  167. package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
  168. package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
  169. package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
  170. package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
  171. package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
  172. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
  173. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
  174. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
  175. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
  176. package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
  177. package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
  178. package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
  179. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
  180. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
  181. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
  182. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
  183. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
  184. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
  185. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
  186. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
  187. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
  188. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
  189. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
  190. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
  191. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
  192. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
  193. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
  194. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
  195. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
  196. package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
  197. package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
  198. package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
  199. package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
  200. package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
  201. package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
  202. package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
  203. package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
  204. package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
  205. package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
  206. package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
  207. package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
  208. package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
  209. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
  210. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
  211. package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
  212. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
  213. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
  214. package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
  215. package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
  216. package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
  217. package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
  218. package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
  219. package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
  220. package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
  221. package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
  222. package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
  223. package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
  224. package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
  225. package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
  226. package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
  227. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
  228. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
  229. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
  230. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
  231. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
  232. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
  233. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
  234. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
  235. package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
  236. package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
  237. package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
  238. package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
  239. package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
  240. package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
  241. package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
  242. package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
  243. package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
  244. package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
  245. package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
  246. package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
  247. package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
  248. package/skills.yaml +0 -21
  249. package/src/ai-debug.ts +0 -188
  250. package/src/api/agent-get.ts +0 -22
  251. package/src/api/agent-start.ts +0 -384
  252. package/src/api/client-log.ts +0 -29
  253. package/src/api/context.ts +0 -332
  254. package/src/api/debug-layout.ts +0 -47
  255. package/src/api/debug-report.ts +0 -29
  256. package/src/api/debug-snapshot.ts +0 -30
  257. package/src/api/debug-stream.ts +0 -52
  258. package/src/api/files-delete.ts +0 -184
  259. package/src/api/files-read.ts +0 -41
  260. package/src/api/files-rename.ts +0 -99
  261. package/src/api/files-tree.ts +0 -292
  262. package/src/api/files-write.ts +0 -41
  263. package/src/api/mcp.ts +0 -603
  264. package/src/api/memory.ts +0 -69
  265. package/src/api/open-external.ts +0 -39
  266. package/src/api/playwright-cli.ts +0 -606
  267. package/src/api/providers.ts +0 -457
  268. package/src/api/read-env-token.ts +0 -33
  269. package/src/api/sessions.ts +0 -79
  270. package/src/api/settings.ts +0 -120
  271. package/src/api/skills.ts +0 -58
  272. package/src/api/testomatio-attachment.ts +0 -89
  273. package/src/api/testomatio-auth.ts +0 -284
  274. package/src/api/testomatio-proxy.ts +0 -197
  275. package/src/api/testomatio-run-stats.ts +0 -81
  276. package/src/api/testomatio-target.ts +0 -225
  277. package/src/api/testomatio-transcription.ts +0 -82
  278. package/src/api/workspace-search.ts +0 -96
  279. package/src/api/workspace-sync.ts +0 -151
  280. package/src/api/workspace.ts +0 -165
  281. package/src/app-server.ts +0 -556
  282. package/src/bridge.ts +0 -251
  283. package/src/check-tests.ts +0 -156
  284. package/src/cli.ts +0 -17
  285. package/src/commands.ts +0 -244
  286. package/src/config.ts +0 -183
  287. package/src/connection.ts +0 -658
  288. package/src/context-store.ts +0 -265
  289. package/src/debug-bus.ts +0 -405
  290. package/src/extensions/tool-gate.ts +0 -220
  291. package/src/extensions/webui/ask-channel.ts +0 -52
  292. package/src/extensions/webui/index.ts +0 -184
  293. package/src/extensions/webui/tools/ask-question.ts +0 -88
  294. package/src/extensions/webui/tools/query-result.ts +0 -79
  295. package/src/extensions/webui/tools/render-chart.ts +0 -53
  296. package/src/extensions/webui/tools/render-item.ts +0 -61
  297. package/src/extensions/webui/tools/render-list.ts +0 -170
  298. package/src/extensions/webui/tools/render-result.ts +0 -85
  299. package/src/extensions/webui/tools/render-tree.ts +0 -71
  300. package/src/extensions/webui/tools/ui-widget.ts +0 -54
  301. package/src/extensions/webui/tools/widget-result.ts +0 -13
  302. package/src/extensions/webui/widget-channel.ts +0 -50
  303. package/src/file-log.ts +0 -196
  304. package/src/git-tracked.ts +0 -68
  305. package/src/gitignore.ts +0 -53
  306. package/src/json-store.ts +0 -43
  307. package/src/load-env.ts +0 -70
  308. package/src/loader-style.ts +0 -96
  309. package/src/main.ts +0 -140
  310. package/src/mcp-catalog.ts +0 -96
  311. package/src/models-catalog.ts +0 -72
  312. package/src/permissions.ts +0 -120
  313. package/src/project-dir.ts +0 -189
  314. package/src/project-info.ts +0 -108
  315. package/src/prompt/app-ui.ts +0 -59
  316. package/src/prompt/browser.ts +0 -27
  317. package/src/prompt/index.ts +0 -62
  318. package/src/prompt/tools.ts +0 -27
  319. package/src/server-info.ts +0 -62
  320. package/src/session-factory.ts +0 -442
  321. package/src/session-store.ts +0 -115
  322. package/src/shell-env.ts +0 -45
  323. package/src/skills.ts +0 -163
  324. package/src/sync-snapshot.ts +0 -140
  325. package/src/telemetry.ts +0 -239
  326. package/src/testomatio-auth.ts +0 -299
  327. package/src/testomatio.ts +0 -98
  328. package/src/theme.ts +0 -30
  329. package/src/user-env.ts +0 -94
  330. package/src/welcome.ts +0 -194
  331. package/src/workspace/safe-path.ts +0 -85
  332. package/src/workspace/test-md.ts +0 -70
  333. package/src/workspace-model.ts +0 -440
  334. package/testeiya.config.json +0 -14
  335. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/authentication-flows.md +0 -0
  336. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/authentication.md +0 -0
  337. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/clock-mocking.md +0 -0
  338. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/mobile-testing.md +0 -0
  339. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/multi-context.md +0 -0
  340. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/multi-user.md +0 -0
  341. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/network-advanced.md +0 -0
  342. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/third-party.md +0 -0
  343. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/pom-vs-fixtures.md +0 -0
  344. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/test-architecture.md +0 -0
  345. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/when-to-mock.md +0 -0
  346. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/browser-apis.md +0 -0
  347. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/iframes.md +0 -0
  348. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/service-workers.md +0 -0
  349. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/websockets.md +0 -0
  350. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/annotations.md +0 -0
  351. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/assertions-waiting.md +0 -0
  352. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/configuration.md +0 -0
  353. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/fixtures-hooks.md +0 -0
  354. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/global-setup.md +0 -0
  355. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/locators.md +0 -0
  356. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/page-object-model.md +0 -0
  357. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/projects-dependencies.md +0 -0
  358. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-data.md +0 -0
  359. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-suite-structure.md +0 -0
  360. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-tags.md +0 -0
  361. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/console-errors.md +0 -0
  362. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/debugging.md +0 -0
  363. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/error-testing.md +0 -0
  364. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/flaky-tests.md +0 -0
  365. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/angular.md +0 -0
  366. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/nextjs.md +0 -0
  367. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/react.md +0 -0
  368. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/vue.md +0 -0
  369. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/ci-cd.md +0 -0
  370. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/docker.md +0 -0
  371. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/github-actions.md +0 -0
  372. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/gitlab.md +0 -0
  373. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/other-providers.md +0 -0
  374. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/parallel-sharding.md +0 -0
  375. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/performance.md +0 -0
  376. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/reporting.md +0 -0
  377. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/test-coverage.md +0 -0
  378. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/accessibility.md +0 -0
  379. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/api-testing.md +0 -0
  380. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/browser-extensions.md +0 -0
  381. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/canvas-webgl.md +0 -0
  382. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/component-testing.md +0 -0
  383. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/drag-drop.md +0 -0
  384. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/electron.md +0 -0
  385. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/file-operations.md +0 -0
  386. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/file-upload-download.md +0 -0
  387. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/forms-validation.md +0 -0
  388. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/graphql-testing.md +0 -0
  389. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/i18n.md +0 -0
  390. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/performance-testing.md +0 -0
  391. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/security-testing.md +0 -0
  392. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/visual-regression.md +0 -0
  393. /package/skills/{playwright-cli → playwright/playwright-cli}/SKILL.md +0 -0
  394. /package/skills/{playwright-cli → playwright/playwright-cli}/references/element-attributes.md +0 -0
  395. /package/skills/{playwright-cli → playwright/playwright-cli}/references/playwright-tests.md +0 -0
  396. /package/skills/{playwright-cli → playwright/playwright-cli}/references/request-mocking.md +0 -0
  397. /package/skills/{playwright-cli → playwright/playwright-cli}/references/running-code.md +0 -0
  398. /package/skills/{playwright-cli → playwright/playwright-cli}/references/session-management.md +0 -0
  399. /package/skills/{playwright-cli → playwright/playwright-cli}/references/storage-state.md +0 -0
  400. /package/skills/{playwright-cli → playwright/playwright-cli}/references/test-generation.md +0 -0
  401. /package/skills/{playwright-cli → playwright/playwright-cli}/references/tracing.md +0 -0
  402. /package/skills/{playwright-cli → playwright/playwright-cli}/references/video-recording.md +0 -0
@@ -1,98 +0,0 @@
1
- ---
2
- title: Jira Plugin
3
- description: Learn how to integrate Testomat.io with Jira using the Jira plugin. This guide covers connecting projects, linking/unlinking tests, suites, and plans to Jira issues, running manual or automated tests, managing BDD feature files, attaching test reports, using AI prompts to improve test descriptions, and leveraging the traceability matrix for comprehensive coverage in sprints.
4
- type: article
5
- url: https://docs.testomat.io/advanced/jira-plugin
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Jira plugin, Testomat.io, test management, test coverage, BDD, feature files, automated tests, manual tests, Jira integration, traceability matrix, test reporting, AI test descriptions, SSO login
11
- ---
12
-
13
- import DirectoryLinks from "/src/components/DirectoryLinks.astro";
14
-
15
- <DirectoryLinks directory="advanced/jira-plugin" />
16
-
17
- The Testomat.io Jira Plugin enhances your Jira experience by enabling you to manage tests directly inside Jira. With this plugin you can:
18
-
19
- - Connect multiple Testomat.io and JIRA projects easily
20
- - Quickly link/unlink tests, suites, and plans to JIRA issues
21
- - View and edit tests directly in JIRA
22
- - Use autocomplete and smart suggestions for creating tests
23
- - Easily modify BDD/Gherkin feature files and scenarios
24
- - Create multiple tests at once from checklists from bulk create
25
- - Run manual and automated tests from JIRA tickets
26
- - Attach test reports to JIRA issues with a click
27
- - Use tracebility matrix and reports to check test coverage in sprints and project
28
- - Manage project branches
29
- - Use AI prompts to generate or improve test descriptions directly in Jira
30
-
31
- :::note
32
-
33
- Jira Plugin requires an active Jira integration in your Testomat.io project. If Jira is not connected yet, please follow [How to Connect Jira Project](https://docs.testomat.io/integrations/issues-management/jira/#connecting-to-jira-project).
34
-
35
- ![No linked connection with Jira](./images/att6_401.png)
36
-
37
- :::
38
-
39
- ## How to Use Jira Plugin Without Logging in
40
-
41
- When you open a Jira issue with linked Testomat.io items **without logging in**, the visibility depends on the type of **Jira connection** used. For full details on connection types and their permissions, see [Jira connection type](https://docs.testomat.io/integrations/issues-management/jira/#jira-connection-types).
42
-
43
- ![Jira connection type](./images/att75_401.png)
44
-
45
- **Connected with an administrator's account**
46
-
47
- You can still:
48
-
49
- - View **tests and suites** linked to the issue
50
-
51
- ![list of tests and suites](./images/gif1_401.gif)
52
-
53
- - Browse the **Tests Coverage** screen
54
-
55
- ![Test Coverage](./images/att7_401.png)
56
-
57
- **Connected with a regular account**
58
-
59
- - only authorized Testomat.io users will be able to see tests and run results in Jira
60
-
61
- ## How to Log in to Testomat.io from Jira
62
-
63
- -To access all Jira Plugin features, you need to log in to Testomat.io. You can log in directly from:
64
-
65
- - a Jira issue
66
-
67
- ![Log In from Jira Plugin](./images/att9_401.png)
68
-
69
- - or you can do this from Apps
70
-
71
- ![Log In from app](./images/att8_401.png)
72
-
73
- ### Login Options
74
-
75
- You can authorize using any of the following methods:
76
-
77
- - **Email + Password** — enter your Testomat.io credentials and click **Submit**
78
- - **Authorize with GitHub** — sign in with your GitHub account
79
- - **Authorize with Google** — sign in with your Google account
80
- - **Authorize with SSO** — use your company’s Single Sign-On provider
81
-
82
- ### What you can do after logging in
83
-
84
- Once logged in, you can:
85
-
86
- - view linked tests and suites
87
- - edit them directly in Jira
88
- - unlink items when needed
89
- - use AI prompts to enhance test descriptions:
90
- - Suggest Description – generate a clear and concise description for a test based on its title and similar tests
91
- - Improve Description – refine the existing description to make it clearer
92
- - Suggest Better Description – provide an alternative improved description
93
-
94
- ![Avaliable options](./images/att10_401.png)
95
-
96
- ## JIRA Plugin Permissions and Security
97
-
98
- Testomat.io’s JIRA plugin is designed to integrate seamlessly with your JIRA projects, requiring specific permissions to operate effectively. The plugin has **read access** to all issues of an enabled project to display tests that can be attached to any JIRA issue and can **write properties** to save test data into JIRA storage attached to a specific issue. Importantly, Testomat.io **does not perform any update or delete operations** on your JIRA issues, maintaining the integrity of your project data. The plugin accesses several JIRA API endpoints strictly necessary for its functionality, adhering to high standards of data security and integrity. For detailed information on permissions and security, refer to the [JIRA Permissions](https://docs.testomat.io/legal/security/jira) section in our documentation.
@@ -1,151 +0,0 @@
1
- ---
2
- title: Creating Jira Issue
3
- description: Learn how to integrate Testomat.io with Jira using the Jira plugin. This guide covers connecting Testomat.io projects to Jira, linking/unlinking tests, suites, and test plans to Jira issues, and running manual or automated tests directly from Jira. Manage BDD feature files, attach test reports, and utilize the traceability matrix for comprehensive test coverage in sprints.
4
- type: article
5
- url: https://docs.testomat.io/advanced/jira-plugin/jira-issue
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: og:image
10
- content: https://docs.testomat.io/_astro/New_8rxMYOhd_2024-10-19.BaU2EWny_Z1oTGPz.webp
11
- - tag: meta
12
- attrs:
13
- name: keywords
14
- content: Jira plugin, Testomat.io, test management, test coverage, BDD, feature files, automated tests, manual tests, Jira integration, traceability matrix, test reporting
15
- ---
16
-
17
- **Jira integration in Testomat.io** helps QA teams quickly turn test results into actionable bug reports. This feature eliminates the manual effort of copying failed test data into Jira and ensures full traceability between test execution and defect tracking.
18
-
19
- With a few clicks, you can:
20
-
21
- - **Create a Jira issue** directly from a failed test or run
22
- - **Link existing Jira issues** to tests or suites
23
- - **Attach contextual details** (test steps, results, environment, and run links) automatically
24
-
25
- This integration was designed to improve collaboration between **QA, development, and management teams**, speeding up feedback loops and ensuring visibility across all project stakeholders.
26
-
27
- ## How to Create a Jira Issue for a Failed Test
28
-
29
- To create a JIRA issue for a Failed Test, open a Run with a failed test. Find a test in list, move the cursor over it and click on the **Link to Issue** icon:
30
-
31
- ![Testomatio.io - Creating JIRA Issue for Failed Test](./images/New_7T8nObH5_2024-10-19.png)
32
-
33
- You can link it to an existing issue **(1)** or create a new one **(2)**.
34
-
35
- Once you have decided to create an issue in your Jira project, you can select its ticket types **(3)**.
36
-
37
- ![Testomatio.io - Link Failed Test to existing issue or create a new one](./images/New_Y2SJbV9K_2024-10-19.png)
38
-
39
- You can even create an issue as a subtask by **specifying a Parent ticket**:
40
-
41
- ![Testomatio.io - Creating JIRA Issue as Subtask](./images/New_8rxMYOhd_2024-10-19.png)
42
-
43
- - Once created, the linked issue appears under the test run, indicated by the **issue icon**
44
- - Hovering over the icon shows the **issue title** and **current status**
45
- - Clicking the icon redirects to the issue in Jira
46
- - This icon remains visible both during test execution
47
-
48
- ![Jira Issue in Ongoing run](./images/att4_462.png)
49
-
50
- - and after the run is completed, making it easy to track related issues at a glance
51
-
52
- ![Completed Run](./images/att5_462.png)
53
-
54
- The generated ticket will contain the specified information, as well as information about the test run and a web link to the test run report:
55
-
56
- ![Testomatio.io - Created ticket in Jira](./images/New_8ENxIFXB_2024-10-19.png)
57
-
58
- ## How to Create a Jira Issue for a Failed Run
59
-
60
- To create a JIRA issue for a Failed Manual or Automated Run, open the run and select the **Link to Issue** option from the dots menu:
61
-
62
- ![Testomatio.io - Creating JIRA Issue for Failed Run](./images/New_cLq5eNs9_2024-10-19.png)
63
-
64
- Create a new issue for a run or append to an existing issue.
65
-
66
- ![Testomatio.io - Link Failed Run to existing issue or create a new one](./images/New_tYJ8Bm2P_2024-10-19.png)
67
-
68
- - Once created, the linked issue appears **under the completed run**, indicated by the **issue icon** in the run’s sidebar
69
- - Hovering over the icon displays the **issue title** and **current status**
70
- - Clicking the icon redirects directly to the issue in the Jira project
71
-
72
- ![Linked Jira to Run](./images/att6_462.png)
73
-
74
- ## How to Link a Test to a Jira Issue
75
-
76
- You can easily connect any individual **test** in Testomat.io to an existing or new Jira issue. This allows quick traceability between your test cases and related Jira tickets.
77
-
78
- 1. Navigate to the **Tests** page in your Testomat.io project
79
- 2. Open the test you want to link
80
- 3. Click the **extra menu (⋯)** button in the top-right corner
81
- 4. Select **Link to Issue**
82
-
83
- ![Link to Issue](./images/att41_401.png)
84
-
85
- Once the **Link to Issue** modal window appears:
86
-
87
- 5. To **link to an existing Jira issue**, paste or enter the issue key and click **Link Issue**
88
- 6. To **create a new Jira issue**, click **Create new issue**
89
-
90
- ![create or link a Jira issue](./images/att42_401.png)
91
-
92
- 7. Select your **Jira profile** (see details: [Connecting Jira Integration](https://docs.testomat.io/integrations/issues-management/jira/)).
93
- 8. Choose the **Issue Type** from the dropdown (e.g., Bug, Task, Sub-task)
94
- 9. Add a **Title**
95
- 10. Optionally, include a **Description** to provide test context
96
- 11. Fill in any **Jira fields** available in your configuration.
97
-
98
- Testomat.io automatically displays all supported fields — such as **Parent**, **Components**, **Fix versions**, **Priority**, **Labels**, or other custom fields defined in your Jira project.
99
-
100
- These may appear immediately or after clicking **Show Optional Fields**, depending on your project setup.
101
-
102
- :::note
103
-
104
- The available fields depend on your Jira project configuration. To see all supported field types in Testomat.io, refer to [Supported Jira Field Types](https://docs.testomat.io/integrations/issues-management/jira/#supported-jira-field-types).
105
-
106
- :::
107
-
108
- 12. Once all required information is filled in, click **Create Jira Issue** to finish linking.
109
-
110
- ![Save new Jira Issue](./images/att43_401.png)
111
-
112
- The linked issue appears under the test, indicated by the **issue icon**, which redirects to the issue in the Jira project. In addition, Testomat.io also displays the linked Jira issue’s **title** and **status**, making it easier to recognize the issue at a glance.
113
-
114
- ![Linked Jira issue showing title and status](./images/att1_462.png)
115
-
116
- :::note
117
-
118
- You can link a test to multiple issues. In this case their IDs will be displayed in test view in Testomatio.
119
-
120
- :::
121
-
122
- ![Multiple Jira issues](./images/att2_462.png)
123
-
124
- ## How to Link a Suite to a Jira Issue
125
-
126
- Linking a suite to a Jira issue works similarly to linking an individual test, with one key difference: **all tests within the suite will automatically be linked to the Jira issue.**
127
-
128
- :::note
129
-
130
- Linking is available only at the **suite level**. You cannot link a Jira issue to a folder, and the **Link to Issue** button does not appear on folder level.
131
-
132
- :::
133
-
134
- 1. Navigate to the **Tests** page in your Testomat.io project
135
- 2. Open the suite you want to link
136
- 3. Click the **extra menu (⋯)** button in the top-right corner
137
- 4. Select **Link to Issue**
138
-
139
- ![Link Jira Issue to Suite](./images/att45_401.png)
140
-
141
- Follow the same steps above as linking a single test: link an existing issue or create a new one, select issue type, fill required fields, and click Create Jira Issue.
142
-
143
- When a suite is linked, both the suite and all its tests will display the linked Jira issue icon along with its title and status, providing immediate context.
144
-
145
- ![Suite Jira Issue](./images/att8_462.png)
146
-
147
- :::note
148
-
149
- If you unlink a suite from a Jira issue, all its linked tests will be unlinked automatically.
150
-
151
- :::
@@ -1,377 +0,0 @@
1
- ---
2
- title: Runs & Reports in Jira
3
- description: Learn how to run manual, automated, or mixed test executions in Jira using the Testomat.io plugin. This guide covers configuring advanced settings, executing test runs.
4
- type: article
5
- url: https://docs.testomat.io/advanced/jira-plugin/runs-and-reports
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Jira plugin, Testomat.io, test runs, test plan, test execution, manual run, mixed run, automated run, CI/CD, test reports, test analytics
11
- ---
12
-
13
- With the **Testomat.io plugin in Jira**, your team can efficiently execute and manage test runs directly from Jira. Launch manual, automated, or mixed tests, configure environments and assignees, group related runs, and get a clear overview of all test executions with their current statuses. This integration keeps QA, development, and management aligned, providing full visibility into testing workflows without leaving Jira.
14
-
15
- This page explains how to:
16
-
17
- - Launch **Manual**, **Mixed**, or **Automated in CI/CD** runs from Jira issues or linked test plans
18
- - Configure **Advanced Settings** such as environment, assignee (email), RunGroup, CI profiles, and custom parameters
19
- - Track execution progress and view the current status of each run directly in Jira
20
- - Receive **Report Notifications** in Jira for failed test runs, with automatically created issues containing detailed run results and optional public report links
21
-
22
- ## Run Flow
23
-
24
- Testomat.io supports three types of test executions **directly in Jira**:
25
-
26
- - **Manual Run** - execute tests manually
27
- - **Automated Run (CI/CD)** - execute automated tests via connected CI service
28
- - **Mixed Run** - run a combination of manual and automated tests in a single execution
29
-
30
- Choose the type of run that fits your workflow and follow the detailed steps below to execute tests directly in Jira.
31
-
32
- ### How to Launch a Manual Run
33
-
34
- Use Manual Run in Jira to execute tests step-by-step directly from the Jira issue. Ideal for fully manual test cases, exploratory testing, or verifying features not yet automated. You can launch a Manual Run in Jira in three different ways:
35
-
36
- **Option 1** – From the '...' Menu on the **Tests** Tab
37
-
38
- 1. Navigate to the **Tests** tab
39
- 2. Click the '...' (extra menu) button on the **Tests** tab
40
- 3. Select **Schedule Run** from the dropdown list
41
-
42
- ![Schedule Run](./images/att48_401.png)
43
-
44
- 4. In the **'Select tests to run'** dialog, choose the tests you want to include
45
- 5. (Optional) Enable **Run as Checklist** toggle - if enabled, marks tests to be executed as checklist
46
- 6. (Optional) Enable **Run Automated as Manual** toggle - if enabled, allows automated tests to be executed manually
47
-
48
- ![Select tests to run](./images/att49_401.png)
49
-
50
- 7. (Optional) Open the **Advanced settings** to select:
51
-
52
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
53
- - **Assign user** – select the **email of the user added to the project** who is responsible for this run
54
- - **RunGroup** – optional grouping of related runs for easier tracking and reporting
55
- - **Title** - provide a descriptive title for the run
56
-
57
- 8. Click **'Create Run'** to start execution
58
-
59
- ![Create Run button](./images/att50_401.png)
60
-
61
- 9. Mark all tests with specific status (e.g., ✔ passed / ✖ failed / ➖ skipped)
62
- 10. Click the **Finish Run** button
63
-
64
- ![Finish Run](./images/att57_401.png)
65
-
66
- **Option 2** – Using the 'Run' Button on the **Tests** Tab
67
-
68
- 1. Navigate to the **Tests** tab
69
- 2. Click the '✔ Run' button
70
- 3. In the **'Select tests to run'** dialog, choose the tests you want to include
71
- 4. (Optional) Enable **Run as Checklist** toggle - if enabled, marks tests to be executed as checklist
72
- 5. (Optional) Enable **Run Automated as Manual** toggle - if enabled, allows automated tests to be executed manually
73
-
74
- ![Select tests to run](./images/att51_401.png)
75
-
76
- 6. (Optional) Use **Advanced settings** to select:
77
-
78
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
79
- - **Assign user** – select the **email of the user added to the project** who is responsible for this run
80
- - **RunGroup** – optional grouping of related runs for easier tracking and reporting
81
- - **Title** - provide a descriptive title for the run
82
-
83
- 7. Click **'Create Run'** to start execution
84
-
85
- ![Create Run](./images/att52_401.png)
86
-
87
- 8. Mark all tests with specific status (e.g., ✔ passed / ✖ failed / ➖ skipped)
88
- 9. Click the **Finish Run** button
89
-
90
- ![Finish Run](./images/att56_401.png)
91
-
92
- **Option 3** – From the **'Plans'** Tab
93
-
94
- 1. Navigate to the **Plans** tab in the Jira issue
95
- 2. Click the **▶︎ icon** (Launch a plan) next to the linked Plan to quickly start a run
96
- 3. or click the **⚙︎ icon** (Launch with advanced options) to configure **Advanced Settings**
97
-
98
- ![Launch a plan](./images/att53_401.png)
99
-
100
- Once the **Manual Run Settings** window opens (this appears only if you clicked the **⚙︎ icon**):
101
-
102
- 4. (Optional) Enable **Run as Checklist** toggle - if enabled, marks tests to be executed as checklist
103
- 5. (Optional) Enable **Run Automated as Manual** toggle - if enabled, allows automated tests to be executed manually
104
-
105
- :::note
106
-
107
- **Run Automated as Manual** option is disabled if the selected Plan contains only manual tests.
108
-
109
- :::
110
-
111
- 6. Configure **Advanced Settings**
112
-
113
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
114
- - **Assign user** – select the **email of the user added to the project** who is responsible for this run
115
- - **RunGroup** – optional grouping of related runs for easier tracking and reporting
116
- - **Title** - provide a descriptive title for the run
117
-
118
- 7. Click **'Create Run'** to start execution
119
-
120
- ![Launch a manual run bia Plan](./images/att61_401.png)
121
-
122
- 8. Mark all tests with specific status (e.g., ✔ passed / ✖ failed / ➖ skipped)
123
- 9. Click the **Finish Run** button
124
-
125
- ![Finish Run](./images/att56_401.png)
126
-
127
- ### How to Launch an Automated Run (CI/CD)
128
-
129
- Use Automated Run in Jira to trigger tests automatically via a connected CI/CD service without leaving your Jira issue. Ideal for running regression suites, nightly builds, or executing fully automated test cases directly from the Jira interface.
130
-
131
- **Option 1** – From the '...' menu on the **Tests** Tab
132
-
133
- 1. Click the '...' (extra menu) button on the **Tests** tab
134
- 2. Select **Run in CI** from the dropdown list
135
-
136
- ![Run in CI](./images/att58_401.png)
137
-
138
- :::note
139
-
140
- If your CI service is not connected, you will see the message: 'Continuous Integration service is not enabled. Connect a CI service to run automated tests from the Testomat.io Jira Plugin.' To enable CI runs, connect your preferred [CI/CD service](https://docs.testomat.io/integrations/continuous-integration/) in your Testomat.io project settings.
141
-
142
- :::
143
-
144
- 3. Add specific tests to run by selecting one by one or **Select all** option
145
-
146
- ![Select tests to run](./images/att59_401.png)
147
-
148
- 4. (Optional) Open the **Advanced settings** to select:
149
-
150
- - **Title** - provide a title for the run
151
- - **CI profile** – select the CI configuration profile for automated test execution
152
- - **Enter config** – specify custom environment variables (e.g. `ref=main`)
153
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
154
- - **Assign user** - select the **email of the user added to the project** who is responsible for this run
155
- - **RunGroup** - optional grouping of related runs for easier tracking and reporting
156
-
157
- 5. Click **'Create Run'** to start execution
158
-
159
- ![Create Automated Run](./images/att60_401.png)
160
-
161
- **Option 2** – From the **'Plans'** Tab
162
-
163
- 1. Navigate to the **Plans** tab in the Jira issue
164
- 2. Click the **▶︎ icon** (Launch a plan) next to the linked Plan **(recommended)** in CI
165
- 3. or click the **⚙︎ icon** (Launch with advanced options)
166
-
167
- ![Launch a plan](./images/att53_401.png)
168
-
169
- 4. Once the **Run settings** window opens (this appears only if you clicked the **▶︎ icon**), select:
170
-
171
- - **Title** - provide a title for the run
172
- - **CI profile** – select the CI configuration profile for automated test execution
173
- - **Enter config** – specify custom environment variables (e.g. `ref=main`)
174
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
175
- - **Assign user** – select the **email of the user added to the project** who is responsible for this run
176
- - **RunGroup** - optional grouping of related runs for easier tracking and reporting
177
-
178
- 5. Click **'Create Run'** to start execution
179
-
180
- ![Launch Automated Run](./images/att62_401.png)
181
-
182
- 6. Once the automated run is created, it appears in the **Runs** tab with the **Pending** status
183
-
184
- - The test results will update automatically when your CI job completes — showing the final status
185
- - No manual action is required in Jira
186
-
187
- ![CI Run created](./images/att63_401.png)
188
-
189
- ### How to Launch a Mixed Run
190
-
191
- Use Mixed Run in Jira to execute both manual and automated tests in a single run directly from the Jira issue. Ideal when part of the test suite is automated, but some tests still require manual verification. You can launch a Mixed Run in Jira in two different ways:
192
-
193
- **Option 1** – From the '...' Menu on the **Tests** Tab
194
-
195
- 1. Click the '...' (extra menu) button on the **Tests** tab
196
- 2. Select **Mixed Run** from the dropdown list
197
-
198
- ![Mixed Run option](./images/att64_401.png)
199
-
200
- :::note
201
-
202
- If your CI service is not connected, you will see the message: 'Continuous Integration service is not enabled. Connect a CI service to run automated tests from the Testomat.io Jira Plugin.' To enable CI runs, connect your preferred [CI/CD service](https://docs.testomat.io/integrations/continuous-integration/) in your Testomat.io project settings.
203
-
204
- :::
205
-
206
- 3. In the **'Select tests to run'** dialog, choose the tests you want to include
207
-
208
- ![Select mix tests to run](./images/att65_401.png)
209
-
210
- 4. Configure **Advanced Settings**:
211
-
212
- - **Title** - provide a title for the run
213
- - **CI profile** – select the CI configuration profile for automated test execution
214
- - **Enter config** – specify custom environment variables (e.g. `ref=main`)
215
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
216
- - **Assign user** - select the **email of the user added to the project** who is responsible for this run
217
- - **RunGroup** - optional grouping of related runs for easier tracking and reporting
218
-
219
- 5. Click **'Create Run'** to start execution
220
-
221
- ![Create Run](./images/att66_401.png)
222
-
223
- Once the mixed run starts:
224
-
225
- 6. **Automated tests** are sent to your connected **CI service** for execution. Their results will update automatically in Jira once the CI job completes.
226
- 7. **Manual tests** can be executed directly inside Jira — mark each test with its result (e.g., ✔ passed / ✖ failed / ➖ skipped)
227
- 8. Click the **Finish Run** button to close the run
228
-
229
- ![Finish mixed run](./images/att67_401.png)
230
-
231
- **Option 2** – From the **'Plans'** Tab
232
-
233
- 1. Navigate to the **Plans** tab in the Jira issue
234
- 2. Click the **▶︎ icon** (Launch a plan) next to the linked Plan
235
- 3. or click the **⚙︎ icon** (Launch with advanced options)
236
-
237
- ![Launch a plan](./images/att53_401.png)
238
-
239
- 4. Once the **Run settings** window opens (this appears only if you clicked the **▶︎ icon**), select:
240
-
241
- - **Title** - provide a title for the run
242
- - **CI profile** – select the CI configuration profile for automated test execution
243
- - **Enter config** – specify custom environment variables (e.g. `ref=main`)
244
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
245
- - **Assign user** – select the **email of the user added to the project** who is responsible for this run
246
- - **RunGroup** - optional grouping of related runs for easier tracking and reporting
247
-
248
- 5. Click **'Create Run'** to start execution
249
-
250
- ![Launch Automated Run](./images/att62_401.png)
251
-
252
- 6. **Automated tests** are sent to your connected **CI service** for execution. Their results will update automatically in Jira once the CI job completes.
253
- 7. **Manual tests** can be executed directly inside Jira — mark each test with its result (e.g., ✔ passed / ✖ failed / ➖ skipped)
254
- 8. Click the **Finish Run** button to close the run
255
-
256
- ![Finish mixed run](./images/att67_401.png)
257
-
258
- ## Run Reports in Jira
259
-
260
- Once a run is completed, it automatically appears in **Testomat.io** and in the **Runs** tab within Jira. In this tab, you can view all runs that were **launched in Jira** or **linked in Testomat.io project**, and quickly access key information about each run.
261
-
262
- - **External link (URL)** – opens the detailed report in Testomat.io
263
- - **Status icon** – shows the color of the run’s status (Passed / Failed / Skipped)
264
- - **Title** – the title provided for the run
265
- - **Run type** – a badge indicating the type of run (e.g., manual / automated / mixed)
266
- - **Environment** – selected environments for the run (e.g., macOS, Chrome, staging)
267
- - **Execution date** – date the run was completed (or **Not finished**)
268
- - **Test statuses** – number of tests with each status (e.g., ✔ Passed / ✖ Failed / ➖ Skipped)
269
- - **Actions** – **▶︎ icon** appears if the run is not yet completed
270
-
271
- ![Run general information](./images/att68_401.png)
272
-
273
- For full report options (filters, exports, comparisons, etc.), you can **open the Run Reports in Testomat.io**, or to learn more, visit the [Run Reports documentation](https://docs.testomat.io/project/runs/reports/).
274
-
275
- ### Receive Reports in Jira
276
-
277
- You can receive a summary report directly inside Jira by enabling **Report Notifications** in your Testomat.io project settings. This integration automatically posts key information about each test run into your Jira project, including:
278
-
279
- - Run ID and Status
280
- - Project name
281
- - Number of Executed Tests
282
- - Execution Date and Duration
283
- - Failed Tests
284
- - Environment
285
- - Link to Full Report
286
-
287
- This summary allows you to quickly see the key results of each run directly in Jira, while full details remain accessible via the Testomat.io report link.
288
-
289
- ![Report Notifications in Jira](./images/att69_401.png)
290
-
291
- Learn how to set it up in [Report Notifications in Jira.](https://docs.testomat.io/integrations/report-notifications/jira/)
292
-
293
- ## Tests Coverage
294
-
295
- The Tests Coverage screen provides a traceability matrix showing all Jira issues with their linked
296
- tests. For each issue you can see:
297
-
298
- - Title — Jira issue key and name
299
- - Tests — number of linked tests
300
- - Status — current test run status (e.g., Failed, Passed)
301
- - Automation status — percentage of automated tests among linked ones
302
-
303
- This gives the team a quick overview of which requirements are covered, how many tests back each issue, and how far automation has progressed per story.
304
-
305
- To open the Tests Coverage screen:
306
-
307
- 1. Open the specific space
308
- 2. Click the 'More' option
309
- 3. Select the 'Tests Coverage' tab
310
-
311
- ![Tests Coverage tab](./images/att1_575.png)
312
-
313
- The automation percentage reflects how many of the linked tests are automated — from 0% (all manual) to 100% (fully automated). Issues with no linked tests signal coverage gaps that need attention.
314
-
315
- ![Tests Coverage screen](./images/att2_575.png)
316
-
317
- ## Sprint Coverage
318
-
319
- The Sprint Coverage tab gives a high-level summary of test execution health across a sprint. Use it to understand how well a sprint is covered with tests and how the execution is progressing — without leaving Jira.
320
-
321
- For each sprint it shows:
322
-
323
- - Issues with tests / Issues without tests — how many sprint issues have linked tests and how many are left uncovered
324
- - Manual tests / Automated tests — breakdown of test types across the sprint
325
- - Passed / Failed / Skipped / Pending / Not executed — full execution status breakdown
326
-
327
- This makes it easy to spot coverage gaps, track automation progress, and assess sprint readiness at a glance.
328
-
329
- To check test coverage for a sprint:
330
-
331
- 1. Open the specific space
332
- 2. Click the 'More' option
333
- 3. Select the 'Sprints Coverage' tab
334
-
335
- ![Sprint Coverage](./images/att3_575.png)
336
-
337
- 4. Enter the sprint ID(s)
338
- 5. Click the 'Submit' button
339
-
340
- ![Search sprint ID(s)](./images/att4_575.png)
341
-
342
- :::note
343
-
344
- To find your sprint ID, visit the [Jira Software sprint ID guide](https://support.atlassian.com/jira/kb/jira-software-how-to-identify-the-id-of-a-sprint/).
345
-
346
- :::
347
-
348
- ## Data Sync in Jira
349
-
350
- Testomat.io and Jira are continuously synchronized to ensure test data stays up to date across both systems. This **two-way sync** keeps all team members — QA, development, management, and stakeholders — aligned.
351
-
352
- **Automatic Sync**
353
-
354
- All key updates are automatically synchronized:
355
-
356
- - Linked test cases, test suites, and plans remain aligned in both systems
357
- - Statuses of linked Jira issues are synchronized
358
- - Executing a run in Testomat.io updates the corresponding Jira issue with the latest run status
359
- - Launching or updating a run from Jira instantly reflects in Testomat.io
360
- - Testomat.io settings — including environments, branches, users, run groups, and CI integrations — are synchronized and visible in Jira
361
-
362
- This real-time, two-way sync ensures that everyone sees the same up-to-date information, eliminating confusion and reducing manual updates.
363
-
364
- **Manual Sync**
365
-
366
- If your Jira issue view or run list does not show the latest data, you can trigger synchronization manually. This ensures that all test results, linked issues, and run information are up-to-date in both Jira and Testomat.io.
367
-
368
- To manually refresh data:
369
-
370
- 1. Open the **Tests** tab in the Jira issue
371
- 2. Click the '⋯' (extra menu) button
372
- 3. Select **Sync** from the dropdown list
373
-
374
- ![Sync button](./images/att55_401.png)
375
-
376
- Testomat.io will re-fetch the latest information and update linked test results, statuses, and settings inside Jira. This keeps your Jira and Testomat.io data fully consistent — whether you rely on automatic background sync or perform a quick manual refresh when needed.
377
-