testeiya 0.2.0 → 0.3.9

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (412) hide show
  1. package/LICENSE +21 -0
  2. package/README.md +37 -175
  3. package/dist/prompt/context.js +79 -0
  4. package/dist/prompt/context.js.map +1 -0
  5. package/dist/prompt/index.js +56 -0
  6. package/dist/prompt/index.js.map +1 -0
  7. package/dist/prompt/print.js +22 -0
  8. package/dist/prompt/print.js.map +1 -0
  9. package/dist/prompt/project-info.js +2 -0
  10. package/dist/prompt/project-info.js.map +1 -0
  11. package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +24 -21
  12. package/dist/prompt/system-prompt.js.map +1 -0
  13. package/dist/prompt/testomatio.js +264 -0
  14. package/dist/prompt/testomatio.js.map +1 -0
  15. package/dist/prompt/tools.js +49 -0
  16. package/dist/prompt/tools.js.map +1 -0
  17. package/dist/prompt/vocab.js +8 -0
  18. package/dist/prompt/vocab.js.map +1 -0
  19. package/dist/src/args.js +72 -0
  20. package/dist/src/args.js.map +1 -0
  21. package/dist/src/cli.js +61 -0
  22. package/dist/src/cli.js.map +1 -0
  23. package/dist/src/env.js +69 -0
  24. package/dist/src/env.js.map +1 -0
  25. package/dist/src/mcp-extension.js +9 -0
  26. package/dist/src/mcp-extension.js.map +1 -0
  27. package/dist/src/mcp.js +139 -0
  28. package/dist/src/mcp.js.map +1 -0
  29. package/dist/src/model.js +66 -0
  30. package/dist/src/model.js.map +1 -0
  31. package/dist/src/result.js +41 -0
  32. package/dist/src/result.js.map +1 -0
  33. package/dist/src/run.js +199 -0
  34. package/dist/src/run.js.map +1 -0
  35. package/dist/src/session.js +77 -0
  36. package/dist/src/session.js.map +1 -0
  37. package/dist/vendor/mcp.js +14801 -0
  38. package/mcp-tools.json +2967 -0
  39. package/package.json +29 -41
  40. package/prompt/context.ts +101 -0
  41. package/prompt/index.ts +93 -0
  42. package/prompt/print.ts +23 -0
  43. package/prompt/project-info.ts +30 -0
  44. package/prompt/system-prompt.ts +173 -0
  45. package/{src/prompt → prompt}/testomatio.ts +119 -8
  46. package/{src/prompt → prompt}/tools.ts +30 -8
  47. package/prompt/vocab.ts +7 -0
  48. package/{skills.lock.json → skills/skills.lock.json} +11 -7
  49. package/skills/skills.yaml +34 -0
  50. package/models.catalog.json +0 -6963
  51. package/skills/codeceptjs/ci-fix-tests/SKILL.md +0 -120
  52. package/skills/codeceptjs/codeceptjs-auth/SKILL.md +0 -158
  53. package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +0 -91
  54. package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +0 -158
  55. package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +0 -90
  56. package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +0 -234
  57. package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +0 -110
  58. package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +0 -306
  59. package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +0 -352
  60. package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +0 -472
  61. package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +0 -350
  62. package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +0 -81
  63. package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +0 -206
  64. package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
  65. package/skills/playwright-best-practices-skill/README.md +0 -147
  66. package/skills/playwright-best-practices-skill/SKILL.md +0 -303
  67. package/skills/playwright-best-practices-skill/advanced/authentication-flows.md +0 -360
  68. package/skills/playwright-best-practices-skill/advanced/authentication.md +0 -871
  69. package/skills/playwright-best-practices-skill/advanced/clock-mocking.md +0 -364
  70. package/skills/playwright-best-practices-skill/advanced/mobile-testing.md +0 -409
  71. package/skills/playwright-best-practices-skill/advanced/multi-context.md +0 -288
  72. package/skills/playwright-best-practices-skill/advanced/multi-user.md +0 -393
  73. package/skills/playwright-best-practices-skill/advanced/network-advanced.md +0 -452
  74. package/skills/playwright-best-practices-skill/advanced/third-party.md +0 -464
  75. package/skills/playwright-best-practices-skill/architecture/pom-vs-fixtures.md +0 -363
  76. package/skills/playwright-best-practices-skill/architecture/test-architecture.md +0 -369
  77. package/skills/playwright-best-practices-skill/architecture/when-to-mock.md +0 -383
  78. package/skills/playwright-best-practices-skill/browser-apis/browser-apis.md +0 -391
  79. package/skills/playwright-best-practices-skill/browser-apis/iframes.md +0 -403
  80. package/skills/playwright-best-practices-skill/browser-apis/service-workers.md +0 -504
  81. package/skills/playwright-best-practices-skill/browser-apis/websockets.md +0 -403
  82. package/skills/playwright-best-practices-skill/core/annotations.md +0 -424
  83. package/skills/playwright-best-practices-skill/core/assertions-waiting.md +0 -361
  84. package/skills/playwright-best-practices-skill/core/configuration.md +0 -452
  85. package/skills/playwright-best-practices-skill/core/fixtures-hooks.md +0 -417
  86. package/skills/playwright-best-practices-skill/core/global-setup.md +0 -434
  87. package/skills/playwright-best-practices-skill/core/locators.md +0 -242
  88. package/skills/playwright-best-practices-skill/core/page-object-model.md +0 -315
  89. package/skills/playwright-best-practices-skill/core/projects-dependencies.md +0 -453
  90. package/skills/playwright-best-practices-skill/core/test-data.md +0 -492
  91. package/skills/playwright-best-practices-skill/core/test-suite-structure.md +0 -361
  92. package/skills/playwright-best-practices-skill/core/test-tags.md +0 -298
  93. package/skills/playwright-best-practices-skill/debugging/console-errors.md +0 -420
  94. package/skills/playwright-best-practices-skill/debugging/debugging.md +0 -504
  95. package/skills/playwright-best-practices-skill/debugging/error-testing.md +0 -360
  96. package/skills/playwright-best-practices-skill/debugging/flaky-tests.md +0 -496
  97. package/skills/playwright-best-practices-skill/frameworks/angular.md +0 -530
  98. package/skills/playwright-best-practices-skill/frameworks/nextjs.md +0 -469
  99. package/skills/playwright-best-practices-skill/frameworks/react.md +0 -531
  100. package/skills/playwright-best-practices-skill/frameworks/vue.md +0 -574
  101. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/ci-cd.md +0 -468
  102. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/docker.md +0 -283
  103. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/github-actions.md +0 -546
  104. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/gitlab.md +0 -397
  105. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/other-providers.md +0 -521
  106. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/parallel-sharding.md +0 -371
  107. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/performance.md +0 -453
  108. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/reporting.md +0 -424
  109. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/test-coverage.md +0 -497
  110. package/skills/playwright-best-practices-skill/testing-patterns/accessibility.md +0 -359
  111. package/skills/playwright-best-practices-skill/testing-patterns/api-testing.md +0 -719
  112. package/skills/playwright-best-practices-skill/testing-patterns/browser-extensions.md +0 -506
  113. package/skills/playwright-best-practices-skill/testing-patterns/canvas-webgl.md +0 -493
  114. package/skills/playwright-best-practices-skill/testing-patterns/component-testing.md +0 -500
  115. package/skills/playwright-best-practices-skill/testing-patterns/drag-drop.md +0 -576
  116. package/skills/playwright-best-practices-skill/testing-patterns/electron.md +0 -509
  117. package/skills/playwright-best-practices-skill/testing-patterns/file-operations.md +0 -377
  118. package/skills/playwright-best-practices-skill/testing-patterns/file-upload-download.md +0 -562
  119. package/skills/playwright-best-practices-skill/testing-patterns/forms-validation.md +0 -561
  120. package/skills/playwright-best-practices-skill/testing-patterns/graphql-testing.md +0 -331
  121. package/skills/playwright-best-practices-skill/testing-patterns/i18n.md +0 -508
  122. package/skills/playwright-best-practices-skill/testing-patterns/performance-testing.md +0 -476
  123. package/skills/playwright-best-practices-skill/testing-patterns/security-testing.md +0 -430
  124. package/skills/playwright-best-practices-skill/testing-patterns/visual-regression.md +0 -634
  125. package/skills/playwright-cli/SKILL.md +0 -420
  126. package/skills/playwright-cli/references/element-attributes.md +0 -23
  127. package/skills/playwright-cli/references/playwright-tests.md +0 -39
  128. package/skills/playwright-cli/references/request-mocking.md +0 -87
  129. package/skills/playwright-cli/references/running-code.md +0 -241
  130. package/skills/playwright-cli/references/session-management.md +0 -225
  131. package/skills/playwright-cli/references/storage-state.md +0 -275
  132. package/skills/playwright-cli/references/test-generation.md +0 -433
  133. package/skills/playwright-cli/references/tracing.md +0 -139
  134. package/skills/playwright-cli/references/video-recording.md +0 -143
  135. package/skills/testeiya/README.md +0 -29
  136. package/skills/testeiya/answer-formatting/SKILL.md +0 -30
  137. package/skills/testeiya/check-cucumber/SKILL.md +0 -200
  138. package/skills/testeiya/check-tests/SKILL.md +0 -260
  139. package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
  140. package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
  141. package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
  142. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
  143. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
  144. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
  145. package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
  146. package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
  147. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
  148. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
  149. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
  150. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
  151. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
  152. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
  153. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
  154. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
  155. package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
  156. package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
  157. package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
  158. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
  159. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
  160. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
  161. package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
  162. package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
  163. package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
  164. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
  165. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
  166. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
  167. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
  168. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
  169. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
  170. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
  171. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
  172. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
  173. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
  174. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
  175. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
  176. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
  177. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
  178. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
  179. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
  180. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
  181. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
  182. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
  183. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
  184. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
  185. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
  186. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
  187. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
  188. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
  189. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
  190. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
  191. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
  192. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
  193. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
  194. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
  195. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
  196. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
  197. package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
  198. package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
  199. package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
  200. package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
  201. package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
  202. package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
  203. package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
  204. package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
  205. package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
  206. package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
  207. package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
  208. package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
  209. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
  210. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
  211. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
  212. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
  213. package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
  214. package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
  215. package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
  216. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
  217. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
  218. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
  219. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
  220. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
  221. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
  222. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
  223. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
  224. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
  225. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
  226. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
  227. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
  228. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
  229. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
  230. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
  231. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
  232. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
  233. package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
  234. package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
  235. package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
  236. package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
  237. package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
  238. package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
  239. package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
  240. package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
  241. package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
  242. package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
  243. package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
  244. package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
  245. package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
  246. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
  247. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
  248. package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
  249. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
  250. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
  251. package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
  252. package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
  253. package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
  254. package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
  255. package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
  256. package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
  257. package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
  258. package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
  259. package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
  260. package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
  261. package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
  262. package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
  263. package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
  264. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
  265. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
  266. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
  267. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
  268. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
  269. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
  270. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
  271. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
  272. package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
  273. package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
  274. package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
  275. package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
  276. package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
  277. package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
  278. package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
  279. package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
  280. package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
  281. package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
  282. package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
  283. package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
  284. package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +0 -88
  285. package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +0 -95
  286. package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +0 -334
  287. package/skills/testomatio/test-automation/automate-manual-test-cases/CLAUDE.md +0 -56
  288. package/skills/testomatio/test-automation/automate-manual-test-cases/SKILL.md +0 -242
  289. package/skills/testomatio/test-automation/automate-manual-test-cases/references/CODECEPTJS_BEST_PRACTICES.md +0 -182
  290. package/skills/testomatio/test-automation/automate-manual-test-cases/references/FINAL_SUMMARY_TEMPLATE.md +0 -22
  291. package/skills/testomatio/test-automation/automate-manual-test-cases/references/PLAYWRIGHT_BEST_PRACTICES.md +0 -90
  292. package/skills/testomatio/test-automation/automate-manual-test-cases/references/POM_BEST_PRACTICES.md +0 -53
  293. package/skills/testomatio/test-automation/automate-manual-test-cases/references/TEST_DATA_MANAGEMENT.md +0 -52
  294. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/SKILL.md +0 -107
  295. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/references/DEBUGGING_QUICK_REFERENCE.md +0 -113
  296. package/skills/testomatio/test-automation/qa-automation-test-consolidation/SKILL.md +0 -29
  297. package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +0 -151
  298. package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
  299. package/skills/testomatio/test-automation/testomat-allure-adapter/SKILL.md +0 -289
  300. package/skills/testomatio/test-management/detect-duplicate-test-cases/SKILL.md +0 -86
  301. package/skills/testomatio/test-management/detect-duplicate-test-cases/references/DUPLICATE_INSTRUCTIONS.md +0 -54
  302. package/skills/testomatio/test-management/improve-test-cases/SKILL.md +0 -114
  303. package/skills/testomatio/test-management/improve-test-cases/references/TESTOMAT_MARKDOWN_EXAMPLE.md +0 -66
  304. package/skills/testomatio/test-management/pull-request-diff-analyzer/SKILL.md +0 -141
  305. package/skills/testomatio/test-management/qa-e2e-tests-reporting/SKILL.md +0 -354
  306. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_ARTIFACTS.md +0 -82
  307. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_HTML_REPORT.md +0 -37
  308. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_REPORTERS_CONFIG.md +0 -118
  309. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/SKILL.md +0 -149
  310. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/references/summary-example.md +0 -54
  311. package/skills/testomatio/test-management/qa-requirement-reviewer/SKILL.md +0 -126
  312. package/skills/testomatio/test-management/qa-requirement-reviewer/references/requirements_reviewer_examples.md +0 -128
  313. package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +0 -174
  314. package/skills/testomatio/test-management/qa-test-code-coverage/references/COVERAGE_FILE_FORMAT.md +0 -138
  315. package/skills/testomatio/test-management/qa-test-code-coverage/references/E2E_FRAMEWORKS.md +0 -65
  316. package/skills/testomatio/test-management/qa-test-code-coverage/scripts/check-coverage.mjs +0 -40
  317. package/skills/testomatio/test-management/qa-thinking/SKILL.md +0 -36
  318. package/skills/testomatio/test-management/qa-write-test-cases/SKILL.md +0 -267
  319. package/skills/testomatio/test-management/qa-write-test-cases/references/test-case-format.md +0 -387
  320. package/skills/testomatio/test-management/qa-write-test-cases/references/testomat-tms-guide.md +0 -72
  321. package/skills/testomatio/test-management/qa-write-test-cases/references/writing-rule.md +0 -159
  322. package/skills/testomatio/test-management/scan-automation-project/SKILL.md +0 -152
  323. package/skills/testomatio/test-management/sync-test-cases-with-tms/SKILL.md +0 -107
  324. package/skills/testomatio/test-management/sync-test-cases-with-tms/references/TESTOMATIO_CLI.md +0 -140
  325. package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +0 -182
  326. package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +0 -169
  327. package/skills.yaml +0 -21
  328. package/src/ai-debug.ts +0 -188
  329. package/src/api/agent-get.ts +0 -22
  330. package/src/api/agent-start.ts +0 -384
  331. package/src/api/client-log.ts +0 -29
  332. package/src/api/context.ts +0 -332
  333. package/src/api/debug-layout.ts +0 -47
  334. package/src/api/debug-report.ts +0 -29
  335. package/src/api/debug-snapshot.ts +0 -30
  336. package/src/api/debug-stream.ts +0 -52
  337. package/src/api/files-delete.ts +0 -184
  338. package/src/api/files-read.ts +0 -41
  339. package/src/api/files-rename.ts +0 -99
  340. package/src/api/files-tree.ts +0 -292
  341. package/src/api/files-write.ts +0 -41
  342. package/src/api/mcp.ts +0 -603
  343. package/src/api/memory.ts +0 -69
  344. package/src/api/open-external.ts +0 -39
  345. package/src/api/playwright-cli.ts +0 -606
  346. package/src/api/providers.ts +0 -457
  347. package/src/api/read-env-token.ts +0 -33
  348. package/src/api/sessions.ts +0 -79
  349. package/src/api/settings.ts +0 -120
  350. package/src/api/skills.ts +0 -58
  351. package/src/api/testomatio-attachment.ts +0 -89
  352. package/src/api/testomatio-auth.ts +0 -284
  353. package/src/api/testomatio-proxy.ts +0 -197
  354. package/src/api/testomatio-run-stats.ts +0 -81
  355. package/src/api/testomatio-target.ts +0 -225
  356. package/src/api/testomatio-transcription.ts +0 -82
  357. package/src/api/workspace-search.ts +0 -96
  358. package/src/api/workspace-sync.ts +0 -151
  359. package/src/api/workspace.ts +0 -165
  360. package/src/app-server.ts +0 -556
  361. package/src/bridge.ts +0 -251
  362. package/src/check-tests.ts +0 -156
  363. package/src/cli.ts +0 -17
  364. package/src/commands.ts +0 -244
  365. package/src/config.ts +0 -183
  366. package/src/connection.ts +0 -658
  367. package/src/context-store.ts +0 -265
  368. package/src/debug-bus.ts +0 -405
  369. package/src/extensions/tool-gate.ts +0 -220
  370. package/src/extensions/webui/ask-channel.ts +0 -52
  371. package/src/extensions/webui/index.ts +0 -184
  372. package/src/extensions/webui/tools/ask-question.ts +0 -88
  373. package/src/extensions/webui/tools/query-result.ts +0 -79
  374. package/src/extensions/webui/tools/render-chart.ts +0 -53
  375. package/src/extensions/webui/tools/render-item.ts +0 -61
  376. package/src/extensions/webui/tools/render-list.ts +0 -170
  377. package/src/extensions/webui/tools/render-result.ts +0 -85
  378. package/src/extensions/webui/tools/render-tree.ts +0 -71
  379. package/src/extensions/webui/tools/ui-widget.ts +0 -54
  380. package/src/extensions/webui/tools/widget-result.ts +0 -13
  381. package/src/extensions/webui/widget-channel.ts +0 -50
  382. package/src/file-log.ts +0 -196
  383. package/src/git-tracked.ts +0 -68
  384. package/src/gitignore.ts +0 -53
  385. package/src/json-store.ts +0 -43
  386. package/src/load-env.ts +0 -70
  387. package/src/loader-style.ts +0 -96
  388. package/src/main.ts +0 -140
  389. package/src/mcp-catalog.ts +0 -96
  390. package/src/models-catalog.ts +0 -72
  391. package/src/permissions.ts +0 -120
  392. package/src/project-dir.ts +0 -189
  393. package/src/project-info.ts +0 -108
  394. package/src/prompt/app-ui.ts +0 -59
  395. package/src/prompt/browser.ts +0 -27
  396. package/src/prompt/index.ts +0 -62
  397. package/src/server-info.ts +0 -62
  398. package/src/session-factory.ts +0 -442
  399. package/src/session-store.ts +0 -115
  400. package/src/shell-env.ts +0 -45
  401. package/src/skills.ts +0 -163
  402. package/src/sync-snapshot.ts +0 -140
  403. package/src/telemetry.ts +0 -239
  404. package/src/testomatio-auth.ts +0 -299
  405. package/src/testomatio.ts +0 -98
  406. package/src/theme.ts +0 -30
  407. package/src/user-env.ts +0 -94
  408. package/src/welcome.ts +0 -127
  409. package/src/workspace/safe-path.ts +0 -85
  410. package/src/workspace/test-md.ts +0 -70
  411. package/src/workspace-model.ts +0 -440
  412. package/testeiya.config.json +0 -14
@@ -1,98 +0,0 @@
1
- ---
2
- title: Jira Plugin
3
- description: Learn how to integrate Testomat.io with Jira using the Jira plugin. This guide covers connecting projects, linking/unlinking tests, suites, and plans to Jira issues, running manual or automated tests, managing BDD feature files, attaching test reports, using AI prompts to improve test descriptions, and leveraging the traceability matrix for comprehensive coverage in sprints.
4
- type: article
5
- url: https://docs.testomat.io/advanced/jira-plugin
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Jira plugin, Testomat.io, test management, test coverage, BDD, feature files, automated tests, manual tests, Jira integration, traceability matrix, test reporting, AI test descriptions, SSO login
11
- ---
12
-
13
- import DirectoryLinks from "/src/components/DirectoryLinks.astro";
14
-
15
- <DirectoryLinks directory="advanced/jira-plugin" />
16
-
17
- The Testomat.io Jira Plugin enhances your Jira experience by enabling you to manage tests directly inside Jira. With this plugin you can:
18
-
19
- - Connect multiple Testomat.io and JIRA projects easily
20
- - Quickly link/unlink tests, suites, and plans to JIRA issues
21
- - View and edit tests directly in JIRA
22
- - Use autocomplete and smart suggestions for creating tests
23
- - Easily modify BDD/Gherkin feature files and scenarios
24
- - Create multiple tests at once from checklists from bulk create
25
- - Run manual and automated tests from JIRA tickets
26
- - Attach test reports to JIRA issues with a click
27
- - Use tracebility matrix and reports to check test coverage in sprints and project
28
- - Manage project branches
29
- - Use AI prompts to generate or improve test descriptions directly in Jira
30
-
31
- :::note
32
-
33
- Jira Plugin requires an active Jira integration in your Testomat.io project. If Jira is not connected yet, please follow [How to Connect Jira Project](https://docs.testomat.io/integrations/issues-management/jira/#connecting-to-jira-project).
34
-
35
- ![No linked connection with Jira](./images/att6_401.png)
36
-
37
- :::
38
-
39
- ## How to Use Jira Plugin Without Logging in
40
-
41
- When you open a Jira issue with linked Testomat.io items **without logging in**, the visibility depends on the type of **Jira connection** used. For full details on connection types and their permissions, see [Jira connection type](https://docs.testomat.io/integrations/issues-management/jira/#jira-connection-types).
42
-
43
- ![Jira connection type](./images/att75_401.png)
44
-
45
- **Connected with an administrator's account**
46
-
47
- You can still:
48
-
49
- - View **tests and suites** linked to the issue
50
-
51
- ![list of tests and suites](./images/gif1_401.gif)
52
-
53
- - Browse the **Tests Coverage** screen
54
-
55
- ![Test Coverage](./images/att7_401.png)
56
-
57
- **Connected with a regular account**
58
-
59
- - only authorized Testomat.io users will be able to see tests and run results in Jira
60
-
61
- ## How to Log in to Testomat.io from Jira
62
-
63
- -To access all Jira Plugin features, you need to log in to Testomat.io. You can log in directly from:
64
-
65
- - a Jira issue
66
-
67
- ![Log In from Jira Plugin](./images/att9_401.png)
68
-
69
- - or you can do this from Apps
70
-
71
- ![Log In from app](./images/att8_401.png)
72
-
73
- ### Login Options
74
-
75
- You can authorize using any of the following methods:
76
-
77
- - **Email + Password** — enter your Testomat.io credentials and click **Submit**
78
- - **Authorize with GitHub** — sign in with your GitHub account
79
- - **Authorize with Google** — sign in with your Google account
80
- - **Authorize with SSO** — use your company’s Single Sign-On provider
81
-
82
- ### What you can do after logging in
83
-
84
- Once logged in, you can:
85
-
86
- - view linked tests and suites
87
- - edit them directly in Jira
88
- - unlink items when needed
89
- - use AI prompts to enhance test descriptions:
90
- - Suggest Description – generate a clear and concise description for a test based on its title and similar tests
91
- - Improve Description – refine the existing description to make it clearer
92
- - Suggest Better Description – provide an alternative improved description
93
-
94
- ![Avaliable options](./images/att10_401.png)
95
-
96
- ## JIRA Plugin Permissions and Security
97
-
98
- Testomat.io’s JIRA plugin is designed to integrate seamlessly with your JIRA projects, requiring specific permissions to operate effectively. The plugin has **read access** to all issues of an enabled project to display tests that can be attached to any JIRA issue and can **write properties** to save test data into JIRA storage attached to a specific issue. Importantly, Testomat.io **does not perform any update or delete operations** on your JIRA issues, maintaining the integrity of your project data. The plugin accesses several JIRA API endpoints strictly necessary for its functionality, adhering to high standards of data security and integrity. For detailed information on permissions and security, refer to the [JIRA Permissions](https://docs.testomat.io/legal/security/jira) section in our documentation.
@@ -1,151 +0,0 @@
1
- ---
2
- title: Creating Jira Issue
3
- description: Learn how to integrate Testomat.io with Jira using the Jira plugin. This guide covers connecting Testomat.io projects to Jira, linking/unlinking tests, suites, and test plans to Jira issues, and running manual or automated tests directly from Jira. Manage BDD feature files, attach test reports, and utilize the traceability matrix for comprehensive test coverage in sprints.
4
- type: article
5
- url: https://docs.testomat.io/advanced/jira-plugin/jira-issue
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: og:image
10
- content: https://docs.testomat.io/_astro/New_8rxMYOhd_2024-10-19.BaU2EWny_Z1oTGPz.webp
11
- - tag: meta
12
- attrs:
13
- name: keywords
14
- content: Jira plugin, Testomat.io, test management, test coverage, BDD, feature files, automated tests, manual tests, Jira integration, traceability matrix, test reporting
15
- ---
16
-
17
- **Jira integration in Testomat.io** helps QA teams quickly turn test results into actionable bug reports. This feature eliminates the manual effort of copying failed test data into Jira and ensures full traceability between test execution and defect tracking.
18
-
19
- With a few clicks, you can:
20
-
21
- - **Create a Jira issue** directly from a failed test or run
22
- - **Link existing Jira issues** to tests or suites
23
- - **Attach contextual details** (test steps, results, environment, and run links) automatically
24
-
25
- This integration was designed to improve collaboration between **QA, development, and management teams**, speeding up feedback loops and ensuring visibility across all project stakeholders.
26
-
27
- ## How to Create a Jira Issue for a Failed Test
28
-
29
- To create a JIRA issue for a Failed Test, open a Run with a failed test. Find a test in list, move the cursor over it and click on the **Link to Issue** icon:
30
-
31
- ![Testomatio.io - Creating JIRA Issue for Failed Test](./images/New_7T8nObH5_2024-10-19.png)
32
-
33
- You can link it to an existing issue **(1)** or create a new one **(2)**.
34
-
35
- Once you have decided to create an issue in your Jira project, you can select its ticket types **(3)**.
36
-
37
- ![Testomatio.io - Link Failed Test to existing issue or create a new one](./images/New_Y2SJbV9K_2024-10-19.png)
38
-
39
- You can even create an issue as a subtask by **specifying a Parent ticket**:
40
-
41
- ![Testomatio.io - Creating JIRA Issue as Subtask](./images/New_8rxMYOhd_2024-10-19.png)
42
-
43
- - Once created, the linked issue appears under the test run, indicated by the **issue icon**
44
- - Hovering over the icon shows the **issue title** and **current status**
45
- - Clicking the icon redirects to the issue in Jira
46
- - This icon remains visible both during test execution
47
-
48
- ![Jira Issue in Ongoing run](./images/att4_462.png)
49
-
50
- - and after the run is completed, making it easy to track related issues at a glance
51
-
52
- ![Completed Run](./images/att5_462.png)
53
-
54
- The generated ticket will contain the specified information, as well as information about the test run and a web link to the test run report:
55
-
56
- ![Testomatio.io - Created ticket in Jira](./images/New_8ENxIFXB_2024-10-19.png)
57
-
58
- ## How to Create a Jira Issue for a Failed Run
59
-
60
- To create a JIRA issue for a Failed Manual or Automated Run, open the run and select the **Link to Issue** option from the dots menu:
61
-
62
- ![Testomatio.io - Creating JIRA Issue for Failed Run](./images/New_cLq5eNs9_2024-10-19.png)
63
-
64
- Create a new issue for a run or append to an existing issue.
65
-
66
- ![Testomatio.io - Link Failed Run to existing issue or create a new one](./images/New_tYJ8Bm2P_2024-10-19.png)
67
-
68
- - Once created, the linked issue appears **under the completed run**, indicated by the **issue icon** in the run’s sidebar
69
- - Hovering over the icon displays the **issue title** and **current status**
70
- - Clicking the icon redirects directly to the issue in the Jira project
71
-
72
- ![Linked Jira to Run](./images/att6_462.png)
73
-
74
- ## How to Link a Test to a Jira Issue
75
-
76
- You can easily connect any individual **test** in Testomat.io to an existing or new Jira issue. This allows quick traceability between your test cases and related Jira tickets.
77
-
78
- 1. Navigate to the **Tests** page in your Testomat.io project
79
- 2. Open the test you want to link
80
- 3. Click the **extra menu (⋯)** button in the top-right corner
81
- 4. Select **Link to Issue**
82
-
83
- ![Link to Issue](./images/att41_401.png)
84
-
85
- Once the **Link to Issue** modal window appears:
86
-
87
- 5. To **link to an existing Jira issue**, paste or enter the issue key and click **Link Issue**
88
- 6. To **create a new Jira issue**, click **Create new issue**
89
-
90
- ![create or link a Jira issue](./images/att42_401.png)
91
-
92
- 7. Select your **Jira profile** (see details: [Connecting Jira Integration](https://docs.testomat.io/integrations/issues-management/jira/)).
93
- 8. Choose the **Issue Type** from the dropdown (e.g., Bug, Task, Sub-task)
94
- 9. Add a **Title**
95
- 10. Optionally, include a **Description** to provide test context
96
- 11. Fill in any **Jira fields** available in your configuration.
97
-
98
- Testomat.io automatically displays all supported fields — such as **Parent**, **Components**, **Fix versions**, **Priority**, **Labels**, or other custom fields defined in your Jira project.
99
-
100
- These may appear immediately or after clicking **Show Optional Fields**, depending on your project setup.
101
-
102
- :::note
103
-
104
- The available fields depend on your Jira project configuration. To see all supported field types in Testomat.io, refer to [Supported Jira Field Types](https://docs.testomat.io/integrations/issues-management/jira/#supported-jira-field-types).
105
-
106
- :::
107
-
108
- 12. Once all required information is filled in, click **Create Jira Issue** to finish linking.
109
-
110
- ![Save new Jira Issue](./images/att43_401.png)
111
-
112
- The linked issue appears under the test, indicated by the **issue icon**, which redirects to the issue in the Jira project. In addition, Testomat.io also displays the linked Jira issue’s **title** and **status**, making it easier to recognize the issue at a glance.
113
-
114
- ![Linked Jira issue showing title and status](./images/att1_462.png)
115
-
116
- :::note
117
-
118
- You can link a test to multiple issues. In this case their IDs will be displayed in test view in Testomatio.
119
-
120
- :::
121
-
122
- ![Multiple Jira issues](./images/att2_462.png)
123
-
124
- ## How to Link a Suite to a Jira Issue
125
-
126
- Linking a suite to a Jira issue works similarly to linking an individual test, with one key difference: **all tests within the suite will automatically be linked to the Jira issue.**
127
-
128
- :::note
129
-
130
- Linking is available only at the **suite level**. You cannot link a Jira issue to a folder, and the **Link to Issue** button does not appear on folder level.
131
-
132
- :::
133
-
134
- 1. Navigate to the **Tests** page in your Testomat.io project
135
- 2. Open the suite you want to link
136
- 3. Click the **extra menu (⋯)** button in the top-right corner
137
- 4. Select **Link to Issue**
138
-
139
- ![Link Jira Issue to Suite](./images/att45_401.png)
140
-
141
- Follow the same steps above as linking a single test: link an existing issue or create a new one, select issue type, fill required fields, and click Create Jira Issue.
142
-
143
- When a suite is linked, both the suite and all its tests will display the linked Jira issue icon along with its title and status, providing immediate context.
144
-
145
- ![Suite Jira Issue](./images/att8_462.png)
146
-
147
- :::note
148
-
149
- If you unlink a suite from a Jira issue, all its linked tests will be unlinked automatically.
150
-
151
- :::
@@ -1,377 +0,0 @@
1
- ---
2
- title: Runs & Reports in Jira
3
- description: Learn how to run manual, automated, or mixed test executions in Jira using the Testomat.io plugin. This guide covers configuring advanced settings, executing test runs.
4
- type: article
5
- url: https://docs.testomat.io/advanced/jira-plugin/runs-and-reports
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Jira plugin, Testomat.io, test runs, test plan, test execution, manual run, mixed run, automated run, CI/CD, test reports, test analytics
11
- ---
12
-
13
- With the **Testomat.io plugin in Jira**, your team can efficiently execute and manage test runs directly from Jira. Launch manual, automated, or mixed tests, configure environments and assignees, group related runs, and get a clear overview of all test executions with their current statuses. This integration keeps QA, development, and management aligned, providing full visibility into testing workflows without leaving Jira.
14
-
15
- This page explains how to:
16
-
17
- - Launch **Manual**, **Mixed**, or **Automated in CI/CD** runs from Jira issues or linked test plans
18
- - Configure **Advanced Settings** such as environment, assignee (email), RunGroup, CI profiles, and custom parameters
19
- - Track execution progress and view the current status of each run directly in Jira
20
- - Receive **Report Notifications** in Jira for failed test runs, with automatically created issues containing detailed run results and optional public report links
21
-
22
- ## Run Flow
23
-
24
- Testomat.io supports three types of test executions **directly in Jira**:
25
-
26
- - **Manual Run** - execute tests manually
27
- - **Automated Run (CI/CD)** - execute automated tests via connected CI service
28
- - **Mixed Run** - run a combination of manual and automated tests in a single execution
29
-
30
- Choose the type of run that fits your workflow and follow the detailed steps below to execute tests directly in Jira.
31
-
32
- ### How to Launch a Manual Run
33
-
34
- Use Manual Run in Jira to execute tests step-by-step directly from the Jira issue. Ideal for fully manual test cases, exploratory testing, or verifying features not yet automated. You can launch a Manual Run in Jira in three different ways:
35
-
36
- **Option 1** – From the '...' Menu on the **Tests** Tab
37
-
38
- 1. Navigate to the **Tests** tab
39
- 2. Click the '...' (extra menu) button on the **Tests** tab
40
- 3. Select **Schedule Run** from the dropdown list
41
-
42
- ![Schedule Run](./images/att48_401.png)
43
-
44
- 4. In the **'Select tests to run'** dialog, choose the tests you want to include
45
- 5. (Optional) Enable **Run as Checklist** toggle - if enabled, marks tests to be executed as checklist
46
- 6. (Optional) Enable **Run Automated as Manual** toggle - if enabled, allows automated tests to be executed manually
47
-
48
- ![Select tests to run](./images/att49_401.png)
49
-
50
- 7. (Optional) Open the **Advanced settings** to select:
51
-
52
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
53
- - **Assign user** – select the **email of the user added to the project** who is responsible for this run
54
- - **RunGroup** – optional grouping of related runs for easier tracking and reporting
55
- - **Title** - provide a descriptive title for the run
56
-
57
- 8. Click **'Create Run'** to start execution
58
-
59
- ![Create Run button](./images/att50_401.png)
60
-
61
- 9. Mark all tests with specific status (e.g., ✔ passed / ✖ failed / ➖ skipped)
62
- 10. Click the **Finish Run** button
63
-
64
- ![Finish Run](./images/att57_401.png)
65
-
66
- **Option 2** – Using the 'Run' Button on the **Tests** Tab
67
-
68
- 1. Navigate to the **Tests** tab
69
- 2. Click the '✔ Run' button
70
- 3. In the **'Select tests to run'** dialog, choose the tests you want to include
71
- 4. (Optional) Enable **Run as Checklist** toggle - if enabled, marks tests to be executed as checklist
72
- 5. (Optional) Enable **Run Automated as Manual** toggle - if enabled, allows automated tests to be executed manually
73
-
74
- ![Select tests to run](./images/att51_401.png)
75
-
76
- 6. (Optional) Use **Advanced settings** to select:
77
-
78
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
79
- - **Assign user** – select the **email of the user added to the project** who is responsible for this run
80
- - **RunGroup** – optional grouping of related runs for easier tracking and reporting
81
- - **Title** - provide a descriptive title for the run
82
-
83
- 7. Click **'Create Run'** to start execution
84
-
85
- ![Create Run](./images/att52_401.png)
86
-
87
- 8. Mark all tests with specific status (e.g., ✔ passed / ✖ failed / ➖ skipped)
88
- 9. Click the **Finish Run** button
89
-
90
- ![Finish Run](./images/att56_401.png)
91
-
92
- **Option 3** – From the **'Plans'** Tab
93
-
94
- 1. Navigate to the **Plans** tab in the Jira issue
95
- 2. Click the **▶︎ icon** (Launch a plan) next to the linked Plan to quickly start a run
96
- 3. or click the **⚙︎ icon** (Launch with advanced options) to configure **Advanced Settings**
97
-
98
- ![Launch a plan](./images/att53_401.png)
99
-
100
- Once the **Manual Run Settings** window opens (this appears only if you clicked the **⚙︎ icon**):
101
-
102
- 4. (Optional) Enable **Run as Checklist** toggle - if enabled, marks tests to be executed as checklist
103
- 5. (Optional) Enable **Run Automated as Manual** toggle - if enabled, allows automated tests to be executed manually
104
-
105
- :::note
106
-
107
- **Run Automated as Manual** option is disabled if the selected Plan contains only manual tests.
108
-
109
- :::
110
-
111
- 6. Configure **Advanced Settings**
112
-
113
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
114
- - **Assign user** – select the **email of the user added to the project** who is responsible for this run
115
- - **RunGroup** – optional grouping of related runs for easier tracking and reporting
116
- - **Title** - provide a descriptive title for the run
117
-
118
- 7. Click **'Create Run'** to start execution
119
-
120
- ![Launch a manual run bia Plan](./images/att61_401.png)
121
-
122
- 8. Mark all tests with specific status (e.g., ✔ passed / ✖ failed / ➖ skipped)
123
- 9. Click the **Finish Run** button
124
-
125
- ![Finish Run](./images/att56_401.png)
126
-
127
- ### How to Launch an Automated Run (CI/CD)
128
-
129
- Use Automated Run in Jira to trigger tests automatically via a connected CI/CD service without leaving your Jira issue. Ideal for running regression suites, nightly builds, or executing fully automated test cases directly from the Jira interface.
130
-
131
- **Option 1** – From the '...' menu on the **Tests** Tab
132
-
133
- 1. Click the '...' (extra menu) button on the **Tests** tab
134
- 2. Select **Run in CI** from the dropdown list
135
-
136
- ![Run in CI](./images/att58_401.png)
137
-
138
- :::note
139
-
140
- If your CI service is not connected, you will see the message: 'Continuous Integration service is not enabled. Connect a CI service to run automated tests from the Testomat.io Jira Plugin.' To enable CI runs, connect your preferred [CI/CD service](https://docs.testomat.io/integrations/continuous-integration/) in your Testomat.io project settings.
141
-
142
- :::
143
-
144
- 3. Add specific tests to run by selecting one by one or **Select all** option
145
-
146
- ![Select tests to run](./images/att59_401.png)
147
-
148
- 4. (Optional) Open the **Advanced settings** to select:
149
-
150
- - **Title** - provide a title for the run
151
- - **CI profile** – select the CI configuration profile for automated test execution
152
- - **Enter config** – specify custom environment variables (e.g. `ref=main`)
153
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
154
- - **Assign user** - select the **email of the user added to the project** who is responsible for this run
155
- - **RunGroup** - optional grouping of related runs for easier tracking and reporting
156
-
157
- 5. Click **'Create Run'** to start execution
158
-
159
- ![Create Automated Run](./images/att60_401.png)
160
-
161
- **Option 2** – From the **'Plans'** Tab
162
-
163
- 1. Navigate to the **Plans** tab in the Jira issue
164
- 2. Click the **▶︎ icon** (Launch a plan) next to the linked Plan **(recommended)** in CI
165
- 3. or click the **⚙︎ icon** (Launch with advanced options)
166
-
167
- ![Launch a plan](./images/att53_401.png)
168
-
169
- 4. Once the **Run settings** window opens (this appears only if you clicked the **▶︎ icon**), select:
170
-
171
- - **Title** - provide a title for the run
172
- - **CI profile** – select the CI configuration profile for automated test execution
173
- - **Enter config** – specify custom environment variables (e.g. `ref=main`)
174
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
175
- - **Assign user** – select the **email of the user added to the project** who is responsible for this run
176
- - **RunGroup** - optional grouping of related runs for easier tracking and reporting
177
-
178
- 5. Click **'Create Run'** to start execution
179
-
180
- ![Launch Automated Run](./images/att62_401.png)
181
-
182
- 6. Once the automated run is created, it appears in the **Runs** tab with the **Pending** status
183
-
184
- - The test results will update automatically when your CI job completes — showing the final status
185
- - No manual action is required in Jira
186
-
187
- ![CI Run created](./images/att63_401.png)
188
-
189
- ### How to Launch a Mixed Run
190
-
191
- Use Mixed Run in Jira to execute both manual and automated tests in a single run directly from the Jira issue. Ideal when part of the test suite is automated, but some tests still require manual verification. You can launch a Mixed Run in Jira in two different ways:
192
-
193
- **Option 1** – From the '...' Menu on the **Tests** Tab
194
-
195
- 1. Click the '...' (extra menu) button on the **Tests** tab
196
- 2. Select **Mixed Run** from the dropdown list
197
-
198
- ![Mixed Run option](./images/att64_401.png)
199
-
200
- :::note
201
-
202
- If your CI service is not connected, you will see the message: 'Continuous Integration service is not enabled. Connect a CI service to run automated tests from the Testomat.io Jira Plugin.' To enable CI runs, connect your preferred [CI/CD service](https://docs.testomat.io/integrations/continuous-integration/) in your Testomat.io project settings.
203
-
204
- :::
205
-
206
- 3. In the **'Select tests to run'** dialog, choose the tests you want to include
207
-
208
- ![Select mix tests to run](./images/att65_401.png)
209
-
210
- 4. Configure **Advanced Settings**:
211
-
212
- - **Title** - provide a title for the run
213
- - **CI profile** – select the CI configuration profile for automated test execution
214
- - **Enter config** – specify custom environment variables (e.g. `ref=main`)
215
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
216
- - **Assign user** - select the **email of the user added to the project** who is responsible for this run
217
- - **RunGroup** - optional grouping of related runs for easier tracking and reporting
218
-
219
- 5. Click **'Create Run'** to start execution
220
-
221
- ![Create Run](./images/att66_401.png)
222
-
223
- Once the mixed run starts:
224
-
225
- 6. **Automated tests** are sent to your connected **CI service** for execution. Their results will update automatically in Jira once the CI job completes.
226
- 7. **Manual tests** can be executed directly inside Jira — mark each test with its result (e.g., ✔ passed / ✖ failed / ➖ skipped)
227
- 8. Click the **Finish Run** button to close the run
228
-
229
- ![Finish mixed run](./images/att67_401.png)
230
-
231
- **Option 2** – From the **'Plans'** Tab
232
-
233
- 1. Navigate to the **Plans** tab in the Jira issue
234
- 2. Click the **▶︎ icon** (Launch a plan) next to the linked Plan
235
- 3. or click the **⚙︎ icon** (Launch with advanced options)
236
-
237
- ![Launch a plan](./images/att53_401.png)
238
-
239
- 4. Once the **Run settings** window opens (this appears only if you clicked the **▶︎ icon**), select:
240
-
241
- - **Title** - provide a title for the run
242
- - **CI profile** – select the CI configuration profile for automated test execution
243
- - **Enter config** – specify custom environment variables (e.g. `ref=main`)
244
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
245
- - **Assign user** – select the **email of the user added to the project** who is responsible for this run
246
- - **RunGroup** - optional grouping of related runs for easier tracking and reporting
247
-
248
- 5. Click **'Create Run'** to start execution
249
-
250
- ![Launch Automated Run](./images/att62_401.png)
251
-
252
- 6. **Automated tests** are sent to your connected **CI service** for execution. Their results will update automatically in Jira once the CI job completes.
253
- 7. **Manual tests** can be executed directly inside Jira — mark each test with its result (e.g., ✔ passed / ✖ failed / ➖ skipped)
254
- 8. Click the **Finish Run** button to close the run
255
-
256
- ![Finish mixed run](./images/att67_401.png)
257
-
258
- ## Run Reports in Jira
259
-
260
- Once a run is completed, it automatically appears in **Testomat.io** and in the **Runs** tab within Jira. In this tab, you can view all runs that were **launched in Jira** or **linked in Testomat.io project**, and quickly access key information about each run.
261
-
262
- - **External link (URL)** – opens the detailed report in Testomat.io
263
- - **Status icon** – shows the color of the run’s status (Passed / Failed / Skipped)
264
- - **Title** – the title provided for the run
265
- - **Run type** – a badge indicating the type of run (e.g., manual / automated / mixed)
266
- - **Environment** – selected environments for the run (e.g., macOS, Chrome, staging)
267
- - **Execution date** – date the run was completed (or **Not finished**)
268
- - **Test statuses** – number of tests with each status (e.g., ✔ Passed / ✖ Failed / ➖ Skipped)
269
- - **Actions** – **▶︎ icon** appears if the run is not yet completed
270
-
271
- ![Run general information](./images/att68_401.png)
272
-
273
- For full report options (filters, exports, comparisons, etc.), you can **open the Run Reports in Testomat.io**, or to learn more, visit the [Run Reports documentation](https://docs.testomat.io/project/runs/reports/).
274
-
275
- ### Receive Reports in Jira
276
-
277
- You can receive a summary report directly inside Jira by enabling **Report Notifications** in your Testomat.io project settings. This integration automatically posts key information about each test run into your Jira project, including:
278
-
279
- - Run ID and Status
280
- - Project name
281
- - Number of Executed Tests
282
- - Execution Date and Duration
283
- - Failed Tests
284
- - Environment
285
- - Link to Full Report
286
-
287
- This summary allows you to quickly see the key results of each run directly in Jira, while full details remain accessible via the Testomat.io report link.
288
-
289
- ![Report Notifications in Jira](./images/att69_401.png)
290
-
291
- Learn how to set it up in [Report Notifications in Jira.](https://docs.testomat.io/integrations/report-notifications/jira/)
292
-
293
- ## Tests Coverage
294
-
295
- The Tests Coverage screen provides a traceability matrix showing all Jira issues with their linked
296
- tests. For each issue you can see:
297
-
298
- - Title — Jira issue key and name
299
- - Tests — number of linked tests
300
- - Status — current test run status (e.g., Failed, Passed)
301
- - Automation status — percentage of automated tests among linked ones
302
-
303
- This gives the team a quick overview of which requirements are covered, how many tests back each issue, and how far automation has progressed per story.
304
-
305
- To open the Tests Coverage screen:
306
-
307
- 1. Open the specific space
308
- 2. Click the 'More' option
309
- 3. Select the 'Tests Coverage' tab
310
-
311
- ![Tests Coverage tab](./images/att1_575.png)
312
-
313
- The automation percentage reflects how many of the linked tests are automated — from 0% (all manual) to 100% (fully automated). Issues with no linked tests signal coverage gaps that need attention.
314
-
315
- ![Tests Coverage screen](./images/att2_575.png)
316
-
317
- ## Sprint Coverage
318
-
319
- The Sprint Coverage tab gives a high-level summary of test execution health across a sprint. Use it to understand how well a sprint is covered with tests and how the execution is progressing — without leaving Jira.
320
-
321
- For each sprint it shows:
322
-
323
- - Issues with tests / Issues without tests — how many sprint issues have linked tests and how many are left uncovered
324
- - Manual tests / Automated tests — breakdown of test types across the sprint
325
- - Passed / Failed / Skipped / Pending / Not executed — full execution status breakdown
326
-
327
- This makes it easy to spot coverage gaps, track automation progress, and assess sprint readiness at a glance.
328
-
329
- To check test coverage for a sprint:
330
-
331
- 1. Open the specific space
332
- 2. Click the 'More' option
333
- 3. Select the 'Sprints Coverage' tab
334
-
335
- ![Sprint Coverage](./images/att3_575.png)
336
-
337
- 4. Enter the sprint ID(s)
338
- 5. Click the 'Submit' button
339
-
340
- ![Search sprint ID(s)](./images/att4_575.png)
341
-
342
- :::note
343
-
344
- To find your sprint ID, visit the [Jira Software sprint ID guide](https://support.atlassian.com/jira/kb/jira-software-how-to-identify-the-id-of-a-sprint/).
345
-
346
- :::
347
-
348
- ## Data Sync in Jira
349
-
350
- Testomat.io and Jira are continuously synchronized to ensure test data stays up to date across both systems. This **two-way sync** keeps all team members — QA, development, management, and stakeholders — aligned.
351
-
352
- **Automatic Sync**
353
-
354
- All key updates are automatically synchronized:
355
-
356
- - Linked test cases, test suites, and plans remain aligned in both systems
357
- - Statuses of linked Jira issues are synchronized
358
- - Executing a run in Testomat.io updates the corresponding Jira issue with the latest run status
359
- - Launching or updating a run from Jira instantly reflects in Testomat.io
360
- - Testomat.io settings — including environments, branches, users, run groups, and CI integrations — are synchronized and visible in Jira
361
-
362
- This real-time, two-way sync ensures that everyone sees the same up-to-date information, eliminating confusion and reducing manual updates.
363
-
364
- **Manual Sync**
365
-
366
- If your Jira issue view or run list does not show the latest data, you can trigger synchronization manually. This ensures that all test results, linked issues, and run information are up-to-date in both Jira and Testomat.io.
367
-
368
- To manually refresh data:
369
-
370
- 1. Open the **Tests** tab in the Jira issue
371
- 2. Click the '⋯' (extra menu) button
372
- 3. Select **Sync** from the dropdown list
373
-
374
- ![Sync button](./images/att55_401.png)
375
-
376
- Testomat.io will re-fetch the latest information and update linked test results, statuses, and settings inside Jira. This keeps your Jira and Testomat.io data fully consistent — whether you rely on automatic background sync or perform a quick manual refresh when needed.
377
-