testeiya 0.2.1 → 0.3.9

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (414) hide show
  1. package/LICENSE +21 -0
  2. package/README.md +41 -213
  3. package/dist/prompt/context.js +79 -0
  4. package/dist/prompt/context.js.map +1 -0
  5. package/dist/prompt/index.js +56 -0
  6. package/dist/prompt/index.js.map +1 -0
  7. package/dist/prompt/print.js +22 -0
  8. package/dist/prompt/print.js.map +1 -0
  9. package/dist/prompt/project-info.js +2 -0
  10. package/dist/prompt/project-info.js.map +1 -0
  11. package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +24 -21
  12. package/dist/prompt/system-prompt.js.map +1 -0
  13. package/dist/prompt/testomatio.js +264 -0
  14. package/dist/prompt/testomatio.js.map +1 -0
  15. package/dist/prompt/tools.js +49 -0
  16. package/dist/prompt/tools.js.map +1 -0
  17. package/dist/prompt/vocab.js +8 -0
  18. package/dist/prompt/vocab.js.map +1 -0
  19. package/dist/src/args.js +72 -0
  20. package/dist/src/args.js.map +1 -0
  21. package/dist/src/cli.js +61 -0
  22. package/dist/src/cli.js.map +1 -0
  23. package/dist/src/env.js +69 -0
  24. package/dist/src/env.js.map +1 -0
  25. package/dist/src/mcp-extension.js +9 -0
  26. package/dist/src/mcp-extension.js.map +1 -0
  27. package/dist/src/mcp.js +139 -0
  28. package/dist/src/mcp.js.map +1 -0
  29. package/dist/src/model.js +66 -0
  30. package/dist/src/model.js.map +1 -0
  31. package/dist/src/result.js +41 -0
  32. package/dist/src/result.js.map +1 -0
  33. package/dist/src/run.js +199 -0
  34. package/dist/src/run.js.map +1 -0
  35. package/dist/src/session.js +77 -0
  36. package/dist/src/session.js.map +1 -0
  37. package/dist/vendor/mcp.js +14801 -0
  38. package/mcp-tools.json +2967 -0
  39. package/package.json +29 -42
  40. package/prompt/context.ts +101 -0
  41. package/prompt/index.ts +93 -0
  42. package/prompt/print.ts +23 -0
  43. package/prompt/project-info.ts +30 -0
  44. package/prompt/system-prompt.ts +173 -0
  45. package/{src/prompt → prompt}/testomatio.ts +119 -8
  46. package/{src/prompt → prompt}/tools.ts +30 -8
  47. package/prompt/vocab.ts +7 -0
  48. package/{skills.lock.json → skills/skills.lock.json} +11 -7
  49. package/skills/skills.yaml +34 -0
  50. package/assets/testeiya-logo-dark.svg +0 -16
  51. package/assets/testeiya-logo.svg +0 -15
  52. package/models.catalog.json +0 -6963
  53. package/skills/codeceptjs/ci-fix-tests/SKILL.md +0 -120
  54. package/skills/codeceptjs/codeceptjs-auth/SKILL.md +0 -158
  55. package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +0 -91
  56. package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +0 -158
  57. package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +0 -90
  58. package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +0 -234
  59. package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +0 -110
  60. package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +0 -306
  61. package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +0 -352
  62. package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +0 -472
  63. package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +0 -350
  64. package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +0 -81
  65. package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +0 -206
  66. package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
  67. package/skills/playwright-best-practices-skill/README.md +0 -147
  68. package/skills/playwright-best-practices-skill/SKILL.md +0 -303
  69. package/skills/playwright-best-practices-skill/advanced/authentication-flows.md +0 -360
  70. package/skills/playwright-best-practices-skill/advanced/authentication.md +0 -871
  71. package/skills/playwright-best-practices-skill/advanced/clock-mocking.md +0 -364
  72. package/skills/playwright-best-practices-skill/advanced/mobile-testing.md +0 -409
  73. package/skills/playwright-best-practices-skill/advanced/multi-context.md +0 -288
  74. package/skills/playwright-best-practices-skill/advanced/multi-user.md +0 -393
  75. package/skills/playwright-best-practices-skill/advanced/network-advanced.md +0 -452
  76. package/skills/playwright-best-practices-skill/advanced/third-party.md +0 -464
  77. package/skills/playwright-best-practices-skill/architecture/pom-vs-fixtures.md +0 -363
  78. package/skills/playwright-best-practices-skill/architecture/test-architecture.md +0 -369
  79. package/skills/playwright-best-practices-skill/architecture/when-to-mock.md +0 -383
  80. package/skills/playwright-best-practices-skill/browser-apis/browser-apis.md +0 -391
  81. package/skills/playwright-best-practices-skill/browser-apis/iframes.md +0 -403
  82. package/skills/playwright-best-practices-skill/browser-apis/service-workers.md +0 -504
  83. package/skills/playwright-best-practices-skill/browser-apis/websockets.md +0 -403
  84. package/skills/playwright-best-practices-skill/core/annotations.md +0 -424
  85. package/skills/playwright-best-practices-skill/core/assertions-waiting.md +0 -361
  86. package/skills/playwright-best-practices-skill/core/configuration.md +0 -452
  87. package/skills/playwright-best-practices-skill/core/fixtures-hooks.md +0 -417
  88. package/skills/playwright-best-practices-skill/core/global-setup.md +0 -434
  89. package/skills/playwright-best-practices-skill/core/locators.md +0 -242
  90. package/skills/playwright-best-practices-skill/core/page-object-model.md +0 -315
  91. package/skills/playwright-best-practices-skill/core/projects-dependencies.md +0 -453
  92. package/skills/playwright-best-practices-skill/core/test-data.md +0 -492
  93. package/skills/playwright-best-practices-skill/core/test-suite-structure.md +0 -361
  94. package/skills/playwright-best-practices-skill/core/test-tags.md +0 -298
  95. package/skills/playwright-best-practices-skill/debugging/console-errors.md +0 -420
  96. package/skills/playwright-best-practices-skill/debugging/debugging.md +0 -504
  97. package/skills/playwright-best-practices-skill/debugging/error-testing.md +0 -360
  98. package/skills/playwright-best-practices-skill/debugging/flaky-tests.md +0 -496
  99. package/skills/playwright-best-practices-skill/frameworks/angular.md +0 -530
  100. package/skills/playwright-best-practices-skill/frameworks/nextjs.md +0 -469
  101. package/skills/playwright-best-practices-skill/frameworks/react.md +0 -531
  102. package/skills/playwright-best-practices-skill/frameworks/vue.md +0 -574
  103. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/ci-cd.md +0 -468
  104. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/docker.md +0 -283
  105. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/github-actions.md +0 -546
  106. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/gitlab.md +0 -397
  107. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/other-providers.md +0 -521
  108. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/parallel-sharding.md +0 -371
  109. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/performance.md +0 -453
  110. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/reporting.md +0 -424
  111. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/test-coverage.md +0 -497
  112. package/skills/playwright-best-practices-skill/testing-patterns/accessibility.md +0 -359
  113. package/skills/playwright-best-practices-skill/testing-patterns/api-testing.md +0 -719
  114. package/skills/playwright-best-practices-skill/testing-patterns/browser-extensions.md +0 -506
  115. package/skills/playwright-best-practices-skill/testing-patterns/canvas-webgl.md +0 -493
  116. package/skills/playwright-best-practices-skill/testing-patterns/component-testing.md +0 -500
  117. package/skills/playwright-best-practices-skill/testing-patterns/drag-drop.md +0 -576
  118. package/skills/playwright-best-practices-skill/testing-patterns/electron.md +0 -509
  119. package/skills/playwright-best-practices-skill/testing-patterns/file-operations.md +0 -377
  120. package/skills/playwright-best-practices-skill/testing-patterns/file-upload-download.md +0 -562
  121. package/skills/playwright-best-practices-skill/testing-patterns/forms-validation.md +0 -561
  122. package/skills/playwright-best-practices-skill/testing-patterns/graphql-testing.md +0 -331
  123. package/skills/playwright-best-practices-skill/testing-patterns/i18n.md +0 -508
  124. package/skills/playwright-best-practices-skill/testing-patterns/performance-testing.md +0 -476
  125. package/skills/playwright-best-practices-skill/testing-patterns/security-testing.md +0 -430
  126. package/skills/playwright-best-practices-skill/testing-patterns/visual-regression.md +0 -634
  127. package/skills/playwright-cli/SKILL.md +0 -420
  128. package/skills/playwright-cli/references/element-attributes.md +0 -23
  129. package/skills/playwright-cli/references/playwright-tests.md +0 -39
  130. package/skills/playwright-cli/references/request-mocking.md +0 -87
  131. package/skills/playwright-cli/references/running-code.md +0 -241
  132. package/skills/playwright-cli/references/session-management.md +0 -225
  133. package/skills/playwright-cli/references/storage-state.md +0 -275
  134. package/skills/playwright-cli/references/test-generation.md +0 -433
  135. package/skills/playwright-cli/references/tracing.md +0 -139
  136. package/skills/playwright-cli/references/video-recording.md +0 -143
  137. package/skills/testeiya/README.md +0 -29
  138. package/skills/testeiya/answer-formatting/SKILL.md +0 -30
  139. package/skills/testeiya/check-cucumber/SKILL.md +0 -200
  140. package/skills/testeiya/check-tests/SKILL.md +0 -260
  141. package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
  142. package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
  143. package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
  144. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
  145. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
  146. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
  147. package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
  148. package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
  149. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
  150. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
  151. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
  152. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
  153. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
  154. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
  155. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
  156. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
  157. package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
  158. package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
  159. package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
  160. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
  161. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
  162. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
  163. package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
  164. package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
  165. package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
  166. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
  167. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
  168. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
  169. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
  170. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
  171. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
  172. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
  173. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
  174. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
  175. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
  176. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
  177. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
  178. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
  179. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
  180. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
  181. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
  182. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
  183. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
  184. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
  185. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
  186. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
  187. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
  188. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
  189. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
  190. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
  191. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
  192. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
  193. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
  194. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
  195. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
  196. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
  197. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
  198. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
  199. package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
  200. package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
  201. package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
  202. package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
  203. package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
  204. package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
  205. package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
  206. package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
  207. package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
  208. package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
  209. package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
  210. package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
  211. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
  212. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
  213. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
  214. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
  215. package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
  216. package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
  217. package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
  218. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
  219. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
  220. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
  221. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
  222. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
  223. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
  224. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
  225. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
  226. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
  227. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
  228. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
  229. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
  230. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
  231. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
  232. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
  233. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
  234. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
  235. package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
  236. package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
  237. package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
  238. package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
  239. package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
  240. package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
  241. package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
  242. package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
  243. package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
  244. package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
  245. package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
  246. package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
  247. package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
  248. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
  249. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
  250. package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
  251. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
  252. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
  253. package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
  254. package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
  255. package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
  256. package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
  257. package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
  258. package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
  259. package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
  260. package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
  261. package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
  262. package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
  263. package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
  264. package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
  265. package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
  266. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
  267. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
  268. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
  269. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
  270. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
  271. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
  272. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
  273. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
  274. package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
  275. package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
  276. package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
  277. package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
  278. package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
  279. package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
  280. package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
  281. package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
  282. package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
  283. package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
  284. package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
  285. package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
  286. package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +0 -88
  287. package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +0 -95
  288. package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +0 -334
  289. package/skills/testomatio/test-automation/automate-manual-test-cases/CLAUDE.md +0 -56
  290. package/skills/testomatio/test-automation/automate-manual-test-cases/SKILL.md +0 -242
  291. package/skills/testomatio/test-automation/automate-manual-test-cases/references/CODECEPTJS_BEST_PRACTICES.md +0 -182
  292. package/skills/testomatio/test-automation/automate-manual-test-cases/references/FINAL_SUMMARY_TEMPLATE.md +0 -22
  293. package/skills/testomatio/test-automation/automate-manual-test-cases/references/PLAYWRIGHT_BEST_PRACTICES.md +0 -90
  294. package/skills/testomatio/test-automation/automate-manual-test-cases/references/POM_BEST_PRACTICES.md +0 -53
  295. package/skills/testomatio/test-automation/automate-manual-test-cases/references/TEST_DATA_MANAGEMENT.md +0 -52
  296. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/SKILL.md +0 -107
  297. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/references/DEBUGGING_QUICK_REFERENCE.md +0 -113
  298. package/skills/testomatio/test-automation/qa-automation-test-consolidation/SKILL.md +0 -29
  299. package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +0 -151
  300. package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
  301. package/skills/testomatio/test-automation/testomat-allure-adapter/SKILL.md +0 -289
  302. package/skills/testomatio/test-management/detect-duplicate-test-cases/SKILL.md +0 -86
  303. package/skills/testomatio/test-management/detect-duplicate-test-cases/references/DUPLICATE_INSTRUCTIONS.md +0 -54
  304. package/skills/testomatio/test-management/improve-test-cases/SKILL.md +0 -114
  305. package/skills/testomatio/test-management/improve-test-cases/references/TESTOMAT_MARKDOWN_EXAMPLE.md +0 -66
  306. package/skills/testomatio/test-management/pull-request-diff-analyzer/SKILL.md +0 -141
  307. package/skills/testomatio/test-management/qa-e2e-tests-reporting/SKILL.md +0 -354
  308. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_ARTIFACTS.md +0 -82
  309. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_HTML_REPORT.md +0 -37
  310. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_REPORTERS_CONFIG.md +0 -118
  311. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/SKILL.md +0 -149
  312. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/references/summary-example.md +0 -54
  313. package/skills/testomatio/test-management/qa-requirement-reviewer/SKILL.md +0 -126
  314. package/skills/testomatio/test-management/qa-requirement-reviewer/references/requirements_reviewer_examples.md +0 -128
  315. package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +0 -174
  316. package/skills/testomatio/test-management/qa-test-code-coverage/references/COVERAGE_FILE_FORMAT.md +0 -138
  317. package/skills/testomatio/test-management/qa-test-code-coverage/references/E2E_FRAMEWORKS.md +0 -65
  318. package/skills/testomatio/test-management/qa-test-code-coverage/scripts/check-coverage.mjs +0 -40
  319. package/skills/testomatio/test-management/qa-thinking/SKILL.md +0 -36
  320. package/skills/testomatio/test-management/qa-write-test-cases/SKILL.md +0 -267
  321. package/skills/testomatio/test-management/qa-write-test-cases/references/test-case-format.md +0 -387
  322. package/skills/testomatio/test-management/qa-write-test-cases/references/testomat-tms-guide.md +0 -72
  323. package/skills/testomatio/test-management/qa-write-test-cases/references/writing-rule.md +0 -159
  324. package/skills/testomatio/test-management/scan-automation-project/SKILL.md +0 -152
  325. package/skills/testomatio/test-management/sync-test-cases-with-tms/SKILL.md +0 -107
  326. package/skills/testomatio/test-management/sync-test-cases-with-tms/references/TESTOMATIO_CLI.md +0 -140
  327. package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +0 -182
  328. package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +0 -169
  329. package/skills.yaml +0 -21
  330. package/src/ai-debug.ts +0 -188
  331. package/src/api/agent-get.ts +0 -22
  332. package/src/api/agent-start.ts +0 -384
  333. package/src/api/client-log.ts +0 -29
  334. package/src/api/context.ts +0 -332
  335. package/src/api/debug-layout.ts +0 -47
  336. package/src/api/debug-report.ts +0 -29
  337. package/src/api/debug-snapshot.ts +0 -30
  338. package/src/api/debug-stream.ts +0 -52
  339. package/src/api/files-delete.ts +0 -184
  340. package/src/api/files-read.ts +0 -41
  341. package/src/api/files-rename.ts +0 -99
  342. package/src/api/files-tree.ts +0 -292
  343. package/src/api/files-write.ts +0 -41
  344. package/src/api/mcp.ts +0 -603
  345. package/src/api/memory.ts +0 -69
  346. package/src/api/open-external.ts +0 -39
  347. package/src/api/playwright-cli.ts +0 -606
  348. package/src/api/providers.ts +0 -457
  349. package/src/api/read-env-token.ts +0 -33
  350. package/src/api/sessions.ts +0 -79
  351. package/src/api/settings.ts +0 -120
  352. package/src/api/skills.ts +0 -58
  353. package/src/api/testomatio-attachment.ts +0 -89
  354. package/src/api/testomatio-auth.ts +0 -284
  355. package/src/api/testomatio-proxy.ts +0 -197
  356. package/src/api/testomatio-run-stats.ts +0 -81
  357. package/src/api/testomatio-target.ts +0 -225
  358. package/src/api/testomatio-transcription.ts +0 -82
  359. package/src/api/workspace-search.ts +0 -96
  360. package/src/api/workspace-sync.ts +0 -151
  361. package/src/api/workspace.ts +0 -165
  362. package/src/app-server.ts +0 -556
  363. package/src/bridge.ts +0 -251
  364. package/src/check-tests.ts +0 -156
  365. package/src/cli.ts +0 -17
  366. package/src/commands.ts +0 -244
  367. package/src/config.ts +0 -183
  368. package/src/connection.ts +0 -658
  369. package/src/context-store.ts +0 -265
  370. package/src/debug-bus.ts +0 -405
  371. package/src/extensions/tool-gate.ts +0 -220
  372. package/src/extensions/webui/ask-channel.ts +0 -52
  373. package/src/extensions/webui/index.ts +0 -184
  374. package/src/extensions/webui/tools/ask-question.ts +0 -88
  375. package/src/extensions/webui/tools/query-result.ts +0 -79
  376. package/src/extensions/webui/tools/render-chart.ts +0 -53
  377. package/src/extensions/webui/tools/render-item.ts +0 -61
  378. package/src/extensions/webui/tools/render-list.ts +0 -170
  379. package/src/extensions/webui/tools/render-result.ts +0 -85
  380. package/src/extensions/webui/tools/render-tree.ts +0 -71
  381. package/src/extensions/webui/tools/ui-widget.ts +0 -54
  382. package/src/extensions/webui/tools/widget-result.ts +0 -13
  383. package/src/extensions/webui/widget-channel.ts +0 -50
  384. package/src/file-log.ts +0 -196
  385. package/src/git-tracked.ts +0 -68
  386. package/src/gitignore.ts +0 -53
  387. package/src/json-store.ts +0 -43
  388. package/src/load-env.ts +0 -70
  389. package/src/loader-style.ts +0 -96
  390. package/src/main.ts +0 -140
  391. package/src/mcp-catalog.ts +0 -96
  392. package/src/models-catalog.ts +0 -72
  393. package/src/permissions.ts +0 -120
  394. package/src/project-dir.ts +0 -189
  395. package/src/project-info.ts +0 -108
  396. package/src/prompt/app-ui.ts +0 -59
  397. package/src/prompt/browser.ts +0 -27
  398. package/src/prompt/index.ts +0 -62
  399. package/src/server-info.ts +0 -62
  400. package/src/session-factory.ts +0 -442
  401. package/src/session-store.ts +0 -115
  402. package/src/shell-env.ts +0 -45
  403. package/src/skills.ts +0 -163
  404. package/src/sync-snapshot.ts +0 -140
  405. package/src/telemetry.ts +0 -239
  406. package/src/testomatio-auth.ts +0 -299
  407. package/src/testomatio.ts +0 -98
  408. package/src/theme.ts +0 -30
  409. package/src/user-env.ts +0 -94
  410. package/src/welcome.ts +0 -194
  411. package/src/workspace/safe-path.ts +0 -85
  412. package/src/workspace/test-md.ts +0 -70
  413. package/src/workspace-model.ts +0 -440
  414. package/testeiya.config.json +0 -14
@@ -1,98 +0,0 @@
1
- ---
2
- title: Jira Plugin
3
- description: Learn how to integrate Testomat.io with Jira using the Jira plugin. This guide covers connecting projects, linking/unlinking tests, suites, and plans to Jira issues, running manual or automated tests, managing BDD feature files, attaching test reports, using AI prompts to improve test descriptions, and leveraging the traceability matrix for comprehensive coverage in sprints.
4
- type: article
5
- url: https://docs.testomat.io/advanced/jira-plugin
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Jira plugin, Testomat.io, test management, test coverage, BDD, feature files, automated tests, manual tests, Jira integration, traceability matrix, test reporting, AI test descriptions, SSO login
11
- ---
12
-
13
- import DirectoryLinks from "/src/components/DirectoryLinks.astro";
14
-
15
- <DirectoryLinks directory="advanced/jira-plugin" />
16
-
17
- The Testomat.io Jira Plugin enhances your Jira experience by enabling you to manage tests directly inside Jira. With this plugin you can:
18
-
19
- - Connect multiple Testomat.io and JIRA projects easily
20
- - Quickly link/unlink tests, suites, and plans to JIRA issues
21
- - View and edit tests directly in JIRA
22
- - Use autocomplete and smart suggestions for creating tests
23
- - Easily modify BDD/Gherkin feature files and scenarios
24
- - Create multiple tests at once from checklists from bulk create
25
- - Run manual and automated tests from JIRA tickets
26
- - Attach test reports to JIRA issues with a click
27
- - Use tracebility matrix and reports to check test coverage in sprints and project
28
- - Manage project branches
29
- - Use AI prompts to generate or improve test descriptions directly in Jira
30
-
31
- :::note
32
-
33
- Jira Plugin requires an active Jira integration in your Testomat.io project. If Jira is not connected yet, please follow [How to Connect Jira Project](https://docs.testomat.io/integrations/issues-management/jira/#connecting-to-jira-project).
34
-
35
- ![No linked connection with Jira](./images/att6_401.png)
36
-
37
- :::
38
-
39
- ## How to Use Jira Plugin Without Logging in
40
-
41
- When you open a Jira issue with linked Testomat.io items **without logging in**, the visibility depends on the type of **Jira connection** used. For full details on connection types and their permissions, see [Jira connection type](https://docs.testomat.io/integrations/issues-management/jira/#jira-connection-types).
42
-
43
- ![Jira connection type](./images/att75_401.png)
44
-
45
- **Connected with an administrator's account**
46
-
47
- You can still:
48
-
49
- - View **tests and suites** linked to the issue
50
-
51
- ![list of tests and suites](./images/gif1_401.gif)
52
-
53
- - Browse the **Tests Coverage** screen
54
-
55
- ![Test Coverage](./images/att7_401.png)
56
-
57
- **Connected with a regular account**
58
-
59
- - only authorized Testomat.io users will be able to see tests and run results in Jira
60
-
61
- ## How to Log in to Testomat.io from Jira
62
-
63
- -To access all Jira Plugin features, you need to log in to Testomat.io. You can log in directly from:
64
-
65
- - a Jira issue
66
-
67
- ![Log In from Jira Plugin](./images/att9_401.png)
68
-
69
- - or you can do this from Apps
70
-
71
- ![Log In from app](./images/att8_401.png)
72
-
73
- ### Login Options
74
-
75
- You can authorize using any of the following methods:
76
-
77
- - **Email + Password** — enter your Testomat.io credentials and click **Submit**
78
- - **Authorize with GitHub** — sign in with your GitHub account
79
- - **Authorize with Google** — sign in with your Google account
80
- - **Authorize with SSO** — use your company’s Single Sign-On provider
81
-
82
- ### What you can do after logging in
83
-
84
- Once logged in, you can:
85
-
86
- - view linked tests and suites
87
- - edit them directly in Jira
88
- - unlink items when needed
89
- - use AI prompts to enhance test descriptions:
90
- - Suggest Description – generate a clear and concise description for a test based on its title and similar tests
91
- - Improve Description – refine the existing description to make it clearer
92
- - Suggest Better Description – provide an alternative improved description
93
-
94
- ![Avaliable options](./images/att10_401.png)
95
-
96
- ## JIRA Plugin Permissions and Security
97
-
98
- Testomat.io’s JIRA plugin is designed to integrate seamlessly with your JIRA projects, requiring specific permissions to operate effectively. The plugin has **read access** to all issues of an enabled project to display tests that can be attached to any JIRA issue and can **write properties** to save test data into JIRA storage attached to a specific issue. Importantly, Testomat.io **does not perform any update or delete operations** on your JIRA issues, maintaining the integrity of your project data. The plugin accesses several JIRA API endpoints strictly necessary for its functionality, adhering to high standards of data security and integrity. For detailed information on permissions and security, refer to the [JIRA Permissions](https://docs.testomat.io/legal/security/jira) section in our documentation.
@@ -1,151 +0,0 @@
1
- ---
2
- title: Creating Jira Issue
3
- description: Learn how to integrate Testomat.io with Jira using the Jira plugin. This guide covers connecting Testomat.io projects to Jira, linking/unlinking tests, suites, and test plans to Jira issues, and running manual or automated tests directly from Jira. Manage BDD feature files, attach test reports, and utilize the traceability matrix for comprehensive test coverage in sprints.
4
- type: article
5
- url: https://docs.testomat.io/advanced/jira-plugin/jira-issue
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: og:image
10
- content: https://docs.testomat.io/_astro/New_8rxMYOhd_2024-10-19.BaU2EWny_Z1oTGPz.webp
11
- - tag: meta
12
- attrs:
13
- name: keywords
14
- content: Jira plugin, Testomat.io, test management, test coverage, BDD, feature files, automated tests, manual tests, Jira integration, traceability matrix, test reporting
15
- ---
16
-
17
- **Jira integration in Testomat.io** helps QA teams quickly turn test results into actionable bug reports. This feature eliminates the manual effort of copying failed test data into Jira and ensures full traceability between test execution and defect tracking.
18
-
19
- With a few clicks, you can:
20
-
21
- - **Create a Jira issue** directly from a failed test or run
22
- - **Link existing Jira issues** to tests or suites
23
- - **Attach contextual details** (test steps, results, environment, and run links) automatically
24
-
25
- This integration was designed to improve collaboration between **QA, development, and management teams**, speeding up feedback loops and ensuring visibility across all project stakeholders.
26
-
27
- ## How to Create a Jira Issue for a Failed Test
28
-
29
- To create a JIRA issue for a Failed Test, open a Run with a failed test. Find a test in list, move the cursor over it and click on the **Link to Issue** icon:
30
-
31
- ![Testomatio.io - Creating JIRA Issue for Failed Test](./images/New_7T8nObH5_2024-10-19.png)
32
-
33
- You can link it to an existing issue **(1)** or create a new one **(2)**.
34
-
35
- Once you have decided to create an issue in your Jira project, you can select its ticket types **(3)**.
36
-
37
- ![Testomatio.io - Link Failed Test to existing issue or create a new one](./images/New_Y2SJbV9K_2024-10-19.png)
38
-
39
- You can even create an issue as a subtask by **specifying a Parent ticket**:
40
-
41
- ![Testomatio.io - Creating JIRA Issue as Subtask](./images/New_8rxMYOhd_2024-10-19.png)
42
-
43
- - Once created, the linked issue appears under the test run, indicated by the **issue icon**
44
- - Hovering over the icon shows the **issue title** and **current status**
45
- - Clicking the icon redirects to the issue in Jira
46
- - This icon remains visible both during test execution
47
-
48
- ![Jira Issue in Ongoing run](./images/att4_462.png)
49
-
50
- - and after the run is completed, making it easy to track related issues at a glance
51
-
52
- ![Completed Run](./images/att5_462.png)
53
-
54
- The generated ticket will contain the specified information, as well as information about the test run and a web link to the test run report:
55
-
56
- ![Testomatio.io - Created ticket in Jira](./images/New_8ENxIFXB_2024-10-19.png)
57
-
58
- ## How to Create a Jira Issue for a Failed Run
59
-
60
- To create a JIRA issue for a Failed Manual or Automated Run, open the run and select the **Link to Issue** option from the dots menu:
61
-
62
- ![Testomatio.io - Creating JIRA Issue for Failed Run](./images/New_cLq5eNs9_2024-10-19.png)
63
-
64
- Create a new issue for a run or append to an existing issue.
65
-
66
- ![Testomatio.io - Link Failed Run to existing issue or create a new one](./images/New_tYJ8Bm2P_2024-10-19.png)
67
-
68
- - Once created, the linked issue appears **under the completed run**, indicated by the **issue icon** in the run’s sidebar
69
- - Hovering over the icon displays the **issue title** and **current status**
70
- - Clicking the icon redirects directly to the issue in the Jira project
71
-
72
- ![Linked Jira to Run](./images/att6_462.png)
73
-
74
- ## How to Link a Test to a Jira Issue
75
-
76
- You can easily connect any individual **test** in Testomat.io to an existing or new Jira issue. This allows quick traceability between your test cases and related Jira tickets.
77
-
78
- 1. Navigate to the **Tests** page in your Testomat.io project
79
- 2. Open the test you want to link
80
- 3. Click the **extra menu (⋯)** button in the top-right corner
81
- 4. Select **Link to Issue**
82
-
83
- ![Link to Issue](./images/att41_401.png)
84
-
85
- Once the **Link to Issue** modal window appears:
86
-
87
- 5. To **link to an existing Jira issue**, paste or enter the issue key and click **Link Issue**
88
- 6. To **create a new Jira issue**, click **Create new issue**
89
-
90
- ![create or link a Jira issue](./images/att42_401.png)
91
-
92
- 7. Select your **Jira profile** (see details: [Connecting Jira Integration](https://docs.testomat.io/integrations/issues-management/jira/)).
93
- 8. Choose the **Issue Type** from the dropdown (e.g., Bug, Task, Sub-task)
94
- 9. Add a **Title**
95
- 10. Optionally, include a **Description** to provide test context
96
- 11. Fill in any **Jira fields** available in your configuration.
97
-
98
- Testomat.io automatically displays all supported fields — such as **Parent**, **Components**, **Fix versions**, **Priority**, **Labels**, or other custom fields defined in your Jira project.
99
-
100
- These may appear immediately or after clicking **Show Optional Fields**, depending on your project setup.
101
-
102
- :::note
103
-
104
- The available fields depend on your Jira project configuration. To see all supported field types in Testomat.io, refer to [Supported Jira Field Types](https://docs.testomat.io/integrations/issues-management/jira/#supported-jira-field-types).
105
-
106
- :::
107
-
108
- 12. Once all required information is filled in, click **Create Jira Issue** to finish linking.
109
-
110
- ![Save new Jira Issue](./images/att43_401.png)
111
-
112
- The linked issue appears under the test, indicated by the **issue icon**, which redirects to the issue in the Jira project. In addition, Testomat.io also displays the linked Jira issue’s **title** and **status**, making it easier to recognize the issue at a glance.
113
-
114
- ![Linked Jira issue showing title and status](./images/att1_462.png)
115
-
116
- :::note
117
-
118
- You can link a test to multiple issues. In this case their IDs will be displayed in test view in Testomatio.
119
-
120
- :::
121
-
122
- ![Multiple Jira issues](./images/att2_462.png)
123
-
124
- ## How to Link a Suite to a Jira Issue
125
-
126
- Linking a suite to a Jira issue works similarly to linking an individual test, with one key difference: **all tests within the suite will automatically be linked to the Jira issue.**
127
-
128
- :::note
129
-
130
- Linking is available only at the **suite level**. You cannot link a Jira issue to a folder, and the **Link to Issue** button does not appear on folder level.
131
-
132
- :::
133
-
134
- 1. Navigate to the **Tests** page in your Testomat.io project
135
- 2. Open the suite you want to link
136
- 3. Click the **extra menu (⋯)** button in the top-right corner
137
- 4. Select **Link to Issue**
138
-
139
- ![Link Jira Issue to Suite](./images/att45_401.png)
140
-
141
- Follow the same steps above as linking a single test: link an existing issue or create a new one, select issue type, fill required fields, and click Create Jira Issue.
142
-
143
- When a suite is linked, both the suite and all its tests will display the linked Jira issue icon along with its title and status, providing immediate context.
144
-
145
- ![Suite Jira Issue](./images/att8_462.png)
146
-
147
- :::note
148
-
149
- If you unlink a suite from a Jira issue, all its linked tests will be unlinked automatically.
150
-
151
- :::
@@ -1,377 +0,0 @@
1
- ---
2
- title: Runs & Reports in Jira
3
- description: Learn how to run manual, automated, or mixed test executions in Jira using the Testomat.io plugin. This guide covers configuring advanced settings, executing test runs.
4
- type: article
5
- url: https://docs.testomat.io/advanced/jira-plugin/runs-and-reports
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Jira plugin, Testomat.io, test runs, test plan, test execution, manual run, mixed run, automated run, CI/CD, test reports, test analytics
11
- ---
12
-
13
- With the **Testomat.io plugin in Jira**, your team can efficiently execute and manage test runs directly from Jira. Launch manual, automated, or mixed tests, configure environments and assignees, group related runs, and get a clear overview of all test executions with their current statuses. This integration keeps QA, development, and management aligned, providing full visibility into testing workflows without leaving Jira.
14
-
15
- This page explains how to:
16
-
17
- - Launch **Manual**, **Mixed**, or **Automated in CI/CD** runs from Jira issues or linked test plans
18
- - Configure **Advanced Settings** such as environment, assignee (email), RunGroup, CI profiles, and custom parameters
19
- - Track execution progress and view the current status of each run directly in Jira
20
- - Receive **Report Notifications** in Jira for failed test runs, with automatically created issues containing detailed run results and optional public report links
21
-
22
- ## Run Flow
23
-
24
- Testomat.io supports three types of test executions **directly in Jira**:
25
-
26
- - **Manual Run** - execute tests manually
27
- - **Automated Run (CI/CD)** - execute automated tests via connected CI service
28
- - **Mixed Run** - run a combination of manual and automated tests in a single execution
29
-
30
- Choose the type of run that fits your workflow and follow the detailed steps below to execute tests directly in Jira.
31
-
32
- ### How to Launch a Manual Run
33
-
34
- Use Manual Run in Jira to execute tests step-by-step directly from the Jira issue. Ideal for fully manual test cases, exploratory testing, or verifying features not yet automated. You can launch a Manual Run in Jira in three different ways:
35
-
36
- **Option 1** – From the '...' Menu on the **Tests** Tab
37
-
38
- 1. Navigate to the **Tests** tab
39
- 2. Click the '...' (extra menu) button on the **Tests** tab
40
- 3. Select **Schedule Run** from the dropdown list
41
-
42
- ![Schedule Run](./images/att48_401.png)
43
-
44
- 4. In the **'Select tests to run'** dialog, choose the tests you want to include
45
- 5. (Optional) Enable **Run as Checklist** toggle - if enabled, marks tests to be executed as checklist
46
- 6. (Optional) Enable **Run Automated as Manual** toggle - if enabled, allows automated tests to be executed manually
47
-
48
- ![Select tests to run](./images/att49_401.png)
49
-
50
- 7. (Optional) Open the **Advanced settings** to select:
51
-
52
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
53
- - **Assign user** – select the **email of the user added to the project** who is responsible for this run
54
- - **RunGroup** – optional grouping of related runs for easier tracking and reporting
55
- - **Title** - provide a descriptive title for the run
56
-
57
- 8. Click **'Create Run'** to start execution
58
-
59
- ![Create Run button](./images/att50_401.png)
60
-
61
- 9. Mark all tests with specific status (e.g., ✔ passed / ✖ failed / ➖ skipped)
62
- 10. Click the **Finish Run** button
63
-
64
- ![Finish Run](./images/att57_401.png)
65
-
66
- **Option 2** – Using the 'Run' Button on the **Tests** Tab
67
-
68
- 1. Navigate to the **Tests** tab
69
- 2. Click the '✔ Run' button
70
- 3. In the **'Select tests to run'** dialog, choose the tests you want to include
71
- 4. (Optional) Enable **Run as Checklist** toggle - if enabled, marks tests to be executed as checklist
72
- 5. (Optional) Enable **Run Automated as Manual** toggle - if enabled, allows automated tests to be executed manually
73
-
74
- ![Select tests to run](./images/att51_401.png)
75
-
76
- 6. (Optional) Use **Advanced settings** to select:
77
-
78
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
79
- - **Assign user** – select the **email of the user added to the project** who is responsible for this run
80
- - **RunGroup** – optional grouping of related runs for easier tracking and reporting
81
- - **Title** - provide a descriptive title for the run
82
-
83
- 7. Click **'Create Run'** to start execution
84
-
85
- ![Create Run](./images/att52_401.png)
86
-
87
- 8. Mark all tests with specific status (e.g., ✔ passed / ✖ failed / ➖ skipped)
88
- 9. Click the **Finish Run** button
89
-
90
- ![Finish Run](./images/att56_401.png)
91
-
92
- **Option 3** – From the **'Plans'** Tab
93
-
94
- 1. Navigate to the **Plans** tab in the Jira issue
95
- 2. Click the **▶︎ icon** (Launch a plan) next to the linked Plan to quickly start a run
96
- 3. or click the **⚙︎ icon** (Launch with advanced options) to configure **Advanced Settings**
97
-
98
- ![Launch a plan](./images/att53_401.png)
99
-
100
- Once the **Manual Run Settings** window opens (this appears only if you clicked the **⚙︎ icon**):
101
-
102
- 4. (Optional) Enable **Run as Checklist** toggle - if enabled, marks tests to be executed as checklist
103
- 5. (Optional) Enable **Run Automated as Manual** toggle - if enabled, allows automated tests to be executed manually
104
-
105
- :::note
106
-
107
- **Run Automated as Manual** option is disabled if the selected Plan contains only manual tests.
108
-
109
- :::
110
-
111
- 6. Configure **Advanced Settings**
112
-
113
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
114
- - **Assign user** – select the **email of the user added to the project** who is responsible for this run
115
- - **RunGroup** – optional grouping of related runs for easier tracking and reporting
116
- - **Title** - provide a descriptive title for the run
117
-
118
- 7. Click **'Create Run'** to start execution
119
-
120
- ![Launch a manual run bia Plan](./images/att61_401.png)
121
-
122
- 8. Mark all tests with specific status (e.g., ✔ passed / ✖ failed / ➖ skipped)
123
- 9. Click the **Finish Run** button
124
-
125
- ![Finish Run](./images/att56_401.png)
126
-
127
- ### How to Launch an Automated Run (CI/CD)
128
-
129
- Use Automated Run in Jira to trigger tests automatically via a connected CI/CD service without leaving your Jira issue. Ideal for running regression suites, nightly builds, or executing fully automated test cases directly from the Jira interface.
130
-
131
- **Option 1** – From the '...' menu on the **Tests** Tab
132
-
133
- 1. Click the '...' (extra menu) button on the **Tests** tab
134
- 2. Select **Run in CI** from the dropdown list
135
-
136
- ![Run in CI](./images/att58_401.png)
137
-
138
- :::note
139
-
140
- If your CI service is not connected, you will see the message: 'Continuous Integration service is not enabled. Connect a CI service to run automated tests from the Testomat.io Jira Plugin.' To enable CI runs, connect your preferred [CI/CD service](https://docs.testomat.io/integrations/continuous-integration/) in your Testomat.io project settings.
141
-
142
- :::
143
-
144
- 3. Add specific tests to run by selecting one by one or **Select all** option
145
-
146
- ![Select tests to run](./images/att59_401.png)
147
-
148
- 4. (Optional) Open the **Advanced settings** to select:
149
-
150
- - **Title** - provide a title for the run
151
- - **CI profile** – select the CI configuration profile for automated test execution
152
- - **Enter config** – specify custom environment variables (e.g. `ref=main`)
153
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
154
- - **Assign user** - select the **email of the user added to the project** who is responsible for this run
155
- - **RunGroup** - optional grouping of related runs for easier tracking and reporting
156
-
157
- 5. Click **'Create Run'** to start execution
158
-
159
- ![Create Automated Run](./images/att60_401.png)
160
-
161
- **Option 2** – From the **'Plans'** Tab
162
-
163
- 1. Navigate to the **Plans** tab in the Jira issue
164
- 2. Click the **▶︎ icon** (Launch a plan) next to the linked Plan **(recommended)** in CI
165
- 3. or click the **⚙︎ icon** (Launch with advanced options)
166
-
167
- ![Launch a plan](./images/att53_401.png)
168
-
169
- 4. Once the **Run settings** window opens (this appears only if you clicked the **▶︎ icon**), select:
170
-
171
- - **Title** - provide a title for the run
172
- - **CI profile** – select the CI configuration profile for automated test execution
173
- - **Enter config** – specify custom environment variables (e.g. `ref=main`)
174
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
175
- - **Assign user** – select the **email of the user added to the project** who is responsible for this run
176
- - **RunGroup** - optional grouping of related runs for easier tracking and reporting
177
-
178
- 5. Click **'Create Run'** to start execution
179
-
180
- ![Launch Automated Run](./images/att62_401.png)
181
-
182
- 6. Once the automated run is created, it appears in the **Runs** tab with the **Pending** status
183
-
184
- - The test results will update automatically when your CI job completes — showing the final status
185
- - No manual action is required in Jira
186
-
187
- ![CI Run created](./images/att63_401.png)
188
-
189
- ### How to Launch a Mixed Run
190
-
191
- Use Mixed Run in Jira to execute both manual and automated tests in a single run directly from the Jira issue. Ideal when part of the test suite is automated, but some tests still require manual verification. You can launch a Mixed Run in Jira in two different ways:
192
-
193
- **Option 1** – From the '...' Menu on the **Tests** Tab
194
-
195
- 1. Click the '...' (extra menu) button on the **Tests** tab
196
- 2. Select **Mixed Run** from the dropdown list
197
-
198
- ![Mixed Run option](./images/att64_401.png)
199
-
200
- :::note
201
-
202
- If your CI service is not connected, you will see the message: 'Continuous Integration service is not enabled. Connect a CI service to run automated tests from the Testomat.io Jira Plugin.' To enable CI runs, connect your preferred [CI/CD service](https://docs.testomat.io/integrations/continuous-integration/) in your Testomat.io project settings.
203
-
204
- :::
205
-
206
- 3. In the **'Select tests to run'** dialog, choose the tests you want to include
207
-
208
- ![Select mix tests to run](./images/att65_401.png)
209
-
210
- 4. Configure **Advanced Settings**:
211
-
212
- - **Title** - provide a title for the run
213
- - **CI profile** – select the CI configuration profile for automated test execution
214
- - **Enter config** – specify custom environment variables (e.g. `ref=main`)
215
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
216
- - **Assign user** - select the **email of the user added to the project** who is responsible for this run
217
- - **RunGroup** - optional grouping of related runs for easier tracking and reporting
218
-
219
- 5. Click **'Create Run'** to start execution
220
-
221
- ![Create Run](./images/att66_401.png)
222
-
223
- Once the mixed run starts:
224
-
225
- 6. **Automated tests** are sent to your connected **CI service** for execution. Their results will update automatically in Jira once the CI job completes.
226
- 7. **Manual tests** can be executed directly inside Jira — mark each test with its result (e.g., ✔ passed / ✖ failed / ➖ skipped)
227
- 8. Click the **Finish Run** button to close the run
228
-
229
- ![Finish mixed run](./images/att67_401.png)
230
-
231
- **Option 2** – From the **'Plans'** Tab
232
-
233
- 1. Navigate to the **Plans** tab in the Jira issue
234
- 2. Click the **▶︎ icon** (Launch a plan) next to the linked Plan
235
- 3. or click the **⚙︎ icon** (Launch with advanced options)
236
-
237
- ![Launch a plan](./images/att53_401.png)
238
-
239
- 4. Once the **Run settings** window opens (this appears only if you clicked the **▶︎ icon**), select:
240
-
241
- - **Title** - provide a title for the run
242
- - **CI profile** – select the CI configuration profile for automated test execution
243
- - **Enter config** – specify custom environment variables (e.g. `ref=main`)
244
- - **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
245
- - **Assign user** – select the **email of the user added to the project** who is responsible for this run
246
- - **RunGroup** - optional grouping of related runs for easier tracking and reporting
247
-
248
- 5. Click **'Create Run'** to start execution
249
-
250
- ![Launch Automated Run](./images/att62_401.png)
251
-
252
- 6. **Automated tests** are sent to your connected **CI service** for execution. Their results will update automatically in Jira once the CI job completes.
253
- 7. **Manual tests** can be executed directly inside Jira — mark each test with its result (e.g., ✔ passed / ✖ failed / ➖ skipped)
254
- 8. Click the **Finish Run** button to close the run
255
-
256
- ![Finish mixed run](./images/att67_401.png)
257
-
258
- ## Run Reports in Jira
259
-
260
- Once a run is completed, it automatically appears in **Testomat.io** and in the **Runs** tab within Jira. In this tab, you can view all runs that were **launched in Jira** or **linked in Testomat.io project**, and quickly access key information about each run.
261
-
262
- - **External link (URL)** – opens the detailed report in Testomat.io
263
- - **Status icon** – shows the color of the run’s status (Passed / Failed / Skipped)
264
- - **Title** – the title provided for the run
265
- - **Run type** – a badge indicating the type of run (e.g., manual / automated / mixed)
266
- - **Environment** – selected environments for the run (e.g., macOS, Chrome, staging)
267
- - **Execution date** – date the run was completed (or **Not finished**)
268
- - **Test statuses** – number of tests with each status (e.g., ✔ Passed / ✖ Failed / ➖ Skipped)
269
- - **Actions** – **▶︎ icon** appears if the run is not yet completed
270
-
271
- ![Run general information](./images/att68_401.png)
272
-
273
- For full report options (filters, exports, comparisons, etc.), you can **open the Run Reports in Testomat.io**, or to learn more, visit the [Run Reports documentation](https://docs.testomat.io/project/runs/reports/).
274
-
275
- ### Receive Reports in Jira
276
-
277
- You can receive a summary report directly inside Jira by enabling **Report Notifications** in your Testomat.io project settings. This integration automatically posts key information about each test run into your Jira project, including:
278
-
279
- - Run ID and Status
280
- - Project name
281
- - Number of Executed Tests
282
- - Execution Date and Duration
283
- - Failed Tests
284
- - Environment
285
- - Link to Full Report
286
-
287
- This summary allows you to quickly see the key results of each run directly in Jira, while full details remain accessible via the Testomat.io report link.
288
-
289
- ![Report Notifications in Jira](./images/att69_401.png)
290
-
291
- Learn how to set it up in [Report Notifications in Jira.](https://docs.testomat.io/integrations/report-notifications/jira/)
292
-
293
- ## Tests Coverage
294
-
295
- The Tests Coverage screen provides a traceability matrix showing all Jira issues with their linked
296
- tests. For each issue you can see:
297
-
298
- - Title — Jira issue key and name
299
- - Tests — number of linked tests
300
- - Status — current test run status (e.g., Failed, Passed)
301
- - Automation status — percentage of automated tests among linked ones
302
-
303
- This gives the team a quick overview of which requirements are covered, how many tests back each issue, and how far automation has progressed per story.
304
-
305
- To open the Tests Coverage screen:
306
-
307
- 1. Open the specific space
308
- 2. Click the 'More' option
309
- 3. Select the 'Tests Coverage' tab
310
-
311
- ![Tests Coverage tab](./images/att1_575.png)
312
-
313
- The automation percentage reflects how many of the linked tests are automated — from 0% (all manual) to 100% (fully automated). Issues with no linked tests signal coverage gaps that need attention.
314
-
315
- ![Tests Coverage screen](./images/att2_575.png)
316
-
317
- ## Sprint Coverage
318
-
319
- The Sprint Coverage tab gives a high-level summary of test execution health across a sprint. Use it to understand how well a sprint is covered with tests and how the execution is progressing — without leaving Jira.
320
-
321
- For each sprint it shows:
322
-
323
- - Issues with tests / Issues without tests — how many sprint issues have linked tests and how many are left uncovered
324
- - Manual tests / Automated tests — breakdown of test types across the sprint
325
- - Passed / Failed / Skipped / Pending / Not executed — full execution status breakdown
326
-
327
- This makes it easy to spot coverage gaps, track automation progress, and assess sprint readiness at a glance.
328
-
329
- To check test coverage for a sprint:
330
-
331
- 1. Open the specific space
332
- 2. Click the 'More' option
333
- 3. Select the 'Sprints Coverage' tab
334
-
335
- ![Sprint Coverage](./images/att3_575.png)
336
-
337
- 4. Enter the sprint ID(s)
338
- 5. Click the 'Submit' button
339
-
340
- ![Search sprint ID(s)](./images/att4_575.png)
341
-
342
- :::note
343
-
344
- To find your sprint ID, visit the [Jira Software sprint ID guide](https://support.atlassian.com/jira/kb/jira-software-how-to-identify-the-id-of-a-sprint/).
345
-
346
- :::
347
-
348
- ## Data Sync in Jira
349
-
350
- Testomat.io and Jira are continuously synchronized to ensure test data stays up to date across both systems. This **two-way sync** keeps all team members — QA, development, management, and stakeholders — aligned.
351
-
352
- **Automatic Sync**
353
-
354
- All key updates are automatically synchronized:
355
-
356
- - Linked test cases, test suites, and plans remain aligned in both systems
357
- - Statuses of linked Jira issues are synchronized
358
- - Executing a run in Testomat.io updates the corresponding Jira issue with the latest run status
359
- - Launching or updating a run from Jira instantly reflects in Testomat.io
360
- - Testomat.io settings — including environments, branches, users, run groups, and CI integrations — are synchronized and visible in Jira
361
-
362
- This real-time, two-way sync ensures that everyone sees the same up-to-date information, eliminating confusion and reducing manual updates.
363
-
364
- **Manual Sync**
365
-
366
- If your Jira issue view or run list does not show the latest data, you can trigger synchronization manually. This ensures that all test results, linked issues, and run information are up-to-date in both Jira and Testomat.io.
367
-
368
- To manually refresh data:
369
-
370
- 1. Open the **Tests** tab in the Jira issue
371
- 2. Click the '⋯' (extra menu) button
372
- 3. Select **Sync** from the dropdown list
373
-
374
- ![Sync button](./images/att55_401.png)
375
-
376
- Testomat.io will re-fetch the latest information and update linked test results, statuses, and settings inside Jira. This keeps your Jira and Testomat.io data fully consistent — whether you rely on automatic background sync or perform a quick manual refresh when needed.
377
-