testeiya 0.2.1 → 0.3.9

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (414) hide show
  1. package/LICENSE +21 -0
  2. package/README.md +41 -213
  3. package/dist/prompt/context.js +79 -0
  4. package/dist/prompt/context.js.map +1 -0
  5. package/dist/prompt/index.js +56 -0
  6. package/dist/prompt/index.js.map +1 -0
  7. package/dist/prompt/print.js +22 -0
  8. package/dist/prompt/print.js.map +1 -0
  9. package/dist/prompt/project-info.js +2 -0
  10. package/dist/prompt/project-info.js.map +1 -0
  11. package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +24 -21
  12. package/dist/prompt/system-prompt.js.map +1 -0
  13. package/dist/prompt/testomatio.js +264 -0
  14. package/dist/prompt/testomatio.js.map +1 -0
  15. package/dist/prompt/tools.js +49 -0
  16. package/dist/prompt/tools.js.map +1 -0
  17. package/dist/prompt/vocab.js +8 -0
  18. package/dist/prompt/vocab.js.map +1 -0
  19. package/dist/src/args.js +72 -0
  20. package/dist/src/args.js.map +1 -0
  21. package/dist/src/cli.js +61 -0
  22. package/dist/src/cli.js.map +1 -0
  23. package/dist/src/env.js +69 -0
  24. package/dist/src/env.js.map +1 -0
  25. package/dist/src/mcp-extension.js +9 -0
  26. package/dist/src/mcp-extension.js.map +1 -0
  27. package/dist/src/mcp.js +139 -0
  28. package/dist/src/mcp.js.map +1 -0
  29. package/dist/src/model.js +66 -0
  30. package/dist/src/model.js.map +1 -0
  31. package/dist/src/result.js +41 -0
  32. package/dist/src/result.js.map +1 -0
  33. package/dist/src/run.js +199 -0
  34. package/dist/src/run.js.map +1 -0
  35. package/dist/src/session.js +77 -0
  36. package/dist/src/session.js.map +1 -0
  37. package/dist/vendor/mcp.js +14801 -0
  38. package/mcp-tools.json +2967 -0
  39. package/package.json +29 -42
  40. package/prompt/context.ts +101 -0
  41. package/prompt/index.ts +93 -0
  42. package/prompt/print.ts +23 -0
  43. package/prompt/project-info.ts +30 -0
  44. package/prompt/system-prompt.ts +173 -0
  45. package/{src/prompt → prompt}/testomatio.ts +119 -8
  46. package/{src/prompt → prompt}/tools.ts +30 -8
  47. package/prompt/vocab.ts +7 -0
  48. package/{skills.lock.json → skills/skills.lock.json} +11 -7
  49. package/skills/skills.yaml +34 -0
  50. package/assets/testeiya-logo-dark.svg +0 -16
  51. package/assets/testeiya-logo.svg +0 -15
  52. package/models.catalog.json +0 -6963
  53. package/skills/codeceptjs/ci-fix-tests/SKILL.md +0 -120
  54. package/skills/codeceptjs/codeceptjs-auth/SKILL.md +0 -158
  55. package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +0 -91
  56. package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +0 -158
  57. package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +0 -90
  58. package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +0 -234
  59. package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +0 -110
  60. package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +0 -306
  61. package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +0 -352
  62. package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +0 -472
  63. package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +0 -350
  64. package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +0 -81
  65. package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +0 -206
  66. package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
  67. package/skills/playwright-best-practices-skill/README.md +0 -147
  68. package/skills/playwright-best-practices-skill/SKILL.md +0 -303
  69. package/skills/playwright-best-practices-skill/advanced/authentication-flows.md +0 -360
  70. package/skills/playwright-best-practices-skill/advanced/authentication.md +0 -871
  71. package/skills/playwright-best-practices-skill/advanced/clock-mocking.md +0 -364
  72. package/skills/playwright-best-practices-skill/advanced/mobile-testing.md +0 -409
  73. package/skills/playwright-best-practices-skill/advanced/multi-context.md +0 -288
  74. package/skills/playwright-best-practices-skill/advanced/multi-user.md +0 -393
  75. package/skills/playwright-best-practices-skill/advanced/network-advanced.md +0 -452
  76. package/skills/playwright-best-practices-skill/advanced/third-party.md +0 -464
  77. package/skills/playwright-best-practices-skill/architecture/pom-vs-fixtures.md +0 -363
  78. package/skills/playwright-best-practices-skill/architecture/test-architecture.md +0 -369
  79. package/skills/playwright-best-practices-skill/architecture/when-to-mock.md +0 -383
  80. package/skills/playwright-best-practices-skill/browser-apis/browser-apis.md +0 -391
  81. package/skills/playwright-best-practices-skill/browser-apis/iframes.md +0 -403
  82. package/skills/playwright-best-practices-skill/browser-apis/service-workers.md +0 -504
  83. package/skills/playwright-best-practices-skill/browser-apis/websockets.md +0 -403
  84. package/skills/playwright-best-practices-skill/core/annotations.md +0 -424
  85. package/skills/playwright-best-practices-skill/core/assertions-waiting.md +0 -361
  86. package/skills/playwright-best-practices-skill/core/configuration.md +0 -452
  87. package/skills/playwright-best-practices-skill/core/fixtures-hooks.md +0 -417
  88. package/skills/playwright-best-practices-skill/core/global-setup.md +0 -434
  89. package/skills/playwright-best-practices-skill/core/locators.md +0 -242
  90. package/skills/playwright-best-practices-skill/core/page-object-model.md +0 -315
  91. package/skills/playwright-best-practices-skill/core/projects-dependencies.md +0 -453
  92. package/skills/playwright-best-practices-skill/core/test-data.md +0 -492
  93. package/skills/playwright-best-practices-skill/core/test-suite-structure.md +0 -361
  94. package/skills/playwright-best-practices-skill/core/test-tags.md +0 -298
  95. package/skills/playwright-best-practices-skill/debugging/console-errors.md +0 -420
  96. package/skills/playwright-best-practices-skill/debugging/debugging.md +0 -504
  97. package/skills/playwright-best-practices-skill/debugging/error-testing.md +0 -360
  98. package/skills/playwright-best-practices-skill/debugging/flaky-tests.md +0 -496
  99. package/skills/playwright-best-practices-skill/frameworks/angular.md +0 -530
  100. package/skills/playwright-best-practices-skill/frameworks/nextjs.md +0 -469
  101. package/skills/playwright-best-practices-skill/frameworks/react.md +0 -531
  102. package/skills/playwright-best-practices-skill/frameworks/vue.md +0 -574
  103. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/ci-cd.md +0 -468
  104. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/docker.md +0 -283
  105. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/github-actions.md +0 -546
  106. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/gitlab.md +0 -397
  107. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/other-providers.md +0 -521
  108. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/parallel-sharding.md +0 -371
  109. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/performance.md +0 -453
  110. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/reporting.md +0 -424
  111. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/test-coverage.md +0 -497
  112. package/skills/playwright-best-practices-skill/testing-patterns/accessibility.md +0 -359
  113. package/skills/playwright-best-practices-skill/testing-patterns/api-testing.md +0 -719
  114. package/skills/playwright-best-practices-skill/testing-patterns/browser-extensions.md +0 -506
  115. package/skills/playwright-best-practices-skill/testing-patterns/canvas-webgl.md +0 -493
  116. package/skills/playwright-best-practices-skill/testing-patterns/component-testing.md +0 -500
  117. package/skills/playwright-best-practices-skill/testing-patterns/drag-drop.md +0 -576
  118. package/skills/playwright-best-practices-skill/testing-patterns/electron.md +0 -509
  119. package/skills/playwright-best-practices-skill/testing-patterns/file-operations.md +0 -377
  120. package/skills/playwright-best-practices-skill/testing-patterns/file-upload-download.md +0 -562
  121. package/skills/playwright-best-practices-skill/testing-patterns/forms-validation.md +0 -561
  122. package/skills/playwright-best-practices-skill/testing-patterns/graphql-testing.md +0 -331
  123. package/skills/playwright-best-practices-skill/testing-patterns/i18n.md +0 -508
  124. package/skills/playwright-best-practices-skill/testing-patterns/performance-testing.md +0 -476
  125. package/skills/playwright-best-practices-skill/testing-patterns/security-testing.md +0 -430
  126. package/skills/playwright-best-practices-skill/testing-patterns/visual-regression.md +0 -634
  127. package/skills/playwright-cli/SKILL.md +0 -420
  128. package/skills/playwright-cli/references/element-attributes.md +0 -23
  129. package/skills/playwright-cli/references/playwright-tests.md +0 -39
  130. package/skills/playwright-cli/references/request-mocking.md +0 -87
  131. package/skills/playwright-cli/references/running-code.md +0 -241
  132. package/skills/playwright-cli/references/session-management.md +0 -225
  133. package/skills/playwright-cli/references/storage-state.md +0 -275
  134. package/skills/playwright-cli/references/test-generation.md +0 -433
  135. package/skills/playwright-cli/references/tracing.md +0 -139
  136. package/skills/playwright-cli/references/video-recording.md +0 -143
  137. package/skills/testeiya/README.md +0 -29
  138. package/skills/testeiya/answer-formatting/SKILL.md +0 -30
  139. package/skills/testeiya/check-cucumber/SKILL.md +0 -200
  140. package/skills/testeiya/check-tests/SKILL.md +0 -260
  141. package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
  142. package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
  143. package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
  144. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
  145. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
  146. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
  147. package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
  148. package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
  149. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
  150. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
  151. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
  152. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
  153. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
  154. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
  155. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
  156. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
  157. package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
  158. package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
  159. package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
  160. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
  161. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
  162. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
  163. package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
  164. package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
  165. package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
  166. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
  167. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
  168. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
  169. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
  170. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
  171. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
  172. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
  173. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
  174. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
  175. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
  176. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
  177. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
  178. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
  179. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
  180. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
  181. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
  182. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
  183. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
  184. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
  185. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
  186. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
  187. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
  188. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
  189. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
  190. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
  191. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
  192. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
  193. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
  194. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
  195. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
  196. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
  197. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
  198. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
  199. package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
  200. package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
  201. package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
  202. package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
  203. package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
  204. package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
  205. package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
  206. package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
  207. package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
  208. package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
  209. package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
  210. package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
  211. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
  212. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
  213. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
  214. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
  215. package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
  216. package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
  217. package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
  218. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
  219. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
  220. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
  221. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
  222. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
  223. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
  224. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
  225. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
  226. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
  227. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
  228. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
  229. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
  230. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
  231. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
  232. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
  233. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
  234. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
  235. package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
  236. package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
  237. package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
  238. package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
  239. package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
  240. package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
  241. package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
  242. package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
  243. package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
  244. package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
  245. package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
  246. package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
  247. package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
  248. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
  249. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
  250. package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
  251. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
  252. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
  253. package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
  254. package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
  255. package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
  256. package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
  257. package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
  258. package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
  259. package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
  260. package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
  261. package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
  262. package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
  263. package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
  264. package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
  265. package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
  266. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
  267. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
  268. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
  269. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
  270. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
  271. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
  272. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
  273. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
  274. package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
  275. package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
  276. package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
  277. package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
  278. package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
  279. package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
  280. package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
  281. package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
  282. package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
  283. package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
  284. package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
  285. package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
  286. package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +0 -88
  287. package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +0 -95
  288. package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +0 -334
  289. package/skills/testomatio/test-automation/automate-manual-test-cases/CLAUDE.md +0 -56
  290. package/skills/testomatio/test-automation/automate-manual-test-cases/SKILL.md +0 -242
  291. package/skills/testomatio/test-automation/automate-manual-test-cases/references/CODECEPTJS_BEST_PRACTICES.md +0 -182
  292. package/skills/testomatio/test-automation/automate-manual-test-cases/references/FINAL_SUMMARY_TEMPLATE.md +0 -22
  293. package/skills/testomatio/test-automation/automate-manual-test-cases/references/PLAYWRIGHT_BEST_PRACTICES.md +0 -90
  294. package/skills/testomatio/test-automation/automate-manual-test-cases/references/POM_BEST_PRACTICES.md +0 -53
  295. package/skills/testomatio/test-automation/automate-manual-test-cases/references/TEST_DATA_MANAGEMENT.md +0 -52
  296. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/SKILL.md +0 -107
  297. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/references/DEBUGGING_QUICK_REFERENCE.md +0 -113
  298. package/skills/testomatio/test-automation/qa-automation-test-consolidation/SKILL.md +0 -29
  299. package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +0 -151
  300. package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
  301. package/skills/testomatio/test-automation/testomat-allure-adapter/SKILL.md +0 -289
  302. package/skills/testomatio/test-management/detect-duplicate-test-cases/SKILL.md +0 -86
  303. package/skills/testomatio/test-management/detect-duplicate-test-cases/references/DUPLICATE_INSTRUCTIONS.md +0 -54
  304. package/skills/testomatio/test-management/improve-test-cases/SKILL.md +0 -114
  305. package/skills/testomatio/test-management/improve-test-cases/references/TESTOMAT_MARKDOWN_EXAMPLE.md +0 -66
  306. package/skills/testomatio/test-management/pull-request-diff-analyzer/SKILL.md +0 -141
  307. package/skills/testomatio/test-management/qa-e2e-tests-reporting/SKILL.md +0 -354
  308. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_ARTIFACTS.md +0 -82
  309. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_HTML_REPORT.md +0 -37
  310. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_REPORTERS_CONFIG.md +0 -118
  311. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/SKILL.md +0 -149
  312. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/references/summary-example.md +0 -54
  313. package/skills/testomatio/test-management/qa-requirement-reviewer/SKILL.md +0 -126
  314. package/skills/testomatio/test-management/qa-requirement-reviewer/references/requirements_reviewer_examples.md +0 -128
  315. package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +0 -174
  316. package/skills/testomatio/test-management/qa-test-code-coverage/references/COVERAGE_FILE_FORMAT.md +0 -138
  317. package/skills/testomatio/test-management/qa-test-code-coverage/references/E2E_FRAMEWORKS.md +0 -65
  318. package/skills/testomatio/test-management/qa-test-code-coverage/scripts/check-coverage.mjs +0 -40
  319. package/skills/testomatio/test-management/qa-thinking/SKILL.md +0 -36
  320. package/skills/testomatio/test-management/qa-write-test-cases/SKILL.md +0 -267
  321. package/skills/testomatio/test-management/qa-write-test-cases/references/test-case-format.md +0 -387
  322. package/skills/testomatio/test-management/qa-write-test-cases/references/testomat-tms-guide.md +0 -72
  323. package/skills/testomatio/test-management/qa-write-test-cases/references/writing-rule.md +0 -159
  324. package/skills/testomatio/test-management/scan-automation-project/SKILL.md +0 -152
  325. package/skills/testomatio/test-management/sync-test-cases-with-tms/SKILL.md +0 -107
  326. package/skills/testomatio/test-management/sync-test-cases-with-tms/references/TESTOMATIO_CLI.md +0 -140
  327. package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +0 -182
  328. package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +0 -169
  329. package/skills.yaml +0 -21
  330. package/src/ai-debug.ts +0 -188
  331. package/src/api/agent-get.ts +0 -22
  332. package/src/api/agent-start.ts +0 -384
  333. package/src/api/client-log.ts +0 -29
  334. package/src/api/context.ts +0 -332
  335. package/src/api/debug-layout.ts +0 -47
  336. package/src/api/debug-report.ts +0 -29
  337. package/src/api/debug-snapshot.ts +0 -30
  338. package/src/api/debug-stream.ts +0 -52
  339. package/src/api/files-delete.ts +0 -184
  340. package/src/api/files-read.ts +0 -41
  341. package/src/api/files-rename.ts +0 -99
  342. package/src/api/files-tree.ts +0 -292
  343. package/src/api/files-write.ts +0 -41
  344. package/src/api/mcp.ts +0 -603
  345. package/src/api/memory.ts +0 -69
  346. package/src/api/open-external.ts +0 -39
  347. package/src/api/playwright-cli.ts +0 -606
  348. package/src/api/providers.ts +0 -457
  349. package/src/api/read-env-token.ts +0 -33
  350. package/src/api/sessions.ts +0 -79
  351. package/src/api/settings.ts +0 -120
  352. package/src/api/skills.ts +0 -58
  353. package/src/api/testomatio-attachment.ts +0 -89
  354. package/src/api/testomatio-auth.ts +0 -284
  355. package/src/api/testomatio-proxy.ts +0 -197
  356. package/src/api/testomatio-run-stats.ts +0 -81
  357. package/src/api/testomatio-target.ts +0 -225
  358. package/src/api/testomatio-transcription.ts +0 -82
  359. package/src/api/workspace-search.ts +0 -96
  360. package/src/api/workspace-sync.ts +0 -151
  361. package/src/api/workspace.ts +0 -165
  362. package/src/app-server.ts +0 -556
  363. package/src/bridge.ts +0 -251
  364. package/src/check-tests.ts +0 -156
  365. package/src/cli.ts +0 -17
  366. package/src/commands.ts +0 -244
  367. package/src/config.ts +0 -183
  368. package/src/connection.ts +0 -658
  369. package/src/context-store.ts +0 -265
  370. package/src/debug-bus.ts +0 -405
  371. package/src/extensions/tool-gate.ts +0 -220
  372. package/src/extensions/webui/ask-channel.ts +0 -52
  373. package/src/extensions/webui/index.ts +0 -184
  374. package/src/extensions/webui/tools/ask-question.ts +0 -88
  375. package/src/extensions/webui/tools/query-result.ts +0 -79
  376. package/src/extensions/webui/tools/render-chart.ts +0 -53
  377. package/src/extensions/webui/tools/render-item.ts +0 -61
  378. package/src/extensions/webui/tools/render-list.ts +0 -170
  379. package/src/extensions/webui/tools/render-result.ts +0 -85
  380. package/src/extensions/webui/tools/render-tree.ts +0 -71
  381. package/src/extensions/webui/tools/ui-widget.ts +0 -54
  382. package/src/extensions/webui/tools/widget-result.ts +0 -13
  383. package/src/extensions/webui/widget-channel.ts +0 -50
  384. package/src/file-log.ts +0 -196
  385. package/src/git-tracked.ts +0 -68
  386. package/src/gitignore.ts +0 -53
  387. package/src/json-store.ts +0 -43
  388. package/src/load-env.ts +0 -70
  389. package/src/loader-style.ts +0 -96
  390. package/src/main.ts +0 -140
  391. package/src/mcp-catalog.ts +0 -96
  392. package/src/models-catalog.ts +0 -72
  393. package/src/permissions.ts +0 -120
  394. package/src/project-dir.ts +0 -189
  395. package/src/project-info.ts +0 -108
  396. package/src/prompt/app-ui.ts +0 -59
  397. package/src/prompt/browser.ts +0 -27
  398. package/src/prompt/index.ts +0 -62
  399. package/src/server-info.ts +0 -62
  400. package/src/session-factory.ts +0 -442
  401. package/src/session-store.ts +0 -115
  402. package/src/shell-env.ts +0 -45
  403. package/src/skills.ts +0 -163
  404. package/src/sync-snapshot.ts +0 -140
  405. package/src/telemetry.ts +0 -239
  406. package/src/testomatio-auth.ts +0 -299
  407. package/src/testomatio.ts +0 -98
  408. package/src/theme.ts +0 -30
  409. package/src/user-env.ts +0 -94
  410. package/src/welcome.ts +0 -194
  411. package/src/workspace/safe-path.ts +0 -85
  412. package/src/workspace/test-md.ts +0 -70
  413. package/src/workspace-model.ts +0 -440
  414. package/testeiya.config.json +0 -14
@@ -1,67 +0,0 @@
1
- ---
2
- title: Shortcut Configuration
3
- description: Learn how to integrate Shortcut with Testomat.io for effective issue tracking. This guide details how to retrieve your API Access Token and Workflow Name and provides step-by-step instructions to configure the Shortcut integration within Testomat.io seamlessly.
4
- type: article
5
- url: https://docs.testomat.io/integrations/issues-management/shortcut
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: og:image
10
- content: https://docs.testomat.io/_astro/New_UTbONHqM_2024-10-31.DUKqHBp2_YEDnG.webp
11
-
12
- - tag: meta
13
- attrs:
14
- name: keywords
15
- content: Shortcut integration, Testomat.io, issue management, API Access Token, Workflow Name, project management, test management tools, software testing, agile development
16
- ---
17
-
18
- If you already have a workspace configured in **Shortcut**, you're ready to integrate it with Testomat.io. To get started, you’ll need your **Workflow Name**, and **API Access Token**. We’ll walk you through each step to locate this information and connect it with Testomat.io.
19
-
20
- ![Testomat.io - Shortcut workspace](./images/New_OsYXONII_2024-11-21.png)
21
-
22
- To create the **API Access Token**, follow these steps:
23
-
24
- 1. Click on **Settings** button
25
- 2. Go to **API Tokens**
26
- 3. Enter **Token Name**
27
- 4. Click on **Generate Token** button
28
-
29
- ![Testomat.io - Shortcut Create Token](./images/New_ipmViSuc_2024-11-21.png)
30
-
31
- 5. Copy your API Token
32
-
33
- ![Testomat.io - Shortcut API Access Token](./images/New_xCU4yAtk_2024-11-21.png)
34
-
35
- Keep your **API Access Token** secure, as you’ll need it for the integration with Testomat.io.
36
-
37
- To locate the **Workflow Name**, follow these steps:
38
-
39
- 1. Click on **Settings** button
40
- 2. Go to **Workflows**
41
- 5. Copy your Workflow Name
42
-
43
- ![Testomat.io - Shortcut Workflow Name](./images/New_L83JSNf7_2024-11-21.png)
44
-
45
- After collecting all necessary data, we can move on to Testomat.io.
46
-
47
- 1. Select Shortcut from the list of available Issue Management Systems.
48
-
49
- ![Testomat.io - Connect to Shortcut](./images/New_FMxDuVut_2024-11-21.png)
50
-
51
- 2. Enter a **Profile Name**
52
- 3. Paste Shortcut **API Access Token**
53
- 4. Paste Shortcut **Workflow Name**
54
- 5. Click on **Save** button
55
-
56
- ![Testomat.io - Shortcut Configuration](./images/New_g9KgOr4g_2024-11-21.png)
57
-
58
- If everything was done correctly, you will receive a confirmation message indicating that the Shortcut profile was successfully created.
59
-
60
- ![Testomat.io - Shortcut Profile](./images/New_58FqfBg9_2024-11-21.png)
61
-
62
- ## Frequently Asked Questions (FAQ)
63
-
64
- **Q: Although linking an already existing Shortcut ticket does not work as I expected. When using **“Link to Issue”** and entering the Shortcut URL, it does not automatically create an external link on Shortcut.**
65
-
66
- A: This behavior is expected. When you use the **“Link to Issue”** feature in Testomat.io to attach an existing Shortcut ticket, it will not automatically create a backlink (external link) inside Shortcut. This limitation is caused by Shortcut’s API, which currently does not allow third-party tools to generate external links on already existing tickets.
67
-
@@ -1,94 +0,0 @@
1
- ---
2
- title: YouTrack Configuration
3
- description: Learn how to integrate YouTrack with Testomat.io for streamlined issue management. This guide explains how to retrieve your YouTrack Workspace Name, Personal Access Token, and Project ID, and then configure the integration within Testomat.io.
4
- type: article
5
- url: https://docs.testomat.io/integrations/issues-management/youtrack
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: og:image
10
- content: https://docs.testomat.io/_astro/New_UTbONHqM_2024-10-31.DUKqHBp2_YEDnG.webp
11
-
12
- - tag: meta
13
- attrs:
14
- name: keywords
15
- content: YouTrack integration, Testomat.io, issue tracking, personal access token, workspace configuration, project management, test management tools, software testing, bug tracking
16
- ---
17
-
18
- If you already have a workspace and project in YouTrack, you’re ready to integrate it with Testomat.io. To do so, you’ll need three items:
19
-
20
- - Workspace Name
21
- - Personal Access Token
22
- - Project ID
23
-
24
- This guide walks you through where to find each.
25
-
26
- ![Testomat.io - YouTrack Project](./images/New_US8feteR_2024-10-31.png)
27
-
28
- ## How to Find a Workspace Name
29
-
30
- You can find your **Workspace Name** in the browser **URL** when you're logged into YouTrack. For example: `[my-workspace].youtrack.cloud`
31
-
32
- ![Testomat.io - YouTrack Workspace Name](./images/New_kltLXnVA_2024-10-31.png)
33
-
34
- ## How to Create a Personal Access Token
35
-
36
- To create the **Personal Access Token**, follow these steps:
37
-
38
- 1. Click on the profile avatar
39
- 2. Go to **Profile**
40
- 3. Then go to **Account Security**
41
- 4. Click on **New token...** button
42
-
43
- ![Testomat.io - YouTrack Create Token](./images/New_pCUPQyzz_2024-10-31.png)
44
-
45
- 5. Enter a **Token** name
46
- 6. Select services (**YouTrack, YouTrack Administration**)
47
- 7. Click on **Create** button
48
-
49
- ![Testomat.io - YouTrack Personal Access Token](./images/New_WzTEWxkc_2024-10-31.png)
50
-
51
- Once the token has been created, copy it. Keep your Personal Access Token secure, as you’ll need it for the integration with Testomat.io.
52
-
53
- ## How to Get a Project ID
54
-
55
- Finally, to get the **Project ID**, follow these steps:
56
-
57
- 1. Open YouTrack [API Documentation](https://www.postman.com/youtrack-dev/youtrack/documentation/sd7pq8x/youtrack-rest-api)-> Administration -> Projects -> Read a List of Projects
58
- 2. Get a request:
59
-
60
- ```
61
- https://<your-workspace>.youtrack.cloud/api/admin/projects?fields=id,key,name
62
-
63
- ```
64
-
65
- 3. Paste your Personal Access Token
66
- 4. Click **Send** button and get your Project ID in the response body (e.g. `"id": "0-1"`)
67
-
68
- ![Get Project ID](./images/att1_youtrack.png)
69
-
70
- :::note
71
-
72
- The ID in the browser URL isn't the same as the project ID in the database.
73
-
74
- :::
75
-
76
- After collecting all necessary data, we can move on to Testomat.io.
77
-
78
- ## How to Connect YouTrack in Testomat.io
79
-
80
- 1. Select YouTrack from the list of available Issue Management Systems.
81
-
82
- ![Testomat.io - Connect to YouTrack](./images/New_F8MYluVy_2024-10-31.png)
83
-
84
- 2. Enter a **Profile Name**
85
- 3. Paste YouTrack **Workspace Name**
86
- 4. Paste YouTrack **Personal Access Token**
87
- 5. Paste YouTrack **Project ID**
88
- 6. Click on **Save** button
89
-
90
- ![Testomat.io - YouTrack Configuration](./images/New_UTbONHqM_2024-10-31.png)
91
-
92
- If everything was done correctly, you will receive a confirmation message indicating that the YouTrack profile was successfully created.
93
-
94
- ![Testomat.io - YouTrack Profile](./images/New_K1fdAe5k_2024-10-31.png)
@@ -1,53 +0,0 @@
1
- ---
2
- title: Azure DevOps Notifications
3
- description: Configure Azure DevOps notifications in Testomat.io to automate issue creation for failed test runs. This guide explains linking Azure DevOps projects, and setting notification rules to streamline workflows and save time by automating detailed test result reporting.
4
- type: article
5
- url: https://docs.testomat.io/integrations/report-notifications/azure-devops
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Azure DevOps, Testomat.io, issue tracking, Notification rules, Report Notifications, Azure DevOps integration, publish report, detailed test run results, test management, test automation, software testing, basic rules, advanced rules engine
11
- ---
12
-
13
- Testomat.io allows to create issue for failed test runs automatically in Azure DevOps. This option can be enabled in **Settings**.
14
-
15
- Before you set up Notification rules for Azure DevOps, you need to connect your Azure DevOps project with Testomat.io. Please follow the instuction in dedicated section - [Azure DevOps Configuration.](https://docs.testomat.io/integrations/issues-management/azure/)
16
-
17
- After the Azure DevOps is connected with Testomat.io, go to the **Settings (1) -> Report Notifications(2)** and click on **Add Notification Rule (3)**.
18
-
19
- ![Testomat.io - Notification](./images/Notification.png)
20
-
21
- To enable Notification for Azure DevOps follow next steps:
22
-
23
- 1. Add a title for Notification Rule.
24
- 2. Choose **Azure DevOps** from the dropdown list.
25
-
26
- ![Testomat.io - Notification Azure DevOps](./images/Azure_DevOps_1.png)
27
-
28
- 3. Select **Azure DevOps integration** from dropdown list.
29
- 4. Select **'Publish a report and use public link in report notification'** option, if you need it.
30
- 5. Configure rules to define on which conditions this notification should be sent in **BASIC RULES** section
31
-
32
- OR
33
-
34
- use **ADVANCED RULES ENGINE** to enter your rule expression.
35
-
36
- 6. Click on **Save** button.
37
-
38
- | **Basic Rules** | **Advanced Rules Engine** |
39
- | --------------------------- | ------------------------------------- |
40
- | ![Testomat.io - Basic rule](./images/Azure_DevOps_2.png) | ![Testomat.io - Advanced Rules Engine](./images/Azure_DevOps_3.png) |
41
-
42
- Testomat.io will now automatically create an issue with detailed Test Run results in your Azure DevOps project for any failed Test Runs. This eliminates the need to manually input data for each Test Run, saving you time and ensuring that all contributors are notified in a convenient way.
43
-
44
- ![Testomat.io - Notification Azure DevOps](./images/Azure_DevOps_4.png)
45
-
46
-
47
- :::note
48
-
49
- When **'Publish a report and use public link in report notification'** option is enabled, the public report will be generated and everyone who has this link will be able to see it.
50
-
51
- ![Testomat.io - Notification](./images/Public_Report.png)
52
-
53
- :::
@@ -1,71 +0,0 @@
1
- ---
2
- title: Email Notifications
3
- description: Learn how to configure email notifications in Testomat.io to receive updates on test run results. This guide covers setting notification rules, customizing fields, and managing multiple email recipients effectively.
4
- type: article
5
- url: https://docs.testomat.io/integrations/report-notifications/email
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Testomat.io, Email notifications, Report Notifications, Add Notification Rule, Run context, RunGroup context, basic rules, advanced rules engine, Run Report, multiple notifications, test management, test automation, software testing
11
- ---
12
-
13
- Testomat.io allows sending Notifications for finished runs via Email.
14
- Let's see how it works!
15
-
16
- First, you need to set up Email notifications in the Settings tab:
17
-
18
- 1. Go to **Settings**.
19
- 2. Select **Report Notifications** option.
20
- 3. Click on **Add Notification Rule**.
21
-
22
- ![Testomat.io - Notification](./images/Notification.png)
23
-
24
- At this point your next steps are:
25
-
26
- 4. Add a title for Notification Rule.
27
- 5. Choose **Email** from the dropdown list.
28
-
29
- ![Testomat.io - Notification Email](./images/Email_2.png)
30
-
31
- 6. Enter one or multiple email addresses (separated by coma) to receive notifications.
32
- 7. Select **'Publish a report and use public link in report notification'** option, if you need it.
33
- 8. Select **Notification rule context**: Run or RunGroup.
34
- 9. Add notification rules in **BASIC RULES** section
35
-
36
- OR
37
-
38
- use **ADVANCED RULES ENGINE** to enter your rule expression.
39
-
40
- 10. Click on **Save** button.
41
-
42
- | **Basic Rules** | **Advanced Rules Engine** |
43
- | --------------------------- | ------------------------------------- |
44
- | ![Testomat.io - Basic rule](./images/Email_3.png) | ![Testomat.io - Advanced Rules Engine](./images/Email_4.png) |
45
-
46
- Now you have Email Notification enabled for the project.
47
-
48
- ![Testomat.io - Notification Email](./images/Email_5.png)
49
-
50
- **How does it work?**
51
- Each time Testomat.io creates Run Report, which corresponds to your Email Notification Rule, it will be sent to email.
52
-
53
- ![Testomat.io - Notification Email](./images/Email_6.png)
54
-
55
- :::note
56
-
57
- You can set up multiple Email Notifications for different Rules.
58
-
59
- ![Testomat.io - Notification Email](./images/Email_7.png)
60
-
61
- :::
62
-
63
- :::note
64
-
65
- When **'Publish a report and use public link in report notification'** option is enabled, the public report will be generated and everyone who has this link will be able to see it.
66
-
67
- ![Testomat.io - Notification](./images/Public_Report.png)
68
-
69
- :::
70
-
71
-
@@ -1,52 +0,0 @@
1
- ---
2
- title: Jira Notifications
3
- description: Configure Jira notifications in Testomat.io to automate issue creation for failed test runs. This guide explains linking Jira projects, selecting issue types, and setting notification rules to streamline workflows and save time by automating detailed test result reporting.
4
- type: article
5
- url: https://docs.testomat.io/integrations/report-notifications/jira
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Testomat.io, Jira, automatic issue creation, failed test runs, Notification rules, Report Notifications, Add Notification Rule, Jira project, publish report, public link, basic rules, advanced rules engine, detailed test run results, test management, test automation, software testing
11
- ---
12
-
13
- Testomat.io allows to create Jira issue for failed test runs automatically. This option can be enabled in **Settings**.
14
- To do this, you need to connect Jira project with Testomat.io. Please see dedicated documentation - [Connecting to JIRA project.](https://docs.testomat.io/integration/jira/#connecting-to-jira-project)
15
-
16
- After the Jira is connected with Testomat.io, go to the **Settings (1) -> Report Notifications(2)** and click on **Add Notification Rule (3)**.
17
-
18
- ![Testomat.io - Notification](./images/Notification.png)
19
-
20
- To create a new Notification Rule for Jira follow next steps:
21
-
22
- 1. Add a title for Notification Rule.
23
- 2. Choose **Jira** from the dropdown list.
24
-
25
- ![Testomat.io - Notification Jira](./images/Jira_1.png)
26
-
27
- 3. Select your dedicated Jira project from **Jira Project** dropdown list.
28
- 4. Select needed issue type from **Issue Type** dropdown list.
29
- 5. Select **'Publish a report and use public link in report notification'** option, if you need it.
30
- 6. Configure rules to define on which conditions this notification should be sent in **BASIC RULES** section
31
-
32
- OR
33
-
34
- use **ADVANCED RULES ENGINE** to enter your rule expression.
35
-
36
- 7. Click on **Save** button.
37
-
38
- | **Basic Rules** | **Advanced Rules Engine** |
39
- | --------------------------- | ------------------------------------- |
40
- | ![Testomat.io - Basic rule](./images/Jira_2.png) | ![Testomat.io - Advanced Rules Engine](./images/Jira_3.png) |
41
-
42
- Now Testomat.io will create an issue with detailed information on Test Run results within your Jira project for failed Test Runs. So you don't need to put all the data on each Test Run manually. This helps to save time and notify all contributors in a convenient way.
43
-
44
- ![Testomat.io - Notification Jira](./images/Jira_4.png)
45
-
46
- :::note
47
-
48
- When **'Publish a report and use public link in report notification'** option is enabled, the public report will be generated and everyone who has this link will be able to see it.
49
-
50
- ![Testomat.io - Notification](./images/Public_Report.png)
51
-
52
- :::
@@ -1,60 +0,0 @@
1
- ---
2
- title: Microsoft Teams Notifications
3
- description: Configure Microsoft Teams notifications in Testomat.io to receive test updates. This guide provides detailed steps for setting up incoming webhooks in Teams, generating a Webhook URL, and linking it with Testomat.io for seamless test result notifications.
4
- type: article
5
- url: https://docs.testomat.io/integrations/report-notifications/ms-teams
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Microsoft Teams integration, Testomat.io, failed test runs, Notification rules, Report Notifications, Add Notification Rule, publish report, public link, basic rules, advanced rules engine, detailed test run results, test management, test automation, software testing
11
- ---
12
-
13
- To send noitifcations in MS Teams, first you need to set up **Incoming Webhooks** for your channel.
14
-
15
- Steps to configure:
16
-
17
- 1. Navigate to **Apps** panel.
18
- 2. Search for **Incoming Webhook** and add it ([read more here](https://learn.microsoft.com/en-us/microsoftteams/platform/webhooks-and-connectors/how-to/add-incoming-webhook?tabs=newteams%2Cdotnet)).
19
-
20
- ![Testomat.io - Notification Teams](./images/Teams_1.png)
21
-
22
- 3. Configure it and copy Webhook URL.
23
-
24
- ![Testomat.io - Notification Teams](./images/Teams_2.png)
25
-
26
- After Teams is Set up, open your Project in Testomat.io and go to the **Settings (1) -> Report Notifications(2)** and click on **Add Notification Rule (3)**.
27
-
28
- ![Testomat.io - Notification](./images/Notification.png)
29
-
30
- Create a new Notification Rule for Teams in Testomat.io following next steps:
31
-
32
- 1. Add a title for Notification Rule.
33
- 2. Choose **Microsoft Teams** from the dropdown list.
34
-
35
- ![Testomat.io - Notification Teams](./images/Teams_3.png)
36
-
37
- 3. Paste Teams Webhook URL.
38
- 4. Select **'Publish a report and use public link in report notification'** option, if you need it.
39
- 5. Configure rules to define on which conditions this notification should be sent in **BASIC RULES** section
40
-
41
- OR
42
-
43
- using **ADVANCED RULES ENGINE** to enter your rule expression.
44
-
45
- 6. Click on **Save** button.
46
-
47
- | **Basic Rules** | **Advanced Rules Engine** |
48
- | --------------------------- | ------------------------------------- |
49
- | ![Testomat.io - Basic rule](./images/Teams_4.png) | ![Testomat.io - Advanced Rules Engine](./images/Teams_5.png) |
50
-
51
- **How does it work?**
52
- Each time Testomat.io creates Run Report, which corresponds to your Teams Notification Rule, it will be sent to selected Teams channel.
53
-
54
- :::note
55
-
56
- When **'Publish a report and use public link in report notification'** option is enabled, the public report will be generated and everyone who has this link will be able to see it.
57
-
58
- ![Testomat.io - Notification](./images/Public_Report.png)
59
-
60
- :::
@@ -1,267 +0,0 @@
1
- ---
2
- title: Notification Rules
3
- description: Learn how to configure and manage notifications in Testomat.io for various channels, including Email, Slack, MS Teams, and Jira. This guide covers setting up notification rules, both basic and advanced, and demonstrates how to send alerts based on specific test run conditions. Streamline communication with automatic notifications for failed tests, test completion, and other custom triggers.
4
- type: article
5
- url: https://docs.testomat.io/integrations/report-notifications/rules
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: og:image
10
- content: https://docs.testomat.io/_astro/Basic_Rules.BGM4UhZJ_Z1Yiri8.webp
11
-
12
- - tag: meta
13
- attrs:
14
- name: keywords
15
- content: Testomat.io, notifications, Email alerts, Email notifications, Slack notifications, MS Teams, Jira integration, Jira Notification, Azure DevOps, Telegram notification, Notification rules, test runs, automated alerts, CI notifications, QA tools, notification channels, Report Notification, Basic rules, Advanced rules engine, Run Group Notifications, test management, test automation, software testing
16
- ---
17
-
18
- **Notification** is one of the attractive Agile testing tool features. Test management web application Testomat.io provides for collaborative purposes notification QA team, development team and business. So, keeping the teams engaged with project updates and getting fast feedback from business owners is simpler than ever! In addition, you as the test manager or team owner through **Team Management Dashboard** will have end-to-end visibility on your collaboration process.
19
-
20
- **Available to notify by:**
21
-
22
- - **Email** notifications.
23
- - **Slack** notification.
24
- - **Microsoft Teams** notification.
25
- - **Jira** notification.
26
- - **Azure DevOps** notification.
27
- - **Telegram** notification.
28
-
29
- Testomat.io allows sending notifications for finished runs:
30
-
31
- - Send brief reports to stakeholders.
32
- - Notify team members of failed or passed tests.
33
- - Notify test results after test executions.
34
- - Configure on which condition notification should be sent.
35
-
36
- Testomat.io has powerful rule engine which can be used to define on which conditions a notification should be sent. You can have multiple notification types with different notification channels in use for a single project.
37
-
38
- ![Testomat.io - Notification](./images/Rules.png)
39
-
40
- ## How to Setup Notification
41
-
42
- Sending configuration thanks to seamless integration is really simple. Enable notification you can on **Settings Dashboard** -> **Report Notification**. You are free to select an environment and configure condition notification should be sent. Simply fill the fields using **Basic rules**. Then modify your notification scheme to notify a group of people of your choice. Also, notification settings might be configured through the **Advanced rules engine** with using variables.
43
-
44
- You can read more about how to setup your notification in the sections below.
45
-
46
- ## Basic Rules
47
-
48
- There is a basic and advanced rules engine.
49
-
50
- Inside Basic rules you can define simple conditions on which notifications should be sent:
51
-
52
- 1. Runs with title.
53
- 2. Runs of RunGroup with title.
54
- 3. Run Type.
55
- 4. Run Status.
56
-
57
- ![Testomat.io - Basic Rules](./images/Basic_Rules.png)
58
-
59
- For instance, here is the rule for all manual runs with **"Release"** word in title to be reported:
60
-
61
- ![Testomat.io - Basic Rules](./images/Basic_Rules_1.png)
62
-
63
- ## Quick Toggle for Report Notifications
64
- You can enable or disable report notifications directly from the notification profile using a quick toggle. Switch notifications on or off without changing the full configuration. This is useful when notifications need to be temporarily paused during debugging or active development.
65
-
66
- ## Advanced Rules
67
-
68
- The advanced rules engine allows writing conditions in a special expression language similar to Ruby or JavaScript.
69
-
70
- This is the same rule we defined previously in Basic mode written in the format of Advanced mode. A notification will be sent for all manual runs that contain the word "Release":
71
-
72
- ```
73
- manual and contains(run, "Release")
74
- ```
75
-
76
- A complete list of allowed variables:
77
-
78
- - `automated` - boolean. True if a run is automated
79
- - `manual` - boolean. True if a run is manual
80
- - `has_failed` - boolean. True if a run has failed
81
- - `has_passed` - boolean. True if a run has passed
82
- - `was_terminated` - boolean. True if a run was terminated
83
- - `run` - string. Title of a run
84
- - `rungroup` - title. Title of rungroup a run belongs to
85
- - `status` - string. Status of run, 'passed' or 'failed' as a string.
86
- - `started_at` - datetime. Time when the run was started.
87
- - `finished_at` - datetime. Time when the run was finished
88
- - `passed_tests` - collection. A list of all passed tests in a run.
89
- - `failed_tests` - collection. A list of all failed tests in a run.
90
- - `skipped_tests` - collection. A list of all skipped tests in a run.
91
- - `env` - collection. A list of environments.
92
-
93
- An expression should return a boolean value. To deal with types other than boolean functions and methods can be used:
94
-
95
- **String**
96
-
97
- String values can be checked with equal `==` or not equal `!=` operators. Also there is `contains` function which checks inclusion of a string in another string:
98
-
99
- ```
100
- contains(run, "New")
101
- ```
102
-
103
- **Collection**
104
-
105
- Collections contain an array of objects.
106
-
107
- Use `.size` to check for the size of items in the collection. For instance, this rule is activated when a number of failed tests is more than 10.
108
-
109
- ```
110
- failed_tests.size > 10
111
- ```
112
-
113
- Collection of tests can be filtered. Tests in the collection have following properties:
114
-
115
- - `test['title']` - title of a test
116
- - `test['suite']` - title of a suite of a test
117
- - `test['id']` - id of a test
118
- - `test['suite_id']` - id of a suite
119
- - `test['status']` - status of a test in collection
120
-
121
- For instance, this is how to check if a collection of failed tests contains at least one test with `@important` tag in its name:
122
-
123
- ```
124
- failed_tests.filter(test, contains(test["title"], "@important")).size > 0
125
- ```
126
-
127
- **DateTime**
128
-
129
- `started_at` and `finished_at` variables are of datetime type. They have properties from [Date](https://ruby-doc.org/stdlib-2.6.1/libdoc/date/rdoc/Date.html) and [DateTime](https://ruby-doc.org/stdlib-2.6.1/libdoc/date/rdoc/DateTime.html) classes of Ruby that can be used in expressions. Most used ones are:
130
-
131
- - `hour`
132
- - `minute`
133
- - `day`
134
- - `wday`
135
- - `month`
136
- - `year`
137
- - [etc](https://ruby-doc.org/stdlib-2.6.1/libdoc/date/rdoc/Date.html)
138
-
139
- For instance, this is how notification can be enabled for reports finished in non-business time:
140
-
141
- ```
142
- (finished_at.hour > 18 or finished_at.hour < 9)
143
- ```
144
-
145
- ## Examples
146
-
147
- **Notify when tests are failing on CI:**
148
-
149
- To match tests executed on CI specify a Run title with "[CI]" prefix to identify that these tests were executed on CI:
150
-
151
- ```
152
- TESTOMATIO_TITLE="[CI] Automated Tests"
153
- ```
154
-
155
- Then write a notification rule that will check only for failing runs with "[CI]" in their title:
156
-
157
- ```
158
- contains(run, "[CI]") and has_failed
159
- ```
160
-
161
- **Notify when automated tests are terminated:**
162
-
163
- ```
164
- automated and was_terminated
165
- ```
166
-
167
- ### Examples for Runs Notifications
168
-
169
- **Notify when a Run has failed between 10 PM and 9 AM:**
170
-
171
- ```
172
- has_failed and (finished_at.hour > 22 or finished_at.hour < 9)
173
- ```
174
-
175
- **Notify when an automated Run has failed on alpha environment:**
176
-
177
- ```
178
- automated and has_failed and contains (env, "alpha”)
179
- ```
180
-
181
- **Notify when a Run that contains at least one test with the word "autocomplete" in the title has passed:**
182
-
183
- ```
184
- has_passed and passed_tests.filter(test, contains(test["title"], "autocomplete")).size > 0
185
- ```
186
-
187
- For example:
188
-
189
- ![Testomat.io - Run Rules](./images/Run_rule.png)
190
-
191
- And Run that matches this Notification rule:
192
-
193
- ![Testomat.io - Run Rules](./images/Run_rule_1.png)
194
-
195
- ## Run Group Notifications
196
-
197
- :::note
198
-
199
- Please note that Run Group Notifications are available for **Email notification** type only.
200
-
201
- :::
202
-
203
- To configure Notification Rule for Run Group you need:
204
-
205
- 1. Select rungroup for Notification rule context
206
- 2. Add your Rule Expression, for example, you can use `rungroup_finished` variable if you want to get notification when all Run report inside the group are finished.
207
-
208
- ![Alt text](./images/Rungroup.png)
209
-
210
- ### Rules for Run Group Notifications
211
-
212
- The rules engine allows writing conditions in a special expression language similar to Ruby or JavaScript.
213
-
214
- A list of allowed variables:
215
-
216
- - `title` - string. Title of a rungroup
217
- - `rungroup_finished` - boolean. True if all runs completed => True if rungroup contains only finished runs.
218
- - `runs` - collection. A list of all runs inside a rungroup
219
- - `finished_runs` - collection. A list of finished (passed or failed) runs inside a rungroup
220
- - `ongoing_runs` - collection. A list of pending runs (scheduled, in progress) runs inside a rungroup
221
- - `failed_runs` - collection. A list of failed runs inside a rungroup
222
-
223
- ### Examples for Run Groups Notifications
224
-
225
- **Notify when all runs within one Run Group (Run Group include more than 1 run) are finished:**
226
-
227
- ```
228
- (runs.size > 1) and rungroup_finished
229
- ```
230
-
231
- **Notify when there is at least one run in the `finished_runs` collection whose `finished_at` timestamp is older than 100 seconds ago:**
232
-
233
- ```
234
- finished_runs.filter(run, run['finished_at'] < 100.seconds_ago).size > 0
235
- ```
236
-
237
- **Notify when there are no currently ongoing runs in the run Group (means all runs are finished):**
238
-
239
- ```
240
- ongoing_runs.filter(run, run['created_at'] <= 0.seconds_ago).size == 0
241
- ```
242
-
243
- **Notify when next rules are met:**
244
-
245
- - the title of the Run Group contains the substring 'str-' and
246
- - all runs within this Run Group are finished and
247
- - at least one of the runs within this Run Group has a title that contains the exact string 'islast: true'
248
-
249
- ```
250
- contains(title, "str-") and rungroup_finished and (runs.select(run, contains(run["title"], "islast: true")).size > 0)
251
- ```
252
-
253
- For example:
254
-
255
- ![Testomat.io - RunGroup Rules](./images/RunGroup_rule.png)
256
-
257
- And Run Group that matches this Notification rule:
258
-
259
- ![Testomat.io - RunGroup Rules](./images/RunGroup_rule_1.png)
260
-
261
- :::note
262
-
263
- Testomat.io allows you to check which of your Runs or Run Groups match the created notification rule:
264
-
265
- ![Testomat.io - Rule Check](./images/Rule_check.gif)
266
-
267
- :::