testeiya 0.2.0 → 0.3.9

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (412) hide show
  1. package/LICENSE +21 -0
  2. package/README.md +37 -175
  3. package/dist/prompt/context.js +79 -0
  4. package/dist/prompt/context.js.map +1 -0
  5. package/dist/prompt/index.js +56 -0
  6. package/dist/prompt/index.js.map +1 -0
  7. package/dist/prompt/print.js +22 -0
  8. package/dist/prompt/print.js.map +1 -0
  9. package/dist/prompt/project-info.js +2 -0
  10. package/dist/prompt/project-info.js.map +1 -0
  11. package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +24 -21
  12. package/dist/prompt/system-prompt.js.map +1 -0
  13. package/dist/prompt/testomatio.js +264 -0
  14. package/dist/prompt/testomatio.js.map +1 -0
  15. package/dist/prompt/tools.js +49 -0
  16. package/dist/prompt/tools.js.map +1 -0
  17. package/dist/prompt/vocab.js +8 -0
  18. package/dist/prompt/vocab.js.map +1 -0
  19. package/dist/src/args.js +72 -0
  20. package/dist/src/args.js.map +1 -0
  21. package/dist/src/cli.js +61 -0
  22. package/dist/src/cli.js.map +1 -0
  23. package/dist/src/env.js +69 -0
  24. package/dist/src/env.js.map +1 -0
  25. package/dist/src/mcp-extension.js +9 -0
  26. package/dist/src/mcp-extension.js.map +1 -0
  27. package/dist/src/mcp.js +139 -0
  28. package/dist/src/mcp.js.map +1 -0
  29. package/dist/src/model.js +66 -0
  30. package/dist/src/model.js.map +1 -0
  31. package/dist/src/result.js +41 -0
  32. package/dist/src/result.js.map +1 -0
  33. package/dist/src/run.js +199 -0
  34. package/dist/src/run.js.map +1 -0
  35. package/dist/src/session.js +77 -0
  36. package/dist/src/session.js.map +1 -0
  37. package/dist/vendor/mcp.js +14801 -0
  38. package/mcp-tools.json +2967 -0
  39. package/package.json +29 -41
  40. package/prompt/context.ts +101 -0
  41. package/prompt/index.ts +93 -0
  42. package/prompt/print.ts +23 -0
  43. package/prompt/project-info.ts +30 -0
  44. package/prompt/system-prompt.ts +173 -0
  45. package/{src/prompt → prompt}/testomatio.ts +119 -8
  46. package/{src/prompt → prompt}/tools.ts +30 -8
  47. package/prompt/vocab.ts +7 -0
  48. package/{skills.lock.json → skills/skills.lock.json} +11 -7
  49. package/skills/skills.yaml +34 -0
  50. package/models.catalog.json +0 -6963
  51. package/skills/codeceptjs/ci-fix-tests/SKILL.md +0 -120
  52. package/skills/codeceptjs/codeceptjs-auth/SKILL.md +0 -158
  53. package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +0 -91
  54. package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +0 -158
  55. package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +0 -90
  56. package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +0 -234
  57. package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +0 -110
  58. package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +0 -306
  59. package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +0 -352
  60. package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +0 -472
  61. package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +0 -350
  62. package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +0 -81
  63. package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +0 -206
  64. package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
  65. package/skills/playwright-best-practices-skill/README.md +0 -147
  66. package/skills/playwright-best-practices-skill/SKILL.md +0 -303
  67. package/skills/playwright-best-practices-skill/advanced/authentication-flows.md +0 -360
  68. package/skills/playwright-best-practices-skill/advanced/authentication.md +0 -871
  69. package/skills/playwright-best-practices-skill/advanced/clock-mocking.md +0 -364
  70. package/skills/playwright-best-practices-skill/advanced/mobile-testing.md +0 -409
  71. package/skills/playwright-best-practices-skill/advanced/multi-context.md +0 -288
  72. package/skills/playwright-best-practices-skill/advanced/multi-user.md +0 -393
  73. package/skills/playwright-best-practices-skill/advanced/network-advanced.md +0 -452
  74. package/skills/playwright-best-practices-skill/advanced/third-party.md +0 -464
  75. package/skills/playwright-best-practices-skill/architecture/pom-vs-fixtures.md +0 -363
  76. package/skills/playwright-best-practices-skill/architecture/test-architecture.md +0 -369
  77. package/skills/playwright-best-practices-skill/architecture/when-to-mock.md +0 -383
  78. package/skills/playwright-best-practices-skill/browser-apis/browser-apis.md +0 -391
  79. package/skills/playwright-best-practices-skill/browser-apis/iframes.md +0 -403
  80. package/skills/playwright-best-practices-skill/browser-apis/service-workers.md +0 -504
  81. package/skills/playwright-best-practices-skill/browser-apis/websockets.md +0 -403
  82. package/skills/playwright-best-practices-skill/core/annotations.md +0 -424
  83. package/skills/playwright-best-practices-skill/core/assertions-waiting.md +0 -361
  84. package/skills/playwright-best-practices-skill/core/configuration.md +0 -452
  85. package/skills/playwright-best-practices-skill/core/fixtures-hooks.md +0 -417
  86. package/skills/playwright-best-practices-skill/core/global-setup.md +0 -434
  87. package/skills/playwright-best-practices-skill/core/locators.md +0 -242
  88. package/skills/playwright-best-practices-skill/core/page-object-model.md +0 -315
  89. package/skills/playwright-best-practices-skill/core/projects-dependencies.md +0 -453
  90. package/skills/playwright-best-practices-skill/core/test-data.md +0 -492
  91. package/skills/playwright-best-practices-skill/core/test-suite-structure.md +0 -361
  92. package/skills/playwright-best-practices-skill/core/test-tags.md +0 -298
  93. package/skills/playwright-best-practices-skill/debugging/console-errors.md +0 -420
  94. package/skills/playwright-best-practices-skill/debugging/debugging.md +0 -504
  95. package/skills/playwright-best-practices-skill/debugging/error-testing.md +0 -360
  96. package/skills/playwright-best-practices-skill/debugging/flaky-tests.md +0 -496
  97. package/skills/playwright-best-practices-skill/frameworks/angular.md +0 -530
  98. package/skills/playwright-best-practices-skill/frameworks/nextjs.md +0 -469
  99. package/skills/playwright-best-practices-skill/frameworks/react.md +0 -531
  100. package/skills/playwright-best-practices-skill/frameworks/vue.md +0 -574
  101. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/ci-cd.md +0 -468
  102. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/docker.md +0 -283
  103. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/github-actions.md +0 -546
  104. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/gitlab.md +0 -397
  105. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/other-providers.md +0 -521
  106. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/parallel-sharding.md +0 -371
  107. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/performance.md +0 -453
  108. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/reporting.md +0 -424
  109. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/test-coverage.md +0 -497
  110. package/skills/playwright-best-practices-skill/testing-patterns/accessibility.md +0 -359
  111. package/skills/playwright-best-practices-skill/testing-patterns/api-testing.md +0 -719
  112. package/skills/playwright-best-practices-skill/testing-patterns/browser-extensions.md +0 -506
  113. package/skills/playwright-best-practices-skill/testing-patterns/canvas-webgl.md +0 -493
  114. package/skills/playwright-best-practices-skill/testing-patterns/component-testing.md +0 -500
  115. package/skills/playwright-best-practices-skill/testing-patterns/drag-drop.md +0 -576
  116. package/skills/playwright-best-practices-skill/testing-patterns/electron.md +0 -509
  117. package/skills/playwright-best-practices-skill/testing-patterns/file-operations.md +0 -377
  118. package/skills/playwright-best-practices-skill/testing-patterns/file-upload-download.md +0 -562
  119. package/skills/playwright-best-practices-skill/testing-patterns/forms-validation.md +0 -561
  120. package/skills/playwright-best-practices-skill/testing-patterns/graphql-testing.md +0 -331
  121. package/skills/playwright-best-practices-skill/testing-patterns/i18n.md +0 -508
  122. package/skills/playwright-best-practices-skill/testing-patterns/performance-testing.md +0 -476
  123. package/skills/playwright-best-practices-skill/testing-patterns/security-testing.md +0 -430
  124. package/skills/playwright-best-practices-skill/testing-patterns/visual-regression.md +0 -634
  125. package/skills/playwright-cli/SKILL.md +0 -420
  126. package/skills/playwright-cli/references/element-attributes.md +0 -23
  127. package/skills/playwright-cli/references/playwright-tests.md +0 -39
  128. package/skills/playwright-cli/references/request-mocking.md +0 -87
  129. package/skills/playwright-cli/references/running-code.md +0 -241
  130. package/skills/playwright-cli/references/session-management.md +0 -225
  131. package/skills/playwright-cli/references/storage-state.md +0 -275
  132. package/skills/playwright-cli/references/test-generation.md +0 -433
  133. package/skills/playwright-cli/references/tracing.md +0 -139
  134. package/skills/playwright-cli/references/video-recording.md +0 -143
  135. package/skills/testeiya/README.md +0 -29
  136. package/skills/testeiya/answer-formatting/SKILL.md +0 -30
  137. package/skills/testeiya/check-cucumber/SKILL.md +0 -200
  138. package/skills/testeiya/check-tests/SKILL.md +0 -260
  139. package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
  140. package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
  141. package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
  142. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
  143. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
  144. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
  145. package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
  146. package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
  147. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
  148. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
  149. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
  150. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
  151. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
  152. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
  153. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
  154. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
  155. package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
  156. package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
  157. package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
  158. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
  159. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
  160. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
  161. package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
  162. package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
  163. package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
  164. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
  165. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
  166. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
  167. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
  168. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
  169. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
  170. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
  171. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
  172. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
  173. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
  174. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
  175. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
  176. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
  177. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
  178. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
  179. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
  180. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
  181. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
  182. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
  183. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
  184. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
  185. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
  186. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
  187. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
  188. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
  189. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
  190. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
  191. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
  192. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
  193. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
  194. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
  195. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
  196. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
  197. package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
  198. package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
  199. package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
  200. package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
  201. package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
  202. package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
  203. package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
  204. package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
  205. package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
  206. package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
  207. package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
  208. package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
  209. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
  210. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
  211. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
  212. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
  213. package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
  214. package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
  215. package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
  216. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
  217. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
  218. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
  219. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
  220. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
  221. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
  222. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
  223. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
  224. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
  225. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
  226. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
  227. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
  228. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
  229. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
  230. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
  231. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
  232. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
  233. package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
  234. package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
  235. package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
  236. package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
  237. package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
  238. package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
  239. package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
  240. package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
  241. package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
  242. package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
  243. package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
  244. package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
  245. package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
  246. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
  247. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
  248. package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
  249. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
  250. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
  251. package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
  252. package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
  253. package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
  254. package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
  255. package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
  256. package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
  257. package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
  258. package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
  259. package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
  260. package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
  261. package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
  262. package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
  263. package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
  264. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
  265. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
  266. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
  267. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
  268. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
  269. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
  270. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
  271. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
  272. package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
  273. package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
  274. package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
  275. package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
  276. package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
  277. package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
  278. package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
  279. package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
  280. package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
  281. package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
  282. package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
  283. package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
  284. package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +0 -88
  285. package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +0 -95
  286. package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +0 -334
  287. package/skills/testomatio/test-automation/automate-manual-test-cases/CLAUDE.md +0 -56
  288. package/skills/testomatio/test-automation/automate-manual-test-cases/SKILL.md +0 -242
  289. package/skills/testomatio/test-automation/automate-manual-test-cases/references/CODECEPTJS_BEST_PRACTICES.md +0 -182
  290. package/skills/testomatio/test-automation/automate-manual-test-cases/references/FINAL_SUMMARY_TEMPLATE.md +0 -22
  291. package/skills/testomatio/test-automation/automate-manual-test-cases/references/PLAYWRIGHT_BEST_PRACTICES.md +0 -90
  292. package/skills/testomatio/test-automation/automate-manual-test-cases/references/POM_BEST_PRACTICES.md +0 -53
  293. package/skills/testomatio/test-automation/automate-manual-test-cases/references/TEST_DATA_MANAGEMENT.md +0 -52
  294. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/SKILL.md +0 -107
  295. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/references/DEBUGGING_QUICK_REFERENCE.md +0 -113
  296. package/skills/testomatio/test-automation/qa-automation-test-consolidation/SKILL.md +0 -29
  297. package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +0 -151
  298. package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
  299. package/skills/testomatio/test-automation/testomat-allure-adapter/SKILL.md +0 -289
  300. package/skills/testomatio/test-management/detect-duplicate-test-cases/SKILL.md +0 -86
  301. package/skills/testomatio/test-management/detect-duplicate-test-cases/references/DUPLICATE_INSTRUCTIONS.md +0 -54
  302. package/skills/testomatio/test-management/improve-test-cases/SKILL.md +0 -114
  303. package/skills/testomatio/test-management/improve-test-cases/references/TESTOMAT_MARKDOWN_EXAMPLE.md +0 -66
  304. package/skills/testomatio/test-management/pull-request-diff-analyzer/SKILL.md +0 -141
  305. package/skills/testomatio/test-management/qa-e2e-tests-reporting/SKILL.md +0 -354
  306. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_ARTIFACTS.md +0 -82
  307. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_HTML_REPORT.md +0 -37
  308. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_REPORTERS_CONFIG.md +0 -118
  309. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/SKILL.md +0 -149
  310. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/references/summary-example.md +0 -54
  311. package/skills/testomatio/test-management/qa-requirement-reviewer/SKILL.md +0 -126
  312. package/skills/testomatio/test-management/qa-requirement-reviewer/references/requirements_reviewer_examples.md +0 -128
  313. package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +0 -174
  314. package/skills/testomatio/test-management/qa-test-code-coverage/references/COVERAGE_FILE_FORMAT.md +0 -138
  315. package/skills/testomatio/test-management/qa-test-code-coverage/references/E2E_FRAMEWORKS.md +0 -65
  316. package/skills/testomatio/test-management/qa-test-code-coverage/scripts/check-coverage.mjs +0 -40
  317. package/skills/testomatio/test-management/qa-thinking/SKILL.md +0 -36
  318. package/skills/testomatio/test-management/qa-write-test-cases/SKILL.md +0 -267
  319. package/skills/testomatio/test-management/qa-write-test-cases/references/test-case-format.md +0 -387
  320. package/skills/testomatio/test-management/qa-write-test-cases/references/testomat-tms-guide.md +0 -72
  321. package/skills/testomatio/test-management/qa-write-test-cases/references/writing-rule.md +0 -159
  322. package/skills/testomatio/test-management/scan-automation-project/SKILL.md +0 -152
  323. package/skills/testomatio/test-management/sync-test-cases-with-tms/SKILL.md +0 -107
  324. package/skills/testomatio/test-management/sync-test-cases-with-tms/references/TESTOMATIO_CLI.md +0 -140
  325. package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +0 -182
  326. package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +0 -169
  327. package/skills.yaml +0 -21
  328. package/src/ai-debug.ts +0 -188
  329. package/src/api/agent-get.ts +0 -22
  330. package/src/api/agent-start.ts +0 -384
  331. package/src/api/client-log.ts +0 -29
  332. package/src/api/context.ts +0 -332
  333. package/src/api/debug-layout.ts +0 -47
  334. package/src/api/debug-report.ts +0 -29
  335. package/src/api/debug-snapshot.ts +0 -30
  336. package/src/api/debug-stream.ts +0 -52
  337. package/src/api/files-delete.ts +0 -184
  338. package/src/api/files-read.ts +0 -41
  339. package/src/api/files-rename.ts +0 -99
  340. package/src/api/files-tree.ts +0 -292
  341. package/src/api/files-write.ts +0 -41
  342. package/src/api/mcp.ts +0 -603
  343. package/src/api/memory.ts +0 -69
  344. package/src/api/open-external.ts +0 -39
  345. package/src/api/playwright-cli.ts +0 -606
  346. package/src/api/providers.ts +0 -457
  347. package/src/api/read-env-token.ts +0 -33
  348. package/src/api/sessions.ts +0 -79
  349. package/src/api/settings.ts +0 -120
  350. package/src/api/skills.ts +0 -58
  351. package/src/api/testomatio-attachment.ts +0 -89
  352. package/src/api/testomatio-auth.ts +0 -284
  353. package/src/api/testomatio-proxy.ts +0 -197
  354. package/src/api/testomatio-run-stats.ts +0 -81
  355. package/src/api/testomatio-target.ts +0 -225
  356. package/src/api/testomatio-transcription.ts +0 -82
  357. package/src/api/workspace-search.ts +0 -96
  358. package/src/api/workspace-sync.ts +0 -151
  359. package/src/api/workspace.ts +0 -165
  360. package/src/app-server.ts +0 -556
  361. package/src/bridge.ts +0 -251
  362. package/src/check-tests.ts +0 -156
  363. package/src/cli.ts +0 -17
  364. package/src/commands.ts +0 -244
  365. package/src/config.ts +0 -183
  366. package/src/connection.ts +0 -658
  367. package/src/context-store.ts +0 -265
  368. package/src/debug-bus.ts +0 -405
  369. package/src/extensions/tool-gate.ts +0 -220
  370. package/src/extensions/webui/ask-channel.ts +0 -52
  371. package/src/extensions/webui/index.ts +0 -184
  372. package/src/extensions/webui/tools/ask-question.ts +0 -88
  373. package/src/extensions/webui/tools/query-result.ts +0 -79
  374. package/src/extensions/webui/tools/render-chart.ts +0 -53
  375. package/src/extensions/webui/tools/render-item.ts +0 -61
  376. package/src/extensions/webui/tools/render-list.ts +0 -170
  377. package/src/extensions/webui/tools/render-result.ts +0 -85
  378. package/src/extensions/webui/tools/render-tree.ts +0 -71
  379. package/src/extensions/webui/tools/ui-widget.ts +0 -54
  380. package/src/extensions/webui/tools/widget-result.ts +0 -13
  381. package/src/extensions/webui/widget-channel.ts +0 -50
  382. package/src/file-log.ts +0 -196
  383. package/src/git-tracked.ts +0 -68
  384. package/src/gitignore.ts +0 -53
  385. package/src/json-store.ts +0 -43
  386. package/src/load-env.ts +0 -70
  387. package/src/loader-style.ts +0 -96
  388. package/src/main.ts +0 -140
  389. package/src/mcp-catalog.ts +0 -96
  390. package/src/models-catalog.ts +0 -72
  391. package/src/permissions.ts +0 -120
  392. package/src/project-dir.ts +0 -189
  393. package/src/project-info.ts +0 -108
  394. package/src/prompt/app-ui.ts +0 -59
  395. package/src/prompt/browser.ts +0 -27
  396. package/src/prompt/index.ts +0 -62
  397. package/src/server-info.ts +0 -62
  398. package/src/session-factory.ts +0 -442
  399. package/src/session-store.ts +0 -115
  400. package/src/shell-env.ts +0 -45
  401. package/src/skills.ts +0 -163
  402. package/src/sync-snapshot.ts +0 -140
  403. package/src/telemetry.ts +0 -239
  404. package/src/testomatio-auth.ts +0 -299
  405. package/src/testomatio.ts +0 -98
  406. package/src/theme.ts +0 -30
  407. package/src/user-env.ts +0 -94
  408. package/src/welcome.ts +0 -127
  409. package/src/workspace/safe-path.ts +0 -85
  410. package/src/workspace/test-md.ts +0 -70
  411. package/src/workspace-model.ts +0 -440
  412. package/testeiya.config.json +0 -14
@@ -1,67 +0,0 @@
1
- ---
2
- title: Shortcut Configuration
3
- description: Learn how to integrate Shortcut with Testomat.io for effective issue tracking. This guide details how to retrieve your API Access Token and Workflow Name and provides step-by-step instructions to configure the Shortcut integration within Testomat.io seamlessly.
4
- type: article
5
- url: https://docs.testomat.io/integrations/issues-management/shortcut
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: og:image
10
- content: https://docs.testomat.io/_astro/New_UTbONHqM_2024-10-31.DUKqHBp2_YEDnG.webp
11
-
12
- - tag: meta
13
- attrs:
14
- name: keywords
15
- content: Shortcut integration, Testomat.io, issue management, API Access Token, Workflow Name, project management, test management tools, software testing, agile development
16
- ---
17
-
18
- If you already have a workspace configured in **Shortcut**, you're ready to integrate it with Testomat.io. To get started, you’ll need your **Workflow Name**, and **API Access Token**. We’ll walk you through each step to locate this information and connect it with Testomat.io.
19
-
20
- ![Testomat.io - Shortcut workspace](./images/New_OsYXONII_2024-11-21.png)
21
-
22
- To create the **API Access Token**, follow these steps:
23
-
24
- 1. Click on **Settings** button
25
- 2. Go to **API Tokens**
26
- 3. Enter **Token Name**
27
- 4. Click on **Generate Token** button
28
-
29
- ![Testomat.io - Shortcut Create Token](./images/New_ipmViSuc_2024-11-21.png)
30
-
31
- 5. Copy your API Token
32
-
33
- ![Testomat.io - Shortcut API Access Token](./images/New_xCU4yAtk_2024-11-21.png)
34
-
35
- Keep your **API Access Token** secure, as you’ll need it for the integration with Testomat.io.
36
-
37
- To locate the **Workflow Name**, follow these steps:
38
-
39
- 1. Click on **Settings** button
40
- 2. Go to **Workflows**
41
- 5. Copy your Workflow Name
42
-
43
- ![Testomat.io - Shortcut Workflow Name](./images/New_L83JSNf7_2024-11-21.png)
44
-
45
- After collecting all necessary data, we can move on to Testomat.io.
46
-
47
- 1. Select Shortcut from the list of available Issue Management Systems.
48
-
49
- ![Testomat.io - Connect to Shortcut](./images/New_FMxDuVut_2024-11-21.png)
50
-
51
- 2. Enter a **Profile Name**
52
- 3. Paste Shortcut **API Access Token**
53
- 4. Paste Shortcut **Workflow Name**
54
- 5. Click on **Save** button
55
-
56
- ![Testomat.io - Shortcut Configuration](./images/New_g9KgOr4g_2024-11-21.png)
57
-
58
- If everything was done correctly, you will receive a confirmation message indicating that the Shortcut profile was successfully created.
59
-
60
- ![Testomat.io - Shortcut Profile](./images/New_58FqfBg9_2024-11-21.png)
61
-
62
- ## Frequently Asked Questions (FAQ)
63
-
64
- **Q: Although linking an already existing Shortcut ticket does not work as I expected. When using **“Link to Issue”** and entering the Shortcut URL, it does not automatically create an external link on Shortcut.**
65
-
66
- A: This behavior is expected. When you use the **“Link to Issue”** feature in Testomat.io to attach an existing Shortcut ticket, it will not automatically create a backlink (external link) inside Shortcut. This limitation is caused by Shortcut’s API, which currently does not allow third-party tools to generate external links on already existing tickets.
67
-
@@ -1,94 +0,0 @@
1
- ---
2
- title: YouTrack Configuration
3
- description: Learn how to integrate YouTrack with Testomat.io for streamlined issue management. This guide explains how to retrieve your YouTrack Workspace Name, Personal Access Token, and Project ID, and then configure the integration within Testomat.io.
4
- type: article
5
- url: https://docs.testomat.io/integrations/issues-management/youtrack
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: og:image
10
- content: https://docs.testomat.io/_astro/New_UTbONHqM_2024-10-31.DUKqHBp2_YEDnG.webp
11
-
12
- - tag: meta
13
- attrs:
14
- name: keywords
15
- content: YouTrack integration, Testomat.io, issue tracking, personal access token, workspace configuration, project management, test management tools, software testing, bug tracking
16
- ---
17
-
18
- If you already have a workspace and project in YouTrack, you’re ready to integrate it with Testomat.io. To do so, you’ll need three items:
19
-
20
- - Workspace Name
21
- - Personal Access Token
22
- - Project ID
23
-
24
- This guide walks you through where to find each.
25
-
26
- ![Testomat.io - YouTrack Project](./images/New_US8feteR_2024-10-31.png)
27
-
28
- ## How to Find a Workspace Name
29
-
30
- You can find your **Workspace Name** in the browser **URL** when you're logged into YouTrack. For example: `[my-workspace].youtrack.cloud`
31
-
32
- ![Testomat.io - YouTrack Workspace Name](./images/New_kltLXnVA_2024-10-31.png)
33
-
34
- ## How to Create a Personal Access Token
35
-
36
- To create the **Personal Access Token**, follow these steps:
37
-
38
- 1. Click on the profile avatar
39
- 2. Go to **Profile**
40
- 3. Then go to **Account Security**
41
- 4. Click on **New token...** button
42
-
43
- ![Testomat.io - YouTrack Create Token](./images/New_pCUPQyzz_2024-10-31.png)
44
-
45
- 5. Enter a **Token** name
46
- 6. Select services (**YouTrack, YouTrack Administration**)
47
- 7. Click on **Create** button
48
-
49
- ![Testomat.io - YouTrack Personal Access Token](./images/New_WzTEWxkc_2024-10-31.png)
50
-
51
- Once the token has been created, copy it. Keep your Personal Access Token secure, as you’ll need it for the integration with Testomat.io.
52
-
53
- ## How to Get a Project ID
54
-
55
- Finally, to get the **Project ID**, follow these steps:
56
-
57
- 1. Open YouTrack [API Documentation](https://www.postman.com/youtrack-dev/youtrack/documentation/sd7pq8x/youtrack-rest-api)-> Administration -> Projects -> Read a List of Projects
58
- 2. Get a request:
59
-
60
- ```
61
- https://<your-workspace>.youtrack.cloud/api/admin/projects?fields=id,key,name
62
-
63
- ```
64
-
65
- 3. Paste your Personal Access Token
66
- 4. Click **Send** button and get your Project ID in the response body (e.g. `"id": "0-1"`)
67
-
68
- ![Get Project ID](./images/att1_youtrack.png)
69
-
70
- :::note
71
-
72
- The ID in the browser URL isn't the same as the project ID in the database.
73
-
74
- :::
75
-
76
- After collecting all necessary data, we can move on to Testomat.io.
77
-
78
- ## How to Connect YouTrack in Testomat.io
79
-
80
- 1. Select YouTrack from the list of available Issue Management Systems.
81
-
82
- ![Testomat.io - Connect to YouTrack](./images/New_F8MYluVy_2024-10-31.png)
83
-
84
- 2. Enter a **Profile Name**
85
- 3. Paste YouTrack **Workspace Name**
86
- 4. Paste YouTrack **Personal Access Token**
87
- 5. Paste YouTrack **Project ID**
88
- 6. Click on **Save** button
89
-
90
- ![Testomat.io - YouTrack Configuration](./images/New_UTbONHqM_2024-10-31.png)
91
-
92
- If everything was done correctly, you will receive a confirmation message indicating that the YouTrack profile was successfully created.
93
-
94
- ![Testomat.io - YouTrack Profile](./images/New_K1fdAe5k_2024-10-31.png)
@@ -1,53 +0,0 @@
1
- ---
2
- title: Azure DevOps Notifications
3
- description: Configure Azure DevOps notifications in Testomat.io to automate issue creation for failed test runs. This guide explains linking Azure DevOps projects, and setting notification rules to streamline workflows and save time by automating detailed test result reporting.
4
- type: article
5
- url: https://docs.testomat.io/integrations/report-notifications/azure-devops
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Azure DevOps, Testomat.io, issue tracking, Notification rules, Report Notifications, Azure DevOps integration, publish report, detailed test run results, test management, test automation, software testing, basic rules, advanced rules engine
11
- ---
12
-
13
- Testomat.io allows to create issue for failed test runs automatically in Azure DevOps. This option can be enabled in **Settings**.
14
-
15
- Before you set up Notification rules for Azure DevOps, you need to connect your Azure DevOps project with Testomat.io. Please follow the instuction in dedicated section - [Azure DevOps Configuration.](https://docs.testomat.io/integrations/issues-management/azure/)
16
-
17
- After the Azure DevOps is connected with Testomat.io, go to the **Settings (1) -> Report Notifications(2)** and click on **Add Notification Rule (3)**.
18
-
19
- ![Testomat.io - Notification](./images/Notification.png)
20
-
21
- To enable Notification for Azure DevOps follow next steps:
22
-
23
- 1. Add a title for Notification Rule.
24
- 2. Choose **Azure DevOps** from the dropdown list.
25
-
26
- ![Testomat.io - Notification Azure DevOps](./images/Azure_DevOps_1.png)
27
-
28
- 3. Select **Azure DevOps integration** from dropdown list.
29
- 4. Select **'Publish a report and use public link in report notification'** option, if you need it.
30
- 5. Configure rules to define on which conditions this notification should be sent in **BASIC RULES** section
31
-
32
- OR
33
-
34
- use **ADVANCED RULES ENGINE** to enter your rule expression.
35
-
36
- 6. Click on **Save** button.
37
-
38
- | **Basic Rules** | **Advanced Rules Engine** |
39
- | --------------------------- | ------------------------------------- |
40
- | ![Testomat.io - Basic rule](./images/Azure_DevOps_2.png) | ![Testomat.io - Advanced Rules Engine](./images/Azure_DevOps_3.png) |
41
-
42
- Testomat.io will now automatically create an issue with detailed Test Run results in your Azure DevOps project for any failed Test Runs. This eliminates the need to manually input data for each Test Run, saving you time and ensuring that all contributors are notified in a convenient way.
43
-
44
- ![Testomat.io - Notification Azure DevOps](./images/Azure_DevOps_4.png)
45
-
46
-
47
- :::note
48
-
49
- When **'Publish a report and use public link in report notification'** option is enabled, the public report will be generated and everyone who has this link will be able to see it.
50
-
51
- ![Testomat.io - Notification](./images/Public_Report.png)
52
-
53
- :::
@@ -1,71 +0,0 @@
1
- ---
2
- title: Email Notifications
3
- description: Learn how to configure email notifications in Testomat.io to receive updates on test run results. This guide covers setting notification rules, customizing fields, and managing multiple email recipients effectively.
4
- type: article
5
- url: https://docs.testomat.io/integrations/report-notifications/email
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Testomat.io, Email notifications, Report Notifications, Add Notification Rule, Run context, RunGroup context, basic rules, advanced rules engine, Run Report, multiple notifications, test management, test automation, software testing
11
- ---
12
-
13
- Testomat.io allows sending Notifications for finished runs via Email.
14
- Let's see how it works!
15
-
16
- First, you need to set up Email notifications in the Settings tab:
17
-
18
- 1. Go to **Settings**.
19
- 2. Select **Report Notifications** option.
20
- 3. Click on **Add Notification Rule**.
21
-
22
- ![Testomat.io - Notification](./images/Notification.png)
23
-
24
- At this point your next steps are:
25
-
26
- 4. Add a title for Notification Rule.
27
- 5. Choose **Email** from the dropdown list.
28
-
29
- ![Testomat.io - Notification Email](./images/Email_2.png)
30
-
31
- 6. Enter one or multiple email addresses (separated by coma) to receive notifications.
32
- 7. Select **'Publish a report and use public link in report notification'** option, if you need it.
33
- 8. Select **Notification rule context**: Run or RunGroup.
34
- 9. Add notification rules in **BASIC RULES** section
35
-
36
- OR
37
-
38
- use **ADVANCED RULES ENGINE** to enter your rule expression.
39
-
40
- 10. Click on **Save** button.
41
-
42
- | **Basic Rules** | **Advanced Rules Engine** |
43
- | --------------------------- | ------------------------------------- |
44
- | ![Testomat.io - Basic rule](./images/Email_3.png) | ![Testomat.io - Advanced Rules Engine](./images/Email_4.png) |
45
-
46
- Now you have Email Notification enabled for the project.
47
-
48
- ![Testomat.io - Notification Email](./images/Email_5.png)
49
-
50
- **How does it work?**
51
- Each time Testomat.io creates Run Report, which corresponds to your Email Notification Rule, it will be sent to email.
52
-
53
- ![Testomat.io - Notification Email](./images/Email_6.png)
54
-
55
- :::note
56
-
57
- You can set up multiple Email Notifications for different Rules.
58
-
59
- ![Testomat.io - Notification Email](./images/Email_7.png)
60
-
61
- :::
62
-
63
- :::note
64
-
65
- When **'Publish a report and use public link in report notification'** option is enabled, the public report will be generated and everyone who has this link will be able to see it.
66
-
67
- ![Testomat.io - Notification](./images/Public_Report.png)
68
-
69
- :::
70
-
71
-
@@ -1,52 +0,0 @@
1
- ---
2
- title: Jira Notifications
3
- description: Configure Jira notifications in Testomat.io to automate issue creation for failed test runs. This guide explains linking Jira projects, selecting issue types, and setting notification rules to streamline workflows and save time by automating detailed test result reporting.
4
- type: article
5
- url: https://docs.testomat.io/integrations/report-notifications/jira
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Testomat.io, Jira, automatic issue creation, failed test runs, Notification rules, Report Notifications, Add Notification Rule, Jira project, publish report, public link, basic rules, advanced rules engine, detailed test run results, test management, test automation, software testing
11
- ---
12
-
13
- Testomat.io allows to create Jira issue for failed test runs automatically. This option can be enabled in **Settings**.
14
- To do this, you need to connect Jira project with Testomat.io. Please see dedicated documentation - [Connecting to JIRA project.](https://docs.testomat.io/integration/jira/#connecting-to-jira-project)
15
-
16
- After the Jira is connected with Testomat.io, go to the **Settings (1) -> Report Notifications(2)** and click on **Add Notification Rule (3)**.
17
-
18
- ![Testomat.io - Notification](./images/Notification.png)
19
-
20
- To create a new Notification Rule for Jira follow next steps:
21
-
22
- 1. Add a title for Notification Rule.
23
- 2. Choose **Jira** from the dropdown list.
24
-
25
- ![Testomat.io - Notification Jira](./images/Jira_1.png)
26
-
27
- 3. Select your dedicated Jira project from **Jira Project** dropdown list.
28
- 4. Select needed issue type from **Issue Type** dropdown list.
29
- 5. Select **'Publish a report and use public link in report notification'** option, if you need it.
30
- 6. Configure rules to define on which conditions this notification should be sent in **BASIC RULES** section
31
-
32
- OR
33
-
34
- use **ADVANCED RULES ENGINE** to enter your rule expression.
35
-
36
- 7. Click on **Save** button.
37
-
38
- | **Basic Rules** | **Advanced Rules Engine** |
39
- | --------------------------- | ------------------------------------- |
40
- | ![Testomat.io - Basic rule](./images/Jira_2.png) | ![Testomat.io - Advanced Rules Engine](./images/Jira_3.png) |
41
-
42
- Now Testomat.io will create an issue with detailed information on Test Run results within your Jira project for failed Test Runs. So you don't need to put all the data on each Test Run manually. This helps to save time and notify all contributors in a convenient way.
43
-
44
- ![Testomat.io - Notification Jira](./images/Jira_4.png)
45
-
46
- :::note
47
-
48
- When **'Publish a report and use public link in report notification'** option is enabled, the public report will be generated and everyone who has this link will be able to see it.
49
-
50
- ![Testomat.io - Notification](./images/Public_Report.png)
51
-
52
- :::
@@ -1,60 +0,0 @@
1
- ---
2
- title: Microsoft Teams Notifications
3
- description: Configure Microsoft Teams notifications in Testomat.io to receive test updates. This guide provides detailed steps for setting up incoming webhooks in Teams, generating a Webhook URL, and linking it with Testomat.io for seamless test result notifications.
4
- type: article
5
- url: https://docs.testomat.io/integrations/report-notifications/ms-teams
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Microsoft Teams integration, Testomat.io, failed test runs, Notification rules, Report Notifications, Add Notification Rule, publish report, public link, basic rules, advanced rules engine, detailed test run results, test management, test automation, software testing
11
- ---
12
-
13
- To send noitifcations in MS Teams, first you need to set up **Incoming Webhooks** for your channel.
14
-
15
- Steps to configure:
16
-
17
- 1. Navigate to **Apps** panel.
18
- 2. Search for **Incoming Webhook** and add it ([read more here](https://learn.microsoft.com/en-us/microsoftteams/platform/webhooks-and-connectors/how-to/add-incoming-webhook?tabs=newteams%2Cdotnet)).
19
-
20
- ![Testomat.io - Notification Teams](./images/Teams_1.png)
21
-
22
- 3. Configure it and copy Webhook URL.
23
-
24
- ![Testomat.io - Notification Teams](./images/Teams_2.png)
25
-
26
- After Teams is Set up, open your Project in Testomat.io and go to the **Settings (1) -> Report Notifications(2)** and click on **Add Notification Rule (3)**.
27
-
28
- ![Testomat.io - Notification](./images/Notification.png)
29
-
30
- Create a new Notification Rule for Teams in Testomat.io following next steps:
31
-
32
- 1. Add a title for Notification Rule.
33
- 2. Choose **Microsoft Teams** from the dropdown list.
34
-
35
- ![Testomat.io - Notification Teams](./images/Teams_3.png)
36
-
37
- 3. Paste Teams Webhook URL.
38
- 4. Select **'Publish a report and use public link in report notification'** option, if you need it.
39
- 5. Configure rules to define on which conditions this notification should be sent in **BASIC RULES** section
40
-
41
- OR
42
-
43
- using **ADVANCED RULES ENGINE** to enter your rule expression.
44
-
45
- 6. Click on **Save** button.
46
-
47
- | **Basic Rules** | **Advanced Rules Engine** |
48
- | --------------------------- | ------------------------------------- |
49
- | ![Testomat.io - Basic rule](./images/Teams_4.png) | ![Testomat.io - Advanced Rules Engine](./images/Teams_5.png) |
50
-
51
- **How does it work?**
52
- Each time Testomat.io creates Run Report, which corresponds to your Teams Notification Rule, it will be sent to selected Teams channel.
53
-
54
- :::note
55
-
56
- When **'Publish a report and use public link in report notification'** option is enabled, the public report will be generated and everyone who has this link will be able to see it.
57
-
58
- ![Testomat.io - Notification](./images/Public_Report.png)
59
-
60
- :::
@@ -1,267 +0,0 @@
1
- ---
2
- title: Notification Rules
3
- description: Learn how to configure and manage notifications in Testomat.io for various channels, including Email, Slack, MS Teams, and Jira. This guide covers setting up notification rules, both basic and advanced, and demonstrates how to send alerts based on specific test run conditions. Streamline communication with automatic notifications for failed tests, test completion, and other custom triggers.
4
- type: article
5
- url: https://docs.testomat.io/integrations/report-notifications/rules
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: og:image
10
- content: https://docs.testomat.io/_astro/Basic_Rules.BGM4UhZJ_Z1Yiri8.webp
11
-
12
- - tag: meta
13
- attrs:
14
- name: keywords
15
- content: Testomat.io, notifications, Email alerts, Email notifications, Slack notifications, MS Teams, Jira integration, Jira Notification, Azure DevOps, Telegram notification, Notification rules, test runs, automated alerts, CI notifications, QA tools, notification channels, Report Notification, Basic rules, Advanced rules engine, Run Group Notifications, test management, test automation, software testing
16
- ---
17
-
18
- **Notification** is one of the attractive Agile testing tool features. Test management web application Testomat.io provides for collaborative purposes notification QA team, development team and business. So, keeping the teams engaged with project updates and getting fast feedback from business owners is simpler than ever! In addition, you as the test manager or team owner through **Team Management Dashboard** will have end-to-end visibility on your collaboration process.
19
-
20
- **Available to notify by:**
21
-
22
- - **Email** notifications.
23
- - **Slack** notification.
24
- - **Microsoft Teams** notification.
25
- - **Jira** notification.
26
- - **Azure DevOps** notification.
27
- - **Telegram** notification.
28
-
29
- Testomat.io allows sending notifications for finished runs:
30
-
31
- - Send brief reports to stakeholders.
32
- - Notify team members of failed or passed tests.
33
- - Notify test results after test executions.
34
- - Configure on which condition notification should be sent.
35
-
36
- Testomat.io has powerful rule engine which can be used to define on which conditions a notification should be sent. You can have multiple notification types with different notification channels in use for a single project.
37
-
38
- ![Testomat.io - Notification](./images/Rules.png)
39
-
40
- ## How to Setup Notification
41
-
42
- Sending configuration thanks to seamless integration is really simple. Enable notification you can on **Settings Dashboard** -> **Report Notification**. You are free to select an environment and configure condition notification should be sent. Simply fill the fields using **Basic rules**. Then modify your notification scheme to notify a group of people of your choice. Also, notification settings might be configured through the **Advanced rules engine** with using variables.
43
-
44
- You can read more about how to setup your notification in the sections below.
45
-
46
- ## Basic Rules
47
-
48
- There is a basic and advanced rules engine.
49
-
50
- Inside Basic rules you can define simple conditions on which notifications should be sent:
51
-
52
- 1. Runs with title.
53
- 2. Runs of RunGroup with title.
54
- 3. Run Type.
55
- 4. Run Status.
56
-
57
- ![Testomat.io - Basic Rules](./images/Basic_Rules.png)
58
-
59
- For instance, here is the rule for all manual runs with **"Release"** word in title to be reported:
60
-
61
- ![Testomat.io - Basic Rules](./images/Basic_Rules_1.png)
62
-
63
- ## Quick Toggle for Report Notifications
64
- You can enable or disable report notifications directly from the notification profile using a quick toggle. Switch notifications on or off without changing the full configuration. This is useful when notifications need to be temporarily paused during debugging or active development.
65
-
66
- ## Advanced Rules
67
-
68
- The advanced rules engine allows writing conditions in a special expression language similar to Ruby or JavaScript.
69
-
70
- This is the same rule we defined previously in Basic mode written in the format of Advanced mode. A notification will be sent for all manual runs that contain the word "Release":
71
-
72
- ```
73
- manual and contains(run, "Release")
74
- ```
75
-
76
- A complete list of allowed variables:
77
-
78
- - `automated` - boolean. True if a run is automated
79
- - `manual` - boolean. True if a run is manual
80
- - `has_failed` - boolean. True if a run has failed
81
- - `has_passed` - boolean. True if a run has passed
82
- - `was_terminated` - boolean. True if a run was terminated
83
- - `run` - string. Title of a run
84
- - `rungroup` - title. Title of rungroup a run belongs to
85
- - `status` - string. Status of run, 'passed' or 'failed' as a string.
86
- - `started_at` - datetime. Time when the run was started.
87
- - `finished_at` - datetime. Time when the run was finished
88
- - `passed_tests` - collection. A list of all passed tests in a run.
89
- - `failed_tests` - collection. A list of all failed tests in a run.
90
- - `skipped_tests` - collection. A list of all skipped tests in a run.
91
- - `env` - collection. A list of environments.
92
-
93
- An expression should return a boolean value. To deal with types other than boolean functions and methods can be used:
94
-
95
- **String**
96
-
97
- String values can be checked with equal `==` or not equal `!=` operators. Also there is `contains` function which checks inclusion of a string in another string:
98
-
99
- ```
100
- contains(run, "New")
101
- ```
102
-
103
- **Collection**
104
-
105
- Collections contain an array of objects.
106
-
107
- Use `.size` to check for the size of items in the collection. For instance, this rule is activated when a number of failed tests is more than 10.
108
-
109
- ```
110
- failed_tests.size > 10
111
- ```
112
-
113
- Collection of tests can be filtered. Tests in the collection have following properties:
114
-
115
- - `test['title']` - title of a test
116
- - `test['suite']` - title of a suite of a test
117
- - `test['id']` - id of a test
118
- - `test['suite_id']` - id of a suite
119
- - `test['status']` - status of a test in collection
120
-
121
- For instance, this is how to check if a collection of failed tests contains at least one test with `@important` tag in its name:
122
-
123
- ```
124
- failed_tests.filter(test, contains(test["title"], "@important")).size > 0
125
- ```
126
-
127
- **DateTime**
128
-
129
- `started_at` and `finished_at` variables are of datetime type. They have properties from [Date](https://ruby-doc.org/stdlib-2.6.1/libdoc/date/rdoc/Date.html) and [DateTime](https://ruby-doc.org/stdlib-2.6.1/libdoc/date/rdoc/DateTime.html) classes of Ruby that can be used in expressions. Most used ones are:
130
-
131
- - `hour`
132
- - `minute`
133
- - `day`
134
- - `wday`
135
- - `month`
136
- - `year`
137
- - [etc](https://ruby-doc.org/stdlib-2.6.1/libdoc/date/rdoc/Date.html)
138
-
139
- For instance, this is how notification can be enabled for reports finished in non-business time:
140
-
141
- ```
142
- (finished_at.hour > 18 or finished_at.hour < 9)
143
- ```
144
-
145
- ## Examples
146
-
147
- **Notify when tests are failing on CI:**
148
-
149
- To match tests executed on CI specify a Run title with "[CI]" prefix to identify that these tests were executed on CI:
150
-
151
- ```
152
- TESTOMATIO_TITLE="[CI] Automated Tests"
153
- ```
154
-
155
- Then write a notification rule that will check only for failing runs with "[CI]" in their title:
156
-
157
- ```
158
- contains(run, "[CI]") and has_failed
159
- ```
160
-
161
- **Notify when automated tests are terminated:**
162
-
163
- ```
164
- automated and was_terminated
165
- ```
166
-
167
- ### Examples for Runs Notifications
168
-
169
- **Notify when a Run has failed between 10 PM and 9 AM:**
170
-
171
- ```
172
- has_failed and (finished_at.hour > 22 or finished_at.hour < 9)
173
- ```
174
-
175
- **Notify when an automated Run has failed on alpha environment:**
176
-
177
- ```
178
- automated and has_failed and contains (env, "alpha”)
179
- ```
180
-
181
- **Notify when a Run that contains at least one test with the word "autocomplete" in the title has passed:**
182
-
183
- ```
184
- has_passed and passed_tests.filter(test, contains(test["title"], "autocomplete")).size > 0
185
- ```
186
-
187
- For example:
188
-
189
- ![Testomat.io - Run Rules](./images/Run_rule.png)
190
-
191
- And Run that matches this Notification rule:
192
-
193
- ![Testomat.io - Run Rules](./images/Run_rule_1.png)
194
-
195
- ## Run Group Notifications
196
-
197
- :::note
198
-
199
- Please note that Run Group Notifications are available for **Email notification** type only.
200
-
201
- :::
202
-
203
- To configure Notification Rule for Run Group you need:
204
-
205
- 1. Select rungroup for Notification rule context
206
- 2. Add your Rule Expression, for example, you can use `rungroup_finished` variable if you want to get notification when all Run report inside the group are finished.
207
-
208
- ![Alt text](./images/Rungroup.png)
209
-
210
- ### Rules for Run Group Notifications
211
-
212
- The rules engine allows writing conditions in a special expression language similar to Ruby or JavaScript.
213
-
214
- A list of allowed variables:
215
-
216
- - `title` - string. Title of a rungroup
217
- - `rungroup_finished` - boolean. True if all runs completed => True if rungroup contains only finished runs.
218
- - `runs` - collection. A list of all runs inside a rungroup
219
- - `finished_runs` - collection. A list of finished (passed or failed) runs inside a rungroup
220
- - `ongoing_runs` - collection. A list of pending runs (scheduled, in progress) runs inside a rungroup
221
- - `failed_runs` - collection. A list of failed runs inside a rungroup
222
-
223
- ### Examples for Run Groups Notifications
224
-
225
- **Notify when all runs within one Run Group (Run Group include more than 1 run) are finished:**
226
-
227
- ```
228
- (runs.size > 1) and rungroup_finished
229
- ```
230
-
231
- **Notify when there is at least one run in the `finished_runs` collection whose `finished_at` timestamp is older than 100 seconds ago:**
232
-
233
- ```
234
- finished_runs.filter(run, run['finished_at'] < 100.seconds_ago).size > 0
235
- ```
236
-
237
- **Notify when there are no currently ongoing runs in the run Group (means all runs are finished):**
238
-
239
- ```
240
- ongoing_runs.filter(run, run['created_at'] <= 0.seconds_ago).size == 0
241
- ```
242
-
243
- **Notify when next rules are met:**
244
-
245
- - the title of the Run Group contains the substring 'str-' and
246
- - all runs within this Run Group are finished and
247
- - at least one of the runs within this Run Group has a title that contains the exact string 'islast: true'
248
-
249
- ```
250
- contains(title, "str-") and rungroup_finished and (runs.select(run, contains(run["title"], "islast: true")).size > 0)
251
- ```
252
-
253
- For example:
254
-
255
- ![Testomat.io - RunGroup Rules](./images/RunGroup_rule.png)
256
-
257
- And Run Group that matches this Notification rule:
258
-
259
- ![Testomat.io - RunGroup Rules](./images/RunGroup_rule_1.png)
260
-
261
- :::note
262
-
263
- Testomat.io allows you to check which of your Runs or Run Groups match the created notification rule:
264
-
265
- ![Testomat.io - Rule Check](./images/Rule_check.gif)
266
-
267
- :::