testeiya 0.2.1 → 0.3.10

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (402) hide show
  1. package/LICENSE +21 -0
  2. package/README.md +284 -171
  3. package/dist/prompt/context.js +79 -0
  4. package/dist/prompt/context.js.map +1 -0
  5. package/dist/prompt/index.js +60 -0
  6. package/dist/prompt/index.js.map +1 -0
  7. package/dist/prompt/print.js +30 -0
  8. package/dist/prompt/print.js.map +1 -0
  9. package/dist/prompt/project-info.js +2 -0
  10. package/dist/prompt/project-info.js.map +1 -0
  11. package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +38 -25
  12. package/dist/prompt/system-prompt.js.map +1 -0
  13. package/dist/prompt/testomatio.js +264 -0
  14. package/dist/prompt/testomatio.js.map +1 -0
  15. package/dist/prompt/tools.js +57 -0
  16. package/dist/prompt/tools.js.map +1 -0
  17. package/dist/prompt/vocab.js +8 -0
  18. package/dist/prompt/vocab.js.map +1 -0
  19. package/dist/src/args.js +172 -0
  20. package/dist/src/args.js.map +1 -0
  21. package/dist/src/cli.js +97 -0
  22. package/dist/src/cli.js.map +1 -0
  23. package/dist/src/doctor.js +186 -0
  24. package/dist/src/doctor.js.map +1 -0
  25. package/dist/src/env.js +93 -0
  26. package/dist/src/env.js.map +1 -0
  27. package/dist/src/mcp-extension.js +9 -0
  28. package/dist/src/mcp-extension.js.map +1 -0
  29. package/dist/src/mcp.js +139 -0
  30. package/dist/src/mcp.js.map +1 -0
  31. package/dist/src/model.js +71 -0
  32. package/dist/src/model.js.map +1 -0
  33. package/dist/src/models.js +38 -0
  34. package/dist/src/models.js.map +1 -0
  35. package/dist/src/output.js +185 -0
  36. package/dist/src/output.js.map +1 -0
  37. package/dist/src/result.js +41 -0
  38. package/dist/src/result.js.map +1 -0
  39. package/dist/src/run.js +291 -0
  40. package/dist/src/run.js.map +1 -0
  41. package/dist/src/session.js +92 -0
  42. package/dist/src/session.js.map +1 -0
  43. package/dist/src/sessions.js +61 -0
  44. package/dist/src/sessions.js.map +1 -0
  45. package/dist/vendor/mcp.js +14801 -0
  46. package/mcp-tools.json +2967 -0
  47. package/package.json +34 -43
  48. package/prompt/context.ts +101 -0
  49. package/prompt/index.ts +102 -0
  50. package/prompt/print.ts +32 -0
  51. package/prompt/project-info.ts +30 -0
  52. package/prompt/system-prompt.ts +187 -0
  53. package/{src/prompt → prompt}/testomatio.ts +120 -9
  54. package/prompt/tools.ts +57 -0
  55. package/prompt/vocab.ts +7 -0
  56. package/skills/codeceptjs/ci-fix-tests/SKILL.md +7 -8
  57. package/skills/codeceptjs/codeceptjs-auth/SKILL.md +47 -64
  58. package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +56 -47
  59. package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +144 -106
  60. package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +50 -57
  61. package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +88 -196
  62. package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +4 -5
  63. package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +25 -36
  64. package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +23 -36
  65. package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +23 -36
  66. package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +23 -35
  67. package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +50 -53
  68. package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +87 -191
  69. package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/SKILL.md +1 -1
  70. package/{skills.lock.json → skills/skills.lock.json} +43 -36
  71. package/skills/skills.yaml +34 -0
  72. package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +49 -61
  73. package/skills/testomatio/explorbot/explorbot-fundamentals/references/no-install.md +36 -0
  74. package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +20 -7
  75. package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +41 -289
  76. package/skills/testomatio/qa-process/qa-explain-behavior/SKILL.md +111 -0
  77. package/skills/testomatio/qa-process/qa-explain-behavior/references/answer-shapes.md +116 -0
  78. package/skills/testomatio/qa-process/qa-explain-behavior/references/examples.md +157 -0
  79. package/skills/testomatio/qa-process/qa-lead-strategy-advisor/SKILL.md +91 -0
  80. package/skills/testomatio/qa-process/qa-lead-strategy-advisor/references/output-format.md +71 -0
  81. package/skills/testomatio/qa-process/testing-workflow/SKILL.md +227 -0
  82. package/skills/testomatio/test-automation/qa-data-seeder/SKILL.md +83 -0
  83. package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +5 -3
  84. package/skills/testomatio/test-automation/setup-change-aware-pr-testing/SKILL.md +190 -0
  85. package/skills/testomatio/test-automation/setup-ci-automation/SKILL.md +76 -0
  86. package/skills/testomatio/test-management/qa-split-testing-levels-pyramid/SKILL.md +55 -0
  87. package/skills/testomatio/test-management/qa-sprint-report-by-testomatio/SKILL.md +220 -0
  88. package/skills/testomatio/test-management/qa-sprint-report-by-testomatio/references/qa-sprint-report.md +126 -0
  89. package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +1 -1
  90. package/skills/testomatio/test-management/qa-thinking/SKILL.md +25 -25
  91. package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +14 -1
  92. package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +8 -0
  93. package/assets/testeiya-logo-dark.svg +0 -16
  94. package/assets/testeiya-logo.svg +0 -15
  95. package/models.catalog.json +0 -6963
  96. package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
  97. package/skills/playwright-best-practices-skill/README.md +0 -147
  98. package/skills/testeiya/README.md +0 -29
  99. package/skills/testeiya/answer-formatting/SKILL.md +0 -30
  100. package/skills/testeiya/check-cucumber/SKILL.md +0 -200
  101. package/skills/testeiya/check-tests/SKILL.md +0 -260
  102. package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
  103. package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
  104. package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
  105. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
  106. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
  107. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
  108. package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
  109. package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
  110. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
  111. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
  112. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
  113. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
  114. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
  115. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
  116. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
  117. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
  118. package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
  119. package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
  120. package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
  121. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
  122. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
  123. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
  124. package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
  125. package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
  126. package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
  127. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
  128. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
  129. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
  130. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
  131. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
  132. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
  133. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
  134. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
  135. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
  136. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
  137. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
  138. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
  139. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
  140. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
  141. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
  142. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
  143. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
  144. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
  145. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
  146. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
  147. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
  148. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
  149. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
  150. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
  151. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
  152. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
  153. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
  154. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
  155. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
  156. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
  157. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
  158. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
  159. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
  160. package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
  161. package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
  162. package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
  163. package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
  164. package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
  165. package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
  166. package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
  167. package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
  168. package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
  169. package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
  170. package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
  171. package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
  172. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
  173. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
  174. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
  175. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
  176. package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
  177. package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
  178. package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
  179. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
  180. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
  181. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
  182. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
  183. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
  184. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
  185. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
  186. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
  187. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
  188. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
  189. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
  190. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
  191. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
  192. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
  193. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
  194. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
  195. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
  196. package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
  197. package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
  198. package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
  199. package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
  200. package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
  201. package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
  202. package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
  203. package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
  204. package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
  205. package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
  206. package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
  207. package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
  208. package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
  209. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
  210. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
  211. package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
  212. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
  213. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
  214. package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
  215. package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
  216. package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
  217. package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
  218. package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
  219. package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
  220. package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
  221. package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
  222. package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
  223. package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
  224. package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
  225. package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
  226. package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
  227. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
  228. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
  229. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
  230. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
  231. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
  232. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
  233. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
  234. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
  235. package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
  236. package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
  237. package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
  238. package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
  239. package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
  240. package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
  241. package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
  242. package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
  243. package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
  244. package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
  245. package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
  246. package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
  247. package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
  248. package/skills.yaml +0 -21
  249. package/src/ai-debug.ts +0 -188
  250. package/src/api/agent-get.ts +0 -22
  251. package/src/api/agent-start.ts +0 -384
  252. package/src/api/client-log.ts +0 -29
  253. package/src/api/context.ts +0 -332
  254. package/src/api/debug-layout.ts +0 -47
  255. package/src/api/debug-report.ts +0 -29
  256. package/src/api/debug-snapshot.ts +0 -30
  257. package/src/api/debug-stream.ts +0 -52
  258. package/src/api/files-delete.ts +0 -184
  259. package/src/api/files-read.ts +0 -41
  260. package/src/api/files-rename.ts +0 -99
  261. package/src/api/files-tree.ts +0 -292
  262. package/src/api/files-write.ts +0 -41
  263. package/src/api/mcp.ts +0 -603
  264. package/src/api/memory.ts +0 -69
  265. package/src/api/open-external.ts +0 -39
  266. package/src/api/playwright-cli.ts +0 -606
  267. package/src/api/providers.ts +0 -457
  268. package/src/api/read-env-token.ts +0 -33
  269. package/src/api/sessions.ts +0 -79
  270. package/src/api/settings.ts +0 -120
  271. package/src/api/skills.ts +0 -58
  272. package/src/api/testomatio-attachment.ts +0 -89
  273. package/src/api/testomatio-auth.ts +0 -284
  274. package/src/api/testomatio-proxy.ts +0 -197
  275. package/src/api/testomatio-run-stats.ts +0 -81
  276. package/src/api/testomatio-target.ts +0 -225
  277. package/src/api/testomatio-transcription.ts +0 -82
  278. package/src/api/workspace-search.ts +0 -96
  279. package/src/api/workspace-sync.ts +0 -151
  280. package/src/api/workspace.ts +0 -165
  281. package/src/app-server.ts +0 -556
  282. package/src/bridge.ts +0 -251
  283. package/src/check-tests.ts +0 -156
  284. package/src/cli.ts +0 -17
  285. package/src/commands.ts +0 -244
  286. package/src/config.ts +0 -183
  287. package/src/connection.ts +0 -658
  288. package/src/context-store.ts +0 -265
  289. package/src/debug-bus.ts +0 -405
  290. package/src/extensions/tool-gate.ts +0 -220
  291. package/src/extensions/webui/ask-channel.ts +0 -52
  292. package/src/extensions/webui/index.ts +0 -184
  293. package/src/extensions/webui/tools/ask-question.ts +0 -88
  294. package/src/extensions/webui/tools/query-result.ts +0 -79
  295. package/src/extensions/webui/tools/render-chart.ts +0 -53
  296. package/src/extensions/webui/tools/render-item.ts +0 -61
  297. package/src/extensions/webui/tools/render-list.ts +0 -170
  298. package/src/extensions/webui/tools/render-result.ts +0 -85
  299. package/src/extensions/webui/tools/render-tree.ts +0 -71
  300. package/src/extensions/webui/tools/ui-widget.ts +0 -54
  301. package/src/extensions/webui/tools/widget-result.ts +0 -13
  302. package/src/extensions/webui/widget-channel.ts +0 -50
  303. package/src/file-log.ts +0 -196
  304. package/src/git-tracked.ts +0 -68
  305. package/src/gitignore.ts +0 -53
  306. package/src/json-store.ts +0 -43
  307. package/src/load-env.ts +0 -70
  308. package/src/loader-style.ts +0 -96
  309. package/src/main.ts +0 -140
  310. package/src/mcp-catalog.ts +0 -96
  311. package/src/models-catalog.ts +0 -72
  312. package/src/permissions.ts +0 -120
  313. package/src/project-dir.ts +0 -189
  314. package/src/project-info.ts +0 -108
  315. package/src/prompt/app-ui.ts +0 -59
  316. package/src/prompt/browser.ts +0 -27
  317. package/src/prompt/index.ts +0 -62
  318. package/src/prompt/tools.ts +0 -27
  319. package/src/server-info.ts +0 -62
  320. package/src/session-factory.ts +0 -442
  321. package/src/session-store.ts +0 -115
  322. package/src/shell-env.ts +0 -45
  323. package/src/skills.ts +0 -163
  324. package/src/sync-snapshot.ts +0 -140
  325. package/src/telemetry.ts +0 -239
  326. package/src/testomatio-auth.ts +0 -299
  327. package/src/testomatio.ts +0 -98
  328. package/src/theme.ts +0 -30
  329. package/src/user-env.ts +0 -94
  330. package/src/welcome.ts +0 -194
  331. package/src/workspace/safe-path.ts +0 -85
  332. package/src/workspace/test-md.ts +0 -70
  333. package/src/workspace-model.ts +0 -440
  334. package/testeiya.config.json +0 -14
  335. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/authentication-flows.md +0 -0
  336. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/authentication.md +0 -0
  337. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/clock-mocking.md +0 -0
  338. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/mobile-testing.md +0 -0
  339. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/multi-context.md +0 -0
  340. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/multi-user.md +0 -0
  341. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/network-advanced.md +0 -0
  342. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/third-party.md +0 -0
  343. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/pom-vs-fixtures.md +0 -0
  344. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/test-architecture.md +0 -0
  345. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/when-to-mock.md +0 -0
  346. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/browser-apis.md +0 -0
  347. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/iframes.md +0 -0
  348. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/service-workers.md +0 -0
  349. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/websockets.md +0 -0
  350. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/annotations.md +0 -0
  351. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/assertions-waiting.md +0 -0
  352. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/configuration.md +0 -0
  353. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/fixtures-hooks.md +0 -0
  354. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/global-setup.md +0 -0
  355. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/locators.md +0 -0
  356. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/page-object-model.md +0 -0
  357. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/projects-dependencies.md +0 -0
  358. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-data.md +0 -0
  359. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-suite-structure.md +0 -0
  360. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-tags.md +0 -0
  361. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/console-errors.md +0 -0
  362. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/debugging.md +0 -0
  363. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/error-testing.md +0 -0
  364. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/flaky-tests.md +0 -0
  365. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/angular.md +0 -0
  366. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/nextjs.md +0 -0
  367. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/react.md +0 -0
  368. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/vue.md +0 -0
  369. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/ci-cd.md +0 -0
  370. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/docker.md +0 -0
  371. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/github-actions.md +0 -0
  372. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/gitlab.md +0 -0
  373. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/other-providers.md +0 -0
  374. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/parallel-sharding.md +0 -0
  375. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/performance.md +0 -0
  376. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/reporting.md +0 -0
  377. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/test-coverage.md +0 -0
  378. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/accessibility.md +0 -0
  379. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/api-testing.md +0 -0
  380. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/browser-extensions.md +0 -0
  381. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/canvas-webgl.md +0 -0
  382. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/component-testing.md +0 -0
  383. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/drag-drop.md +0 -0
  384. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/electron.md +0 -0
  385. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/file-operations.md +0 -0
  386. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/file-upload-download.md +0 -0
  387. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/forms-validation.md +0 -0
  388. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/graphql-testing.md +0 -0
  389. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/i18n.md +0 -0
  390. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/performance-testing.md +0 -0
  391. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/security-testing.md +0 -0
  392. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/visual-regression.md +0 -0
  393. /package/skills/{playwright-cli → playwright/playwright-cli}/SKILL.md +0 -0
  394. /package/skills/{playwright-cli → playwright/playwright-cli}/references/element-attributes.md +0 -0
  395. /package/skills/{playwright-cli → playwright/playwright-cli}/references/playwright-tests.md +0 -0
  396. /package/skills/{playwright-cli → playwright/playwright-cli}/references/request-mocking.md +0 -0
  397. /package/skills/{playwright-cli → playwright/playwright-cli}/references/running-code.md +0 -0
  398. /package/skills/{playwright-cli → playwright/playwright-cli}/references/session-management.md +0 -0
  399. /package/skills/{playwright-cli → playwright/playwright-cli}/references/storage-state.md +0 -0
  400. /package/skills/{playwright-cli → playwright/playwright-cli}/references/test-generation.md +0 -0
  401. /package/skills/{playwright-cli → playwright/playwright-cli}/references/tracing.md +0 -0
  402. /package/skills/{playwright-cli → playwright/playwright-cli}/references/video-recording.md +0 -0
@@ -1,67 +0,0 @@
1
- ---
2
- title: Shortcut Configuration
3
- description: Learn how to integrate Shortcut with Testomat.io for effective issue tracking. This guide details how to retrieve your API Access Token and Workflow Name and provides step-by-step instructions to configure the Shortcut integration within Testomat.io seamlessly.
4
- type: article
5
- url: https://docs.testomat.io/integrations/issues-management/shortcut
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: og:image
10
- content: https://docs.testomat.io/_astro/New_UTbONHqM_2024-10-31.DUKqHBp2_YEDnG.webp
11
-
12
- - tag: meta
13
- attrs:
14
- name: keywords
15
- content: Shortcut integration, Testomat.io, issue management, API Access Token, Workflow Name, project management, test management tools, software testing, agile development
16
- ---
17
-
18
- If you already have a workspace configured in **Shortcut**, you're ready to integrate it with Testomat.io. To get started, you’ll need your **Workflow Name**, and **API Access Token**. We’ll walk you through each step to locate this information and connect it with Testomat.io.
19
-
20
- ![Testomat.io - Shortcut workspace](./images/New_OsYXONII_2024-11-21.png)
21
-
22
- To create the **API Access Token**, follow these steps:
23
-
24
- 1. Click on **Settings** button
25
- 2. Go to **API Tokens**
26
- 3. Enter **Token Name**
27
- 4. Click on **Generate Token** button
28
-
29
- ![Testomat.io - Shortcut Create Token](./images/New_ipmViSuc_2024-11-21.png)
30
-
31
- 5. Copy your API Token
32
-
33
- ![Testomat.io - Shortcut API Access Token](./images/New_xCU4yAtk_2024-11-21.png)
34
-
35
- Keep your **API Access Token** secure, as you’ll need it for the integration with Testomat.io.
36
-
37
- To locate the **Workflow Name**, follow these steps:
38
-
39
- 1. Click on **Settings** button
40
- 2. Go to **Workflows**
41
- 5. Copy your Workflow Name
42
-
43
- ![Testomat.io - Shortcut Workflow Name](./images/New_L83JSNf7_2024-11-21.png)
44
-
45
- After collecting all necessary data, we can move on to Testomat.io.
46
-
47
- 1. Select Shortcut from the list of available Issue Management Systems.
48
-
49
- ![Testomat.io - Connect to Shortcut](./images/New_FMxDuVut_2024-11-21.png)
50
-
51
- 2. Enter a **Profile Name**
52
- 3. Paste Shortcut **API Access Token**
53
- 4. Paste Shortcut **Workflow Name**
54
- 5. Click on **Save** button
55
-
56
- ![Testomat.io - Shortcut Configuration](./images/New_g9KgOr4g_2024-11-21.png)
57
-
58
- If everything was done correctly, you will receive a confirmation message indicating that the Shortcut profile was successfully created.
59
-
60
- ![Testomat.io - Shortcut Profile](./images/New_58FqfBg9_2024-11-21.png)
61
-
62
- ## Frequently Asked Questions (FAQ)
63
-
64
- **Q: Although linking an already existing Shortcut ticket does not work as I expected. When using **“Link to Issue”** and entering the Shortcut URL, it does not automatically create an external link on Shortcut.**
65
-
66
- A: This behavior is expected. When you use the **“Link to Issue”** feature in Testomat.io to attach an existing Shortcut ticket, it will not automatically create a backlink (external link) inside Shortcut. This limitation is caused by Shortcut’s API, which currently does not allow third-party tools to generate external links on already existing tickets.
67
-
@@ -1,94 +0,0 @@
1
- ---
2
- title: YouTrack Configuration
3
- description: Learn how to integrate YouTrack with Testomat.io for streamlined issue management. This guide explains how to retrieve your YouTrack Workspace Name, Personal Access Token, and Project ID, and then configure the integration within Testomat.io.
4
- type: article
5
- url: https://docs.testomat.io/integrations/issues-management/youtrack
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: og:image
10
- content: https://docs.testomat.io/_astro/New_UTbONHqM_2024-10-31.DUKqHBp2_YEDnG.webp
11
-
12
- - tag: meta
13
- attrs:
14
- name: keywords
15
- content: YouTrack integration, Testomat.io, issue tracking, personal access token, workspace configuration, project management, test management tools, software testing, bug tracking
16
- ---
17
-
18
- If you already have a workspace and project in YouTrack, you’re ready to integrate it with Testomat.io. To do so, you’ll need three items:
19
-
20
- - Workspace Name
21
- - Personal Access Token
22
- - Project ID
23
-
24
- This guide walks you through where to find each.
25
-
26
- ![Testomat.io - YouTrack Project](./images/New_US8feteR_2024-10-31.png)
27
-
28
- ## How to Find a Workspace Name
29
-
30
- You can find your **Workspace Name** in the browser **URL** when you're logged into YouTrack. For example: `[my-workspace].youtrack.cloud`
31
-
32
- ![Testomat.io - YouTrack Workspace Name](./images/New_kltLXnVA_2024-10-31.png)
33
-
34
- ## How to Create a Personal Access Token
35
-
36
- To create the **Personal Access Token**, follow these steps:
37
-
38
- 1. Click on the profile avatar
39
- 2. Go to **Profile**
40
- 3. Then go to **Account Security**
41
- 4. Click on **New token...** button
42
-
43
- ![Testomat.io - YouTrack Create Token](./images/New_pCUPQyzz_2024-10-31.png)
44
-
45
- 5. Enter a **Token** name
46
- 6. Select services (**YouTrack, YouTrack Administration**)
47
- 7. Click on **Create** button
48
-
49
- ![Testomat.io - YouTrack Personal Access Token](./images/New_WzTEWxkc_2024-10-31.png)
50
-
51
- Once the token has been created, copy it. Keep your Personal Access Token secure, as you’ll need it for the integration with Testomat.io.
52
-
53
- ## How to Get a Project ID
54
-
55
- Finally, to get the **Project ID**, follow these steps:
56
-
57
- 1. Open YouTrack [API Documentation](https://www.postman.com/youtrack-dev/youtrack/documentation/sd7pq8x/youtrack-rest-api)-> Administration -> Projects -> Read a List of Projects
58
- 2. Get a request:
59
-
60
- ```
61
- https://<your-workspace>.youtrack.cloud/api/admin/projects?fields=id,key,name
62
-
63
- ```
64
-
65
- 3. Paste your Personal Access Token
66
- 4. Click **Send** button and get your Project ID in the response body (e.g. `"id": "0-1"`)
67
-
68
- ![Get Project ID](./images/att1_youtrack.png)
69
-
70
- :::note
71
-
72
- The ID in the browser URL isn't the same as the project ID in the database.
73
-
74
- :::
75
-
76
- After collecting all necessary data, we can move on to Testomat.io.
77
-
78
- ## How to Connect YouTrack in Testomat.io
79
-
80
- 1. Select YouTrack from the list of available Issue Management Systems.
81
-
82
- ![Testomat.io - Connect to YouTrack](./images/New_F8MYluVy_2024-10-31.png)
83
-
84
- 2. Enter a **Profile Name**
85
- 3. Paste YouTrack **Workspace Name**
86
- 4. Paste YouTrack **Personal Access Token**
87
- 5. Paste YouTrack **Project ID**
88
- 6. Click on **Save** button
89
-
90
- ![Testomat.io - YouTrack Configuration](./images/New_UTbONHqM_2024-10-31.png)
91
-
92
- If everything was done correctly, you will receive a confirmation message indicating that the YouTrack profile was successfully created.
93
-
94
- ![Testomat.io - YouTrack Profile](./images/New_K1fdAe5k_2024-10-31.png)
@@ -1,53 +0,0 @@
1
- ---
2
- title: Azure DevOps Notifications
3
- description: Configure Azure DevOps notifications in Testomat.io to automate issue creation for failed test runs. This guide explains linking Azure DevOps projects, and setting notification rules to streamline workflows and save time by automating detailed test result reporting.
4
- type: article
5
- url: https://docs.testomat.io/integrations/report-notifications/azure-devops
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Azure DevOps, Testomat.io, issue tracking, Notification rules, Report Notifications, Azure DevOps integration, publish report, detailed test run results, test management, test automation, software testing, basic rules, advanced rules engine
11
- ---
12
-
13
- Testomat.io allows to create issue for failed test runs automatically in Azure DevOps. This option can be enabled in **Settings**.
14
-
15
- Before you set up Notification rules for Azure DevOps, you need to connect your Azure DevOps project with Testomat.io. Please follow the instuction in dedicated section - [Azure DevOps Configuration.](https://docs.testomat.io/integrations/issues-management/azure/)
16
-
17
- After the Azure DevOps is connected with Testomat.io, go to the **Settings (1) -> Report Notifications(2)** and click on **Add Notification Rule (3)**.
18
-
19
- ![Testomat.io - Notification](./images/Notification.png)
20
-
21
- To enable Notification for Azure DevOps follow next steps:
22
-
23
- 1. Add a title for Notification Rule.
24
- 2. Choose **Azure DevOps** from the dropdown list.
25
-
26
- ![Testomat.io - Notification Azure DevOps](./images/Azure_DevOps_1.png)
27
-
28
- 3. Select **Azure DevOps integration** from dropdown list.
29
- 4. Select **'Publish a report and use public link in report notification'** option, if you need it.
30
- 5. Configure rules to define on which conditions this notification should be sent in **BASIC RULES** section
31
-
32
- OR
33
-
34
- use **ADVANCED RULES ENGINE** to enter your rule expression.
35
-
36
- 6. Click on **Save** button.
37
-
38
- | **Basic Rules** | **Advanced Rules Engine** |
39
- | --------------------------- | ------------------------------------- |
40
- | ![Testomat.io - Basic rule](./images/Azure_DevOps_2.png) | ![Testomat.io - Advanced Rules Engine](./images/Azure_DevOps_3.png) |
41
-
42
- Testomat.io will now automatically create an issue with detailed Test Run results in your Azure DevOps project for any failed Test Runs. This eliminates the need to manually input data for each Test Run, saving you time and ensuring that all contributors are notified in a convenient way.
43
-
44
- ![Testomat.io - Notification Azure DevOps](./images/Azure_DevOps_4.png)
45
-
46
-
47
- :::note
48
-
49
- When **'Publish a report and use public link in report notification'** option is enabled, the public report will be generated and everyone who has this link will be able to see it.
50
-
51
- ![Testomat.io - Notification](./images/Public_Report.png)
52
-
53
- :::
@@ -1,71 +0,0 @@
1
- ---
2
- title: Email Notifications
3
- description: Learn how to configure email notifications in Testomat.io to receive updates on test run results. This guide covers setting notification rules, customizing fields, and managing multiple email recipients effectively.
4
- type: article
5
- url: https://docs.testomat.io/integrations/report-notifications/email
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Testomat.io, Email notifications, Report Notifications, Add Notification Rule, Run context, RunGroup context, basic rules, advanced rules engine, Run Report, multiple notifications, test management, test automation, software testing
11
- ---
12
-
13
- Testomat.io allows sending Notifications for finished runs via Email.
14
- Let's see how it works!
15
-
16
- First, you need to set up Email notifications in the Settings tab:
17
-
18
- 1. Go to **Settings**.
19
- 2. Select **Report Notifications** option.
20
- 3. Click on **Add Notification Rule**.
21
-
22
- ![Testomat.io - Notification](./images/Notification.png)
23
-
24
- At this point your next steps are:
25
-
26
- 4. Add a title for Notification Rule.
27
- 5. Choose **Email** from the dropdown list.
28
-
29
- ![Testomat.io - Notification Email](./images/Email_2.png)
30
-
31
- 6. Enter one or multiple email addresses (separated by coma) to receive notifications.
32
- 7. Select **'Publish a report and use public link in report notification'** option, if you need it.
33
- 8. Select **Notification rule context**: Run or RunGroup.
34
- 9. Add notification rules in **BASIC RULES** section
35
-
36
- OR
37
-
38
- use **ADVANCED RULES ENGINE** to enter your rule expression.
39
-
40
- 10. Click on **Save** button.
41
-
42
- | **Basic Rules** | **Advanced Rules Engine** |
43
- | --------------------------- | ------------------------------------- |
44
- | ![Testomat.io - Basic rule](./images/Email_3.png) | ![Testomat.io - Advanced Rules Engine](./images/Email_4.png) |
45
-
46
- Now you have Email Notification enabled for the project.
47
-
48
- ![Testomat.io - Notification Email](./images/Email_5.png)
49
-
50
- **How does it work?**
51
- Each time Testomat.io creates Run Report, which corresponds to your Email Notification Rule, it will be sent to email.
52
-
53
- ![Testomat.io - Notification Email](./images/Email_6.png)
54
-
55
- :::note
56
-
57
- You can set up multiple Email Notifications for different Rules.
58
-
59
- ![Testomat.io - Notification Email](./images/Email_7.png)
60
-
61
- :::
62
-
63
- :::note
64
-
65
- When **'Publish a report and use public link in report notification'** option is enabled, the public report will be generated and everyone who has this link will be able to see it.
66
-
67
- ![Testomat.io - Notification](./images/Public_Report.png)
68
-
69
- :::
70
-
71
-
@@ -1,52 +0,0 @@
1
- ---
2
- title: Jira Notifications
3
- description: Configure Jira notifications in Testomat.io to automate issue creation for failed test runs. This guide explains linking Jira projects, selecting issue types, and setting notification rules to streamline workflows and save time by automating detailed test result reporting.
4
- type: article
5
- url: https://docs.testomat.io/integrations/report-notifications/jira
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Testomat.io, Jira, automatic issue creation, failed test runs, Notification rules, Report Notifications, Add Notification Rule, Jira project, publish report, public link, basic rules, advanced rules engine, detailed test run results, test management, test automation, software testing
11
- ---
12
-
13
- Testomat.io allows to create Jira issue for failed test runs automatically. This option can be enabled in **Settings**.
14
- To do this, you need to connect Jira project with Testomat.io. Please see dedicated documentation - [Connecting to JIRA project.](https://docs.testomat.io/integration/jira/#connecting-to-jira-project)
15
-
16
- After the Jira is connected with Testomat.io, go to the **Settings (1) -> Report Notifications(2)** and click on **Add Notification Rule (3)**.
17
-
18
- ![Testomat.io - Notification](./images/Notification.png)
19
-
20
- To create a new Notification Rule for Jira follow next steps:
21
-
22
- 1. Add a title for Notification Rule.
23
- 2. Choose **Jira** from the dropdown list.
24
-
25
- ![Testomat.io - Notification Jira](./images/Jira_1.png)
26
-
27
- 3. Select your dedicated Jira project from **Jira Project** dropdown list.
28
- 4. Select needed issue type from **Issue Type** dropdown list.
29
- 5. Select **'Publish a report and use public link in report notification'** option, if you need it.
30
- 6. Configure rules to define on which conditions this notification should be sent in **BASIC RULES** section
31
-
32
- OR
33
-
34
- use **ADVANCED RULES ENGINE** to enter your rule expression.
35
-
36
- 7. Click on **Save** button.
37
-
38
- | **Basic Rules** | **Advanced Rules Engine** |
39
- | --------------------------- | ------------------------------------- |
40
- | ![Testomat.io - Basic rule](./images/Jira_2.png) | ![Testomat.io - Advanced Rules Engine](./images/Jira_3.png) |
41
-
42
- Now Testomat.io will create an issue with detailed information on Test Run results within your Jira project for failed Test Runs. So you don't need to put all the data on each Test Run manually. This helps to save time and notify all contributors in a convenient way.
43
-
44
- ![Testomat.io - Notification Jira](./images/Jira_4.png)
45
-
46
- :::note
47
-
48
- When **'Publish a report and use public link in report notification'** option is enabled, the public report will be generated and everyone who has this link will be able to see it.
49
-
50
- ![Testomat.io - Notification](./images/Public_Report.png)
51
-
52
- :::
@@ -1,60 +0,0 @@
1
- ---
2
- title: Microsoft Teams Notifications
3
- description: Configure Microsoft Teams notifications in Testomat.io to receive test updates. This guide provides detailed steps for setting up incoming webhooks in Teams, generating a Webhook URL, and linking it with Testomat.io for seamless test result notifications.
4
- type: article
5
- url: https://docs.testomat.io/integrations/report-notifications/ms-teams
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Microsoft Teams integration, Testomat.io, failed test runs, Notification rules, Report Notifications, Add Notification Rule, publish report, public link, basic rules, advanced rules engine, detailed test run results, test management, test automation, software testing
11
- ---
12
-
13
- To send noitifcations in MS Teams, first you need to set up **Incoming Webhooks** for your channel.
14
-
15
- Steps to configure:
16
-
17
- 1. Navigate to **Apps** panel.
18
- 2. Search for **Incoming Webhook** and add it ([read more here](https://learn.microsoft.com/en-us/microsoftteams/platform/webhooks-and-connectors/how-to/add-incoming-webhook?tabs=newteams%2Cdotnet)).
19
-
20
- ![Testomat.io - Notification Teams](./images/Teams_1.png)
21
-
22
- 3. Configure it and copy Webhook URL.
23
-
24
- ![Testomat.io - Notification Teams](./images/Teams_2.png)
25
-
26
- After Teams is Set up, open your Project in Testomat.io and go to the **Settings (1) -> Report Notifications(2)** and click on **Add Notification Rule (3)**.
27
-
28
- ![Testomat.io - Notification](./images/Notification.png)
29
-
30
- Create a new Notification Rule for Teams in Testomat.io following next steps:
31
-
32
- 1. Add a title for Notification Rule.
33
- 2. Choose **Microsoft Teams** from the dropdown list.
34
-
35
- ![Testomat.io - Notification Teams](./images/Teams_3.png)
36
-
37
- 3. Paste Teams Webhook URL.
38
- 4. Select **'Publish a report and use public link in report notification'** option, if you need it.
39
- 5. Configure rules to define on which conditions this notification should be sent in **BASIC RULES** section
40
-
41
- OR
42
-
43
- using **ADVANCED RULES ENGINE** to enter your rule expression.
44
-
45
- 6. Click on **Save** button.
46
-
47
- | **Basic Rules** | **Advanced Rules Engine** |
48
- | --------------------------- | ------------------------------------- |
49
- | ![Testomat.io - Basic rule](./images/Teams_4.png) | ![Testomat.io - Advanced Rules Engine](./images/Teams_5.png) |
50
-
51
- **How does it work?**
52
- Each time Testomat.io creates Run Report, which corresponds to your Teams Notification Rule, it will be sent to selected Teams channel.
53
-
54
- :::note
55
-
56
- When **'Publish a report and use public link in report notification'** option is enabled, the public report will be generated and everyone who has this link will be able to see it.
57
-
58
- ![Testomat.io - Notification](./images/Public_Report.png)
59
-
60
- :::
@@ -1,267 +0,0 @@
1
- ---
2
- title: Notification Rules
3
- description: Learn how to configure and manage notifications in Testomat.io for various channels, including Email, Slack, MS Teams, and Jira. This guide covers setting up notification rules, both basic and advanced, and demonstrates how to send alerts based on specific test run conditions. Streamline communication with automatic notifications for failed tests, test completion, and other custom triggers.
4
- type: article
5
- url: https://docs.testomat.io/integrations/report-notifications/rules
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: og:image
10
- content: https://docs.testomat.io/_astro/Basic_Rules.BGM4UhZJ_Z1Yiri8.webp
11
-
12
- - tag: meta
13
- attrs:
14
- name: keywords
15
- content: Testomat.io, notifications, Email alerts, Email notifications, Slack notifications, MS Teams, Jira integration, Jira Notification, Azure DevOps, Telegram notification, Notification rules, test runs, automated alerts, CI notifications, QA tools, notification channels, Report Notification, Basic rules, Advanced rules engine, Run Group Notifications, test management, test automation, software testing
16
- ---
17
-
18
- **Notification** is one of the attractive Agile testing tool features. Test management web application Testomat.io provides for collaborative purposes notification QA team, development team and business. So, keeping the teams engaged with project updates and getting fast feedback from business owners is simpler than ever! In addition, you as the test manager or team owner through **Team Management Dashboard** will have end-to-end visibility on your collaboration process.
19
-
20
- **Available to notify by:**
21
-
22
- - **Email** notifications.
23
- - **Slack** notification.
24
- - **Microsoft Teams** notification.
25
- - **Jira** notification.
26
- - **Azure DevOps** notification.
27
- - **Telegram** notification.
28
-
29
- Testomat.io allows sending notifications for finished runs:
30
-
31
- - Send brief reports to stakeholders.
32
- - Notify team members of failed or passed tests.
33
- - Notify test results after test executions.
34
- - Configure on which condition notification should be sent.
35
-
36
- Testomat.io has powerful rule engine which can be used to define on which conditions a notification should be sent. You can have multiple notification types with different notification channels in use for a single project.
37
-
38
- ![Testomat.io - Notification](./images/Rules.png)
39
-
40
- ## How to Setup Notification
41
-
42
- Sending configuration thanks to seamless integration is really simple. Enable notification you can on **Settings Dashboard** -> **Report Notification**. You are free to select an environment and configure condition notification should be sent. Simply fill the fields using **Basic rules**. Then modify your notification scheme to notify a group of people of your choice. Also, notification settings might be configured through the **Advanced rules engine** with using variables.
43
-
44
- You can read more about how to setup your notification in the sections below.
45
-
46
- ## Basic Rules
47
-
48
- There is a basic and advanced rules engine.
49
-
50
- Inside Basic rules you can define simple conditions on which notifications should be sent:
51
-
52
- 1. Runs with title.
53
- 2. Runs of RunGroup with title.
54
- 3. Run Type.
55
- 4. Run Status.
56
-
57
- ![Testomat.io - Basic Rules](./images/Basic_Rules.png)
58
-
59
- For instance, here is the rule for all manual runs with **"Release"** word in title to be reported:
60
-
61
- ![Testomat.io - Basic Rules](./images/Basic_Rules_1.png)
62
-
63
- ## Quick Toggle for Report Notifications
64
- You can enable or disable report notifications directly from the notification profile using a quick toggle. Switch notifications on or off without changing the full configuration. This is useful when notifications need to be temporarily paused during debugging or active development.
65
-
66
- ## Advanced Rules
67
-
68
- The advanced rules engine allows writing conditions in a special expression language similar to Ruby or JavaScript.
69
-
70
- This is the same rule we defined previously in Basic mode written in the format of Advanced mode. A notification will be sent for all manual runs that contain the word "Release":
71
-
72
- ```
73
- manual and contains(run, "Release")
74
- ```
75
-
76
- A complete list of allowed variables:
77
-
78
- - `automated` - boolean. True if a run is automated
79
- - `manual` - boolean. True if a run is manual
80
- - `has_failed` - boolean. True if a run has failed
81
- - `has_passed` - boolean. True if a run has passed
82
- - `was_terminated` - boolean. True if a run was terminated
83
- - `run` - string. Title of a run
84
- - `rungroup` - title. Title of rungroup a run belongs to
85
- - `status` - string. Status of run, 'passed' or 'failed' as a string.
86
- - `started_at` - datetime. Time when the run was started.
87
- - `finished_at` - datetime. Time when the run was finished
88
- - `passed_tests` - collection. A list of all passed tests in a run.
89
- - `failed_tests` - collection. A list of all failed tests in a run.
90
- - `skipped_tests` - collection. A list of all skipped tests in a run.
91
- - `env` - collection. A list of environments.
92
-
93
- An expression should return a boolean value. To deal with types other than boolean functions and methods can be used:
94
-
95
- **String**
96
-
97
- String values can be checked with equal `==` or not equal `!=` operators. Also there is `contains` function which checks inclusion of a string in another string:
98
-
99
- ```
100
- contains(run, "New")
101
- ```
102
-
103
- **Collection**
104
-
105
- Collections contain an array of objects.
106
-
107
- Use `.size` to check for the size of items in the collection. For instance, this rule is activated when a number of failed tests is more than 10.
108
-
109
- ```
110
- failed_tests.size > 10
111
- ```
112
-
113
- Collection of tests can be filtered. Tests in the collection have following properties:
114
-
115
- - `test['title']` - title of a test
116
- - `test['suite']` - title of a suite of a test
117
- - `test['id']` - id of a test
118
- - `test['suite_id']` - id of a suite
119
- - `test['status']` - status of a test in collection
120
-
121
- For instance, this is how to check if a collection of failed tests contains at least one test with `@important` tag in its name:
122
-
123
- ```
124
- failed_tests.filter(test, contains(test["title"], "@important")).size > 0
125
- ```
126
-
127
- **DateTime**
128
-
129
- `started_at` and `finished_at` variables are of datetime type. They have properties from [Date](https://ruby-doc.org/stdlib-2.6.1/libdoc/date/rdoc/Date.html) and [DateTime](https://ruby-doc.org/stdlib-2.6.1/libdoc/date/rdoc/DateTime.html) classes of Ruby that can be used in expressions. Most used ones are:
130
-
131
- - `hour`
132
- - `minute`
133
- - `day`
134
- - `wday`
135
- - `month`
136
- - `year`
137
- - [etc](https://ruby-doc.org/stdlib-2.6.1/libdoc/date/rdoc/Date.html)
138
-
139
- For instance, this is how notification can be enabled for reports finished in non-business time:
140
-
141
- ```
142
- (finished_at.hour > 18 or finished_at.hour < 9)
143
- ```
144
-
145
- ## Examples
146
-
147
- **Notify when tests are failing on CI:**
148
-
149
- To match tests executed on CI specify a Run title with "[CI]" prefix to identify that these tests were executed on CI:
150
-
151
- ```
152
- TESTOMATIO_TITLE="[CI] Automated Tests"
153
- ```
154
-
155
- Then write a notification rule that will check only for failing runs with "[CI]" in their title:
156
-
157
- ```
158
- contains(run, "[CI]") and has_failed
159
- ```
160
-
161
- **Notify when automated tests are terminated:**
162
-
163
- ```
164
- automated and was_terminated
165
- ```
166
-
167
- ### Examples for Runs Notifications
168
-
169
- **Notify when a Run has failed between 10 PM and 9 AM:**
170
-
171
- ```
172
- has_failed and (finished_at.hour > 22 or finished_at.hour < 9)
173
- ```
174
-
175
- **Notify when an automated Run has failed on alpha environment:**
176
-
177
- ```
178
- automated and has_failed and contains (env, "alpha”)
179
- ```
180
-
181
- **Notify when a Run that contains at least one test with the word "autocomplete" in the title has passed:**
182
-
183
- ```
184
- has_passed and passed_tests.filter(test, contains(test["title"], "autocomplete")).size > 0
185
- ```
186
-
187
- For example:
188
-
189
- ![Testomat.io - Run Rules](./images/Run_rule.png)
190
-
191
- And Run that matches this Notification rule:
192
-
193
- ![Testomat.io - Run Rules](./images/Run_rule_1.png)
194
-
195
- ## Run Group Notifications
196
-
197
- :::note
198
-
199
- Please note that Run Group Notifications are available for **Email notification** type only.
200
-
201
- :::
202
-
203
- To configure Notification Rule for Run Group you need:
204
-
205
- 1. Select rungroup for Notification rule context
206
- 2. Add your Rule Expression, for example, you can use `rungroup_finished` variable if you want to get notification when all Run report inside the group are finished.
207
-
208
- ![Alt text](./images/Rungroup.png)
209
-
210
- ### Rules for Run Group Notifications
211
-
212
- The rules engine allows writing conditions in a special expression language similar to Ruby or JavaScript.
213
-
214
- A list of allowed variables:
215
-
216
- - `title` - string. Title of a rungroup
217
- - `rungroup_finished` - boolean. True if all runs completed => True if rungroup contains only finished runs.
218
- - `runs` - collection. A list of all runs inside a rungroup
219
- - `finished_runs` - collection. A list of finished (passed or failed) runs inside a rungroup
220
- - `ongoing_runs` - collection. A list of pending runs (scheduled, in progress) runs inside a rungroup
221
- - `failed_runs` - collection. A list of failed runs inside a rungroup
222
-
223
- ### Examples for Run Groups Notifications
224
-
225
- **Notify when all runs within one Run Group (Run Group include more than 1 run) are finished:**
226
-
227
- ```
228
- (runs.size > 1) and rungroup_finished
229
- ```
230
-
231
- **Notify when there is at least one run in the `finished_runs` collection whose `finished_at` timestamp is older than 100 seconds ago:**
232
-
233
- ```
234
- finished_runs.filter(run, run['finished_at'] < 100.seconds_ago).size > 0
235
- ```
236
-
237
- **Notify when there are no currently ongoing runs in the run Group (means all runs are finished):**
238
-
239
- ```
240
- ongoing_runs.filter(run, run['created_at'] <= 0.seconds_ago).size == 0
241
- ```
242
-
243
- **Notify when next rules are met:**
244
-
245
- - the title of the Run Group contains the substring 'str-' and
246
- - all runs within this Run Group are finished and
247
- - at least one of the runs within this Run Group has a title that contains the exact string 'islast: true'
248
-
249
- ```
250
- contains(title, "str-") and rungroup_finished and (runs.select(run, contains(run["title"], "islast: true")).size > 0)
251
- ```
252
-
253
- For example:
254
-
255
- ![Testomat.io - RunGroup Rules](./images/RunGroup_rule.png)
256
-
257
- And Run Group that matches this Notification rule:
258
-
259
- ![Testomat.io - RunGroup Rules](./images/RunGroup_rule_1.png)
260
-
261
- :::note
262
-
263
- Testomat.io allows you to check which of your Runs or Run Groups match the created notification rule:
264
-
265
- ![Testomat.io - Rule Check](./images/Rule_check.gif)
266
-
267
- :::