testeiya 0.2.1 → 0.3.10

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (402) hide show
  1. package/LICENSE +21 -0
  2. package/README.md +284 -171
  3. package/dist/prompt/context.js +79 -0
  4. package/dist/prompt/context.js.map +1 -0
  5. package/dist/prompt/index.js +60 -0
  6. package/dist/prompt/index.js.map +1 -0
  7. package/dist/prompt/print.js +30 -0
  8. package/dist/prompt/print.js.map +1 -0
  9. package/dist/prompt/project-info.js +2 -0
  10. package/dist/prompt/project-info.js.map +1 -0
  11. package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +38 -25
  12. package/dist/prompt/system-prompt.js.map +1 -0
  13. package/dist/prompt/testomatio.js +264 -0
  14. package/dist/prompt/testomatio.js.map +1 -0
  15. package/dist/prompt/tools.js +57 -0
  16. package/dist/prompt/tools.js.map +1 -0
  17. package/dist/prompt/vocab.js +8 -0
  18. package/dist/prompt/vocab.js.map +1 -0
  19. package/dist/src/args.js +172 -0
  20. package/dist/src/args.js.map +1 -0
  21. package/dist/src/cli.js +97 -0
  22. package/dist/src/cli.js.map +1 -0
  23. package/dist/src/doctor.js +186 -0
  24. package/dist/src/doctor.js.map +1 -0
  25. package/dist/src/env.js +93 -0
  26. package/dist/src/env.js.map +1 -0
  27. package/dist/src/mcp-extension.js +9 -0
  28. package/dist/src/mcp-extension.js.map +1 -0
  29. package/dist/src/mcp.js +139 -0
  30. package/dist/src/mcp.js.map +1 -0
  31. package/dist/src/model.js +71 -0
  32. package/dist/src/model.js.map +1 -0
  33. package/dist/src/models.js +38 -0
  34. package/dist/src/models.js.map +1 -0
  35. package/dist/src/output.js +185 -0
  36. package/dist/src/output.js.map +1 -0
  37. package/dist/src/result.js +41 -0
  38. package/dist/src/result.js.map +1 -0
  39. package/dist/src/run.js +291 -0
  40. package/dist/src/run.js.map +1 -0
  41. package/dist/src/session.js +92 -0
  42. package/dist/src/session.js.map +1 -0
  43. package/dist/src/sessions.js +61 -0
  44. package/dist/src/sessions.js.map +1 -0
  45. package/dist/vendor/mcp.js +14801 -0
  46. package/mcp-tools.json +2967 -0
  47. package/package.json +34 -43
  48. package/prompt/context.ts +101 -0
  49. package/prompt/index.ts +102 -0
  50. package/prompt/print.ts +32 -0
  51. package/prompt/project-info.ts +30 -0
  52. package/prompt/system-prompt.ts +187 -0
  53. package/{src/prompt → prompt}/testomatio.ts +120 -9
  54. package/prompt/tools.ts +57 -0
  55. package/prompt/vocab.ts +7 -0
  56. package/skills/codeceptjs/ci-fix-tests/SKILL.md +7 -8
  57. package/skills/codeceptjs/codeceptjs-auth/SKILL.md +47 -64
  58. package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +56 -47
  59. package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +144 -106
  60. package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +50 -57
  61. package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +88 -196
  62. package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +4 -5
  63. package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +25 -36
  64. package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +23 -36
  65. package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +23 -36
  66. package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +23 -35
  67. package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +50 -53
  68. package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +87 -191
  69. package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/SKILL.md +1 -1
  70. package/{skills.lock.json → skills/skills.lock.json} +43 -36
  71. package/skills/skills.yaml +34 -0
  72. package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +49 -61
  73. package/skills/testomatio/explorbot/explorbot-fundamentals/references/no-install.md +36 -0
  74. package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +20 -7
  75. package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +41 -289
  76. package/skills/testomatio/qa-process/qa-explain-behavior/SKILL.md +111 -0
  77. package/skills/testomatio/qa-process/qa-explain-behavior/references/answer-shapes.md +116 -0
  78. package/skills/testomatio/qa-process/qa-explain-behavior/references/examples.md +157 -0
  79. package/skills/testomatio/qa-process/qa-lead-strategy-advisor/SKILL.md +91 -0
  80. package/skills/testomatio/qa-process/qa-lead-strategy-advisor/references/output-format.md +71 -0
  81. package/skills/testomatio/qa-process/testing-workflow/SKILL.md +227 -0
  82. package/skills/testomatio/test-automation/qa-data-seeder/SKILL.md +83 -0
  83. package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +5 -3
  84. package/skills/testomatio/test-automation/setup-change-aware-pr-testing/SKILL.md +190 -0
  85. package/skills/testomatio/test-automation/setup-ci-automation/SKILL.md +76 -0
  86. package/skills/testomatio/test-management/qa-split-testing-levels-pyramid/SKILL.md +55 -0
  87. package/skills/testomatio/test-management/qa-sprint-report-by-testomatio/SKILL.md +220 -0
  88. package/skills/testomatio/test-management/qa-sprint-report-by-testomatio/references/qa-sprint-report.md +126 -0
  89. package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +1 -1
  90. package/skills/testomatio/test-management/qa-thinking/SKILL.md +25 -25
  91. package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +14 -1
  92. package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +8 -0
  93. package/assets/testeiya-logo-dark.svg +0 -16
  94. package/assets/testeiya-logo.svg +0 -15
  95. package/models.catalog.json +0 -6963
  96. package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
  97. package/skills/playwright-best-practices-skill/README.md +0 -147
  98. package/skills/testeiya/README.md +0 -29
  99. package/skills/testeiya/answer-formatting/SKILL.md +0 -30
  100. package/skills/testeiya/check-cucumber/SKILL.md +0 -200
  101. package/skills/testeiya/check-tests/SKILL.md +0 -260
  102. package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
  103. package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
  104. package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
  105. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
  106. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
  107. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
  108. package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
  109. package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
  110. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
  111. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
  112. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
  113. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
  114. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
  115. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
  116. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
  117. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
  118. package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
  119. package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
  120. package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
  121. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
  122. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
  123. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
  124. package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
  125. package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
  126. package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
  127. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
  128. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
  129. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
  130. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
  131. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
  132. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
  133. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
  134. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
  135. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
  136. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
  137. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
  138. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
  139. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
  140. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
  141. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
  142. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
  143. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
  144. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
  145. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
  146. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
  147. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
  148. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
  149. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
  150. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
  151. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
  152. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
  153. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
  154. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
  155. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
  156. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
  157. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
  158. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
  159. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
  160. package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
  161. package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
  162. package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
  163. package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
  164. package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
  165. package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
  166. package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
  167. package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
  168. package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
  169. package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
  170. package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
  171. package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
  172. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
  173. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
  174. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
  175. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
  176. package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
  177. package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
  178. package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
  179. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
  180. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
  181. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
  182. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
  183. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
  184. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
  185. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
  186. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
  187. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
  188. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
  189. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
  190. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
  191. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
  192. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
  193. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
  194. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
  195. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
  196. package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
  197. package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
  198. package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
  199. package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
  200. package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
  201. package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
  202. package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
  203. package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
  204. package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
  205. package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
  206. package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
  207. package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
  208. package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
  209. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
  210. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
  211. package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
  212. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
  213. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
  214. package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
  215. package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
  216. package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
  217. package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
  218. package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
  219. package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
  220. package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
  221. package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
  222. package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
  223. package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
  224. package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
  225. package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
  226. package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
  227. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
  228. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
  229. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
  230. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
  231. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
  232. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
  233. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
  234. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
  235. package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
  236. package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
  237. package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
  238. package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
  239. package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
  240. package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
  241. package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
  242. package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
  243. package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
  244. package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
  245. package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
  246. package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
  247. package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
  248. package/skills.yaml +0 -21
  249. package/src/ai-debug.ts +0 -188
  250. package/src/api/agent-get.ts +0 -22
  251. package/src/api/agent-start.ts +0 -384
  252. package/src/api/client-log.ts +0 -29
  253. package/src/api/context.ts +0 -332
  254. package/src/api/debug-layout.ts +0 -47
  255. package/src/api/debug-report.ts +0 -29
  256. package/src/api/debug-snapshot.ts +0 -30
  257. package/src/api/debug-stream.ts +0 -52
  258. package/src/api/files-delete.ts +0 -184
  259. package/src/api/files-read.ts +0 -41
  260. package/src/api/files-rename.ts +0 -99
  261. package/src/api/files-tree.ts +0 -292
  262. package/src/api/files-write.ts +0 -41
  263. package/src/api/mcp.ts +0 -603
  264. package/src/api/memory.ts +0 -69
  265. package/src/api/open-external.ts +0 -39
  266. package/src/api/playwright-cli.ts +0 -606
  267. package/src/api/providers.ts +0 -457
  268. package/src/api/read-env-token.ts +0 -33
  269. package/src/api/sessions.ts +0 -79
  270. package/src/api/settings.ts +0 -120
  271. package/src/api/skills.ts +0 -58
  272. package/src/api/testomatio-attachment.ts +0 -89
  273. package/src/api/testomatio-auth.ts +0 -284
  274. package/src/api/testomatio-proxy.ts +0 -197
  275. package/src/api/testomatio-run-stats.ts +0 -81
  276. package/src/api/testomatio-target.ts +0 -225
  277. package/src/api/testomatio-transcription.ts +0 -82
  278. package/src/api/workspace-search.ts +0 -96
  279. package/src/api/workspace-sync.ts +0 -151
  280. package/src/api/workspace.ts +0 -165
  281. package/src/app-server.ts +0 -556
  282. package/src/bridge.ts +0 -251
  283. package/src/check-tests.ts +0 -156
  284. package/src/cli.ts +0 -17
  285. package/src/commands.ts +0 -244
  286. package/src/config.ts +0 -183
  287. package/src/connection.ts +0 -658
  288. package/src/context-store.ts +0 -265
  289. package/src/debug-bus.ts +0 -405
  290. package/src/extensions/tool-gate.ts +0 -220
  291. package/src/extensions/webui/ask-channel.ts +0 -52
  292. package/src/extensions/webui/index.ts +0 -184
  293. package/src/extensions/webui/tools/ask-question.ts +0 -88
  294. package/src/extensions/webui/tools/query-result.ts +0 -79
  295. package/src/extensions/webui/tools/render-chart.ts +0 -53
  296. package/src/extensions/webui/tools/render-item.ts +0 -61
  297. package/src/extensions/webui/tools/render-list.ts +0 -170
  298. package/src/extensions/webui/tools/render-result.ts +0 -85
  299. package/src/extensions/webui/tools/render-tree.ts +0 -71
  300. package/src/extensions/webui/tools/ui-widget.ts +0 -54
  301. package/src/extensions/webui/tools/widget-result.ts +0 -13
  302. package/src/extensions/webui/widget-channel.ts +0 -50
  303. package/src/file-log.ts +0 -196
  304. package/src/git-tracked.ts +0 -68
  305. package/src/gitignore.ts +0 -53
  306. package/src/json-store.ts +0 -43
  307. package/src/load-env.ts +0 -70
  308. package/src/loader-style.ts +0 -96
  309. package/src/main.ts +0 -140
  310. package/src/mcp-catalog.ts +0 -96
  311. package/src/models-catalog.ts +0 -72
  312. package/src/permissions.ts +0 -120
  313. package/src/project-dir.ts +0 -189
  314. package/src/project-info.ts +0 -108
  315. package/src/prompt/app-ui.ts +0 -59
  316. package/src/prompt/browser.ts +0 -27
  317. package/src/prompt/index.ts +0 -62
  318. package/src/prompt/tools.ts +0 -27
  319. package/src/server-info.ts +0 -62
  320. package/src/session-factory.ts +0 -442
  321. package/src/session-store.ts +0 -115
  322. package/src/shell-env.ts +0 -45
  323. package/src/skills.ts +0 -163
  324. package/src/sync-snapshot.ts +0 -140
  325. package/src/telemetry.ts +0 -239
  326. package/src/testomatio-auth.ts +0 -299
  327. package/src/testomatio.ts +0 -98
  328. package/src/theme.ts +0 -30
  329. package/src/user-env.ts +0 -94
  330. package/src/welcome.ts +0 -194
  331. package/src/workspace/safe-path.ts +0 -85
  332. package/src/workspace/test-md.ts +0 -70
  333. package/src/workspace-model.ts +0 -440
  334. package/testeiya.config.json +0 -14
  335. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/authentication-flows.md +0 -0
  336. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/authentication.md +0 -0
  337. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/clock-mocking.md +0 -0
  338. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/mobile-testing.md +0 -0
  339. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/multi-context.md +0 -0
  340. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/multi-user.md +0 -0
  341. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/network-advanced.md +0 -0
  342. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/third-party.md +0 -0
  343. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/pom-vs-fixtures.md +0 -0
  344. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/test-architecture.md +0 -0
  345. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/when-to-mock.md +0 -0
  346. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/browser-apis.md +0 -0
  347. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/iframes.md +0 -0
  348. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/service-workers.md +0 -0
  349. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/websockets.md +0 -0
  350. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/annotations.md +0 -0
  351. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/assertions-waiting.md +0 -0
  352. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/configuration.md +0 -0
  353. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/fixtures-hooks.md +0 -0
  354. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/global-setup.md +0 -0
  355. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/locators.md +0 -0
  356. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/page-object-model.md +0 -0
  357. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/projects-dependencies.md +0 -0
  358. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-data.md +0 -0
  359. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-suite-structure.md +0 -0
  360. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-tags.md +0 -0
  361. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/console-errors.md +0 -0
  362. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/debugging.md +0 -0
  363. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/error-testing.md +0 -0
  364. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/flaky-tests.md +0 -0
  365. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/angular.md +0 -0
  366. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/nextjs.md +0 -0
  367. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/react.md +0 -0
  368. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/vue.md +0 -0
  369. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/ci-cd.md +0 -0
  370. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/docker.md +0 -0
  371. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/github-actions.md +0 -0
  372. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/gitlab.md +0 -0
  373. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/other-providers.md +0 -0
  374. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/parallel-sharding.md +0 -0
  375. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/performance.md +0 -0
  376. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/reporting.md +0 -0
  377. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/test-coverage.md +0 -0
  378. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/accessibility.md +0 -0
  379. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/api-testing.md +0 -0
  380. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/browser-extensions.md +0 -0
  381. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/canvas-webgl.md +0 -0
  382. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/component-testing.md +0 -0
  383. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/drag-drop.md +0 -0
  384. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/electron.md +0 -0
  385. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/file-operations.md +0 -0
  386. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/file-upload-download.md +0 -0
  387. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/forms-validation.md +0 -0
  388. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/graphql-testing.md +0 -0
  389. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/i18n.md +0 -0
  390. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/performance-testing.md +0 -0
  391. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/security-testing.md +0 -0
  392. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/visual-regression.md +0 -0
  393. /package/skills/{playwright-cli → playwright/playwright-cli}/SKILL.md +0 -0
  394. /package/skills/{playwright-cli → playwright/playwright-cli}/references/element-attributes.md +0 -0
  395. /package/skills/{playwright-cli → playwright/playwright-cli}/references/playwright-tests.md +0 -0
  396. /package/skills/{playwright-cli → playwright/playwright-cli}/references/request-mocking.md +0 -0
  397. /package/skills/{playwright-cli → playwright/playwright-cli}/references/running-code.md +0 -0
  398. /package/skills/{playwright-cli → playwright/playwright-cli}/references/session-management.md +0 -0
  399. /package/skills/{playwright-cli → playwright/playwright-cli}/references/storage-state.md +0 -0
  400. /package/skills/{playwright-cli → playwright/playwright-cli}/references/test-generation.md +0 -0
  401. /package/skills/{playwright-cli → playwright/playwright-cli}/references/tracing.md +0 -0
  402. /package/skills/{playwright-cli → playwright/playwright-cli}/references/video-recording.md +0 -0
@@ -1,290 +0,0 @@
1
- ---
2
- title: Start With Testomat.io
3
- description: This guide helps users start from scratch with Testomat.io by creating projects, writing test cases, running manual and automated tests, and analyzing results with detailed reporting and analytics. It also includes importing automated tests and tracking automation coverage for optimization.
4
- type: article
5
- url: https://docs.testomat.io/getting-started/start-from-scratch/
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Testomat.io, getting started, manual tests, automated tests, test reporting, project creation, test analytics, automation coverage, test cases, test management system
11
- ---
12
-
13
- <!--
14
- > If you don't have any manual or automated tests yet - follow this guide. Otherwise, pick the section of the guide relevant to your project. You might want to start from [this section](https://docs.testomat.io/getting-started/import-tests-from-source-code/) if you consider **importing tests from source code** into Testomat.io. For those interested in importing tests from the **Cucumber** framework, go straight to [this section](https://docs.testomat.io/getting-started/import-tests-from-cucumber/#why-do-i-need-to-import-my-tests)!
15
- -->
16
-
17
- Welcome!
18
-
19
- This step-by-step guide helps you to create your project, add tests, execute them, and review results with analytics.
20
-
21
- By the end of this guide, you will have:
22
-
23
- - a project
24
- - suites/folders with suites
25
- - tests
26
- - runs
27
- - a report
28
- - visual analytics with all data
29
-
30
- ![Testomat.io - GETTING STARTED general diagram](./images/testing-workflow.png)
31
-
32
- ## Create Project
33
-
34
- A project is the main entity in Testomat.io that contains all tests, test execution programs, and analytical data on them. Every project can contain any number of suites and folders with any amount of tests, test runs, plans, and reports in them.
35
-
36
- :::note
37
-
38
- Each project is a separate entity. That means, you can do whatever you want within the Project, but you cannot cross-do staff between Projects.
39
-
40
- :::
41
-
42
- Register at [app.testomat.io](https://app.testomat.io) and activate your user account. Then create a new project:
43
- 1. Go to your account **Dashboard**.
44
- 2. In the top-right corner, click **Create**.
45
- 3. Enter the project title.
46
- 4. Choose the project type:
47
- - BDD Project
48
- - Classical Project
49
- 5. Decide whether to use demo data or your own data.
50
- 6. Click **Create**.
51
-
52
- ![Testomat.io - Create new project](./images/create-project.png)
53
-
54
- Use [BDD Project](https://docs.testomat.io/project/tests/bdd-test-case-editor/) if you plan to work with BDD descriptions or the Cucumber framework.
55
-
56
- Use [Classical Project](https://docs.testomat.io/project/tests/classical-test-case-editor/) if you want free-form markdown test cases with automation synced to test cases.
57
-
58
- You have just created your first project!
59
-
60
- Now you can start creating suites and test cases for your projects.
61
-
62
- ## Create a Suite
63
-
64
- Test suite is a collection of tests grouped together. You can create suites or create a folder with suites.
65
-
66
- ![Testomat.io - Create new Suite](./images/project-hierarchy-icons.png)
67
-
68
- To create a suite:
69
- 1. Select a project.
70
- 2. Click **New suite**.
71
- 3. Enter your Suite name.
72
- 4. Press `Enter` on your keyboard.
73
-
74
- Another way to create suite:
75
-
76
- 1. Click action menu button (...).
77
- 2. Select **Create more suites** from the menu.
78
-
79
- ![create more suite button](./images/suite1.png)
80
-
81
- 3. Enter the title of the new suite or folder.
82
- 4. Click **'+ Suite'** to create a test suite, or optionally
83
- 5. Click **'Folder'** to create a folder for grouping suites.
84
-
85
- ![create new suite/folder](./images/suite%202.png)
86
-
87
- :::note
88
-
89
- You can create folders to group your suites. On the project page, click **New folder**, enter its name, and press `Enter` on the keyboard.
90
-
91
- You can create any number of folders and suites within a folder.
92
-
93
- :::
94
-
95
- ## Create Manual Test Cases
96
-
97
- Read full article: [Test Case Creation and Editing](https://docs.testomat.io/project/tests/test-case-creation-and-editing/).
98
-
99
- After you’ve created test suites, you can start adding tests.
100
- 1. Select a test suite.
101
- 2. Click on Suite, and a Suite panel will open to the right.
102
- 3. At the bottom of the **Tests** tab, enter the name of the test.
103
- 4. Click **Create**.
104
- 5. Click on the test to edit it.
105
-
106
- :::note
107
-
108
- When tests are newly created, they are marked as **manual** by default, which shows that they are ready for manual checks.
109
-
110
- :::
111
-
112
- You can also create a test using the **New test** button at the top of the Suite editor panel.
113
-
114
- ![Testomat.io - Create test case](./images/manual-tests-create.png)
115
-
116
- ### Bulk-create Tests
117
-
118
- Read full article: [Bulk Edit](https://docs.testomat.io/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level/).
119
-
120
- To add multiple tests at once by listing their names, rather than adding each one individually:
121
- 1. Open (or create) a suite.
122
- 2. Turn on the **Bulk** toggle.
123
- 3. Type **one test name per line** in the input field.
124
- 4. Click **Create** - every line becomes a separate test, all added together.
125
-
126
- ![Testomat.io - Create test case](./images/bulk-create-tests.png)
127
-
128
- ## Run Manual Tests
129
-
130
- Read full article: [Running Tests Manually](https://docs.testomat.io/project/runs/running-tests-manually/).
131
-
132
- There are two main ways to start a manual run:
133
-
134
- From the ‘Tests’ page, quick launch for selected tests or suites, or adding tests to an already ongoing run without leaving the Tests view.
135
-
136
- 1. On the **Tests** sidebar tab, activate **Multi-select**.
137
- 2. Select tests you need to run.
138
- 3. Click the **Run** button in the actions menu below.
139
-
140
- ![Testomat.io - Tests manual run](./images/tests-manual-run.png)
141
-
142
- From the ‘Runs’ page - the classic way to create and manage full runs with complete configuration options.
143
-
144
- 1. Go to the **Runs** tab in the sidebar.
145
- 2. Click the **New** button and select **New manual test run**.
146
- 3. Enter the run **Title**.
147
- 4. Then select **All tests**, **Test plan**, **Select tests**, or **Without tests** to run tests.
148
- 5. Click the **Launch** button to execute the tests.
149
-
150
- ![Testomat.io - Run manual tests](./images/run-manual-tests.png)
151
-
152
- :::note
153
-
154
- Before tests execution, you can specify the run [environment options](https://docs.testomat.io/getting-started/running-tests-manually/#multi-environment-tests).
155
-
156
- You can also toggle the **Run Automated as Manual** switch to select the result of automated tests manually.
157
-
158
- :::
159
-
160
- When the test execution is launched, testers can:
161
- - Mark each test as **Passed**, **Failed**, or **Skipped**.
162
- - Add messages.
163
- - Attach evidence (screenshots, logs, etc.)
164
- - Assign tests to specific team members.
165
-
166
- ![Testomat.io - Execute tests](./images/launch-manual-run.png)
167
-
168
- ## Import Automated Tests
169
-
170
- Read full article: [Import Automated Tests](https://docs.testomat.io/getting-started/#import-automated-tests), [Import from CSV/XLSX](https://docs.testomat.io/project/import-export/import/import-tests-from-csv-xlsx/), and [Import Tests From TestRail](https://docs.testomat.io/project/import-export/import/import-tests-from-testrail/).
171
-
172
- To add automated tests to your project, you must import them from the source code, a CSV file, or an existing TestRail suite. To import automated tests, follow these steps:
173
-
174
- 1. Open your project.
175
- 2. Navigate to the actions (...).
176
- 3. Click **Import automated tests**.
177
-
178
- Alternatively:
179
-
180
- 1. Go to the Imports menu.
181
- 2. Navigate to the **Import** dropdown menu.
182
- 3. Select an import option:
183
-
184
- | Import option | Description |
185
- |---|---|
186
- | **Import from Source Code** | Imports tests directly from your local project or repository. |
187
- | **Import from CSV** | Imports tests from a CSV file and converts it to one of the available formats. |
188
- | **Import from TestRail** | Imports tests from an existing TestRail suite. |
189
-
190
- In the **Import** section, pick the framework, programming language and operating system you are using for testing.
191
-
192
- ![Testomat.io - Copy instructions](./images/copy-import-instructions.png)
193
-
194
- :::note
195
-
196
- Please check your environment:
197
-
198
- - For NodeJS (JavaScript, TypeScript): you need NodeJS 10+ and npm installed to be able to run this command.
199
- - For PHP: you need PHP > 7.2 and Composer installed.
200
-
201
- :::
202
-
203
- ### Import via Terminal
204
-
205
- Testomat.io can store tests from various frameworks. To import automated tests:
206
-
207
- 1. Open a terminal, navigate to the tests folder in your project.
208
- 2. Copy and execute the import command in a terminal.
209
- 3. See a report on how many tests were found.
210
- 4. Reopen the project and see that all tests with their folders and files are shown on Testomat.io.
211
-
212
- ![Testomat.io - Execute command in terminal, automated tests found and sent](./images/import-tests-terminal.png)
213
-
214
- If you don't see a similar message, please check the command's API change command parameters so it could find tests. The most common issues with import are different file naming format and/or incorrect directory for import.
215
-
216
- :::note
217
-
218
- All imported tests are marked as "Automated" by default. Please, check that the link actually points to the corresponding file.
219
-
220
- :::
221
-
222
- ## Run Automated Tests
223
-
224
- Read full article: [Running Automated Tests](https://docs.testomat.io/project/runs/running-automated-tests/).
225
-
226
- To start Run Automated Tests:
227
- 1. Go to the **Runs** page.
228
- 2. Navigate to the **New** dropdown menu.
229
- 3. Select **Report automated tests**.
230
-
231
- ![Testomat.io - Import automated tests](./images/report-automated-tests.png)
232
-
233
- 5. In the opened window select your framework.
234
- 6. Testomat.io will generate a terminal command.
235
-
236
- ![Testomat.io - Choose test automation framework](./images/report-automated-tests-2.png)
237
-
238
- 7. Start generated commands in your terminal from your project folder.
239
-
240
- ![Testomat.io - Execute test cases](./images/execute-test-terminal.png)
241
-
242
- 8. A new Test Run will appear on Runs page.
243
-
244
- ## Test Run Report
245
-
246
- Read full article: [Testomat.io Reporter](https://docs.testomat.io/test-reporting/reporter/).
247
-
248
- You can use Testomat.io as a test management system or as a rich reporting tool. Each test has its history and a lifecycle, so each test report will be attached to a corresponding test in a project.
249
-
250
- To view your test run reports:
251
-
252
- 1. Navigate to the Runs menu.
253
- 2. Find the information about the completed test run (the duration of the run, the performer, etc.)
254
- 3. Filter by status, find specific tests by tags, or sort by available methods.
255
- 4. You can see test results in real-time.
256
-
257
- ![Testomat.io - Simplified test report](./images/run-report-1.png)
258
-
259
- To get a detailed report of the test run, click on the **Report** button. Share the report with your stakeholders.
260
-
261
- ![Testomat.io - Detailed test report](./images/run-report-2.png)
262
-
263
- :::note
264
-
265
- Artifacts like screenshots, videos, and traces are uploaded to your own cloud storage via S3 protocol. Artifacts can be uploaded privately or publicly and used in reports.
266
-
267
- :::
268
-
269
- ## Analytics
270
-
271
- Read full article: [Analytics](https://docs.testomat.io/project/analytics/).
272
-
273
- Testomat.io Analytics provides an extensive overview of testing data by tracking both automated and manual tests. You can visualize trends over time with custom charts, identify automation coverage, monitor failure patterns, and analyze metrics like flaky or slowest tests.
274
-
275
- ![Testomat.io - Analytics](./images/analytics-testomat-io.png)
276
-
277
- Additional features include a failure board, label, and tag statistics for better team insights, allowing for optimized testing and proactive bug prevention.
278
-
279
-
280
-
281
- ## Explore more features
282
-
283
- Learn more: [AI-Powered Features](https://docs.testomat.io/advanced/ai-powered-features/ai-powered-features/) and [Issues Management Systems](https://docs.testomat.io/integrations/issues-management/).
284
-
285
- Once you’re comfortable with the core workflow, you can start using advanced features to help you with your QA process.
286
-
287
- A built-in AI assistant can generate new test cases from existing suites or requirements, suggest missing scenarios, summarize project coverage, and write descriptions for undocumented automated tests.
288
-
289
- On the integrations side, Testomat.io works out of the box with popular automation frameworks ([Playwright](https://docs.testomat.io/tutorials/playwright/), [Cypress](https://docs.testomat.io/test-reporting/workflows/#github-actions-and-cypress-trigger--pr), [Cucumber](https://docs.testomat.io/project/import-export/import/import-bdd/#_top), and more), CI/CD tools like [GitHub Actions](https://docs.testomat.io/integrations/continuous-integration/github), [GitLab](https://docs.testomat.io/integrations/continuous-integration/gitlab), and [Jenkins](https://docs.testomat.io/integrations/continuous-integration/jenkins), as well as team tools such as [Slack](https://docs.testomat.io/integrations/report-notifications/slack) and [Confluence](https://docs.testomat.io/integrations/issues-management/confluence). In addition, the [Jira](https://docs.testomat.io/integrations/report-notifications/jira) plugin keeps tests, issues, and results in sync so your whole team can manage testing without leaving the tools they already use.
290
-
@@ -1,96 +0,0 @@
1
- ---
2
- title: Azure Pipelines
3
- description: Integrate Azure Pipelines with Testomat.io to automate test execution and reporting. This guide explains setting up CI connections, creating input variables, and configuring pipelines to run tests with tools like CodeceptJS, Jest, or Playwright. It also details passing custom variables and specifying branches for targeted testing.
4
- type: article
5
- url: https://docs.testomat.io/integrations/continuous-integration/azure
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Azure DevOps, Testomat.io, CI connection, CI Integration, Azure Pipeline, Personal Access Token, Continious Integration, Test Automation, Test Management, Microsoft Azure, input variables, configuration, workflows, test reporting
11
- ---
12
-
13
- To connect Azure DevOps to Testomat.io, first you need to create an Private Access Token (PAT).
14
- Learn how to create a PAT following the link - [Create PAT](https://learn.microsoft.com/en-us/azure/devops/organizations/accounts/use-personal-access-tokens-to-authenticate?view=azure-devops&tabs=Windows).
15
-
16
- And follow the instructions below:
17
-
18
- 1. Create a **PAT** in your Azure DevOps account with permission to **Read & Execute Build**.
19
-
20
- ![Testomatio - Azure Pipeline](./images/Azure_D_1.png)
21
-
22
- 2. Obtain the **ID** of a Pipeline you want to execute. Open a Pipeline and copy its ID from `definitionId` query parameter. On this screenshot the ID is `1`.
23
-
24
- ![Testomatio - Azure Pipeline](./images/Azure_D_2.png)
25
-
26
- 3. Create a new **CI connection** inside your project in Testomat.io: go to **'Settings' -> 'Continuous Integration' ->** click **'Connect to CI'** select **'Azure Pipelines'**
27
-
28
- ![Testomatio - Azure Pipeline](./images/Azure_D_3.png)
29
-
30
- 4. Enter following details on the **'Connection'** tab:
31
-
32
- - `Personal Access Token` - PAT created, in Azure DevOps during Step 1.
33
- - `Azure DevOps Organization`.
34
- - `Azure DevOps Project`.
35
- - `Azure DevOps Pipeline Id` - open a pipeline and copy a number value of `definitionId` param from URL (in our case `definitionId = 1`).
36
- - `Azure Server URL` - in case you use self-hosted Azure DevOps Server instead of Azure Cloud.
37
-
38
- ![Testomatio - Azure Pipeline](./images/Azure_D_4.png)
39
-
40
- 5. Switch to **'Input Variables'** tab and select checkboxes:
41
-
42
- - Send Run ID as `run` input (required for scheduled jobs).
43
- - Send Testomat.io API key as `testomatio` input.
44
- - Send Testomat.io Server URL as `testomatio_url` input (if you use on-premise setup).
45
-
46
- 6. Save the conection
47
-
48
- ![Testomatio - Azure Pipeline](./images/Azure_D_5.png)
49
-
50
- 7. Testomat.io will need to send Input Variables into a Pipeline. For this, you need to enable them inside a Pipeline using **Azure DevOps UI**. Open a Pipeline and edit it.
51
-
52
- ![Testomatio - Azure Pipeline](./images/Azure_D_6.png)
53
-
54
- 8. Click **'Variables'** button
55
-
56
- ![Testomatio - Azure Pipeline](./images/Azure_D_7.png)
57
-
58
- 9. Create the following variables:
59
-
60
- - `grep`
61
- - `run`
62
- - `testomatio`
63
- - `testomatio_url`
64
-
65
- ![Testomatio - Azure Pipeline](./images/Azure_D_8.png)
66
-
67
- Do not set defaults to this variable and tick **'Let users override this value when running this pipeline'** so Testomat.io could set these variables via API request.
68
-
69
- ![Testomatio - Azure Pipeline](./images/Azure_D_9.png)
70
-
71
- 10. Update the Pipeline to use passed variables. Update the script and pass environment variables to a test runner. Each variable can be accessed as `$(variable)`.
72
- For CodeceptJS this command will look the following way:
73
-
74
- ```yaml
75
- - script: |
76
- TESTOMATIO=$(testomatio) TESTOMATIO_URL=$(testomatio_url) TESTOMATIO_RUN=$(run) npx codeceptjs run --grep="$(grep)"
77
- displayName: 'run tests'
78
- ```
79
-
80
- :::note
81
-
82
- If you use Jest, Playwright, Cucumber, Cypress, etc. replace `npx codeceptjs run` with the execution command of your test runner.
83
-
84
- :::
85
-
86
- You can pass more custom variables into a Pipeline defining them in a Pipeline UI first and listing them in Testomat.io configuration as well. These variables should be set in Azure in the same way as `grep`. See [Environment Configuration](./index.md#environment-configuration) to see how they can be configured in Testomat.io.
87
-
88
- To specify a different branch to run tests add `ref` parameter on **'Configuration'** tab specifying target ref.
89
-
90
- ![Testomatio - Azure Pipeline](./images/Azure_D_10.png)
91
-
92
- To specify `develop` branch add this as config parameter:
93
-
94
- ```
95
- ref=refs/heads/develop
96
- ```
@@ -1,94 +0,0 @@
1
- ---
2
- title: Atlassian Bamboo
3
- description: This guide explains integrating Atlassian Bamboo with Testomat.io for continuous integration. It includes configuring Bamboo plans, setting environment variables, and running tests with the CodeceptJS framework. Steps to connect Bamboo to Testomat.io via API keys and enable reporting are also provided.
4
- type: article
5
- url: https://docs.testomat.io/integrations/continuous-integration/bamboo
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Atlassian Bamboo, Testomat.io, CI integration, CI connection, continuous integration, CodeceptJS, test automation, API token, environment variables, test reporting, Bamboo plan setup, configuration, workflows
11
- ---
12
-
13
- Let's configure Bamboo CI server to work for CodeceptJS framework:
14
-
15
- 1. Create a plan in Bamboo for Testomat.io to run in Testomat.io.
16
-
17
- ![Testomatio - Bamboo](./images/Bamboo_1.png)
18
-
19
- 2. Note the **'Plan key'**. In this case its **'TES'**.
20
- 3. Configure the job to install node dependencies.
21
-
22
- ![Testomatio - Bamboo](./images/Bamboo_2.png)
23
-
24
- 4. Add the script to run CodeceptJS tests:
25
-
26
- ```
27
- TESTOMATIO_RUN=${bamboo.run} npx codeceptjs run --grep "${bamboo.grep}"
28
- ```
29
- Following environment variables must be set:
30
-
31
- - **Add `TESTOMATIO` environment variable with API key of Testomat.io project.**
32
- - If you are running a self-hosted Testomat.io instance, add `TESTOMATIO_URL` variable to specify a host to which reports will be sent.
33
-
34
- ![Testomatio - Bamboo](./images/Bamboo_3.png)
35
-
36
- 5. Set an input variable. Open Plan configuration:
37
-
38
- ![Testomatio - Bamboo](./images/Bamboo_4.png)
39
-
40
- add `grep` and `run` variables with an empty string as a default value
41
-
42
- ![Testomatio - Bamboo](./images/Bamboo_5.png)
43
-
44
- Now, as Bamboo is configured, you need to configure Bamboo integration at Testomat.io:
45
-
46
- 1. Go to **'Settings'**.
47
- 2. Select **'Continuous Integration'**.
48
- 3. Click **'Connect to CI'**.
49
-
50
- ![Testomatio - CI](./images/CI_4.png)
51
-
52
- 4. Select **'Atlassian Bamboo'** and enter the details of Bamboo server on **'Connection'** tab:
53
-
54
- - `Bamboo Hostname` - URL of Bamboo host.
55
- - `API Token` - to generate API token [check this](https://confluence.atlassian.com/bamboo/personal-access-tokens-976779873.html).
56
- - `Project Key` - Chars ID, in our example its `EX`.
57
- - `Plan Key` - Chars ID, in our example its `TES`.
58
-
59
- A project and plan keys can be found from URL:
60
-
61
- ![Testomatio - Bamboo](./images/Bamboo_6.png)
62
-
63
- ![Testomatio - Bamboo](./images/Bamboo_7.png)
64
-
65
- 5. Enable `run` option on **'Input Variables'** tab. This allows CI to send a report to a specific Run inside Testomat.io.
66
- 6. Click **'Save'** button and check the connection.
67
-
68
- ![Testomatio - Bamboo](./images/Bamboo_8.png)
69
-
70
- :::note
71
-
72
- You can pass more input variables if you set them in [Environment Configuration](./index.md#environment-configuration). For example: test environment, browser, branch, etc.
73
-
74
- :::
75
-
76
- 7a. Open **'Runs'** page then select `Run Automated Tests in CI` option in extra menu.
77
-
78
- ![Testomatio - CI Run](./images/CI_Run_1.png)
79
-
80
- 8a. Select **'Bamboo'** profile in a list. Optionally, select a **Test Plan** or create a new one.
81
-
82
- ![Testomatio - Bamboo](./images/Bamboo_10.png)
83
-
84
- OR
85
-
86
- 7b. On **'Tests'** page select any automated suite or test case -> click **'Extra menu'** button -> select **'Run Tests'** option -> open **'Run in CI'** tab.
87
-
88
- 8b. Select **'Bamboo'** profile in a list.
89
-
90
- ![Testomatio - Bamboo](./images/Bamboo_9a.gif)
91
-
92
- 9. Launch a Run and wait for the results.
93
-
94
- ![Testomatio - Bamboo](./images/Bamboo_11.png)
@@ -1,106 +0,0 @@
1
- ---
2
- title: BitBucket Pipelines
3
- description: Integrate Bitbucket Pipelines with Testomat.io to streamline test execution and reporting. This guide explains setting up API tokens, configuring pipeline parameters, and running tests with environment variables like TESTOMATIO. It includes instructions for handling grep options, on-premise setups, and connecting Testomat.io for seamless CI/CD integration.
4
- type: article
5
- url: https://docs.testomat.io/integrations/continuous-integration/bitbucket
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Bitbucket Pipelines, Testomat.io, CI/CD integration, CI connection, CI Integration, automated testing, test reporting, API tokens, environment variables, test management, on-premise setups
11
- ---
12
-
13
- To connect BitBucket to Testomat.io you will need a API Token created in your BitBucket account.
14
- API token can be added on **'Repository settings'** page of the current user - [create an access token for repository](https://support.atlassian.com/bitbucket-cloud/docs/create-a-repository-access-token/).
15
-
16
- ![Testomat.io - Bitbucket API Token](./images/Bitbucket_1.png)
17
-
18
- Then create a new BitBucket project. Click on **'Create'** button at the header menu and select **'Project'** option from the displayed dropdown list.
19
-
20
- ![Testomat.io - Bitbucket New Project](./images/Bitbucket_2.png)
21
-
22
- Make this build parametrized. Go to **'Settings' -> 'Workspace settings' -> 'Workspace variables'**
23
-
24
- ![Testomat.io - Bitbucket Workspace Variables](./images/Bitbucket_3.png)
25
-
26
- Add the following parameters as a string with empty default values:
27
-
28
- - ```run```
29
- - ```testomatio```
30
- - ```grep```
31
-
32
- The **Job** should include a step where the test runner is executed with `—grep` option and `TESTOMATIO` environment variables passed in.
33
-
34
- For instance: ```- npx codeceptjs run-workers 2 --grep "${grep}"```
35
-
36
- ![Testomat.io - Bitbucket Job Step](./images/Bitbucket_4.png)
37
-
38
- :::note
39
-
40
- If you use on-premise Testomat.io setup you will also need to add `testomatio_url` parameter.
41
-
42
- :::
43
-
44
- Save the build and switch to Testomat.io. To integrate BitBucket with your Testomat.io project follow the steps described below:
45
-
46
- 1. Go to **'Settings'**.
47
- 2. Select **'Continuous Integration'**.
48
- 3. Click **'Connect to CI'**.
49
-
50
- ![Testomatio - CI](./images/CI_4.png)
51
-
52
- 4. Select **'BitBucket Pipeline'** and enter following details on the **'Connection'** tab:
53
-
54
- - `API token` - access token, created in BitBucket during Step 1.
55
- - `Workspace Name` - Workspace UID.
56
- - `Repository Slug`- a URL-friendly version of a repository name, automatically generated by BitBucket for use in the URL.
57
-
58
- ![Testomatio - Bitbucket](./images/Bitbucket_5.png)
59
-
60
- 5. Switch to **'Input Variables'** tab and select checkboxes:
61
-
62
- - Send Run ID as `run` input (required for scheduled jobs).
63
- - Send Testomat.io API key as `testomatio` input.
64
- - Send Testomat.io Server URL as `testomatio_url` input (if you use on-premise setup).
65
-
66
- :::note
67
-
68
- You can set and pass more input variables if you set them in [Environment Configuration](./index.md#environment-configuration). For example: test environment, browser, branch, etc.
69
-
70
- :::
71
-
72
- :::note
73
-
74
- If a pipeline is specified in the configuration, the Bitbucket integration will trigger a custom pipeline instead of the default one.
75
-
76
- :::
77
-
78
- 6. Click on **'Save'** button to save the connection.
79
-
80
- ![Testomatio - Bitbucket](./images/Bitbucket_6.png)
81
-
82
- 7a. When the connection is saved, open **'Runs'** page and select `Run Automated Tests in CI` option in extra menu.
83
-
84
- ![Testomatio - CI Run](./images/CI_Run_1.png)
85
-
86
- 8a. Select **'BitBucket'** profile in a list, select a target ref or any other variables, if any were configured. Optionally, select a **Test Plan** or create a new one.
87
-
88
- 9a. Click on **'Launch'** button and wait for the results.
89
-
90
- ![Testomatio - Bitbucket](./images/Bitbucket_7.png)
91
-
92
- OR
93
-
94
- 7b. On **'Tests'** page select any automated suite or test case -> click **'Extra menu'** button -> select **'Run Tests'** option -> open **'Run in CI'** tab.
95
-
96
- 8b. Select **'BitBucket'** profile in a list, as well, select a target ref or any other variables, if any were configured.
97
-
98
- 9b. Click on **'Launch'** button and wait for the results.
99
-
100
- ![Testomatio - Bitbucket](./images/Bitbucket_7b.gif)
101
-
102
- This will start a new job in BitBucket, please check that the job was successfully triggered and completed. After the job has finished, a run report will be available on Runs page of Testomat.io.
103
-
104
- ![Testomatio - Bitbucket](./images/Bitbucket_8.png)
105
-
106
-