testeiya 0.2.0 → 0.3.9

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (412) hide show
  1. package/LICENSE +21 -0
  2. package/README.md +37 -175
  3. package/dist/prompt/context.js +79 -0
  4. package/dist/prompt/context.js.map +1 -0
  5. package/dist/prompt/index.js +56 -0
  6. package/dist/prompt/index.js.map +1 -0
  7. package/dist/prompt/print.js +22 -0
  8. package/dist/prompt/print.js.map +1 -0
  9. package/dist/prompt/project-info.js +2 -0
  10. package/dist/prompt/project-info.js.map +1 -0
  11. package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +24 -21
  12. package/dist/prompt/system-prompt.js.map +1 -0
  13. package/dist/prompt/testomatio.js +264 -0
  14. package/dist/prompt/testomatio.js.map +1 -0
  15. package/dist/prompt/tools.js +49 -0
  16. package/dist/prompt/tools.js.map +1 -0
  17. package/dist/prompt/vocab.js +8 -0
  18. package/dist/prompt/vocab.js.map +1 -0
  19. package/dist/src/args.js +72 -0
  20. package/dist/src/args.js.map +1 -0
  21. package/dist/src/cli.js +61 -0
  22. package/dist/src/cli.js.map +1 -0
  23. package/dist/src/env.js +69 -0
  24. package/dist/src/env.js.map +1 -0
  25. package/dist/src/mcp-extension.js +9 -0
  26. package/dist/src/mcp-extension.js.map +1 -0
  27. package/dist/src/mcp.js +139 -0
  28. package/dist/src/mcp.js.map +1 -0
  29. package/dist/src/model.js +66 -0
  30. package/dist/src/model.js.map +1 -0
  31. package/dist/src/result.js +41 -0
  32. package/dist/src/result.js.map +1 -0
  33. package/dist/src/run.js +199 -0
  34. package/dist/src/run.js.map +1 -0
  35. package/dist/src/session.js +77 -0
  36. package/dist/src/session.js.map +1 -0
  37. package/dist/vendor/mcp.js +14801 -0
  38. package/mcp-tools.json +2967 -0
  39. package/package.json +29 -41
  40. package/prompt/context.ts +101 -0
  41. package/prompt/index.ts +93 -0
  42. package/prompt/print.ts +23 -0
  43. package/prompt/project-info.ts +30 -0
  44. package/prompt/system-prompt.ts +173 -0
  45. package/{src/prompt → prompt}/testomatio.ts +119 -8
  46. package/{src/prompt → prompt}/tools.ts +30 -8
  47. package/prompt/vocab.ts +7 -0
  48. package/{skills.lock.json → skills/skills.lock.json} +11 -7
  49. package/skills/skills.yaml +34 -0
  50. package/models.catalog.json +0 -6963
  51. package/skills/codeceptjs/ci-fix-tests/SKILL.md +0 -120
  52. package/skills/codeceptjs/codeceptjs-auth/SKILL.md +0 -158
  53. package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +0 -91
  54. package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +0 -158
  55. package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +0 -90
  56. package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +0 -234
  57. package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +0 -110
  58. package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +0 -306
  59. package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +0 -352
  60. package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +0 -472
  61. package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +0 -350
  62. package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +0 -81
  63. package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +0 -206
  64. package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
  65. package/skills/playwright-best-practices-skill/README.md +0 -147
  66. package/skills/playwright-best-practices-skill/SKILL.md +0 -303
  67. package/skills/playwright-best-practices-skill/advanced/authentication-flows.md +0 -360
  68. package/skills/playwright-best-practices-skill/advanced/authentication.md +0 -871
  69. package/skills/playwright-best-practices-skill/advanced/clock-mocking.md +0 -364
  70. package/skills/playwright-best-practices-skill/advanced/mobile-testing.md +0 -409
  71. package/skills/playwright-best-practices-skill/advanced/multi-context.md +0 -288
  72. package/skills/playwright-best-practices-skill/advanced/multi-user.md +0 -393
  73. package/skills/playwright-best-practices-skill/advanced/network-advanced.md +0 -452
  74. package/skills/playwright-best-practices-skill/advanced/third-party.md +0 -464
  75. package/skills/playwright-best-practices-skill/architecture/pom-vs-fixtures.md +0 -363
  76. package/skills/playwright-best-practices-skill/architecture/test-architecture.md +0 -369
  77. package/skills/playwright-best-practices-skill/architecture/when-to-mock.md +0 -383
  78. package/skills/playwright-best-practices-skill/browser-apis/browser-apis.md +0 -391
  79. package/skills/playwright-best-practices-skill/browser-apis/iframes.md +0 -403
  80. package/skills/playwright-best-practices-skill/browser-apis/service-workers.md +0 -504
  81. package/skills/playwright-best-practices-skill/browser-apis/websockets.md +0 -403
  82. package/skills/playwright-best-practices-skill/core/annotations.md +0 -424
  83. package/skills/playwright-best-practices-skill/core/assertions-waiting.md +0 -361
  84. package/skills/playwright-best-practices-skill/core/configuration.md +0 -452
  85. package/skills/playwright-best-practices-skill/core/fixtures-hooks.md +0 -417
  86. package/skills/playwright-best-practices-skill/core/global-setup.md +0 -434
  87. package/skills/playwright-best-practices-skill/core/locators.md +0 -242
  88. package/skills/playwright-best-practices-skill/core/page-object-model.md +0 -315
  89. package/skills/playwright-best-practices-skill/core/projects-dependencies.md +0 -453
  90. package/skills/playwright-best-practices-skill/core/test-data.md +0 -492
  91. package/skills/playwright-best-practices-skill/core/test-suite-structure.md +0 -361
  92. package/skills/playwright-best-practices-skill/core/test-tags.md +0 -298
  93. package/skills/playwright-best-practices-skill/debugging/console-errors.md +0 -420
  94. package/skills/playwright-best-practices-skill/debugging/debugging.md +0 -504
  95. package/skills/playwright-best-practices-skill/debugging/error-testing.md +0 -360
  96. package/skills/playwright-best-practices-skill/debugging/flaky-tests.md +0 -496
  97. package/skills/playwright-best-practices-skill/frameworks/angular.md +0 -530
  98. package/skills/playwright-best-practices-skill/frameworks/nextjs.md +0 -469
  99. package/skills/playwright-best-practices-skill/frameworks/react.md +0 -531
  100. package/skills/playwright-best-practices-skill/frameworks/vue.md +0 -574
  101. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/ci-cd.md +0 -468
  102. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/docker.md +0 -283
  103. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/github-actions.md +0 -546
  104. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/gitlab.md +0 -397
  105. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/other-providers.md +0 -521
  106. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/parallel-sharding.md +0 -371
  107. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/performance.md +0 -453
  108. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/reporting.md +0 -424
  109. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/test-coverage.md +0 -497
  110. package/skills/playwright-best-practices-skill/testing-patterns/accessibility.md +0 -359
  111. package/skills/playwright-best-practices-skill/testing-patterns/api-testing.md +0 -719
  112. package/skills/playwright-best-practices-skill/testing-patterns/browser-extensions.md +0 -506
  113. package/skills/playwright-best-practices-skill/testing-patterns/canvas-webgl.md +0 -493
  114. package/skills/playwright-best-practices-skill/testing-patterns/component-testing.md +0 -500
  115. package/skills/playwright-best-practices-skill/testing-patterns/drag-drop.md +0 -576
  116. package/skills/playwright-best-practices-skill/testing-patterns/electron.md +0 -509
  117. package/skills/playwright-best-practices-skill/testing-patterns/file-operations.md +0 -377
  118. package/skills/playwright-best-practices-skill/testing-patterns/file-upload-download.md +0 -562
  119. package/skills/playwright-best-practices-skill/testing-patterns/forms-validation.md +0 -561
  120. package/skills/playwright-best-practices-skill/testing-patterns/graphql-testing.md +0 -331
  121. package/skills/playwright-best-practices-skill/testing-patterns/i18n.md +0 -508
  122. package/skills/playwright-best-practices-skill/testing-patterns/performance-testing.md +0 -476
  123. package/skills/playwright-best-practices-skill/testing-patterns/security-testing.md +0 -430
  124. package/skills/playwright-best-practices-skill/testing-patterns/visual-regression.md +0 -634
  125. package/skills/playwright-cli/SKILL.md +0 -420
  126. package/skills/playwright-cli/references/element-attributes.md +0 -23
  127. package/skills/playwright-cli/references/playwright-tests.md +0 -39
  128. package/skills/playwright-cli/references/request-mocking.md +0 -87
  129. package/skills/playwright-cli/references/running-code.md +0 -241
  130. package/skills/playwright-cli/references/session-management.md +0 -225
  131. package/skills/playwright-cli/references/storage-state.md +0 -275
  132. package/skills/playwright-cli/references/test-generation.md +0 -433
  133. package/skills/playwright-cli/references/tracing.md +0 -139
  134. package/skills/playwright-cli/references/video-recording.md +0 -143
  135. package/skills/testeiya/README.md +0 -29
  136. package/skills/testeiya/answer-formatting/SKILL.md +0 -30
  137. package/skills/testeiya/check-cucumber/SKILL.md +0 -200
  138. package/skills/testeiya/check-tests/SKILL.md +0 -260
  139. package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
  140. package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
  141. package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
  142. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
  143. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
  144. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
  145. package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
  146. package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
  147. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
  148. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
  149. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
  150. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
  151. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
  152. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
  153. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
  154. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
  155. package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
  156. package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
  157. package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
  158. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
  159. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
  160. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
  161. package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
  162. package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
  163. package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
  164. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
  165. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
  166. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
  167. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
  168. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
  169. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
  170. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
  171. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
  172. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
  173. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
  174. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
  175. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
  176. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
  177. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
  178. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
  179. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
  180. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
  181. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
  182. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
  183. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
  184. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
  185. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
  186. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
  187. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
  188. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
  189. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
  190. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
  191. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
  192. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
  193. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
  194. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
  195. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
  196. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
  197. package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
  198. package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
  199. package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
  200. package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
  201. package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
  202. package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
  203. package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
  204. package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
  205. package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
  206. package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
  207. package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
  208. package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
  209. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
  210. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
  211. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
  212. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
  213. package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
  214. package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
  215. package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
  216. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
  217. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
  218. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
  219. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
  220. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
  221. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
  222. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
  223. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
  224. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
  225. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
  226. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
  227. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
  228. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
  229. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
  230. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
  231. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
  232. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
  233. package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
  234. package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
  235. package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
  236. package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
  237. package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
  238. package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
  239. package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
  240. package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
  241. package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
  242. package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
  243. package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
  244. package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
  245. package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
  246. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
  247. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
  248. package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
  249. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
  250. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
  251. package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
  252. package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
  253. package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
  254. package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
  255. package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
  256. package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
  257. package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
  258. package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
  259. package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
  260. package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
  261. package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
  262. package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
  263. package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
  264. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
  265. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
  266. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
  267. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
  268. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
  269. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
  270. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
  271. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
  272. package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
  273. package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
  274. package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
  275. package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
  276. package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
  277. package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
  278. package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
  279. package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
  280. package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
  281. package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
  282. package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
  283. package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
  284. package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +0 -88
  285. package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +0 -95
  286. package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +0 -334
  287. package/skills/testomatio/test-automation/automate-manual-test-cases/CLAUDE.md +0 -56
  288. package/skills/testomatio/test-automation/automate-manual-test-cases/SKILL.md +0 -242
  289. package/skills/testomatio/test-automation/automate-manual-test-cases/references/CODECEPTJS_BEST_PRACTICES.md +0 -182
  290. package/skills/testomatio/test-automation/automate-manual-test-cases/references/FINAL_SUMMARY_TEMPLATE.md +0 -22
  291. package/skills/testomatio/test-automation/automate-manual-test-cases/references/PLAYWRIGHT_BEST_PRACTICES.md +0 -90
  292. package/skills/testomatio/test-automation/automate-manual-test-cases/references/POM_BEST_PRACTICES.md +0 -53
  293. package/skills/testomatio/test-automation/automate-manual-test-cases/references/TEST_DATA_MANAGEMENT.md +0 -52
  294. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/SKILL.md +0 -107
  295. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/references/DEBUGGING_QUICK_REFERENCE.md +0 -113
  296. package/skills/testomatio/test-automation/qa-automation-test-consolidation/SKILL.md +0 -29
  297. package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +0 -151
  298. package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
  299. package/skills/testomatio/test-automation/testomat-allure-adapter/SKILL.md +0 -289
  300. package/skills/testomatio/test-management/detect-duplicate-test-cases/SKILL.md +0 -86
  301. package/skills/testomatio/test-management/detect-duplicate-test-cases/references/DUPLICATE_INSTRUCTIONS.md +0 -54
  302. package/skills/testomatio/test-management/improve-test-cases/SKILL.md +0 -114
  303. package/skills/testomatio/test-management/improve-test-cases/references/TESTOMAT_MARKDOWN_EXAMPLE.md +0 -66
  304. package/skills/testomatio/test-management/pull-request-diff-analyzer/SKILL.md +0 -141
  305. package/skills/testomatio/test-management/qa-e2e-tests-reporting/SKILL.md +0 -354
  306. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_ARTIFACTS.md +0 -82
  307. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_HTML_REPORT.md +0 -37
  308. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_REPORTERS_CONFIG.md +0 -118
  309. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/SKILL.md +0 -149
  310. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/references/summary-example.md +0 -54
  311. package/skills/testomatio/test-management/qa-requirement-reviewer/SKILL.md +0 -126
  312. package/skills/testomatio/test-management/qa-requirement-reviewer/references/requirements_reviewer_examples.md +0 -128
  313. package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +0 -174
  314. package/skills/testomatio/test-management/qa-test-code-coverage/references/COVERAGE_FILE_FORMAT.md +0 -138
  315. package/skills/testomatio/test-management/qa-test-code-coverage/references/E2E_FRAMEWORKS.md +0 -65
  316. package/skills/testomatio/test-management/qa-test-code-coverage/scripts/check-coverage.mjs +0 -40
  317. package/skills/testomatio/test-management/qa-thinking/SKILL.md +0 -36
  318. package/skills/testomatio/test-management/qa-write-test-cases/SKILL.md +0 -267
  319. package/skills/testomatio/test-management/qa-write-test-cases/references/test-case-format.md +0 -387
  320. package/skills/testomatio/test-management/qa-write-test-cases/references/testomat-tms-guide.md +0 -72
  321. package/skills/testomatio/test-management/qa-write-test-cases/references/writing-rule.md +0 -159
  322. package/skills/testomatio/test-management/scan-automation-project/SKILL.md +0 -152
  323. package/skills/testomatio/test-management/sync-test-cases-with-tms/SKILL.md +0 -107
  324. package/skills/testomatio/test-management/sync-test-cases-with-tms/references/TESTOMATIO_CLI.md +0 -140
  325. package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +0 -182
  326. package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +0 -169
  327. package/skills.yaml +0 -21
  328. package/src/ai-debug.ts +0 -188
  329. package/src/api/agent-get.ts +0 -22
  330. package/src/api/agent-start.ts +0 -384
  331. package/src/api/client-log.ts +0 -29
  332. package/src/api/context.ts +0 -332
  333. package/src/api/debug-layout.ts +0 -47
  334. package/src/api/debug-report.ts +0 -29
  335. package/src/api/debug-snapshot.ts +0 -30
  336. package/src/api/debug-stream.ts +0 -52
  337. package/src/api/files-delete.ts +0 -184
  338. package/src/api/files-read.ts +0 -41
  339. package/src/api/files-rename.ts +0 -99
  340. package/src/api/files-tree.ts +0 -292
  341. package/src/api/files-write.ts +0 -41
  342. package/src/api/mcp.ts +0 -603
  343. package/src/api/memory.ts +0 -69
  344. package/src/api/open-external.ts +0 -39
  345. package/src/api/playwright-cli.ts +0 -606
  346. package/src/api/providers.ts +0 -457
  347. package/src/api/read-env-token.ts +0 -33
  348. package/src/api/sessions.ts +0 -79
  349. package/src/api/settings.ts +0 -120
  350. package/src/api/skills.ts +0 -58
  351. package/src/api/testomatio-attachment.ts +0 -89
  352. package/src/api/testomatio-auth.ts +0 -284
  353. package/src/api/testomatio-proxy.ts +0 -197
  354. package/src/api/testomatio-run-stats.ts +0 -81
  355. package/src/api/testomatio-target.ts +0 -225
  356. package/src/api/testomatio-transcription.ts +0 -82
  357. package/src/api/workspace-search.ts +0 -96
  358. package/src/api/workspace-sync.ts +0 -151
  359. package/src/api/workspace.ts +0 -165
  360. package/src/app-server.ts +0 -556
  361. package/src/bridge.ts +0 -251
  362. package/src/check-tests.ts +0 -156
  363. package/src/cli.ts +0 -17
  364. package/src/commands.ts +0 -244
  365. package/src/config.ts +0 -183
  366. package/src/connection.ts +0 -658
  367. package/src/context-store.ts +0 -265
  368. package/src/debug-bus.ts +0 -405
  369. package/src/extensions/tool-gate.ts +0 -220
  370. package/src/extensions/webui/ask-channel.ts +0 -52
  371. package/src/extensions/webui/index.ts +0 -184
  372. package/src/extensions/webui/tools/ask-question.ts +0 -88
  373. package/src/extensions/webui/tools/query-result.ts +0 -79
  374. package/src/extensions/webui/tools/render-chart.ts +0 -53
  375. package/src/extensions/webui/tools/render-item.ts +0 -61
  376. package/src/extensions/webui/tools/render-list.ts +0 -170
  377. package/src/extensions/webui/tools/render-result.ts +0 -85
  378. package/src/extensions/webui/tools/render-tree.ts +0 -71
  379. package/src/extensions/webui/tools/ui-widget.ts +0 -54
  380. package/src/extensions/webui/tools/widget-result.ts +0 -13
  381. package/src/extensions/webui/widget-channel.ts +0 -50
  382. package/src/file-log.ts +0 -196
  383. package/src/git-tracked.ts +0 -68
  384. package/src/gitignore.ts +0 -53
  385. package/src/json-store.ts +0 -43
  386. package/src/load-env.ts +0 -70
  387. package/src/loader-style.ts +0 -96
  388. package/src/main.ts +0 -140
  389. package/src/mcp-catalog.ts +0 -96
  390. package/src/models-catalog.ts +0 -72
  391. package/src/permissions.ts +0 -120
  392. package/src/project-dir.ts +0 -189
  393. package/src/project-info.ts +0 -108
  394. package/src/prompt/app-ui.ts +0 -59
  395. package/src/prompt/browser.ts +0 -27
  396. package/src/prompt/index.ts +0 -62
  397. package/src/server-info.ts +0 -62
  398. package/src/session-factory.ts +0 -442
  399. package/src/session-store.ts +0 -115
  400. package/src/shell-env.ts +0 -45
  401. package/src/skills.ts +0 -163
  402. package/src/sync-snapshot.ts +0 -140
  403. package/src/telemetry.ts +0 -239
  404. package/src/testomatio-auth.ts +0 -299
  405. package/src/testomatio.ts +0 -98
  406. package/src/theme.ts +0 -30
  407. package/src/user-env.ts +0 -94
  408. package/src/welcome.ts +0 -127
  409. package/src/workspace/safe-path.ts +0 -85
  410. package/src/workspace/test-md.ts +0 -70
  411. package/src/workspace-model.ts +0 -440
  412. package/testeiya.config.json +0 -14
@@ -1,290 +0,0 @@
1
- ---
2
- title: Start With Testomat.io
3
- description: This guide helps users start from scratch with Testomat.io by creating projects, writing test cases, running manual and automated tests, and analyzing results with detailed reporting and analytics. It also includes importing automated tests and tracking automation coverage for optimization.
4
- type: article
5
- url: https://docs.testomat.io/getting-started/start-from-scratch/
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Testomat.io, getting started, manual tests, automated tests, test reporting, project creation, test analytics, automation coverage, test cases, test management system
11
- ---
12
-
13
- <!--
14
- > If you don't have any manual or automated tests yet - follow this guide. Otherwise, pick the section of the guide relevant to your project. You might want to start from [this section](https://docs.testomat.io/getting-started/import-tests-from-source-code/) if you consider **importing tests from source code** into Testomat.io. For those interested in importing tests from the **Cucumber** framework, go straight to [this section](https://docs.testomat.io/getting-started/import-tests-from-cucumber/#why-do-i-need-to-import-my-tests)!
15
- -->
16
-
17
- Welcome!
18
-
19
- This step-by-step guide helps you to create your project, add tests, execute them, and review results with analytics.
20
-
21
- By the end of this guide, you will have:
22
-
23
- - a project
24
- - suites/folders with suites
25
- - tests
26
- - runs
27
- - a report
28
- - visual analytics with all data
29
-
30
- ![Testomat.io - GETTING STARTED general diagram](./images/testing-workflow.png)
31
-
32
- ## Create Project
33
-
34
- A project is the main entity in Testomat.io that contains all tests, test execution programs, and analytical data on them. Every project can contain any number of suites and folders with any amount of tests, test runs, plans, and reports in them.
35
-
36
- :::note
37
-
38
- Each project is a separate entity. That means, you can do whatever you want within the Project, but you cannot cross-do staff between Projects.
39
-
40
- :::
41
-
42
- Register at [app.testomat.io](https://app.testomat.io) and activate your user account. Then create a new project:
43
- 1. Go to your account **Dashboard**.
44
- 2. In the top-right corner, click **Create**.
45
- 3. Enter the project title.
46
- 4. Choose the project type:
47
- - BDD Project
48
- - Classical Project
49
- 5. Decide whether to use demo data or your own data.
50
- 6. Click **Create**.
51
-
52
- ![Testomat.io - Create new project](./images/create-project.png)
53
-
54
- Use [BDD Project](https://docs.testomat.io/project/tests/bdd-test-case-editor/) if you plan to work with BDD descriptions or the Cucumber framework.
55
-
56
- Use [Classical Project](https://docs.testomat.io/project/tests/classical-test-case-editor/) if you want free-form markdown test cases with automation synced to test cases.
57
-
58
- You have just created your first project!
59
-
60
- Now you can start creating suites and test cases for your projects.
61
-
62
- ## Create a Suite
63
-
64
- Test suite is a collection of tests grouped together. You can create suites or create a folder with suites.
65
-
66
- ![Testomat.io - Create new Suite](./images/project-hierarchy-icons.png)
67
-
68
- To create a suite:
69
- 1. Select a project.
70
- 2. Click **New suite**.
71
- 3. Enter your Suite name.
72
- 4. Press `Enter` on your keyboard.
73
-
74
- Another way to create suite:
75
-
76
- 1. Click action menu button (...).
77
- 2. Select **Create more suites** from the menu.
78
-
79
- ![create more suite button](./images/suite1.png)
80
-
81
- 3. Enter the title of the new suite or folder.
82
- 4. Click **'+ Suite'** to create a test suite, or optionally
83
- 5. Click **'Folder'** to create a folder for grouping suites.
84
-
85
- ![create new suite/folder](./images/suite%202.png)
86
-
87
- :::note
88
-
89
- You can create folders to group your suites. On the project page, click **New folder**, enter its name, and press `Enter` on the keyboard.
90
-
91
- You can create any number of folders and suites within a folder.
92
-
93
- :::
94
-
95
- ## Create Manual Test Cases
96
-
97
- Read full article: [Test Case Creation and Editing](https://docs.testomat.io/project/tests/test-case-creation-and-editing/).
98
-
99
- After you’ve created test suites, you can start adding tests.
100
- 1. Select a test suite.
101
- 2. Click on Suite, and a Suite panel will open to the right.
102
- 3. At the bottom of the **Tests** tab, enter the name of the test.
103
- 4. Click **Create**.
104
- 5. Click on the test to edit it.
105
-
106
- :::note
107
-
108
- When tests are newly created, they are marked as **manual** by default, which shows that they are ready for manual checks.
109
-
110
- :::
111
-
112
- You can also create a test using the **New test** button at the top of the Suite editor panel.
113
-
114
- ![Testomat.io - Create test case](./images/manual-tests-create.png)
115
-
116
- ### Bulk-create Tests
117
-
118
- Read full article: [Bulk Edit](https://docs.testomat.io/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level/).
119
-
120
- To add multiple tests at once by listing their names, rather than adding each one individually:
121
- 1. Open (or create) a suite.
122
- 2. Turn on the **Bulk** toggle.
123
- 3. Type **one test name per line** in the input field.
124
- 4. Click **Create** - every line becomes a separate test, all added together.
125
-
126
- ![Testomat.io - Create test case](./images/bulk-create-tests.png)
127
-
128
- ## Run Manual Tests
129
-
130
- Read full article: [Running Tests Manually](https://docs.testomat.io/project/runs/running-tests-manually/).
131
-
132
- There are two main ways to start a manual run:
133
-
134
- From the ‘Tests’ page, quick launch for selected tests or suites, or adding tests to an already ongoing run without leaving the Tests view.
135
-
136
- 1. On the **Tests** sidebar tab, activate **Multi-select**.
137
- 2. Select tests you need to run.
138
- 3. Click the **Run** button in the actions menu below.
139
-
140
- ![Testomat.io - Tests manual run](./images/tests-manual-run.png)
141
-
142
- From the ‘Runs’ page - the classic way to create and manage full runs with complete configuration options.
143
-
144
- 1. Go to the **Runs** tab in the sidebar.
145
- 2. Click the **New** button and select **New manual test run**.
146
- 3. Enter the run **Title**.
147
- 4. Then select **All tests**, **Test plan**, **Select tests**, or **Without tests** to run tests.
148
- 5. Click the **Launch** button to execute the tests.
149
-
150
- ![Testomat.io - Run manual tests](./images/run-manual-tests.png)
151
-
152
- :::note
153
-
154
- Before tests execution, you can specify the run [environment options](https://docs.testomat.io/getting-started/running-tests-manually/#multi-environment-tests).
155
-
156
- You can also toggle the **Run Automated as Manual** switch to select the result of automated tests manually.
157
-
158
- :::
159
-
160
- When the test execution is launched, testers can:
161
- - Mark each test as **Passed**, **Failed**, or **Skipped**.
162
- - Add messages.
163
- - Attach evidence (screenshots, logs, etc.)
164
- - Assign tests to specific team members.
165
-
166
- ![Testomat.io - Execute tests](./images/launch-manual-run.png)
167
-
168
- ## Import Automated Tests
169
-
170
- Read full article: [Import Automated Tests](https://docs.testomat.io/getting-started/#import-automated-tests), [Import from CSV/XLSX](https://docs.testomat.io/project/import-export/import/import-tests-from-csv-xlsx/), and [Import Tests From TestRail](https://docs.testomat.io/project/import-export/import/import-tests-from-testrail/).
171
-
172
- To add automated tests to your project, you must import them from the source code, a CSV file, or an existing TestRail suite. To import automated tests, follow these steps:
173
-
174
- 1. Open your project.
175
- 2. Navigate to the actions (...).
176
- 3. Click **Import automated tests**.
177
-
178
- Alternatively:
179
-
180
- 1. Go to the Imports menu.
181
- 2. Navigate to the **Import** dropdown menu.
182
- 3. Select an import option:
183
-
184
- | Import option | Description |
185
- |---|---|
186
- | **Import from Source Code** | Imports tests directly from your local project or repository. |
187
- | **Import from CSV** | Imports tests from a CSV file and converts it to one of the available formats. |
188
- | **Import from TestRail** | Imports tests from an existing TestRail suite. |
189
-
190
- In the **Import** section, pick the framework, programming language and operating system you are using for testing.
191
-
192
- ![Testomat.io - Copy instructions](./images/copy-import-instructions.png)
193
-
194
- :::note
195
-
196
- Please check your environment:
197
-
198
- - For NodeJS (JavaScript, TypeScript): you need NodeJS 10+ and npm installed to be able to run this command.
199
- - For PHP: you need PHP > 7.2 and Composer installed.
200
-
201
- :::
202
-
203
- ### Import via Terminal
204
-
205
- Testomat.io can store tests from various frameworks. To import automated tests:
206
-
207
- 1. Open a terminal, navigate to the tests folder in your project.
208
- 2. Copy and execute the import command in a terminal.
209
- 3. See a report on how many tests were found.
210
- 4. Reopen the project and see that all tests with their folders and files are shown on Testomat.io.
211
-
212
- ![Testomat.io - Execute command in terminal, automated tests found and sent](./images/import-tests-terminal.png)
213
-
214
- If you don't see a similar message, please check the command's API change command parameters so it could find tests. The most common issues with import are different file naming format and/or incorrect directory for import.
215
-
216
- :::note
217
-
218
- All imported tests are marked as "Automated" by default. Please, check that the link actually points to the corresponding file.
219
-
220
- :::
221
-
222
- ## Run Automated Tests
223
-
224
- Read full article: [Running Automated Tests](https://docs.testomat.io/project/runs/running-automated-tests/).
225
-
226
- To start Run Automated Tests:
227
- 1. Go to the **Runs** page.
228
- 2. Navigate to the **New** dropdown menu.
229
- 3. Select **Report automated tests**.
230
-
231
- ![Testomat.io - Import automated tests](./images/report-automated-tests.png)
232
-
233
- 5. In the opened window select your framework.
234
- 6. Testomat.io will generate a terminal command.
235
-
236
- ![Testomat.io - Choose test automation framework](./images/report-automated-tests-2.png)
237
-
238
- 7. Start generated commands in your terminal from your project folder.
239
-
240
- ![Testomat.io - Execute test cases](./images/execute-test-terminal.png)
241
-
242
- 8. A new Test Run will appear on Runs page.
243
-
244
- ## Test Run Report
245
-
246
- Read full article: [Testomat.io Reporter](https://docs.testomat.io/test-reporting/reporter/).
247
-
248
- You can use Testomat.io as a test management system or as a rich reporting tool. Each test has its history and a lifecycle, so each test report will be attached to a corresponding test in a project.
249
-
250
- To view your test run reports:
251
-
252
- 1. Navigate to the Runs menu.
253
- 2. Find the information about the completed test run (the duration of the run, the performer, etc.)
254
- 3. Filter by status, find specific tests by tags, or sort by available methods.
255
- 4. You can see test results in real-time.
256
-
257
- ![Testomat.io - Simplified test report](./images/run-report-1.png)
258
-
259
- To get a detailed report of the test run, click on the **Report** button. Share the report with your stakeholders.
260
-
261
- ![Testomat.io - Detailed test report](./images/run-report-2.png)
262
-
263
- :::note
264
-
265
- Artifacts like screenshots, videos, and traces are uploaded to your own cloud storage via S3 protocol. Artifacts can be uploaded privately or publicly and used in reports.
266
-
267
- :::
268
-
269
- ## Analytics
270
-
271
- Read full article: [Analytics](https://docs.testomat.io/project/analytics/).
272
-
273
- Testomat.io Analytics provides an extensive overview of testing data by tracking both automated and manual tests. You can visualize trends over time with custom charts, identify automation coverage, monitor failure patterns, and analyze metrics like flaky or slowest tests.
274
-
275
- ![Testomat.io - Analytics](./images/analytics-testomat-io.png)
276
-
277
- Additional features include a failure board, label, and tag statistics for better team insights, allowing for optimized testing and proactive bug prevention.
278
-
279
-
280
-
281
- ## Explore more features
282
-
283
- Learn more: [AI-Powered Features](https://docs.testomat.io/advanced/ai-powered-features/ai-powered-features/) and [Issues Management Systems](https://docs.testomat.io/integrations/issues-management/).
284
-
285
- Once you’re comfortable with the core workflow, you can start using advanced features to help you with your QA process.
286
-
287
- A built-in AI assistant can generate new test cases from existing suites or requirements, suggest missing scenarios, summarize project coverage, and write descriptions for undocumented automated tests.
288
-
289
- On the integrations side, Testomat.io works out of the box with popular automation frameworks ([Playwright](https://docs.testomat.io/tutorials/playwright/), [Cypress](https://docs.testomat.io/test-reporting/workflows/#github-actions-and-cypress-trigger--pr), [Cucumber](https://docs.testomat.io/project/import-export/import/import-bdd/#_top), and more), CI/CD tools like [GitHub Actions](https://docs.testomat.io/integrations/continuous-integration/github), [GitLab](https://docs.testomat.io/integrations/continuous-integration/gitlab), and [Jenkins](https://docs.testomat.io/integrations/continuous-integration/jenkins), as well as team tools such as [Slack](https://docs.testomat.io/integrations/report-notifications/slack) and [Confluence](https://docs.testomat.io/integrations/issues-management/confluence). In addition, the [Jira](https://docs.testomat.io/integrations/report-notifications/jira) plugin keeps tests, issues, and results in sync so your whole team can manage testing without leaving the tools they already use.
290
-
@@ -1,96 +0,0 @@
1
- ---
2
- title: Azure Pipelines
3
- description: Integrate Azure Pipelines with Testomat.io to automate test execution and reporting. This guide explains setting up CI connections, creating input variables, and configuring pipelines to run tests with tools like CodeceptJS, Jest, or Playwright. It also details passing custom variables and specifying branches for targeted testing.
4
- type: article
5
- url: https://docs.testomat.io/integrations/continuous-integration/azure
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Azure DevOps, Testomat.io, CI connection, CI Integration, Azure Pipeline, Personal Access Token, Continious Integration, Test Automation, Test Management, Microsoft Azure, input variables, configuration, workflows, test reporting
11
- ---
12
-
13
- To connect Azure DevOps to Testomat.io, first you need to create an Private Access Token (PAT).
14
- Learn how to create a PAT following the link - [Create PAT](https://learn.microsoft.com/en-us/azure/devops/organizations/accounts/use-personal-access-tokens-to-authenticate?view=azure-devops&tabs=Windows).
15
-
16
- And follow the instructions below:
17
-
18
- 1. Create a **PAT** in your Azure DevOps account with permission to **Read & Execute Build**.
19
-
20
- ![Testomatio - Azure Pipeline](./images/Azure_D_1.png)
21
-
22
- 2. Obtain the **ID** of a Pipeline you want to execute. Open a Pipeline and copy its ID from `definitionId` query parameter. On this screenshot the ID is `1`.
23
-
24
- ![Testomatio - Azure Pipeline](./images/Azure_D_2.png)
25
-
26
- 3. Create a new **CI connection** inside your project in Testomat.io: go to **'Settings' -> 'Continuous Integration' ->** click **'Connect to CI'** select **'Azure Pipelines'**
27
-
28
- ![Testomatio - Azure Pipeline](./images/Azure_D_3.png)
29
-
30
- 4. Enter following details on the **'Connection'** tab:
31
-
32
- - `Personal Access Token` - PAT created, in Azure DevOps during Step 1.
33
- - `Azure DevOps Organization`.
34
- - `Azure DevOps Project`.
35
- - `Azure DevOps Pipeline Id` - open a pipeline and copy a number value of `definitionId` param from URL (in our case `definitionId = 1`).
36
- - `Azure Server URL` - in case you use self-hosted Azure DevOps Server instead of Azure Cloud.
37
-
38
- ![Testomatio - Azure Pipeline](./images/Azure_D_4.png)
39
-
40
- 5. Switch to **'Input Variables'** tab and select checkboxes:
41
-
42
- - Send Run ID as `run` input (required for scheduled jobs).
43
- - Send Testomat.io API key as `testomatio` input.
44
- - Send Testomat.io Server URL as `testomatio_url` input (if you use on-premise setup).
45
-
46
- 6. Save the conection
47
-
48
- ![Testomatio - Azure Pipeline](./images/Azure_D_5.png)
49
-
50
- 7. Testomat.io will need to send Input Variables into a Pipeline. For this, you need to enable them inside a Pipeline using **Azure DevOps UI**. Open a Pipeline and edit it.
51
-
52
- ![Testomatio - Azure Pipeline](./images/Azure_D_6.png)
53
-
54
- 8. Click **'Variables'** button
55
-
56
- ![Testomatio - Azure Pipeline](./images/Azure_D_7.png)
57
-
58
- 9. Create the following variables:
59
-
60
- - `grep`
61
- - `run`
62
- - `testomatio`
63
- - `testomatio_url`
64
-
65
- ![Testomatio - Azure Pipeline](./images/Azure_D_8.png)
66
-
67
- Do not set defaults to this variable and tick **'Let users override this value when running this pipeline'** so Testomat.io could set these variables via API request.
68
-
69
- ![Testomatio - Azure Pipeline](./images/Azure_D_9.png)
70
-
71
- 10. Update the Pipeline to use passed variables. Update the script and pass environment variables to a test runner. Each variable can be accessed as `$(variable)`.
72
- For CodeceptJS this command will look the following way:
73
-
74
- ```yaml
75
- - script: |
76
- TESTOMATIO=$(testomatio) TESTOMATIO_URL=$(testomatio_url) TESTOMATIO_RUN=$(run) npx codeceptjs run --grep="$(grep)"
77
- displayName: 'run tests'
78
- ```
79
-
80
- :::note
81
-
82
- If you use Jest, Playwright, Cucumber, Cypress, etc. replace `npx codeceptjs run` with the execution command of your test runner.
83
-
84
- :::
85
-
86
- You can pass more custom variables into a Pipeline defining them in a Pipeline UI first and listing them in Testomat.io configuration as well. These variables should be set in Azure in the same way as `grep`. See [Environment Configuration](./index.md#environment-configuration) to see how they can be configured in Testomat.io.
87
-
88
- To specify a different branch to run tests add `ref` parameter on **'Configuration'** tab specifying target ref.
89
-
90
- ![Testomatio - Azure Pipeline](./images/Azure_D_10.png)
91
-
92
- To specify `develop` branch add this as config parameter:
93
-
94
- ```
95
- ref=refs/heads/develop
96
- ```
@@ -1,94 +0,0 @@
1
- ---
2
- title: Atlassian Bamboo
3
- description: This guide explains integrating Atlassian Bamboo with Testomat.io for continuous integration. It includes configuring Bamboo plans, setting environment variables, and running tests with the CodeceptJS framework. Steps to connect Bamboo to Testomat.io via API keys and enable reporting are also provided.
4
- type: article
5
- url: https://docs.testomat.io/integrations/continuous-integration/bamboo
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Atlassian Bamboo, Testomat.io, CI integration, CI connection, continuous integration, CodeceptJS, test automation, API token, environment variables, test reporting, Bamboo plan setup, configuration, workflows
11
- ---
12
-
13
- Let's configure Bamboo CI server to work for CodeceptJS framework:
14
-
15
- 1. Create a plan in Bamboo for Testomat.io to run in Testomat.io.
16
-
17
- ![Testomatio - Bamboo](./images/Bamboo_1.png)
18
-
19
- 2. Note the **'Plan key'**. In this case its **'TES'**.
20
- 3. Configure the job to install node dependencies.
21
-
22
- ![Testomatio - Bamboo](./images/Bamboo_2.png)
23
-
24
- 4. Add the script to run CodeceptJS tests:
25
-
26
- ```
27
- TESTOMATIO_RUN=${bamboo.run} npx codeceptjs run --grep "${bamboo.grep}"
28
- ```
29
- Following environment variables must be set:
30
-
31
- - **Add `TESTOMATIO` environment variable with API key of Testomat.io project.**
32
- - If you are running a self-hosted Testomat.io instance, add `TESTOMATIO_URL` variable to specify a host to which reports will be sent.
33
-
34
- ![Testomatio - Bamboo](./images/Bamboo_3.png)
35
-
36
- 5. Set an input variable. Open Plan configuration:
37
-
38
- ![Testomatio - Bamboo](./images/Bamboo_4.png)
39
-
40
- add `grep` and `run` variables with an empty string as a default value
41
-
42
- ![Testomatio - Bamboo](./images/Bamboo_5.png)
43
-
44
- Now, as Bamboo is configured, you need to configure Bamboo integration at Testomat.io:
45
-
46
- 1. Go to **'Settings'**.
47
- 2. Select **'Continuous Integration'**.
48
- 3. Click **'Connect to CI'**.
49
-
50
- ![Testomatio - CI](./images/CI_4.png)
51
-
52
- 4. Select **'Atlassian Bamboo'** and enter the details of Bamboo server on **'Connection'** tab:
53
-
54
- - `Bamboo Hostname` - URL of Bamboo host.
55
- - `API Token` - to generate API token [check this](https://confluence.atlassian.com/bamboo/personal-access-tokens-976779873.html).
56
- - `Project Key` - Chars ID, in our example its `EX`.
57
- - `Plan Key` - Chars ID, in our example its `TES`.
58
-
59
- A project and plan keys can be found from URL:
60
-
61
- ![Testomatio - Bamboo](./images/Bamboo_6.png)
62
-
63
- ![Testomatio - Bamboo](./images/Bamboo_7.png)
64
-
65
- 5. Enable `run` option on **'Input Variables'** tab. This allows CI to send a report to a specific Run inside Testomat.io.
66
- 6. Click **'Save'** button and check the connection.
67
-
68
- ![Testomatio - Bamboo](./images/Bamboo_8.png)
69
-
70
- :::note
71
-
72
- You can pass more input variables if you set them in [Environment Configuration](./index.md#environment-configuration). For example: test environment, browser, branch, etc.
73
-
74
- :::
75
-
76
- 7a. Open **'Runs'** page then select `Run Automated Tests in CI` option in extra menu.
77
-
78
- ![Testomatio - CI Run](./images/CI_Run_1.png)
79
-
80
- 8a. Select **'Bamboo'** profile in a list. Optionally, select a **Test Plan** or create a new one.
81
-
82
- ![Testomatio - Bamboo](./images/Bamboo_10.png)
83
-
84
- OR
85
-
86
- 7b. On **'Tests'** page select any automated suite or test case -> click **'Extra menu'** button -> select **'Run Tests'** option -> open **'Run in CI'** tab.
87
-
88
- 8b. Select **'Bamboo'** profile in a list.
89
-
90
- ![Testomatio - Bamboo](./images/Bamboo_9a.gif)
91
-
92
- 9. Launch a Run and wait for the results.
93
-
94
- ![Testomatio - Bamboo](./images/Bamboo_11.png)
@@ -1,106 +0,0 @@
1
- ---
2
- title: BitBucket Pipelines
3
- description: Integrate Bitbucket Pipelines with Testomat.io to streamline test execution and reporting. This guide explains setting up API tokens, configuring pipeline parameters, and running tests with environment variables like TESTOMATIO. It includes instructions for handling grep options, on-premise setups, and connecting Testomat.io for seamless CI/CD integration.
4
- type: article
5
- url: https://docs.testomat.io/integrations/continuous-integration/bitbucket
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Bitbucket Pipelines, Testomat.io, CI/CD integration, CI connection, CI Integration, automated testing, test reporting, API tokens, environment variables, test management, on-premise setups
11
- ---
12
-
13
- To connect BitBucket to Testomat.io you will need a API Token created in your BitBucket account.
14
- API token can be added on **'Repository settings'** page of the current user - [create an access token for repository](https://support.atlassian.com/bitbucket-cloud/docs/create-a-repository-access-token/).
15
-
16
- ![Testomat.io - Bitbucket API Token](./images/Bitbucket_1.png)
17
-
18
- Then create a new BitBucket project. Click on **'Create'** button at the header menu and select **'Project'** option from the displayed dropdown list.
19
-
20
- ![Testomat.io - Bitbucket New Project](./images/Bitbucket_2.png)
21
-
22
- Make this build parametrized. Go to **'Settings' -> 'Workspace settings' -> 'Workspace variables'**
23
-
24
- ![Testomat.io - Bitbucket Workspace Variables](./images/Bitbucket_3.png)
25
-
26
- Add the following parameters as a string with empty default values:
27
-
28
- - ```run```
29
- - ```testomatio```
30
- - ```grep```
31
-
32
- The **Job** should include a step where the test runner is executed with `—grep` option and `TESTOMATIO` environment variables passed in.
33
-
34
- For instance: ```- npx codeceptjs run-workers 2 --grep "${grep}"```
35
-
36
- ![Testomat.io - Bitbucket Job Step](./images/Bitbucket_4.png)
37
-
38
- :::note
39
-
40
- If you use on-premise Testomat.io setup you will also need to add `testomatio_url` parameter.
41
-
42
- :::
43
-
44
- Save the build and switch to Testomat.io. To integrate BitBucket with your Testomat.io project follow the steps described below:
45
-
46
- 1. Go to **'Settings'**.
47
- 2. Select **'Continuous Integration'**.
48
- 3. Click **'Connect to CI'**.
49
-
50
- ![Testomatio - CI](./images/CI_4.png)
51
-
52
- 4. Select **'BitBucket Pipeline'** and enter following details on the **'Connection'** tab:
53
-
54
- - `API token` - access token, created in BitBucket during Step 1.
55
- - `Workspace Name` - Workspace UID.
56
- - `Repository Slug`- a URL-friendly version of a repository name, automatically generated by BitBucket for use in the URL.
57
-
58
- ![Testomatio - Bitbucket](./images/Bitbucket_5.png)
59
-
60
- 5. Switch to **'Input Variables'** tab and select checkboxes:
61
-
62
- - Send Run ID as `run` input (required for scheduled jobs).
63
- - Send Testomat.io API key as `testomatio` input.
64
- - Send Testomat.io Server URL as `testomatio_url` input (if you use on-premise setup).
65
-
66
- :::note
67
-
68
- You can set and pass more input variables if you set them in [Environment Configuration](./index.md#environment-configuration). For example: test environment, browser, branch, etc.
69
-
70
- :::
71
-
72
- :::note
73
-
74
- If a pipeline is specified in the configuration, the Bitbucket integration will trigger a custom pipeline instead of the default one.
75
-
76
- :::
77
-
78
- 6. Click on **'Save'** button to save the connection.
79
-
80
- ![Testomatio - Bitbucket](./images/Bitbucket_6.png)
81
-
82
- 7a. When the connection is saved, open **'Runs'** page and select `Run Automated Tests in CI` option in extra menu.
83
-
84
- ![Testomatio - CI Run](./images/CI_Run_1.png)
85
-
86
- 8a. Select **'BitBucket'** profile in a list, select a target ref or any other variables, if any were configured. Optionally, select a **Test Plan** or create a new one.
87
-
88
- 9a. Click on **'Launch'** button and wait for the results.
89
-
90
- ![Testomatio - Bitbucket](./images/Bitbucket_7.png)
91
-
92
- OR
93
-
94
- 7b. On **'Tests'** page select any automated suite or test case -> click **'Extra menu'** button -> select **'Run Tests'** option -> open **'Run in CI'** tab.
95
-
96
- 8b. Select **'BitBucket'** profile in a list, as well, select a target ref or any other variables, if any were configured.
97
-
98
- 9b. Click on **'Launch'** button and wait for the results.
99
-
100
- ![Testomatio - Bitbucket](./images/Bitbucket_7b.gif)
101
-
102
- This will start a new job in BitBucket, please check that the job was successfully triggered and completed. After the job has finished, a run report will be available on Runs page of Testomat.io.
103
-
104
- ![Testomatio - Bitbucket](./images/Bitbucket_8.png)
105
-
106
-