testeiya 0.2.0 → 0.3.9

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (412) hide show
  1. package/LICENSE +21 -0
  2. package/README.md +37 -175
  3. package/dist/prompt/context.js +79 -0
  4. package/dist/prompt/context.js.map +1 -0
  5. package/dist/prompt/index.js +56 -0
  6. package/dist/prompt/index.js.map +1 -0
  7. package/dist/prompt/print.js +22 -0
  8. package/dist/prompt/print.js.map +1 -0
  9. package/dist/prompt/project-info.js +2 -0
  10. package/dist/prompt/project-info.js.map +1 -0
  11. package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +24 -21
  12. package/dist/prompt/system-prompt.js.map +1 -0
  13. package/dist/prompt/testomatio.js +264 -0
  14. package/dist/prompt/testomatio.js.map +1 -0
  15. package/dist/prompt/tools.js +49 -0
  16. package/dist/prompt/tools.js.map +1 -0
  17. package/dist/prompt/vocab.js +8 -0
  18. package/dist/prompt/vocab.js.map +1 -0
  19. package/dist/src/args.js +72 -0
  20. package/dist/src/args.js.map +1 -0
  21. package/dist/src/cli.js +61 -0
  22. package/dist/src/cli.js.map +1 -0
  23. package/dist/src/env.js +69 -0
  24. package/dist/src/env.js.map +1 -0
  25. package/dist/src/mcp-extension.js +9 -0
  26. package/dist/src/mcp-extension.js.map +1 -0
  27. package/dist/src/mcp.js +139 -0
  28. package/dist/src/mcp.js.map +1 -0
  29. package/dist/src/model.js +66 -0
  30. package/dist/src/model.js.map +1 -0
  31. package/dist/src/result.js +41 -0
  32. package/dist/src/result.js.map +1 -0
  33. package/dist/src/run.js +199 -0
  34. package/dist/src/run.js.map +1 -0
  35. package/dist/src/session.js +77 -0
  36. package/dist/src/session.js.map +1 -0
  37. package/dist/vendor/mcp.js +14801 -0
  38. package/mcp-tools.json +2967 -0
  39. package/package.json +29 -41
  40. package/prompt/context.ts +101 -0
  41. package/prompt/index.ts +93 -0
  42. package/prompt/print.ts +23 -0
  43. package/prompt/project-info.ts +30 -0
  44. package/prompt/system-prompt.ts +173 -0
  45. package/{src/prompt → prompt}/testomatio.ts +119 -8
  46. package/{src/prompt → prompt}/tools.ts +30 -8
  47. package/prompt/vocab.ts +7 -0
  48. package/{skills.lock.json → skills/skills.lock.json} +11 -7
  49. package/skills/skills.yaml +34 -0
  50. package/models.catalog.json +0 -6963
  51. package/skills/codeceptjs/ci-fix-tests/SKILL.md +0 -120
  52. package/skills/codeceptjs/codeceptjs-auth/SKILL.md +0 -158
  53. package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +0 -91
  54. package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +0 -158
  55. package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +0 -90
  56. package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +0 -234
  57. package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +0 -110
  58. package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +0 -306
  59. package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +0 -352
  60. package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +0 -472
  61. package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +0 -350
  62. package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +0 -81
  63. package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +0 -206
  64. package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
  65. package/skills/playwright-best-practices-skill/README.md +0 -147
  66. package/skills/playwright-best-practices-skill/SKILL.md +0 -303
  67. package/skills/playwright-best-practices-skill/advanced/authentication-flows.md +0 -360
  68. package/skills/playwright-best-practices-skill/advanced/authentication.md +0 -871
  69. package/skills/playwright-best-practices-skill/advanced/clock-mocking.md +0 -364
  70. package/skills/playwright-best-practices-skill/advanced/mobile-testing.md +0 -409
  71. package/skills/playwright-best-practices-skill/advanced/multi-context.md +0 -288
  72. package/skills/playwright-best-practices-skill/advanced/multi-user.md +0 -393
  73. package/skills/playwright-best-practices-skill/advanced/network-advanced.md +0 -452
  74. package/skills/playwright-best-practices-skill/advanced/third-party.md +0 -464
  75. package/skills/playwright-best-practices-skill/architecture/pom-vs-fixtures.md +0 -363
  76. package/skills/playwright-best-practices-skill/architecture/test-architecture.md +0 -369
  77. package/skills/playwright-best-practices-skill/architecture/when-to-mock.md +0 -383
  78. package/skills/playwright-best-practices-skill/browser-apis/browser-apis.md +0 -391
  79. package/skills/playwright-best-practices-skill/browser-apis/iframes.md +0 -403
  80. package/skills/playwright-best-practices-skill/browser-apis/service-workers.md +0 -504
  81. package/skills/playwright-best-practices-skill/browser-apis/websockets.md +0 -403
  82. package/skills/playwright-best-practices-skill/core/annotations.md +0 -424
  83. package/skills/playwright-best-practices-skill/core/assertions-waiting.md +0 -361
  84. package/skills/playwright-best-practices-skill/core/configuration.md +0 -452
  85. package/skills/playwright-best-practices-skill/core/fixtures-hooks.md +0 -417
  86. package/skills/playwright-best-practices-skill/core/global-setup.md +0 -434
  87. package/skills/playwright-best-practices-skill/core/locators.md +0 -242
  88. package/skills/playwright-best-practices-skill/core/page-object-model.md +0 -315
  89. package/skills/playwright-best-practices-skill/core/projects-dependencies.md +0 -453
  90. package/skills/playwright-best-practices-skill/core/test-data.md +0 -492
  91. package/skills/playwright-best-practices-skill/core/test-suite-structure.md +0 -361
  92. package/skills/playwright-best-practices-skill/core/test-tags.md +0 -298
  93. package/skills/playwright-best-practices-skill/debugging/console-errors.md +0 -420
  94. package/skills/playwright-best-practices-skill/debugging/debugging.md +0 -504
  95. package/skills/playwright-best-practices-skill/debugging/error-testing.md +0 -360
  96. package/skills/playwright-best-practices-skill/debugging/flaky-tests.md +0 -496
  97. package/skills/playwright-best-practices-skill/frameworks/angular.md +0 -530
  98. package/skills/playwright-best-practices-skill/frameworks/nextjs.md +0 -469
  99. package/skills/playwright-best-practices-skill/frameworks/react.md +0 -531
  100. package/skills/playwright-best-practices-skill/frameworks/vue.md +0 -574
  101. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/ci-cd.md +0 -468
  102. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/docker.md +0 -283
  103. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/github-actions.md +0 -546
  104. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/gitlab.md +0 -397
  105. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/other-providers.md +0 -521
  106. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/parallel-sharding.md +0 -371
  107. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/performance.md +0 -453
  108. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/reporting.md +0 -424
  109. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/test-coverage.md +0 -497
  110. package/skills/playwright-best-practices-skill/testing-patterns/accessibility.md +0 -359
  111. package/skills/playwright-best-practices-skill/testing-patterns/api-testing.md +0 -719
  112. package/skills/playwright-best-practices-skill/testing-patterns/browser-extensions.md +0 -506
  113. package/skills/playwright-best-practices-skill/testing-patterns/canvas-webgl.md +0 -493
  114. package/skills/playwright-best-practices-skill/testing-patterns/component-testing.md +0 -500
  115. package/skills/playwright-best-practices-skill/testing-patterns/drag-drop.md +0 -576
  116. package/skills/playwright-best-practices-skill/testing-patterns/electron.md +0 -509
  117. package/skills/playwright-best-practices-skill/testing-patterns/file-operations.md +0 -377
  118. package/skills/playwright-best-practices-skill/testing-patterns/file-upload-download.md +0 -562
  119. package/skills/playwright-best-practices-skill/testing-patterns/forms-validation.md +0 -561
  120. package/skills/playwright-best-practices-skill/testing-patterns/graphql-testing.md +0 -331
  121. package/skills/playwright-best-practices-skill/testing-patterns/i18n.md +0 -508
  122. package/skills/playwright-best-practices-skill/testing-patterns/performance-testing.md +0 -476
  123. package/skills/playwright-best-practices-skill/testing-patterns/security-testing.md +0 -430
  124. package/skills/playwright-best-practices-skill/testing-patterns/visual-regression.md +0 -634
  125. package/skills/playwright-cli/SKILL.md +0 -420
  126. package/skills/playwright-cli/references/element-attributes.md +0 -23
  127. package/skills/playwright-cli/references/playwright-tests.md +0 -39
  128. package/skills/playwright-cli/references/request-mocking.md +0 -87
  129. package/skills/playwright-cli/references/running-code.md +0 -241
  130. package/skills/playwright-cli/references/session-management.md +0 -225
  131. package/skills/playwright-cli/references/storage-state.md +0 -275
  132. package/skills/playwright-cli/references/test-generation.md +0 -433
  133. package/skills/playwright-cli/references/tracing.md +0 -139
  134. package/skills/playwright-cli/references/video-recording.md +0 -143
  135. package/skills/testeiya/README.md +0 -29
  136. package/skills/testeiya/answer-formatting/SKILL.md +0 -30
  137. package/skills/testeiya/check-cucumber/SKILL.md +0 -200
  138. package/skills/testeiya/check-tests/SKILL.md +0 -260
  139. package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
  140. package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
  141. package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
  142. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
  143. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
  144. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
  145. package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
  146. package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
  147. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
  148. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
  149. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
  150. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
  151. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
  152. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
  153. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
  154. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
  155. package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
  156. package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
  157. package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
  158. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
  159. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
  160. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
  161. package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
  162. package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
  163. package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
  164. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
  165. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
  166. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
  167. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
  168. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
  169. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
  170. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
  171. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
  172. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
  173. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
  174. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
  175. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
  176. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
  177. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
  178. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
  179. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
  180. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
  181. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
  182. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
  183. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
  184. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
  185. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
  186. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
  187. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
  188. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
  189. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
  190. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
  191. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
  192. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
  193. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
  194. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
  195. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
  196. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
  197. package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
  198. package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
  199. package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
  200. package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
  201. package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
  202. package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
  203. package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
  204. package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
  205. package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
  206. package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
  207. package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
  208. package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
  209. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
  210. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
  211. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
  212. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
  213. package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
  214. package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
  215. package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
  216. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
  217. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
  218. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
  219. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
  220. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
  221. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
  222. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
  223. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
  224. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
  225. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
  226. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
  227. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
  228. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
  229. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
  230. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
  231. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
  232. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
  233. package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
  234. package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
  235. package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
  236. package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
  237. package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
  238. package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
  239. package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
  240. package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
  241. package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
  242. package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
  243. package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
  244. package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
  245. package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
  246. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
  247. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
  248. package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
  249. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
  250. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
  251. package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
  252. package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
  253. package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
  254. package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
  255. package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
  256. package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
  257. package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
  258. package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
  259. package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
  260. package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
  261. package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
  262. package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
  263. package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
  264. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
  265. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
  266. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
  267. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
  268. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
  269. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
  270. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
  271. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
  272. package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
  273. package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
  274. package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
  275. package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
  276. package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
  277. package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
  278. package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
  279. package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
  280. package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
  281. package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
  282. package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
  283. package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
  284. package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +0 -88
  285. package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +0 -95
  286. package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +0 -334
  287. package/skills/testomatio/test-automation/automate-manual-test-cases/CLAUDE.md +0 -56
  288. package/skills/testomatio/test-automation/automate-manual-test-cases/SKILL.md +0 -242
  289. package/skills/testomatio/test-automation/automate-manual-test-cases/references/CODECEPTJS_BEST_PRACTICES.md +0 -182
  290. package/skills/testomatio/test-automation/automate-manual-test-cases/references/FINAL_SUMMARY_TEMPLATE.md +0 -22
  291. package/skills/testomatio/test-automation/automate-manual-test-cases/references/PLAYWRIGHT_BEST_PRACTICES.md +0 -90
  292. package/skills/testomatio/test-automation/automate-manual-test-cases/references/POM_BEST_PRACTICES.md +0 -53
  293. package/skills/testomatio/test-automation/automate-manual-test-cases/references/TEST_DATA_MANAGEMENT.md +0 -52
  294. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/SKILL.md +0 -107
  295. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/references/DEBUGGING_QUICK_REFERENCE.md +0 -113
  296. package/skills/testomatio/test-automation/qa-automation-test-consolidation/SKILL.md +0 -29
  297. package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +0 -151
  298. package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
  299. package/skills/testomatio/test-automation/testomat-allure-adapter/SKILL.md +0 -289
  300. package/skills/testomatio/test-management/detect-duplicate-test-cases/SKILL.md +0 -86
  301. package/skills/testomatio/test-management/detect-duplicate-test-cases/references/DUPLICATE_INSTRUCTIONS.md +0 -54
  302. package/skills/testomatio/test-management/improve-test-cases/SKILL.md +0 -114
  303. package/skills/testomatio/test-management/improve-test-cases/references/TESTOMAT_MARKDOWN_EXAMPLE.md +0 -66
  304. package/skills/testomatio/test-management/pull-request-diff-analyzer/SKILL.md +0 -141
  305. package/skills/testomatio/test-management/qa-e2e-tests-reporting/SKILL.md +0 -354
  306. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_ARTIFACTS.md +0 -82
  307. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_HTML_REPORT.md +0 -37
  308. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_REPORTERS_CONFIG.md +0 -118
  309. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/SKILL.md +0 -149
  310. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/references/summary-example.md +0 -54
  311. package/skills/testomatio/test-management/qa-requirement-reviewer/SKILL.md +0 -126
  312. package/skills/testomatio/test-management/qa-requirement-reviewer/references/requirements_reviewer_examples.md +0 -128
  313. package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +0 -174
  314. package/skills/testomatio/test-management/qa-test-code-coverage/references/COVERAGE_FILE_FORMAT.md +0 -138
  315. package/skills/testomatio/test-management/qa-test-code-coverage/references/E2E_FRAMEWORKS.md +0 -65
  316. package/skills/testomatio/test-management/qa-test-code-coverage/scripts/check-coverage.mjs +0 -40
  317. package/skills/testomatio/test-management/qa-thinking/SKILL.md +0 -36
  318. package/skills/testomatio/test-management/qa-write-test-cases/SKILL.md +0 -267
  319. package/skills/testomatio/test-management/qa-write-test-cases/references/test-case-format.md +0 -387
  320. package/skills/testomatio/test-management/qa-write-test-cases/references/testomat-tms-guide.md +0 -72
  321. package/skills/testomatio/test-management/qa-write-test-cases/references/writing-rule.md +0 -159
  322. package/skills/testomatio/test-management/scan-automation-project/SKILL.md +0 -152
  323. package/skills/testomatio/test-management/sync-test-cases-with-tms/SKILL.md +0 -107
  324. package/skills/testomatio/test-management/sync-test-cases-with-tms/references/TESTOMATIO_CLI.md +0 -140
  325. package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +0 -182
  326. package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +0 -169
  327. package/skills.yaml +0 -21
  328. package/src/ai-debug.ts +0 -188
  329. package/src/api/agent-get.ts +0 -22
  330. package/src/api/agent-start.ts +0 -384
  331. package/src/api/client-log.ts +0 -29
  332. package/src/api/context.ts +0 -332
  333. package/src/api/debug-layout.ts +0 -47
  334. package/src/api/debug-report.ts +0 -29
  335. package/src/api/debug-snapshot.ts +0 -30
  336. package/src/api/debug-stream.ts +0 -52
  337. package/src/api/files-delete.ts +0 -184
  338. package/src/api/files-read.ts +0 -41
  339. package/src/api/files-rename.ts +0 -99
  340. package/src/api/files-tree.ts +0 -292
  341. package/src/api/files-write.ts +0 -41
  342. package/src/api/mcp.ts +0 -603
  343. package/src/api/memory.ts +0 -69
  344. package/src/api/open-external.ts +0 -39
  345. package/src/api/playwright-cli.ts +0 -606
  346. package/src/api/providers.ts +0 -457
  347. package/src/api/read-env-token.ts +0 -33
  348. package/src/api/sessions.ts +0 -79
  349. package/src/api/settings.ts +0 -120
  350. package/src/api/skills.ts +0 -58
  351. package/src/api/testomatio-attachment.ts +0 -89
  352. package/src/api/testomatio-auth.ts +0 -284
  353. package/src/api/testomatio-proxy.ts +0 -197
  354. package/src/api/testomatio-run-stats.ts +0 -81
  355. package/src/api/testomatio-target.ts +0 -225
  356. package/src/api/testomatio-transcription.ts +0 -82
  357. package/src/api/workspace-search.ts +0 -96
  358. package/src/api/workspace-sync.ts +0 -151
  359. package/src/api/workspace.ts +0 -165
  360. package/src/app-server.ts +0 -556
  361. package/src/bridge.ts +0 -251
  362. package/src/check-tests.ts +0 -156
  363. package/src/cli.ts +0 -17
  364. package/src/commands.ts +0 -244
  365. package/src/config.ts +0 -183
  366. package/src/connection.ts +0 -658
  367. package/src/context-store.ts +0 -265
  368. package/src/debug-bus.ts +0 -405
  369. package/src/extensions/tool-gate.ts +0 -220
  370. package/src/extensions/webui/ask-channel.ts +0 -52
  371. package/src/extensions/webui/index.ts +0 -184
  372. package/src/extensions/webui/tools/ask-question.ts +0 -88
  373. package/src/extensions/webui/tools/query-result.ts +0 -79
  374. package/src/extensions/webui/tools/render-chart.ts +0 -53
  375. package/src/extensions/webui/tools/render-item.ts +0 -61
  376. package/src/extensions/webui/tools/render-list.ts +0 -170
  377. package/src/extensions/webui/tools/render-result.ts +0 -85
  378. package/src/extensions/webui/tools/render-tree.ts +0 -71
  379. package/src/extensions/webui/tools/ui-widget.ts +0 -54
  380. package/src/extensions/webui/tools/widget-result.ts +0 -13
  381. package/src/extensions/webui/widget-channel.ts +0 -50
  382. package/src/file-log.ts +0 -196
  383. package/src/git-tracked.ts +0 -68
  384. package/src/gitignore.ts +0 -53
  385. package/src/json-store.ts +0 -43
  386. package/src/load-env.ts +0 -70
  387. package/src/loader-style.ts +0 -96
  388. package/src/main.ts +0 -140
  389. package/src/mcp-catalog.ts +0 -96
  390. package/src/models-catalog.ts +0 -72
  391. package/src/permissions.ts +0 -120
  392. package/src/project-dir.ts +0 -189
  393. package/src/project-info.ts +0 -108
  394. package/src/prompt/app-ui.ts +0 -59
  395. package/src/prompt/browser.ts +0 -27
  396. package/src/prompt/index.ts +0 -62
  397. package/src/server-info.ts +0 -62
  398. package/src/session-factory.ts +0 -442
  399. package/src/session-store.ts +0 -115
  400. package/src/shell-env.ts +0 -45
  401. package/src/skills.ts +0 -163
  402. package/src/sync-snapshot.ts +0 -140
  403. package/src/telemetry.ts +0 -239
  404. package/src/testomatio-auth.ts +0 -299
  405. package/src/testomatio.ts +0 -98
  406. package/src/theme.ts +0 -30
  407. package/src/user-env.ts +0 -94
  408. package/src/welcome.ts +0 -127
  409. package/src/workspace/safe-path.ts +0 -85
  410. package/src/workspace/test-md.ts +0 -70
  411. package/src/workspace-model.ts +0 -440
  412. package/testeiya.config.json +0 -14
@@ -1,115 +0,0 @@
1
- ---
2
- title: Circle CI
3
- description: Integrate CircleCI with Testomat.io to automate test execution and reporting. This guide explains configuring the config.yml workflow, setting parameters, and passing environment variables for streamlined CI integration. It covers running tests via the Testomat.io interface and accessing test reports post-execution.
4
- type: article
5
- url: https://docs.testomat.io/integrations/continuous-integration/circle
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Circle CI, Testomat.io, CI connection, CI Integration, CircleCI workflow, Personal API Token, Continuous Integration, Test Automation, Test Management, input variables, configuration, Circle CI Trigger URL
11
- ---
12
-
13
- To connect Circle CI to Testomat.io, lets start with configuring your Circle CI:
14
-
15
- 1. Create an access token on Circle CI by following [the instuctions by link](https://circleci.com/docs/managing-api-tokens/#creating-a-personal-api-token).
16
-
17
- ![Testomat.io - CircleCI](./images/CircleCI_1.png)
18
-
19
- 2. Create a workflow in `config.yml` file in `.circle` folder in the root folder in your repository.
20
-
21
- 3. This workflow will be used solely by Testomat.io so it should start only on `workflow_dispatch` event. The event should be defined with the following input parameters:
22
-
23
- ```
24
- parameters:
25
- testomatio:
26
- type: string
27
- default: ""
28
-
29
- run:
30
- type: string
31
- default: ""
32
-
33
- testomatio_url:
34
- type: string
35
- default: ""
36
-
37
- grep:
38
- type: string
39
- default: ""
40
-
41
- ```
42
-
43
- 4. The **Job** should include a step where the test runner is executed with `--grep` option and `TESTOMATIO` environment variables passed in.
44
- For instance:
45
-
46
- ```
47
- - run:
48
- name: Run tests
49
- command: npx codeceptjs run --grep "<< pipeline.parameters.grep >>"
50
- environment:
51
- TESTOMATIO: << pipeline.parameters.testomatio >>
52
- TESTOMATIO_RUN: << pipeline.parameters.run >>
53
- TESTOMATIO_URL: << pipeline.parameters.testomatio_url >>
54
- ```
55
-
56
- :::note
57
-
58
- If you use on-premise Testomat.io setup you will also need to add `testomatio_url` parameter.
59
-
60
- :::
61
-
62
- After Circle CI is set up, its time to open your project in Testomat.io and configure the connection between these two systems.
63
-
64
- 1. Go to **'Settings'**.
65
- 2. Select **'Continuous Integration'**.
66
- 3. Click **'Connect to CI'**.
67
-
68
- ![Testomatio - CI](./images/CI_4.png)
69
-
70
- 4. Select **'Circle CI'** and enter following details on the **'Connection'** tab:
71
-
72
- - `Circle CI Trigger Url` - (see how it works [here](https://circleci.com/docs/2.0/api-developers-guide/#getting-started-with-the-api)).
73
- - `Circle Token` - Auth token from Circle CI, created in Circle CI during Step 1.
74
-
75
- ![Testomatio - CircleCI](./images/CircleCI_2.png)
76
-
77
- 5. Switch to **'Input Variables'** tab and select checkboxes:
78
-
79
- - Send Run ID as `run` input (required for scheduled jobs).
80
- - Send Testomat.io API key as `testomatio` input.
81
- - Send Testomat.io Server URL as `testomatio_url` input (if you use on-premise setup).
82
-
83
- :::note
84
-
85
- You can set and pass more input variables if you set them in [Environment Configuration](./index.md#environment-configuration). For example: test environment, browser, branch, etc.
86
-
87
- :::
88
-
89
- 6. Click on **'Save'** button to save the connection.
90
-
91
- ![Testomatio - CircleCI](./images/CircleCI_3.png)
92
-
93
- 7a. When the connection is saved, open **'Runs'** page and select `Run Automated Tests in CI` option in extra menu.
94
-
95
- ![Testomatio - CI Run](./images/CI_Run_1.png)
96
-
97
- 8a. Select **'Circle CI'** profile in a list, select a target ref or any other variables, if any were configured. Optionally, select a **Test Plan** or create a new one.
98
-
99
- 9a. Click on **'Launch'** button and wait for the results.
100
-
101
- ![Testomatio - CircleCI](./images/CircleCI_4.png)
102
-
103
- OR
104
-
105
- 7b. On **'Tests'** page select any automated suite or test case -> click **'Extra menu'** button -> select **'Run Tests'** option -> open **'Run in CI'** tab.
106
-
107
- 8b. Select **'Circle CI'** profile in a list, as well, select a target ref or any other variables, if any were configured.
108
-
109
- 9b. Click on **'Launch'** button and wait for the results.
110
-
111
- ![Testomatio - CircleCI](./images/CircleCI_4b.gif)
112
-
113
- This will start a new job in Circle CI, please check that the job was successfully triggered and completed. After the job has finished, a run report will be available on Runs page of Testomat.io.
114
-
115
- ![Testomatio - CircleCI](./images/CircleCI_5.png)
@@ -1,120 +0,0 @@
1
- ---
2
- title: GitHub Actions
3
- description: This guide explains how to integrate GitHub Actions with Testomat.io for continuous integration. It includes creating workflows, setting up environment variables, using Testomat.io-specific input parameters, and triggering automated tests. The integration allows detailed test reporting and efficient CI workflows.
4
- type: article
5
- url: https://docs.testomat.io/integrations/continuous-integration/github
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: GitHub, Testomat.io, CI connection, CI Integration, GitHub Actions, Personal Access Token, Continuous Integration, Test Automation, Test Management, input parameters, environment variables, API token, Workflow, test reporting
11
- ---
12
-
13
- To set up connection between GitHub and Testomat.io, first, you need to configure your GitHub account:
14
-
15
- 1. Create a Personal Access Token on GitHub with access to workflow scope (follow the instructions by link - [Create PAT](https://docs.github.com/en/authentication/keeping-your-account-and-data-secure/managing-your-personal-access-tokens#creating-a-personal-access-token-classic)).
16
-
17
- ![Testomatio - GitHub](./images/Github_1.png)
18
-
19
- 2. Create a Workflow in a GitHub Repository: Go to **'Actions'** tab in Repository -> Select Workflow template -> Click **'Configure'** button. Then you will get a workflow template.
20
- **A workflow filename will be used by Testomat.io to call a specific workflow.**
21
-
22
- ![Testomatio - GitHub](./images/Github_2.png)
23
-
24
- ![Testomatio - GitHub](./images/Github_3.png)
25
-
26
- 3. This workflow will be used solely by Testomat.io, so it should start only on `workflow_dispatch` event. The event should be defined with the following input parameters:
27
-
28
- ```yaml
29
- name: Testomatio Tests
30
-
31
- on:
32
- workflow_dispatch:
33
- inputs:
34
- grep:
35
- description: 'tests to grep '
36
- required: false
37
- default: ''
38
- run:
39
- required: false
40
- testomatio:
41
- required: false
42
- ```
43
-
44
- 4. The **Job** should include a step where the test runner is executed with `--grep` option and `TESTOMATIO` environment variables passed in. For instance:
45
-
46
- ```yaml
47
- - run: npx codeceptjs run --grep "${{ github.event.inputs.grep }}"
48
- env:
49
- TESTOMATIO: "${{ github.event.inputs.testomatio }}"
50
- TESTOMATIO_RUN: "${{ github.event.inputs.run }}"
51
- ```
52
-
53
- After configuring your GitHub account, integrate GitHub Actions CI with your Testomat.io project:
54
-
55
- 1. Go to **'Settings'**.
56
- 2. Select **'Continuous Integration'**.
57
- 3. Click **'Connect to CI'**.
58
-
59
- ![Testomatio - CI](./images/CI_4.png)
60
-
61
- 4. Select **'GitHub'** and enter following details on the **'Connection'** tab:
62
-
63
- - `GitHub Username`.
64
- - `API token` - PAT created, in GitHub during Step 1.
65
- - `Organization/Repository (or User/Repository)`.
66
- - `Workflow` - name of a workflow in GitHub Actions, in our case `testomatio.yml`.
67
-
68
- ![Testomatio - GitHub](./images/Github_4.png)
69
-
70
- 5. Open **'Configuration'** tab and check the default `ref` value. `ref` specifies the target branch or tag for test execution. By default, it is set to `master`, but you can adjust this if your main branch uses a different name, such as `main`.
71
-
72
- ![Testomatio - GitHub](./images/Github_5.png)
73
-
74
- 6. Go to **'Input Variables'** tab and enable `run` and `testomatio` inputs, to pass them from Testomat.io.
75
-
76
- :::note
77
-
78
- You can set and pass more input variables if you set them in [Environment Configuration](./index.md#environment-configuration). Like in our case, test environments were set.
79
-
80
- :::
81
-
82
- :::note
83
-
84
- The `ref` parameter specifies which branch to run the workflow on. The provided workflow must be registered in the repository's GitHub Actions and must exist in the branch referenced by ref. A GitHub Action is considered registered if it exists in the project's default branch or has been triggered at least once.
85
-
86
- :::
87
-
88
- 7. Click on **'Save'** button to save the connection.
89
-
90
- ![Testomatio - GitHub](./images/Github_6.png)
91
-
92
- 8a. When the connection is saved, open **'Runs'** page and select `Run Automated Tests in CI` option in extra menu.
93
-
94
- :::note
95
-
96
- When using the "Test connection" button, workflow lookup is performed against the repository's default branch. The ref parameter from the config is ignored. This is a GitHub Actions API limitation.
97
-
98
- :::
99
-
100
- ![Testomatio - CI Run](./images/CI_Run_2.png)
101
-
102
- 9a. Select **'GitHub'** profile in a list, select a target ref and any other variables, if any were configured. Optionally, select a **Test Plan** or create a new one.
103
-
104
- 10a. Click on **'Launch'** button and wait for the results.
105
-
106
- ![Testomatio - GitHub](./images/Github_7.png)
107
-
108
- OR
109
-
110
- 8b. On **'Tests'** page select any automated suite or test case -> click **'Extra menu'** button -> select **'Run Tests'** option -> open **'Run in CI'** tab.
111
-
112
- 9b. Select **'GitHub'** profile in a list, as well, select a target ref and any other variables, if any were configured.
113
-
114
- 10b. Click on **'Launch'** button and wait for the results.
115
-
116
- ![Testomatio - GitHub](./images/Github_7b.gif)
117
-
118
- This will start a new job in GitHub Actions, please check that the job was successfully triggered and completed. After the job has finished, a run report will be available on Runs page of Testomat.io.
119
-
120
- ![Testomatio - GitHub](./images/Github_8.png)
@@ -1,88 +0,0 @@
1
- ---
2
- title: GitLab CI
3
- description: Learn how to integrate GitLab CI with Testomat.io to automate test execution and reporting. The guide covers configuring .gitlab-ci.yml, passing environment variables, and triggering pipelines for seamless CI/CD integration. It also explains setting input variables and running tests directly from the Testomat.io interface.
4
- type: article
5
- url: https://docs.testomat.io/integrations/continuous-integration/gitlab
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: GitLab, Testomat.io, CI connection, CI Integration, GitLab CI, Pipeline Trigger, Continuous Integration, Test Automation, Test Management, environment variables, GitLab Host, GitLab CI Trigger URL, Workflow, API
11
- ---
12
-
13
- To set up connection between GitLab and Testomat.io, first, you need to configure your GitLab account:
14
-
15
- 1. Add new **Pipeline Trigger** in your GitLab Project - [read more](https://docs.gitlab.com/ee/ci/triggers/#trigger-a-pipeline).
16
-
17
- ![Testomatio - GitLab](./images/GitLab_1.png)
18
-
19
- 2. Go to **'Code' -> 'Repository'** and create **.gitlab-ci.yml** file or add the job to existing one. E.g. check by [link](https://gitlab.com/TetianaKhomenko/prod-setup/-/blob/main/.gitlab-ci.yml).
20
-
21
- ![Testomatio - GitLab](./images/GitLab_2.png)
22
-
23
- It should contain next commands:
24
- ```
25
- - export TESTOMATIO="${testomatio}"
26
- - export TESTOMATIO_URL="${testomatio_url}"
27
- - export TESTOMATIO_RUN="${run}"
28
- ```
29
- 3. The **Job** should include a step where the test runner is executed with `--grep` option and `TESTOMATIO` environment variables passed in. For instance:
30
-
31
- ```
32
- - npx codeceptjs run-workers 2 --grep "${grep}"
33
- ```
34
- When GitLab is set up, go to your Project in Testomat.io and configure GitLab CI connection:
35
-
36
- 1. Go to **'Settings'**.
37
- 2. Select **'Continuous Integration'**.
38
- 3. Click **'Connect to CI'**.
39
-
40
- ![Testomatio - CI](./images/CI_4.png)
41
-
42
- 4. Select **'GitLab'** and enter following details on the **'Connection'** tab:
43
-
44
- - `Gitlab Host`.
45
- - `GitLab CI Trigger Url` - trigger pipeline URL, created in GitLab during Step 1.
46
- - `Trigger Token` - Active pipeline trigger token, created in GitLab during Step 1.
47
-
48
- ![Testomatio - GitLab](./images/GitLab_3.png)
49
-
50
- 5. Open **'Configuration'** tab and check the default `ref` value. `ref` specifies the target branch or tag for test execution. By default, it is set to `master`, but you can adjust this if your main branch uses a different name, such as `main`.
51
-
52
- ![Testomatio - GitLab](./images/GitLab_4.png)
53
-
54
- 6. Go to **'Input Variables'** tab and enable `run`, `testomatio token` and `TESTOMATIO_URL` variables to pass them from Testomat.io.
55
-
56
- :::note
57
-
58
- You can set and pass more input variables if you set them in [Environment Configuration](./index.md#environment-configuration). For example: test environment, browser, branch, etc.
59
- :::
60
-
61
- 7. Click on **'Save'** button to save the connection.
62
-
63
- ![Testomatio - GitLab](./images/GitLab_5.png)
64
-
65
- 8a. When the connection is saved, open **'Runs'** page and select `Run Automated Tests in CI` option in extra menu.
66
-
67
- ![Testomatio - CI Run](./images/CI_Run_3.png)
68
-
69
- 9a. Select **'GitLab'** profile in a list, select a target ref and any other variables, if any were configured. Optionally, select a **Test Plan** or create a new one.
70
-
71
- 10a. Click on **'Launch'** button and wait for the results.
72
-
73
- ![Testomatio - GitLab](./images/GitLab_6.png)
74
-
75
- OR
76
-
77
- 8b. On **'Tests'** page select any automated suite or test case -> click **'Extra menu'** button -> select **'Run Tests'** option -> open **'Run in CI'** tab.
78
-
79
- 9b. Select **'GitLab'** profile in a list, as well, select a target ref and any other variables, if any were configured.
80
-
81
- 10b. Click on **'Launch'** button and wait for the results.
82
-
83
- ![Testomatio - GitLab](./images/GitLab_6b.gif)
84
-
85
-
86
- This will start a new pipeline in GitLab CI. Please check that the job was successfully triggered and completed. After the job has finished, a run report will be available on Runs page of Testomat.io.
87
-
88
- ![Testomatio - GitLab](./images/GitLab_7.png)
@@ -1,151 +0,0 @@
1
- ---
2
- title: Continuous Integration
3
- description: Explore how to integrate continuous testing into your CI/CD pipeline using Testomat.io. This guide explains the setup process for Continuous Integration (CI), allowing users to connect their test management tool with popular CI tools like Jenkins, GitLab, and more. Learn how to automate test runs, manage reports, and streamline your testing workflows within a CI environment for effective test tracking and execution.
4
- type: article
5
- url: https://docs.testomat.io/integrations/continuous-integration
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Testomat.io, Continuous Integration, CI connection, CI Integration, CI/CD, test automation, test management, Jenkins, Atlassian Bamboo, BitBucket Pipelines, TeamCity, GitHub Actions, GitLab CI, Circle CI, Azure Pipelines, automated testing, CI tools, CI job, testing workflow, test reports, input variables, environment configuration, custom variables
11
- ---
12
-
13
- import DirectoryLinks from '/src/components/DirectoryLinks.astro';
14
-
15
- <DirectoryLinks directory="integrations/continuous-integration" />
16
-
17
- Testomat.io allows executing tests on CI from its interface.
18
- A single test, suite, test plan, or all tests can be executed automatically on CI.
19
-
20
- **Currently following CI systems supported:**
21
-
22
- * [Atlassian Bamboo](https://docs.testomat.io/integrations/continuous-integration/bamboo)
23
- * [BitBucket Pipelines](https://docs.testomat.io/integrations/continuous-integration/bitbucket)
24
- * [Teamcity](https://docs.testomat.io/integrations/continuous-integration/teamcity)
25
- * [GitHub Actions](https://docs.testomat.io/integrations/continuous-integration/github)
26
- * [GitLab CI](https://docs.testomat.io/integrations/continuous-integration/gitlab)
27
- * [Jenkins](https://docs.testomat.io/integrations/continuous-integration/jenkins)
28
- * [Circle CI](https://docs.testomat.io/integrations/continuous-integration/circle)
29
- * [Azure Pipelines](https://docs.testomat.io/integrations/continuous-integration/azure)
30
-
31
- Testomat.io uses REST API to trigger jobs on external CI systems. IDs of tests or suites can be passed to the job so only a specific test or suite will be executed. The test runner greps all tests by their IDs and executes a subset of tests. Then a report is sent back to Testomat.io via reporter.
32
-
33
- ![Testomatio - CI](./images/CI_1.png)
34
-
35
- **Connecting CI server to Testomat.io consist of the following steps:**
36
-
37
- 1. Create Testomat.io Project.
38
- 2. Import automated tests into that project from a repository.
39
- 3. [Assign IDs](#assigning-ids) for imported tests source code.
40
- 4. Create a new job in CI according to instructions on this page.
41
- 5. Connect CI server to Testomat.io.
42
- 6. Run your tests or suites to get reports!
43
-
44
- ## Configuring CI
45
-
46
- CI configuration has 3 steps:
47
-
48
- 1. Establishing a connection with CI.
49
- 2. Setting up required input variables.
50
- 3. Setting up custom configuration variables.
51
-
52
- Follow the guide for a corresponding CI to set it up.
53
-
54
- :::note
55
-
56
- Please ensure that Testomat.io IP addresses are allowed to access your CI environment: 142.132.185.19, 5.75.250.20
57
-
58
- ![Testomatio - Configuration](./images/CI_IP_address.png)
59
-
60
- :::
61
-
62
- ### Input Variables
63
-
64
- While connection settings can be different across CI settings, the list of input variables is the same.
65
-
66
- Here is how `run` input variable can be accessed on different CIs:
67
-
68
- - Atlassian Bamboo: `${bamboo.run}`
69
- - GitHub Actions: `${github.event.inputs.run}`
70
-
71
- It may as well pass other input variables which can be used on CI to improve reporting.
72
-
73
- **Here is the list of preconfigured input variables:**
74
-
75
- 1. `grep` - Testomat.io sends `grep` variable to CI to identify which tests should be executed. `grep` variable is required and selected by default in Testomat.io.
76
-
77
- 2. `run` - passes Run ID to CI. If this option is toggled on, when a run is created in Testomat.io, it is instantly added to the list of runs marked as 'Scheduled'. On CI `run` variable must be passed as `TESTOMATIO_RUN` environment variable to a reporter. This allows mapping a scheduled run to the run which is currently processed. **If `TESTOMATIO_RUN` is not set, a duplicate run will be created**.
78
-
79
- 3. `testomatio` - passes project access key to CI. This input variable must be passed as `TESTOMATIO` environment variable to match the Testomat.io project. Toggle on this option if you prefer not to hardcode Testomat.io Project ID in CI configuration but to obtain this value on launch. This may be useful if you have a different Testomat.io project configured on CI run.
80
-
81
- 4. `testomatio_url` - when working on a self-hosted Testomat.io instance, this variable can be used to pass Testomat.io endpoint to CI system. Pass `testomatio_url` environment variable to `TESTOMATIO_URL`.
82
-
83
- ![Testomatio - Input Variables](./images/CI_2.png)
84
-
85
- ### Environment Configuration
86
-
87
- Sometimes extra configuration is required for CI job. For instance, extra configuration variables can be used to specify:
88
-
89
- - browser.
90
- - target branch.
91
- - staging/production environments.
92
- - suites.
93
-
94
- Testomat.io allows to predefine configuration variables and adjust them for each run. Config variables can be set in **'Configuration'** tab on CI connection settings.
95
-
96
- ![Testomatio - Configuration](./images/CI_3.png)
97
-
98
- Config variables should be put per line with the default value passed in with `=`. The format is similar to `.env` file format:
99
-
100
- ```
101
- browsers=chrome,firefox,safari
102
- branch=main
103
- user=admin@admin.com
104
- password=123456
105
- suites=[3f4290f0,b89df296,78b10b62]
106
- ```
107
-
108
- `ref=master` config variable is set up by default for some CI services in Testomat.io but it can be changed at any time.
109
-
110
- :::note
111
-
112
- To set a variable without a default value just pass it as on a line without `=`
113
-
114
- :::
115
-
116
- Those variables will be available for a reconfiguration on each CI Run executed from Testomat.io.
117
- If a variable value contains comma `,` like in example above: `chrome,firefox,safari`, these values will be displayed with the select box. Otherwise, a simple input will be shown.
118
-
119
- ![Testomatio - CI Profile](./images/CI_profile.png)
120
-
121
- These variables will be passed to CI in the same manner as `grep` parameter. So, CI job should be prepared to handle these config variables. For instance, if GitHub Actions are used, values are passed as `inputs` and can be used like this:
122
-
123
- ```yaml
124
- - run: npx codeceptjs run --grep "${{ github.event.inputs.grep }}" --profile "${{ github.event.inputs.branch }}"
125
- env:
126
- TESTOMATIO: "${{ github.event.inputs.testomatio }}" # passed from Testomatio by default
127
- BROWSER: "${{ github.event.inputs.browser }}"
128
- TEST_USER: "${{ github.event.inputs.user }}"
129
- TEST_PASSWORD: "${{ github.event.inputs.password }}"
130
- ```
131
-
132
- ### Assigning IDs
133
-
134
- To execute a specific test or a suite a test runner should have a way to find a test by its unique name. For this reason, Testomat.io IDs can be used. If tests in the source code will have Testomat.io IDs it will be very simple to filter tests. We provide a semi-automatic way to assign Testomat.io IDs to tests in source code.
135
-
136
- For JavaScript frameworks use the same `check-tests` command you used for importing tests with `--update-ids`. The tests must be already imported in Testomat.io:
137
-
138
- ```
139
- TESTOMATIO={apiKey} npx check-tests <framework> <pattern> --update-ids
140
- ```
141
-
142
- For Cucumber tests use `check-cucumber` command with the similar `--update-ids` command. The command should be the same as for importing plus `--update-ids` option:
143
-
144
- ```
145
- TESTOMATIO={apiKey} npx check-cucumber <pattern> --update-ids
146
- ```
147
-
148
- This command will update your source code. Please check the changes before committing it.
149
- If the Testomat.io IDs were placed correctly you can commit your changes to repository.
150
-
151
- From now on, Testomat.io can use Test IDs to run exact tests and suites on Continuous Integration servers.
@@ -1,121 +0,0 @@
1
- ---
2
- title: Jenkins
3
- description: Learn how to integrate Jenkins with Testomat.io for continuous integration. This guide covers creating Jenkins jobs, configuring parameters, triggering builds remotely, and connecting Jenkins with Testomat.io using API tokens. It also includes steps for passing environment variables for test execution and enabling on-premise setups.
4
- type: article
5
- url: https://docs.testomat.io/integrations/continuous-integration/jenkins
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Jenkins, Testomat.io, CI connection, CI Integration, Jenkins API Token, Freestyle project, build triggers, remote build, environment variables, CodeceptJS, Jenkins Hostname, input variables, environment configuration, automated tests, test plan
11
- ---
12
-
13
- To connect Jenkins to Testomat.io you will need a user and an API Token created on Jenkins.
14
- API token can be added on **'Configure'** page of the current user:
15
-
16
- ![Testomatio - Jenkins](./images/Jenkins.png)
17
-
18
- Then, follow the instructions added below:
19
-
20
- 1. Create a new Jenkins job. Select **'Freestyle project'**.
21
-
22
- ![Testomatio - Jenkins](./images/Jenkins_1.png)
23
-
24
- :::note
25
-
26
- It is recommended to avoid spaces in Job Name to prevent issues with connecting to this job via URL.
27
-
28
- :::
29
-
30
- 2. Make this build parametrized
31
-
32
- ![Testomatio - Jenkins](./images/Jenkins_2.png)
33
-
34
- 3. Add the following parameters as a string with empty default values:
35
-
36
- - `run`
37
- - `testomatio`
38
- - `grep`
39
-
40
- :::note
41
-
42
- If you use on-premise Testomat.io setup you will also need to add `testomatio_url` parameter.
43
-
44
- :::
45
-
46
- 4. Go to **'Build Triggers'** and select **'Trigger build remotely'**.
47
-
48
- ![Testomatio - Jenkins](./images/Jenkins_3.png)
49
-
50
- 5. Proceed with configuring the Job and set all required parameters like SCM and build steps.
51
-
52
- ![Testomatio - Jenkins](./images/Jenkins_4.png)
53
-
54
- Within a step pass in configured parameters as environment variables into the test runner. Let's take CodeceptJS command as an example:
55
-
56
- ```
57
- TESTOMATIO_RUN=${run} TESTOMATIO=${testomatio} npx codeceptjs run --grep "${grep}"
58
- ```
59
-
60
- :::note
61
-
62
- Prepend `TESTOMATIO_URL=${testomatio_url}` if you use on-premise version
63
-
64
- :::
65
-
66
- ![Testomatio - Jenkins](./images/Jenkins_5.png)
67
-
68
- 6. Save the build.
69
-
70
- After Jenkins is set up, go to Testomat.io and create a new **CI connection** inside your project:
71
-
72
- 1. Go to **'Settings'**.
73
- 2. Select **'Continuous Integration'**.
74
- 3. Click **'Connect to CI'**.
75
-
76
- ![Testomatio - CI](./images/CI_4.png)
77
-
78
- 4. Select **'Jenkins'** and fill in all required fields:
79
-
80
- - `Jenkins Hostname` - URL of Jenkins host.
81
- - `Username` - a user on Jenkins which will trigger builds.
82
- - `API Token` - a token we created previously in the user's settings.
83
- - `Job Name` - the name of a job we just created.
84
-
85
- ![Testomatio - Jenkins](./images/Jenkins_7.png)
86
-
87
- 5. Switch to **'Input variables'** tab and enable variables that were configured for parametrized builds.
88
-
89
- :::note
90
-
91
- Don't forget to select `testomatio_url` if you use on-premise version.
92
-
93
- :::
94
-
95
- You can pass more input variables if you set them in [Environment Configuration](./index.md#environment-configuration). For example: test environment, browser, branch, etc.
96
-
97
- 6. Click **'Save'** button and check the connection.
98
-
99
- ![Testomatio - Jenkins](./images/Jenkins_8.png)
100
-
101
- Now you can run a test or a group of tests via Jenkins CI.
102
-
103
- 7a. Open **'Runs'** page then select `Run Automated Tests in CI` option in extra menu.
104
-
105
- ![Testomatio - CI Run](./images/CI_Run_1.png)
106
-
107
- 8a. Select **'Jenkins'** profile in a list. Optionally, select a **Test Plan** or create a new one.
108
-
109
- ![Testomatio - Jenkins](./images/Jenkins_9.png)
110
-
111
- OR
112
-
113
- 7b. On **'Tests'** page select any automated suite or test case -> click **'Extra menu'** button -> select **'Run Tests'** option -> open **'Run in CI'** tab.
114
-
115
- 8b. Select **'Jenkins'** profile in a list.
116
-
117
- ![Testomatio - Jenkins](./images/Jenkins_9a.gif)
118
-
119
- 9. Launch a Run and wait for the results.
120
-
121
- ![Testomatio - Jenkins](./images/Jenkins_10.png)