testeiya 0.2.1 → 0.3.10

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (402) hide show
  1. package/LICENSE +21 -0
  2. package/README.md +284 -171
  3. package/dist/prompt/context.js +79 -0
  4. package/dist/prompt/context.js.map +1 -0
  5. package/dist/prompt/index.js +60 -0
  6. package/dist/prompt/index.js.map +1 -0
  7. package/dist/prompt/print.js +30 -0
  8. package/dist/prompt/print.js.map +1 -0
  9. package/dist/prompt/project-info.js +2 -0
  10. package/dist/prompt/project-info.js.map +1 -0
  11. package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +38 -25
  12. package/dist/prompt/system-prompt.js.map +1 -0
  13. package/dist/prompt/testomatio.js +264 -0
  14. package/dist/prompt/testomatio.js.map +1 -0
  15. package/dist/prompt/tools.js +57 -0
  16. package/dist/prompt/tools.js.map +1 -0
  17. package/dist/prompt/vocab.js +8 -0
  18. package/dist/prompt/vocab.js.map +1 -0
  19. package/dist/src/args.js +172 -0
  20. package/dist/src/args.js.map +1 -0
  21. package/dist/src/cli.js +97 -0
  22. package/dist/src/cli.js.map +1 -0
  23. package/dist/src/doctor.js +186 -0
  24. package/dist/src/doctor.js.map +1 -0
  25. package/dist/src/env.js +93 -0
  26. package/dist/src/env.js.map +1 -0
  27. package/dist/src/mcp-extension.js +9 -0
  28. package/dist/src/mcp-extension.js.map +1 -0
  29. package/dist/src/mcp.js +139 -0
  30. package/dist/src/mcp.js.map +1 -0
  31. package/dist/src/model.js +71 -0
  32. package/dist/src/model.js.map +1 -0
  33. package/dist/src/models.js +38 -0
  34. package/dist/src/models.js.map +1 -0
  35. package/dist/src/output.js +185 -0
  36. package/dist/src/output.js.map +1 -0
  37. package/dist/src/result.js +41 -0
  38. package/dist/src/result.js.map +1 -0
  39. package/dist/src/run.js +291 -0
  40. package/dist/src/run.js.map +1 -0
  41. package/dist/src/session.js +92 -0
  42. package/dist/src/session.js.map +1 -0
  43. package/dist/src/sessions.js +61 -0
  44. package/dist/src/sessions.js.map +1 -0
  45. package/dist/vendor/mcp.js +14801 -0
  46. package/mcp-tools.json +2967 -0
  47. package/package.json +34 -43
  48. package/prompt/context.ts +101 -0
  49. package/prompt/index.ts +102 -0
  50. package/prompt/print.ts +32 -0
  51. package/prompt/project-info.ts +30 -0
  52. package/prompt/system-prompt.ts +187 -0
  53. package/{src/prompt → prompt}/testomatio.ts +120 -9
  54. package/prompt/tools.ts +57 -0
  55. package/prompt/vocab.ts +7 -0
  56. package/skills/codeceptjs/ci-fix-tests/SKILL.md +7 -8
  57. package/skills/codeceptjs/codeceptjs-auth/SKILL.md +47 -64
  58. package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +56 -47
  59. package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +144 -106
  60. package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +50 -57
  61. package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +88 -196
  62. package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +4 -5
  63. package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +25 -36
  64. package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +23 -36
  65. package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +23 -36
  66. package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +23 -35
  67. package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +50 -53
  68. package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +87 -191
  69. package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/SKILL.md +1 -1
  70. package/{skills.lock.json → skills/skills.lock.json} +43 -36
  71. package/skills/skills.yaml +34 -0
  72. package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +49 -61
  73. package/skills/testomatio/explorbot/explorbot-fundamentals/references/no-install.md +36 -0
  74. package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +20 -7
  75. package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +41 -289
  76. package/skills/testomatio/qa-process/qa-explain-behavior/SKILL.md +111 -0
  77. package/skills/testomatio/qa-process/qa-explain-behavior/references/answer-shapes.md +116 -0
  78. package/skills/testomatio/qa-process/qa-explain-behavior/references/examples.md +157 -0
  79. package/skills/testomatio/qa-process/qa-lead-strategy-advisor/SKILL.md +91 -0
  80. package/skills/testomatio/qa-process/qa-lead-strategy-advisor/references/output-format.md +71 -0
  81. package/skills/testomatio/qa-process/testing-workflow/SKILL.md +227 -0
  82. package/skills/testomatio/test-automation/qa-data-seeder/SKILL.md +83 -0
  83. package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +5 -3
  84. package/skills/testomatio/test-automation/setup-change-aware-pr-testing/SKILL.md +190 -0
  85. package/skills/testomatio/test-automation/setup-ci-automation/SKILL.md +76 -0
  86. package/skills/testomatio/test-management/qa-split-testing-levels-pyramid/SKILL.md +55 -0
  87. package/skills/testomatio/test-management/qa-sprint-report-by-testomatio/SKILL.md +220 -0
  88. package/skills/testomatio/test-management/qa-sprint-report-by-testomatio/references/qa-sprint-report.md +126 -0
  89. package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +1 -1
  90. package/skills/testomatio/test-management/qa-thinking/SKILL.md +25 -25
  91. package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +14 -1
  92. package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +8 -0
  93. package/assets/testeiya-logo-dark.svg +0 -16
  94. package/assets/testeiya-logo.svg +0 -15
  95. package/models.catalog.json +0 -6963
  96. package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
  97. package/skills/playwright-best-practices-skill/README.md +0 -147
  98. package/skills/testeiya/README.md +0 -29
  99. package/skills/testeiya/answer-formatting/SKILL.md +0 -30
  100. package/skills/testeiya/check-cucumber/SKILL.md +0 -200
  101. package/skills/testeiya/check-tests/SKILL.md +0 -260
  102. package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
  103. package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
  104. package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
  105. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
  106. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
  107. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
  108. package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
  109. package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
  110. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
  111. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
  112. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
  113. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
  114. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
  115. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
  116. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
  117. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
  118. package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
  119. package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
  120. package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
  121. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
  122. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
  123. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
  124. package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
  125. package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
  126. package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
  127. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
  128. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
  129. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
  130. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
  131. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
  132. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
  133. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
  134. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
  135. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
  136. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
  137. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
  138. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
  139. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
  140. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
  141. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
  142. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
  143. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
  144. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
  145. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
  146. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
  147. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
  148. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
  149. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
  150. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
  151. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
  152. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
  153. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
  154. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
  155. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
  156. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
  157. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
  158. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
  159. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
  160. package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
  161. package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
  162. package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
  163. package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
  164. package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
  165. package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
  166. package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
  167. package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
  168. package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
  169. package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
  170. package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
  171. package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
  172. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
  173. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
  174. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
  175. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
  176. package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
  177. package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
  178. package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
  179. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
  180. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
  181. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
  182. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
  183. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
  184. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
  185. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
  186. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
  187. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
  188. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
  189. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
  190. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
  191. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
  192. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
  193. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
  194. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
  195. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
  196. package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
  197. package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
  198. package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
  199. package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
  200. package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
  201. package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
  202. package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
  203. package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
  204. package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
  205. package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
  206. package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
  207. package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
  208. package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
  209. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
  210. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
  211. package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
  212. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
  213. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
  214. package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
  215. package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
  216. package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
  217. package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
  218. package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
  219. package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
  220. package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
  221. package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
  222. package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
  223. package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
  224. package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
  225. package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
  226. package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
  227. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
  228. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
  229. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
  230. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
  231. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
  232. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
  233. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
  234. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
  235. package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
  236. package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
  237. package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
  238. package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
  239. package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
  240. package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
  241. package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
  242. package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
  243. package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
  244. package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
  245. package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
  246. package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
  247. package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
  248. package/skills.yaml +0 -21
  249. package/src/ai-debug.ts +0 -188
  250. package/src/api/agent-get.ts +0 -22
  251. package/src/api/agent-start.ts +0 -384
  252. package/src/api/client-log.ts +0 -29
  253. package/src/api/context.ts +0 -332
  254. package/src/api/debug-layout.ts +0 -47
  255. package/src/api/debug-report.ts +0 -29
  256. package/src/api/debug-snapshot.ts +0 -30
  257. package/src/api/debug-stream.ts +0 -52
  258. package/src/api/files-delete.ts +0 -184
  259. package/src/api/files-read.ts +0 -41
  260. package/src/api/files-rename.ts +0 -99
  261. package/src/api/files-tree.ts +0 -292
  262. package/src/api/files-write.ts +0 -41
  263. package/src/api/mcp.ts +0 -603
  264. package/src/api/memory.ts +0 -69
  265. package/src/api/open-external.ts +0 -39
  266. package/src/api/playwright-cli.ts +0 -606
  267. package/src/api/providers.ts +0 -457
  268. package/src/api/read-env-token.ts +0 -33
  269. package/src/api/sessions.ts +0 -79
  270. package/src/api/settings.ts +0 -120
  271. package/src/api/skills.ts +0 -58
  272. package/src/api/testomatio-attachment.ts +0 -89
  273. package/src/api/testomatio-auth.ts +0 -284
  274. package/src/api/testomatio-proxy.ts +0 -197
  275. package/src/api/testomatio-run-stats.ts +0 -81
  276. package/src/api/testomatio-target.ts +0 -225
  277. package/src/api/testomatio-transcription.ts +0 -82
  278. package/src/api/workspace-search.ts +0 -96
  279. package/src/api/workspace-sync.ts +0 -151
  280. package/src/api/workspace.ts +0 -165
  281. package/src/app-server.ts +0 -556
  282. package/src/bridge.ts +0 -251
  283. package/src/check-tests.ts +0 -156
  284. package/src/cli.ts +0 -17
  285. package/src/commands.ts +0 -244
  286. package/src/config.ts +0 -183
  287. package/src/connection.ts +0 -658
  288. package/src/context-store.ts +0 -265
  289. package/src/debug-bus.ts +0 -405
  290. package/src/extensions/tool-gate.ts +0 -220
  291. package/src/extensions/webui/ask-channel.ts +0 -52
  292. package/src/extensions/webui/index.ts +0 -184
  293. package/src/extensions/webui/tools/ask-question.ts +0 -88
  294. package/src/extensions/webui/tools/query-result.ts +0 -79
  295. package/src/extensions/webui/tools/render-chart.ts +0 -53
  296. package/src/extensions/webui/tools/render-item.ts +0 -61
  297. package/src/extensions/webui/tools/render-list.ts +0 -170
  298. package/src/extensions/webui/tools/render-result.ts +0 -85
  299. package/src/extensions/webui/tools/render-tree.ts +0 -71
  300. package/src/extensions/webui/tools/ui-widget.ts +0 -54
  301. package/src/extensions/webui/tools/widget-result.ts +0 -13
  302. package/src/extensions/webui/widget-channel.ts +0 -50
  303. package/src/file-log.ts +0 -196
  304. package/src/git-tracked.ts +0 -68
  305. package/src/gitignore.ts +0 -53
  306. package/src/json-store.ts +0 -43
  307. package/src/load-env.ts +0 -70
  308. package/src/loader-style.ts +0 -96
  309. package/src/main.ts +0 -140
  310. package/src/mcp-catalog.ts +0 -96
  311. package/src/models-catalog.ts +0 -72
  312. package/src/permissions.ts +0 -120
  313. package/src/project-dir.ts +0 -189
  314. package/src/project-info.ts +0 -108
  315. package/src/prompt/app-ui.ts +0 -59
  316. package/src/prompt/browser.ts +0 -27
  317. package/src/prompt/index.ts +0 -62
  318. package/src/prompt/tools.ts +0 -27
  319. package/src/server-info.ts +0 -62
  320. package/src/session-factory.ts +0 -442
  321. package/src/session-store.ts +0 -115
  322. package/src/shell-env.ts +0 -45
  323. package/src/skills.ts +0 -163
  324. package/src/sync-snapshot.ts +0 -140
  325. package/src/telemetry.ts +0 -239
  326. package/src/testomatio-auth.ts +0 -299
  327. package/src/testomatio.ts +0 -98
  328. package/src/theme.ts +0 -30
  329. package/src/user-env.ts +0 -94
  330. package/src/welcome.ts +0 -194
  331. package/src/workspace/safe-path.ts +0 -85
  332. package/src/workspace/test-md.ts +0 -70
  333. package/src/workspace-model.ts +0 -440
  334. package/testeiya.config.json +0 -14
  335. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/authentication-flows.md +0 -0
  336. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/authentication.md +0 -0
  337. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/clock-mocking.md +0 -0
  338. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/mobile-testing.md +0 -0
  339. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/multi-context.md +0 -0
  340. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/multi-user.md +0 -0
  341. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/network-advanced.md +0 -0
  342. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/third-party.md +0 -0
  343. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/pom-vs-fixtures.md +0 -0
  344. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/test-architecture.md +0 -0
  345. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/when-to-mock.md +0 -0
  346. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/browser-apis.md +0 -0
  347. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/iframes.md +0 -0
  348. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/service-workers.md +0 -0
  349. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/websockets.md +0 -0
  350. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/annotations.md +0 -0
  351. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/assertions-waiting.md +0 -0
  352. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/configuration.md +0 -0
  353. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/fixtures-hooks.md +0 -0
  354. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/global-setup.md +0 -0
  355. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/locators.md +0 -0
  356. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/page-object-model.md +0 -0
  357. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/projects-dependencies.md +0 -0
  358. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-data.md +0 -0
  359. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-suite-structure.md +0 -0
  360. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-tags.md +0 -0
  361. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/console-errors.md +0 -0
  362. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/debugging.md +0 -0
  363. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/error-testing.md +0 -0
  364. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/flaky-tests.md +0 -0
  365. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/angular.md +0 -0
  366. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/nextjs.md +0 -0
  367. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/react.md +0 -0
  368. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/vue.md +0 -0
  369. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/ci-cd.md +0 -0
  370. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/docker.md +0 -0
  371. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/github-actions.md +0 -0
  372. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/gitlab.md +0 -0
  373. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/other-providers.md +0 -0
  374. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/parallel-sharding.md +0 -0
  375. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/performance.md +0 -0
  376. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/reporting.md +0 -0
  377. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/test-coverage.md +0 -0
  378. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/accessibility.md +0 -0
  379. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/api-testing.md +0 -0
  380. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/browser-extensions.md +0 -0
  381. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/canvas-webgl.md +0 -0
  382. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/component-testing.md +0 -0
  383. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/drag-drop.md +0 -0
  384. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/electron.md +0 -0
  385. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/file-operations.md +0 -0
  386. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/file-upload-download.md +0 -0
  387. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/forms-validation.md +0 -0
  388. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/graphql-testing.md +0 -0
  389. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/i18n.md +0 -0
  390. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/performance-testing.md +0 -0
  391. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/security-testing.md +0 -0
  392. /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/visual-regression.md +0 -0
  393. /package/skills/{playwright-cli → playwright/playwright-cli}/SKILL.md +0 -0
  394. /package/skills/{playwright-cli → playwright/playwright-cli}/references/element-attributes.md +0 -0
  395. /package/skills/{playwright-cli → playwright/playwright-cli}/references/playwright-tests.md +0 -0
  396. /package/skills/{playwright-cli → playwright/playwright-cli}/references/request-mocking.md +0 -0
  397. /package/skills/{playwright-cli → playwright/playwright-cli}/references/running-code.md +0 -0
  398. /package/skills/{playwright-cli → playwright/playwright-cli}/references/session-management.md +0 -0
  399. /package/skills/{playwright-cli → playwright/playwright-cli}/references/storage-state.md +0 -0
  400. /package/skills/{playwright-cli → playwright/playwright-cli}/references/test-generation.md +0 -0
  401. /package/skills/{playwright-cli → playwright/playwright-cli}/references/tracing.md +0 -0
  402. /package/skills/{playwright-cli → playwright/playwright-cli}/references/video-recording.md +0 -0
@@ -1,115 +0,0 @@
1
- ---
2
- title: Circle CI
3
- description: Integrate CircleCI with Testomat.io to automate test execution and reporting. This guide explains configuring the config.yml workflow, setting parameters, and passing environment variables for streamlined CI integration. It covers running tests via the Testomat.io interface and accessing test reports post-execution.
4
- type: article
5
- url: https://docs.testomat.io/integrations/continuous-integration/circle
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Circle CI, Testomat.io, CI connection, CI Integration, CircleCI workflow, Personal API Token, Continuous Integration, Test Automation, Test Management, input variables, configuration, Circle CI Trigger URL
11
- ---
12
-
13
- To connect Circle CI to Testomat.io, lets start with configuring your Circle CI:
14
-
15
- 1. Create an access token on Circle CI by following [the instuctions by link](https://circleci.com/docs/managing-api-tokens/#creating-a-personal-api-token).
16
-
17
- ![Testomat.io - CircleCI](./images/CircleCI_1.png)
18
-
19
- 2. Create a workflow in `config.yml` file in `.circle` folder in the root folder in your repository.
20
-
21
- 3. This workflow will be used solely by Testomat.io so it should start only on `workflow_dispatch` event. The event should be defined with the following input parameters:
22
-
23
- ```
24
- parameters:
25
- testomatio:
26
- type: string
27
- default: ""
28
-
29
- run:
30
- type: string
31
- default: ""
32
-
33
- testomatio_url:
34
- type: string
35
- default: ""
36
-
37
- grep:
38
- type: string
39
- default: ""
40
-
41
- ```
42
-
43
- 4. The **Job** should include a step where the test runner is executed with `--grep` option and `TESTOMATIO` environment variables passed in.
44
- For instance:
45
-
46
- ```
47
- - run:
48
- name: Run tests
49
- command: npx codeceptjs run --grep "<< pipeline.parameters.grep >>"
50
- environment:
51
- TESTOMATIO: << pipeline.parameters.testomatio >>
52
- TESTOMATIO_RUN: << pipeline.parameters.run >>
53
- TESTOMATIO_URL: << pipeline.parameters.testomatio_url >>
54
- ```
55
-
56
- :::note
57
-
58
- If you use on-premise Testomat.io setup you will also need to add `testomatio_url` parameter.
59
-
60
- :::
61
-
62
- After Circle CI is set up, its time to open your project in Testomat.io and configure the connection between these two systems.
63
-
64
- 1. Go to **'Settings'**.
65
- 2. Select **'Continuous Integration'**.
66
- 3. Click **'Connect to CI'**.
67
-
68
- ![Testomatio - CI](./images/CI_4.png)
69
-
70
- 4. Select **'Circle CI'** and enter following details on the **'Connection'** tab:
71
-
72
- - `Circle CI Trigger Url` - (see how it works [here](https://circleci.com/docs/2.0/api-developers-guide/#getting-started-with-the-api)).
73
- - `Circle Token` - Auth token from Circle CI, created in Circle CI during Step 1.
74
-
75
- ![Testomatio - CircleCI](./images/CircleCI_2.png)
76
-
77
- 5. Switch to **'Input Variables'** tab and select checkboxes:
78
-
79
- - Send Run ID as `run` input (required for scheduled jobs).
80
- - Send Testomat.io API key as `testomatio` input.
81
- - Send Testomat.io Server URL as `testomatio_url` input (if you use on-premise setup).
82
-
83
- :::note
84
-
85
- You can set and pass more input variables if you set them in [Environment Configuration](./index.md#environment-configuration). For example: test environment, browser, branch, etc.
86
-
87
- :::
88
-
89
- 6. Click on **'Save'** button to save the connection.
90
-
91
- ![Testomatio - CircleCI](./images/CircleCI_3.png)
92
-
93
- 7a. When the connection is saved, open **'Runs'** page and select `Run Automated Tests in CI` option in extra menu.
94
-
95
- ![Testomatio - CI Run](./images/CI_Run_1.png)
96
-
97
- 8a. Select **'Circle CI'** profile in a list, select a target ref or any other variables, if any were configured. Optionally, select a **Test Plan** or create a new one.
98
-
99
- 9a. Click on **'Launch'** button and wait for the results.
100
-
101
- ![Testomatio - CircleCI](./images/CircleCI_4.png)
102
-
103
- OR
104
-
105
- 7b. On **'Tests'** page select any automated suite or test case -> click **'Extra menu'** button -> select **'Run Tests'** option -> open **'Run in CI'** tab.
106
-
107
- 8b. Select **'Circle CI'** profile in a list, as well, select a target ref or any other variables, if any were configured.
108
-
109
- 9b. Click on **'Launch'** button and wait for the results.
110
-
111
- ![Testomatio - CircleCI](./images/CircleCI_4b.gif)
112
-
113
- This will start a new job in Circle CI, please check that the job was successfully triggered and completed. After the job has finished, a run report will be available on Runs page of Testomat.io.
114
-
115
- ![Testomatio - CircleCI](./images/CircleCI_5.png)
@@ -1,120 +0,0 @@
1
- ---
2
- title: GitHub Actions
3
- description: This guide explains how to integrate GitHub Actions with Testomat.io for continuous integration. It includes creating workflows, setting up environment variables, using Testomat.io-specific input parameters, and triggering automated tests. The integration allows detailed test reporting and efficient CI workflows.
4
- type: article
5
- url: https://docs.testomat.io/integrations/continuous-integration/github
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: GitHub, Testomat.io, CI connection, CI Integration, GitHub Actions, Personal Access Token, Continuous Integration, Test Automation, Test Management, input parameters, environment variables, API token, Workflow, test reporting
11
- ---
12
-
13
- To set up connection between GitHub and Testomat.io, first, you need to configure your GitHub account:
14
-
15
- 1. Create a Personal Access Token on GitHub with access to workflow scope (follow the instructions by link - [Create PAT](https://docs.github.com/en/authentication/keeping-your-account-and-data-secure/managing-your-personal-access-tokens#creating-a-personal-access-token-classic)).
16
-
17
- ![Testomatio - GitHub](./images/Github_1.png)
18
-
19
- 2. Create a Workflow in a GitHub Repository: Go to **'Actions'** tab in Repository -> Select Workflow template -> Click **'Configure'** button. Then you will get a workflow template.
20
- **A workflow filename will be used by Testomat.io to call a specific workflow.**
21
-
22
- ![Testomatio - GitHub](./images/Github_2.png)
23
-
24
- ![Testomatio - GitHub](./images/Github_3.png)
25
-
26
- 3. This workflow will be used solely by Testomat.io, so it should start only on `workflow_dispatch` event. The event should be defined with the following input parameters:
27
-
28
- ```yaml
29
- name: Testomatio Tests
30
-
31
- on:
32
- workflow_dispatch:
33
- inputs:
34
- grep:
35
- description: 'tests to grep '
36
- required: false
37
- default: ''
38
- run:
39
- required: false
40
- testomatio:
41
- required: false
42
- ```
43
-
44
- 4. The **Job** should include a step where the test runner is executed with `--grep` option and `TESTOMATIO` environment variables passed in. For instance:
45
-
46
- ```yaml
47
- - run: npx codeceptjs run --grep "${{ github.event.inputs.grep }}"
48
- env:
49
- TESTOMATIO: "${{ github.event.inputs.testomatio }}"
50
- TESTOMATIO_RUN: "${{ github.event.inputs.run }}"
51
- ```
52
-
53
- After configuring your GitHub account, integrate GitHub Actions CI with your Testomat.io project:
54
-
55
- 1. Go to **'Settings'**.
56
- 2. Select **'Continuous Integration'**.
57
- 3. Click **'Connect to CI'**.
58
-
59
- ![Testomatio - CI](./images/CI_4.png)
60
-
61
- 4. Select **'GitHub'** and enter following details on the **'Connection'** tab:
62
-
63
- - `GitHub Username`.
64
- - `API token` - PAT created, in GitHub during Step 1.
65
- - `Organization/Repository (or User/Repository)`.
66
- - `Workflow` - name of a workflow in GitHub Actions, in our case `testomatio.yml`.
67
-
68
- ![Testomatio - GitHub](./images/Github_4.png)
69
-
70
- 5. Open **'Configuration'** tab and check the default `ref` value. `ref` specifies the target branch or tag for test execution. By default, it is set to `master`, but you can adjust this if your main branch uses a different name, such as `main`.
71
-
72
- ![Testomatio - GitHub](./images/Github_5.png)
73
-
74
- 6. Go to **'Input Variables'** tab and enable `run` and `testomatio` inputs, to pass them from Testomat.io.
75
-
76
- :::note
77
-
78
- You can set and pass more input variables if you set them in [Environment Configuration](./index.md#environment-configuration). Like in our case, test environments were set.
79
-
80
- :::
81
-
82
- :::note
83
-
84
- The `ref` parameter specifies which branch to run the workflow on. The provided workflow must be registered in the repository's GitHub Actions and must exist in the branch referenced by ref. A GitHub Action is considered registered if it exists in the project's default branch or has been triggered at least once.
85
-
86
- :::
87
-
88
- 7. Click on **'Save'** button to save the connection.
89
-
90
- ![Testomatio - GitHub](./images/Github_6.png)
91
-
92
- 8a. When the connection is saved, open **'Runs'** page and select `Run Automated Tests in CI` option in extra menu.
93
-
94
- :::note
95
-
96
- When using the "Test connection" button, workflow lookup is performed against the repository's default branch. The ref parameter from the config is ignored. This is a GitHub Actions API limitation.
97
-
98
- :::
99
-
100
- ![Testomatio - CI Run](./images/CI_Run_2.png)
101
-
102
- 9a. Select **'GitHub'** profile in a list, select a target ref and any other variables, if any were configured. Optionally, select a **Test Plan** or create a new one.
103
-
104
- 10a. Click on **'Launch'** button and wait for the results.
105
-
106
- ![Testomatio - GitHub](./images/Github_7.png)
107
-
108
- OR
109
-
110
- 8b. On **'Tests'** page select any automated suite or test case -> click **'Extra menu'** button -> select **'Run Tests'** option -> open **'Run in CI'** tab.
111
-
112
- 9b. Select **'GitHub'** profile in a list, as well, select a target ref and any other variables, if any were configured.
113
-
114
- 10b. Click on **'Launch'** button and wait for the results.
115
-
116
- ![Testomatio - GitHub](./images/Github_7b.gif)
117
-
118
- This will start a new job in GitHub Actions, please check that the job was successfully triggered and completed. After the job has finished, a run report will be available on Runs page of Testomat.io.
119
-
120
- ![Testomatio - GitHub](./images/Github_8.png)
@@ -1,88 +0,0 @@
1
- ---
2
- title: GitLab CI
3
- description: Learn how to integrate GitLab CI with Testomat.io to automate test execution and reporting. The guide covers configuring .gitlab-ci.yml, passing environment variables, and triggering pipelines for seamless CI/CD integration. It also explains setting input variables and running tests directly from the Testomat.io interface.
4
- type: article
5
- url: https://docs.testomat.io/integrations/continuous-integration/gitlab
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: GitLab, Testomat.io, CI connection, CI Integration, GitLab CI, Pipeline Trigger, Continuous Integration, Test Automation, Test Management, environment variables, GitLab Host, GitLab CI Trigger URL, Workflow, API
11
- ---
12
-
13
- To set up connection between GitLab and Testomat.io, first, you need to configure your GitLab account:
14
-
15
- 1. Add new **Pipeline Trigger** in your GitLab Project - [read more](https://docs.gitlab.com/ee/ci/triggers/#trigger-a-pipeline).
16
-
17
- ![Testomatio - GitLab](./images/GitLab_1.png)
18
-
19
- 2. Go to **'Code' -> 'Repository'** and create **.gitlab-ci.yml** file or add the job to existing one. E.g. check by [link](https://gitlab.com/TetianaKhomenko/prod-setup/-/blob/main/.gitlab-ci.yml).
20
-
21
- ![Testomatio - GitLab](./images/GitLab_2.png)
22
-
23
- It should contain next commands:
24
- ```
25
- - export TESTOMATIO="${testomatio}"
26
- - export TESTOMATIO_URL="${testomatio_url}"
27
- - export TESTOMATIO_RUN="${run}"
28
- ```
29
- 3. The **Job** should include a step where the test runner is executed with `--grep` option and `TESTOMATIO` environment variables passed in. For instance:
30
-
31
- ```
32
- - npx codeceptjs run-workers 2 --grep "${grep}"
33
- ```
34
- When GitLab is set up, go to your Project in Testomat.io and configure GitLab CI connection:
35
-
36
- 1. Go to **'Settings'**.
37
- 2. Select **'Continuous Integration'**.
38
- 3. Click **'Connect to CI'**.
39
-
40
- ![Testomatio - CI](./images/CI_4.png)
41
-
42
- 4. Select **'GitLab'** and enter following details on the **'Connection'** tab:
43
-
44
- - `Gitlab Host`.
45
- - `GitLab CI Trigger Url` - trigger pipeline URL, created in GitLab during Step 1.
46
- - `Trigger Token` - Active pipeline trigger token, created in GitLab during Step 1.
47
-
48
- ![Testomatio - GitLab](./images/GitLab_3.png)
49
-
50
- 5. Open **'Configuration'** tab and check the default `ref` value. `ref` specifies the target branch or tag for test execution. By default, it is set to `master`, but you can adjust this if your main branch uses a different name, such as `main`.
51
-
52
- ![Testomatio - GitLab](./images/GitLab_4.png)
53
-
54
- 6. Go to **'Input Variables'** tab and enable `run`, `testomatio token` and `TESTOMATIO_URL` variables to pass them from Testomat.io.
55
-
56
- :::note
57
-
58
- You can set and pass more input variables if you set them in [Environment Configuration](./index.md#environment-configuration). For example: test environment, browser, branch, etc.
59
- :::
60
-
61
- 7. Click on **'Save'** button to save the connection.
62
-
63
- ![Testomatio - GitLab](./images/GitLab_5.png)
64
-
65
- 8a. When the connection is saved, open **'Runs'** page and select `Run Automated Tests in CI` option in extra menu.
66
-
67
- ![Testomatio - CI Run](./images/CI_Run_3.png)
68
-
69
- 9a. Select **'GitLab'** profile in a list, select a target ref and any other variables, if any were configured. Optionally, select a **Test Plan** or create a new one.
70
-
71
- 10a. Click on **'Launch'** button and wait for the results.
72
-
73
- ![Testomatio - GitLab](./images/GitLab_6.png)
74
-
75
- OR
76
-
77
- 8b. On **'Tests'** page select any automated suite or test case -> click **'Extra menu'** button -> select **'Run Tests'** option -> open **'Run in CI'** tab.
78
-
79
- 9b. Select **'GitLab'** profile in a list, as well, select a target ref and any other variables, if any were configured.
80
-
81
- 10b. Click on **'Launch'** button and wait for the results.
82
-
83
- ![Testomatio - GitLab](./images/GitLab_6b.gif)
84
-
85
-
86
- This will start a new pipeline in GitLab CI. Please check that the job was successfully triggered and completed. After the job has finished, a run report will be available on Runs page of Testomat.io.
87
-
88
- ![Testomatio - GitLab](./images/GitLab_7.png)
@@ -1,151 +0,0 @@
1
- ---
2
- title: Continuous Integration
3
- description: Explore how to integrate continuous testing into your CI/CD pipeline using Testomat.io. This guide explains the setup process for Continuous Integration (CI), allowing users to connect their test management tool with popular CI tools like Jenkins, GitLab, and more. Learn how to automate test runs, manage reports, and streamline your testing workflows within a CI environment for effective test tracking and execution.
4
- type: article
5
- url: https://docs.testomat.io/integrations/continuous-integration
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Testomat.io, Continuous Integration, CI connection, CI Integration, CI/CD, test automation, test management, Jenkins, Atlassian Bamboo, BitBucket Pipelines, TeamCity, GitHub Actions, GitLab CI, Circle CI, Azure Pipelines, automated testing, CI tools, CI job, testing workflow, test reports, input variables, environment configuration, custom variables
11
- ---
12
-
13
- import DirectoryLinks from '/src/components/DirectoryLinks.astro';
14
-
15
- <DirectoryLinks directory="integrations/continuous-integration" />
16
-
17
- Testomat.io allows executing tests on CI from its interface.
18
- A single test, suite, test plan, or all tests can be executed automatically on CI.
19
-
20
- **Currently following CI systems supported:**
21
-
22
- * [Atlassian Bamboo](https://docs.testomat.io/integrations/continuous-integration/bamboo)
23
- * [BitBucket Pipelines](https://docs.testomat.io/integrations/continuous-integration/bitbucket)
24
- * [Teamcity](https://docs.testomat.io/integrations/continuous-integration/teamcity)
25
- * [GitHub Actions](https://docs.testomat.io/integrations/continuous-integration/github)
26
- * [GitLab CI](https://docs.testomat.io/integrations/continuous-integration/gitlab)
27
- * [Jenkins](https://docs.testomat.io/integrations/continuous-integration/jenkins)
28
- * [Circle CI](https://docs.testomat.io/integrations/continuous-integration/circle)
29
- * [Azure Pipelines](https://docs.testomat.io/integrations/continuous-integration/azure)
30
-
31
- Testomat.io uses REST API to trigger jobs on external CI systems. IDs of tests or suites can be passed to the job so only a specific test or suite will be executed. The test runner greps all tests by their IDs and executes a subset of tests. Then a report is sent back to Testomat.io via reporter.
32
-
33
- ![Testomatio - CI](./images/CI_1.png)
34
-
35
- **Connecting CI server to Testomat.io consist of the following steps:**
36
-
37
- 1. Create Testomat.io Project.
38
- 2. Import automated tests into that project from a repository.
39
- 3. [Assign IDs](#assigning-ids) for imported tests source code.
40
- 4. Create a new job in CI according to instructions on this page.
41
- 5. Connect CI server to Testomat.io.
42
- 6. Run your tests or suites to get reports!
43
-
44
- ## Configuring CI
45
-
46
- CI configuration has 3 steps:
47
-
48
- 1. Establishing a connection with CI.
49
- 2. Setting up required input variables.
50
- 3. Setting up custom configuration variables.
51
-
52
- Follow the guide for a corresponding CI to set it up.
53
-
54
- :::note
55
-
56
- Please ensure that Testomat.io IP addresses are allowed to access your CI environment: 142.132.185.19, 5.75.250.20
57
-
58
- ![Testomatio - Configuration](./images/CI_IP_address.png)
59
-
60
- :::
61
-
62
- ### Input Variables
63
-
64
- While connection settings can be different across CI settings, the list of input variables is the same.
65
-
66
- Here is how `run` input variable can be accessed on different CIs:
67
-
68
- - Atlassian Bamboo: `${bamboo.run}`
69
- - GitHub Actions: `${github.event.inputs.run}`
70
-
71
- It may as well pass other input variables which can be used on CI to improve reporting.
72
-
73
- **Here is the list of preconfigured input variables:**
74
-
75
- 1. `grep` - Testomat.io sends `grep` variable to CI to identify which tests should be executed. `grep` variable is required and selected by default in Testomat.io.
76
-
77
- 2. `run` - passes Run ID to CI. If this option is toggled on, when a run is created in Testomat.io, it is instantly added to the list of runs marked as 'Scheduled'. On CI `run` variable must be passed as `TESTOMATIO_RUN` environment variable to a reporter. This allows mapping a scheduled run to the run which is currently processed. **If `TESTOMATIO_RUN` is not set, a duplicate run will be created**.
78
-
79
- 3. `testomatio` - passes project access key to CI. This input variable must be passed as `TESTOMATIO` environment variable to match the Testomat.io project. Toggle on this option if you prefer not to hardcode Testomat.io Project ID in CI configuration but to obtain this value on launch. This may be useful if you have a different Testomat.io project configured on CI run.
80
-
81
- 4. `testomatio_url` - when working on a self-hosted Testomat.io instance, this variable can be used to pass Testomat.io endpoint to CI system. Pass `testomatio_url` environment variable to `TESTOMATIO_URL`.
82
-
83
- ![Testomatio - Input Variables](./images/CI_2.png)
84
-
85
- ### Environment Configuration
86
-
87
- Sometimes extra configuration is required for CI job. For instance, extra configuration variables can be used to specify:
88
-
89
- - browser.
90
- - target branch.
91
- - staging/production environments.
92
- - suites.
93
-
94
- Testomat.io allows to predefine configuration variables and adjust them for each run. Config variables can be set in **'Configuration'** tab on CI connection settings.
95
-
96
- ![Testomatio - Configuration](./images/CI_3.png)
97
-
98
- Config variables should be put per line with the default value passed in with `=`. The format is similar to `.env` file format:
99
-
100
- ```
101
- browsers=chrome,firefox,safari
102
- branch=main
103
- user=admin@admin.com
104
- password=123456
105
- suites=[3f4290f0,b89df296,78b10b62]
106
- ```
107
-
108
- `ref=master` config variable is set up by default for some CI services in Testomat.io but it can be changed at any time.
109
-
110
- :::note
111
-
112
- To set a variable without a default value just pass it as on a line without `=`
113
-
114
- :::
115
-
116
- Those variables will be available for a reconfiguration on each CI Run executed from Testomat.io.
117
- If a variable value contains comma `,` like in example above: `chrome,firefox,safari`, these values will be displayed with the select box. Otherwise, a simple input will be shown.
118
-
119
- ![Testomatio - CI Profile](./images/CI_profile.png)
120
-
121
- These variables will be passed to CI in the same manner as `grep` parameter. So, CI job should be prepared to handle these config variables. For instance, if GitHub Actions are used, values are passed as `inputs` and can be used like this:
122
-
123
- ```yaml
124
- - run: npx codeceptjs run --grep "${{ github.event.inputs.grep }}" --profile "${{ github.event.inputs.branch }}"
125
- env:
126
- TESTOMATIO: "${{ github.event.inputs.testomatio }}" # passed from Testomatio by default
127
- BROWSER: "${{ github.event.inputs.browser }}"
128
- TEST_USER: "${{ github.event.inputs.user }}"
129
- TEST_PASSWORD: "${{ github.event.inputs.password }}"
130
- ```
131
-
132
- ### Assigning IDs
133
-
134
- To execute a specific test or a suite a test runner should have a way to find a test by its unique name. For this reason, Testomat.io IDs can be used. If tests in the source code will have Testomat.io IDs it will be very simple to filter tests. We provide a semi-automatic way to assign Testomat.io IDs to tests in source code.
135
-
136
- For JavaScript frameworks use the same `check-tests` command you used for importing tests with `--update-ids`. The tests must be already imported in Testomat.io:
137
-
138
- ```
139
- TESTOMATIO={apiKey} npx check-tests <framework> <pattern> --update-ids
140
- ```
141
-
142
- For Cucumber tests use `check-cucumber` command with the similar `--update-ids` command. The command should be the same as for importing plus `--update-ids` option:
143
-
144
- ```
145
- TESTOMATIO={apiKey} npx check-cucumber <pattern> --update-ids
146
- ```
147
-
148
- This command will update your source code. Please check the changes before committing it.
149
- If the Testomat.io IDs were placed correctly you can commit your changes to repository.
150
-
151
- From now on, Testomat.io can use Test IDs to run exact tests and suites on Continuous Integration servers.
@@ -1,121 +0,0 @@
1
- ---
2
- title: Jenkins
3
- description: Learn how to integrate Jenkins with Testomat.io for continuous integration. This guide covers creating Jenkins jobs, configuring parameters, triggering builds remotely, and connecting Jenkins with Testomat.io using API tokens. It also includes steps for passing environment variables for test execution and enabling on-premise setups.
4
- type: article
5
- url: https://docs.testomat.io/integrations/continuous-integration/jenkins
6
- head:
7
- - tag: meta
8
- attrs:
9
- name: keywords
10
- content: Jenkins, Testomat.io, CI connection, CI Integration, Jenkins API Token, Freestyle project, build triggers, remote build, environment variables, CodeceptJS, Jenkins Hostname, input variables, environment configuration, automated tests, test plan
11
- ---
12
-
13
- To connect Jenkins to Testomat.io you will need a user and an API Token created on Jenkins.
14
- API token can be added on **'Configure'** page of the current user:
15
-
16
- ![Testomatio - Jenkins](./images/Jenkins.png)
17
-
18
- Then, follow the instructions added below:
19
-
20
- 1. Create a new Jenkins job. Select **'Freestyle project'**.
21
-
22
- ![Testomatio - Jenkins](./images/Jenkins_1.png)
23
-
24
- :::note
25
-
26
- It is recommended to avoid spaces in Job Name to prevent issues with connecting to this job via URL.
27
-
28
- :::
29
-
30
- 2. Make this build parametrized
31
-
32
- ![Testomatio - Jenkins](./images/Jenkins_2.png)
33
-
34
- 3. Add the following parameters as a string with empty default values:
35
-
36
- - `run`
37
- - `testomatio`
38
- - `grep`
39
-
40
- :::note
41
-
42
- If you use on-premise Testomat.io setup you will also need to add `testomatio_url` parameter.
43
-
44
- :::
45
-
46
- 4. Go to **'Build Triggers'** and select **'Trigger build remotely'**.
47
-
48
- ![Testomatio - Jenkins](./images/Jenkins_3.png)
49
-
50
- 5. Proceed with configuring the Job and set all required parameters like SCM and build steps.
51
-
52
- ![Testomatio - Jenkins](./images/Jenkins_4.png)
53
-
54
- Within a step pass in configured parameters as environment variables into the test runner. Let's take CodeceptJS command as an example:
55
-
56
- ```
57
- TESTOMATIO_RUN=${run} TESTOMATIO=${testomatio} npx codeceptjs run --grep "${grep}"
58
- ```
59
-
60
- :::note
61
-
62
- Prepend `TESTOMATIO_URL=${testomatio_url}` if you use on-premise version
63
-
64
- :::
65
-
66
- ![Testomatio - Jenkins](./images/Jenkins_5.png)
67
-
68
- 6. Save the build.
69
-
70
- After Jenkins is set up, go to Testomat.io and create a new **CI connection** inside your project:
71
-
72
- 1. Go to **'Settings'**.
73
- 2. Select **'Continuous Integration'**.
74
- 3. Click **'Connect to CI'**.
75
-
76
- ![Testomatio - CI](./images/CI_4.png)
77
-
78
- 4. Select **'Jenkins'** and fill in all required fields:
79
-
80
- - `Jenkins Hostname` - URL of Jenkins host.
81
- - `Username` - a user on Jenkins which will trigger builds.
82
- - `API Token` - a token we created previously in the user's settings.
83
- - `Job Name` - the name of a job we just created.
84
-
85
- ![Testomatio - Jenkins](./images/Jenkins_7.png)
86
-
87
- 5. Switch to **'Input variables'** tab and enable variables that were configured for parametrized builds.
88
-
89
- :::note
90
-
91
- Don't forget to select `testomatio_url` if you use on-premise version.
92
-
93
- :::
94
-
95
- You can pass more input variables if you set them in [Environment Configuration](./index.md#environment-configuration). For example: test environment, browser, branch, etc.
96
-
97
- 6. Click **'Save'** button and check the connection.
98
-
99
- ![Testomatio - Jenkins](./images/Jenkins_8.png)
100
-
101
- Now you can run a test or a group of tests via Jenkins CI.
102
-
103
- 7a. Open **'Runs'** page then select `Run Automated Tests in CI` option in extra menu.
104
-
105
- ![Testomatio - CI Run](./images/CI_Run_1.png)
106
-
107
- 8a. Select **'Jenkins'** profile in a list. Optionally, select a **Test Plan** or create a new one.
108
-
109
- ![Testomatio - Jenkins](./images/Jenkins_9.png)
110
-
111
- OR
112
-
113
- 7b. On **'Tests'** page select any automated suite or test case -> click **'Extra menu'** button -> select **'Run Tests'** option -> open **'Run in CI'** tab.
114
-
115
- 8b. Select **'Jenkins'** profile in a list.
116
-
117
- ![Testomatio - Jenkins](./images/Jenkins_9a.gif)
118
-
119
- 9. Launch a Run and wait for the results.
120
-
121
- ![Testomatio - Jenkins](./images/Jenkins_10.png)