testeiya 0.2.0 → 0.3.9
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/LICENSE +21 -0
- package/README.md +37 -175
- package/dist/prompt/context.js +79 -0
- package/dist/prompt/context.js.map +1 -0
- package/dist/prompt/index.js +56 -0
- package/dist/prompt/index.js.map +1 -0
- package/dist/prompt/print.js +22 -0
- package/dist/prompt/print.js.map +1 -0
- package/dist/prompt/project-info.js +2 -0
- package/dist/prompt/project-info.js.map +1 -0
- package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +24 -21
- package/dist/prompt/system-prompt.js.map +1 -0
- package/dist/prompt/testomatio.js +264 -0
- package/dist/prompt/testomatio.js.map +1 -0
- package/dist/prompt/tools.js +49 -0
- package/dist/prompt/tools.js.map +1 -0
- package/dist/prompt/vocab.js +8 -0
- package/dist/prompt/vocab.js.map +1 -0
- package/dist/src/args.js +72 -0
- package/dist/src/args.js.map +1 -0
- package/dist/src/cli.js +61 -0
- package/dist/src/cli.js.map +1 -0
- package/dist/src/env.js +69 -0
- package/dist/src/env.js.map +1 -0
- package/dist/src/mcp-extension.js +9 -0
- package/dist/src/mcp-extension.js.map +1 -0
- package/dist/src/mcp.js +139 -0
- package/dist/src/mcp.js.map +1 -0
- package/dist/src/model.js +66 -0
- package/dist/src/model.js.map +1 -0
- package/dist/src/result.js +41 -0
- package/dist/src/result.js.map +1 -0
- package/dist/src/run.js +199 -0
- package/dist/src/run.js.map +1 -0
- package/dist/src/session.js +77 -0
- package/dist/src/session.js.map +1 -0
- package/dist/vendor/mcp.js +14801 -0
- package/mcp-tools.json +2967 -0
- package/package.json +29 -41
- package/prompt/context.ts +101 -0
- package/prompt/index.ts +93 -0
- package/prompt/print.ts +23 -0
- package/prompt/project-info.ts +30 -0
- package/prompt/system-prompt.ts +173 -0
- package/{src/prompt → prompt}/testomatio.ts +119 -8
- package/{src/prompt → prompt}/tools.ts +30 -8
- package/prompt/vocab.ts +7 -0
- package/{skills.lock.json → skills/skills.lock.json} +11 -7
- package/skills/skills.yaml +34 -0
- package/models.catalog.json +0 -6963
- package/skills/codeceptjs/ci-fix-tests/SKILL.md +0 -120
- package/skills/codeceptjs/codeceptjs-auth/SKILL.md +0 -158
- package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +0 -91
- package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +0 -158
- package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +0 -90
- package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +0 -234
- package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +0 -110
- package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +0 -306
- package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +0 -352
- package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +0 -472
- package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +0 -350
- package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +0 -81
- package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +0 -206
- package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
- package/skills/playwright-best-practices-skill/README.md +0 -147
- package/skills/playwright-best-practices-skill/SKILL.md +0 -303
- package/skills/playwright-best-practices-skill/advanced/authentication-flows.md +0 -360
- package/skills/playwright-best-practices-skill/advanced/authentication.md +0 -871
- package/skills/playwright-best-practices-skill/advanced/clock-mocking.md +0 -364
- package/skills/playwright-best-practices-skill/advanced/mobile-testing.md +0 -409
- package/skills/playwright-best-practices-skill/advanced/multi-context.md +0 -288
- package/skills/playwright-best-practices-skill/advanced/multi-user.md +0 -393
- package/skills/playwright-best-practices-skill/advanced/network-advanced.md +0 -452
- package/skills/playwright-best-practices-skill/advanced/third-party.md +0 -464
- package/skills/playwright-best-practices-skill/architecture/pom-vs-fixtures.md +0 -363
- package/skills/playwright-best-practices-skill/architecture/test-architecture.md +0 -369
- package/skills/playwright-best-practices-skill/architecture/when-to-mock.md +0 -383
- package/skills/playwright-best-practices-skill/browser-apis/browser-apis.md +0 -391
- package/skills/playwright-best-practices-skill/browser-apis/iframes.md +0 -403
- package/skills/playwright-best-practices-skill/browser-apis/service-workers.md +0 -504
- package/skills/playwright-best-practices-skill/browser-apis/websockets.md +0 -403
- package/skills/playwright-best-practices-skill/core/annotations.md +0 -424
- package/skills/playwright-best-practices-skill/core/assertions-waiting.md +0 -361
- package/skills/playwright-best-practices-skill/core/configuration.md +0 -452
- package/skills/playwright-best-practices-skill/core/fixtures-hooks.md +0 -417
- package/skills/playwright-best-practices-skill/core/global-setup.md +0 -434
- package/skills/playwright-best-practices-skill/core/locators.md +0 -242
- package/skills/playwright-best-practices-skill/core/page-object-model.md +0 -315
- package/skills/playwright-best-practices-skill/core/projects-dependencies.md +0 -453
- package/skills/playwright-best-practices-skill/core/test-data.md +0 -492
- package/skills/playwright-best-practices-skill/core/test-suite-structure.md +0 -361
- package/skills/playwright-best-practices-skill/core/test-tags.md +0 -298
- package/skills/playwright-best-practices-skill/debugging/console-errors.md +0 -420
- package/skills/playwright-best-practices-skill/debugging/debugging.md +0 -504
- package/skills/playwright-best-practices-skill/debugging/error-testing.md +0 -360
- package/skills/playwright-best-practices-skill/debugging/flaky-tests.md +0 -496
- package/skills/playwright-best-practices-skill/frameworks/angular.md +0 -530
- package/skills/playwright-best-practices-skill/frameworks/nextjs.md +0 -469
- package/skills/playwright-best-practices-skill/frameworks/react.md +0 -531
- package/skills/playwright-best-practices-skill/frameworks/vue.md +0 -574
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/ci-cd.md +0 -468
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/docker.md +0 -283
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/github-actions.md +0 -546
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/gitlab.md +0 -397
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/other-providers.md +0 -521
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/parallel-sharding.md +0 -371
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/performance.md +0 -453
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/reporting.md +0 -424
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/test-coverage.md +0 -497
- package/skills/playwright-best-practices-skill/testing-patterns/accessibility.md +0 -359
- package/skills/playwright-best-practices-skill/testing-patterns/api-testing.md +0 -719
- package/skills/playwright-best-practices-skill/testing-patterns/browser-extensions.md +0 -506
- package/skills/playwright-best-practices-skill/testing-patterns/canvas-webgl.md +0 -493
- package/skills/playwright-best-practices-skill/testing-patterns/component-testing.md +0 -500
- package/skills/playwright-best-practices-skill/testing-patterns/drag-drop.md +0 -576
- package/skills/playwright-best-practices-skill/testing-patterns/electron.md +0 -509
- package/skills/playwright-best-practices-skill/testing-patterns/file-operations.md +0 -377
- package/skills/playwright-best-practices-skill/testing-patterns/file-upload-download.md +0 -562
- package/skills/playwright-best-practices-skill/testing-patterns/forms-validation.md +0 -561
- package/skills/playwright-best-practices-skill/testing-patterns/graphql-testing.md +0 -331
- package/skills/playwright-best-practices-skill/testing-patterns/i18n.md +0 -508
- package/skills/playwright-best-practices-skill/testing-patterns/performance-testing.md +0 -476
- package/skills/playwright-best-practices-skill/testing-patterns/security-testing.md +0 -430
- package/skills/playwright-best-practices-skill/testing-patterns/visual-regression.md +0 -634
- package/skills/playwright-cli/SKILL.md +0 -420
- package/skills/playwright-cli/references/element-attributes.md +0 -23
- package/skills/playwright-cli/references/playwright-tests.md +0 -39
- package/skills/playwright-cli/references/request-mocking.md +0 -87
- package/skills/playwright-cli/references/running-code.md +0 -241
- package/skills/playwright-cli/references/session-management.md +0 -225
- package/skills/playwright-cli/references/storage-state.md +0 -275
- package/skills/playwright-cli/references/test-generation.md +0 -433
- package/skills/playwright-cli/references/tracing.md +0 -139
- package/skills/playwright-cli/references/video-recording.md +0 -143
- package/skills/testeiya/README.md +0 -29
- package/skills/testeiya/answer-formatting/SKILL.md +0 -30
- package/skills/testeiya/check-cucumber/SKILL.md +0 -200
- package/skills/testeiya/check-tests/SKILL.md +0 -260
- package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
- package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
- package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
- package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
- package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
- package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
- package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
- package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
- package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
- package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
- package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
- package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
- package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
- package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
- package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
- package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
- package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
- package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
- package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
- package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
- package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
- package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
- package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
- package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
- package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
- package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
- package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
- package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
- package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
- package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
- package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
- package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
- package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
- package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
- package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
- package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
- package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
- package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
- package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
- package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
- package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
- package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
- package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
- package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
- package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
- package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
- package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
- package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
- package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
- package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
- package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
- package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
- package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
- package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
- package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
- package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
- package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
- package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
- package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
- package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
- package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +0 -88
- package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +0 -95
- package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +0 -334
- package/skills/testomatio/test-automation/automate-manual-test-cases/CLAUDE.md +0 -56
- package/skills/testomatio/test-automation/automate-manual-test-cases/SKILL.md +0 -242
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/CODECEPTJS_BEST_PRACTICES.md +0 -182
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/FINAL_SUMMARY_TEMPLATE.md +0 -22
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/PLAYWRIGHT_BEST_PRACTICES.md +0 -90
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/POM_BEST_PRACTICES.md +0 -53
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/TEST_DATA_MANAGEMENT.md +0 -52
- package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/SKILL.md +0 -107
- package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/references/DEBUGGING_QUICK_REFERENCE.md +0 -113
- package/skills/testomatio/test-automation/qa-automation-test-consolidation/SKILL.md +0 -29
- package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +0 -151
- package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
- package/skills/testomatio/test-automation/testomat-allure-adapter/SKILL.md +0 -289
- package/skills/testomatio/test-management/detect-duplicate-test-cases/SKILL.md +0 -86
- package/skills/testomatio/test-management/detect-duplicate-test-cases/references/DUPLICATE_INSTRUCTIONS.md +0 -54
- package/skills/testomatio/test-management/improve-test-cases/SKILL.md +0 -114
- package/skills/testomatio/test-management/improve-test-cases/references/TESTOMAT_MARKDOWN_EXAMPLE.md +0 -66
- package/skills/testomatio/test-management/pull-request-diff-analyzer/SKILL.md +0 -141
- package/skills/testomatio/test-management/qa-e2e-tests-reporting/SKILL.md +0 -354
- package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_ARTIFACTS.md +0 -82
- package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_HTML_REPORT.md +0 -37
- package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_REPORTERS_CONFIG.md +0 -118
- package/skills/testomatio/test-management/qa-pr-requirements-analyzer/SKILL.md +0 -149
- package/skills/testomatio/test-management/qa-pr-requirements-analyzer/references/summary-example.md +0 -54
- package/skills/testomatio/test-management/qa-requirement-reviewer/SKILL.md +0 -126
- package/skills/testomatio/test-management/qa-requirement-reviewer/references/requirements_reviewer_examples.md +0 -128
- package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +0 -174
- package/skills/testomatio/test-management/qa-test-code-coverage/references/COVERAGE_FILE_FORMAT.md +0 -138
- package/skills/testomatio/test-management/qa-test-code-coverage/references/E2E_FRAMEWORKS.md +0 -65
- package/skills/testomatio/test-management/qa-test-code-coverage/scripts/check-coverage.mjs +0 -40
- package/skills/testomatio/test-management/qa-thinking/SKILL.md +0 -36
- package/skills/testomatio/test-management/qa-write-test-cases/SKILL.md +0 -267
- package/skills/testomatio/test-management/qa-write-test-cases/references/test-case-format.md +0 -387
- package/skills/testomatio/test-management/qa-write-test-cases/references/testomat-tms-guide.md +0 -72
- package/skills/testomatio/test-management/qa-write-test-cases/references/writing-rule.md +0 -159
- package/skills/testomatio/test-management/scan-automation-project/SKILL.md +0 -152
- package/skills/testomatio/test-management/sync-test-cases-with-tms/SKILL.md +0 -107
- package/skills/testomatio/test-management/sync-test-cases-with-tms/references/TESTOMATIO_CLI.md +0 -140
- package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +0 -182
- package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +0 -169
- package/skills.yaml +0 -21
- package/src/ai-debug.ts +0 -188
- package/src/api/agent-get.ts +0 -22
- package/src/api/agent-start.ts +0 -384
- package/src/api/client-log.ts +0 -29
- package/src/api/context.ts +0 -332
- package/src/api/debug-layout.ts +0 -47
- package/src/api/debug-report.ts +0 -29
- package/src/api/debug-snapshot.ts +0 -30
- package/src/api/debug-stream.ts +0 -52
- package/src/api/files-delete.ts +0 -184
- package/src/api/files-read.ts +0 -41
- package/src/api/files-rename.ts +0 -99
- package/src/api/files-tree.ts +0 -292
- package/src/api/files-write.ts +0 -41
- package/src/api/mcp.ts +0 -603
- package/src/api/memory.ts +0 -69
- package/src/api/open-external.ts +0 -39
- package/src/api/playwright-cli.ts +0 -606
- package/src/api/providers.ts +0 -457
- package/src/api/read-env-token.ts +0 -33
- package/src/api/sessions.ts +0 -79
- package/src/api/settings.ts +0 -120
- package/src/api/skills.ts +0 -58
- package/src/api/testomatio-attachment.ts +0 -89
- package/src/api/testomatio-auth.ts +0 -284
- package/src/api/testomatio-proxy.ts +0 -197
- package/src/api/testomatio-run-stats.ts +0 -81
- package/src/api/testomatio-target.ts +0 -225
- package/src/api/testomatio-transcription.ts +0 -82
- package/src/api/workspace-search.ts +0 -96
- package/src/api/workspace-sync.ts +0 -151
- package/src/api/workspace.ts +0 -165
- package/src/app-server.ts +0 -556
- package/src/bridge.ts +0 -251
- package/src/check-tests.ts +0 -156
- package/src/cli.ts +0 -17
- package/src/commands.ts +0 -244
- package/src/config.ts +0 -183
- package/src/connection.ts +0 -658
- package/src/context-store.ts +0 -265
- package/src/debug-bus.ts +0 -405
- package/src/extensions/tool-gate.ts +0 -220
- package/src/extensions/webui/ask-channel.ts +0 -52
- package/src/extensions/webui/index.ts +0 -184
- package/src/extensions/webui/tools/ask-question.ts +0 -88
- package/src/extensions/webui/tools/query-result.ts +0 -79
- package/src/extensions/webui/tools/render-chart.ts +0 -53
- package/src/extensions/webui/tools/render-item.ts +0 -61
- package/src/extensions/webui/tools/render-list.ts +0 -170
- package/src/extensions/webui/tools/render-result.ts +0 -85
- package/src/extensions/webui/tools/render-tree.ts +0 -71
- package/src/extensions/webui/tools/ui-widget.ts +0 -54
- package/src/extensions/webui/tools/widget-result.ts +0 -13
- package/src/extensions/webui/widget-channel.ts +0 -50
- package/src/file-log.ts +0 -196
- package/src/git-tracked.ts +0 -68
- package/src/gitignore.ts +0 -53
- package/src/json-store.ts +0 -43
- package/src/load-env.ts +0 -70
- package/src/loader-style.ts +0 -96
- package/src/main.ts +0 -140
- package/src/mcp-catalog.ts +0 -96
- package/src/models-catalog.ts +0 -72
- package/src/permissions.ts +0 -120
- package/src/project-dir.ts +0 -189
- package/src/project-info.ts +0 -108
- package/src/prompt/app-ui.ts +0 -59
- package/src/prompt/browser.ts +0 -27
- package/src/prompt/index.ts +0 -62
- package/src/server-info.ts +0 -62
- package/src/session-factory.ts +0 -442
- package/src/session-store.ts +0 -115
- package/src/shell-env.ts +0 -45
- package/src/skills.ts +0 -163
- package/src/sync-snapshot.ts +0 -140
- package/src/telemetry.ts +0 -239
- package/src/testomatio-auth.ts +0 -299
- package/src/testomatio.ts +0 -98
- package/src/theme.ts +0 -30
- package/src/user-env.ts +0 -94
- package/src/welcome.ts +0 -127
- package/src/workspace/safe-path.ts +0 -85
- package/src/workspace/test-md.ts +0 -70
- package/src/workspace-model.ts +0 -440
- package/testeiya.config.json +0 -14
|
@@ -1,115 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: Circle CI
|
|
3
|
-
description: Integrate CircleCI with Testomat.io to automate test execution and reporting. This guide explains configuring the config.yml workflow, setting parameters, and passing environment variables for streamlined CI integration. It covers running tests via the Testomat.io interface and accessing test reports post-execution.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/integrations/continuous-integration/circle
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: keywords
|
|
10
|
-
content: Circle CI, Testomat.io, CI connection, CI Integration, CircleCI workflow, Personal API Token, Continuous Integration, Test Automation, Test Management, input variables, configuration, Circle CI Trigger URL
|
|
11
|
-
---
|
|
12
|
-
|
|
13
|
-
To connect Circle CI to Testomat.io, lets start with configuring your Circle CI:
|
|
14
|
-
|
|
15
|
-
1. Create an access token on Circle CI by following [the instuctions by link](https://circleci.com/docs/managing-api-tokens/#creating-a-personal-api-token).
|
|
16
|
-
|
|
17
|
-

|
|
18
|
-
|
|
19
|
-
2. Create a workflow in `config.yml` file in `.circle` folder in the root folder in your repository.
|
|
20
|
-
|
|
21
|
-
3. This workflow will be used solely by Testomat.io so it should start only on `workflow_dispatch` event. The event should be defined with the following input parameters:
|
|
22
|
-
|
|
23
|
-
```
|
|
24
|
-
parameters:
|
|
25
|
-
testomatio:
|
|
26
|
-
type: string
|
|
27
|
-
default: ""
|
|
28
|
-
|
|
29
|
-
run:
|
|
30
|
-
type: string
|
|
31
|
-
default: ""
|
|
32
|
-
|
|
33
|
-
testomatio_url:
|
|
34
|
-
type: string
|
|
35
|
-
default: ""
|
|
36
|
-
|
|
37
|
-
grep:
|
|
38
|
-
type: string
|
|
39
|
-
default: ""
|
|
40
|
-
|
|
41
|
-
```
|
|
42
|
-
|
|
43
|
-
4. The **Job** should include a step where the test runner is executed with `--grep` option and `TESTOMATIO` environment variables passed in.
|
|
44
|
-
For instance:
|
|
45
|
-
|
|
46
|
-
```
|
|
47
|
-
- run:
|
|
48
|
-
name: Run tests
|
|
49
|
-
command: npx codeceptjs run --grep "<< pipeline.parameters.grep >>"
|
|
50
|
-
environment:
|
|
51
|
-
TESTOMATIO: << pipeline.parameters.testomatio >>
|
|
52
|
-
TESTOMATIO_RUN: << pipeline.parameters.run >>
|
|
53
|
-
TESTOMATIO_URL: << pipeline.parameters.testomatio_url >>
|
|
54
|
-
```
|
|
55
|
-
|
|
56
|
-
:::note
|
|
57
|
-
|
|
58
|
-
If you use on-premise Testomat.io setup you will also need to add `testomatio_url` parameter.
|
|
59
|
-
|
|
60
|
-
:::
|
|
61
|
-
|
|
62
|
-
After Circle CI is set up, its time to open your project in Testomat.io and configure the connection between these two systems.
|
|
63
|
-
|
|
64
|
-
1. Go to **'Settings'**.
|
|
65
|
-
2. Select **'Continuous Integration'**.
|
|
66
|
-
3. Click **'Connect to CI'**.
|
|
67
|
-
|
|
68
|
-

|
|
69
|
-
|
|
70
|
-
4. Select **'Circle CI'** and enter following details on the **'Connection'** tab:
|
|
71
|
-
|
|
72
|
-
- `Circle CI Trigger Url` - (see how it works [here](https://circleci.com/docs/2.0/api-developers-guide/#getting-started-with-the-api)).
|
|
73
|
-
- `Circle Token` - Auth token from Circle CI, created in Circle CI during Step 1.
|
|
74
|
-
|
|
75
|
-

|
|
76
|
-
|
|
77
|
-
5. Switch to **'Input Variables'** tab and select checkboxes:
|
|
78
|
-
|
|
79
|
-
- Send Run ID as `run` input (required for scheduled jobs).
|
|
80
|
-
- Send Testomat.io API key as `testomatio` input.
|
|
81
|
-
- Send Testomat.io Server URL as `testomatio_url` input (if you use on-premise setup).
|
|
82
|
-
|
|
83
|
-
:::note
|
|
84
|
-
|
|
85
|
-
You can set and pass more input variables if you set them in [Environment Configuration](./index.md#environment-configuration). For example: test environment, browser, branch, etc.
|
|
86
|
-
|
|
87
|
-
:::
|
|
88
|
-
|
|
89
|
-
6. Click on **'Save'** button to save the connection.
|
|
90
|
-
|
|
91
|
-

|
|
92
|
-
|
|
93
|
-
7a. When the connection is saved, open **'Runs'** page and select `Run Automated Tests in CI` option in extra menu.
|
|
94
|
-
|
|
95
|
-

|
|
96
|
-
|
|
97
|
-
8a. Select **'Circle CI'** profile in a list, select a target ref or any other variables, if any were configured. Optionally, select a **Test Plan** or create a new one.
|
|
98
|
-
|
|
99
|
-
9a. Click on **'Launch'** button and wait for the results.
|
|
100
|
-
|
|
101
|
-

|
|
102
|
-
|
|
103
|
-
OR
|
|
104
|
-
|
|
105
|
-
7b. On **'Tests'** page select any automated suite or test case -> click **'Extra menu'** button -> select **'Run Tests'** option -> open **'Run in CI'** tab.
|
|
106
|
-
|
|
107
|
-
8b. Select **'Circle CI'** profile in a list, as well, select a target ref or any other variables, if any were configured.
|
|
108
|
-
|
|
109
|
-
9b. Click on **'Launch'** button and wait for the results.
|
|
110
|
-
|
|
111
|
-

|
|
112
|
-
|
|
113
|
-
This will start a new job in Circle CI, please check that the job was successfully triggered and completed. After the job has finished, a run report will be available on Runs page of Testomat.io.
|
|
114
|
-
|
|
115
|
-

|
|
@@ -1,120 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: GitHub Actions
|
|
3
|
-
description: This guide explains how to integrate GitHub Actions with Testomat.io for continuous integration. It includes creating workflows, setting up environment variables, using Testomat.io-specific input parameters, and triggering automated tests. The integration allows detailed test reporting and efficient CI workflows.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/integrations/continuous-integration/github
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: keywords
|
|
10
|
-
content: GitHub, Testomat.io, CI connection, CI Integration, GitHub Actions, Personal Access Token, Continuous Integration, Test Automation, Test Management, input parameters, environment variables, API token, Workflow, test reporting
|
|
11
|
-
---
|
|
12
|
-
|
|
13
|
-
To set up connection between GitHub and Testomat.io, first, you need to configure your GitHub account:
|
|
14
|
-
|
|
15
|
-
1. Create a Personal Access Token on GitHub with access to workflow scope (follow the instructions by link - [Create PAT](https://docs.github.com/en/authentication/keeping-your-account-and-data-secure/managing-your-personal-access-tokens#creating-a-personal-access-token-classic)).
|
|
16
|
-
|
|
17
|
-

|
|
18
|
-
|
|
19
|
-
2. Create a Workflow in a GitHub Repository: Go to **'Actions'** tab in Repository -> Select Workflow template -> Click **'Configure'** button. Then you will get a workflow template.
|
|
20
|
-
**A workflow filename will be used by Testomat.io to call a specific workflow.**
|
|
21
|
-
|
|
22
|
-

|
|
23
|
-
|
|
24
|
-

|
|
25
|
-
|
|
26
|
-
3. This workflow will be used solely by Testomat.io, so it should start only on `workflow_dispatch` event. The event should be defined with the following input parameters:
|
|
27
|
-
|
|
28
|
-
```yaml
|
|
29
|
-
name: Testomatio Tests
|
|
30
|
-
|
|
31
|
-
on:
|
|
32
|
-
workflow_dispatch:
|
|
33
|
-
inputs:
|
|
34
|
-
grep:
|
|
35
|
-
description: 'tests to grep '
|
|
36
|
-
required: false
|
|
37
|
-
default: ''
|
|
38
|
-
run:
|
|
39
|
-
required: false
|
|
40
|
-
testomatio:
|
|
41
|
-
required: false
|
|
42
|
-
```
|
|
43
|
-
|
|
44
|
-
4. The **Job** should include a step where the test runner is executed with `--grep` option and `TESTOMATIO` environment variables passed in. For instance:
|
|
45
|
-
|
|
46
|
-
```yaml
|
|
47
|
-
- run: npx codeceptjs run --grep "${{ github.event.inputs.grep }}"
|
|
48
|
-
env:
|
|
49
|
-
TESTOMATIO: "${{ github.event.inputs.testomatio }}"
|
|
50
|
-
TESTOMATIO_RUN: "${{ github.event.inputs.run }}"
|
|
51
|
-
```
|
|
52
|
-
|
|
53
|
-
After configuring your GitHub account, integrate GitHub Actions CI with your Testomat.io project:
|
|
54
|
-
|
|
55
|
-
1. Go to **'Settings'**.
|
|
56
|
-
2. Select **'Continuous Integration'**.
|
|
57
|
-
3. Click **'Connect to CI'**.
|
|
58
|
-
|
|
59
|
-

|
|
60
|
-
|
|
61
|
-
4. Select **'GitHub'** and enter following details on the **'Connection'** tab:
|
|
62
|
-
|
|
63
|
-
- `GitHub Username`.
|
|
64
|
-
- `API token` - PAT created, in GitHub during Step 1.
|
|
65
|
-
- `Organization/Repository (or User/Repository)`.
|
|
66
|
-
- `Workflow` - name of a workflow in GitHub Actions, in our case `testomatio.yml`.
|
|
67
|
-
|
|
68
|
-

|
|
69
|
-
|
|
70
|
-
5. Open **'Configuration'** tab and check the default `ref` value. `ref` specifies the target branch or tag for test execution. By default, it is set to `master`, but you can adjust this if your main branch uses a different name, such as `main`.
|
|
71
|
-
|
|
72
|
-

|
|
73
|
-
|
|
74
|
-
6. Go to **'Input Variables'** tab and enable `run` and `testomatio` inputs, to pass them from Testomat.io.
|
|
75
|
-
|
|
76
|
-
:::note
|
|
77
|
-
|
|
78
|
-
You can set and pass more input variables if you set them in [Environment Configuration](./index.md#environment-configuration). Like in our case, test environments were set.
|
|
79
|
-
|
|
80
|
-
:::
|
|
81
|
-
|
|
82
|
-
:::note
|
|
83
|
-
|
|
84
|
-
The `ref` parameter specifies which branch to run the workflow on. The provided workflow must be registered in the repository's GitHub Actions and must exist in the branch referenced by ref. A GitHub Action is considered registered if it exists in the project's default branch or has been triggered at least once.
|
|
85
|
-
|
|
86
|
-
:::
|
|
87
|
-
|
|
88
|
-
7. Click on **'Save'** button to save the connection.
|
|
89
|
-
|
|
90
|
-

|
|
91
|
-
|
|
92
|
-
8a. When the connection is saved, open **'Runs'** page and select `Run Automated Tests in CI` option in extra menu.
|
|
93
|
-
|
|
94
|
-
:::note
|
|
95
|
-
|
|
96
|
-
When using the "Test connection" button, workflow lookup is performed against the repository's default branch. The ref parameter from the config is ignored. This is a GitHub Actions API limitation.
|
|
97
|
-
|
|
98
|
-
:::
|
|
99
|
-
|
|
100
|
-

|
|
101
|
-
|
|
102
|
-
9a. Select **'GitHub'** profile in a list, select a target ref and any other variables, if any were configured. Optionally, select a **Test Plan** or create a new one.
|
|
103
|
-
|
|
104
|
-
10a. Click on **'Launch'** button and wait for the results.
|
|
105
|
-
|
|
106
|
-

|
|
107
|
-
|
|
108
|
-
OR
|
|
109
|
-
|
|
110
|
-
8b. On **'Tests'** page select any automated suite or test case -> click **'Extra menu'** button -> select **'Run Tests'** option -> open **'Run in CI'** tab.
|
|
111
|
-
|
|
112
|
-
9b. Select **'GitHub'** profile in a list, as well, select a target ref and any other variables, if any were configured.
|
|
113
|
-
|
|
114
|
-
10b. Click on **'Launch'** button and wait for the results.
|
|
115
|
-
|
|
116
|
-

|
|
117
|
-
|
|
118
|
-
This will start a new job in GitHub Actions, please check that the job was successfully triggered and completed. After the job has finished, a run report will be available on Runs page of Testomat.io.
|
|
119
|
-
|
|
120
|
-

|
|
@@ -1,88 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: GitLab CI
|
|
3
|
-
description: Learn how to integrate GitLab CI with Testomat.io to automate test execution and reporting. The guide covers configuring .gitlab-ci.yml, passing environment variables, and triggering pipelines for seamless CI/CD integration. It also explains setting input variables and running tests directly from the Testomat.io interface.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/integrations/continuous-integration/gitlab
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: keywords
|
|
10
|
-
content: GitLab, Testomat.io, CI connection, CI Integration, GitLab CI, Pipeline Trigger, Continuous Integration, Test Automation, Test Management, environment variables, GitLab Host, GitLab CI Trigger URL, Workflow, API
|
|
11
|
-
---
|
|
12
|
-
|
|
13
|
-
To set up connection between GitLab and Testomat.io, first, you need to configure your GitLab account:
|
|
14
|
-
|
|
15
|
-
1. Add new **Pipeline Trigger** in your GitLab Project - [read more](https://docs.gitlab.com/ee/ci/triggers/#trigger-a-pipeline).
|
|
16
|
-
|
|
17
|
-

|
|
18
|
-
|
|
19
|
-
2. Go to **'Code' -> 'Repository'** and create **.gitlab-ci.yml** file or add the job to existing one. E.g. check by [link](https://gitlab.com/TetianaKhomenko/prod-setup/-/blob/main/.gitlab-ci.yml).
|
|
20
|
-
|
|
21
|
-

|
|
22
|
-
|
|
23
|
-
It should contain next commands:
|
|
24
|
-
```
|
|
25
|
-
- export TESTOMATIO="${testomatio}"
|
|
26
|
-
- export TESTOMATIO_URL="${testomatio_url}"
|
|
27
|
-
- export TESTOMATIO_RUN="${run}"
|
|
28
|
-
```
|
|
29
|
-
3. The **Job** should include a step where the test runner is executed with `--grep` option and `TESTOMATIO` environment variables passed in. For instance:
|
|
30
|
-
|
|
31
|
-
```
|
|
32
|
-
- npx codeceptjs run-workers 2 --grep "${grep}"
|
|
33
|
-
```
|
|
34
|
-
When GitLab is set up, go to your Project in Testomat.io and configure GitLab CI connection:
|
|
35
|
-
|
|
36
|
-
1. Go to **'Settings'**.
|
|
37
|
-
2. Select **'Continuous Integration'**.
|
|
38
|
-
3. Click **'Connect to CI'**.
|
|
39
|
-
|
|
40
|
-

|
|
41
|
-
|
|
42
|
-
4. Select **'GitLab'** and enter following details on the **'Connection'** tab:
|
|
43
|
-
|
|
44
|
-
- `Gitlab Host`.
|
|
45
|
-
- `GitLab CI Trigger Url` - trigger pipeline URL, created in GitLab during Step 1.
|
|
46
|
-
- `Trigger Token` - Active pipeline trigger token, created in GitLab during Step 1.
|
|
47
|
-
|
|
48
|
-

|
|
49
|
-
|
|
50
|
-
5. Open **'Configuration'** tab and check the default `ref` value. `ref` specifies the target branch or tag for test execution. By default, it is set to `master`, but you can adjust this if your main branch uses a different name, such as `main`.
|
|
51
|
-
|
|
52
|
-

|
|
53
|
-
|
|
54
|
-
6. Go to **'Input Variables'** tab and enable `run`, `testomatio token` and `TESTOMATIO_URL` variables to pass them from Testomat.io.
|
|
55
|
-
|
|
56
|
-
:::note
|
|
57
|
-
|
|
58
|
-
You can set and pass more input variables if you set them in [Environment Configuration](./index.md#environment-configuration). For example: test environment, browser, branch, etc.
|
|
59
|
-
:::
|
|
60
|
-
|
|
61
|
-
7. Click on **'Save'** button to save the connection.
|
|
62
|
-
|
|
63
|
-

|
|
64
|
-
|
|
65
|
-
8a. When the connection is saved, open **'Runs'** page and select `Run Automated Tests in CI` option in extra menu.
|
|
66
|
-
|
|
67
|
-

|
|
68
|
-
|
|
69
|
-
9a. Select **'GitLab'** profile in a list, select a target ref and any other variables, if any were configured. Optionally, select a **Test Plan** or create a new one.
|
|
70
|
-
|
|
71
|
-
10a. Click on **'Launch'** button and wait for the results.
|
|
72
|
-
|
|
73
|
-

|
|
74
|
-
|
|
75
|
-
OR
|
|
76
|
-
|
|
77
|
-
8b. On **'Tests'** page select any automated suite or test case -> click **'Extra menu'** button -> select **'Run Tests'** option -> open **'Run in CI'** tab.
|
|
78
|
-
|
|
79
|
-
9b. Select **'GitLab'** profile in a list, as well, select a target ref and any other variables, if any were configured.
|
|
80
|
-
|
|
81
|
-
10b. Click on **'Launch'** button and wait for the results.
|
|
82
|
-
|
|
83
|
-

|
|
84
|
-
|
|
85
|
-
|
|
86
|
-
This will start a new pipeline in GitLab CI. Please check that the job was successfully triggered and completed. After the job has finished, a run report will be available on Runs page of Testomat.io.
|
|
87
|
-
|
|
88
|
-

|
|
@@ -1,151 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: Continuous Integration
|
|
3
|
-
description: Explore how to integrate continuous testing into your CI/CD pipeline using Testomat.io. This guide explains the setup process for Continuous Integration (CI), allowing users to connect their test management tool with popular CI tools like Jenkins, GitLab, and more. Learn how to automate test runs, manage reports, and streamline your testing workflows within a CI environment for effective test tracking and execution.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/integrations/continuous-integration
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: keywords
|
|
10
|
-
content: Testomat.io, Continuous Integration, CI connection, CI Integration, CI/CD, test automation, test management, Jenkins, Atlassian Bamboo, BitBucket Pipelines, TeamCity, GitHub Actions, GitLab CI, Circle CI, Azure Pipelines, automated testing, CI tools, CI job, testing workflow, test reports, input variables, environment configuration, custom variables
|
|
11
|
-
---
|
|
12
|
-
|
|
13
|
-
import DirectoryLinks from '/src/components/DirectoryLinks.astro';
|
|
14
|
-
|
|
15
|
-
<DirectoryLinks directory="integrations/continuous-integration" />
|
|
16
|
-
|
|
17
|
-
Testomat.io allows executing tests on CI from its interface.
|
|
18
|
-
A single test, suite, test plan, or all tests can be executed automatically on CI.
|
|
19
|
-
|
|
20
|
-
**Currently following CI systems supported:**
|
|
21
|
-
|
|
22
|
-
* [Atlassian Bamboo](https://docs.testomat.io/integrations/continuous-integration/bamboo)
|
|
23
|
-
* [BitBucket Pipelines](https://docs.testomat.io/integrations/continuous-integration/bitbucket)
|
|
24
|
-
* [Teamcity](https://docs.testomat.io/integrations/continuous-integration/teamcity)
|
|
25
|
-
* [GitHub Actions](https://docs.testomat.io/integrations/continuous-integration/github)
|
|
26
|
-
* [GitLab CI](https://docs.testomat.io/integrations/continuous-integration/gitlab)
|
|
27
|
-
* [Jenkins](https://docs.testomat.io/integrations/continuous-integration/jenkins)
|
|
28
|
-
* [Circle CI](https://docs.testomat.io/integrations/continuous-integration/circle)
|
|
29
|
-
* [Azure Pipelines](https://docs.testomat.io/integrations/continuous-integration/azure)
|
|
30
|
-
|
|
31
|
-
Testomat.io uses REST API to trigger jobs on external CI systems. IDs of tests or suites can be passed to the job so only a specific test or suite will be executed. The test runner greps all tests by their IDs and executes a subset of tests. Then a report is sent back to Testomat.io via reporter.
|
|
32
|
-
|
|
33
|
-

|
|
34
|
-
|
|
35
|
-
**Connecting CI server to Testomat.io consist of the following steps:**
|
|
36
|
-
|
|
37
|
-
1. Create Testomat.io Project.
|
|
38
|
-
2. Import automated tests into that project from a repository.
|
|
39
|
-
3. [Assign IDs](#assigning-ids) for imported tests source code.
|
|
40
|
-
4. Create a new job in CI according to instructions on this page.
|
|
41
|
-
5. Connect CI server to Testomat.io.
|
|
42
|
-
6. Run your tests or suites to get reports!
|
|
43
|
-
|
|
44
|
-
## Configuring CI
|
|
45
|
-
|
|
46
|
-
CI configuration has 3 steps:
|
|
47
|
-
|
|
48
|
-
1. Establishing a connection with CI.
|
|
49
|
-
2. Setting up required input variables.
|
|
50
|
-
3. Setting up custom configuration variables.
|
|
51
|
-
|
|
52
|
-
Follow the guide for a corresponding CI to set it up.
|
|
53
|
-
|
|
54
|
-
:::note
|
|
55
|
-
|
|
56
|
-
Please ensure that Testomat.io IP addresses are allowed to access your CI environment: 142.132.185.19, 5.75.250.20
|
|
57
|
-
|
|
58
|
-

|
|
59
|
-
|
|
60
|
-
:::
|
|
61
|
-
|
|
62
|
-
### Input Variables
|
|
63
|
-
|
|
64
|
-
While connection settings can be different across CI settings, the list of input variables is the same.
|
|
65
|
-
|
|
66
|
-
Here is how `run` input variable can be accessed on different CIs:
|
|
67
|
-
|
|
68
|
-
- Atlassian Bamboo: `${bamboo.run}`
|
|
69
|
-
- GitHub Actions: `${github.event.inputs.run}`
|
|
70
|
-
|
|
71
|
-
It may as well pass other input variables which can be used on CI to improve reporting.
|
|
72
|
-
|
|
73
|
-
**Here is the list of preconfigured input variables:**
|
|
74
|
-
|
|
75
|
-
1. `grep` - Testomat.io sends `grep` variable to CI to identify which tests should be executed. `grep` variable is required and selected by default in Testomat.io.
|
|
76
|
-
|
|
77
|
-
2. `run` - passes Run ID to CI. If this option is toggled on, when a run is created in Testomat.io, it is instantly added to the list of runs marked as 'Scheduled'. On CI `run` variable must be passed as `TESTOMATIO_RUN` environment variable to a reporter. This allows mapping a scheduled run to the run which is currently processed. **If `TESTOMATIO_RUN` is not set, a duplicate run will be created**.
|
|
78
|
-
|
|
79
|
-
3. `testomatio` - passes project access key to CI. This input variable must be passed as `TESTOMATIO` environment variable to match the Testomat.io project. Toggle on this option if you prefer not to hardcode Testomat.io Project ID in CI configuration but to obtain this value on launch. This may be useful if you have a different Testomat.io project configured on CI run.
|
|
80
|
-
|
|
81
|
-
4. `testomatio_url` - when working on a self-hosted Testomat.io instance, this variable can be used to pass Testomat.io endpoint to CI system. Pass `testomatio_url` environment variable to `TESTOMATIO_URL`.
|
|
82
|
-
|
|
83
|
-

|
|
84
|
-
|
|
85
|
-
### Environment Configuration
|
|
86
|
-
|
|
87
|
-
Sometimes extra configuration is required for CI job. For instance, extra configuration variables can be used to specify:
|
|
88
|
-
|
|
89
|
-
- browser.
|
|
90
|
-
- target branch.
|
|
91
|
-
- staging/production environments.
|
|
92
|
-
- suites.
|
|
93
|
-
|
|
94
|
-
Testomat.io allows to predefine configuration variables and adjust them for each run. Config variables can be set in **'Configuration'** tab on CI connection settings.
|
|
95
|
-
|
|
96
|
-

|
|
97
|
-
|
|
98
|
-
Config variables should be put per line with the default value passed in with `=`. The format is similar to `.env` file format:
|
|
99
|
-
|
|
100
|
-
```
|
|
101
|
-
browsers=chrome,firefox,safari
|
|
102
|
-
branch=main
|
|
103
|
-
user=admin@admin.com
|
|
104
|
-
password=123456
|
|
105
|
-
suites=[3f4290f0,b89df296,78b10b62]
|
|
106
|
-
```
|
|
107
|
-
|
|
108
|
-
`ref=master` config variable is set up by default for some CI services in Testomat.io but it can be changed at any time.
|
|
109
|
-
|
|
110
|
-
:::note
|
|
111
|
-
|
|
112
|
-
To set a variable without a default value just pass it as on a line without `=`
|
|
113
|
-
|
|
114
|
-
:::
|
|
115
|
-
|
|
116
|
-
Those variables will be available for a reconfiguration on each CI Run executed from Testomat.io.
|
|
117
|
-
If a variable value contains comma `,` like in example above: `chrome,firefox,safari`, these values will be displayed with the select box. Otherwise, a simple input will be shown.
|
|
118
|
-
|
|
119
|
-

|
|
120
|
-
|
|
121
|
-
These variables will be passed to CI in the same manner as `grep` parameter. So, CI job should be prepared to handle these config variables. For instance, if GitHub Actions are used, values are passed as `inputs` and can be used like this:
|
|
122
|
-
|
|
123
|
-
```yaml
|
|
124
|
-
- run: npx codeceptjs run --grep "${{ github.event.inputs.grep }}" --profile "${{ github.event.inputs.branch }}"
|
|
125
|
-
env:
|
|
126
|
-
TESTOMATIO: "${{ github.event.inputs.testomatio }}" # passed from Testomatio by default
|
|
127
|
-
BROWSER: "${{ github.event.inputs.browser }}"
|
|
128
|
-
TEST_USER: "${{ github.event.inputs.user }}"
|
|
129
|
-
TEST_PASSWORD: "${{ github.event.inputs.password }}"
|
|
130
|
-
```
|
|
131
|
-
|
|
132
|
-
### Assigning IDs
|
|
133
|
-
|
|
134
|
-
To execute a specific test or a suite a test runner should have a way to find a test by its unique name. For this reason, Testomat.io IDs can be used. If tests in the source code will have Testomat.io IDs it will be very simple to filter tests. We provide a semi-automatic way to assign Testomat.io IDs to tests in source code.
|
|
135
|
-
|
|
136
|
-
For JavaScript frameworks use the same `check-tests` command you used for importing tests with `--update-ids`. The tests must be already imported in Testomat.io:
|
|
137
|
-
|
|
138
|
-
```
|
|
139
|
-
TESTOMATIO={apiKey} npx check-tests <framework> <pattern> --update-ids
|
|
140
|
-
```
|
|
141
|
-
|
|
142
|
-
For Cucumber tests use `check-cucumber` command with the similar `--update-ids` command. The command should be the same as for importing plus `--update-ids` option:
|
|
143
|
-
|
|
144
|
-
```
|
|
145
|
-
TESTOMATIO={apiKey} npx check-cucumber <pattern> --update-ids
|
|
146
|
-
```
|
|
147
|
-
|
|
148
|
-
This command will update your source code. Please check the changes before committing it.
|
|
149
|
-
If the Testomat.io IDs were placed correctly you can commit your changes to repository.
|
|
150
|
-
|
|
151
|
-
From now on, Testomat.io can use Test IDs to run exact tests and suites on Continuous Integration servers.
|
|
@@ -1,121 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: Jenkins
|
|
3
|
-
description: Learn how to integrate Jenkins with Testomat.io for continuous integration. This guide covers creating Jenkins jobs, configuring parameters, triggering builds remotely, and connecting Jenkins with Testomat.io using API tokens. It also includes steps for passing environment variables for test execution and enabling on-premise setups.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/integrations/continuous-integration/jenkins
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: keywords
|
|
10
|
-
content: Jenkins, Testomat.io, CI connection, CI Integration, Jenkins API Token, Freestyle project, build triggers, remote build, environment variables, CodeceptJS, Jenkins Hostname, input variables, environment configuration, automated tests, test plan
|
|
11
|
-
---
|
|
12
|
-
|
|
13
|
-
To connect Jenkins to Testomat.io you will need a user and an API Token created on Jenkins.
|
|
14
|
-
API token can be added on **'Configure'** page of the current user:
|
|
15
|
-
|
|
16
|
-

|
|
17
|
-
|
|
18
|
-
Then, follow the instructions added below:
|
|
19
|
-
|
|
20
|
-
1. Create a new Jenkins job. Select **'Freestyle project'**.
|
|
21
|
-
|
|
22
|
-

|
|
23
|
-
|
|
24
|
-
:::note
|
|
25
|
-
|
|
26
|
-
It is recommended to avoid spaces in Job Name to prevent issues with connecting to this job via URL.
|
|
27
|
-
|
|
28
|
-
:::
|
|
29
|
-
|
|
30
|
-
2. Make this build parametrized
|
|
31
|
-
|
|
32
|
-

|
|
33
|
-
|
|
34
|
-
3. Add the following parameters as a string with empty default values:
|
|
35
|
-
|
|
36
|
-
- `run`
|
|
37
|
-
- `testomatio`
|
|
38
|
-
- `grep`
|
|
39
|
-
|
|
40
|
-
:::note
|
|
41
|
-
|
|
42
|
-
If you use on-premise Testomat.io setup you will also need to add `testomatio_url` parameter.
|
|
43
|
-
|
|
44
|
-
:::
|
|
45
|
-
|
|
46
|
-
4. Go to **'Build Triggers'** and select **'Trigger build remotely'**.
|
|
47
|
-
|
|
48
|
-

|
|
49
|
-
|
|
50
|
-
5. Proceed with configuring the Job and set all required parameters like SCM and build steps.
|
|
51
|
-
|
|
52
|
-

|
|
53
|
-
|
|
54
|
-
Within a step pass in configured parameters as environment variables into the test runner. Let's take CodeceptJS command as an example:
|
|
55
|
-
|
|
56
|
-
```
|
|
57
|
-
TESTOMATIO_RUN=${run} TESTOMATIO=${testomatio} npx codeceptjs run --grep "${grep}"
|
|
58
|
-
```
|
|
59
|
-
|
|
60
|
-
:::note
|
|
61
|
-
|
|
62
|
-
Prepend `TESTOMATIO_URL=${testomatio_url}` if you use on-premise version
|
|
63
|
-
|
|
64
|
-
:::
|
|
65
|
-
|
|
66
|
-

|
|
67
|
-
|
|
68
|
-
6. Save the build.
|
|
69
|
-
|
|
70
|
-
After Jenkins is set up, go to Testomat.io and create a new **CI connection** inside your project:
|
|
71
|
-
|
|
72
|
-
1. Go to **'Settings'**.
|
|
73
|
-
2. Select **'Continuous Integration'**.
|
|
74
|
-
3. Click **'Connect to CI'**.
|
|
75
|
-
|
|
76
|
-

|
|
77
|
-
|
|
78
|
-
4. Select **'Jenkins'** and fill in all required fields:
|
|
79
|
-
|
|
80
|
-
- `Jenkins Hostname` - URL of Jenkins host.
|
|
81
|
-
- `Username` - a user on Jenkins which will trigger builds.
|
|
82
|
-
- `API Token` - a token we created previously in the user's settings.
|
|
83
|
-
- `Job Name` - the name of a job we just created.
|
|
84
|
-
|
|
85
|
-

|
|
86
|
-
|
|
87
|
-
5. Switch to **'Input variables'** tab and enable variables that were configured for parametrized builds.
|
|
88
|
-
|
|
89
|
-
:::note
|
|
90
|
-
|
|
91
|
-
Don't forget to select `testomatio_url` if you use on-premise version.
|
|
92
|
-
|
|
93
|
-
:::
|
|
94
|
-
|
|
95
|
-
You can pass more input variables if you set them in [Environment Configuration](./index.md#environment-configuration). For example: test environment, browser, branch, etc.
|
|
96
|
-
|
|
97
|
-
6. Click **'Save'** button and check the connection.
|
|
98
|
-
|
|
99
|
-

|
|
100
|
-
|
|
101
|
-
Now you can run a test or a group of tests via Jenkins CI.
|
|
102
|
-
|
|
103
|
-
7a. Open **'Runs'** page then select `Run Automated Tests in CI` option in extra menu.
|
|
104
|
-
|
|
105
|
-

|
|
106
|
-
|
|
107
|
-
8a. Select **'Jenkins'** profile in a list. Optionally, select a **Test Plan** or create a new one.
|
|
108
|
-
|
|
109
|
-

|
|
110
|
-
|
|
111
|
-
OR
|
|
112
|
-
|
|
113
|
-
7b. On **'Tests'** page select any automated suite or test case -> click **'Extra menu'** button -> select **'Run Tests'** option -> open **'Run in CI'** tab.
|
|
114
|
-
|
|
115
|
-
8b. Select **'Jenkins'** profile in a list.
|
|
116
|
-
|
|
117
|
-

|
|
118
|
-
|
|
119
|
-
9. Launch a Run and wait for the results.
|
|
120
|
-
|
|
121
|
-

|