testeiya 0.2.0 → 0.3.9
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/LICENSE +21 -0
- package/README.md +37 -175
- package/dist/prompt/context.js +79 -0
- package/dist/prompt/context.js.map +1 -0
- package/dist/prompt/index.js +56 -0
- package/dist/prompt/index.js.map +1 -0
- package/dist/prompt/print.js +22 -0
- package/dist/prompt/print.js.map +1 -0
- package/dist/prompt/project-info.js +2 -0
- package/dist/prompt/project-info.js.map +1 -0
- package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +24 -21
- package/dist/prompt/system-prompt.js.map +1 -0
- package/dist/prompt/testomatio.js +264 -0
- package/dist/prompt/testomatio.js.map +1 -0
- package/dist/prompt/tools.js +49 -0
- package/dist/prompt/tools.js.map +1 -0
- package/dist/prompt/vocab.js +8 -0
- package/dist/prompt/vocab.js.map +1 -0
- package/dist/src/args.js +72 -0
- package/dist/src/args.js.map +1 -0
- package/dist/src/cli.js +61 -0
- package/dist/src/cli.js.map +1 -0
- package/dist/src/env.js +69 -0
- package/dist/src/env.js.map +1 -0
- package/dist/src/mcp-extension.js +9 -0
- package/dist/src/mcp-extension.js.map +1 -0
- package/dist/src/mcp.js +139 -0
- package/dist/src/mcp.js.map +1 -0
- package/dist/src/model.js +66 -0
- package/dist/src/model.js.map +1 -0
- package/dist/src/result.js +41 -0
- package/dist/src/result.js.map +1 -0
- package/dist/src/run.js +199 -0
- package/dist/src/run.js.map +1 -0
- package/dist/src/session.js +77 -0
- package/dist/src/session.js.map +1 -0
- package/dist/vendor/mcp.js +14801 -0
- package/mcp-tools.json +2967 -0
- package/package.json +29 -41
- package/prompt/context.ts +101 -0
- package/prompt/index.ts +93 -0
- package/prompt/print.ts +23 -0
- package/prompt/project-info.ts +30 -0
- package/prompt/system-prompt.ts +173 -0
- package/{src/prompt → prompt}/testomatio.ts +119 -8
- package/{src/prompt → prompt}/tools.ts +30 -8
- package/prompt/vocab.ts +7 -0
- package/{skills.lock.json → skills/skills.lock.json} +11 -7
- package/skills/skills.yaml +34 -0
- package/models.catalog.json +0 -6963
- package/skills/codeceptjs/ci-fix-tests/SKILL.md +0 -120
- package/skills/codeceptjs/codeceptjs-auth/SKILL.md +0 -158
- package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +0 -91
- package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +0 -158
- package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +0 -90
- package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +0 -234
- package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +0 -110
- package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +0 -306
- package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +0 -352
- package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +0 -472
- package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +0 -350
- package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +0 -81
- package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +0 -206
- package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
- package/skills/playwright-best-practices-skill/README.md +0 -147
- package/skills/playwright-best-practices-skill/SKILL.md +0 -303
- package/skills/playwright-best-practices-skill/advanced/authentication-flows.md +0 -360
- package/skills/playwright-best-practices-skill/advanced/authentication.md +0 -871
- package/skills/playwright-best-practices-skill/advanced/clock-mocking.md +0 -364
- package/skills/playwright-best-practices-skill/advanced/mobile-testing.md +0 -409
- package/skills/playwright-best-practices-skill/advanced/multi-context.md +0 -288
- package/skills/playwright-best-practices-skill/advanced/multi-user.md +0 -393
- package/skills/playwright-best-practices-skill/advanced/network-advanced.md +0 -452
- package/skills/playwright-best-practices-skill/advanced/third-party.md +0 -464
- package/skills/playwright-best-practices-skill/architecture/pom-vs-fixtures.md +0 -363
- package/skills/playwright-best-practices-skill/architecture/test-architecture.md +0 -369
- package/skills/playwright-best-practices-skill/architecture/when-to-mock.md +0 -383
- package/skills/playwright-best-practices-skill/browser-apis/browser-apis.md +0 -391
- package/skills/playwright-best-practices-skill/browser-apis/iframes.md +0 -403
- package/skills/playwright-best-practices-skill/browser-apis/service-workers.md +0 -504
- package/skills/playwright-best-practices-skill/browser-apis/websockets.md +0 -403
- package/skills/playwright-best-practices-skill/core/annotations.md +0 -424
- package/skills/playwright-best-practices-skill/core/assertions-waiting.md +0 -361
- package/skills/playwright-best-practices-skill/core/configuration.md +0 -452
- package/skills/playwright-best-practices-skill/core/fixtures-hooks.md +0 -417
- package/skills/playwright-best-practices-skill/core/global-setup.md +0 -434
- package/skills/playwright-best-practices-skill/core/locators.md +0 -242
- package/skills/playwright-best-practices-skill/core/page-object-model.md +0 -315
- package/skills/playwright-best-practices-skill/core/projects-dependencies.md +0 -453
- package/skills/playwright-best-practices-skill/core/test-data.md +0 -492
- package/skills/playwright-best-practices-skill/core/test-suite-structure.md +0 -361
- package/skills/playwright-best-practices-skill/core/test-tags.md +0 -298
- package/skills/playwright-best-practices-skill/debugging/console-errors.md +0 -420
- package/skills/playwright-best-practices-skill/debugging/debugging.md +0 -504
- package/skills/playwright-best-practices-skill/debugging/error-testing.md +0 -360
- package/skills/playwright-best-practices-skill/debugging/flaky-tests.md +0 -496
- package/skills/playwright-best-practices-skill/frameworks/angular.md +0 -530
- package/skills/playwright-best-practices-skill/frameworks/nextjs.md +0 -469
- package/skills/playwright-best-practices-skill/frameworks/react.md +0 -531
- package/skills/playwright-best-practices-skill/frameworks/vue.md +0 -574
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/ci-cd.md +0 -468
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/docker.md +0 -283
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/github-actions.md +0 -546
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/gitlab.md +0 -397
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/other-providers.md +0 -521
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/parallel-sharding.md +0 -371
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/performance.md +0 -453
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/reporting.md +0 -424
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/test-coverage.md +0 -497
- package/skills/playwright-best-practices-skill/testing-patterns/accessibility.md +0 -359
- package/skills/playwright-best-practices-skill/testing-patterns/api-testing.md +0 -719
- package/skills/playwright-best-practices-skill/testing-patterns/browser-extensions.md +0 -506
- package/skills/playwright-best-practices-skill/testing-patterns/canvas-webgl.md +0 -493
- package/skills/playwright-best-practices-skill/testing-patterns/component-testing.md +0 -500
- package/skills/playwright-best-practices-skill/testing-patterns/drag-drop.md +0 -576
- package/skills/playwright-best-practices-skill/testing-patterns/electron.md +0 -509
- package/skills/playwright-best-practices-skill/testing-patterns/file-operations.md +0 -377
- package/skills/playwright-best-practices-skill/testing-patterns/file-upload-download.md +0 -562
- package/skills/playwright-best-practices-skill/testing-patterns/forms-validation.md +0 -561
- package/skills/playwright-best-practices-skill/testing-patterns/graphql-testing.md +0 -331
- package/skills/playwright-best-practices-skill/testing-patterns/i18n.md +0 -508
- package/skills/playwright-best-practices-skill/testing-patterns/performance-testing.md +0 -476
- package/skills/playwright-best-practices-skill/testing-patterns/security-testing.md +0 -430
- package/skills/playwright-best-practices-skill/testing-patterns/visual-regression.md +0 -634
- package/skills/playwright-cli/SKILL.md +0 -420
- package/skills/playwright-cli/references/element-attributes.md +0 -23
- package/skills/playwright-cli/references/playwright-tests.md +0 -39
- package/skills/playwright-cli/references/request-mocking.md +0 -87
- package/skills/playwright-cli/references/running-code.md +0 -241
- package/skills/playwright-cli/references/session-management.md +0 -225
- package/skills/playwright-cli/references/storage-state.md +0 -275
- package/skills/playwright-cli/references/test-generation.md +0 -433
- package/skills/playwright-cli/references/tracing.md +0 -139
- package/skills/playwright-cli/references/video-recording.md +0 -143
- package/skills/testeiya/README.md +0 -29
- package/skills/testeiya/answer-formatting/SKILL.md +0 -30
- package/skills/testeiya/check-cucumber/SKILL.md +0 -200
- package/skills/testeiya/check-tests/SKILL.md +0 -260
- package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
- package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
- package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
- package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
- package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
- package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
- package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
- package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
- package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
- package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
- package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
- package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
- package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
- package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
- package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
- package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
- package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
- package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
- package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
- package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
- package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
- package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
- package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
- package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
- package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
- package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
- package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
- package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
- package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
- package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
- package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
- package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
- package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
- package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
- package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
- package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
- package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
- package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
- package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
- package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
- package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
- package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
- package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
- package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
- package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
- package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
- package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
- package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
- package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
- package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
- package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
- package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
- package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
- package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
- package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
- package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
- package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
- package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
- package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
- package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
- package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +0 -88
- package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +0 -95
- package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +0 -334
- package/skills/testomatio/test-automation/automate-manual-test-cases/CLAUDE.md +0 -56
- package/skills/testomatio/test-automation/automate-manual-test-cases/SKILL.md +0 -242
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/CODECEPTJS_BEST_PRACTICES.md +0 -182
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/FINAL_SUMMARY_TEMPLATE.md +0 -22
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/PLAYWRIGHT_BEST_PRACTICES.md +0 -90
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/POM_BEST_PRACTICES.md +0 -53
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/TEST_DATA_MANAGEMENT.md +0 -52
- package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/SKILL.md +0 -107
- package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/references/DEBUGGING_QUICK_REFERENCE.md +0 -113
- package/skills/testomatio/test-automation/qa-automation-test-consolidation/SKILL.md +0 -29
- package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +0 -151
- package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
- package/skills/testomatio/test-automation/testomat-allure-adapter/SKILL.md +0 -289
- package/skills/testomatio/test-management/detect-duplicate-test-cases/SKILL.md +0 -86
- package/skills/testomatio/test-management/detect-duplicate-test-cases/references/DUPLICATE_INSTRUCTIONS.md +0 -54
- package/skills/testomatio/test-management/improve-test-cases/SKILL.md +0 -114
- package/skills/testomatio/test-management/improve-test-cases/references/TESTOMAT_MARKDOWN_EXAMPLE.md +0 -66
- package/skills/testomatio/test-management/pull-request-diff-analyzer/SKILL.md +0 -141
- package/skills/testomatio/test-management/qa-e2e-tests-reporting/SKILL.md +0 -354
- package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_ARTIFACTS.md +0 -82
- package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_HTML_REPORT.md +0 -37
- package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_REPORTERS_CONFIG.md +0 -118
- package/skills/testomatio/test-management/qa-pr-requirements-analyzer/SKILL.md +0 -149
- package/skills/testomatio/test-management/qa-pr-requirements-analyzer/references/summary-example.md +0 -54
- package/skills/testomatio/test-management/qa-requirement-reviewer/SKILL.md +0 -126
- package/skills/testomatio/test-management/qa-requirement-reviewer/references/requirements_reviewer_examples.md +0 -128
- package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +0 -174
- package/skills/testomatio/test-management/qa-test-code-coverage/references/COVERAGE_FILE_FORMAT.md +0 -138
- package/skills/testomatio/test-management/qa-test-code-coverage/references/E2E_FRAMEWORKS.md +0 -65
- package/skills/testomatio/test-management/qa-test-code-coverage/scripts/check-coverage.mjs +0 -40
- package/skills/testomatio/test-management/qa-thinking/SKILL.md +0 -36
- package/skills/testomatio/test-management/qa-write-test-cases/SKILL.md +0 -267
- package/skills/testomatio/test-management/qa-write-test-cases/references/test-case-format.md +0 -387
- package/skills/testomatio/test-management/qa-write-test-cases/references/testomat-tms-guide.md +0 -72
- package/skills/testomatio/test-management/qa-write-test-cases/references/writing-rule.md +0 -159
- package/skills/testomatio/test-management/scan-automation-project/SKILL.md +0 -152
- package/skills/testomatio/test-management/sync-test-cases-with-tms/SKILL.md +0 -107
- package/skills/testomatio/test-management/sync-test-cases-with-tms/references/TESTOMATIO_CLI.md +0 -140
- package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +0 -182
- package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +0 -169
- package/skills.yaml +0 -21
- package/src/ai-debug.ts +0 -188
- package/src/api/agent-get.ts +0 -22
- package/src/api/agent-start.ts +0 -384
- package/src/api/client-log.ts +0 -29
- package/src/api/context.ts +0 -332
- package/src/api/debug-layout.ts +0 -47
- package/src/api/debug-report.ts +0 -29
- package/src/api/debug-snapshot.ts +0 -30
- package/src/api/debug-stream.ts +0 -52
- package/src/api/files-delete.ts +0 -184
- package/src/api/files-read.ts +0 -41
- package/src/api/files-rename.ts +0 -99
- package/src/api/files-tree.ts +0 -292
- package/src/api/files-write.ts +0 -41
- package/src/api/mcp.ts +0 -603
- package/src/api/memory.ts +0 -69
- package/src/api/open-external.ts +0 -39
- package/src/api/playwright-cli.ts +0 -606
- package/src/api/providers.ts +0 -457
- package/src/api/read-env-token.ts +0 -33
- package/src/api/sessions.ts +0 -79
- package/src/api/settings.ts +0 -120
- package/src/api/skills.ts +0 -58
- package/src/api/testomatio-attachment.ts +0 -89
- package/src/api/testomatio-auth.ts +0 -284
- package/src/api/testomatio-proxy.ts +0 -197
- package/src/api/testomatio-run-stats.ts +0 -81
- package/src/api/testomatio-target.ts +0 -225
- package/src/api/testomatio-transcription.ts +0 -82
- package/src/api/workspace-search.ts +0 -96
- package/src/api/workspace-sync.ts +0 -151
- package/src/api/workspace.ts +0 -165
- package/src/app-server.ts +0 -556
- package/src/bridge.ts +0 -251
- package/src/check-tests.ts +0 -156
- package/src/cli.ts +0 -17
- package/src/commands.ts +0 -244
- package/src/config.ts +0 -183
- package/src/connection.ts +0 -658
- package/src/context-store.ts +0 -265
- package/src/debug-bus.ts +0 -405
- package/src/extensions/tool-gate.ts +0 -220
- package/src/extensions/webui/ask-channel.ts +0 -52
- package/src/extensions/webui/index.ts +0 -184
- package/src/extensions/webui/tools/ask-question.ts +0 -88
- package/src/extensions/webui/tools/query-result.ts +0 -79
- package/src/extensions/webui/tools/render-chart.ts +0 -53
- package/src/extensions/webui/tools/render-item.ts +0 -61
- package/src/extensions/webui/tools/render-list.ts +0 -170
- package/src/extensions/webui/tools/render-result.ts +0 -85
- package/src/extensions/webui/tools/render-tree.ts +0 -71
- package/src/extensions/webui/tools/ui-widget.ts +0 -54
- package/src/extensions/webui/tools/widget-result.ts +0 -13
- package/src/extensions/webui/widget-channel.ts +0 -50
- package/src/file-log.ts +0 -196
- package/src/git-tracked.ts +0 -68
- package/src/gitignore.ts +0 -53
- package/src/json-store.ts +0 -43
- package/src/load-env.ts +0 -70
- package/src/loader-style.ts +0 -96
- package/src/main.ts +0 -140
- package/src/mcp-catalog.ts +0 -96
- package/src/models-catalog.ts +0 -72
- package/src/permissions.ts +0 -120
- package/src/project-dir.ts +0 -189
- package/src/project-info.ts +0 -108
- package/src/prompt/app-ui.ts +0 -59
- package/src/prompt/browser.ts +0 -27
- package/src/prompt/index.ts +0 -62
- package/src/server-info.ts +0 -62
- package/src/session-factory.ts +0 -442
- package/src/session-store.ts +0 -115
- package/src/shell-env.ts +0 -45
- package/src/skills.ts +0 -163
- package/src/sync-snapshot.ts +0 -140
- package/src/telemetry.ts +0 -239
- package/src/testomatio-auth.ts +0 -299
- package/src/testomatio.ts +0 -98
- package/src/theme.ts +0 -30
- package/src/user-env.ts +0 -94
- package/src/welcome.ts +0 -127
- package/src/workspace/safe-path.ts +0 -85
- package/src/workspace/test-md.ts +0 -70
- package/src/workspace-model.ts +0 -440
- package/testeiya.config.json +0 -14
|
@@ -1,290 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: Start With Testomat.io
|
|
3
|
-
description: This guide helps users start from scratch with Testomat.io by creating projects, writing test cases, running manual and automated tests, and analyzing results with detailed reporting and analytics. It also includes importing automated tests and tracking automation coverage for optimization.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/getting-started/start-from-scratch/
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: keywords
|
|
10
|
-
content: Testomat.io, getting started, manual tests, automated tests, test reporting, project creation, test analytics, automation coverage, test cases, test management system
|
|
11
|
-
---
|
|
12
|
-
|
|
13
|
-
<!--
|
|
14
|
-
> If you don't have any manual or automated tests yet - follow this guide. Otherwise, pick the section of the guide relevant to your project. You might want to start from [this section](https://docs.testomat.io/getting-started/import-tests-from-source-code/) if you consider **importing tests from source code** into Testomat.io. For those interested in importing tests from the **Cucumber** framework, go straight to [this section](https://docs.testomat.io/getting-started/import-tests-from-cucumber/#why-do-i-need-to-import-my-tests)!
|
|
15
|
-
-->
|
|
16
|
-
|
|
17
|
-
Welcome!
|
|
18
|
-
|
|
19
|
-
This step-by-step guide helps you to create your project, add tests, execute them, and review results with analytics.
|
|
20
|
-
|
|
21
|
-
By the end of this guide, you will have:
|
|
22
|
-
|
|
23
|
-
- a project
|
|
24
|
-
- suites/folders with suites
|
|
25
|
-
- tests
|
|
26
|
-
- runs
|
|
27
|
-
- a report
|
|
28
|
-
- visual analytics with all data
|
|
29
|
-
|
|
30
|
-

|
|
31
|
-
|
|
32
|
-
## Create Project
|
|
33
|
-
|
|
34
|
-
A project is the main entity in Testomat.io that contains all tests, test execution programs, and analytical data on them. Every project can contain any number of suites and folders with any amount of tests, test runs, plans, and reports in them.
|
|
35
|
-
|
|
36
|
-
:::note
|
|
37
|
-
|
|
38
|
-
Each project is a separate entity. That means, you can do whatever you want within the Project, but you cannot cross-do staff between Projects.
|
|
39
|
-
|
|
40
|
-
:::
|
|
41
|
-
|
|
42
|
-
Register at [app.testomat.io](https://app.testomat.io) and activate your user account. Then create a new project:
|
|
43
|
-
1. Go to your account **Dashboard**.
|
|
44
|
-
2. In the top-right corner, click **Create**.
|
|
45
|
-
3. Enter the project title.
|
|
46
|
-
4. Choose the project type:
|
|
47
|
-
- BDD Project
|
|
48
|
-
- Classical Project
|
|
49
|
-
5. Decide whether to use demo data or your own data.
|
|
50
|
-
6. Click **Create**.
|
|
51
|
-
|
|
52
|
-

|
|
53
|
-
|
|
54
|
-
Use [BDD Project](https://docs.testomat.io/project/tests/bdd-test-case-editor/) if you plan to work with BDD descriptions or the Cucumber framework.
|
|
55
|
-
|
|
56
|
-
Use [Classical Project](https://docs.testomat.io/project/tests/classical-test-case-editor/) if you want free-form markdown test cases with automation synced to test cases.
|
|
57
|
-
|
|
58
|
-
You have just created your first project!
|
|
59
|
-
|
|
60
|
-
Now you can start creating suites and test cases for your projects.
|
|
61
|
-
|
|
62
|
-
## Create a Suite
|
|
63
|
-
|
|
64
|
-
Test suite is a collection of tests grouped together. You can create suites or create a folder with suites.
|
|
65
|
-
|
|
66
|
-

|
|
67
|
-
|
|
68
|
-
To create a suite:
|
|
69
|
-
1. Select a project.
|
|
70
|
-
2. Click **New suite**.
|
|
71
|
-
3. Enter your Suite name.
|
|
72
|
-
4. Press `Enter` on your keyboard.
|
|
73
|
-
|
|
74
|
-
Another way to create suite:
|
|
75
|
-
|
|
76
|
-
1. Click action menu button (...).
|
|
77
|
-
2. Select **Create more suites** from the menu.
|
|
78
|
-
|
|
79
|
-

|
|
80
|
-
|
|
81
|
-
3. Enter the title of the new suite or folder.
|
|
82
|
-
4. Click **'+ Suite'** to create a test suite, or optionally
|
|
83
|
-
5. Click **'Folder'** to create a folder for grouping suites.
|
|
84
|
-
|
|
85
|
-

|
|
86
|
-
|
|
87
|
-
:::note
|
|
88
|
-
|
|
89
|
-
You can create folders to group your suites. On the project page, click **New folder**, enter its name, and press `Enter` on the keyboard.
|
|
90
|
-
|
|
91
|
-
You can create any number of folders and suites within a folder.
|
|
92
|
-
|
|
93
|
-
:::
|
|
94
|
-
|
|
95
|
-
## Create Manual Test Cases
|
|
96
|
-
|
|
97
|
-
Read full article: [Test Case Creation and Editing](https://docs.testomat.io/project/tests/test-case-creation-and-editing/).
|
|
98
|
-
|
|
99
|
-
After you’ve created test suites, you can start adding tests.
|
|
100
|
-
1. Select a test suite.
|
|
101
|
-
2. Click on Suite, and a Suite panel will open to the right.
|
|
102
|
-
3. At the bottom of the **Tests** tab, enter the name of the test.
|
|
103
|
-
4. Click **Create**.
|
|
104
|
-
5. Click on the test to edit it.
|
|
105
|
-
|
|
106
|
-
:::note
|
|
107
|
-
|
|
108
|
-
When tests are newly created, they are marked as **manual** by default, which shows that they are ready for manual checks.
|
|
109
|
-
|
|
110
|
-
:::
|
|
111
|
-
|
|
112
|
-
You can also create a test using the **New test** button at the top of the Suite editor panel.
|
|
113
|
-
|
|
114
|
-

|
|
115
|
-
|
|
116
|
-
### Bulk-create Tests
|
|
117
|
-
|
|
118
|
-
Read full article: [Bulk Edit](https://docs.testomat.io/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level/).
|
|
119
|
-
|
|
120
|
-
To add multiple tests at once by listing their names, rather than adding each one individually:
|
|
121
|
-
1. Open (or create) a suite.
|
|
122
|
-
2. Turn on the **Bulk** toggle.
|
|
123
|
-
3. Type **one test name per line** in the input field.
|
|
124
|
-
4. Click **Create** - every line becomes a separate test, all added together.
|
|
125
|
-
|
|
126
|
-

|
|
127
|
-
|
|
128
|
-
## Run Manual Tests
|
|
129
|
-
|
|
130
|
-
Read full article: [Running Tests Manually](https://docs.testomat.io/project/runs/running-tests-manually/).
|
|
131
|
-
|
|
132
|
-
There are two main ways to start a manual run:
|
|
133
|
-
|
|
134
|
-
From the ‘Tests’ page, quick launch for selected tests or suites, or adding tests to an already ongoing run without leaving the Tests view.
|
|
135
|
-
|
|
136
|
-
1. On the **Tests** sidebar tab, activate **Multi-select**.
|
|
137
|
-
2. Select tests you need to run.
|
|
138
|
-
3. Click the **Run** button in the actions menu below.
|
|
139
|
-
|
|
140
|
-

|
|
141
|
-
|
|
142
|
-
From the ‘Runs’ page - the classic way to create and manage full runs with complete configuration options.
|
|
143
|
-
|
|
144
|
-
1. Go to the **Runs** tab in the sidebar.
|
|
145
|
-
2. Click the **New** button and select **New manual test run**.
|
|
146
|
-
3. Enter the run **Title**.
|
|
147
|
-
4. Then select **All tests**, **Test plan**, **Select tests**, or **Without tests** to run tests.
|
|
148
|
-
5. Click the **Launch** button to execute the tests.
|
|
149
|
-
|
|
150
|
-

|
|
151
|
-
|
|
152
|
-
:::note
|
|
153
|
-
|
|
154
|
-
Before tests execution, you can specify the run [environment options](https://docs.testomat.io/getting-started/running-tests-manually/#multi-environment-tests).
|
|
155
|
-
|
|
156
|
-
You can also toggle the **Run Automated as Manual** switch to select the result of automated tests manually.
|
|
157
|
-
|
|
158
|
-
:::
|
|
159
|
-
|
|
160
|
-
When the test execution is launched, testers can:
|
|
161
|
-
- Mark each test as **Passed**, **Failed**, or **Skipped**.
|
|
162
|
-
- Add messages.
|
|
163
|
-
- Attach evidence (screenshots, logs, etc.)
|
|
164
|
-
- Assign tests to specific team members.
|
|
165
|
-
|
|
166
|
-

|
|
167
|
-
|
|
168
|
-
## Import Automated Tests
|
|
169
|
-
|
|
170
|
-
Read full article: [Import Automated Tests](https://docs.testomat.io/getting-started/#import-automated-tests), [Import from CSV/XLSX](https://docs.testomat.io/project/import-export/import/import-tests-from-csv-xlsx/), and [Import Tests From TestRail](https://docs.testomat.io/project/import-export/import/import-tests-from-testrail/).
|
|
171
|
-
|
|
172
|
-
To add automated tests to your project, you must import them from the source code, a CSV file, or an existing TestRail suite. To import automated tests, follow these steps:
|
|
173
|
-
|
|
174
|
-
1. Open your project.
|
|
175
|
-
2. Navigate to the actions (...).
|
|
176
|
-
3. Click **Import automated tests**.
|
|
177
|
-
|
|
178
|
-
Alternatively:
|
|
179
|
-
|
|
180
|
-
1. Go to the Imports menu.
|
|
181
|
-
2. Navigate to the **Import** dropdown menu.
|
|
182
|
-
3. Select an import option:
|
|
183
|
-
|
|
184
|
-
| Import option | Description |
|
|
185
|
-
|---|---|
|
|
186
|
-
| **Import from Source Code** | Imports tests directly from your local project or repository. |
|
|
187
|
-
| **Import from CSV** | Imports tests from a CSV file and converts it to one of the available formats. |
|
|
188
|
-
| **Import from TestRail** | Imports tests from an existing TestRail suite. |
|
|
189
|
-
|
|
190
|
-
In the **Import** section, pick the framework, programming language and operating system you are using for testing.
|
|
191
|
-
|
|
192
|
-

|
|
193
|
-
|
|
194
|
-
:::note
|
|
195
|
-
|
|
196
|
-
Please check your environment:
|
|
197
|
-
|
|
198
|
-
- For NodeJS (JavaScript, TypeScript): you need NodeJS 10+ and npm installed to be able to run this command.
|
|
199
|
-
- For PHP: you need PHP > 7.2 and Composer installed.
|
|
200
|
-
|
|
201
|
-
:::
|
|
202
|
-
|
|
203
|
-
### Import via Terminal
|
|
204
|
-
|
|
205
|
-
Testomat.io can store tests from various frameworks. To import automated tests:
|
|
206
|
-
|
|
207
|
-
1. Open a terminal, navigate to the tests folder in your project.
|
|
208
|
-
2. Copy and execute the import command in a terminal.
|
|
209
|
-
3. See a report on how many tests were found.
|
|
210
|
-
4. Reopen the project and see that all tests with their folders and files are shown on Testomat.io.
|
|
211
|
-
|
|
212
|
-

|
|
213
|
-
|
|
214
|
-
If you don't see a similar message, please check the command's API change command parameters so it could find tests. The most common issues with import are different file naming format and/or incorrect directory for import.
|
|
215
|
-
|
|
216
|
-
:::note
|
|
217
|
-
|
|
218
|
-
All imported tests are marked as "Automated" by default. Please, check that the link actually points to the corresponding file.
|
|
219
|
-
|
|
220
|
-
:::
|
|
221
|
-
|
|
222
|
-
## Run Automated Tests
|
|
223
|
-
|
|
224
|
-
Read full article: [Running Automated Tests](https://docs.testomat.io/project/runs/running-automated-tests/).
|
|
225
|
-
|
|
226
|
-
To start Run Automated Tests:
|
|
227
|
-
1. Go to the **Runs** page.
|
|
228
|
-
2. Navigate to the **New** dropdown menu.
|
|
229
|
-
3. Select **Report automated tests**.
|
|
230
|
-
|
|
231
|
-

|
|
232
|
-
|
|
233
|
-
5. In the opened window select your framework.
|
|
234
|
-
6. Testomat.io will generate a terminal command.
|
|
235
|
-
|
|
236
|
-

|
|
237
|
-
|
|
238
|
-
7. Start generated commands in your terminal from your project folder.
|
|
239
|
-
|
|
240
|
-

|
|
241
|
-
|
|
242
|
-
8. A new Test Run will appear on Runs page.
|
|
243
|
-
|
|
244
|
-
## Test Run Report
|
|
245
|
-
|
|
246
|
-
Read full article: [Testomat.io Reporter](https://docs.testomat.io/test-reporting/reporter/).
|
|
247
|
-
|
|
248
|
-
You can use Testomat.io as a test management system or as a rich reporting tool. Each test has its history and a lifecycle, so each test report will be attached to a corresponding test in a project.
|
|
249
|
-
|
|
250
|
-
To view your test run reports:
|
|
251
|
-
|
|
252
|
-
1. Navigate to the Runs menu.
|
|
253
|
-
2. Find the information about the completed test run (the duration of the run, the performer, etc.)
|
|
254
|
-
3. Filter by status, find specific tests by tags, or sort by available methods.
|
|
255
|
-
4. You can see test results in real-time.
|
|
256
|
-
|
|
257
|
-

|
|
258
|
-
|
|
259
|
-
To get a detailed report of the test run, click on the **Report** button. Share the report with your stakeholders.
|
|
260
|
-
|
|
261
|
-

|
|
262
|
-
|
|
263
|
-
:::note
|
|
264
|
-
|
|
265
|
-
Artifacts like screenshots, videos, and traces are uploaded to your own cloud storage via S3 protocol. Artifacts can be uploaded privately or publicly and used in reports.
|
|
266
|
-
|
|
267
|
-
:::
|
|
268
|
-
|
|
269
|
-
## Analytics
|
|
270
|
-
|
|
271
|
-
Read full article: [Analytics](https://docs.testomat.io/project/analytics/).
|
|
272
|
-
|
|
273
|
-
Testomat.io Analytics provides an extensive overview of testing data by tracking both automated and manual tests. You can visualize trends over time with custom charts, identify automation coverage, monitor failure patterns, and analyze metrics like flaky or slowest tests.
|
|
274
|
-
|
|
275
|
-

|
|
276
|
-
|
|
277
|
-
Additional features include a failure board, label, and tag statistics for better team insights, allowing for optimized testing and proactive bug prevention.
|
|
278
|
-
|
|
279
|
-
|
|
280
|
-
|
|
281
|
-
## Explore more features
|
|
282
|
-
|
|
283
|
-
Learn more: [AI-Powered Features](https://docs.testomat.io/advanced/ai-powered-features/ai-powered-features/) and [Issues Management Systems](https://docs.testomat.io/integrations/issues-management/).
|
|
284
|
-
|
|
285
|
-
Once you’re comfortable with the core workflow, you can start using advanced features to help you with your QA process.
|
|
286
|
-
|
|
287
|
-
A built-in AI assistant can generate new test cases from existing suites or requirements, suggest missing scenarios, summarize project coverage, and write descriptions for undocumented automated tests.
|
|
288
|
-
|
|
289
|
-
On the integrations side, Testomat.io works out of the box with popular automation frameworks ([Playwright](https://docs.testomat.io/tutorials/playwright/), [Cypress](https://docs.testomat.io/test-reporting/workflows/#github-actions-and-cypress-trigger--pr), [Cucumber](https://docs.testomat.io/project/import-export/import/import-bdd/#_top), and more), CI/CD tools like [GitHub Actions](https://docs.testomat.io/integrations/continuous-integration/github), [GitLab](https://docs.testomat.io/integrations/continuous-integration/gitlab), and [Jenkins](https://docs.testomat.io/integrations/continuous-integration/jenkins), as well as team tools such as [Slack](https://docs.testomat.io/integrations/report-notifications/slack) and [Confluence](https://docs.testomat.io/integrations/issues-management/confluence). In addition, the [Jira](https://docs.testomat.io/integrations/report-notifications/jira) plugin keeps tests, issues, and results in sync so your whole team can manage testing without leaving the tools they already use.
|
|
290
|
-
|
|
@@ -1,96 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: Azure Pipelines
|
|
3
|
-
description: Integrate Azure Pipelines with Testomat.io to automate test execution and reporting. This guide explains setting up CI connections, creating input variables, and configuring pipelines to run tests with tools like CodeceptJS, Jest, or Playwright. It also details passing custom variables and specifying branches for targeted testing.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/integrations/continuous-integration/azure
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: keywords
|
|
10
|
-
content: Azure DevOps, Testomat.io, CI connection, CI Integration, Azure Pipeline, Personal Access Token, Continious Integration, Test Automation, Test Management, Microsoft Azure, input variables, configuration, workflows, test reporting
|
|
11
|
-
---
|
|
12
|
-
|
|
13
|
-
To connect Azure DevOps to Testomat.io, first you need to create an Private Access Token (PAT).
|
|
14
|
-
Learn how to create a PAT following the link - [Create PAT](https://learn.microsoft.com/en-us/azure/devops/organizations/accounts/use-personal-access-tokens-to-authenticate?view=azure-devops&tabs=Windows).
|
|
15
|
-
|
|
16
|
-
And follow the instructions below:
|
|
17
|
-
|
|
18
|
-
1. Create a **PAT** in your Azure DevOps account with permission to **Read & Execute Build**.
|
|
19
|
-
|
|
20
|
-

|
|
21
|
-
|
|
22
|
-
2. Obtain the **ID** of a Pipeline you want to execute. Open a Pipeline and copy its ID from `definitionId` query parameter. On this screenshot the ID is `1`.
|
|
23
|
-
|
|
24
|
-

|
|
25
|
-
|
|
26
|
-
3. Create a new **CI connection** inside your project in Testomat.io: go to **'Settings' -> 'Continuous Integration' ->** click **'Connect to CI'** select **'Azure Pipelines'**
|
|
27
|
-
|
|
28
|
-

|
|
29
|
-
|
|
30
|
-
4. Enter following details on the **'Connection'** tab:
|
|
31
|
-
|
|
32
|
-
- `Personal Access Token` - PAT created, in Azure DevOps during Step 1.
|
|
33
|
-
- `Azure DevOps Organization`.
|
|
34
|
-
- `Azure DevOps Project`.
|
|
35
|
-
- `Azure DevOps Pipeline Id` - open a pipeline and copy a number value of `definitionId` param from URL (in our case `definitionId = 1`).
|
|
36
|
-
- `Azure Server URL` - in case you use self-hosted Azure DevOps Server instead of Azure Cloud.
|
|
37
|
-
|
|
38
|
-

|
|
39
|
-
|
|
40
|
-
5. Switch to **'Input Variables'** tab and select checkboxes:
|
|
41
|
-
|
|
42
|
-
- Send Run ID as `run` input (required for scheduled jobs).
|
|
43
|
-
- Send Testomat.io API key as `testomatio` input.
|
|
44
|
-
- Send Testomat.io Server URL as `testomatio_url` input (if you use on-premise setup).
|
|
45
|
-
|
|
46
|
-
6. Save the conection
|
|
47
|
-
|
|
48
|
-

|
|
49
|
-
|
|
50
|
-
7. Testomat.io will need to send Input Variables into a Pipeline. For this, you need to enable them inside a Pipeline using **Azure DevOps UI**. Open a Pipeline and edit it.
|
|
51
|
-
|
|
52
|
-

|
|
53
|
-
|
|
54
|
-
8. Click **'Variables'** button
|
|
55
|
-
|
|
56
|
-

|
|
57
|
-
|
|
58
|
-
9. Create the following variables:
|
|
59
|
-
|
|
60
|
-
- `grep`
|
|
61
|
-
- `run`
|
|
62
|
-
- `testomatio`
|
|
63
|
-
- `testomatio_url`
|
|
64
|
-
|
|
65
|
-

|
|
66
|
-
|
|
67
|
-
Do not set defaults to this variable and tick **'Let users override this value when running this pipeline'** so Testomat.io could set these variables via API request.
|
|
68
|
-
|
|
69
|
-

|
|
70
|
-
|
|
71
|
-
10. Update the Pipeline to use passed variables. Update the script and pass environment variables to a test runner. Each variable can be accessed as `$(variable)`.
|
|
72
|
-
For CodeceptJS this command will look the following way:
|
|
73
|
-
|
|
74
|
-
```yaml
|
|
75
|
-
- script: |
|
|
76
|
-
TESTOMATIO=$(testomatio) TESTOMATIO_URL=$(testomatio_url) TESTOMATIO_RUN=$(run) npx codeceptjs run --grep="$(grep)"
|
|
77
|
-
displayName: 'run tests'
|
|
78
|
-
```
|
|
79
|
-
|
|
80
|
-
:::note
|
|
81
|
-
|
|
82
|
-
If you use Jest, Playwright, Cucumber, Cypress, etc. replace `npx codeceptjs run` with the execution command of your test runner.
|
|
83
|
-
|
|
84
|
-
:::
|
|
85
|
-
|
|
86
|
-
You can pass more custom variables into a Pipeline defining them in a Pipeline UI first and listing them in Testomat.io configuration as well. These variables should be set in Azure in the same way as `grep`. See [Environment Configuration](./index.md#environment-configuration) to see how they can be configured in Testomat.io.
|
|
87
|
-
|
|
88
|
-
To specify a different branch to run tests add `ref` parameter on **'Configuration'** tab specifying target ref.
|
|
89
|
-
|
|
90
|
-

|
|
91
|
-
|
|
92
|
-
To specify `develop` branch add this as config parameter:
|
|
93
|
-
|
|
94
|
-
```
|
|
95
|
-
ref=refs/heads/develop
|
|
96
|
-
```
|
|
@@ -1,94 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: Atlassian Bamboo
|
|
3
|
-
description: This guide explains integrating Atlassian Bamboo with Testomat.io for continuous integration. It includes configuring Bamboo plans, setting environment variables, and running tests with the CodeceptJS framework. Steps to connect Bamboo to Testomat.io via API keys and enable reporting are also provided.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/integrations/continuous-integration/bamboo
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: keywords
|
|
10
|
-
content: Atlassian Bamboo, Testomat.io, CI integration, CI connection, continuous integration, CodeceptJS, test automation, API token, environment variables, test reporting, Bamboo plan setup, configuration, workflows
|
|
11
|
-
---
|
|
12
|
-
|
|
13
|
-
Let's configure Bamboo CI server to work for CodeceptJS framework:
|
|
14
|
-
|
|
15
|
-
1. Create a plan in Bamboo for Testomat.io to run in Testomat.io.
|
|
16
|
-
|
|
17
|
-

|
|
18
|
-
|
|
19
|
-
2. Note the **'Plan key'**. In this case its **'TES'**.
|
|
20
|
-
3. Configure the job to install node dependencies.
|
|
21
|
-
|
|
22
|
-

|
|
23
|
-
|
|
24
|
-
4. Add the script to run CodeceptJS tests:
|
|
25
|
-
|
|
26
|
-
```
|
|
27
|
-
TESTOMATIO_RUN=${bamboo.run} npx codeceptjs run --grep "${bamboo.grep}"
|
|
28
|
-
```
|
|
29
|
-
Following environment variables must be set:
|
|
30
|
-
|
|
31
|
-
- **Add `TESTOMATIO` environment variable with API key of Testomat.io project.**
|
|
32
|
-
- If you are running a self-hosted Testomat.io instance, add `TESTOMATIO_URL` variable to specify a host to which reports will be sent.
|
|
33
|
-
|
|
34
|
-

|
|
35
|
-
|
|
36
|
-
5. Set an input variable. Open Plan configuration:
|
|
37
|
-
|
|
38
|
-

|
|
39
|
-
|
|
40
|
-
add `grep` and `run` variables with an empty string as a default value
|
|
41
|
-
|
|
42
|
-

|
|
43
|
-
|
|
44
|
-
Now, as Bamboo is configured, you need to configure Bamboo integration at Testomat.io:
|
|
45
|
-
|
|
46
|
-
1. Go to **'Settings'**.
|
|
47
|
-
2. Select **'Continuous Integration'**.
|
|
48
|
-
3. Click **'Connect to CI'**.
|
|
49
|
-
|
|
50
|
-

|
|
51
|
-
|
|
52
|
-
4. Select **'Atlassian Bamboo'** and enter the details of Bamboo server on **'Connection'** tab:
|
|
53
|
-
|
|
54
|
-
- `Bamboo Hostname` - URL of Bamboo host.
|
|
55
|
-
- `API Token` - to generate API token [check this](https://confluence.atlassian.com/bamboo/personal-access-tokens-976779873.html).
|
|
56
|
-
- `Project Key` - Chars ID, in our example its `EX`.
|
|
57
|
-
- `Plan Key` - Chars ID, in our example its `TES`.
|
|
58
|
-
|
|
59
|
-
A project and plan keys can be found from URL:
|
|
60
|
-
|
|
61
|
-

|
|
62
|
-
|
|
63
|
-

|
|
64
|
-
|
|
65
|
-
5. Enable `run` option on **'Input Variables'** tab. This allows CI to send a report to a specific Run inside Testomat.io.
|
|
66
|
-
6. Click **'Save'** button and check the connection.
|
|
67
|
-
|
|
68
|
-

|
|
69
|
-
|
|
70
|
-
:::note
|
|
71
|
-
|
|
72
|
-
You can pass more input variables if you set them in [Environment Configuration](./index.md#environment-configuration). For example: test environment, browser, branch, etc.
|
|
73
|
-
|
|
74
|
-
:::
|
|
75
|
-
|
|
76
|
-
7a. Open **'Runs'** page then select `Run Automated Tests in CI` option in extra menu.
|
|
77
|
-
|
|
78
|
-

|
|
79
|
-
|
|
80
|
-
8a. Select **'Bamboo'** profile in a list. Optionally, select a **Test Plan** or create a new one.
|
|
81
|
-
|
|
82
|
-

|
|
83
|
-
|
|
84
|
-
OR
|
|
85
|
-
|
|
86
|
-
7b. On **'Tests'** page select any automated suite or test case -> click **'Extra menu'** button -> select **'Run Tests'** option -> open **'Run in CI'** tab.
|
|
87
|
-
|
|
88
|
-
8b. Select **'Bamboo'** profile in a list.
|
|
89
|
-
|
|
90
|
-

|
|
91
|
-
|
|
92
|
-
9. Launch a Run and wait for the results.
|
|
93
|
-
|
|
94
|
-

|
package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md
DELETED
|
@@ -1,106 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: BitBucket Pipelines
|
|
3
|
-
description: Integrate Bitbucket Pipelines with Testomat.io to streamline test execution and reporting. This guide explains setting up API tokens, configuring pipeline parameters, and running tests with environment variables like TESTOMATIO. It includes instructions for handling grep options, on-premise setups, and connecting Testomat.io for seamless CI/CD integration.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/integrations/continuous-integration/bitbucket
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: keywords
|
|
10
|
-
content: Bitbucket Pipelines, Testomat.io, CI/CD integration, CI connection, CI Integration, automated testing, test reporting, API tokens, environment variables, test management, on-premise setups
|
|
11
|
-
---
|
|
12
|
-
|
|
13
|
-
To connect BitBucket to Testomat.io you will need a API Token created in your BitBucket account.
|
|
14
|
-
API token can be added on **'Repository settings'** page of the current user - [create an access token for repository](https://support.atlassian.com/bitbucket-cloud/docs/create-a-repository-access-token/).
|
|
15
|
-
|
|
16
|
-

|
|
17
|
-
|
|
18
|
-
Then create a new BitBucket project. Click on **'Create'** button at the header menu and select **'Project'** option from the displayed dropdown list.
|
|
19
|
-
|
|
20
|
-

|
|
21
|
-
|
|
22
|
-
Make this build parametrized. Go to **'Settings' -> 'Workspace settings' -> 'Workspace variables'**
|
|
23
|
-
|
|
24
|
-

|
|
25
|
-
|
|
26
|
-
Add the following parameters as a string with empty default values:
|
|
27
|
-
|
|
28
|
-
- ```run```
|
|
29
|
-
- ```testomatio```
|
|
30
|
-
- ```grep```
|
|
31
|
-
|
|
32
|
-
The **Job** should include a step where the test runner is executed with `—grep` option and `TESTOMATIO` environment variables passed in.
|
|
33
|
-
|
|
34
|
-
For instance: ```- npx codeceptjs run-workers 2 --grep "${grep}"```
|
|
35
|
-
|
|
36
|
-

|
|
37
|
-
|
|
38
|
-
:::note
|
|
39
|
-
|
|
40
|
-
If you use on-premise Testomat.io setup you will also need to add `testomatio_url` parameter.
|
|
41
|
-
|
|
42
|
-
:::
|
|
43
|
-
|
|
44
|
-
Save the build and switch to Testomat.io. To integrate BitBucket with your Testomat.io project follow the steps described below:
|
|
45
|
-
|
|
46
|
-
1. Go to **'Settings'**.
|
|
47
|
-
2. Select **'Continuous Integration'**.
|
|
48
|
-
3. Click **'Connect to CI'**.
|
|
49
|
-
|
|
50
|
-

|
|
51
|
-
|
|
52
|
-
4. Select **'BitBucket Pipeline'** and enter following details on the **'Connection'** tab:
|
|
53
|
-
|
|
54
|
-
- `API token` - access token, created in BitBucket during Step 1.
|
|
55
|
-
- `Workspace Name` - Workspace UID.
|
|
56
|
-
- `Repository Slug`- a URL-friendly version of a repository name, automatically generated by BitBucket for use in the URL.
|
|
57
|
-
|
|
58
|
-

|
|
59
|
-
|
|
60
|
-
5. Switch to **'Input Variables'** tab and select checkboxes:
|
|
61
|
-
|
|
62
|
-
- Send Run ID as `run` input (required for scheduled jobs).
|
|
63
|
-
- Send Testomat.io API key as `testomatio` input.
|
|
64
|
-
- Send Testomat.io Server URL as `testomatio_url` input (if you use on-premise setup).
|
|
65
|
-
|
|
66
|
-
:::note
|
|
67
|
-
|
|
68
|
-
You can set and pass more input variables if you set them in [Environment Configuration](./index.md#environment-configuration). For example: test environment, browser, branch, etc.
|
|
69
|
-
|
|
70
|
-
:::
|
|
71
|
-
|
|
72
|
-
:::note
|
|
73
|
-
|
|
74
|
-
If a pipeline is specified in the configuration, the Bitbucket integration will trigger a custom pipeline instead of the default one.
|
|
75
|
-
|
|
76
|
-
:::
|
|
77
|
-
|
|
78
|
-
6. Click on **'Save'** button to save the connection.
|
|
79
|
-
|
|
80
|
-

|
|
81
|
-
|
|
82
|
-
7a. When the connection is saved, open **'Runs'** page and select `Run Automated Tests in CI` option in extra menu.
|
|
83
|
-
|
|
84
|
-

|
|
85
|
-
|
|
86
|
-
8a. Select **'BitBucket'** profile in a list, select a target ref or any other variables, if any were configured. Optionally, select a **Test Plan** or create a new one.
|
|
87
|
-
|
|
88
|
-
9a. Click on **'Launch'** button and wait for the results.
|
|
89
|
-
|
|
90
|
-

|
|
91
|
-
|
|
92
|
-
OR
|
|
93
|
-
|
|
94
|
-
7b. On **'Tests'** page select any automated suite or test case -> click **'Extra menu'** button -> select **'Run Tests'** option -> open **'Run in CI'** tab.
|
|
95
|
-
|
|
96
|
-
8b. Select **'BitBucket'** profile in a list, as well, select a target ref or any other variables, if any were configured.
|
|
97
|
-
|
|
98
|
-
9b. Click on **'Launch'** button and wait for the results.
|
|
99
|
-
|
|
100
|
-

|
|
101
|
-
|
|
102
|
-
This will start a new job in BitBucket, please check that the job was successfully triggered and completed. After the job has finished, a run report will be available on Runs page of Testomat.io.
|
|
103
|
-
|
|
104
|
-

|
|
105
|
-
|
|
106
|
-
|