testeiya 0.2.1 → 0.3.9
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/LICENSE +21 -0
- package/README.md +41 -213
- package/dist/prompt/context.js +79 -0
- package/dist/prompt/context.js.map +1 -0
- package/dist/prompt/index.js +56 -0
- package/dist/prompt/index.js.map +1 -0
- package/dist/prompt/print.js +22 -0
- package/dist/prompt/print.js.map +1 -0
- package/dist/prompt/project-info.js +2 -0
- package/dist/prompt/project-info.js.map +1 -0
- package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +24 -21
- package/dist/prompt/system-prompt.js.map +1 -0
- package/dist/prompt/testomatio.js +264 -0
- package/dist/prompt/testomatio.js.map +1 -0
- package/dist/prompt/tools.js +49 -0
- package/dist/prompt/tools.js.map +1 -0
- package/dist/prompt/vocab.js +8 -0
- package/dist/prompt/vocab.js.map +1 -0
- package/dist/src/args.js +72 -0
- package/dist/src/args.js.map +1 -0
- package/dist/src/cli.js +61 -0
- package/dist/src/cli.js.map +1 -0
- package/dist/src/env.js +69 -0
- package/dist/src/env.js.map +1 -0
- package/dist/src/mcp-extension.js +9 -0
- package/dist/src/mcp-extension.js.map +1 -0
- package/dist/src/mcp.js +139 -0
- package/dist/src/mcp.js.map +1 -0
- package/dist/src/model.js +66 -0
- package/dist/src/model.js.map +1 -0
- package/dist/src/result.js +41 -0
- package/dist/src/result.js.map +1 -0
- package/dist/src/run.js +199 -0
- package/dist/src/run.js.map +1 -0
- package/dist/src/session.js +77 -0
- package/dist/src/session.js.map +1 -0
- package/dist/vendor/mcp.js +14801 -0
- package/mcp-tools.json +2967 -0
- package/package.json +29 -42
- package/prompt/context.ts +101 -0
- package/prompt/index.ts +93 -0
- package/prompt/print.ts +23 -0
- package/prompt/project-info.ts +30 -0
- package/prompt/system-prompt.ts +173 -0
- package/{src/prompt → prompt}/testomatio.ts +119 -8
- package/{src/prompt → prompt}/tools.ts +30 -8
- package/prompt/vocab.ts +7 -0
- package/{skills.lock.json → skills/skills.lock.json} +11 -7
- package/skills/skills.yaml +34 -0
- package/assets/testeiya-logo-dark.svg +0 -16
- package/assets/testeiya-logo.svg +0 -15
- package/models.catalog.json +0 -6963
- package/skills/codeceptjs/ci-fix-tests/SKILL.md +0 -120
- package/skills/codeceptjs/codeceptjs-auth/SKILL.md +0 -158
- package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +0 -91
- package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +0 -158
- package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +0 -90
- package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +0 -234
- package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +0 -110
- package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +0 -306
- package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +0 -352
- package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +0 -472
- package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +0 -350
- package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +0 -81
- package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +0 -206
- package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
- package/skills/playwright-best-practices-skill/README.md +0 -147
- package/skills/playwright-best-practices-skill/SKILL.md +0 -303
- package/skills/playwright-best-practices-skill/advanced/authentication-flows.md +0 -360
- package/skills/playwright-best-practices-skill/advanced/authentication.md +0 -871
- package/skills/playwright-best-practices-skill/advanced/clock-mocking.md +0 -364
- package/skills/playwright-best-practices-skill/advanced/mobile-testing.md +0 -409
- package/skills/playwright-best-practices-skill/advanced/multi-context.md +0 -288
- package/skills/playwright-best-practices-skill/advanced/multi-user.md +0 -393
- package/skills/playwright-best-practices-skill/advanced/network-advanced.md +0 -452
- package/skills/playwright-best-practices-skill/advanced/third-party.md +0 -464
- package/skills/playwright-best-practices-skill/architecture/pom-vs-fixtures.md +0 -363
- package/skills/playwright-best-practices-skill/architecture/test-architecture.md +0 -369
- package/skills/playwright-best-practices-skill/architecture/when-to-mock.md +0 -383
- package/skills/playwright-best-practices-skill/browser-apis/browser-apis.md +0 -391
- package/skills/playwright-best-practices-skill/browser-apis/iframes.md +0 -403
- package/skills/playwright-best-practices-skill/browser-apis/service-workers.md +0 -504
- package/skills/playwright-best-practices-skill/browser-apis/websockets.md +0 -403
- package/skills/playwright-best-practices-skill/core/annotations.md +0 -424
- package/skills/playwright-best-practices-skill/core/assertions-waiting.md +0 -361
- package/skills/playwright-best-practices-skill/core/configuration.md +0 -452
- package/skills/playwright-best-practices-skill/core/fixtures-hooks.md +0 -417
- package/skills/playwright-best-practices-skill/core/global-setup.md +0 -434
- package/skills/playwright-best-practices-skill/core/locators.md +0 -242
- package/skills/playwright-best-practices-skill/core/page-object-model.md +0 -315
- package/skills/playwright-best-practices-skill/core/projects-dependencies.md +0 -453
- package/skills/playwright-best-practices-skill/core/test-data.md +0 -492
- package/skills/playwright-best-practices-skill/core/test-suite-structure.md +0 -361
- package/skills/playwright-best-practices-skill/core/test-tags.md +0 -298
- package/skills/playwright-best-practices-skill/debugging/console-errors.md +0 -420
- package/skills/playwright-best-practices-skill/debugging/debugging.md +0 -504
- package/skills/playwright-best-practices-skill/debugging/error-testing.md +0 -360
- package/skills/playwright-best-practices-skill/debugging/flaky-tests.md +0 -496
- package/skills/playwright-best-practices-skill/frameworks/angular.md +0 -530
- package/skills/playwright-best-practices-skill/frameworks/nextjs.md +0 -469
- package/skills/playwright-best-practices-skill/frameworks/react.md +0 -531
- package/skills/playwright-best-practices-skill/frameworks/vue.md +0 -574
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/ci-cd.md +0 -468
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/docker.md +0 -283
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/github-actions.md +0 -546
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/gitlab.md +0 -397
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/other-providers.md +0 -521
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/parallel-sharding.md +0 -371
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/performance.md +0 -453
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/reporting.md +0 -424
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/test-coverage.md +0 -497
- package/skills/playwright-best-practices-skill/testing-patterns/accessibility.md +0 -359
- package/skills/playwright-best-practices-skill/testing-patterns/api-testing.md +0 -719
- package/skills/playwright-best-practices-skill/testing-patterns/browser-extensions.md +0 -506
- package/skills/playwright-best-practices-skill/testing-patterns/canvas-webgl.md +0 -493
- package/skills/playwright-best-practices-skill/testing-patterns/component-testing.md +0 -500
- package/skills/playwright-best-practices-skill/testing-patterns/drag-drop.md +0 -576
- package/skills/playwright-best-practices-skill/testing-patterns/electron.md +0 -509
- package/skills/playwright-best-practices-skill/testing-patterns/file-operations.md +0 -377
- package/skills/playwright-best-practices-skill/testing-patterns/file-upload-download.md +0 -562
- package/skills/playwright-best-practices-skill/testing-patterns/forms-validation.md +0 -561
- package/skills/playwright-best-practices-skill/testing-patterns/graphql-testing.md +0 -331
- package/skills/playwright-best-practices-skill/testing-patterns/i18n.md +0 -508
- package/skills/playwright-best-practices-skill/testing-patterns/performance-testing.md +0 -476
- package/skills/playwright-best-practices-skill/testing-patterns/security-testing.md +0 -430
- package/skills/playwright-best-practices-skill/testing-patterns/visual-regression.md +0 -634
- package/skills/playwright-cli/SKILL.md +0 -420
- package/skills/playwright-cli/references/element-attributes.md +0 -23
- package/skills/playwright-cli/references/playwright-tests.md +0 -39
- package/skills/playwright-cli/references/request-mocking.md +0 -87
- package/skills/playwright-cli/references/running-code.md +0 -241
- package/skills/playwright-cli/references/session-management.md +0 -225
- package/skills/playwright-cli/references/storage-state.md +0 -275
- package/skills/playwright-cli/references/test-generation.md +0 -433
- package/skills/playwright-cli/references/tracing.md +0 -139
- package/skills/playwright-cli/references/video-recording.md +0 -143
- package/skills/testeiya/README.md +0 -29
- package/skills/testeiya/answer-formatting/SKILL.md +0 -30
- package/skills/testeiya/check-cucumber/SKILL.md +0 -200
- package/skills/testeiya/check-tests/SKILL.md +0 -260
- package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
- package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
- package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
- package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
- package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
- package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
- package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
- package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
- package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
- package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
- package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
- package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
- package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
- package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
- package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
- package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
- package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
- package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
- package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
- package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
- package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
- package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
- package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
- package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
- package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
- package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
- package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
- package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
- package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
- package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
- package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
- package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
- package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
- package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
- package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
- package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
- package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
- package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
- package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
- package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
- package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
- package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
- package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
- package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
- package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
- package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
- package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
- package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
- package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
- package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
- package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
- package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
- package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
- package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
- package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
- package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
- package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
- package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
- package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
- package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
- package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +0 -88
- package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +0 -95
- package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +0 -334
- package/skills/testomatio/test-automation/automate-manual-test-cases/CLAUDE.md +0 -56
- package/skills/testomatio/test-automation/automate-manual-test-cases/SKILL.md +0 -242
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/CODECEPTJS_BEST_PRACTICES.md +0 -182
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/FINAL_SUMMARY_TEMPLATE.md +0 -22
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/PLAYWRIGHT_BEST_PRACTICES.md +0 -90
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/POM_BEST_PRACTICES.md +0 -53
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/TEST_DATA_MANAGEMENT.md +0 -52
- package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/SKILL.md +0 -107
- package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/references/DEBUGGING_QUICK_REFERENCE.md +0 -113
- package/skills/testomatio/test-automation/qa-automation-test-consolidation/SKILL.md +0 -29
- package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +0 -151
- package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
- package/skills/testomatio/test-automation/testomat-allure-adapter/SKILL.md +0 -289
- package/skills/testomatio/test-management/detect-duplicate-test-cases/SKILL.md +0 -86
- package/skills/testomatio/test-management/detect-duplicate-test-cases/references/DUPLICATE_INSTRUCTIONS.md +0 -54
- package/skills/testomatio/test-management/improve-test-cases/SKILL.md +0 -114
- package/skills/testomatio/test-management/improve-test-cases/references/TESTOMAT_MARKDOWN_EXAMPLE.md +0 -66
- package/skills/testomatio/test-management/pull-request-diff-analyzer/SKILL.md +0 -141
- package/skills/testomatio/test-management/qa-e2e-tests-reporting/SKILL.md +0 -354
- package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_ARTIFACTS.md +0 -82
- package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_HTML_REPORT.md +0 -37
- package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_REPORTERS_CONFIG.md +0 -118
- package/skills/testomatio/test-management/qa-pr-requirements-analyzer/SKILL.md +0 -149
- package/skills/testomatio/test-management/qa-pr-requirements-analyzer/references/summary-example.md +0 -54
- package/skills/testomatio/test-management/qa-requirement-reviewer/SKILL.md +0 -126
- package/skills/testomatio/test-management/qa-requirement-reviewer/references/requirements_reviewer_examples.md +0 -128
- package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +0 -174
- package/skills/testomatio/test-management/qa-test-code-coverage/references/COVERAGE_FILE_FORMAT.md +0 -138
- package/skills/testomatio/test-management/qa-test-code-coverage/references/E2E_FRAMEWORKS.md +0 -65
- package/skills/testomatio/test-management/qa-test-code-coverage/scripts/check-coverage.mjs +0 -40
- package/skills/testomatio/test-management/qa-thinking/SKILL.md +0 -36
- package/skills/testomatio/test-management/qa-write-test-cases/SKILL.md +0 -267
- package/skills/testomatio/test-management/qa-write-test-cases/references/test-case-format.md +0 -387
- package/skills/testomatio/test-management/qa-write-test-cases/references/testomat-tms-guide.md +0 -72
- package/skills/testomatio/test-management/qa-write-test-cases/references/writing-rule.md +0 -159
- package/skills/testomatio/test-management/scan-automation-project/SKILL.md +0 -152
- package/skills/testomatio/test-management/sync-test-cases-with-tms/SKILL.md +0 -107
- package/skills/testomatio/test-management/sync-test-cases-with-tms/references/TESTOMATIO_CLI.md +0 -140
- package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +0 -182
- package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +0 -169
- package/skills.yaml +0 -21
- package/src/ai-debug.ts +0 -188
- package/src/api/agent-get.ts +0 -22
- package/src/api/agent-start.ts +0 -384
- package/src/api/client-log.ts +0 -29
- package/src/api/context.ts +0 -332
- package/src/api/debug-layout.ts +0 -47
- package/src/api/debug-report.ts +0 -29
- package/src/api/debug-snapshot.ts +0 -30
- package/src/api/debug-stream.ts +0 -52
- package/src/api/files-delete.ts +0 -184
- package/src/api/files-read.ts +0 -41
- package/src/api/files-rename.ts +0 -99
- package/src/api/files-tree.ts +0 -292
- package/src/api/files-write.ts +0 -41
- package/src/api/mcp.ts +0 -603
- package/src/api/memory.ts +0 -69
- package/src/api/open-external.ts +0 -39
- package/src/api/playwright-cli.ts +0 -606
- package/src/api/providers.ts +0 -457
- package/src/api/read-env-token.ts +0 -33
- package/src/api/sessions.ts +0 -79
- package/src/api/settings.ts +0 -120
- package/src/api/skills.ts +0 -58
- package/src/api/testomatio-attachment.ts +0 -89
- package/src/api/testomatio-auth.ts +0 -284
- package/src/api/testomatio-proxy.ts +0 -197
- package/src/api/testomatio-run-stats.ts +0 -81
- package/src/api/testomatio-target.ts +0 -225
- package/src/api/testomatio-transcription.ts +0 -82
- package/src/api/workspace-search.ts +0 -96
- package/src/api/workspace-sync.ts +0 -151
- package/src/api/workspace.ts +0 -165
- package/src/app-server.ts +0 -556
- package/src/bridge.ts +0 -251
- package/src/check-tests.ts +0 -156
- package/src/cli.ts +0 -17
- package/src/commands.ts +0 -244
- package/src/config.ts +0 -183
- package/src/connection.ts +0 -658
- package/src/context-store.ts +0 -265
- package/src/debug-bus.ts +0 -405
- package/src/extensions/tool-gate.ts +0 -220
- package/src/extensions/webui/ask-channel.ts +0 -52
- package/src/extensions/webui/index.ts +0 -184
- package/src/extensions/webui/tools/ask-question.ts +0 -88
- package/src/extensions/webui/tools/query-result.ts +0 -79
- package/src/extensions/webui/tools/render-chart.ts +0 -53
- package/src/extensions/webui/tools/render-item.ts +0 -61
- package/src/extensions/webui/tools/render-list.ts +0 -170
- package/src/extensions/webui/tools/render-result.ts +0 -85
- package/src/extensions/webui/tools/render-tree.ts +0 -71
- package/src/extensions/webui/tools/ui-widget.ts +0 -54
- package/src/extensions/webui/tools/widget-result.ts +0 -13
- package/src/extensions/webui/widget-channel.ts +0 -50
- package/src/file-log.ts +0 -196
- package/src/git-tracked.ts +0 -68
- package/src/gitignore.ts +0 -53
- package/src/json-store.ts +0 -43
- package/src/load-env.ts +0 -70
- package/src/loader-style.ts +0 -96
- package/src/main.ts +0 -140
- package/src/mcp-catalog.ts +0 -96
- package/src/models-catalog.ts +0 -72
- package/src/permissions.ts +0 -120
- package/src/project-dir.ts +0 -189
- package/src/project-info.ts +0 -108
- package/src/prompt/app-ui.ts +0 -59
- package/src/prompt/browser.ts +0 -27
- package/src/prompt/index.ts +0 -62
- package/src/server-info.ts +0 -62
- package/src/session-factory.ts +0 -442
- package/src/session-store.ts +0 -115
- package/src/shell-env.ts +0 -45
- package/src/skills.ts +0 -163
- package/src/sync-snapshot.ts +0 -140
- package/src/telemetry.ts +0 -239
- package/src/testomatio-auth.ts +0 -299
- package/src/testomatio.ts +0 -98
- package/src/theme.ts +0 -30
- package/src/user-env.ts +0 -94
- package/src/welcome.ts +0 -194
- package/src/workspace/safe-path.ts +0 -85
- package/src/workspace/test-md.ts +0 -70
- package/src/workspace-model.ts +0 -440
- package/testeiya.config.json +0 -14
|
@@ -1,82 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: Import Tests From TestRail
|
|
3
|
-
description: Learn how to export tests from TestRail using three different methods CSV export, the built-in UI tool, and the migration script. This guide walks you through the process of exporting test cases from TestRail, whether you're using the CSV export feature for easy data transfer, the intuitive UI tool for streamlined export, or the migration script for more advanced needs. Each method is explained in detail, allowing you to choose the best option for exporting your test data efficiently.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/project/import-export/import-tests-from-testrail
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: og:image
|
|
10
|
-
content: https://docs.testomat.io/_astro/import_from_testrail_button.CWNnrpnC_JhLel.webp
|
|
11
|
-
|
|
12
|
-
- tag: meta
|
|
13
|
-
attrs:
|
|
14
|
-
name: keywords
|
|
15
|
-
content: Testomat.io, CSV, TestRail, test import, TestRail migration, manual tests, automated tests, test management, custom XLS
|
|
16
|
-
---
|
|
17
|
-
|
|
18
|
-
> If you have existing tests in TestRail and wish to migrate to Testomat.io, this guide will walk you through the process of importing your tests into Testomat.io.
|
|
19
|
-
|
|
20
|
-
Currently, Testomat.io supports three methods for exporting tests from TestRail
|
|
21
|
-
|
|
22
|
-
- Import via CSV
|
|
23
|
-
- Built-in UI tool (via API)
|
|
24
|
-
- API migration script
|
|
25
|
-
|
|
26
|
-
## How to Import Tests from CSV
|
|
27
|
-
|
|
28
|
-
> Use CSV Import for quick imports without attachments. It’s ideal for straightforward migrations, especially when you don’t need to include test attachments or extra metadata.
|
|
29
|
-
|
|
30
|
-
1. Navigate to your project in Testomat.io.
|
|
31
|
-
2. Click on the **Imports** tab.
|
|
32
|
-
3. Select the **Import From TestRail** button.
|
|
33
|
-
|
|
34
|
-

|
|
35
|
-
|
|
36
|
-
4. Click on the **Import tests from CSV file** link.
|
|
37
|
-
|
|
38
|
-

|
|
39
|
-
|
|
40
|
-
5. From the dropdown menu, choose **TestRail**.
|
|
41
|
-
6. Select the CSV file containing your exported TestRail tests.
|
|
42
|
-
7. Click the **Create** button to complete the import.
|
|
43
|
-
|
|
44
|
-

|
|
45
|
-
|
|
46
|
-
## Example Files For Import
|
|
47
|
-
|
|
48
|
-
Below is a sample of the supported format:
|
|
49
|
-
|
|
50
|
-
[TestRail](https://testomatio-artifacts.ams3.cdn.digitaloceanspaces.com/documentation/TestRail.csv)
|
|
51
|
-
|
|
52
|
-
|
|
53
|
-
## Import TestRail Project via Build-in UI Tool (via API)
|
|
54
|
-
|
|
55
|
-
>If you have a small or medium-sized TestRail project (up to 1000 tests) that you'd like to import into Testomat.io, you can easily use our intuitive built-in UI tool, which imports tests via the API.
|
|
56
|
-
|
|
57
|
-
1. Navigate to your project in Testomat.io.
|
|
58
|
-
2. Click on the **Imports** tab.
|
|
59
|
-
3. Select the **Import From TestRail** button.
|
|
60
|
-
4. Enter your valid TestRail credentials in the provided fields.
|
|
61
|
-
5. Click the **Import Tests** button to begin the import process.
|
|
62
|
-
|
|
63
|
-

|
|
64
|
-
|
|
65
|
-
> Make sure that you have enabled API in the administration area in TestRail under Administration > Site Settings > API.
|
|
66
|
-
|
|
67
|
-
## Import TestRail Project via API Migration Script
|
|
68
|
-
|
|
69
|
-
>Use the API Migration Script when migrating large TestRail projects (more than 1000 tests) that include attachments or require more customization than the built-in UI tool can handle. This method is ideal for transferring extensive datasets, ensuring that all test cases, including attachments, are accurately imported into Testomat.io.
|
|
70
|
-
|
|
71
|
-
1. Navigate to your project in Testomat.io.
|
|
72
|
-
2. Click on the **Imports** tab.
|
|
73
|
-
3. Select the **Import From TestRail** button.
|
|
74
|
-
4. Click on the **Import Locally** link to access the [migration script instructions](https://github.com/testomatio/migrate-testrail).
|
|
75
|
-
|
|
76
|
-
|
|
77
|
-

|
|
78
|
-
|
|
79
|
-
|
|
80
|
-
|
|
81
|
-
|
|
82
|
-
|
package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md
DELETED
|
@@ -1,55 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: Import Tests From XRay
|
|
3
|
-
description: Learn how to import tests from XRay into Testomat.io using the migration script that utilizes the XRay API.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/project/import-export/import-tests-from-xray
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: keywords
|
|
10
|
-
content: Testomat.io, CSV, XRay, test import, XRay migration, manual tests, automated tests, test management
|
|
11
|
-
---
|
|
12
|
-
|
|
13
|
-
> If you have existing tests in XRay and want to migrate to Testomat.io, you can use our migration script, which pulls test cases via the XRay API and converts them into Testomat.io’s format.
|
|
14
|
-
|
|
15
|
-
## Import XRay Project via Migration Script
|
|
16
|
-
|
|
17
|
-
This method is ideal if you need to migrate test cases directly from XRay, including custom fields or complex structures.
|
|
18
|
-
|
|
19
|
-
### Steps:
|
|
20
|
-
|
|
21
|
-
1. Open your project in Testomat.io.
|
|
22
|
-
2. Go to the **Imports** tab.
|
|
23
|
-
3. Click the **Import from CSV** button.
|
|
24
|
-
|
|
25
|
-

|
|
26
|
-
|
|
27
|
-
4. From the dropdown, select **XRay**.
|
|
28
|
-
5. Follow the instructions in the [advanced XRay migration script](https://github.com/testomatio/migrate-xray) to export your tests via API and convert them into a CSV format compatible with Testomat.io.
|
|
29
|
-
|
|
30
|
-

|
|
31
|
-
|
|
32
|
-
## How to Import Tests into Testomat.io
|
|
33
|
-
|
|
34
|
-
1. If you're creating a brand new project, the **Import from Spreadsheet** button will be available under the Test tab.
|
|
35
|
-
|
|
36
|
-

|
|
37
|
-
|
|
38
|
-
2. If you're working in an existing project, open it in Testomat.io.
|
|
39
|
-
3. Click the **Imports** tab.
|
|
40
|
-
4. Click the **Import from CSV** button.
|
|
41
|
-
|
|
42
|
-

|
|
43
|
-
|
|
44
|
-
5. From the dropdown menu, choose **Testomatio**.
|
|
45
|
-
6. Select the file generated by the migration script.
|
|
46
|
-
7. Click the **Create** button to complete the import.
|
|
47
|
-
|
|
48
|
-

|
|
49
|
-
|
|
50
|
-
|
|
51
|
-
|
|
52
|
-
|
|
53
|
-
|
|
54
|
-
|
|
55
|
-
|
|
@@ -1,334 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: Test Plans Overview
|
|
3
|
-
description: Explore how to create and manage test plans in Testomat.io. This guide covers manual, automated, and mixed test plans, detailing how to organize test cases, run tests on CI, and combine manual and automated test reports. Learn how to configure Continuous Integration and use filters for efficient test management.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/project/plans
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: keywords
|
|
10
|
-
content: test plans, test plan creation, test plan execution, manual testing, automated testing, mixed test plans, CI/CD, CLI, continuous integration, test case management, QA, Testomat.io, testing strategy, test reports
|
|
11
|
-
---
|
|
12
|
-
|
|
13
|
-
**Test Plan** defines the scope, structure, and execution model of a run. It helps teams clearly understand which tests will be executed, how they are grouped, and how results will be reported.
|
|
14
|
-
|
|
15
|
-
In Testomat.io, Test Plans allow you to organize tests, control how they are executed (manually, automatically, or both), and keep test results consistent and transparent for all stakeholders.
|
|
16
|
-
|
|
17
|
-
The **Plans** page is the central place where you create, manage, and organize all test plans. From here, you can:
|
|
18
|
-
|
|
19
|
-
1. **Filter by label** – Narrow down plans by labels for better organization
|
|
20
|
-
2. **Search** – Quickly find plans by name
|
|
21
|
-
3. **+ New plan** – Create Manual, Automated, or Mixed plans
|
|
22
|
-
4. **Multiselect** – Select multiple plans to apply bulk actions
|
|
23
|
-
5. **Filter by type** – Narrow down plans by types (Manual, Automated, Mixed, or Generated)
|
|
24
|
-
6. **Labels** – Assign or remove labels to one or multiple plans
|
|
25
|
-
7. **Link to Issue** – Link plans to issues individually or in bulk
|
|
26
|
-
8. **Delete** – Remove one or multiple plans using multiselect
|
|
27
|
-
|
|
28
|
-

|
|
29
|
-
|
|
30
|
-
This overview helps you quickly navigate, filter, and manage test plans before working with plan details and runs.
|
|
31
|
-
|
|
32
|
-
## Types of Test Plans
|
|
33
|
-
|
|
34
|
-
Testomat.io supports three main types of test plans. Each type is designed for a specific testing goal and execution model. Choosing the right plan type depends on how your tests are executed and how results should be reported.
|
|
35
|
-
|
|
36
|
-
- **Manual** – for executing tests manually and reporting results from the UI
|
|
37
|
-
- **Automated** – for running automated tests via CI or CLI and reporting results automatically
|
|
38
|
-
- **Mixed** – for combining manual and automated tests in a single plan and report
|
|
39
|
-
|
|
40
|
-
Below, we’ll walk through each plan type and explain how and when to use it.
|
|
41
|
-
|
|
42
|
-
### Manual Plans
|
|
43
|
-
|
|
44
|
-
**Manual Plans** are designed for tests that are executed manually by testers.
|
|
45
|
-
|
|
46
|
-
They are typically used when:
|
|
47
|
-
|
|
48
|
-
- Tests require human validation or judgment
|
|
49
|
-
- Exploratory or usability testing is performed
|
|
50
|
-
- Manual regression or acceptance testing is needed
|
|
51
|
-
|
|
52
|
-
#### Add Automated Tests as Manual
|
|
53
|
-
|
|
54
|
-
Manual Plans include an optional toggle: **Run Automated as Manual**.
|
|
55
|
-
|
|
56
|
-
**When enabled:**
|
|
57
|
-
|
|
58
|
-
- Automated tests can be added to a Manual Plan **using the same selection logic as manual tests** (test tree, folders/suites, or filters)
|
|
59
|
-
- These tests are executed manually, and test run statuses (**Passed / Failed / Skipped**) are assigned manually during the run
|
|
60
|
-
|
|
61
|
-
**When disabled:**
|
|
62
|
-
|
|
63
|
-
- Automated tests are not selectable
|
|
64
|
-
|
|
65
|
-
This toggle is the **only exception** to the strict plan-to-test-type mapping.
|
|
66
|
-
|
|
67
|
-

|
|
68
|
-
|
|
69
|
-
### Automated Plans
|
|
70
|
-
|
|
71
|
-
**Automated Plans** are designed for running automated tests and sending their results to Testomat.io.
|
|
72
|
-
|
|
73
|
-
They are typically used when you:
|
|
74
|
-
|
|
75
|
-
- Want to run a fixed or predefined set of automated tests
|
|
76
|
-
- Execute tests automatically via a **Continuous Integration (CI) service** or **from CLI**
|
|
77
|
-
- Need tests to run regularly (e.g., nightly, on every commit, or before a release)
|
|
78
|
-
- Want test results reported automatically, without manual intervention
|
|
79
|
-
|
|
80
|
-
With Automated Plans:
|
|
81
|
-
|
|
82
|
-
- Only **automated tests** can be added to the plan
|
|
83
|
-
- Test execution is triggered via a CI pipeline or CLI command
|
|
84
|
-
- Execution results are sent automatically to Testomat.io
|
|
85
|
-
|
|
86
|
-
To use an Automated Plan:
|
|
87
|
-
|
|
88
|
-
- Tests must have **IDs**
|
|
89
|
-
- IDs can be generated using the `--update-ids` option during test import
|
|
90
|
-
- Each plan has a **Plan ID**, which can be used to run this specific collection of tests
|
|
91
|
-
|
|
92
|
-
For example,
|
|
93
|
-
|
|
94
|
-
`TESTOMATIO={API_KEY} npx @testomatio/reporter run 'actual run command' --filter 'testomatio:plan={Plan_ID}'`
|
|
95
|
-
|
|
96
|
-
- `{API_KEY}` – your Testomat.io Reporting API key
|
|
97
|
-
- `{Plan_ID}` – ID of the plan you want to run
|
|
98
|
-
- `'actual run command'` – your test framework command (e.g., `npx codeceptjs`)
|
|
99
|
-
|
|
100
|
-
#### How to Launch an Automated Run from a Plan
|
|
101
|
-
|
|
102
|
-
Once your Automated Plan is created, you can start an automated run from the **'Plans'** page.
|
|
103
|
-
|
|
104
|
-
If you want to run tests automatically on a CI service:
|
|
105
|
-
|
|
106
|
-
1. Go to the **'Plans'** page
|
|
107
|
-
2. Open your Automated Plan
|
|
108
|
-
3. Click the **'Launch'** button → you will be redirected to the **Runs** page
|
|
109
|
-
4. A new run **'Run automated tests in CI'** will be triggered in the sidebar
|
|
110
|
-
|
|
111
|
-

|
|
112
|
-
|
|
113
|
-
:::note
|
|
114
|
-
|
|
115
|
-
The **'Launch'** button on the Plans page will **not be active** if Continuous Integration is not configured. Make sure CI is set up first. Learn more on the [Continuous Integration page](https://docs.testomat.io/usage/continuous-integration/).
|
|
116
|
-
|
|
117
|
-
:::
|
|
118
|
-
|
|
119
|
-
### Mixed Plans
|
|
120
|
-
|
|
121
|
-
**Mixed Plans** combine both manual and automated tests in a single plan.
|
|
122
|
-
|
|
123
|
-
They are typically used when you:
|
|
124
|
-
|
|
125
|
-
- Include automated tests that run via CI or via CLI
|
|
126
|
-
- Have other tests that still require manual execution
|
|
127
|
-
- Want a **single report** for the entire testing scope
|
|
128
|
-
|
|
129
|
-
With Mixed Plans:
|
|
130
|
-
|
|
131
|
-
- Both **manual and automated tests** can be added in the same plan
|
|
132
|
-
- Automated tests can be executed via CI or triggered via CLI
|
|
133
|
-
- Manual tests are executed manually
|
|
134
|
-
- Results from both test types are combined into a single run report
|
|
135
|
-
|
|
136
|
-
This makes Mixed Plans suitable for flexible or transitional testing strategies.
|
|
137
|
-
|
|
138
|
-
#### How to Launch a Mixed Run from a Plan
|
|
139
|
-
|
|
140
|
-
Once your Mixed Plan is created, you can start a run directly from the **'Plans'** page. When triggered:
|
|
141
|
-
|
|
142
|
-
1. Go to the **'Plans'** page
|
|
143
|
-
2. Open your Mixed Plan
|
|
144
|
-
3. Click the **'Launch'** button → you will be redirected to the **Runs** page
|
|
145
|
-
4. A new run **'New Mixed Run'** will be triggered in the sidebar
|
|
146
|
-
5. You can choose whether to **enable or disable CI build** for this run
|
|
147
|
-
|
|
148
|
-
:::note
|
|
149
|
-
|
|
150
|
-
The **'Launch'** button on the Plans page will **not be active** if Continuous Integration is not configured. Make sure CI is set up first. Learn more on the [Continuous Integration page](https://docs.testomat.io/usage/continuous-integration/).
|
|
151
|
-
|
|
152
|
-
:::
|
|
153
|
-
|
|
154
|
-

|
|
155
|
-
|
|
156
|
-
## How to Create a New Plan
|
|
157
|
-
|
|
158
|
-
This section explains how to create a Test Plan in Testomat.io and configure its basic settings. You can create a plan from different parts of the application, depending on your workflow.
|
|
159
|
-
|
|
160
|
-
### Ways to Create a Test Plan
|
|
161
|
-
|
|
162
|
-
There are two ways to create a Test Plan in Testomat.io:
|
|
163
|
-
|
|
164
|
-
1. **From the Plans page**
|
|
165
|
-
This is the standard way to create and manage plans. It is suitable for all plan types and is described in detail below.
|
|
166
|
-
|
|
167
|
-
2. **From the Runs page**
|
|
168
|
-
You can also create a plan directly while launching a run.
|
|
169
|
-
In this case:
|
|
170
|
-
- The plan creation settings are **identical** to creating a plan from the Plans page
|
|
171
|
-
- The newly created plan is **automatically pre-selected** for the current run
|
|
172
|
-
- This is the **only supported way** to create a plan during **Manual or Mixed run**
|
|
173
|
-
|
|
174
|
-

|
|
175
|
-
|
|
176
|
-
Regardless of where you start — from the **Plans** page or directly from the **Runs** page — the plan creation and configuration flow remains the same.
|
|
177
|
-
|
|
178
|
-
### Common Flow for All Plan Types (Including All Tests)
|
|
179
|
-
|
|
180
|
-
Before selecting test cases for any plan, the creation process follows the same initial steps for all plan types:
|
|
181
|
-
|
|
182
|
-
1. Go to the **'Plans'** page
|
|
183
|
-
2. Click the **'+ New plan'** dropdown
|
|
184
|
-
3. Choose one of the following options from the dropdown:
|
|
185
|
-
|
|
186
|
-
- **Manual**
|
|
187
|
-
- **Automated**
|
|
188
|
-
- **Mixed**
|
|
189
|
-
|
|
190
|
-

|
|
191
|
-
|
|
192
|
-
4. Enter a **Title** (required)
|
|
193
|
-
5. Add a **Description** (optional)
|
|
194
|
-
|
|
195
|
-
The description helps clarify the plan’s purpose, scope, and objectives. It can also be viewed later in the plan details or when inspecting Runs.
|
|
196
|
-
|
|
197
|
-
6. Enable the **'Run Automated as Manual'** toggle (optional)
|
|
198
|
-
7. Click the **'+ All tests'** button, then confirm
|
|
199
|
-
|
|
200
|
-
:::note
|
|
201
|
-
|
|
202
|
-
Clicking 'All tests' adds all tests to the collection and clears any other filters.
|
|
203
|
-
|
|
204
|
-
:::
|
|
205
|
-
|
|
206
|
-
8. Click the **'Save'** button
|
|
207
|
-
|
|
208
|
-

|
|
209
|
-
|
|
210
|
-
## How to Work with Test Collections
|
|
211
|
-
|
|
212
|
-
| Feature / Action | Description | Notes / Logic |
|
|
213
|
-
| ----------------------------- | ------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
|
|
214
|
-
| **Enable/Disable collection** | Toggle to show/hide tests in the collection | No restrictions |
|
|
215
|
-
| **Add filter** | Adds filters within a collection | **AND** logic is applied between filters inside a single collection. <br> Cannot add any filters in a collection where **Tests** are already selected <br> To use filters, apply different filters or create another collection |
|
|
216
|
-
| **Delete filters** | Removes filters from the collection | If the **last remaining filter** is removed while the collection toggle is enabled, <br> **all tests are included in the collection**.<br> Removing one of multiple filters works as expected |
|
|
217
|
-
| **All tests** | Includes all tests in the collection | All tests are included in the collection; removes any active filters |
|
|
218
|
-
| **Add collection** | Adds a new collection with its own filters | Allows combining different sets of filters across collections; **OR** logic applies between collections |
|
|
219
|
-
| **Delete collection** | Deletes the collection | Removes the collection along with all its filters. The first (default) collection cannot be deleted |
|
|
220
|
-
|
|
221
|
-
### Filter-based selection
|
|
222
|
-
|
|
223
|
-
Filters allow you to dynamically **include or exclude tests in a plan** based on metadata. Adding or removing tests via filters directly affects the plan, not just the collection.
|
|
224
|
-
|
|
225
|
-
**Include Tests by Filters**
|
|
226
|
-
|
|
227
|
-
- Adds tests to the collection **and the plan** that match any of the selected filters
|
|
228
|
-
- Supported filters for Include:
|
|
229
|
-
- Suites & folders
|
|
230
|
-
- Tags
|
|
231
|
-
- Priority
|
|
232
|
-
- Assignees
|
|
233
|
-
- Labels
|
|
234
|
-
- Custom labels
|
|
235
|
-
- Query
|
|
236
|
-
- Logic: **AND** within a collection, **OR** between collections
|
|
237
|
-
- All tests selected by the filters are displayed in the **Matched tests** tab
|
|
238
|
-
|
|
239
|
-
**Exclude Tests by Filters**
|
|
240
|
-
|
|
241
|
-
- Removes tests from the collection **and the plan** that match selected filters
|
|
242
|
-
- Supported filters for Exclude:
|
|
243
|
-
- Suites & folders
|
|
244
|
-
- Query
|
|
245
|
-
- Works in combination with **Include Tests by Filters**
|
|
246
|
-
- Logic: **AND** within a collection
|
|
247
|
-
|
|
248
|
-
:::note
|
|
249
|
-
|
|
250
|
-
**Tests** is a chosen mode, not a filter. It cannot be combined with **supported filters** in the same collection.
|
|
251
|
-
|
|
252
|
-
:::
|
|
253
|
-
|
|
254
|
-

|
|
255
|
-
|
|
256
|
-
## Managing Plans
|
|
257
|
-
|
|
258
|
-
Efficient management of test plans is key to keeping your testing organized and transparent. In Testomat.io, you can group and organize plans using **Labels**, making it easy to filter, find, and manage multiple plans at once.
|
|
259
|
-
|
|
260
|
-
### Benefits of Using Labels for Plans
|
|
261
|
-
|
|
262
|
-
By assigning labels to your plans, you can:
|
|
263
|
-
|
|
264
|
-
- Organize plans by category, team, or purpose – e.g., 'Regression', 'Smoke', 'QA'
|
|
265
|
-
- Filter plans quickly – instantly narrow down the list of plans by selecting specific labels
|
|
266
|
-
- Maintain consistency across projects – ensure all plans follow a structured labeling system
|
|
267
|
-
- Apply bulk actions easily – assign or remove labels from multiple plans at once using multi-selection
|
|
268
|
-
|
|
269
|
-
Labels provide a flexible way to group and manage plans according to your workflow.
|
|
270
|
-
|
|
271
|
-
### How to Assign Labels to Plans
|
|
272
|
-
|
|
273
|
-
1. Go to the **Plans** page
|
|
274
|
-
2. Open a plan or select multiple plans using multi-selection mode
|
|
275
|
-
3. Click the **Labels**
|
|
276
|
-
4. Select the labels you want to assign
|
|
277
|
-
5. Click **Add** button
|
|
278
|
-
|
|
279
|
-

|
|
280
|
-
|
|
281
|
-
:::note
|
|
282
|
-
|
|
283
|
-
You can create new labels or manage existing ones in [Settings → Labels & Fields](https://docs.testomat.io/advanced/tags-labels/labels-and-custom-fields/#how-to-add-labels--custom-fields). Make sure to set the Scope to Plans so labels are applied correctly.
|
|
284
|
-
|
|
285
|
-
:::
|
|
286
|
-
|
|
287
|
-
### Filtering Plans by Labels
|
|
288
|
-
|
|
289
|
-
Testomat.io offers two convenient ways to filter your plans using **labels**:
|
|
290
|
-
|
|
291
|
-
1. Using the **Filter Bar**:
|
|
292
|
-
|
|
293
|
-
- Click the **filter** icon next to the search bar
|
|
294
|
-
- Apply one or multiple labels
|
|
295
|
-
- This method allows multi-label filtering, showing only plans that match all selected labels
|
|
296
|
-
|
|
297
|
-

|
|
298
|
-
|
|
299
|
-
2. Using the **Quick Filter Panel**
|
|
300
|
-
|
|
301
|
-
- All labels currently in use are displayed
|
|
302
|
-
- Select a single label from this list to quickly filter plans
|
|
303
|
-
- This method is ideal for fast, one-label filtering
|
|
304
|
-
|
|
305
|
-

|
|
306
|
-
|
|
307
|
-
:::note
|
|
308
|
-
|
|
309
|
-
Use the **Filter Bar** for more advanced multi-label filtering, and the **Quick Filter Panel** for fast access to frequently used labels.
|
|
310
|
-
|
|
311
|
-
:::
|
|
312
|
-
|
|
313
|
-
### Tree View for Plans
|
|
314
|
-
|
|
315
|
-
Plans can be displayed in a hierarchical tree structure that mirrors the test organization. To switch to tree view, open a plan and click the tree view icon in the top right corner of the test list.
|
|
316
|
-
|
|
317
|
-
You can:
|
|
318
|
-
|
|
319
|
-
* Expand folders
|
|
320
|
-
* Collapse sections
|
|
321
|
-
* Navigate large test sets faster
|
|
322
|
-
* Focus on specific areas of a project
|
|
323
|
-
|
|
324
|
-
:::note
|
|
325
|
-
|
|
326
|
-
This is particularly useful for large projects containing hundreds or thousands of tests.
|
|
327
|
-
|
|
328
|
-
:::
|
|
329
|
-
|
|
330
|
-
### Example Use Cases
|
|
331
|
-
|
|
332
|
-
- QA lead wants to see only Regression plans – assign a 'Regression' label to all relevant plans and filter by it
|
|
333
|
-
- A team working on Frontend tests can quickly access all their plans by using the 'Frontend' label
|
|
334
|
-
- During release planning, project managers can filter plans by priority or milestone labels to focus on relevant test coverage
|
|
@@ -1,104 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: Pulse
|
|
3
|
-
description: Pulse in Testomat.io tracks all changes to tests, test suites, test plans, and test runs, providing transparency and control over project modifications. It tracks creation details, updates, and offers a history of changes. With its recovery feature, deleted items can be easily restored. The Bulk Restore option allows users to recover multiple deleted tests, suites, or plans simultaneously.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/project/pulse
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: keywords
|
|
10
|
-
content: Pulse, Testomat.io, test tracking, test suite monitoring, test plan tracking, test run tracking, version history, change tracking, test recovery, Bulk Restore, test management, suite restoration, plan monitoring
|
|
11
|
-
---
|
|
12
|
-
|
|
13
|
-
**Pulse** is a powerful feature in [Testomat.io](https://app.testomat.io) that brings full visibility, traceability, and control to your QA workflow. It tracks every change made within your projects — including **tests, suites, plans, and runs** — giving you a clear picture of how your testing assets evolve over time.
|
|
14
|
-
|
|
15
|
-
Pulse provides instant visibility into team activity and testing progress. This helps **QA Leads** and **Project Managers** stay informed without manually requesting status updates.
|
|
16
|
-
|
|
17
|
-
## What is Pulse
|
|
18
|
-
|
|
19
|
-
Pulse acts as your **project’s activity log** and **version history**, automatically recording all modifications across **tests, suites, plans, and runs**. It’s designed to ensure transparency, accountability, and easy recovery, so your team can work confidently knowing that every action is tracked and reversible.
|
|
20
|
-
|
|
21
|
-
Every action related to these entities is recorded, providing full visibility into how your testing assets evolve over time.
|
|
22
|
-
|
|
23
|
-
With Pulse, you can:
|
|
24
|
-
|
|
25
|
-
- See **who made a change**, **what was changed**, and **when** it happened.
|
|
26
|
-
- Review the history of edits, additions, or deletions for any test, suite, plan, or run.
|
|
27
|
-
- **Restore deleted items** or roll back to previous versions with a single click.
|
|
28
|
-
|
|
29
|
-
For **QA Engineers**, this means full control over versioned work. For **managers**, it offers a reliable audit trail and a clear view of project momentum over time.
|
|
30
|
-
|
|
31
|
-
This ensures you’ll never lose important test data or struggle to understand how your project has evolved — Pulse keeps your QA process transparent and your history intact.
|
|
32
|
-
|
|
33
|
-
## How Pulse Works
|
|
34
|
-
|
|
35
|
-
You can access Pulse directly from the **Pulse** tab in your Testomat.io project. There, you’ll find a chronological list of all activities recorded over the last **90 days**. Each entry contains detailed information about the change, including timestamps, item type, and the responsible team member.
|
|
36
|
-
|
|
37
|
-
Pulse allows you to track every action across your QA workflow, giving you a clear picture of how tests, suites, plans, and runs evolve over time.
|
|
38
|
-
|
|
39
|
-
### Activity Types
|
|
40
|
-
|
|
41
|
-
Activity tracking applies to all main QA entities in your project. For each entity, Pulse records **who performed the action** and **when it happened**:
|
|
42
|
-
|
|
43
|
-
- **Suite** — tracking full **CRUD** activity for suites, with versioned changes, before/after diffs, including title and description updates, attachment changes, bulk edits within a suite, and suite restore.
|
|
44
|
-
- **Test** — tracking full **CRUD** activity for tests, with versioned changes, before/after diffs, including title and description updates, attachment and priority changes, test state updates (manual, automated), and test restore.
|
|
45
|
-
- **Run** — tracking activity for runs, with versioned changes, before/after diffs, including manual or automatic purge, run restore, and permanent removal.
|
|
46
|
-
- **Plan** — tracking full **CRUD** activity for plans (manual, automated, mixed), with versioned changes, before/after diffs, including filter updates, included/excluded suites and tests, query changes, manual/automated state changes, and plan restore.
|
|
47
|
-
|
|
48
|
-
**QA Leads** can use this overview to identify active contributors, while **PMs** can quickly assess whether recent changes align with sprint goals or release timelines.
|
|
49
|
-
|
|
50
|
-
:::note
|
|
51
|
-
|
|
52
|
-
Every recorded event provides a clear snapshot of the change and supports **rollback functionality**, so you can revert to a previous version or recover deleted items when needed.
|
|
53
|
-
|
|
54
|
-
:::
|
|
55
|
-
|
|
56
|
-
## Filtering and Navigation
|
|
57
|
-
|
|
58
|
-
Pulse includes powerful filters to help you quickly find the information you need. You can narrow down activities based on:
|
|
59
|
-
|
|
60
|
-
- **Item Type** – filter logs by **Suite, Test, Run, or Plan**.
|
|
61
|
-
- **Date Range** – filter changes within a specific time window.
|
|
62
|
-
- **Changed By** – see actions performed by a particular user.
|
|
63
|
-
|
|
64
|
-

|
|
65
|
-
|
|
66
|
-
Each filter can be applied individually or in combination, enabling precise tracking of team activity and project evolution.
|
|
67
|
-
|
|
68
|
-

|
|
69
|
-
|
|
70
|
-
This makes it easy to monitor specific team members’ contributions or isolate changes from a given testing phase.
|
|
71
|
-
|
|
72
|
-
In addition to filters, Pulse provides activity tabs that allow you to switch between:
|
|
73
|
-
|
|
74
|
-
- **Created** — new tests, suites, or plans added to the project.
|
|
75
|
-
- **Changed** — updates to existing items.
|
|
76
|
-
- **Deleted** — items removed from the project, including tests, suites, plans, or runs.
|
|
77
|
-
|
|
78
|
-
These tabs instantly filter the activity feed by action type, making navigation faster and more intuitive.
|
|
79
|
-
|
|
80
|
-

|
|
81
|
-
|
|
82
|
-
## Diff
|
|
83
|
-
|
|
84
|
-
Pulse provides a Diff view for items with the **Changed** action. It allows you to compare different versions of the same item and clearly see what was modified between them.
|
|
85
|
-
|
|
86
|
-

|
|
87
|
-
|
|
88
|
-
## Bulk Restore
|
|
89
|
-
|
|
90
|
-
Bulk Restore is a great extension for Pulse. It is designed to save you time and effort by allowing you to restore multiple deleted tests and suites at once.
|
|
91
|
-
|
|
92
|
-
With Bulk Restore, you can:
|
|
93
|
-
|
|
94
|
-
- **Batch Restore:** Quickly and efficiently recover multiple deleted tests and suites at once, eliminating the need to restore each item individually.
|
|
95
|
-
|
|
96
|
-
- **Multi-Selection Mode:** Easily activate multi-select mode, choose the tests and suites you wish to restore, and bring them all back with a single action.
|
|
97
|
-
|
|
98
|
-

|
|
99
|
-
|
|
100
|
-
:::note
|
|
101
|
-
|
|
102
|
-
**Runs activity in Pulse** tracks all purge actions for transparency. Permanently deleted Runs cannot be restored. Full details: [Runs Activity Tracked in Pulse](https://docs.testomat.io/project/runs/managing-runs/#runs-activity-tracked-in-pulse).
|
|
103
|
-
|
|
104
|
-
:::
|