testeiya 0.2.1 → 0.3.9
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/LICENSE +21 -0
- package/README.md +41 -213
- package/dist/prompt/context.js +79 -0
- package/dist/prompt/context.js.map +1 -0
- package/dist/prompt/index.js +56 -0
- package/dist/prompt/index.js.map +1 -0
- package/dist/prompt/print.js +22 -0
- package/dist/prompt/print.js.map +1 -0
- package/dist/prompt/project-info.js +2 -0
- package/dist/prompt/project-info.js.map +1 -0
- package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +24 -21
- package/dist/prompt/system-prompt.js.map +1 -0
- package/dist/prompt/testomatio.js +264 -0
- package/dist/prompt/testomatio.js.map +1 -0
- package/dist/prompt/tools.js +49 -0
- package/dist/prompt/tools.js.map +1 -0
- package/dist/prompt/vocab.js +8 -0
- package/dist/prompt/vocab.js.map +1 -0
- package/dist/src/args.js +72 -0
- package/dist/src/args.js.map +1 -0
- package/dist/src/cli.js +61 -0
- package/dist/src/cli.js.map +1 -0
- package/dist/src/env.js +69 -0
- package/dist/src/env.js.map +1 -0
- package/dist/src/mcp-extension.js +9 -0
- package/dist/src/mcp-extension.js.map +1 -0
- package/dist/src/mcp.js +139 -0
- package/dist/src/mcp.js.map +1 -0
- package/dist/src/model.js +66 -0
- package/dist/src/model.js.map +1 -0
- package/dist/src/result.js +41 -0
- package/dist/src/result.js.map +1 -0
- package/dist/src/run.js +199 -0
- package/dist/src/run.js.map +1 -0
- package/dist/src/session.js +77 -0
- package/dist/src/session.js.map +1 -0
- package/dist/vendor/mcp.js +14801 -0
- package/mcp-tools.json +2967 -0
- package/package.json +29 -42
- package/prompt/context.ts +101 -0
- package/prompt/index.ts +93 -0
- package/prompt/print.ts +23 -0
- package/prompt/project-info.ts +30 -0
- package/prompt/system-prompt.ts +173 -0
- package/{src/prompt → prompt}/testomatio.ts +119 -8
- package/{src/prompt → prompt}/tools.ts +30 -8
- package/prompt/vocab.ts +7 -0
- package/{skills.lock.json → skills/skills.lock.json} +11 -7
- package/skills/skills.yaml +34 -0
- package/assets/testeiya-logo-dark.svg +0 -16
- package/assets/testeiya-logo.svg +0 -15
- package/models.catalog.json +0 -6963
- package/skills/codeceptjs/ci-fix-tests/SKILL.md +0 -120
- package/skills/codeceptjs/codeceptjs-auth/SKILL.md +0 -158
- package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +0 -91
- package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +0 -158
- package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +0 -90
- package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +0 -234
- package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +0 -110
- package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +0 -306
- package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +0 -352
- package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +0 -472
- package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +0 -350
- package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +0 -81
- package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +0 -206
- package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
- package/skills/playwright-best-practices-skill/README.md +0 -147
- package/skills/playwright-best-practices-skill/SKILL.md +0 -303
- package/skills/playwright-best-practices-skill/advanced/authentication-flows.md +0 -360
- package/skills/playwright-best-practices-skill/advanced/authentication.md +0 -871
- package/skills/playwright-best-practices-skill/advanced/clock-mocking.md +0 -364
- package/skills/playwright-best-practices-skill/advanced/mobile-testing.md +0 -409
- package/skills/playwright-best-practices-skill/advanced/multi-context.md +0 -288
- package/skills/playwright-best-practices-skill/advanced/multi-user.md +0 -393
- package/skills/playwright-best-practices-skill/advanced/network-advanced.md +0 -452
- package/skills/playwright-best-practices-skill/advanced/third-party.md +0 -464
- package/skills/playwright-best-practices-skill/architecture/pom-vs-fixtures.md +0 -363
- package/skills/playwright-best-practices-skill/architecture/test-architecture.md +0 -369
- package/skills/playwright-best-practices-skill/architecture/when-to-mock.md +0 -383
- package/skills/playwright-best-practices-skill/browser-apis/browser-apis.md +0 -391
- package/skills/playwright-best-practices-skill/browser-apis/iframes.md +0 -403
- package/skills/playwright-best-practices-skill/browser-apis/service-workers.md +0 -504
- package/skills/playwright-best-practices-skill/browser-apis/websockets.md +0 -403
- package/skills/playwright-best-practices-skill/core/annotations.md +0 -424
- package/skills/playwright-best-practices-skill/core/assertions-waiting.md +0 -361
- package/skills/playwright-best-practices-skill/core/configuration.md +0 -452
- package/skills/playwright-best-practices-skill/core/fixtures-hooks.md +0 -417
- package/skills/playwright-best-practices-skill/core/global-setup.md +0 -434
- package/skills/playwright-best-practices-skill/core/locators.md +0 -242
- package/skills/playwright-best-practices-skill/core/page-object-model.md +0 -315
- package/skills/playwright-best-practices-skill/core/projects-dependencies.md +0 -453
- package/skills/playwright-best-practices-skill/core/test-data.md +0 -492
- package/skills/playwright-best-practices-skill/core/test-suite-structure.md +0 -361
- package/skills/playwright-best-practices-skill/core/test-tags.md +0 -298
- package/skills/playwright-best-practices-skill/debugging/console-errors.md +0 -420
- package/skills/playwright-best-practices-skill/debugging/debugging.md +0 -504
- package/skills/playwright-best-practices-skill/debugging/error-testing.md +0 -360
- package/skills/playwright-best-practices-skill/debugging/flaky-tests.md +0 -496
- package/skills/playwright-best-practices-skill/frameworks/angular.md +0 -530
- package/skills/playwright-best-practices-skill/frameworks/nextjs.md +0 -469
- package/skills/playwright-best-practices-skill/frameworks/react.md +0 -531
- package/skills/playwright-best-practices-skill/frameworks/vue.md +0 -574
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/ci-cd.md +0 -468
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/docker.md +0 -283
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/github-actions.md +0 -546
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/gitlab.md +0 -397
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/other-providers.md +0 -521
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/parallel-sharding.md +0 -371
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/performance.md +0 -453
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/reporting.md +0 -424
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/test-coverage.md +0 -497
- package/skills/playwright-best-practices-skill/testing-patterns/accessibility.md +0 -359
- package/skills/playwright-best-practices-skill/testing-patterns/api-testing.md +0 -719
- package/skills/playwright-best-practices-skill/testing-patterns/browser-extensions.md +0 -506
- package/skills/playwright-best-practices-skill/testing-patterns/canvas-webgl.md +0 -493
- package/skills/playwright-best-practices-skill/testing-patterns/component-testing.md +0 -500
- package/skills/playwright-best-practices-skill/testing-patterns/drag-drop.md +0 -576
- package/skills/playwright-best-practices-skill/testing-patterns/electron.md +0 -509
- package/skills/playwright-best-practices-skill/testing-patterns/file-operations.md +0 -377
- package/skills/playwright-best-practices-skill/testing-patterns/file-upload-download.md +0 -562
- package/skills/playwright-best-practices-skill/testing-patterns/forms-validation.md +0 -561
- package/skills/playwright-best-practices-skill/testing-patterns/graphql-testing.md +0 -331
- package/skills/playwright-best-practices-skill/testing-patterns/i18n.md +0 -508
- package/skills/playwright-best-practices-skill/testing-patterns/performance-testing.md +0 -476
- package/skills/playwright-best-practices-skill/testing-patterns/security-testing.md +0 -430
- package/skills/playwright-best-practices-skill/testing-patterns/visual-regression.md +0 -634
- package/skills/playwright-cli/SKILL.md +0 -420
- package/skills/playwright-cli/references/element-attributes.md +0 -23
- package/skills/playwright-cli/references/playwright-tests.md +0 -39
- package/skills/playwright-cli/references/request-mocking.md +0 -87
- package/skills/playwright-cli/references/running-code.md +0 -241
- package/skills/playwright-cli/references/session-management.md +0 -225
- package/skills/playwright-cli/references/storage-state.md +0 -275
- package/skills/playwright-cli/references/test-generation.md +0 -433
- package/skills/playwright-cli/references/tracing.md +0 -139
- package/skills/playwright-cli/references/video-recording.md +0 -143
- package/skills/testeiya/README.md +0 -29
- package/skills/testeiya/answer-formatting/SKILL.md +0 -30
- package/skills/testeiya/check-cucumber/SKILL.md +0 -200
- package/skills/testeiya/check-tests/SKILL.md +0 -260
- package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
- package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
- package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
- package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
- package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
- package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
- package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
- package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
- package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
- package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
- package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
- package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
- package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
- package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
- package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
- package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
- package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
- package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
- package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
- package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
- package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
- package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
- package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
- package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
- package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
- package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
- package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
- package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
- package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
- package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
- package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
- package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
- package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
- package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
- package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
- package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
- package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
- package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
- package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
- package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
- package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
- package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
- package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
- package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
- package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
- package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
- package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
- package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
- package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
- package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
- package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
- package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
- package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
- package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
- package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
- package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
- package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
- package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
- package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
- package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
- package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +0 -88
- package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +0 -95
- package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +0 -334
- package/skills/testomatio/test-automation/automate-manual-test-cases/CLAUDE.md +0 -56
- package/skills/testomatio/test-automation/automate-manual-test-cases/SKILL.md +0 -242
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/CODECEPTJS_BEST_PRACTICES.md +0 -182
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/FINAL_SUMMARY_TEMPLATE.md +0 -22
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/PLAYWRIGHT_BEST_PRACTICES.md +0 -90
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/POM_BEST_PRACTICES.md +0 -53
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/TEST_DATA_MANAGEMENT.md +0 -52
- package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/SKILL.md +0 -107
- package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/references/DEBUGGING_QUICK_REFERENCE.md +0 -113
- package/skills/testomatio/test-automation/qa-automation-test-consolidation/SKILL.md +0 -29
- package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +0 -151
- package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
- package/skills/testomatio/test-automation/testomat-allure-adapter/SKILL.md +0 -289
- package/skills/testomatio/test-management/detect-duplicate-test-cases/SKILL.md +0 -86
- package/skills/testomatio/test-management/detect-duplicate-test-cases/references/DUPLICATE_INSTRUCTIONS.md +0 -54
- package/skills/testomatio/test-management/improve-test-cases/SKILL.md +0 -114
- package/skills/testomatio/test-management/improve-test-cases/references/TESTOMAT_MARKDOWN_EXAMPLE.md +0 -66
- package/skills/testomatio/test-management/pull-request-diff-analyzer/SKILL.md +0 -141
- package/skills/testomatio/test-management/qa-e2e-tests-reporting/SKILL.md +0 -354
- package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_ARTIFACTS.md +0 -82
- package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_HTML_REPORT.md +0 -37
- package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_REPORTERS_CONFIG.md +0 -118
- package/skills/testomatio/test-management/qa-pr-requirements-analyzer/SKILL.md +0 -149
- package/skills/testomatio/test-management/qa-pr-requirements-analyzer/references/summary-example.md +0 -54
- package/skills/testomatio/test-management/qa-requirement-reviewer/SKILL.md +0 -126
- package/skills/testomatio/test-management/qa-requirement-reviewer/references/requirements_reviewer_examples.md +0 -128
- package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +0 -174
- package/skills/testomatio/test-management/qa-test-code-coverage/references/COVERAGE_FILE_FORMAT.md +0 -138
- package/skills/testomatio/test-management/qa-test-code-coverage/references/E2E_FRAMEWORKS.md +0 -65
- package/skills/testomatio/test-management/qa-test-code-coverage/scripts/check-coverage.mjs +0 -40
- package/skills/testomatio/test-management/qa-thinking/SKILL.md +0 -36
- package/skills/testomatio/test-management/qa-write-test-cases/SKILL.md +0 -267
- package/skills/testomatio/test-management/qa-write-test-cases/references/test-case-format.md +0 -387
- package/skills/testomatio/test-management/qa-write-test-cases/references/testomat-tms-guide.md +0 -72
- package/skills/testomatio/test-management/qa-write-test-cases/references/writing-rule.md +0 -159
- package/skills/testomatio/test-management/scan-automation-project/SKILL.md +0 -152
- package/skills/testomatio/test-management/sync-test-cases-with-tms/SKILL.md +0 -107
- package/skills/testomatio/test-management/sync-test-cases-with-tms/references/TESTOMATIO_CLI.md +0 -140
- package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +0 -182
- package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +0 -169
- package/skills.yaml +0 -21
- package/src/ai-debug.ts +0 -188
- package/src/api/agent-get.ts +0 -22
- package/src/api/agent-start.ts +0 -384
- package/src/api/client-log.ts +0 -29
- package/src/api/context.ts +0 -332
- package/src/api/debug-layout.ts +0 -47
- package/src/api/debug-report.ts +0 -29
- package/src/api/debug-snapshot.ts +0 -30
- package/src/api/debug-stream.ts +0 -52
- package/src/api/files-delete.ts +0 -184
- package/src/api/files-read.ts +0 -41
- package/src/api/files-rename.ts +0 -99
- package/src/api/files-tree.ts +0 -292
- package/src/api/files-write.ts +0 -41
- package/src/api/mcp.ts +0 -603
- package/src/api/memory.ts +0 -69
- package/src/api/open-external.ts +0 -39
- package/src/api/playwright-cli.ts +0 -606
- package/src/api/providers.ts +0 -457
- package/src/api/read-env-token.ts +0 -33
- package/src/api/sessions.ts +0 -79
- package/src/api/settings.ts +0 -120
- package/src/api/skills.ts +0 -58
- package/src/api/testomatio-attachment.ts +0 -89
- package/src/api/testomatio-auth.ts +0 -284
- package/src/api/testomatio-proxy.ts +0 -197
- package/src/api/testomatio-run-stats.ts +0 -81
- package/src/api/testomatio-target.ts +0 -225
- package/src/api/testomatio-transcription.ts +0 -82
- package/src/api/workspace-search.ts +0 -96
- package/src/api/workspace-sync.ts +0 -151
- package/src/api/workspace.ts +0 -165
- package/src/app-server.ts +0 -556
- package/src/bridge.ts +0 -251
- package/src/check-tests.ts +0 -156
- package/src/cli.ts +0 -17
- package/src/commands.ts +0 -244
- package/src/config.ts +0 -183
- package/src/connection.ts +0 -658
- package/src/context-store.ts +0 -265
- package/src/debug-bus.ts +0 -405
- package/src/extensions/tool-gate.ts +0 -220
- package/src/extensions/webui/ask-channel.ts +0 -52
- package/src/extensions/webui/index.ts +0 -184
- package/src/extensions/webui/tools/ask-question.ts +0 -88
- package/src/extensions/webui/tools/query-result.ts +0 -79
- package/src/extensions/webui/tools/render-chart.ts +0 -53
- package/src/extensions/webui/tools/render-item.ts +0 -61
- package/src/extensions/webui/tools/render-list.ts +0 -170
- package/src/extensions/webui/tools/render-result.ts +0 -85
- package/src/extensions/webui/tools/render-tree.ts +0 -71
- package/src/extensions/webui/tools/ui-widget.ts +0 -54
- package/src/extensions/webui/tools/widget-result.ts +0 -13
- package/src/extensions/webui/widget-channel.ts +0 -50
- package/src/file-log.ts +0 -196
- package/src/git-tracked.ts +0 -68
- package/src/gitignore.ts +0 -53
- package/src/json-store.ts +0 -43
- package/src/load-env.ts +0 -70
- package/src/loader-style.ts +0 -96
- package/src/main.ts +0 -140
- package/src/mcp-catalog.ts +0 -96
- package/src/models-catalog.ts +0 -72
- package/src/permissions.ts +0 -120
- package/src/project-dir.ts +0 -189
- package/src/project-info.ts +0 -108
- package/src/prompt/app-ui.ts +0 -59
- package/src/prompt/browser.ts +0 -27
- package/src/prompt/index.ts +0 -62
- package/src/server-info.ts +0 -62
- package/src/session-factory.ts +0 -442
- package/src/session-store.ts +0 -115
- package/src/shell-env.ts +0 -45
- package/src/skills.ts +0 -163
- package/src/sync-snapshot.ts +0 -140
- package/src/telemetry.ts +0 -239
- package/src/testomatio-auth.ts +0 -299
- package/src/testomatio.ts +0 -98
- package/src/theme.ts +0 -30
- package/src/user-env.ts +0 -94
- package/src/welcome.ts +0 -194
- package/src/workspace/safe-path.ts +0 -85
- package/src/workspace/test-md.ts +0 -70
- package/src/workspace-model.ts +0 -440
- package/testeiya.config.json +0 -14
|
@@ -1,98 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: Jira Plugin
|
|
3
|
-
description: Learn how to integrate Testomat.io with Jira using the Jira plugin. This guide covers connecting projects, linking/unlinking tests, suites, and plans to Jira issues, running manual or automated tests, managing BDD feature files, attaching test reports, using AI prompts to improve test descriptions, and leveraging the traceability matrix for comprehensive coverage in sprints.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/advanced/jira-plugin
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: keywords
|
|
10
|
-
content: Jira plugin, Testomat.io, test management, test coverage, BDD, feature files, automated tests, manual tests, Jira integration, traceability matrix, test reporting, AI test descriptions, SSO login
|
|
11
|
-
---
|
|
12
|
-
|
|
13
|
-
import DirectoryLinks from "/src/components/DirectoryLinks.astro";
|
|
14
|
-
|
|
15
|
-
<DirectoryLinks directory="advanced/jira-plugin" />
|
|
16
|
-
|
|
17
|
-
The Testomat.io Jira Plugin enhances your Jira experience by enabling you to manage tests directly inside Jira. With this plugin you can:
|
|
18
|
-
|
|
19
|
-
- Connect multiple Testomat.io and JIRA projects easily
|
|
20
|
-
- Quickly link/unlink tests, suites, and plans to JIRA issues
|
|
21
|
-
- View and edit tests directly in JIRA
|
|
22
|
-
- Use autocomplete and smart suggestions for creating tests
|
|
23
|
-
- Easily modify BDD/Gherkin feature files and scenarios
|
|
24
|
-
- Create multiple tests at once from checklists from bulk create
|
|
25
|
-
- Run manual and automated tests from JIRA tickets
|
|
26
|
-
- Attach test reports to JIRA issues with a click
|
|
27
|
-
- Use tracebility matrix and reports to check test coverage in sprints and project
|
|
28
|
-
- Manage project branches
|
|
29
|
-
- Use AI prompts to generate or improve test descriptions directly in Jira
|
|
30
|
-
|
|
31
|
-
:::note
|
|
32
|
-
|
|
33
|
-
Jira Plugin requires an active Jira integration in your Testomat.io project. If Jira is not connected yet, please follow [How to Connect Jira Project](https://docs.testomat.io/integrations/issues-management/jira/#connecting-to-jira-project).
|
|
34
|
-
|
|
35
|
-

|
|
36
|
-
|
|
37
|
-
:::
|
|
38
|
-
|
|
39
|
-
## How to Use Jira Plugin Without Logging in
|
|
40
|
-
|
|
41
|
-
When you open a Jira issue with linked Testomat.io items **without logging in**, the visibility depends on the type of **Jira connection** used. For full details on connection types and their permissions, see [Jira connection type](https://docs.testomat.io/integrations/issues-management/jira/#jira-connection-types).
|
|
42
|
-
|
|
43
|
-

|
|
44
|
-
|
|
45
|
-
**Connected with an administrator's account**
|
|
46
|
-
|
|
47
|
-
You can still:
|
|
48
|
-
|
|
49
|
-
- View **tests and suites** linked to the issue
|
|
50
|
-
|
|
51
|
-

|
|
52
|
-
|
|
53
|
-
- Browse the **Tests Coverage** screen
|
|
54
|
-
|
|
55
|
-

|
|
56
|
-
|
|
57
|
-
**Connected with a regular account**
|
|
58
|
-
|
|
59
|
-
- only authorized Testomat.io users will be able to see tests and run results in Jira
|
|
60
|
-
|
|
61
|
-
## How to Log in to Testomat.io from Jira
|
|
62
|
-
|
|
63
|
-
-To access all Jira Plugin features, you need to log in to Testomat.io. You can log in directly from:
|
|
64
|
-
|
|
65
|
-
- a Jira issue
|
|
66
|
-
|
|
67
|
-

|
|
68
|
-
|
|
69
|
-
- or you can do this from Apps
|
|
70
|
-
|
|
71
|
-

|
|
72
|
-
|
|
73
|
-
### Login Options
|
|
74
|
-
|
|
75
|
-
You can authorize using any of the following methods:
|
|
76
|
-
|
|
77
|
-
- **Email + Password** — enter your Testomat.io credentials and click **Submit**
|
|
78
|
-
- **Authorize with GitHub** — sign in with your GitHub account
|
|
79
|
-
- **Authorize with Google** — sign in with your Google account
|
|
80
|
-
- **Authorize with SSO** — use your company’s Single Sign-On provider
|
|
81
|
-
|
|
82
|
-
### What you can do after logging in
|
|
83
|
-
|
|
84
|
-
Once logged in, you can:
|
|
85
|
-
|
|
86
|
-
- view linked tests and suites
|
|
87
|
-
- edit them directly in Jira
|
|
88
|
-
- unlink items when needed
|
|
89
|
-
- use AI prompts to enhance test descriptions:
|
|
90
|
-
- Suggest Description – generate a clear and concise description for a test based on its title and similar tests
|
|
91
|
-
- Improve Description – refine the existing description to make it clearer
|
|
92
|
-
- Suggest Better Description – provide an alternative improved description
|
|
93
|
-
|
|
94
|
-

|
|
95
|
-
|
|
96
|
-
## JIRA Plugin Permissions and Security
|
|
97
|
-
|
|
98
|
-
Testomat.io’s JIRA plugin is designed to integrate seamlessly with your JIRA projects, requiring specific permissions to operate effectively. The plugin has **read access** to all issues of an enabled project to display tests that can be attached to any JIRA issue and can **write properties** to save test data into JIRA storage attached to a specific issue. Importantly, Testomat.io **does not perform any update or delete operations** on your JIRA issues, maintaining the integrity of your project data. The plugin accesses several JIRA API endpoints strictly necessary for its functionality, adhering to high standards of data security and integrity. For detailed information on permissions and security, refer to the [JIRA Permissions](https://docs.testomat.io/legal/security/jira) section in our documentation.
|
|
@@ -1,151 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: Creating Jira Issue
|
|
3
|
-
description: Learn how to integrate Testomat.io with Jira using the Jira plugin. This guide covers connecting Testomat.io projects to Jira, linking/unlinking tests, suites, and test plans to Jira issues, and running manual or automated tests directly from Jira. Manage BDD feature files, attach test reports, and utilize the traceability matrix for comprehensive test coverage in sprints.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/advanced/jira-plugin/jira-issue
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: og:image
|
|
10
|
-
content: https://docs.testomat.io/_astro/New_8rxMYOhd_2024-10-19.BaU2EWny_Z1oTGPz.webp
|
|
11
|
-
- tag: meta
|
|
12
|
-
attrs:
|
|
13
|
-
name: keywords
|
|
14
|
-
content: Jira plugin, Testomat.io, test management, test coverage, BDD, feature files, automated tests, manual tests, Jira integration, traceability matrix, test reporting
|
|
15
|
-
---
|
|
16
|
-
|
|
17
|
-
**Jira integration in Testomat.io** helps QA teams quickly turn test results into actionable bug reports. This feature eliminates the manual effort of copying failed test data into Jira and ensures full traceability between test execution and defect tracking.
|
|
18
|
-
|
|
19
|
-
With a few clicks, you can:
|
|
20
|
-
|
|
21
|
-
- **Create a Jira issue** directly from a failed test or run
|
|
22
|
-
- **Link existing Jira issues** to tests or suites
|
|
23
|
-
- **Attach contextual details** (test steps, results, environment, and run links) automatically
|
|
24
|
-
|
|
25
|
-
This integration was designed to improve collaboration between **QA, development, and management teams**, speeding up feedback loops and ensuring visibility across all project stakeholders.
|
|
26
|
-
|
|
27
|
-
## How to Create a Jira Issue for a Failed Test
|
|
28
|
-
|
|
29
|
-
To create a JIRA issue for a Failed Test, open a Run with a failed test. Find a test in list, move the cursor over it and click on the **Link to Issue** icon:
|
|
30
|
-
|
|
31
|
-

|
|
32
|
-
|
|
33
|
-
You can link it to an existing issue **(1)** or create a new one **(2)**.
|
|
34
|
-
|
|
35
|
-
Once you have decided to create an issue in your Jira project, you can select its ticket types **(3)**.
|
|
36
|
-
|
|
37
|
-

|
|
38
|
-
|
|
39
|
-
You can even create an issue as a subtask by **specifying a Parent ticket**:
|
|
40
|
-
|
|
41
|
-

|
|
42
|
-
|
|
43
|
-
- Once created, the linked issue appears under the test run, indicated by the **issue icon**
|
|
44
|
-
- Hovering over the icon shows the **issue title** and **current status**
|
|
45
|
-
- Clicking the icon redirects to the issue in Jira
|
|
46
|
-
- This icon remains visible both during test execution
|
|
47
|
-
|
|
48
|
-

|
|
49
|
-
|
|
50
|
-
- and after the run is completed, making it easy to track related issues at a glance
|
|
51
|
-
|
|
52
|
-

|
|
53
|
-
|
|
54
|
-
The generated ticket will contain the specified information, as well as information about the test run and a web link to the test run report:
|
|
55
|
-
|
|
56
|
-

|
|
57
|
-
|
|
58
|
-
## How to Create a Jira Issue for a Failed Run
|
|
59
|
-
|
|
60
|
-
To create a JIRA issue for a Failed Manual or Automated Run, open the run and select the **Link to Issue** option from the dots menu:
|
|
61
|
-
|
|
62
|
-

|
|
63
|
-
|
|
64
|
-
Create a new issue for a run or append to an existing issue.
|
|
65
|
-
|
|
66
|
-

|
|
67
|
-
|
|
68
|
-
- Once created, the linked issue appears **under the completed run**, indicated by the **issue icon** in the run’s sidebar
|
|
69
|
-
- Hovering over the icon displays the **issue title** and **current status**
|
|
70
|
-
- Clicking the icon redirects directly to the issue in the Jira project
|
|
71
|
-
|
|
72
|
-

|
|
73
|
-
|
|
74
|
-
## How to Link a Test to a Jira Issue
|
|
75
|
-
|
|
76
|
-
You can easily connect any individual **test** in Testomat.io to an existing or new Jira issue. This allows quick traceability between your test cases and related Jira tickets.
|
|
77
|
-
|
|
78
|
-
1. Navigate to the **Tests** page in your Testomat.io project
|
|
79
|
-
2. Open the test you want to link
|
|
80
|
-
3. Click the **extra menu (⋯)** button in the top-right corner
|
|
81
|
-
4. Select **Link to Issue**
|
|
82
|
-
|
|
83
|
-

|
|
84
|
-
|
|
85
|
-
Once the **Link to Issue** modal window appears:
|
|
86
|
-
|
|
87
|
-
5. To **link to an existing Jira issue**, paste or enter the issue key and click **Link Issue**
|
|
88
|
-
6. To **create a new Jira issue**, click **Create new issue**
|
|
89
|
-
|
|
90
|
-

|
|
91
|
-
|
|
92
|
-
7. Select your **Jira profile** (see details: [Connecting Jira Integration](https://docs.testomat.io/integrations/issues-management/jira/)).
|
|
93
|
-
8. Choose the **Issue Type** from the dropdown (e.g., Bug, Task, Sub-task)
|
|
94
|
-
9. Add a **Title**
|
|
95
|
-
10. Optionally, include a **Description** to provide test context
|
|
96
|
-
11. Fill in any **Jira fields** available in your configuration.
|
|
97
|
-
|
|
98
|
-
Testomat.io automatically displays all supported fields — such as **Parent**, **Components**, **Fix versions**, **Priority**, **Labels**, or other custom fields defined in your Jira project.
|
|
99
|
-
|
|
100
|
-
These may appear immediately or after clicking **Show Optional Fields**, depending on your project setup.
|
|
101
|
-
|
|
102
|
-
:::note
|
|
103
|
-
|
|
104
|
-
The available fields depend on your Jira project configuration. To see all supported field types in Testomat.io, refer to [Supported Jira Field Types](https://docs.testomat.io/integrations/issues-management/jira/#supported-jira-field-types).
|
|
105
|
-
|
|
106
|
-
:::
|
|
107
|
-
|
|
108
|
-
12. Once all required information is filled in, click **Create Jira Issue** to finish linking.
|
|
109
|
-
|
|
110
|
-

|
|
111
|
-
|
|
112
|
-
The linked issue appears under the test, indicated by the **issue icon**, which redirects to the issue in the Jira project. In addition, Testomat.io also displays the linked Jira issue’s **title** and **status**, making it easier to recognize the issue at a glance.
|
|
113
|
-
|
|
114
|
-

|
|
115
|
-
|
|
116
|
-
:::note
|
|
117
|
-
|
|
118
|
-
You can link a test to multiple issues. In this case their IDs will be displayed in test view in Testomatio.
|
|
119
|
-
|
|
120
|
-
:::
|
|
121
|
-
|
|
122
|
-

|
|
123
|
-
|
|
124
|
-
## How to Link a Suite to a Jira Issue
|
|
125
|
-
|
|
126
|
-
Linking a suite to a Jira issue works similarly to linking an individual test, with one key difference: **all tests within the suite will automatically be linked to the Jira issue.**
|
|
127
|
-
|
|
128
|
-
:::note
|
|
129
|
-
|
|
130
|
-
Linking is available only at the **suite level**. You cannot link a Jira issue to a folder, and the **Link to Issue** button does not appear on folder level.
|
|
131
|
-
|
|
132
|
-
:::
|
|
133
|
-
|
|
134
|
-
1. Navigate to the **Tests** page in your Testomat.io project
|
|
135
|
-
2. Open the suite you want to link
|
|
136
|
-
3. Click the **extra menu (⋯)** button in the top-right corner
|
|
137
|
-
4. Select **Link to Issue**
|
|
138
|
-
|
|
139
|
-

|
|
140
|
-
|
|
141
|
-
Follow the same steps above as linking a single test: link an existing issue or create a new one, select issue type, fill required fields, and click Create Jira Issue.
|
|
142
|
-
|
|
143
|
-
When a suite is linked, both the suite and all its tests will display the linked Jira issue icon along with its title and status, providing immediate context.
|
|
144
|
-
|
|
145
|
-

|
|
146
|
-
|
|
147
|
-
:::note
|
|
148
|
-
|
|
149
|
-
If you unlink a suite from a Jira issue, all its linked tests will be unlinked automatically.
|
|
150
|
-
|
|
151
|
-
:::
|
|
@@ -1,377 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: Runs & Reports in Jira
|
|
3
|
-
description: Learn how to run manual, automated, or mixed test executions in Jira using the Testomat.io plugin. This guide covers configuring advanced settings, executing test runs.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/advanced/jira-plugin/runs-and-reports
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: keywords
|
|
10
|
-
content: Jira plugin, Testomat.io, test runs, test plan, test execution, manual run, mixed run, automated run, CI/CD, test reports, test analytics
|
|
11
|
-
---
|
|
12
|
-
|
|
13
|
-
With the **Testomat.io plugin in Jira**, your team can efficiently execute and manage test runs directly from Jira. Launch manual, automated, or mixed tests, configure environments and assignees, group related runs, and get a clear overview of all test executions with their current statuses. This integration keeps QA, development, and management aligned, providing full visibility into testing workflows without leaving Jira.
|
|
14
|
-
|
|
15
|
-
This page explains how to:
|
|
16
|
-
|
|
17
|
-
- Launch **Manual**, **Mixed**, or **Automated in CI/CD** runs from Jira issues or linked test plans
|
|
18
|
-
- Configure **Advanced Settings** such as environment, assignee (email), RunGroup, CI profiles, and custom parameters
|
|
19
|
-
- Track execution progress and view the current status of each run directly in Jira
|
|
20
|
-
- Receive **Report Notifications** in Jira for failed test runs, with automatically created issues containing detailed run results and optional public report links
|
|
21
|
-
|
|
22
|
-
## Run Flow
|
|
23
|
-
|
|
24
|
-
Testomat.io supports three types of test executions **directly in Jira**:
|
|
25
|
-
|
|
26
|
-
- **Manual Run** - execute tests manually
|
|
27
|
-
- **Automated Run (CI/CD)** - execute automated tests via connected CI service
|
|
28
|
-
- **Mixed Run** - run a combination of manual and automated tests in a single execution
|
|
29
|
-
|
|
30
|
-
Choose the type of run that fits your workflow and follow the detailed steps below to execute tests directly in Jira.
|
|
31
|
-
|
|
32
|
-
### How to Launch a Manual Run
|
|
33
|
-
|
|
34
|
-
Use Manual Run in Jira to execute tests step-by-step directly from the Jira issue. Ideal for fully manual test cases, exploratory testing, or verifying features not yet automated. You can launch a Manual Run in Jira in three different ways:
|
|
35
|
-
|
|
36
|
-
**Option 1** – From the '...' Menu on the **Tests** Tab
|
|
37
|
-
|
|
38
|
-
1. Navigate to the **Tests** tab
|
|
39
|
-
2. Click the '...' (extra menu) button on the **Tests** tab
|
|
40
|
-
3. Select **Schedule Run** from the dropdown list
|
|
41
|
-
|
|
42
|
-

|
|
43
|
-
|
|
44
|
-
4. In the **'Select tests to run'** dialog, choose the tests you want to include
|
|
45
|
-
5. (Optional) Enable **Run as Checklist** toggle - if enabled, marks tests to be executed as checklist
|
|
46
|
-
6. (Optional) Enable **Run Automated as Manual** toggle - if enabled, allows automated tests to be executed manually
|
|
47
|
-
|
|
48
|
-

|
|
49
|
-
|
|
50
|
-
7. (Optional) Open the **Advanced settings** to select:
|
|
51
|
-
|
|
52
|
-
- **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
|
|
53
|
-
- **Assign user** – select the **email of the user added to the project** who is responsible for this run
|
|
54
|
-
- **RunGroup** – optional grouping of related runs for easier tracking and reporting
|
|
55
|
-
- **Title** - provide a descriptive title for the run
|
|
56
|
-
|
|
57
|
-
8. Click **'Create Run'** to start execution
|
|
58
|
-
|
|
59
|
-

|
|
60
|
-
|
|
61
|
-
9. Mark all tests with specific status (e.g., ✔ passed / ✖ failed / ➖ skipped)
|
|
62
|
-
10. Click the **Finish Run** button
|
|
63
|
-
|
|
64
|
-

|
|
65
|
-
|
|
66
|
-
**Option 2** – Using the 'Run' Button on the **Tests** Tab
|
|
67
|
-
|
|
68
|
-
1. Navigate to the **Tests** tab
|
|
69
|
-
2. Click the '✔ Run' button
|
|
70
|
-
3. In the **'Select tests to run'** dialog, choose the tests you want to include
|
|
71
|
-
4. (Optional) Enable **Run as Checklist** toggle - if enabled, marks tests to be executed as checklist
|
|
72
|
-
5. (Optional) Enable **Run Automated as Manual** toggle - if enabled, allows automated tests to be executed manually
|
|
73
|
-
|
|
74
|
-

|
|
75
|
-
|
|
76
|
-
6. (Optional) Use **Advanced settings** to select:
|
|
77
|
-
|
|
78
|
-
- **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
|
|
79
|
-
- **Assign user** – select the **email of the user added to the project** who is responsible for this run
|
|
80
|
-
- **RunGroup** – optional grouping of related runs for easier tracking and reporting
|
|
81
|
-
- **Title** - provide a descriptive title for the run
|
|
82
|
-
|
|
83
|
-
7. Click **'Create Run'** to start execution
|
|
84
|
-
|
|
85
|
-

|
|
86
|
-
|
|
87
|
-
8. Mark all tests with specific status (e.g., ✔ passed / ✖ failed / ➖ skipped)
|
|
88
|
-
9. Click the **Finish Run** button
|
|
89
|
-
|
|
90
|
-

|
|
91
|
-
|
|
92
|
-
**Option 3** – From the **'Plans'** Tab
|
|
93
|
-
|
|
94
|
-
1. Navigate to the **Plans** tab in the Jira issue
|
|
95
|
-
2. Click the **▶︎ icon** (Launch a plan) next to the linked Plan to quickly start a run
|
|
96
|
-
3. or click the **⚙︎ icon** (Launch with advanced options) to configure **Advanced Settings**
|
|
97
|
-
|
|
98
|
-

|
|
99
|
-
|
|
100
|
-
Once the **Manual Run Settings** window opens (this appears only if you clicked the **⚙︎ icon**):
|
|
101
|
-
|
|
102
|
-
4. (Optional) Enable **Run as Checklist** toggle - if enabled, marks tests to be executed as checklist
|
|
103
|
-
5. (Optional) Enable **Run Automated as Manual** toggle - if enabled, allows automated tests to be executed manually
|
|
104
|
-
|
|
105
|
-
:::note
|
|
106
|
-
|
|
107
|
-
**Run Automated as Manual** option is disabled if the selected Plan contains only manual tests.
|
|
108
|
-
|
|
109
|
-
:::
|
|
110
|
-
|
|
111
|
-
6. Configure **Advanced Settings**
|
|
112
|
-
|
|
113
|
-
- **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
|
|
114
|
-
- **Assign user** – select the **email of the user added to the project** who is responsible for this run
|
|
115
|
-
- **RunGroup** – optional grouping of related runs for easier tracking and reporting
|
|
116
|
-
- **Title** - provide a descriptive title for the run
|
|
117
|
-
|
|
118
|
-
7. Click **'Create Run'** to start execution
|
|
119
|
-
|
|
120
|
-

|
|
121
|
-
|
|
122
|
-
8. Mark all tests with specific status (e.g., ✔ passed / ✖ failed / ➖ skipped)
|
|
123
|
-
9. Click the **Finish Run** button
|
|
124
|
-
|
|
125
|
-

|
|
126
|
-
|
|
127
|
-
### How to Launch an Automated Run (CI/CD)
|
|
128
|
-
|
|
129
|
-
Use Automated Run in Jira to trigger tests automatically via a connected CI/CD service without leaving your Jira issue. Ideal for running regression suites, nightly builds, or executing fully automated test cases directly from the Jira interface.
|
|
130
|
-
|
|
131
|
-
**Option 1** – From the '...' menu on the **Tests** Tab
|
|
132
|
-
|
|
133
|
-
1. Click the '...' (extra menu) button on the **Tests** tab
|
|
134
|
-
2. Select **Run in CI** from the dropdown list
|
|
135
|
-
|
|
136
|
-

|
|
137
|
-
|
|
138
|
-
:::note
|
|
139
|
-
|
|
140
|
-
If your CI service is not connected, you will see the message: 'Continuous Integration service is not enabled. Connect a CI service to run automated tests from the Testomat.io Jira Plugin.' To enable CI runs, connect your preferred [CI/CD service](https://docs.testomat.io/integrations/continuous-integration/) in your Testomat.io project settings.
|
|
141
|
-
|
|
142
|
-
:::
|
|
143
|
-
|
|
144
|
-
3. Add specific tests to run by selecting one by one or **Select all** option
|
|
145
|
-
|
|
146
|
-

|
|
147
|
-
|
|
148
|
-
4. (Optional) Open the **Advanced settings** to select:
|
|
149
|
-
|
|
150
|
-
- **Title** - provide a title for the run
|
|
151
|
-
- **CI profile** – select the CI configuration profile for automated test execution
|
|
152
|
-
- **Enter config** – specify custom environment variables (e.g. `ref=main`)
|
|
153
|
-
- **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
|
|
154
|
-
- **Assign user** - select the **email of the user added to the project** who is responsible for this run
|
|
155
|
-
- **RunGroup** - optional grouping of related runs for easier tracking and reporting
|
|
156
|
-
|
|
157
|
-
5. Click **'Create Run'** to start execution
|
|
158
|
-
|
|
159
|
-

|
|
160
|
-
|
|
161
|
-
**Option 2** – From the **'Plans'** Tab
|
|
162
|
-
|
|
163
|
-
1. Navigate to the **Plans** tab in the Jira issue
|
|
164
|
-
2. Click the **▶︎ icon** (Launch a plan) next to the linked Plan **(recommended)** in CI
|
|
165
|
-
3. or click the **⚙︎ icon** (Launch with advanced options)
|
|
166
|
-
|
|
167
|
-

|
|
168
|
-
|
|
169
|
-
4. Once the **Run settings** window opens (this appears only if you clicked the **▶︎ icon**), select:
|
|
170
|
-
|
|
171
|
-
- **Title** - provide a title for the run
|
|
172
|
-
- **CI profile** – select the CI configuration profile for automated test execution
|
|
173
|
-
- **Enter config** – specify custom environment variables (e.g. `ref=main`)
|
|
174
|
-
- **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
|
|
175
|
-
- **Assign user** – select the **email of the user added to the project** who is responsible for this run
|
|
176
|
-
- **RunGroup** - optional grouping of related runs for easier tracking and reporting
|
|
177
|
-
|
|
178
|
-
5. Click **'Create Run'** to start execution
|
|
179
|
-
|
|
180
|
-

|
|
181
|
-
|
|
182
|
-
6. Once the automated run is created, it appears in the **Runs** tab with the **Pending** status
|
|
183
|
-
|
|
184
|
-
- The test results will update automatically when your CI job completes — showing the final status
|
|
185
|
-
- No manual action is required in Jira
|
|
186
|
-
|
|
187
|
-

|
|
188
|
-
|
|
189
|
-
### How to Launch a Mixed Run
|
|
190
|
-
|
|
191
|
-
Use Mixed Run in Jira to execute both manual and automated tests in a single run directly from the Jira issue. Ideal when part of the test suite is automated, but some tests still require manual verification. You can launch a Mixed Run in Jira in two different ways:
|
|
192
|
-
|
|
193
|
-
**Option 1** – From the '...' Menu on the **Tests** Tab
|
|
194
|
-
|
|
195
|
-
1. Click the '...' (extra menu) button on the **Tests** tab
|
|
196
|
-
2. Select **Mixed Run** from the dropdown list
|
|
197
|
-
|
|
198
|
-

|
|
199
|
-
|
|
200
|
-
:::note
|
|
201
|
-
|
|
202
|
-
If your CI service is not connected, you will see the message: 'Continuous Integration service is not enabled. Connect a CI service to run automated tests from the Testomat.io Jira Plugin.' To enable CI runs, connect your preferred [CI/CD service](https://docs.testomat.io/integrations/continuous-integration/) in your Testomat.io project settings.
|
|
203
|
-
|
|
204
|
-
:::
|
|
205
|
-
|
|
206
|
-
3. In the **'Select tests to run'** dialog, choose the tests you want to include
|
|
207
|
-
|
|
208
|
-

|
|
209
|
-
|
|
210
|
-
4. Configure **Advanced Settings**:
|
|
211
|
-
|
|
212
|
-
- **Title** - provide a title for the run
|
|
213
|
-
- **CI profile** – select the CI configuration profile for automated test execution
|
|
214
|
-
- **Enter config** – specify custom environment variables (e.g. `ref=main`)
|
|
215
|
-
- **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
|
|
216
|
-
- **Assign user** - select the **email of the user added to the project** who is responsible for this run
|
|
217
|
-
- **RunGroup** - optional grouping of related runs for easier tracking and reporting
|
|
218
|
-
|
|
219
|
-
5. Click **'Create Run'** to start execution
|
|
220
|
-
|
|
221
|
-

|
|
222
|
-
|
|
223
|
-
Once the mixed run starts:
|
|
224
|
-
|
|
225
|
-
6. **Automated tests** are sent to your connected **CI service** for execution. Their results will update automatically in Jira once the CI job completes.
|
|
226
|
-
7. **Manual tests** can be executed directly inside Jira — mark each test with its result (e.g., ✔ passed / ✖ failed / ➖ skipped)
|
|
227
|
-
8. Click the **Finish Run** button to close the run
|
|
228
|
-
|
|
229
|
-

|
|
230
|
-
|
|
231
|
-
**Option 2** – From the **'Plans'** Tab
|
|
232
|
-
|
|
233
|
-
1. Navigate to the **Plans** tab in the Jira issue
|
|
234
|
-
2. Click the **▶︎ icon** (Launch a plan) next to the linked Plan
|
|
235
|
-
3. or click the **⚙︎ icon** (Launch with advanced options)
|
|
236
|
-
|
|
237
|
-

|
|
238
|
-
|
|
239
|
-
4. Once the **Run settings** window opens (this appears only if you clicked the **▶︎ icon**), select:
|
|
240
|
-
|
|
241
|
-
- **Title** - provide a title for the run
|
|
242
|
-
- **CI profile** – select the CI configuration profile for automated test execution
|
|
243
|
-
- **Enter config** – specify custom environment variables (e.g. `ref=main`)
|
|
244
|
-
- **Environment** – select where the tests will run (e.g., macOS, Chrome, staging, production)
|
|
245
|
-
- **Assign user** – select the **email of the user added to the project** who is responsible for this run
|
|
246
|
-
- **RunGroup** - optional grouping of related runs for easier tracking and reporting
|
|
247
|
-
|
|
248
|
-
5. Click **'Create Run'** to start execution
|
|
249
|
-
|
|
250
|
-

|
|
251
|
-
|
|
252
|
-
6. **Automated tests** are sent to your connected **CI service** for execution. Their results will update automatically in Jira once the CI job completes.
|
|
253
|
-
7. **Manual tests** can be executed directly inside Jira — mark each test with its result (e.g., ✔ passed / ✖ failed / ➖ skipped)
|
|
254
|
-
8. Click the **Finish Run** button to close the run
|
|
255
|
-
|
|
256
|
-

|
|
257
|
-
|
|
258
|
-
## Run Reports in Jira
|
|
259
|
-
|
|
260
|
-
Once a run is completed, it automatically appears in **Testomat.io** and in the **Runs** tab within Jira. In this tab, you can view all runs that were **launched in Jira** or **linked in Testomat.io project**, and quickly access key information about each run.
|
|
261
|
-
|
|
262
|
-
- **External link (URL)** – opens the detailed report in Testomat.io
|
|
263
|
-
- **Status icon** – shows the color of the run’s status (Passed / Failed / Skipped)
|
|
264
|
-
- **Title** – the title provided for the run
|
|
265
|
-
- **Run type** – a badge indicating the type of run (e.g., manual / automated / mixed)
|
|
266
|
-
- **Environment** – selected environments for the run (e.g., macOS, Chrome, staging)
|
|
267
|
-
- **Execution date** – date the run was completed (or **Not finished**)
|
|
268
|
-
- **Test statuses** – number of tests with each status (e.g., ✔ Passed / ✖ Failed / ➖ Skipped)
|
|
269
|
-
- **Actions** – **▶︎ icon** appears if the run is not yet completed
|
|
270
|
-
|
|
271
|
-

|
|
272
|
-
|
|
273
|
-
For full report options (filters, exports, comparisons, etc.), you can **open the Run Reports in Testomat.io**, or to learn more, visit the [Run Reports documentation](https://docs.testomat.io/project/runs/reports/).
|
|
274
|
-
|
|
275
|
-
### Receive Reports in Jira
|
|
276
|
-
|
|
277
|
-
You can receive a summary report directly inside Jira by enabling **Report Notifications** in your Testomat.io project settings. This integration automatically posts key information about each test run into your Jira project, including:
|
|
278
|
-
|
|
279
|
-
- Run ID and Status
|
|
280
|
-
- Project name
|
|
281
|
-
- Number of Executed Tests
|
|
282
|
-
- Execution Date and Duration
|
|
283
|
-
- Failed Tests
|
|
284
|
-
- Environment
|
|
285
|
-
- Link to Full Report
|
|
286
|
-
|
|
287
|
-
This summary allows you to quickly see the key results of each run directly in Jira, while full details remain accessible via the Testomat.io report link.
|
|
288
|
-
|
|
289
|
-

|
|
290
|
-
|
|
291
|
-
Learn how to set it up in [Report Notifications in Jira.](https://docs.testomat.io/integrations/report-notifications/jira/)
|
|
292
|
-
|
|
293
|
-
## Tests Coverage
|
|
294
|
-
|
|
295
|
-
The Tests Coverage screen provides a traceability matrix showing all Jira issues with their linked
|
|
296
|
-
tests. For each issue you can see:
|
|
297
|
-
|
|
298
|
-
- Title — Jira issue key and name
|
|
299
|
-
- Tests — number of linked tests
|
|
300
|
-
- Status — current test run status (e.g., Failed, Passed)
|
|
301
|
-
- Automation status — percentage of automated tests among linked ones
|
|
302
|
-
|
|
303
|
-
This gives the team a quick overview of which requirements are covered, how many tests back each issue, and how far automation has progressed per story.
|
|
304
|
-
|
|
305
|
-
To open the Tests Coverage screen:
|
|
306
|
-
|
|
307
|
-
1. Open the specific space
|
|
308
|
-
2. Click the 'More' option
|
|
309
|
-
3. Select the 'Tests Coverage' tab
|
|
310
|
-
|
|
311
|
-

|
|
312
|
-
|
|
313
|
-
The automation percentage reflects how many of the linked tests are automated — from 0% (all manual) to 100% (fully automated). Issues with no linked tests signal coverage gaps that need attention.
|
|
314
|
-
|
|
315
|
-

|
|
316
|
-
|
|
317
|
-
## Sprint Coverage
|
|
318
|
-
|
|
319
|
-
The Sprint Coverage tab gives a high-level summary of test execution health across a sprint. Use it to understand how well a sprint is covered with tests and how the execution is progressing — without leaving Jira.
|
|
320
|
-
|
|
321
|
-
For each sprint it shows:
|
|
322
|
-
|
|
323
|
-
- Issues with tests / Issues without tests — how many sprint issues have linked tests and how many are left uncovered
|
|
324
|
-
- Manual tests / Automated tests — breakdown of test types across the sprint
|
|
325
|
-
- Passed / Failed / Skipped / Pending / Not executed — full execution status breakdown
|
|
326
|
-
|
|
327
|
-
This makes it easy to spot coverage gaps, track automation progress, and assess sprint readiness at a glance.
|
|
328
|
-
|
|
329
|
-
To check test coverage for a sprint:
|
|
330
|
-
|
|
331
|
-
1. Open the specific space
|
|
332
|
-
2. Click the 'More' option
|
|
333
|
-
3. Select the 'Sprints Coverage' tab
|
|
334
|
-
|
|
335
|
-

|
|
336
|
-
|
|
337
|
-
4. Enter the sprint ID(s)
|
|
338
|
-
5. Click the 'Submit' button
|
|
339
|
-
|
|
340
|
-

|
|
341
|
-
|
|
342
|
-
:::note
|
|
343
|
-
|
|
344
|
-
To find your sprint ID, visit the [Jira Software sprint ID guide](https://support.atlassian.com/jira/kb/jira-software-how-to-identify-the-id-of-a-sprint/).
|
|
345
|
-
|
|
346
|
-
:::
|
|
347
|
-
|
|
348
|
-
## Data Sync in Jira
|
|
349
|
-
|
|
350
|
-
Testomat.io and Jira are continuously synchronized to ensure test data stays up to date across both systems. This **two-way sync** keeps all team members — QA, development, management, and stakeholders — aligned.
|
|
351
|
-
|
|
352
|
-
**Automatic Sync**
|
|
353
|
-
|
|
354
|
-
All key updates are automatically synchronized:
|
|
355
|
-
|
|
356
|
-
- Linked test cases, test suites, and plans remain aligned in both systems
|
|
357
|
-
- Statuses of linked Jira issues are synchronized
|
|
358
|
-
- Executing a run in Testomat.io updates the corresponding Jira issue with the latest run status
|
|
359
|
-
- Launching or updating a run from Jira instantly reflects in Testomat.io
|
|
360
|
-
- Testomat.io settings — including environments, branches, users, run groups, and CI integrations — are synchronized and visible in Jira
|
|
361
|
-
|
|
362
|
-
This real-time, two-way sync ensures that everyone sees the same up-to-date information, eliminating confusion and reducing manual updates.
|
|
363
|
-
|
|
364
|
-
**Manual Sync**
|
|
365
|
-
|
|
366
|
-
If your Jira issue view or run list does not show the latest data, you can trigger synchronization manually. This ensures that all test results, linked issues, and run information are up-to-date in both Jira and Testomat.io.
|
|
367
|
-
|
|
368
|
-
To manually refresh data:
|
|
369
|
-
|
|
370
|
-
1. Open the **Tests** tab in the Jira issue
|
|
371
|
-
2. Click the '⋯' (extra menu) button
|
|
372
|
-
3. Select **Sync** from the dropdown list
|
|
373
|
-
|
|
374
|
-

|
|
375
|
-
|
|
376
|
-
Testomat.io will re-fetch the latest information and update linked test results, statuses, and settings inside Jira. This keeps your Jira and Testomat.io data fully consistent — whether you rely on automatic background sync or perform a quick manual refresh when needed.
|
|
377
|
-
|