testeiya 0.2.1 → 0.3.10
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/LICENSE +21 -0
- package/README.md +284 -171
- package/dist/prompt/context.js +79 -0
- package/dist/prompt/context.js.map +1 -0
- package/dist/prompt/index.js +60 -0
- package/dist/prompt/index.js.map +1 -0
- package/dist/prompt/print.js +30 -0
- package/dist/prompt/print.js.map +1 -0
- package/dist/prompt/project-info.js +2 -0
- package/dist/prompt/project-info.js.map +1 -0
- package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +38 -25
- package/dist/prompt/system-prompt.js.map +1 -0
- package/dist/prompt/testomatio.js +264 -0
- package/dist/prompt/testomatio.js.map +1 -0
- package/dist/prompt/tools.js +57 -0
- package/dist/prompt/tools.js.map +1 -0
- package/dist/prompt/vocab.js +8 -0
- package/dist/prompt/vocab.js.map +1 -0
- package/dist/src/args.js +172 -0
- package/dist/src/args.js.map +1 -0
- package/dist/src/cli.js +97 -0
- package/dist/src/cli.js.map +1 -0
- package/dist/src/doctor.js +186 -0
- package/dist/src/doctor.js.map +1 -0
- package/dist/src/env.js +93 -0
- package/dist/src/env.js.map +1 -0
- package/dist/src/mcp-extension.js +9 -0
- package/dist/src/mcp-extension.js.map +1 -0
- package/dist/src/mcp.js +139 -0
- package/dist/src/mcp.js.map +1 -0
- package/dist/src/model.js +71 -0
- package/dist/src/model.js.map +1 -0
- package/dist/src/models.js +38 -0
- package/dist/src/models.js.map +1 -0
- package/dist/src/output.js +185 -0
- package/dist/src/output.js.map +1 -0
- package/dist/src/result.js +41 -0
- package/dist/src/result.js.map +1 -0
- package/dist/src/run.js +291 -0
- package/dist/src/run.js.map +1 -0
- package/dist/src/session.js +92 -0
- package/dist/src/session.js.map +1 -0
- package/dist/src/sessions.js +61 -0
- package/dist/src/sessions.js.map +1 -0
- package/dist/vendor/mcp.js +14801 -0
- package/mcp-tools.json +2967 -0
- package/package.json +34 -43
- package/prompt/context.ts +101 -0
- package/prompt/index.ts +102 -0
- package/prompt/print.ts +32 -0
- package/prompt/project-info.ts +30 -0
- package/prompt/system-prompt.ts +187 -0
- package/{src/prompt → prompt}/testomatio.ts +120 -9
- package/prompt/tools.ts +57 -0
- package/prompt/vocab.ts +7 -0
- package/skills/codeceptjs/ci-fix-tests/SKILL.md +7 -8
- package/skills/codeceptjs/codeceptjs-auth/SKILL.md +47 -64
- package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +56 -47
- package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +144 -106
- package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +50 -57
- package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +88 -196
- package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +4 -5
- package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +25 -36
- package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +23 -36
- package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +23 -36
- package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +23 -35
- package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +50 -53
- package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +87 -191
- package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/SKILL.md +1 -1
- package/{skills.lock.json → skills/skills.lock.json} +43 -36
- package/skills/skills.yaml +34 -0
- package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +49 -61
- package/skills/testomatio/explorbot/explorbot-fundamentals/references/no-install.md +36 -0
- package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +20 -7
- package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +41 -289
- package/skills/testomatio/qa-process/qa-explain-behavior/SKILL.md +111 -0
- package/skills/testomatio/qa-process/qa-explain-behavior/references/answer-shapes.md +116 -0
- package/skills/testomatio/qa-process/qa-explain-behavior/references/examples.md +157 -0
- package/skills/testomatio/qa-process/qa-lead-strategy-advisor/SKILL.md +91 -0
- package/skills/testomatio/qa-process/qa-lead-strategy-advisor/references/output-format.md +71 -0
- package/skills/testomatio/qa-process/testing-workflow/SKILL.md +227 -0
- package/skills/testomatio/test-automation/qa-data-seeder/SKILL.md +83 -0
- package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +5 -3
- package/skills/testomatio/test-automation/setup-change-aware-pr-testing/SKILL.md +190 -0
- package/skills/testomatio/test-automation/setup-ci-automation/SKILL.md +76 -0
- package/skills/testomatio/test-management/qa-split-testing-levels-pyramid/SKILL.md +55 -0
- package/skills/testomatio/test-management/qa-sprint-report-by-testomatio/SKILL.md +220 -0
- package/skills/testomatio/test-management/qa-sprint-report-by-testomatio/references/qa-sprint-report.md +126 -0
- package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +1 -1
- package/skills/testomatio/test-management/qa-thinking/SKILL.md +25 -25
- package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +14 -1
- package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +8 -0
- package/assets/testeiya-logo-dark.svg +0 -16
- package/assets/testeiya-logo.svg +0 -15
- package/models.catalog.json +0 -6963
- package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
- package/skills/playwright-best-practices-skill/README.md +0 -147
- package/skills/testeiya/README.md +0 -29
- package/skills/testeiya/answer-formatting/SKILL.md +0 -30
- package/skills/testeiya/check-cucumber/SKILL.md +0 -200
- package/skills/testeiya/check-tests/SKILL.md +0 -260
- package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
- package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
- package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
- package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
- package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
- package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
- package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
- package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
- package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
- package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
- package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
- package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
- package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
- package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
- package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
- package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
- package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
- package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
- package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
- package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
- package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
- package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
- package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
- package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
- package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
- package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
- package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
- package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
- package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
- package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
- package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
- package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
- package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
- package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
- package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
- package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
- package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
- package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
- package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
- package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
- package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
- package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
- package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
- package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
- package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
- package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
- package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
- package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
- package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
- package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
- package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
- package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
- package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
- package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
- package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
- package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
- package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
- package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
- package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
- package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
- package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
- package/skills.yaml +0 -21
- package/src/ai-debug.ts +0 -188
- package/src/api/agent-get.ts +0 -22
- package/src/api/agent-start.ts +0 -384
- package/src/api/client-log.ts +0 -29
- package/src/api/context.ts +0 -332
- package/src/api/debug-layout.ts +0 -47
- package/src/api/debug-report.ts +0 -29
- package/src/api/debug-snapshot.ts +0 -30
- package/src/api/debug-stream.ts +0 -52
- package/src/api/files-delete.ts +0 -184
- package/src/api/files-read.ts +0 -41
- package/src/api/files-rename.ts +0 -99
- package/src/api/files-tree.ts +0 -292
- package/src/api/files-write.ts +0 -41
- package/src/api/mcp.ts +0 -603
- package/src/api/memory.ts +0 -69
- package/src/api/open-external.ts +0 -39
- package/src/api/playwright-cli.ts +0 -606
- package/src/api/providers.ts +0 -457
- package/src/api/read-env-token.ts +0 -33
- package/src/api/sessions.ts +0 -79
- package/src/api/settings.ts +0 -120
- package/src/api/skills.ts +0 -58
- package/src/api/testomatio-attachment.ts +0 -89
- package/src/api/testomatio-auth.ts +0 -284
- package/src/api/testomatio-proxy.ts +0 -197
- package/src/api/testomatio-run-stats.ts +0 -81
- package/src/api/testomatio-target.ts +0 -225
- package/src/api/testomatio-transcription.ts +0 -82
- package/src/api/workspace-search.ts +0 -96
- package/src/api/workspace-sync.ts +0 -151
- package/src/api/workspace.ts +0 -165
- package/src/app-server.ts +0 -556
- package/src/bridge.ts +0 -251
- package/src/check-tests.ts +0 -156
- package/src/cli.ts +0 -17
- package/src/commands.ts +0 -244
- package/src/config.ts +0 -183
- package/src/connection.ts +0 -658
- package/src/context-store.ts +0 -265
- package/src/debug-bus.ts +0 -405
- package/src/extensions/tool-gate.ts +0 -220
- package/src/extensions/webui/ask-channel.ts +0 -52
- package/src/extensions/webui/index.ts +0 -184
- package/src/extensions/webui/tools/ask-question.ts +0 -88
- package/src/extensions/webui/tools/query-result.ts +0 -79
- package/src/extensions/webui/tools/render-chart.ts +0 -53
- package/src/extensions/webui/tools/render-item.ts +0 -61
- package/src/extensions/webui/tools/render-list.ts +0 -170
- package/src/extensions/webui/tools/render-result.ts +0 -85
- package/src/extensions/webui/tools/render-tree.ts +0 -71
- package/src/extensions/webui/tools/ui-widget.ts +0 -54
- package/src/extensions/webui/tools/widget-result.ts +0 -13
- package/src/extensions/webui/widget-channel.ts +0 -50
- package/src/file-log.ts +0 -196
- package/src/git-tracked.ts +0 -68
- package/src/gitignore.ts +0 -53
- package/src/json-store.ts +0 -43
- package/src/load-env.ts +0 -70
- package/src/loader-style.ts +0 -96
- package/src/main.ts +0 -140
- package/src/mcp-catalog.ts +0 -96
- package/src/models-catalog.ts +0 -72
- package/src/permissions.ts +0 -120
- package/src/project-dir.ts +0 -189
- package/src/project-info.ts +0 -108
- package/src/prompt/app-ui.ts +0 -59
- package/src/prompt/browser.ts +0 -27
- package/src/prompt/index.ts +0 -62
- package/src/prompt/tools.ts +0 -27
- package/src/server-info.ts +0 -62
- package/src/session-factory.ts +0 -442
- package/src/session-store.ts +0 -115
- package/src/shell-env.ts +0 -45
- package/src/skills.ts +0 -163
- package/src/sync-snapshot.ts +0 -140
- package/src/telemetry.ts +0 -239
- package/src/testomatio-auth.ts +0 -299
- package/src/testomatio.ts +0 -98
- package/src/theme.ts +0 -30
- package/src/user-env.ts +0 -94
- package/src/welcome.ts +0 -194
- package/src/workspace/safe-path.ts +0 -85
- package/src/workspace/test-md.ts +0 -70
- package/src/workspace-model.ts +0 -440
- package/testeiya.config.json +0 -14
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/authentication-flows.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/authentication.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/clock-mocking.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/mobile-testing.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/multi-context.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/multi-user.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/network-advanced.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/third-party.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/pom-vs-fixtures.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/test-architecture.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/when-to-mock.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/browser-apis.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/iframes.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/service-workers.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/websockets.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/annotations.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/assertions-waiting.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/configuration.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/fixtures-hooks.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/global-setup.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/locators.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/page-object-model.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/projects-dependencies.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-data.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-suite-structure.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-tags.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/console-errors.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/debugging.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/error-testing.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/flaky-tests.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/angular.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/nextjs.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/react.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/vue.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/ci-cd.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/docker.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/github-actions.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/gitlab.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/other-providers.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/parallel-sharding.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/performance.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/reporting.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/test-coverage.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/accessibility.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/api-testing.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/browser-extensions.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/canvas-webgl.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/component-testing.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/drag-drop.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/electron.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/file-operations.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/file-upload-download.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/forms-validation.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/graphql-testing.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/i18n.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/performance-testing.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/security-testing.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/visual-regression.md +0 -0
- /package/skills/{playwright-cli → playwright/playwright-cli}/SKILL.md +0 -0
- /package/skills/{playwright-cli → playwright/playwright-cli}/references/element-attributes.md +0 -0
- /package/skills/{playwright-cli → playwright/playwright-cli}/references/playwright-tests.md +0 -0
- /package/skills/{playwright-cli → playwright/playwright-cli}/references/request-mocking.md +0 -0
- /package/skills/{playwright-cli → playwright/playwright-cli}/references/running-code.md +0 -0
- /package/skills/{playwright-cli → playwright/playwright-cli}/references/session-management.md +0 -0
- /package/skills/{playwright-cli → playwright/playwright-cli}/references/storage-state.md +0 -0
- /package/skills/{playwright-cli → playwright/playwright-cli}/references/test-generation.md +0 -0
- /package/skills/{playwright-cli → playwright/playwright-cli}/references/tracing.md +0 -0
- /package/skills/{playwright-cli → playwright/playwright-cli}/references/video-recording.md +0 -0
|
@@ -1,67 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: Shortcut Configuration
|
|
3
|
-
description: Learn how to integrate Shortcut with Testomat.io for effective issue tracking. This guide details how to retrieve your API Access Token and Workflow Name and provides step-by-step instructions to configure the Shortcut integration within Testomat.io seamlessly.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/integrations/issues-management/shortcut
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: og:image
|
|
10
|
-
content: https://docs.testomat.io/_astro/New_UTbONHqM_2024-10-31.DUKqHBp2_YEDnG.webp
|
|
11
|
-
|
|
12
|
-
- tag: meta
|
|
13
|
-
attrs:
|
|
14
|
-
name: keywords
|
|
15
|
-
content: Shortcut integration, Testomat.io, issue management, API Access Token, Workflow Name, project management, test management tools, software testing, agile development
|
|
16
|
-
---
|
|
17
|
-
|
|
18
|
-
If you already have a workspace configured in **Shortcut**, you're ready to integrate it with Testomat.io. To get started, you’ll need your **Workflow Name**, and **API Access Token**. We’ll walk you through each step to locate this information and connect it with Testomat.io.
|
|
19
|
-
|
|
20
|
-

|
|
21
|
-
|
|
22
|
-
To create the **API Access Token**, follow these steps:
|
|
23
|
-
|
|
24
|
-
1. Click on **Settings** button
|
|
25
|
-
2. Go to **API Tokens**
|
|
26
|
-
3. Enter **Token Name**
|
|
27
|
-
4. Click on **Generate Token** button
|
|
28
|
-
|
|
29
|
-

|
|
30
|
-
|
|
31
|
-
5. Copy your API Token
|
|
32
|
-
|
|
33
|
-

|
|
34
|
-
|
|
35
|
-
Keep your **API Access Token** secure, as you’ll need it for the integration with Testomat.io.
|
|
36
|
-
|
|
37
|
-
To locate the **Workflow Name**, follow these steps:
|
|
38
|
-
|
|
39
|
-
1. Click on **Settings** button
|
|
40
|
-
2. Go to **Workflows**
|
|
41
|
-
5. Copy your Workflow Name
|
|
42
|
-
|
|
43
|
-

|
|
44
|
-
|
|
45
|
-
After collecting all necessary data, we can move on to Testomat.io.
|
|
46
|
-
|
|
47
|
-
1. Select Shortcut from the list of available Issue Management Systems.
|
|
48
|
-
|
|
49
|
-

|
|
50
|
-
|
|
51
|
-
2. Enter a **Profile Name**
|
|
52
|
-
3. Paste Shortcut **API Access Token**
|
|
53
|
-
4. Paste Shortcut **Workflow Name**
|
|
54
|
-
5. Click on **Save** button
|
|
55
|
-
|
|
56
|
-

|
|
57
|
-
|
|
58
|
-
If everything was done correctly, you will receive a confirmation message indicating that the Shortcut profile was successfully created.
|
|
59
|
-
|
|
60
|
-

|
|
61
|
-
|
|
62
|
-
## Frequently Asked Questions (FAQ)
|
|
63
|
-
|
|
64
|
-
**Q: Although linking an already existing Shortcut ticket does not work as I expected. When using **“Link to Issue”** and entering the Shortcut URL, it does not automatically create an external link on Shortcut.**
|
|
65
|
-
|
|
66
|
-
A: This behavior is expected. When you use the **“Link to Issue”** feature in Testomat.io to attach an existing Shortcut ticket, it will not automatically create a backlink (external link) inside Shortcut. This limitation is caused by Shortcut’s API, which currently does not allow third-party tools to generate external links on already existing tickets.
|
|
67
|
-
|
|
@@ -1,94 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: YouTrack Configuration
|
|
3
|
-
description: Learn how to integrate YouTrack with Testomat.io for streamlined issue management. This guide explains how to retrieve your YouTrack Workspace Name, Personal Access Token, and Project ID, and then configure the integration within Testomat.io.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/integrations/issues-management/youtrack
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: og:image
|
|
10
|
-
content: https://docs.testomat.io/_astro/New_UTbONHqM_2024-10-31.DUKqHBp2_YEDnG.webp
|
|
11
|
-
|
|
12
|
-
- tag: meta
|
|
13
|
-
attrs:
|
|
14
|
-
name: keywords
|
|
15
|
-
content: YouTrack integration, Testomat.io, issue tracking, personal access token, workspace configuration, project management, test management tools, software testing, bug tracking
|
|
16
|
-
---
|
|
17
|
-
|
|
18
|
-
If you already have a workspace and project in YouTrack, you’re ready to integrate it with Testomat.io. To do so, you’ll need three items:
|
|
19
|
-
|
|
20
|
-
- Workspace Name
|
|
21
|
-
- Personal Access Token
|
|
22
|
-
- Project ID
|
|
23
|
-
|
|
24
|
-
This guide walks you through where to find each.
|
|
25
|
-
|
|
26
|
-

|
|
27
|
-
|
|
28
|
-
## How to Find a Workspace Name
|
|
29
|
-
|
|
30
|
-
You can find your **Workspace Name** in the browser **URL** when you're logged into YouTrack. For example: `[my-workspace].youtrack.cloud`
|
|
31
|
-
|
|
32
|
-

|
|
33
|
-
|
|
34
|
-
## How to Create a Personal Access Token
|
|
35
|
-
|
|
36
|
-
To create the **Personal Access Token**, follow these steps:
|
|
37
|
-
|
|
38
|
-
1. Click on the profile avatar
|
|
39
|
-
2. Go to **Profile**
|
|
40
|
-
3. Then go to **Account Security**
|
|
41
|
-
4. Click on **New token...** button
|
|
42
|
-
|
|
43
|
-

|
|
44
|
-
|
|
45
|
-
5. Enter a **Token** name
|
|
46
|
-
6. Select services (**YouTrack, YouTrack Administration**)
|
|
47
|
-
7. Click on **Create** button
|
|
48
|
-
|
|
49
|
-

|
|
50
|
-
|
|
51
|
-
Once the token has been created, copy it. Keep your Personal Access Token secure, as you’ll need it for the integration with Testomat.io.
|
|
52
|
-
|
|
53
|
-
## How to Get a Project ID
|
|
54
|
-
|
|
55
|
-
Finally, to get the **Project ID**, follow these steps:
|
|
56
|
-
|
|
57
|
-
1. Open YouTrack [API Documentation](https://www.postman.com/youtrack-dev/youtrack/documentation/sd7pq8x/youtrack-rest-api)-> Administration -> Projects -> Read a List of Projects
|
|
58
|
-
2. Get a request:
|
|
59
|
-
|
|
60
|
-
```
|
|
61
|
-
https://<your-workspace>.youtrack.cloud/api/admin/projects?fields=id,key,name
|
|
62
|
-
|
|
63
|
-
```
|
|
64
|
-
|
|
65
|
-
3. Paste your Personal Access Token
|
|
66
|
-
4. Click **Send** button and get your Project ID in the response body (e.g. `"id": "0-1"`)
|
|
67
|
-
|
|
68
|
-

|
|
69
|
-
|
|
70
|
-
:::note
|
|
71
|
-
|
|
72
|
-
The ID in the browser URL isn't the same as the project ID in the database.
|
|
73
|
-
|
|
74
|
-
:::
|
|
75
|
-
|
|
76
|
-
After collecting all necessary data, we can move on to Testomat.io.
|
|
77
|
-
|
|
78
|
-
## How to Connect YouTrack in Testomat.io
|
|
79
|
-
|
|
80
|
-
1. Select YouTrack from the list of available Issue Management Systems.
|
|
81
|
-
|
|
82
|
-

|
|
83
|
-
|
|
84
|
-
2. Enter a **Profile Name**
|
|
85
|
-
3. Paste YouTrack **Workspace Name**
|
|
86
|
-
4. Paste YouTrack **Personal Access Token**
|
|
87
|
-
5. Paste YouTrack **Project ID**
|
|
88
|
-
6. Click on **Save** button
|
|
89
|
-
|
|
90
|
-

|
|
91
|
-
|
|
92
|
-
If everything was done correctly, you will receive a confirmation message indicating that the YouTrack profile was successfully created.
|
|
93
|
-
|
|
94
|
-

|
package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md
DELETED
|
@@ -1,53 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: Azure DevOps Notifications
|
|
3
|
-
description: Configure Azure DevOps notifications in Testomat.io to automate issue creation for failed test runs. This guide explains linking Azure DevOps projects, and setting notification rules to streamline workflows and save time by automating detailed test result reporting.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/integrations/report-notifications/azure-devops
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: keywords
|
|
10
|
-
content: Azure DevOps, Testomat.io, issue tracking, Notification rules, Report Notifications, Azure DevOps integration, publish report, detailed test run results, test management, test automation, software testing, basic rules, advanced rules engine
|
|
11
|
-
---
|
|
12
|
-
|
|
13
|
-
Testomat.io allows to create issue for failed test runs automatically in Azure DevOps. This option can be enabled in **Settings**.
|
|
14
|
-
|
|
15
|
-
Before you set up Notification rules for Azure DevOps, you need to connect your Azure DevOps project with Testomat.io. Please follow the instuction in dedicated section - [Azure DevOps Configuration.](https://docs.testomat.io/integrations/issues-management/azure/)
|
|
16
|
-
|
|
17
|
-
After the Azure DevOps is connected with Testomat.io, go to the **Settings (1) -> Report Notifications(2)** and click on **Add Notification Rule (3)**.
|
|
18
|
-
|
|
19
|
-

|
|
20
|
-
|
|
21
|
-
To enable Notification for Azure DevOps follow next steps:
|
|
22
|
-
|
|
23
|
-
1. Add a title for Notification Rule.
|
|
24
|
-
2. Choose **Azure DevOps** from the dropdown list.
|
|
25
|
-
|
|
26
|
-

|
|
27
|
-
|
|
28
|
-
3. Select **Azure DevOps integration** from dropdown list.
|
|
29
|
-
4. Select **'Publish a report and use public link in report notification'** option, if you need it.
|
|
30
|
-
5. Configure rules to define on which conditions this notification should be sent in **BASIC RULES** section
|
|
31
|
-
|
|
32
|
-
OR
|
|
33
|
-
|
|
34
|
-
use **ADVANCED RULES ENGINE** to enter your rule expression.
|
|
35
|
-
|
|
36
|
-
6. Click on **Save** button.
|
|
37
|
-
|
|
38
|
-
| **Basic Rules** | **Advanced Rules Engine** |
|
|
39
|
-
| --------------------------- | ------------------------------------- |
|
|
40
|
-
|  |  |
|
|
41
|
-
|
|
42
|
-
Testomat.io will now automatically create an issue with detailed Test Run results in your Azure DevOps project for any failed Test Runs. This eliminates the need to manually input data for each Test Run, saving you time and ensuring that all contributors are notified in a convenient way.
|
|
43
|
-
|
|
44
|
-

|
|
45
|
-
|
|
46
|
-
|
|
47
|
-
:::note
|
|
48
|
-
|
|
49
|
-
When **'Publish a report and use public link in report notification'** option is enabled, the public report will be generated and everyone who has this link will be able to see it.
|
|
50
|
-
|
|
51
|
-

|
|
52
|
-
|
|
53
|
-
:::
|
|
@@ -1,71 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: Email Notifications
|
|
3
|
-
description: Learn how to configure email notifications in Testomat.io to receive updates on test run results. This guide covers setting notification rules, customizing fields, and managing multiple email recipients effectively.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/integrations/report-notifications/email
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: keywords
|
|
10
|
-
content: Testomat.io, Email notifications, Report Notifications, Add Notification Rule, Run context, RunGroup context, basic rules, advanced rules engine, Run Report, multiple notifications, test management, test automation, software testing
|
|
11
|
-
---
|
|
12
|
-
|
|
13
|
-
Testomat.io allows sending Notifications for finished runs via Email.
|
|
14
|
-
Let's see how it works!
|
|
15
|
-
|
|
16
|
-
First, you need to set up Email notifications in the Settings tab:
|
|
17
|
-
|
|
18
|
-
1. Go to **Settings**.
|
|
19
|
-
2. Select **Report Notifications** option.
|
|
20
|
-
3. Click on **Add Notification Rule**.
|
|
21
|
-
|
|
22
|
-

|
|
23
|
-
|
|
24
|
-
At this point your next steps are:
|
|
25
|
-
|
|
26
|
-
4. Add a title for Notification Rule.
|
|
27
|
-
5. Choose **Email** from the dropdown list.
|
|
28
|
-
|
|
29
|
-

|
|
30
|
-
|
|
31
|
-
6. Enter one or multiple email addresses (separated by coma) to receive notifications.
|
|
32
|
-
7. Select **'Publish a report and use public link in report notification'** option, if you need it.
|
|
33
|
-
8. Select **Notification rule context**: Run or RunGroup.
|
|
34
|
-
9. Add notification rules in **BASIC RULES** section
|
|
35
|
-
|
|
36
|
-
OR
|
|
37
|
-
|
|
38
|
-
use **ADVANCED RULES ENGINE** to enter your rule expression.
|
|
39
|
-
|
|
40
|
-
10. Click on **Save** button.
|
|
41
|
-
|
|
42
|
-
| **Basic Rules** | **Advanced Rules Engine** |
|
|
43
|
-
| --------------------------- | ------------------------------------- |
|
|
44
|
-
|  |  |
|
|
45
|
-
|
|
46
|
-
Now you have Email Notification enabled for the project.
|
|
47
|
-
|
|
48
|
-

|
|
49
|
-
|
|
50
|
-
**How does it work?**
|
|
51
|
-
Each time Testomat.io creates Run Report, which corresponds to your Email Notification Rule, it will be sent to email.
|
|
52
|
-
|
|
53
|
-

|
|
54
|
-
|
|
55
|
-
:::note
|
|
56
|
-
|
|
57
|
-
You can set up multiple Email Notifications for different Rules.
|
|
58
|
-
|
|
59
|
-

|
|
60
|
-
|
|
61
|
-
:::
|
|
62
|
-
|
|
63
|
-
:::note
|
|
64
|
-
|
|
65
|
-
When **'Publish a report and use public link in report notification'** option is enabled, the public report will be generated and everyone who has this link will be able to see it.
|
|
66
|
-
|
|
67
|
-

|
|
68
|
-
|
|
69
|
-
:::
|
|
70
|
-
|
|
71
|
-
|
|
@@ -1,52 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: Jira Notifications
|
|
3
|
-
description: Configure Jira notifications in Testomat.io to automate issue creation for failed test runs. This guide explains linking Jira projects, selecting issue types, and setting notification rules to streamline workflows and save time by automating detailed test result reporting.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/integrations/report-notifications/jira
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: keywords
|
|
10
|
-
content: Testomat.io, Jira, automatic issue creation, failed test runs, Notification rules, Report Notifications, Add Notification Rule, Jira project, publish report, public link, basic rules, advanced rules engine, detailed test run results, test management, test automation, software testing
|
|
11
|
-
---
|
|
12
|
-
|
|
13
|
-
Testomat.io allows to create Jira issue for failed test runs automatically. This option can be enabled in **Settings**.
|
|
14
|
-
To do this, you need to connect Jira project with Testomat.io. Please see dedicated documentation - [Connecting to JIRA project.](https://docs.testomat.io/integration/jira/#connecting-to-jira-project)
|
|
15
|
-
|
|
16
|
-
After the Jira is connected with Testomat.io, go to the **Settings (1) -> Report Notifications(2)** and click on **Add Notification Rule (3)**.
|
|
17
|
-
|
|
18
|
-

|
|
19
|
-
|
|
20
|
-
To create a new Notification Rule for Jira follow next steps:
|
|
21
|
-
|
|
22
|
-
1. Add a title for Notification Rule.
|
|
23
|
-
2. Choose **Jira** from the dropdown list.
|
|
24
|
-
|
|
25
|
-

|
|
26
|
-
|
|
27
|
-
3. Select your dedicated Jira project from **Jira Project** dropdown list.
|
|
28
|
-
4. Select needed issue type from **Issue Type** dropdown list.
|
|
29
|
-
5. Select **'Publish a report and use public link in report notification'** option, if you need it.
|
|
30
|
-
6. Configure rules to define on which conditions this notification should be sent in **BASIC RULES** section
|
|
31
|
-
|
|
32
|
-
OR
|
|
33
|
-
|
|
34
|
-
use **ADVANCED RULES ENGINE** to enter your rule expression.
|
|
35
|
-
|
|
36
|
-
7. Click on **Save** button.
|
|
37
|
-
|
|
38
|
-
| **Basic Rules** | **Advanced Rules Engine** |
|
|
39
|
-
| --------------------------- | ------------------------------------- |
|
|
40
|
-
|  |  |
|
|
41
|
-
|
|
42
|
-
Now Testomat.io will create an issue with detailed information on Test Run results within your Jira project for failed Test Runs. So you don't need to put all the data on each Test Run manually. This helps to save time and notify all contributors in a convenient way.
|
|
43
|
-
|
|
44
|
-

|
|
45
|
-
|
|
46
|
-
:::note
|
|
47
|
-
|
|
48
|
-
When **'Publish a report and use public link in report notification'** option is enabled, the public report will be generated and everyone who has this link will be able to see it.
|
|
49
|
-
|
|
50
|
-

|
|
51
|
-
|
|
52
|
-
:::
|
|
@@ -1,60 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: Microsoft Teams Notifications
|
|
3
|
-
description: Configure Microsoft Teams notifications in Testomat.io to receive test updates. This guide provides detailed steps for setting up incoming webhooks in Teams, generating a Webhook URL, and linking it with Testomat.io for seamless test result notifications.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/integrations/report-notifications/ms-teams
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: keywords
|
|
10
|
-
content: Microsoft Teams integration, Testomat.io, failed test runs, Notification rules, Report Notifications, Add Notification Rule, publish report, public link, basic rules, advanced rules engine, detailed test run results, test management, test automation, software testing
|
|
11
|
-
---
|
|
12
|
-
|
|
13
|
-
To send noitifcations in MS Teams, first you need to set up **Incoming Webhooks** for your channel.
|
|
14
|
-
|
|
15
|
-
Steps to configure:
|
|
16
|
-
|
|
17
|
-
1. Navigate to **Apps** panel.
|
|
18
|
-
2. Search for **Incoming Webhook** and add it ([read more here](https://learn.microsoft.com/en-us/microsoftteams/platform/webhooks-and-connectors/how-to/add-incoming-webhook?tabs=newteams%2Cdotnet)).
|
|
19
|
-
|
|
20
|
-

|
|
21
|
-
|
|
22
|
-
3. Configure it and copy Webhook URL.
|
|
23
|
-
|
|
24
|
-

|
|
25
|
-
|
|
26
|
-
After Teams is Set up, open your Project in Testomat.io and go to the **Settings (1) -> Report Notifications(2)** and click on **Add Notification Rule (3)**.
|
|
27
|
-
|
|
28
|
-

|
|
29
|
-
|
|
30
|
-
Create a new Notification Rule for Teams in Testomat.io following next steps:
|
|
31
|
-
|
|
32
|
-
1. Add a title for Notification Rule.
|
|
33
|
-
2. Choose **Microsoft Teams** from the dropdown list.
|
|
34
|
-
|
|
35
|
-

|
|
36
|
-
|
|
37
|
-
3. Paste Teams Webhook URL.
|
|
38
|
-
4. Select **'Publish a report and use public link in report notification'** option, if you need it.
|
|
39
|
-
5. Configure rules to define on which conditions this notification should be sent in **BASIC RULES** section
|
|
40
|
-
|
|
41
|
-
OR
|
|
42
|
-
|
|
43
|
-
using **ADVANCED RULES ENGINE** to enter your rule expression.
|
|
44
|
-
|
|
45
|
-
6. Click on **Save** button.
|
|
46
|
-
|
|
47
|
-
| **Basic Rules** | **Advanced Rules Engine** |
|
|
48
|
-
| --------------------------- | ------------------------------------- |
|
|
49
|
-
|  |  |
|
|
50
|
-
|
|
51
|
-
**How does it work?**
|
|
52
|
-
Each time Testomat.io creates Run Report, which corresponds to your Teams Notification Rule, it will be sent to selected Teams channel.
|
|
53
|
-
|
|
54
|
-
:::note
|
|
55
|
-
|
|
56
|
-
When **'Publish a report and use public link in report notification'** option is enabled, the public report will be generated and everyone who has this link will be able to see it.
|
|
57
|
-
|
|
58
|
-

|
|
59
|
-
|
|
60
|
-
:::
|
|
@@ -1,267 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: Notification Rules
|
|
3
|
-
description: Learn how to configure and manage notifications in Testomat.io for various channels, including Email, Slack, MS Teams, and Jira. This guide covers setting up notification rules, both basic and advanced, and demonstrates how to send alerts based on specific test run conditions. Streamline communication with automatic notifications for failed tests, test completion, and other custom triggers.
|
|
4
|
-
type: article
|
|
5
|
-
url: https://docs.testomat.io/integrations/report-notifications/rules
|
|
6
|
-
head:
|
|
7
|
-
- tag: meta
|
|
8
|
-
attrs:
|
|
9
|
-
name: og:image
|
|
10
|
-
content: https://docs.testomat.io/_astro/Basic_Rules.BGM4UhZJ_Z1Yiri8.webp
|
|
11
|
-
|
|
12
|
-
- tag: meta
|
|
13
|
-
attrs:
|
|
14
|
-
name: keywords
|
|
15
|
-
content: Testomat.io, notifications, Email alerts, Email notifications, Slack notifications, MS Teams, Jira integration, Jira Notification, Azure DevOps, Telegram notification, Notification rules, test runs, automated alerts, CI notifications, QA tools, notification channels, Report Notification, Basic rules, Advanced rules engine, Run Group Notifications, test management, test automation, software testing
|
|
16
|
-
---
|
|
17
|
-
|
|
18
|
-
**Notification** is one of the attractive Agile testing tool features. Test management web application Testomat.io provides for collaborative purposes notification QA team, development team and business. So, keeping the teams engaged with project updates and getting fast feedback from business owners is simpler than ever! In addition, you as the test manager or team owner through **Team Management Dashboard** will have end-to-end visibility on your collaboration process.
|
|
19
|
-
|
|
20
|
-
**Available to notify by:**
|
|
21
|
-
|
|
22
|
-
- **Email** notifications.
|
|
23
|
-
- **Slack** notification.
|
|
24
|
-
- **Microsoft Teams** notification.
|
|
25
|
-
- **Jira** notification.
|
|
26
|
-
- **Azure DevOps** notification.
|
|
27
|
-
- **Telegram** notification.
|
|
28
|
-
|
|
29
|
-
Testomat.io allows sending notifications for finished runs:
|
|
30
|
-
|
|
31
|
-
- Send brief reports to stakeholders.
|
|
32
|
-
- Notify team members of failed or passed tests.
|
|
33
|
-
- Notify test results after test executions.
|
|
34
|
-
- Configure on which condition notification should be sent.
|
|
35
|
-
|
|
36
|
-
Testomat.io has powerful rule engine which can be used to define on which conditions a notification should be sent. You can have multiple notification types with different notification channels in use for a single project.
|
|
37
|
-
|
|
38
|
-

|
|
39
|
-
|
|
40
|
-
## How to Setup Notification
|
|
41
|
-
|
|
42
|
-
Sending configuration thanks to seamless integration is really simple. Enable notification you can on **Settings Dashboard** -> **Report Notification**. You are free to select an environment and configure condition notification should be sent. Simply fill the fields using **Basic rules**. Then modify your notification scheme to notify a group of people of your choice. Also, notification settings might be configured through the **Advanced rules engine** with using variables.
|
|
43
|
-
|
|
44
|
-
You can read more about how to setup your notification in the sections below.
|
|
45
|
-
|
|
46
|
-
## Basic Rules
|
|
47
|
-
|
|
48
|
-
There is a basic and advanced rules engine.
|
|
49
|
-
|
|
50
|
-
Inside Basic rules you can define simple conditions on which notifications should be sent:
|
|
51
|
-
|
|
52
|
-
1. Runs with title.
|
|
53
|
-
2. Runs of RunGroup with title.
|
|
54
|
-
3. Run Type.
|
|
55
|
-
4. Run Status.
|
|
56
|
-
|
|
57
|
-

|
|
58
|
-
|
|
59
|
-
For instance, here is the rule for all manual runs with **"Release"** word in title to be reported:
|
|
60
|
-
|
|
61
|
-

|
|
62
|
-
|
|
63
|
-
## Quick Toggle for Report Notifications
|
|
64
|
-
You can enable or disable report notifications directly from the notification profile using a quick toggle. Switch notifications on or off without changing the full configuration. This is useful when notifications need to be temporarily paused during debugging or active development.
|
|
65
|
-
|
|
66
|
-
## Advanced Rules
|
|
67
|
-
|
|
68
|
-
The advanced rules engine allows writing conditions in a special expression language similar to Ruby or JavaScript.
|
|
69
|
-
|
|
70
|
-
This is the same rule we defined previously in Basic mode written in the format of Advanced mode. A notification will be sent for all manual runs that contain the word "Release":
|
|
71
|
-
|
|
72
|
-
```
|
|
73
|
-
manual and contains(run, "Release")
|
|
74
|
-
```
|
|
75
|
-
|
|
76
|
-
A complete list of allowed variables:
|
|
77
|
-
|
|
78
|
-
- `automated` - boolean. True if a run is automated
|
|
79
|
-
- `manual` - boolean. True if a run is manual
|
|
80
|
-
- `has_failed` - boolean. True if a run has failed
|
|
81
|
-
- `has_passed` - boolean. True if a run has passed
|
|
82
|
-
- `was_terminated` - boolean. True if a run was terminated
|
|
83
|
-
- `run` - string. Title of a run
|
|
84
|
-
- `rungroup` - title. Title of rungroup a run belongs to
|
|
85
|
-
- `status` - string. Status of run, 'passed' or 'failed' as a string.
|
|
86
|
-
- `started_at` - datetime. Time when the run was started.
|
|
87
|
-
- `finished_at` - datetime. Time when the run was finished
|
|
88
|
-
- `passed_tests` - collection. A list of all passed tests in a run.
|
|
89
|
-
- `failed_tests` - collection. A list of all failed tests in a run.
|
|
90
|
-
- `skipped_tests` - collection. A list of all skipped tests in a run.
|
|
91
|
-
- `env` - collection. A list of environments.
|
|
92
|
-
|
|
93
|
-
An expression should return a boolean value. To deal with types other than boolean functions and methods can be used:
|
|
94
|
-
|
|
95
|
-
**String**
|
|
96
|
-
|
|
97
|
-
String values can be checked with equal `==` or not equal `!=` operators. Also there is `contains` function which checks inclusion of a string in another string:
|
|
98
|
-
|
|
99
|
-
```
|
|
100
|
-
contains(run, "New")
|
|
101
|
-
```
|
|
102
|
-
|
|
103
|
-
**Collection**
|
|
104
|
-
|
|
105
|
-
Collections contain an array of objects.
|
|
106
|
-
|
|
107
|
-
Use `.size` to check for the size of items in the collection. For instance, this rule is activated when a number of failed tests is more than 10.
|
|
108
|
-
|
|
109
|
-
```
|
|
110
|
-
failed_tests.size > 10
|
|
111
|
-
```
|
|
112
|
-
|
|
113
|
-
Collection of tests can be filtered. Tests in the collection have following properties:
|
|
114
|
-
|
|
115
|
-
- `test['title']` - title of a test
|
|
116
|
-
- `test['suite']` - title of a suite of a test
|
|
117
|
-
- `test['id']` - id of a test
|
|
118
|
-
- `test['suite_id']` - id of a suite
|
|
119
|
-
- `test['status']` - status of a test in collection
|
|
120
|
-
|
|
121
|
-
For instance, this is how to check if a collection of failed tests contains at least one test with `@important` tag in its name:
|
|
122
|
-
|
|
123
|
-
```
|
|
124
|
-
failed_tests.filter(test, contains(test["title"], "@important")).size > 0
|
|
125
|
-
```
|
|
126
|
-
|
|
127
|
-
**DateTime**
|
|
128
|
-
|
|
129
|
-
`started_at` and `finished_at` variables are of datetime type. They have properties from [Date](https://ruby-doc.org/stdlib-2.6.1/libdoc/date/rdoc/Date.html) and [DateTime](https://ruby-doc.org/stdlib-2.6.1/libdoc/date/rdoc/DateTime.html) classes of Ruby that can be used in expressions. Most used ones are:
|
|
130
|
-
|
|
131
|
-
- `hour`
|
|
132
|
-
- `minute`
|
|
133
|
-
- `day`
|
|
134
|
-
- `wday`
|
|
135
|
-
- `month`
|
|
136
|
-
- `year`
|
|
137
|
-
- [etc](https://ruby-doc.org/stdlib-2.6.1/libdoc/date/rdoc/Date.html)
|
|
138
|
-
|
|
139
|
-
For instance, this is how notification can be enabled for reports finished in non-business time:
|
|
140
|
-
|
|
141
|
-
```
|
|
142
|
-
(finished_at.hour > 18 or finished_at.hour < 9)
|
|
143
|
-
```
|
|
144
|
-
|
|
145
|
-
## Examples
|
|
146
|
-
|
|
147
|
-
**Notify when tests are failing on CI:**
|
|
148
|
-
|
|
149
|
-
To match tests executed on CI specify a Run title with "[CI]" prefix to identify that these tests were executed on CI:
|
|
150
|
-
|
|
151
|
-
```
|
|
152
|
-
TESTOMATIO_TITLE="[CI] Automated Tests"
|
|
153
|
-
```
|
|
154
|
-
|
|
155
|
-
Then write a notification rule that will check only for failing runs with "[CI]" in their title:
|
|
156
|
-
|
|
157
|
-
```
|
|
158
|
-
contains(run, "[CI]") and has_failed
|
|
159
|
-
```
|
|
160
|
-
|
|
161
|
-
**Notify when automated tests are terminated:**
|
|
162
|
-
|
|
163
|
-
```
|
|
164
|
-
automated and was_terminated
|
|
165
|
-
```
|
|
166
|
-
|
|
167
|
-
### Examples for Runs Notifications
|
|
168
|
-
|
|
169
|
-
**Notify when a Run has failed between 10 PM and 9 AM:**
|
|
170
|
-
|
|
171
|
-
```
|
|
172
|
-
has_failed and (finished_at.hour > 22 or finished_at.hour < 9)
|
|
173
|
-
```
|
|
174
|
-
|
|
175
|
-
**Notify when an automated Run has failed on alpha environment:**
|
|
176
|
-
|
|
177
|
-
```
|
|
178
|
-
automated and has_failed and contains (env, "alpha”)
|
|
179
|
-
```
|
|
180
|
-
|
|
181
|
-
**Notify when a Run that contains at least one test with the word "autocomplete" in the title has passed:**
|
|
182
|
-
|
|
183
|
-
```
|
|
184
|
-
has_passed and passed_tests.filter(test, contains(test["title"], "autocomplete")).size > 0
|
|
185
|
-
```
|
|
186
|
-
|
|
187
|
-
For example:
|
|
188
|
-
|
|
189
|
-

|
|
190
|
-
|
|
191
|
-
And Run that matches this Notification rule:
|
|
192
|
-
|
|
193
|
-

|
|
194
|
-
|
|
195
|
-
## Run Group Notifications
|
|
196
|
-
|
|
197
|
-
:::note
|
|
198
|
-
|
|
199
|
-
Please note that Run Group Notifications are available for **Email notification** type only.
|
|
200
|
-
|
|
201
|
-
:::
|
|
202
|
-
|
|
203
|
-
To configure Notification Rule for Run Group you need:
|
|
204
|
-
|
|
205
|
-
1. Select rungroup for Notification rule context
|
|
206
|
-
2. Add your Rule Expression, for example, you can use `rungroup_finished` variable if you want to get notification when all Run report inside the group are finished.
|
|
207
|
-
|
|
208
|
-

|
|
209
|
-
|
|
210
|
-
### Rules for Run Group Notifications
|
|
211
|
-
|
|
212
|
-
The rules engine allows writing conditions in a special expression language similar to Ruby or JavaScript.
|
|
213
|
-
|
|
214
|
-
A list of allowed variables:
|
|
215
|
-
|
|
216
|
-
- `title` - string. Title of a rungroup
|
|
217
|
-
- `rungroup_finished` - boolean. True if all runs completed => True if rungroup contains only finished runs.
|
|
218
|
-
- `runs` - collection. A list of all runs inside a rungroup
|
|
219
|
-
- `finished_runs` - collection. A list of finished (passed or failed) runs inside a rungroup
|
|
220
|
-
- `ongoing_runs` - collection. A list of pending runs (scheduled, in progress) runs inside a rungroup
|
|
221
|
-
- `failed_runs` - collection. A list of failed runs inside a rungroup
|
|
222
|
-
|
|
223
|
-
### Examples for Run Groups Notifications
|
|
224
|
-
|
|
225
|
-
**Notify when all runs within one Run Group (Run Group include more than 1 run) are finished:**
|
|
226
|
-
|
|
227
|
-
```
|
|
228
|
-
(runs.size > 1) and rungroup_finished
|
|
229
|
-
```
|
|
230
|
-
|
|
231
|
-
**Notify when there is at least one run in the `finished_runs` collection whose `finished_at` timestamp is older than 100 seconds ago:**
|
|
232
|
-
|
|
233
|
-
```
|
|
234
|
-
finished_runs.filter(run, run['finished_at'] < 100.seconds_ago).size > 0
|
|
235
|
-
```
|
|
236
|
-
|
|
237
|
-
**Notify when there are no currently ongoing runs in the run Group (means all runs are finished):**
|
|
238
|
-
|
|
239
|
-
```
|
|
240
|
-
ongoing_runs.filter(run, run['created_at'] <= 0.seconds_ago).size == 0
|
|
241
|
-
```
|
|
242
|
-
|
|
243
|
-
**Notify when next rules are met:**
|
|
244
|
-
|
|
245
|
-
- the title of the Run Group contains the substring 'str-' and
|
|
246
|
-
- all runs within this Run Group are finished and
|
|
247
|
-
- at least one of the runs within this Run Group has a title that contains the exact string 'islast: true'
|
|
248
|
-
|
|
249
|
-
```
|
|
250
|
-
contains(title, "str-") and rungroup_finished and (runs.select(run, contains(run["title"], "islast: true")).size > 0)
|
|
251
|
-
```
|
|
252
|
-
|
|
253
|
-
For example:
|
|
254
|
-
|
|
255
|
-

|
|
256
|
-
|
|
257
|
-
And Run Group that matches this Notification rule:
|
|
258
|
-
|
|
259
|
-

|
|
260
|
-
|
|
261
|
-
:::note
|
|
262
|
-
|
|
263
|
-
Testomat.io allows you to check which of your Runs or Run Groups match the created notification rule:
|
|
264
|
-
|
|
265
|
-

|
|
266
|
-
|
|
267
|
-
:::
|