testeiya 0.2.0 → 0.3.1-0.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/LICENSE +21 -0
- package/README.md +304 -132
- package/dist/prompt/context.js +79 -0
- package/dist/prompt/context.js.map +1 -0
- package/dist/prompt/index.js +60 -0
- package/dist/prompt/index.js.map +1 -0
- package/dist/prompt/print.js +30 -0
- package/dist/prompt/print.js.map +1 -0
- package/dist/prompt/project-info.js +2 -0
- package/dist/prompt/project-info.js.map +1 -0
- package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +38 -25
- package/dist/prompt/system-prompt.js.map +1 -0
- package/dist/prompt/testomatio.js +264 -0
- package/dist/prompt/testomatio.js.map +1 -0
- package/dist/prompt/tools.js +70 -0
- package/dist/prompt/tools.js.map +1 -0
- package/dist/prompt/vocab.js +8 -0
- package/dist/prompt/vocab.js.map +1 -0
- package/dist/src/args.js +207 -0
- package/dist/src/args.js.map +1 -0
- package/dist/src/cli.js +114 -0
- package/dist/src/cli.js.map +1 -0
- package/dist/src/doctor.js +171 -0
- package/dist/src/doctor.js.map +1 -0
- package/dist/src/env.js +93 -0
- package/dist/src/env.js.map +1 -0
- package/dist/src/mcp-extension.js +9 -0
- package/dist/src/mcp-extension.js.map +1 -0
- package/dist/src/mcp.js +139 -0
- package/dist/src/mcp.js.map +1 -0
- package/dist/src/model.js +71 -0
- package/dist/src/model.js.map +1 -0
- package/dist/src/models.js +38 -0
- package/dist/src/models.js.map +1 -0
- package/dist/src/output.js +194 -0
- package/dist/src/output.js.map +1 -0
- package/dist/src/result.js +41 -0
- package/dist/src/result.js.map +1 -0
- package/dist/src/run.js +295 -0
- package/dist/src/run.js.map +1 -0
- package/dist/src/session.js +98 -0
- package/dist/src/session.js.map +1 -0
- package/dist/src/sessions.js +72 -0
- package/dist/src/sessions.js.map +1 -0
- package/dist/src/skills.js +88 -0
- package/dist/src/skills.js.map +1 -0
- package/dist/vendor/mcp.js +14801 -0
- package/mcp-tools.json +2967 -0
- package/package.json +34 -42
- package/prompt/context.ts +101 -0
- package/prompt/index.ts +102 -0
- package/prompt/print.ts +32 -0
- package/prompt/project-info.ts +30 -0
- package/prompt/system-prompt.ts +187 -0
- package/{src/prompt → prompt}/testomatio.ts +120 -9
- package/prompt/tools.ts +72 -0
- package/prompt/vocab.ts +7 -0
- package/skills/codeceptjs/ci-fix-tests/SKILL.md +7 -8
- package/skills/codeceptjs/codeceptjs-auth/SKILL.md +47 -64
- package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +56 -47
- package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +144 -106
- package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +50 -57
- package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +88 -196
- package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +4 -5
- package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +25 -36
- package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +23 -36
- package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +23 -36
- package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +23 -35
- package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +50 -53
- package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +87 -191
- package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/SKILL.md +1 -1
- package/{skills.lock.json → skills/skills.lock.json} +43 -36
- package/skills/skills.yaml +34 -0
- package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +49 -61
- package/skills/testomatio/explorbot/explorbot-fundamentals/references/no-install.md +36 -0
- package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +20 -7
- package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +41 -289
- package/skills/testomatio/qa-process/qa-explain-behavior/SKILL.md +111 -0
- package/skills/testomatio/qa-process/qa-explain-behavior/references/answer-shapes.md +116 -0
- package/skills/testomatio/qa-process/qa-explain-behavior/references/examples.md +157 -0
- package/skills/testomatio/qa-process/qa-lead-strategy-advisor/SKILL.md +91 -0
- package/skills/testomatio/qa-process/qa-lead-strategy-advisor/references/output-format.md +71 -0
- package/skills/testomatio/qa-process/testing-workflow/SKILL.md +227 -0
- package/skills/testomatio/test-automation/qa-data-seeder/SKILL.md +83 -0
- package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +5 -3
- package/skills/testomatio/test-automation/setup-change-aware-pr-testing/SKILL.md +190 -0
- package/skills/testomatio/test-automation/setup-ci-automation/SKILL.md +76 -0
- package/skills/testomatio/test-management/qa-split-testing-levels-pyramid/SKILL.md +55 -0
- package/skills/testomatio/test-management/qa-sprint-report-by-testomatio/SKILL.md +220 -0
- package/skills/testomatio/test-management/qa-sprint-report-by-testomatio/references/qa-sprint-report.md +126 -0
- package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +1 -1
- package/skills/testomatio/test-management/qa-thinking/SKILL.md +25 -25
- package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +14 -1
- package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +8 -0
- package/models.catalog.json +0 -6963
- package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
- package/skills/playwright-best-practices-skill/README.md +0 -147
- package/skills/testeiya/README.md +0 -29
- package/skills/testeiya/answer-formatting/SKILL.md +0 -30
- package/skills/testeiya/check-cucumber/SKILL.md +0 -200
- package/skills/testeiya/check-tests/SKILL.md +0 -260
- package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
- package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
- package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
- package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
- package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
- package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
- package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
- package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
- package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
- package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
- package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
- package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
- package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
- package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
- package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
- package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
- package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
- package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
- package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
- package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
- package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
- package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
- package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
- package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
- package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
- package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
- package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
- package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
- package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
- package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
- package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
- package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
- package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
- package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
- package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
- package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
- package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
- package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
- package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
- package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
- package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
- package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
- package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
- package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
- package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
- package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
- package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
- package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
- package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
- package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
- package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
- package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
- package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
- package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
- package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
- package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
- package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
- package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
- package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
- package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
- package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
- package/skills.yaml +0 -21
- package/src/ai-debug.ts +0 -188
- package/src/api/agent-get.ts +0 -22
- package/src/api/agent-start.ts +0 -384
- package/src/api/client-log.ts +0 -29
- package/src/api/context.ts +0 -332
- package/src/api/debug-layout.ts +0 -47
- package/src/api/debug-report.ts +0 -29
- package/src/api/debug-snapshot.ts +0 -30
- package/src/api/debug-stream.ts +0 -52
- package/src/api/files-delete.ts +0 -184
- package/src/api/files-read.ts +0 -41
- package/src/api/files-rename.ts +0 -99
- package/src/api/files-tree.ts +0 -292
- package/src/api/files-write.ts +0 -41
- package/src/api/mcp.ts +0 -603
- package/src/api/memory.ts +0 -69
- package/src/api/open-external.ts +0 -39
- package/src/api/playwright-cli.ts +0 -606
- package/src/api/providers.ts +0 -457
- package/src/api/read-env-token.ts +0 -33
- package/src/api/sessions.ts +0 -79
- package/src/api/settings.ts +0 -120
- package/src/api/skills.ts +0 -58
- package/src/api/testomatio-attachment.ts +0 -89
- package/src/api/testomatio-auth.ts +0 -284
- package/src/api/testomatio-proxy.ts +0 -197
- package/src/api/testomatio-run-stats.ts +0 -81
- package/src/api/testomatio-target.ts +0 -225
- package/src/api/testomatio-transcription.ts +0 -82
- package/src/api/workspace-search.ts +0 -96
- package/src/api/workspace-sync.ts +0 -151
- package/src/api/workspace.ts +0 -165
- package/src/app-server.ts +0 -556
- package/src/bridge.ts +0 -251
- package/src/check-tests.ts +0 -156
- package/src/cli.ts +0 -17
- package/src/commands.ts +0 -244
- package/src/config.ts +0 -183
- package/src/connection.ts +0 -658
- package/src/context-store.ts +0 -265
- package/src/debug-bus.ts +0 -405
- package/src/extensions/tool-gate.ts +0 -220
- package/src/extensions/webui/ask-channel.ts +0 -52
- package/src/extensions/webui/index.ts +0 -184
- package/src/extensions/webui/tools/ask-question.ts +0 -88
- package/src/extensions/webui/tools/query-result.ts +0 -79
- package/src/extensions/webui/tools/render-chart.ts +0 -53
- package/src/extensions/webui/tools/render-item.ts +0 -61
- package/src/extensions/webui/tools/render-list.ts +0 -170
- package/src/extensions/webui/tools/render-result.ts +0 -85
- package/src/extensions/webui/tools/render-tree.ts +0 -71
- package/src/extensions/webui/tools/ui-widget.ts +0 -54
- package/src/extensions/webui/tools/widget-result.ts +0 -13
- package/src/extensions/webui/widget-channel.ts +0 -50
- package/src/file-log.ts +0 -196
- package/src/git-tracked.ts +0 -68
- package/src/gitignore.ts +0 -53
- package/src/json-store.ts +0 -43
- package/src/load-env.ts +0 -70
- package/src/loader-style.ts +0 -96
- package/src/main.ts +0 -140
- package/src/mcp-catalog.ts +0 -96
- package/src/models-catalog.ts +0 -72
- package/src/permissions.ts +0 -120
- package/src/project-dir.ts +0 -189
- package/src/project-info.ts +0 -108
- package/src/prompt/app-ui.ts +0 -59
- package/src/prompt/browser.ts +0 -27
- package/src/prompt/index.ts +0 -62
- package/src/prompt/tools.ts +0 -27
- package/src/server-info.ts +0 -62
- package/src/session-factory.ts +0 -442
- package/src/session-store.ts +0 -115
- package/src/shell-env.ts +0 -45
- package/src/skills.ts +0 -163
- package/src/sync-snapshot.ts +0 -140
- package/src/telemetry.ts +0 -239
- package/src/testomatio-auth.ts +0 -299
- package/src/testomatio.ts +0 -98
- package/src/theme.ts +0 -30
- package/src/user-env.ts +0 -94
- package/src/welcome.ts +0 -127
- package/src/workspace/safe-path.ts +0 -85
- package/src/workspace/test-md.ts +0 -70
- package/src/workspace-model.ts +0 -440
- package/testeiya.config.json +0 -14
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/authentication-flows.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/authentication.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/clock-mocking.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/mobile-testing.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/multi-context.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/multi-user.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/network-advanced.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/advanced/third-party.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/pom-vs-fixtures.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/test-architecture.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/architecture/when-to-mock.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/browser-apis.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/iframes.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/service-workers.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/browser-apis/websockets.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/annotations.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/assertions-waiting.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/configuration.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/fixtures-hooks.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/global-setup.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/locators.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/page-object-model.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/projects-dependencies.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-data.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-suite-structure.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/core/test-tags.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/console-errors.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/debugging.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/error-testing.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/debugging/flaky-tests.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/angular.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/nextjs.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/react.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/frameworks/vue.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/ci-cd.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/docker.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/github-actions.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/gitlab.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/other-providers.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/parallel-sharding.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/performance.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/reporting.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/infrastructure-ci-cd/test-coverage.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/accessibility.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/api-testing.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/browser-extensions.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/canvas-webgl.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/component-testing.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/drag-drop.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/electron.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/file-operations.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/file-upload-download.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/forms-validation.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/graphql-testing.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/i18n.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/performance-testing.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/security-testing.md +0 -0
- /package/skills/{playwright-best-practices-skill → playwright/playwright-best-practices}/testing-patterns/visual-regression.md +0 -0
- /package/skills/{playwright-cli → playwright/playwright-cli}/SKILL.md +0 -0
- /package/skills/{playwright-cli → playwright/playwright-cli}/references/element-attributes.md +0 -0
- /package/skills/{playwright-cli → playwright/playwright-cli}/references/playwright-tests.md +0 -0
- /package/skills/{playwright-cli → playwright/playwright-cli}/references/request-mocking.md +0 -0
- /package/skills/{playwright-cli → playwright/playwright-cli}/references/running-code.md +0 -0
- /package/skills/{playwright-cli → playwright/playwright-cli}/references/session-management.md +0 -0
- /package/skills/{playwright-cli → playwright/playwright-cli}/references/storage-state.md +0 -0
- /package/skills/{playwright-cli → playwright/playwright-cli}/references/test-generation.md +0 -0
- /package/skills/{playwright-cli → playwright/playwright-cli}/references/tracing.md +0 -0
- /package/skills/{playwright-cli → playwright/playwright-cli}/references/video-recording.md +0 -0
|
@@ -0,0 +1,220 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: qa-sprint-report-by-testomatio
|
|
3
|
+
description: Generate a QA Sprint Progress Summary Report from Testomat.io TMS data. Use when the user wants to produce a structured end-of-sprint report covering test design coverage, execution results, defect trends, and quality signals. The skill reads data via Testomat.io MCP tools, maps it to the report sections, and outputs an `.html` file by default (or `.md` if explicitly requested).
|
|
4
|
+
license: MIT
|
|
5
|
+
metadata:
|
|
6
|
+
author: Testomat.io
|
|
7
|
+
version: 1.0.0
|
|
8
|
+
---
|
|
9
|
+
|
|
10
|
+
# QA Sprint Report by Testomat.io
|
|
11
|
+
|
|
12
|
+
## When to Use
|
|
13
|
+
|
|
14
|
+
- End of sprint — produce a shareable QA report for stakeholders.
|
|
15
|
+
- Sprint review — need a structured view of what was tested, passed, failed, blocked.
|
|
16
|
+
- Mid-sprint status — capture current execution progress.
|
|
17
|
+
- The user mentions "sprint report", "QA summary", "sprint progress", or similar.
|
|
18
|
+
|
|
19
|
+
## How to Identify the Sprint
|
|
20
|
+
|
|
21
|
+
The user may identify the sprint in one of these ways (in priority order):
|
|
22
|
+
|
|
23
|
+
1. **Milestone name or ID** — e.g. "Sprint 42", "Sprint 2024.3" — use `milestones_list(type="Sprint")` to find it.
|
|
24
|
+
2. **Run group title** — e.g. "Sprint 42 Run" — use `rungroups_list` / `rungroups_get`.
|
|
25
|
+
3. **Direct run ID or run title** — use `runs_get` or `runs_list`.
|
|
26
|
+
4. **Plan title or ID** — use `plans_list` / `plans_get`.
|
|
27
|
+
5. **No identifier provided** — ask the user to specify the sprint milestone, run group, or run.
|
|
28
|
+
|
|
29
|
+
> If the user provides only a sprint name like "Sprint 42", always resolve it to a concrete milestone/rungroup/run first. Do not assume the title directly maps to an ID.
|
|
30
|
+
|
|
31
|
+
## Rules
|
|
32
|
+
|
|
33
|
+
- **Do not fabricate data.** If MCP does not return a value, use `[None]` or hide the section. Never invent numbers or statuses.
|
|
34
|
+
- **Resolve sprint first.** Never assume a sprint name maps directly to a run ID without verification.
|
|
35
|
+
- **Hide unavailable sections.** If analytics (Section 8) is not available, omit it entirely rather than leaving placeholder text.
|
|
36
|
+
- **One blank line between actions.** In any generated code or CLI snippets.
|
|
37
|
+
- **Use TQL for filtering.** Always prefer `tql` filters over client-side filtering when calling `runs_list`, `tests_list`, `testruns_list`.
|
|
38
|
+
- **HTML is the default output.** Generate `.html` first; only offer `.md` if the user explicitly asks for it or their initial prompt includes a request to save as `.md`.
|
|
39
|
+
|
|
40
|
+
---
|
|
41
|
+
|
|
42
|
+
# MCP Tools Mapping
|
|
43
|
+
|
|
44
|
+
Each report section maps to specific MCP tools. See the full section structure and metrics in the template:
|
|
45
|
+
|
|
46
|
+
- [qa-sprint-report.md](./references/qa-sprint-report.md) — section layout with fill-in placeholders
|
|
47
|
+
|
|
48
|
+
### Quick Commands
|
|
49
|
+
|
|
50
|
+
| Action | MCP Tool | Key Parameters |
|
|
51
|
+
|--------|----------|----------------|
|
|
52
|
+
| Find sprint milestone | `milestones_list` | `type="Sprint"`, `status="active"` |
|
|
53
|
+
| List runs for sprint | `runs_list` | `tql`: `milestone == '{id}'` |
|
|
54
|
+
| Get run details | `runs_get` | `run_id` |
|
|
55
|
+
| Get test results | `testruns_list` | `run_id`, `filter_status` |
|
|
56
|
+
| Get suite tests | `tests_list` | `suite_id`, `per_page=100` |
|
|
57
|
+
| Check analytics availability | `system_ping` | (Enterprise flag in response) |
|
|
58
|
+
| Get test health analytics | `analytics_tests` | `kind`, `days`, `from`, `to` |
|
|
59
|
+
| Get stats analytics | `analytics_stats` | `kind`, `from`, `to` |
|
|
60
|
+
|
|
61
|
+
---
|
|
62
|
+
|
|
63
|
+
# Workflow
|
|
64
|
+
|
|
65
|
+
### Step 1: Resolve Sprint Identity
|
|
66
|
+
|
|
67
|
+
Ask the user if no sprint identifier is provided. Try to resolve:
|
|
68
|
+
|
|
69
|
+
```
|
|
70
|
+
1. milestones_list(type="Sprint") — find milestone matching sprint name
|
|
71
|
+
2. rungroups_list — find rungroup with sprint title
|
|
72
|
+
3. runs_list(tql="title % 'Sprint N'") — find runs by title
|
|
73
|
+
```
|
|
74
|
+
|
|
75
|
+
### Step 2: Gather Sprint Metadata & Time Range
|
|
76
|
+
|
|
77
|
+
Collect for the report header:
|
|
78
|
+
|
|
79
|
+
- `milestones_get(milestone_id)` or `rungroups_get(rungroup_id)` for sprint title/dates.
|
|
80
|
+
- Ask user for QA Lead name if not in TMS.
|
|
81
|
+
|
|
82
|
+
**Critical: Extract Sprint Time Range**
|
|
83
|
+
|
|
84
|
+
Resolve the sprint time range in this priority order:
|
|
85
|
+
|
|
86
|
+
1. **User-provided** — If the user specified a time range in their original prompt, use it.
|
|
87
|
+
2. **Milestone/Rungroup dates** — Extract `start_date` / `due_date` from `milestones_get` or `rungroups_get`.
|
|
88
|
+
3. **Run timestamps** — If milestone/rungroup has no dates, derive from earliest `created_at` and latest `finished_at` across the sprint's runs (`runs_get`).
|
|
89
|
+
4. **Manual input** — If no time range can be determined from TMS, ask the user to specify the sprint period manually.
|
|
90
|
+
|
|
91
|
+
The time range is required for:
|
|
92
|
+
- `analytics_tests(kind="...", from="YYYY-MM-DD", to="YYYY-MM-DD")`
|
|
93
|
+
- `analytics_stats(kind="...", from="YYYY-MM-DD", to="YYYY-MM-DD")`
|
|
94
|
+
- Filtering runs by sprint period
|
|
95
|
+
|
|
96
|
+
### Step 3: Collect Run Data
|
|
97
|
+
|
|
98
|
+
1. `runs_list(tql="milestone == '{id}'")` — all runs for the sprint milestone
|
|
99
|
+
2. For each run, call `runs_get` to get status, counts, environments
|
|
100
|
+
3. `testruns_list(run_id, filter_status)` — get passed/failed/skipped per run
|
|
101
|
+
|
|
102
|
+
### Step 4: Build Report Sections
|
|
103
|
+
|
|
104
|
+
Iterate sections 1–9 of the template, populating each with MCP data. Apply rules:
|
|
105
|
+
|
|
106
|
+
- If a metric is not available → use `[None]` in the cell
|
|
107
|
+
- If an entire section has no data → hide the section (do not show placeholder text)
|
|
108
|
+
- Section 8 (Analytics) → check `system_ping` response for Enterprise capability; if not available, hide
|
|
109
|
+
|
|
110
|
+
### Step 5: Write Output File
|
|
111
|
+
|
|
112
|
+
Write the filled report to:
|
|
113
|
+
```
|
|
114
|
+
{user-specified-path}/QA_Sprint_Progress_Report_{SprintName}_{YYYY-MM-DD}.html
|
|
115
|
+
```
|
|
116
|
+
|
|
117
|
+
If no path specified, save to current working directory.
|
|
118
|
+
|
|
119
|
+
### Step 6: Offer Markdown Export
|
|
120
|
+
|
|
121
|
+
After writing the `.html` file, ask the user if they also want to export the report as a `.md` file:
|
|
122
|
+
|
|
123
|
+
```
|
|
124
|
+
❓ The report has been saved to `{path}`.
|
|
125
|
+
Would you like to also export it as a `.md` file?
|
|
126
|
+
|
|
127
|
+
1. ✏️ Yes, save as `.md` in the same location
|
|
128
|
+
2. 👍 No, keep the `.html` only
|
|
129
|
+
```
|
|
130
|
+
|
|
131
|
+
**If user picks option 1:**
|
|
132
|
+
1. Convert the HTML content to Markdown format.
|
|
133
|
+
1. Generate ".md" markdown format report using template from the references - [qa-sprint-report.md](./references/qa-sprint-report.md).
|
|
134
|
+
2. Save as `QA_Sprint_Progress_Report_{SprintName}_{YYYY-MM-DD}.md` in the **same directory** as the HTML file.
|
|
135
|
+
|
|
136
|
+
**If user picks option 2:**
|
|
137
|
+
- Confirm the `.html` path and end the workflow.
|
|
138
|
+
|
|
139
|
+
## HTML Template Styling
|
|
140
|
+
|
|
141
|
+
When exporting to HTML, apply the following styles:
|
|
142
|
+
|
|
143
|
+
### Color Palette
|
|
144
|
+
|
|
145
|
+
| Token | Hex | Usage |
|
|
146
|
+
|-------|-----|-------|
|
|
147
|
+
| `--primary-color` | `#6366f1` | Headers, badges, links |
|
|
148
|
+
| `--primary-hover` | `#4f46e5` | Hover states |
|
|
149
|
+
| `--success-color` | `#10b981` | Passed/ready badges |
|
|
150
|
+
| `--danger-color` | `#ef4444` | Failed/blocked badges |
|
|
151
|
+
| `--warning-color` | `#f59e0b` | In-progress badges |
|
|
152
|
+
| `--info-color` | `#3b82f6` | Info badges |
|
|
153
|
+
| `--gray-50` to `--gray-900` | `#f9fafb` → `#111827` | Text hierarchy |
|
|
154
|
+
|
|
155
|
+
### Typography
|
|
156
|
+
|
|
157
|
+
- **Font Family:** Inter (Google Fonts) with fallback: `-apple-system, BlinkMacSystemFont, sans-serif`
|
|
158
|
+
- **Font Weights:** 300 (light), 400 (regular), 500 (medium), 600 (semibold), 700 (bold), 800 (extrabold)
|
|
159
|
+
- **Monospace:** `ui-monospace, SFMono-Regular, Menlo, Monaco, Consolas` — for ticket IDs and code
|
|
160
|
+
- **Icons:** Font Awesome 6.4.0 (`fa-solid`)
|
|
161
|
+
|
|
162
|
+
### Status Badges
|
|
163
|
+
|
|
164
|
+
| Status | Background | Text Color |
|
|
165
|
+
|--------|------------|------------|
|
|
166
|
+
| `passed`, `ready` | `#d1fae5` | `#065f46` |
|
|
167
|
+
| `failed`, `blocked` | `#fee2e2` | `#991b1b` |
|
|
168
|
+
| `progress` | `#fef3c7` | `#92400e` |
|
|
169
|
+
| `info` | `#dbeafe` | `#1e40af` |
|
|
170
|
+
|
|
171
|
+
### Key Elements
|
|
172
|
+
|
|
173
|
+
| Element | Description |
|
|
174
|
+
|---------|-------------|
|
|
175
|
+
| `.main-container` | White glass card (`rgba(255,255,255,0.98)`) with `backdrop-filter: blur(20px)`, max-width 1300px, border-radius 20px |
|
|
176
|
+
| `.header` | Gradient background (`linear-gradient(135deg, #6366f1, #4f46e5)`), white text, flex layout |
|
|
177
|
+
| `.section-card` | White background, 1px border `--gray-200`, border-radius 12px, box-shadow |
|
|
178
|
+
| `.report-table` | Full-width, collapse borders, hover highlight on rows |
|
|
179
|
+
| `.meta-grid` | CSS Grid (`repeat(auto-fit, minmax(220px, 1fr))`), gap 20px |
|
|
180
|
+
| `.instruction-card` | Info box with left 5px border in `--primary-color`, background `#eef2ff` |
|
|
181
|
+
| `.tms-link` | Primary color link with hover underline |
|
|
182
|
+
|
|
183
|
+
### HTML Structure
|
|
184
|
+
|
|
185
|
+
```html
|
|
186
|
+
<div class="main-container">
|
|
187
|
+
<header class="header">
|
|
188
|
+
<div class="header-title">
|
|
189
|
+
<h1>QA Sprint Progress Report</h1>
|
|
190
|
+
<p><i class="fa-solid fa-cubes"></i> [Project Name]</p>
|
|
191
|
+
</div>
|
|
192
|
+
<div class="header-badge">
|
|
193
|
+
<i class="fa-solid fa-calendar-days"></i> Sprint: [Sprint Number]
|
|
194
|
+
</div>
|
|
195
|
+
</header>
|
|
196
|
+
|
|
197
|
+
<section class="instruction-section">
|
|
198
|
+
<div class="instruction-card">
|
|
199
|
+
<h5><i class="fa-solid fa-circle-info"></i> How to Use This Template</h5>
|
|
200
|
+
<ul>...</ul>
|
|
201
|
+
</div>
|
|
202
|
+
</section>
|
|
203
|
+
|
|
204
|
+
<main class="content-section">
|
|
205
|
+
<div class="section-card">
|
|
206
|
+
<div class="section-title"><i class="fa-solid fa-chart-pie"></i> 1. Sprint Summary Scorecard</div>
|
|
207
|
+
<div class="meta-grid">...</div>
|
|
208
|
+
</div>
|
|
209
|
+
<!-- Repeat section-card for each section -->
|
|
210
|
+
</main>
|
|
211
|
+
</div>
|
|
212
|
+
```
|
|
213
|
+
|
|
214
|
+
---
|
|
215
|
+
|
|
216
|
+
# Report Template Reference
|
|
217
|
+
|
|
218
|
+
| Section | Description |
|
|
219
|
+
|---------|-------------|
|
|
220
|
+
| [qa-sprint-report.md](./references/qa-sprint-report.md) | Full template with all sections, emoji, and fill-in placeholders |
|
|
@@ -0,0 +1,126 @@
|
|
|
1
|
+
# QA Sprint Progress Summary Report Example
|
|
2
|
+
|
|
3
|
+
The **QA Sprint Progress Summary Report** provides a structured, end-of-cycle view of all testing activities carried out during a sprint. It captures test design coverage, execution results, defect trends, and quality signals to keep stakeholders informed on product readiness.
|
|
4
|
+
|
|
5
|
+
> All sections and metrics in this report are sourced from **Testomat.io TMS** via MCP tools. If a metric or data point is not available in the TMS, the corresponding section is omitted or the value is set to `[None]`. Sections that rely solely on unavailable data are hidden entirely.
|
|
6
|
+
|
|
7
|
+
## 📋 General Sprint Meta
|
|
8
|
+
* **Project / Stream:** [Project Name / Stream]
|
|
9
|
+
* **QA Manager:** [Your Name]
|
|
10
|
+
* **Sprint Cycle:** [Sprint Number / Name]
|
|
11
|
+
* **Timeline Period:** [DD.MM.YYYY – DD.MM.YYYY]
|
|
12
|
+
|
|
13
|
+
---
|
|
14
|
+
|
|
15
|
+
## 📊 1. Sprint Summary Scorecard
|
|
16
|
+
|
|
17
|
+
| Metric | Value | Notes & Data Source |
|
|
18
|
+
| :--- | :---: | :--- |
|
|
19
|
+
| 🖊️ **New Test Cases Added to TMS** | [N] | Net new TCs authored in Testomat.io during this sprint. |
|
|
20
|
+
| 📋 **Total TCs in Project (End of Sprint)** | [N] | `tests_list` count at sprint close. |
|
|
21
|
+
| ⚙️ **Automation Rate** | [XX%] | Automated TCs ÷ Total TCs — from `analytics_stats(kind="automation-rate-by-date")`. |
|
|
22
|
+
| 📈 **Overall Pass Rate** | [XX%] | From `analytics_stats(kind="success-rate-by-date")` for the sprint window. |
|
|
23
|
+
| 🏁 **Tickets Tested** | [N] | Total number of tickets which were finished during the sprint. |
|
|
24
|
+
| ✅ **Tickets Completed (All Tests Passed)** | [N] | Formally approved and ready for delivery/release -> finished with all passed tests. |
|
|
25
|
+
| 🐛 **Defects/Bugs Identified** | [N] | Newly identified defects during execution. |
|
|
26
|
+
|
|
27
|
+
---
|
|
28
|
+
|
|
29
|
+
## 🛠️ 2. Test Design & Coverage Expansion
|
|
30
|
+
|
|
31
|
+
| Ticket ID | Suite / Feature Area | Test Case Title(s) | Total TCs | TMS State |
|
|
32
|
+
| :--- | :--- | :--- | :---: | :--- |
|
|
33
|
+
| **[PROJ-123]** | Authentication | [TC Title 1]; [TC Title 2] | [N] | [Manual / Automated] |
|
|
34
|
+
| **[PROJ-456]** | Data Export | [TC Title 1] | [N] | [Automated] |
|
|
35
|
+
| **[PROJ-789]** | Data Export | [TC Title 1]; [TC Title 2] | [N] | [Mix: Automated & Manual] |
|
|
36
|
+
| *— No new test cases added —* | | | | |
|
|
37
|
+
|
|
38
|
+
> **TMS State** column: pull from `tests_list` → `state` field (`Manual` / `Automated` / `Mix: Automated & Manual`).
|
|
39
|
+
|
|
40
|
+
---
|
|
41
|
+
|
|
42
|
+
## 🎯 3. Testing Execution Progress by Ticket, Suite
|
|
43
|
+
|
|
44
|
+
> Report group is **Suite** (the primary TMS grouping). Each row corresponds to a Testomat.io Suite. Use `testruns_list(run_id="...")` to populate Passed / Failed / Skipped counts per suite.
|
|
45
|
+
|
|
46
|
+
| Ticket Name / Suite / Feature Area | Run Title | Total TCs | Passed | Failed | Skipped | Blocked | Execution % | Suite Release Status |
|
|
47
|
+
| :--- | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :--- |
|
|
48
|
+
| [Suite Name — e.g. Billing] | [Run Title] | [N] | `[N]` | `[N]` | `[N]` | `[N]` | `[XX]%` | 🟡 In Progress |
|
|
49
|
+
| [Suite Name — e.g. Profile] | [Run Title] | [N] | `[N]` | `[N]` | `[N]` | `[N]` | `[XX]%` | ✅ Completed (All Tests Passed) |
|
|
50
|
+
| [Suite Name — e.g. Analytics] | [Run Title] | [N] | `[N]` | `[N]` | `[N]` | `[N]` | `[XX]%` | 🔴 Blocked |
|
|
51
|
+
| **TOTAL** | | **[N]** | **`[N]`** | **`[N]`** | **`[N]`** | **`[N]`** | **`[XX]%`** | **Overall Pass Rate:** `[XX%]` |
|
|
52
|
+
|
|
53
|
+
> **Status Key:**
|
|
54
|
+
> ✅ **Completed (All Tests Passed):** 100% test execution completed with zero critical defects.
|
|
55
|
+
> 🟡 **In Progress:** Validations are actively running or includes in-progress cases; no major technical hurdles encountered (🟡 >51% pass = In Progress).
|
|
56
|
+
> 🔴 **Blocked:** Discovered failure, issues (🔴<50% pass or blocked).
|
|
57
|
+
|
|
58
|
+
---
|
|
59
|
+
|
|
60
|
+
## ✅ 4. Tickets Moved to Sign-Off (already passed)
|
|
61
|
+
* `[PROJ-XXX]` — `[User Story Name]` | **Verified:** `[DD.MM.YYYY]` | **TMS Run:** `[Link to Testomat.io Run]`
|
|
62
|
+
* `[PROJ-YYY]` — `[User Story Name]` | **Verified:** `[DD.MM.YYYY]` | **TMS Run:** `[Link to Testomat.io Run]`
|
|
63
|
+
* *— No tickets signed off during this period —*
|
|
64
|
+
|
|
65
|
+
---
|
|
66
|
+
|
|
67
|
+
## 🔁 5. Quality Feedback Loop (Returned to Dev)
|
|
68
|
+
* `[PROJ-881]` — *`[Feature Name]`*: `[AC #2 failed: App crashes when session expires / Linked to BUG-99]` (**Return Count:** `[1st time / 2nd time]`)
|
|
69
|
+
* *— No tickets returned to development —*
|
|
70
|
+
|
|
71
|
+
---
|
|
72
|
+
|
|
73
|
+
## 🐛 6. Sprint Bug Tracking
|
|
74
|
+
|
|
75
|
+
| Bug ID | Title / Summary Description | Priority | Linked Ticket |
|
|
76
|
+
| :--- | :--- | :---: | :--- | :--- |
|
|
77
|
+
| `[BUG-001]` | `[Short descriptive bug title]` | 🔴 Critical | `[PROJ-XXX]` |
|
|
78
|
+
| `[BUG-002]` | `[Short descriptive bug title]` | 🟠 Major | `[PROJ-XXX]` |
|
|
79
|
+
| *— No bugs registered this week —* | | |
|
|
80
|
+
|
|
81
|
+
---
|
|
82
|
+
|
|
83
|
+
## 📊 8. TMS Test Health Analytics
|
|
84
|
+
|
|
85
|
+
> Data sourced via MCP `analytics_tests` and `analytics_stats` for the **current sprint period** only in case if you have access to this analytics.
|
|
86
|
+
(If most of the metrics could not be obtained, this section should be removed from the results.)
|
|
87
|
+
|
|
88
|
+
### 8.1 Test Health Overview
|
|
89
|
+
| Metric | Value | Notes |
|
|
90
|
+
| :--- | :---: | :--- |
|
|
91
|
+
| 🔀 **Flaky Tests** | [N] | `analytics_tests(kind="flaky", days=N)` |
|
|
92
|
+
| ⏭️ **Never Executed** | [N] | `analytics_tests(kind="never-executed", maturity_days=N)` |
|
|
93
|
+
| 🌿 **Evergreen (Stable)** | [N] | `analytics_tests(kind="evergreen", days=N)` |
|
|
94
|
+
| ⏭️ **Skipped Tests** | [N] | `analytics_tests(kind="skipped", days=N)` |
|
|
95
|
+
| 🐛 **Tests with Defects** | [N] | `analytics_tests(kind="defects", days=N)` |
|
|
96
|
+
| 🐌 **Slow Tests (>N ms)** | [N] | `analytics_tests(kind="slow", threshold_ms=N)` |
|
|
97
|
+
|
|
98
|
+
### 8.2 Success Rate Trend
|
|
99
|
+
> `analytics_stats(kind="success-rate-by-date", from="DD.MM.YYYY", to="DD.MM.YYYY")`
|
|
100
|
+
|
|
101
|
+
| Date | Success Rate % |
|
|
102
|
+
| :--- | :---: |
|
|
103
|
+
| [DD.MM.YYYY] | [XX%] |
|
|
104
|
+
| [DD.MM.YYYY] | [XX%] |
|
|
105
|
+
| [DD.MM.YYYY] | [XX%] |
|
|
106
|
+
|
|
107
|
+
### 8.3 Execution Volume Trend
|
|
108
|
+
> `analytics_stats(kind="testruns-by-date", from="DD.MM.YYYY", to="DD.MM.YYYY")`
|
|
109
|
+
|
|
110
|
+
| Date | Test Runs Executed |
|
|
111
|
+
| :--- | :---: |
|
|
112
|
+
| [DD.MM.YYYY] | [N] |
|
|
113
|
+
| [DD.MM.YYYY] | [N] |
|
|
114
|
+
|
|
115
|
+
---
|
|
116
|
+
|
|
117
|
+
## 📊 9. Sprint Health & Project Readiness Assessment
|
|
118
|
+
|
|
119
|
+
| Assessment Area | Risk Level | Details & Impact Narrative |
|
|
120
|
+
| :--- | :---: | :--- |
|
|
121
|
+
| 🟢 **Sprint Completion Risk** | `[Green / Yellow / Red]` | Narrative based on execution % and sign-off rate. |
|
|
122
|
+
| 📦 **Spillover / Scope Creep Risk** | `[None / Low / High]` | Highlight any items vulnerable to rolling over into the next cycle. |
|
|
123
|
+
| 🖥️ **Environment & CI/CD Stability** | `[Stable / Degraded]` | Log testing framework bottlenecks, env down times, or pipeline blockers. |
|
|
124
|
+
|
|
125
|
+
**Sprint Summary Overview:**
|
|
126
|
+
[Write a summary 1-5 sentences overview by current sprint based on the provided info from this report.]
|
|
@@ -160,7 +160,7 @@ npx @testomatio/reporter run --kind manual \
|
|
|
160
160
|
|
|
161
161
|
### Step 8: Suggest follow-ups
|
|
162
162
|
|
|
163
|
-
- Wire the map into CI — runs created per PR and launched on preview/merge: delegate to `setup-pr-testing`.
|
|
163
|
+
- Wire the map into CI — runs created per PR and launched on preview/merge: delegate to `setup-change-aware-pr-testing`.
|
|
164
164
|
- Run the affected tests right now from the terminal: delegate to `run-tests-with-testomatio-reporter`.
|
|
165
165
|
- Coverage gaps — source features no test maps to. On approval, propose new cases (delegate to `qa-write-test-cases`).
|
|
166
166
|
- Dead tests — tests whose features no longer exist in source.
|
|
@@ -1,36 +1,36 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: qa-thinking
|
|
3
|
-
description: Analyze a feature a developer is building from a QA perspective — edge cases, negative flows, abuses, unobvious scenarios
|
|
3
|
+
description: Analyze a feature a developer is building from a QA perspective — edge cases, negative flows, abuses, unobvious scenarios. Use when asked "what could go wrong?", "what am I missing?", or "review this as QA".
|
|
4
4
|
---
|
|
5
5
|
|
|
6
|
+
# QA Thinking
|
|
6
7
|
|
|
7
|
-
|
|
8
|
-
The user can explain the idea, or
|
|
8
|
+
Think about a feature like a senior QA engineer and surface risk scenarios.
|
|
9
|
+
The user can explain the idea, or take it from the current branch or PR.
|
|
10
|
+
For a PR, gather intent with the `qa-pr-requirements-analyzer` skill first.
|
|
11
|
+
When the feature's current behavior is unclear, establish it with the `qa-explain-behavior` skill first.
|
|
9
12
|
|
|
10
|
-
Think
|
|
13
|
+
## Think
|
|
11
14
|
|
|
12
|
-
-
|
|
13
|
-
-
|
|
14
|
-
-
|
|
15
|
-
- Combinations:
|
|
16
|
-
-
|
|
17
|
-
- Data consistency:
|
|
18
|
-
-
|
|
19
|
-
- What can be unit tested, what can't be, what should be verified manually? How to verify manually? (do not recommend manually verifying things already unit tested)
|
|
20
|
-
- What end-to-end test scenarios can you recommend?
|
|
21
|
-
- What test coverage do you recommend (percent of unit, e2e, manual)?
|
|
15
|
+
- Positive scenarios.
|
|
16
|
+
- Negative scenarios: possible misuse and failures.
|
|
17
|
+
- Unobvious usage: repeated actions, boundary values, cancellations.
|
|
18
|
+
- Combinations: how this feature interacts with other features.
|
|
19
|
+
- Possible abuses.
|
|
20
|
+
- Data consistency: inputs that create inconsistent state, and how it affects the system later.
|
|
21
|
+
- Security vulnerabilities.
|
|
22
22
|
|
|
23
|
-
Output
|
|
23
|
+
## Output
|
|
24
24
|
|
|
25
|
-
-
|
|
26
|
-
-
|
|
27
|
-
-
|
|
28
|
-
-
|
|
29
|
-
- when asked for more, propose another bunch of test scenarios
|
|
30
|
-
- do not list all automated unit/e2e test scenarios (prefer to generalize them and expand when the user asks you to)
|
|
25
|
+
- Section `👓 What must be clarified`: questions to resolve important ambiguities.
|
|
26
|
+
- Section `🔬 What must be verified`: up to 10 most important risk scenarios, no more.
|
|
27
|
+
- Prefer simple wording and short sentences.
|
|
28
|
+
- When asked for more, propose the next batch of scenarios.
|
|
31
29
|
|
|
32
|
-
|
|
30
|
+
## Next actions
|
|
33
31
|
|
|
34
|
-
|
|
35
|
-
|
|
36
|
-
-
|
|
32
|
+
Offer after the analysis:
|
|
33
|
+
|
|
34
|
+
- Split the scenarios across testing levels → `qa-split-testing-levels-pyramid` skill.
|
|
35
|
+
- Turn scenarios into test cases or a checklist → `qa-write-test-cases` skill.
|
|
36
|
+
- Ambiguities point to requirement defects → `qa-requirement-reviewer` skill.
|
|
@@ -26,7 +26,7 @@ Set up access to Testomat.io via MCP and run QA analysis workflows: run analysis
|
|
|
26
26
|
- Run: `runs_list`, `runs_get`, `runs_search`
|
|
27
27
|
- Testrun (results within a run): `testruns_list`, `testruns_get`
|
|
28
28
|
- Suite: `suites_list`, `suites_get`, `suites_search`
|
|
29
|
-
- Label: `labels_list`, `labels_get`
|
|
29
|
+
- Label: `labels_list`, `labels_get`, `labels_create`, `labels_update`, `labels_delete`. Labels may be scoped (`key:value`). Attach or swap them on entities via the `link` parameter — [MCP Setup Reference](./references/MCP_SETUP.md).
|
|
30
30
|
- Tag: `tags_list`, `tags_get`, `tags_search`
|
|
31
31
|
|
|
32
32
|
**CRUD tools (create, update, delete) exist for all entities. Use them only when explicitly needed for targeted updates.**
|
|
@@ -169,6 +169,16 @@ Goal: turn recurring failures into trackable defects.
|
|
|
169
169
|
- if a Jira MCP is available, offer to create the ticket via the Jira skill
|
|
170
170
|
3. After defect creation, call `tests_issues_link` for each affected test to link it to the defect.
|
|
171
171
|
|
|
172
|
+
### Workflow 5: Update Labels & Tags on Tests
|
|
173
|
+
|
|
174
|
+
Goal: set, change, or remove labels and tags on tests — for example, update a status label that drives a dashboard chart.
|
|
175
|
+
|
|
176
|
+
1. Call `labels_list` (or `project_info`) to read the exact label values that exist in the project, including the full `key:value` form of scoped labels. Do not guess label strings.
|
|
177
|
+
2. Optionally find the tests to update with `tests_list` + TQL: `label == 'regression:yes'`.
|
|
178
|
+
3. Update with `tests_update` (or `tests_create`) using the `link` array — one `{ action, type, value }` entry per change. To change a value (e.g. `regression:no` → `regression:yes`), send a `remove` and an `add` in the same call. The same shape works for `tag`, `custom_field`, `milestone`, `issue`, and `jira`.
|
|
179
|
+
|
|
180
|
+
Link format and a full swap example: [MCP Setup Reference](./references/MCP_SETUP.md).
|
|
181
|
+
|
|
172
182
|
## Quick Commands
|
|
173
183
|
|
|
174
184
|
| Action | MCP Tool | Key Parameters |
|
|
@@ -179,4 +189,7 @@ Goal: turn recurring failures into trackable defects.
|
|
|
179
189
|
| Get test details | `tests_get` | `test_id` |
|
|
180
190
|
| Get plan details | `plans_get` | `plan_id` |
|
|
181
191
|
| Link issue to test | `tests_issues_link` | `test_id`, `url` or `jira_id` |
|
|
192
|
+
| List labels | `labels_list` | `page`, `per_page` |
|
|
193
|
+
| Set / swap label on test | `tests_update` | `test_id`, `link` |
|
|
194
|
+
| Find tests by label | `tests_list` | `tql: label == '...'` |
|
|
182
195
|
| Check server status | `system_ping` | none |
|
|
@@ -140,6 +140,7 @@ Supported operators: `==`, `!=`, `>`, `<`, `>=`, `<=`, `in [...]`, `%` (contains
|
|
|
140
140
|
- `state == 'automated'`
|
|
141
141
|
- `suite % 'Checkout'`
|
|
142
142
|
- `tag IN ['@smoke', '@regression']`
|
|
143
|
+
- `label == 'regression:yes'` (scoped / `key:value` label)
|
|
143
144
|
|
|
144
145
|
**Runs:**
|
|
145
146
|
- `title % 'Manual tests'`
|
|
@@ -166,4 +167,11 @@ Or in MCP client config, pass `NODE_OPTIONS` in the server `env` block.
|
|
|
166
167
|
- **Run status transitions** use `runs_update` with `status_event` values: `finish`, `finish_manual`, `launch`, `rerun`, `scheduled`, `terminate`.
|
|
167
168
|
- **Search** for tests and runs uses `tql` as the single filter input; no dedicated `/search` endpoints.
|
|
168
169
|
- **Issue linking** supports scoped helpers: `tests_issues_link/unlink`, `suites_issues_link/unlink`, `runs_issues_link/unlink`.
|
|
170
|
+
- **Linking labels, tags, milestones, issues** to an entity (test, suite, run, plan, step, snippet) uses the `link` array on `*_create` / `*_update`. Each entry is `{ "action": "add"|"remove", "type": "label"|"custom_field"|"tag"|"milestone"|"issue"|"jira", "value": "<title or Key:Value>" }` (suites also accept `requirement`). `label` and `custom_field` are interchangeable on the backend; pass the full `Key:Value` string as `value` for custom fields. Swap a value in one call by combining `remove` and `add`:
|
|
171
|
+
```json
|
|
172
|
+
"link": [
|
|
173
|
+
{ "action": "remove", "type": "label", "value": "regression:no" },
|
|
174
|
+
{ "action": "add", "type": "label", "value": "regression:yes" }
|
|
175
|
+
]
|
|
176
|
+
```
|
|
169
177
|
- **API Sessions** are automatically managed by the MCP server: a session starts before the first mutating request and stops when the server shuts down.
|