testeiya 0.2.1 → 0.3.9
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/LICENSE +21 -0
- package/README.md +41 -213
- package/dist/prompt/context.js +79 -0
- package/dist/prompt/context.js.map +1 -0
- package/dist/prompt/index.js +56 -0
- package/dist/prompt/index.js.map +1 -0
- package/dist/prompt/print.js +22 -0
- package/dist/prompt/print.js.map +1 -0
- package/dist/prompt/project-info.js +2 -0
- package/dist/prompt/project-info.js.map +1 -0
- package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +24 -21
- package/dist/prompt/system-prompt.js.map +1 -0
- package/dist/prompt/testomatio.js +264 -0
- package/dist/prompt/testomatio.js.map +1 -0
- package/dist/prompt/tools.js +49 -0
- package/dist/prompt/tools.js.map +1 -0
- package/dist/prompt/vocab.js +8 -0
- package/dist/prompt/vocab.js.map +1 -0
- package/dist/src/args.js +72 -0
- package/dist/src/args.js.map +1 -0
- package/dist/src/cli.js +61 -0
- package/dist/src/cli.js.map +1 -0
- package/dist/src/env.js +69 -0
- package/dist/src/env.js.map +1 -0
- package/dist/src/mcp-extension.js +9 -0
- package/dist/src/mcp-extension.js.map +1 -0
- package/dist/src/mcp.js +139 -0
- package/dist/src/mcp.js.map +1 -0
- package/dist/src/model.js +66 -0
- package/dist/src/model.js.map +1 -0
- package/dist/src/result.js +41 -0
- package/dist/src/result.js.map +1 -0
- package/dist/src/run.js +199 -0
- package/dist/src/run.js.map +1 -0
- package/dist/src/session.js +77 -0
- package/dist/src/session.js.map +1 -0
- package/dist/vendor/mcp.js +14801 -0
- package/mcp-tools.json +2967 -0
- package/package.json +29 -42
- package/prompt/context.ts +101 -0
- package/prompt/index.ts +93 -0
- package/prompt/print.ts +23 -0
- package/prompt/project-info.ts +30 -0
- package/prompt/system-prompt.ts +173 -0
- package/{src/prompt → prompt}/testomatio.ts +119 -8
- package/{src/prompt → prompt}/tools.ts +30 -8
- package/prompt/vocab.ts +7 -0
- package/{skills.lock.json → skills/skills.lock.json} +11 -7
- package/skills/skills.yaml +34 -0
- package/assets/testeiya-logo-dark.svg +0 -16
- package/assets/testeiya-logo.svg +0 -15
- package/models.catalog.json +0 -6963
- package/skills/codeceptjs/ci-fix-tests/SKILL.md +0 -120
- package/skills/codeceptjs/codeceptjs-auth/SKILL.md +0 -158
- package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +0 -91
- package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +0 -158
- package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +0 -90
- package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +0 -234
- package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +0 -110
- package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +0 -306
- package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +0 -352
- package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +0 -472
- package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +0 -350
- package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +0 -81
- package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +0 -206
- package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
- package/skills/playwright-best-practices-skill/README.md +0 -147
- package/skills/playwright-best-practices-skill/SKILL.md +0 -303
- package/skills/playwright-best-practices-skill/advanced/authentication-flows.md +0 -360
- package/skills/playwright-best-practices-skill/advanced/authentication.md +0 -871
- package/skills/playwright-best-practices-skill/advanced/clock-mocking.md +0 -364
- package/skills/playwright-best-practices-skill/advanced/mobile-testing.md +0 -409
- package/skills/playwright-best-practices-skill/advanced/multi-context.md +0 -288
- package/skills/playwright-best-practices-skill/advanced/multi-user.md +0 -393
- package/skills/playwright-best-practices-skill/advanced/network-advanced.md +0 -452
- package/skills/playwright-best-practices-skill/advanced/third-party.md +0 -464
- package/skills/playwright-best-practices-skill/architecture/pom-vs-fixtures.md +0 -363
- package/skills/playwright-best-practices-skill/architecture/test-architecture.md +0 -369
- package/skills/playwright-best-practices-skill/architecture/when-to-mock.md +0 -383
- package/skills/playwright-best-practices-skill/browser-apis/browser-apis.md +0 -391
- package/skills/playwright-best-practices-skill/browser-apis/iframes.md +0 -403
- package/skills/playwright-best-practices-skill/browser-apis/service-workers.md +0 -504
- package/skills/playwright-best-practices-skill/browser-apis/websockets.md +0 -403
- package/skills/playwright-best-practices-skill/core/annotations.md +0 -424
- package/skills/playwright-best-practices-skill/core/assertions-waiting.md +0 -361
- package/skills/playwright-best-practices-skill/core/configuration.md +0 -452
- package/skills/playwright-best-practices-skill/core/fixtures-hooks.md +0 -417
- package/skills/playwright-best-practices-skill/core/global-setup.md +0 -434
- package/skills/playwright-best-practices-skill/core/locators.md +0 -242
- package/skills/playwright-best-practices-skill/core/page-object-model.md +0 -315
- package/skills/playwright-best-practices-skill/core/projects-dependencies.md +0 -453
- package/skills/playwright-best-practices-skill/core/test-data.md +0 -492
- package/skills/playwright-best-practices-skill/core/test-suite-structure.md +0 -361
- package/skills/playwright-best-practices-skill/core/test-tags.md +0 -298
- package/skills/playwright-best-practices-skill/debugging/console-errors.md +0 -420
- package/skills/playwright-best-practices-skill/debugging/debugging.md +0 -504
- package/skills/playwright-best-practices-skill/debugging/error-testing.md +0 -360
- package/skills/playwright-best-practices-skill/debugging/flaky-tests.md +0 -496
- package/skills/playwright-best-practices-skill/frameworks/angular.md +0 -530
- package/skills/playwright-best-practices-skill/frameworks/nextjs.md +0 -469
- package/skills/playwright-best-practices-skill/frameworks/react.md +0 -531
- package/skills/playwright-best-practices-skill/frameworks/vue.md +0 -574
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/ci-cd.md +0 -468
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/docker.md +0 -283
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/github-actions.md +0 -546
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/gitlab.md +0 -397
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/other-providers.md +0 -521
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/parallel-sharding.md +0 -371
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/performance.md +0 -453
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/reporting.md +0 -424
- package/skills/playwright-best-practices-skill/infrastructure-ci-cd/test-coverage.md +0 -497
- package/skills/playwright-best-practices-skill/testing-patterns/accessibility.md +0 -359
- package/skills/playwright-best-practices-skill/testing-patterns/api-testing.md +0 -719
- package/skills/playwright-best-practices-skill/testing-patterns/browser-extensions.md +0 -506
- package/skills/playwright-best-practices-skill/testing-patterns/canvas-webgl.md +0 -493
- package/skills/playwright-best-practices-skill/testing-patterns/component-testing.md +0 -500
- package/skills/playwright-best-practices-skill/testing-patterns/drag-drop.md +0 -576
- package/skills/playwright-best-practices-skill/testing-patterns/electron.md +0 -509
- package/skills/playwright-best-practices-skill/testing-patterns/file-operations.md +0 -377
- package/skills/playwright-best-practices-skill/testing-patterns/file-upload-download.md +0 -562
- package/skills/playwright-best-practices-skill/testing-patterns/forms-validation.md +0 -561
- package/skills/playwright-best-practices-skill/testing-patterns/graphql-testing.md +0 -331
- package/skills/playwright-best-practices-skill/testing-patterns/i18n.md +0 -508
- package/skills/playwright-best-practices-skill/testing-patterns/performance-testing.md +0 -476
- package/skills/playwright-best-practices-skill/testing-patterns/security-testing.md +0 -430
- package/skills/playwright-best-practices-skill/testing-patterns/visual-regression.md +0 -634
- package/skills/playwright-cli/SKILL.md +0 -420
- package/skills/playwright-cli/references/element-attributes.md +0 -23
- package/skills/playwright-cli/references/playwright-tests.md +0 -39
- package/skills/playwright-cli/references/request-mocking.md +0 -87
- package/skills/playwright-cli/references/running-code.md +0 -241
- package/skills/playwright-cli/references/session-management.md +0 -225
- package/skills/playwright-cli/references/storage-state.md +0 -275
- package/skills/playwright-cli/references/test-generation.md +0 -433
- package/skills/playwright-cli/references/tracing.md +0 -139
- package/skills/playwright-cli/references/video-recording.md +0 -143
- package/skills/testeiya/README.md +0 -29
- package/skills/testeiya/answer-formatting/SKILL.md +0 -30
- package/skills/testeiya/check-cucumber/SKILL.md +0 -200
- package/skills/testeiya/check-tests/SKILL.md +0 -260
- package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
- package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
- package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
- package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
- package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
- package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
- package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
- package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
- package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
- package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
- package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
- package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
- package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
- package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
- package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
- package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
- package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
- package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
- package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
- package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
- package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
- package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
- package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
- package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
- package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
- package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
- package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
- package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
- package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
- package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
- package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
- package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
- package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
- package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
- package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
- package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
- package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
- package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
- package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
- package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
- package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
- package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
- package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
- package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
- package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
- package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
- package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
- package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
- package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
- package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
- package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
- package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
- package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
- package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
- package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
- package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
- package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
- package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
- package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
- package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
- package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
- package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
- package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
- package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
- package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
- package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
- package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
- package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
- package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
- package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
- package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
- package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
- package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
- package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
- package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
- package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +0 -88
- package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +0 -95
- package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +0 -334
- package/skills/testomatio/test-automation/automate-manual-test-cases/CLAUDE.md +0 -56
- package/skills/testomatio/test-automation/automate-manual-test-cases/SKILL.md +0 -242
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/CODECEPTJS_BEST_PRACTICES.md +0 -182
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/FINAL_SUMMARY_TEMPLATE.md +0 -22
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/PLAYWRIGHT_BEST_PRACTICES.md +0 -90
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/POM_BEST_PRACTICES.md +0 -53
- package/skills/testomatio/test-automation/automate-manual-test-cases/references/TEST_DATA_MANAGEMENT.md +0 -52
- package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/SKILL.md +0 -107
- package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/references/DEBUGGING_QUICK_REFERENCE.md +0 -113
- package/skills/testomatio/test-automation/qa-automation-test-consolidation/SKILL.md +0 -29
- package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +0 -151
- package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
- package/skills/testomatio/test-automation/testomat-allure-adapter/SKILL.md +0 -289
- package/skills/testomatio/test-management/detect-duplicate-test-cases/SKILL.md +0 -86
- package/skills/testomatio/test-management/detect-duplicate-test-cases/references/DUPLICATE_INSTRUCTIONS.md +0 -54
- package/skills/testomatio/test-management/improve-test-cases/SKILL.md +0 -114
- package/skills/testomatio/test-management/improve-test-cases/references/TESTOMAT_MARKDOWN_EXAMPLE.md +0 -66
- package/skills/testomatio/test-management/pull-request-diff-analyzer/SKILL.md +0 -141
- package/skills/testomatio/test-management/qa-e2e-tests-reporting/SKILL.md +0 -354
- package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_ARTIFACTS.md +0 -82
- package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_HTML_REPORT.md +0 -37
- package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_REPORTERS_CONFIG.md +0 -118
- package/skills/testomatio/test-management/qa-pr-requirements-analyzer/SKILL.md +0 -149
- package/skills/testomatio/test-management/qa-pr-requirements-analyzer/references/summary-example.md +0 -54
- package/skills/testomatio/test-management/qa-requirement-reviewer/SKILL.md +0 -126
- package/skills/testomatio/test-management/qa-requirement-reviewer/references/requirements_reviewer_examples.md +0 -128
- package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +0 -174
- package/skills/testomatio/test-management/qa-test-code-coverage/references/COVERAGE_FILE_FORMAT.md +0 -138
- package/skills/testomatio/test-management/qa-test-code-coverage/references/E2E_FRAMEWORKS.md +0 -65
- package/skills/testomatio/test-management/qa-test-code-coverage/scripts/check-coverage.mjs +0 -40
- package/skills/testomatio/test-management/qa-thinking/SKILL.md +0 -36
- package/skills/testomatio/test-management/qa-write-test-cases/SKILL.md +0 -267
- package/skills/testomatio/test-management/qa-write-test-cases/references/test-case-format.md +0 -387
- package/skills/testomatio/test-management/qa-write-test-cases/references/testomat-tms-guide.md +0 -72
- package/skills/testomatio/test-management/qa-write-test-cases/references/writing-rule.md +0 -159
- package/skills/testomatio/test-management/scan-automation-project/SKILL.md +0 -152
- package/skills/testomatio/test-management/sync-test-cases-with-tms/SKILL.md +0 -107
- package/skills/testomatio/test-management/sync-test-cases-with-tms/references/TESTOMATIO_CLI.md +0 -140
- package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +0 -182
- package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +0 -169
- package/skills.yaml +0 -21
- package/src/ai-debug.ts +0 -188
- package/src/api/agent-get.ts +0 -22
- package/src/api/agent-start.ts +0 -384
- package/src/api/client-log.ts +0 -29
- package/src/api/context.ts +0 -332
- package/src/api/debug-layout.ts +0 -47
- package/src/api/debug-report.ts +0 -29
- package/src/api/debug-snapshot.ts +0 -30
- package/src/api/debug-stream.ts +0 -52
- package/src/api/files-delete.ts +0 -184
- package/src/api/files-read.ts +0 -41
- package/src/api/files-rename.ts +0 -99
- package/src/api/files-tree.ts +0 -292
- package/src/api/files-write.ts +0 -41
- package/src/api/mcp.ts +0 -603
- package/src/api/memory.ts +0 -69
- package/src/api/open-external.ts +0 -39
- package/src/api/playwright-cli.ts +0 -606
- package/src/api/providers.ts +0 -457
- package/src/api/read-env-token.ts +0 -33
- package/src/api/sessions.ts +0 -79
- package/src/api/settings.ts +0 -120
- package/src/api/skills.ts +0 -58
- package/src/api/testomatio-attachment.ts +0 -89
- package/src/api/testomatio-auth.ts +0 -284
- package/src/api/testomatio-proxy.ts +0 -197
- package/src/api/testomatio-run-stats.ts +0 -81
- package/src/api/testomatio-target.ts +0 -225
- package/src/api/testomatio-transcription.ts +0 -82
- package/src/api/workspace-search.ts +0 -96
- package/src/api/workspace-sync.ts +0 -151
- package/src/api/workspace.ts +0 -165
- package/src/app-server.ts +0 -556
- package/src/bridge.ts +0 -251
- package/src/check-tests.ts +0 -156
- package/src/cli.ts +0 -17
- package/src/commands.ts +0 -244
- package/src/config.ts +0 -183
- package/src/connection.ts +0 -658
- package/src/context-store.ts +0 -265
- package/src/debug-bus.ts +0 -405
- package/src/extensions/tool-gate.ts +0 -220
- package/src/extensions/webui/ask-channel.ts +0 -52
- package/src/extensions/webui/index.ts +0 -184
- package/src/extensions/webui/tools/ask-question.ts +0 -88
- package/src/extensions/webui/tools/query-result.ts +0 -79
- package/src/extensions/webui/tools/render-chart.ts +0 -53
- package/src/extensions/webui/tools/render-item.ts +0 -61
- package/src/extensions/webui/tools/render-list.ts +0 -170
- package/src/extensions/webui/tools/render-result.ts +0 -85
- package/src/extensions/webui/tools/render-tree.ts +0 -71
- package/src/extensions/webui/tools/ui-widget.ts +0 -54
- package/src/extensions/webui/tools/widget-result.ts +0 -13
- package/src/extensions/webui/widget-channel.ts +0 -50
- package/src/file-log.ts +0 -196
- package/src/git-tracked.ts +0 -68
- package/src/gitignore.ts +0 -53
- package/src/json-store.ts +0 -43
- package/src/load-env.ts +0 -70
- package/src/loader-style.ts +0 -96
- package/src/main.ts +0 -140
- package/src/mcp-catalog.ts +0 -96
- package/src/models-catalog.ts +0 -72
- package/src/permissions.ts +0 -120
- package/src/project-dir.ts +0 -189
- package/src/project-info.ts +0 -108
- package/src/prompt/app-ui.ts +0 -59
- package/src/prompt/browser.ts +0 -27
- package/src/prompt/index.ts +0 -62
- package/src/server-info.ts +0 -62
- package/src/session-factory.ts +0 -442
- package/src/session-store.ts +0 -115
- package/src/shell-env.ts +0 -45
- package/src/skills.ts +0 -163
- package/src/sync-snapshot.ts +0 -140
- package/src/telemetry.ts +0 -239
- package/src/testomatio-auth.ts +0 -299
- package/src/testomatio.ts +0 -98
- package/src/theme.ts +0 -30
- package/src/user-env.ts +0 -94
- package/src/welcome.ts +0 -194
- package/src/workspace/safe-path.ts +0 -85
- package/src/workspace/test-md.ts +0 -70
- package/src/workspace-model.ts +0 -440
- package/testeiya.config.json +0 -14
package/skills/testomatio/test-management/qa-write-test-cases/references/testomat-tms-guide.md
DELETED
|
@@ -1,72 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
title: Testomat.io TMS Integration Guide
|
|
3
|
-
description: Essential reference for generating Testomat.io-compatible test cases. Covers structure, MCP tools, conventions, and best practices.
|
|
4
|
-
---
|
|
5
|
-
|
|
6
|
-
# Testomat.io TMS Integration Guide
|
|
7
|
-
|
|
8
|
-
Quick reference for generating test cases compatible with Testomat.io Test Management System.
|
|
9
|
-
|
|
10
|
-
Follow this guide along with [Test Case Format](./test-case-format.md).
|
|
11
|
-
|
|
12
|
-
## Structure
|
|
13
|
-
|
|
14
|
-
```
|
|
15
|
-
Folder (top-level)
|
|
16
|
-
└── Suite {title} (@S{id})
|
|
17
|
-
└── Test {title} (@T{id}) → has tags (e.g. @smoke), labels, priority (e.g. high)
|
|
18
|
-
```
|
|
19
|
-
|
|
20
|
-
Priority values: `critical`, `high`, `normal`, `low`.
|
|
21
|
-
|
|
22
|
-
## Key MCP Tools
|
|
23
|
-
|
|
24
|
-
| Purpose | Entities / tools |
|
|
25
|
-
| --------------- | ------------------------------------------------------------------------------------------ |
|
|
26
|
-
| **Structure** | `suites_list`, `suites_search`, `tests_list`, `tests_search`, `steps_list`, `steps_search` |
|
|
27
|
-
| **Conventions** | `tags_list`, `labels_list` |
|
|
28
|
-
|
|
29
|
-
**Key actions:**
|
|
30
|
-
|
|
31
|
-
- `tests_search` - **Always use before creating new cases** to avoid duplicates
|
|
32
|
-
- `steps_search` - Find reusable shared steps before writing new ones
|
|
33
|
-
|
|
34
|
-
## Use tags and labels
|
|
35
|
-
|
|
36
|
-
Add them based on context, user prompt, existing tags and labels.
|
|
37
|
-
|
|
38
|
-
Split tests by module, testing type, scope and other criteria which helps to organize and filter tests.
|
|
39
|
-
|
|
40
|
-
### When to use Tags vs Labels
|
|
41
|
-
|
|
42
|
-
| Aspect | Tags | Labels |
|
|
43
|
-
| --------------- | -------------------------------------- | ------------------------------------- |
|
|
44
|
-
| **Best for** | Broad categorization | Specific metadata |
|
|
45
|
-
| **Use for** | Test type (@smoke, @regression, @e2e) | Priority, severity, status, ownership |
|
|
46
|
-
| **Flexibility** | Constant, embedded in code | Flexible, easy to change via UI |
|
|
47
|
-
| **Values** | Single tag per category | Multiple values per label allowed |
|
|
48
|
-
| **Examples** | `@smoke`, `@api`, `@auth`, `@checkout` | |
|
|
49
|
-
|
|
50
|
-
**Rule of thumb:** Use tags for test categorization and automation; use labels for test metadata, workflow tracking, and manual test management.
|
|
51
|
-
|
|
52
|
-
## Deduplication Workflow
|
|
53
|
-
|
|
54
|
-
```
|
|
55
|
-
1. tests_search() → Find existing tests
|
|
56
|
-
2. Compare → Exact match? → Notify user, let user decide to skip or not
|
|
57
|
-
3. Partial overlap? → Ask user
|
|
58
|
-
4. No match? → Create new test cases
|
|
59
|
-
```
|
|
60
|
-
|
|
61
|
-
## Quality Checklist
|
|
62
|
-
|
|
63
|
-
- [ ] Followed template format
|
|
64
|
-
- [ ] Priority set
|
|
65
|
-
- [ ] Tags/labels added
|
|
66
|
-
- [ ] Clear steps
|
|
67
|
-
- [ ] No duplicates
|
|
68
|
-
|
|
69
|
-
## References
|
|
70
|
-
|
|
71
|
-
- [Testomat.io Docs](https://testomat.io/docs)
|
|
72
|
-
- [Test Case Format](./test-case-format.md) - Full Markdown format reference
|
|
@@ -1,159 +0,0 @@
|
|
|
1
|
-
# Test Writing Rules
|
|
2
|
-
|
|
3
|
-
If the user provided example test cases, follow their style first; then apply these rules.
|
|
4
|
-
|
|
5
|
-
## Test Suites
|
|
6
|
-
|
|
7
|
-
- Formulas, business rules, edge-case reasoning, and feature context live in the suite/test description.
|
|
8
|
-
- Prerequisites common to all test cases go as bullet points in the suite description.
|
|
9
|
-
- Formulas and diagrams relevant to all test cases can be included as code blocks in the suite description.
|
|
10
|
-
|
|
11
|
-
## Test Cases
|
|
12
|
-
|
|
13
|
-
- A test case consists of a description and steps.
|
|
14
|
-
- Golden rule: "why" in the description, "what" in the steps.
|
|
15
|
-
- Add the intent to the description if the title is not enough to explain it.
|
|
16
|
-
- Keep the description clear and concise.
|
|
17
|
-
- Put preparations into preconditions/description, not into steps.
|
|
18
|
-
- Focus on black-box testing: every action and observable result goes through public APIs or UI (unless the user specifies otherwise).
|
|
19
|
-
- Prefer UI over public APIs when possible.
|
|
20
|
-
- Add system checks only when it is not clear how to test via public APIs or UI. This is not a unit test; usually no direct server or code access is allowed.
|
|
21
|
-
- Understand UI pages, components, or API endpoints from source code, design, or requirements.
|
|
22
|
-
- If this is a web app, ask the user to help discover it:
|
|
23
|
-
- by looking at its frontend source code
|
|
24
|
-
- by accessing it on a non-production environment via browser (URLs and credentials)
|
|
25
|
-
- by looking at screenshots of related pages
|
|
26
|
-
|
|
27
|
-
## Title
|
|
28
|
-
|
|
29
|
-
Title states the behavior under test from the user's perspective.
|
|
30
|
-
|
|
31
|
-
Title structure: `<role> <action> <object> <qualifier>`
|
|
32
|
-
|
|
33
|
-
Examples:
|
|
34
|
-
|
|
35
|
-
- Editor can change description of a blogpost in admin panel
|
|
36
|
-
- User can report a bug using widget on a web page
|
|
37
|
-
- Blocked user must not be able to log in to app workspace
|
|
38
|
-
- Admin can invite up to 10 users to a project via Settings Page
|
|
39
|
-
- User can not edit a comment it doesn't own
|
|
40
|
-
- User can retry operation when NetworkError occurs
|
|
41
|
-
- User can not retry operation when network connection is disabled
|
|
42
|
-
|
|
43
|
-
Avoid:
|
|
44
|
-
|
|
45
|
-
- Filler prefixes: `Verify that ...`, `Test that ...`, `Check ...`, `Should ...`
|
|
46
|
-
- Multi-intent titles joined by `and` / `then`
|
|
47
|
-
- Restating the suite name in every title
|
|
48
|
-
- Embedding IDs or numbers: `TC-001: Login`
|
|
49
|
-
- Vague outcomes: `Successful login`, `Login works`
|
|
50
|
-
|
|
51
|
-
Good vs bad:
|
|
52
|
-
|
|
53
|
-
- `Verify successful login` → `User can log in with valid email and password`
|
|
54
|
-
- `Wrong password test` → `User cannot log in with invalid password`
|
|
55
|
-
- `Login and update profile` → split into two tests
|
|
56
|
-
- `Email validation` → `User sees error when email format is invalid`
|
|
57
|
-
|
|
58
|
-
## Preconditions
|
|
59
|
-
|
|
60
|
-
- Add preconditions for setup that is required for the test to run but is not part of the test actions.
|
|
61
|
-
- Define the preconditions and initial state of the system as bullet points.
|
|
62
|
-
- If relevant, include the user role.
|
|
63
|
-
- Skip preconditions that are not needed or repeat the suite description.
|
|
64
|
-
- Do not include preconditions like "service is running" unless the user explicitly mentioned them or the test is about them.
|
|
65
|
-
|
|
66
|
-
## Steps
|
|
67
|
-
|
|
68
|
-
A step consists of an action (with optional test data) and an expected result.
|
|
69
|
-
|
|
70
|
-
Test steps use the `## Steps` header section with a nested markdown list format:
|
|
71
|
-
|
|
72
|
-
```markdown
|
|
73
|
-
## Steps
|
|
74
|
-
|
|
75
|
-
- (Step Action)
|
|
76
|
-
*Expected*: ... (Observable behavior)
|
|
77
|
-
- ...
|
|
78
|
-
*Expected*: ...
|
|
79
|
-
```
|
|
80
|
-
|
|
81
|
-
e.g.
|
|
82
|
-
|
|
83
|
-
```markdown
|
|
84
|
-
## Steps
|
|
85
|
-
|
|
86
|
-
- Navigate to the login page
|
|
87
|
-
*Expected*: Login form is displayed with username and password fields
|
|
88
|
-
- Enter a valid username and password
|
|
89
|
-
*Expected*: Credentials are entered without errors
|
|
90
|
-
- Click the "Login" button
|
|
91
|
-
*Expected*: User is redirected to the dashboard
|
|
92
|
-
```
|
|
93
|
-
|
|
94
|
-
Step format rules:
|
|
95
|
-
|
|
96
|
-
- Steps must be under a `## Steps` heading.
|
|
97
|
-
- Use nested markdown lists (bulleted `-`/`*` or numbered `1.`).
|
|
98
|
-
- Top-level items describe the action to perform.
|
|
99
|
-
- Nested items with `*Expected*` (or `*Expected*:`, `*Expected result*`) describe the observable behavior.
|
|
100
|
-
- Expected results should be specific and verifiable.
|
|
101
|
-
|
|
102
|
-
Step content rules:
|
|
103
|
-
|
|
104
|
-
- Each step is a simple sentence. Avoid commas and sub-sentences.
|
|
105
|
-
- Steps are mechanical: click, send, read, assert.
|
|
106
|
-
- Each step includes exact instructions with concrete, realistic values a tester can act on directly.
|
|
107
|
-
- Do NOT parametrize by default — first-pass test cases should read as executable manual steps, not templates.
|
|
108
|
-
- Use a placeholder variable like `${domain}` only when the value is genuinely reused across steps or is data-driven (see the Examples section in the format reference). A plain UI/API acceptance step needs concrete values, not placeholders.
|
|
109
|
-
- Do not turn data unrelated to the test into placeholders.
|
|
110
|
-
- Do not add preconditions as placeholders.
|
|
111
|
-
- Prefer URL paths over full URLs, e.g. `/auth/login`.
|
|
112
|
-
- Use specific values when they are important for the scenario (boundary values, format validation, locale-specific input).
|
|
113
|
-
- Avoid vague qualifiers like "small", "known", "around", "e.g.", "like", "(…)"; replace them with concrete, literal values.
|
|
114
|
-
- Avoid general statements in steps. Move them to the description.
|
|
115
|
-
- Do not chain multiple distinct actions or use unnecessary And / Or combinations in a single step.
|
|
116
|
-
- All step actions must be clear to perform via public API or UI.
|
|
117
|
-
- All checks/verifications/assertions belong in the expected result, not in the step action.
|
|
118
|
-
- A code block may follow a step when needed: API request, SQL, shell command, pseudocode, etc.
|
|
119
|
-
|
|
120
|
-
If an expected result has multiple conditions, split them into separate lines.
|
|
121
|
-
|
|
122
|
-
Instead of:
|
|
123
|
-
|
|
124
|
-
`*Expected*: Comment appears in the Run's comment list with the current user as author`
|
|
125
|
-
|
|
126
|
-
Use:
|
|
127
|
-
|
|
128
|
-
`*Expected*: Comment appears in the Run's comment list`
|
|
129
|
-
`*Expected*: Current user is the author`
|
|
130
|
-
|
|
131
|
-
### Bold and italic in steps
|
|
132
|
-
|
|
133
|
-
Use sparingly. Each style serves one purpose; otherwise write plain text.
|
|
134
|
-
|
|
135
|
-
- **bold** — UI elements the user interacts with: buttons, links, fields, tabs, checkboxes, modals (e.g. `Click **Save**`, `Open **Settings** tab`).
|
|
136
|
-
- *italic* — names of pages/screens/documents referenced as context (e.g. `Open the *Privacy Policy* page`).
|
|
137
|
-
|
|
138
|
-
Avoid:
|
|
139
|
-
|
|
140
|
-
- Bold/italic on full sentences or whole steps.
|
|
141
|
-
- Combining bold and italic (`***...***`).
|
|
142
|
-
- Emphasis for visual weight; rephrase or split the step instead.
|
|
143
|
-
- Bold/italic in place of a placeholder (`[url]`) or a code block.
|
|
144
|
-
|
|
145
|
-
## AI Writing Patterns to Avoid
|
|
146
|
-
|
|
147
|
-
Be specific, not grandiose. Say what it actually does. Avoid marketing language and emojis (unless explicitly intended).
|
|
148
|
-
|
|
149
|
-
Avoid:
|
|
150
|
-
|
|
151
|
-
- Puffery: pivotal, crucial, vital, testament, enduring legacy, indelible mark, deeply rooted, profound heritage, steadfast dedication, key turning point
|
|
152
|
-
- Promotional adjectives: groundbreaking (figurative), seamless/seamlessly, robust, cutting-edge, vibrant, nuanced, multifaceted, intricate/intricacies, stunning natural beauty
|
|
153
|
-
- Overused AI vocabulary: delve/delves, leverage/leveraging, foster/fostering, realm, tapestry, landscape, interplay, streamline, shed light on, garnered, notably, key (as adjective)
|
|
154
|
-
- Empty "-ing" phrases: ensuring, showcasing, highlighting, emphasizing, reflecting, underscoring, aligning with, contributing to, enhancing, underpinning
|
|
155
|
-
- Filler frames: stands/serves as, is a testament/reminder, plays a vital/significant/crucial/pivotal role, underscores/highlights its importance, reflects broader, symbolizing its ongoing/enduring/lasting impact, continues to captivate, nestled in the heart of, boasts a
|
|
156
|
-
- Hedges and closers: it's important/critical/crucial to note/remember/consider, may vary, In summary, In conclusion, Overall
|
|
157
|
-
- "Challenges/Legacy" framing: Despite its... faces several challenges, Despite these challenges, Challenges and Legacy, Future Outlook
|
|
158
|
-
- Parallel "not/but/however" constructions: "Not only ... but ...", "It is not just about ..., it's ..." — common in LLM writing but unsuitable for a neutral tone
|
|
159
|
-
- Formatting overuse: excessive bullets, emoji decorations, bold on every other word
|
|
@@ -1,152 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
name: scan-automation-project
|
|
3
|
-
description: Scan project source code to inventory languages, frameworks, and existing tests (manual `*.test.md` and automated test files). Use this skill whenever analyzing a codebase for test planning, detecting test frameworks, or preparing for test automation. Specifically, when the user mentions "scan project", "what tests exist", "analyze codebase", "detect frameworks", "test matrix", or needs a codebase inventory before a QA workflow.
|
|
4
|
-
license: MIT
|
|
5
|
-
metadata:
|
|
6
|
-
author: Testomat.io
|
|
7
|
-
version: 1.0.0
|
|
8
|
-
---
|
|
9
|
-
|
|
10
|
-
# Scan Automation Project
|
|
11
|
-
|
|
12
|
-
Scan project source code and return a QA-focused inventory: languages, frameworks, and existing tests.
|
|
13
|
-
|
|
14
|
-
**Shallow scan only.** No full import resolution, no line-by-line parsing, no reading full test implementations. High-level structure only.
|
|
15
|
-
|
|
16
|
-
## Step 1: Locate Source Code
|
|
17
|
-
|
|
18
|
-
- If the project root has non-empty source folders or files, go to Step 2.
|
|
19
|
-
- If **no source** files are found, stop and ask the user:
|
|
20
|
-
|
|
21
|
-
```
|
|
22
|
-
❓ No application source code detected (folder may be empty or missing).
|
|
23
|
-
Where is the source code?
|
|
24
|
-
1. Use local project from another folder (I will create a symlink)
|
|
25
|
-
2. Clone from Git repo
|
|
26
|
-
3. I don't know yet (stop here)
|
|
27
|
-
```
|
|
28
|
-
|
|
29
|
-
- Wait for the user's reply.
|
|
30
|
-
- If the user gives a Git repo or another folder, clone or symlink it into `.testeiya/code/`. No-op if it is already there.
|
|
31
|
-
|
|
32
|
-
### Rule for pulled data
|
|
33
|
-
|
|
34
|
-
**When you need to pull external data** (manual test cases, app code, e2e tests from another repo) into this project:
|
|
35
|
-
|
|
36
|
-
| This project has | Store pulled data in | Gitignored? |
|
|
37
|
-
| ------------------ | ---------------------- | ----------- |
|
|
38
|
-
| **Source code** (`src/` folder) or **big project** | `.testeiya/…` | **Yes** |
|
|
39
|
-
| **Only test infrastructure** (e2e dirs like `tests/`, `playwright/`, `cypress/` but no `src/`) | `manual-tests/` or `e2e-tests/` | No |
|
|
40
|
-
| **Empty / manual-only** | `manual-tests/` | No |
|
|
41
|
-
|
|
42
|
-
Detection logic:
|
|
43
|
-
1. Has `src/` folder or is a monorepo? → Use `.testeiya/`
|
|
44
|
-
2. Has e2e test dirs (`tests/`, `playwright/`, `cypress/`, `e2e/`)? → Use tracked folder (`manual-tests/`, `e2e-tests/`)
|
|
45
|
-
3. Otherwise → Default to `manual-tests/`
|
|
46
|
-
|
|
47
|
-
- Any skill that creates `.testeiya/...` must also add `.testeiya/` to the project's `.gitignore` — but only if it is not there yet. Never add it twice.
|
|
48
|
-
- The rule covers *pulled* data only. Output a skill *produces* and the user wants — a `coverage.*.yml`, new `*.test.md` files — goes in the repo as normal.
|
|
49
|
-
- On a source repo with no manual tests, this skill changes no tracked file: it only creates the gitignored `.testeiya/` directory and, if needed, adds one line to `.gitignore`.
|
|
50
|
-
- **Only touch `.testeiya/` and tracked folders — never pollute the repo with cache in a wrong location.**
|
|
51
|
-
|
|
52
|
-
## Step 2: Project Analysis
|
|
53
|
-
|
|
54
|
-
Collect source file paths only. **Do NOT read file contents.**
|
|
55
|
-
|
|
56
|
-
Include:
|
|
57
|
-
- Application source files.
|
|
58
|
-
- View/template files: `.html`/`.htm`, `.vue`, `.svelte`, `.hbs`/`.handlebars`, `.ejs`, `.pug`/`.jade`, `.mustache`, `.liquid`, `.erb`, `.haml`, `.slim`, `.blade.php`, `.twig`, `.j2`/`.jinja`/`.jinja2`, `.cshtml`/`.razor`, `.jsp`. They are application source — coverage skills map UI changes through them.
|
|
59
|
-
|
|
60
|
-
Exclude:
|
|
61
|
-
- Dependencies, build output, coverage, reports, caches, config, lock, and environment files.
|
|
62
|
-
- Paths ignored by `.gitignore` — but **not** `.testeiya/code/`. In a manual-tests repo the app code lives there; scan it as source.
|
|
63
|
-
- Testeiya internal files (e.g. `session-factory.ts`, `system-prompt.ts`).
|
|
64
|
-
- **If in doubt**, exclude.
|
|
65
|
-
|
|
66
|
-
From the file list:
|
|
67
|
-
- Detect languages and frameworks. Collect one `frameworks` list with ALL application and testing frameworks.
|
|
68
|
-
- Extract the project name from a project config file (`package.json`, `Cargo.toml`, `pom.xml`, ...); fall back to the root directory name.
|
|
69
|
-
- Rate complexity by source file count:
|
|
70
|
-
|
|
71
|
-
| File Count | Complexity |
|
|
72
|
-
|------------|--------------|
|
|
73
|
-
| 1-30 | `small` |
|
|
74
|
-
| 31-150 | `moderate` |
|
|
75
|
-
| 151-500 | `large` |
|
|
76
|
-
| 500+ | `very-large` |
|
|
77
|
-
|
|
78
|
-
## Step 3: Test Inventory (optional)
|
|
79
|
-
|
|
80
|
-
Detect existing tests, automated and manual. Stay shallow.
|
|
81
|
-
|
|
82
|
-
Automated tests:
|
|
83
|
-
- Detect frameworks via config files (`jest.config.*`, `playwright.config.*`, `vitest.config.*`, `pytest.ini`, `pom.xml`, ...), project dependencies, and test file patterns (`*.test.*`, `*.spec.*`, `*_test.*`).
|
|
84
|
-
- For each framework: identify its test file pattern and count matching files.
|
|
85
|
-
|
|
86
|
-
Manual tests:
|
|
87
|
-
- Find all `.test.md` files and parse test titles. `find .` also looks inside `.testeiya/manual-tests/`, so a re-run after a pull finds the cached cases instead of reporting "no manual tests":
|
|
88
|
-
|
|
89
|
-
```bash
|
|
90
|
-
find . -name "*.test.md" -exec awk '
|
|
91
|
-
/^<!-- test/ { in_block=1; kind="TEST"; next }
|
|
92
|
-
/^<!-- suite/ { in_block=1; kind="SUITE"; next }
|
|
93
|
-
in_block && /^-->/ { in_block=0; expect=1; next }
|
|
94
|
-
expect && /^#+[[:space:]]+/ {
|
|
95
|
-
title=$0; sub(/^#+[[:space:]]+/, "", title)
|
|
96
|
-
if (kind == "SUITE") printf "SUITE: %s\n", title
|
|
97
|
-
else printf "|- %s\n", title
|
|
98
|
-
expect=0
|
|
99
|
-
}
|
|
100
|
-
' {} +
|
|
101
|
-
```
|
|
102
|
-
|
|
103
|
-
- If the only `.test.md` files are under `.testeiya/manual-tests/`, say so in the inventory: they came from Testomat.io, not from this repo.
|
|
104
|
-
|
|
105
|
-
## Step 4: Output
|
|
106
|
-
|
|
107
|
-
Return one structured markdown result directly. **Do NOT save to a file.**
|
|
108
|
-
|
|
109
|
-
```markdown
|
|
110
|
-
# Project Overview
|
|
111
|
-
|
|
112
|
-
- **Project Name:** acme-web-app
|
|
113
|
-
- **Description:** A React-based customer dashboard with an Express API.
|
|
114
|
-
- **Languages:** TypeScript, SQL
|
|
115
|
-
- **Frameworks:** React, Express, Jest, Playwright
|
|
116
|
-
- **Complexity:** small (12 files)
|
|
117
|
-
|
|
118
|
-
## Test Inventory
|
|
119
|
-
|
|
120
|
-
- **Automated Tests:** 10 files
|
|
121
|
-
- **Manual Tests:** 37 cases
|
|
122
|
-
|
|
123
|
-
### Manual Tests (20 of 37 shown)
|
|
124
|
-
|
|
125
|
-
- SUITE: Authentication
|
|
126
|
-
|- User can login
|
|
127
|
-
|- User can reset password
|
|
128
|
-
- SUITE: Billing
|
|
129
|
-
|- User can view invoice
|
|
130
|
-
...and 17 more
|
|
131
|
-
|
|
132
|
-
### Automated Tests (10 of 10 shown)
|
|
133
|
-
|
|
134
|
-
- home.page.spec.ts
|
|
135
|
-
...
|
|
136
|
-
```
|
|
137
|
-
|
|
138
|
-
Field rules:
|
|
139
|
-
- **Description:** 1-2 sentences based only on detected source code and folder structure (include the domain area if that makes sense).
|
|
140
|
-
- **Complexity:** one of `small` | `moderate` | `large` | `very-large`, plus the file count.
|
|
141
|
-
- **Manual Tests:** preserve hierarchy as plain strings — SUITE items as parent bullets, test titles (`|-`) as nested children.
|
|
142
|
-
- **Automated Tests:** list of detected test files.
|
|
143
|
-
- All values must come from observable files. Do NOT guess missing data or add fields not shown above.
|
|
144
|
-
|
|
145
|
-
Sections:
|
|
146
|
-
- If Step 3 was skipped or found no tests, omit `## Test Inventory` and note that the project contains no tests; the `# Project Overview` section is still useful for next steps.
|
|
147
|
-
- If one test type is absent, note it with a blockquote, e.g. ``> No manual tests (`.test.md`) found in the project.``
|
|
148
|
-
|
|
149
|
-
Test listing truncation:
|
|
150
|
-
- Show at most the first 20 entries per list, in original file order.
|
|
151
|
-
- Mark truncation in the heading (`(20 of 37 shown)`) and with `...and N more`.
|
|
152
|
-
- Do not print full test listings beyond that.
|
|
@@ -1,107 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
name: sync-test-cases-with-tms
|
|
3
|
-
description: Synchronize test scenarios and cases between a local project and Testomat.io. Use this skill whenever the user wants to pull/export/download tests from Testomat.io; or push/import/sync new or updated test cases back to the TMS in corresponding `*.test.md` format. Supports custom directories, markdown test format and advanced import/export workflows.
|
|
4
|
-
inputs:
|
|
5
|
-
testDir:
|
|
6
|
-
description: "Target directory for pulled tests"
|
|
7
|
-
required: false
|
|
8
|
-
license: MIT
|
|
9
|
-
metadata:
|
|
10
|
-
author: Testomat.io
|
|
11
|
-
version: 1.0.0
|
|
12
|
-
---
|
|
13
|
-
|
|
14
|
-
# Sync Test Cases with TMS
|
|
15
|
-
|
|
16
|
-
Sync Markdown test cases (`*.test.md`) between the local project and Testomat.io.
|
|
17
|
-
|
|
18
|
-
Use when the user wants to:
|
|
19
|
-
- Pull/export/download tests from Testomat.io to local Markdown files.
|
|
20
|
-
- Push/upload/import local Markdown tests to Testomat.io.
|
|
21
|
-
- Bulk edit: pull cases -> edit locally -> push back to TMS.
|
|
22
|
-
|
|
23
|
-
## Setup
|
|
24
|
-
|
|
25
|
-
- Check for the `TESTOMATIO` token: skill input -> `.env` in project root -> ask the user.
|
|
26
|
-
- Save the token to `.env`: `TESTOMATIO=tstmt_xxxxx`.
|
|
27
|
-
- If the user has no key: get it in Testomat.io under **Settings → Project → Project Reporting API key** (`https://app.testomat.io/projects/<project-id>/settings/project`).
|
|
28
|
-
|
|
29
|
-
## Running the CLI
|
|
30
|
-
|
|
31
|
-
- Run `check-tests` via `npx`. Do not install it as a project dependency.
|
|
32
|
-
- **The first `check-tests` call in the session must be `npx check-tests@latest …`** to resolve the latest version. All later calls in the same session use plain `npx check-tests …`.
|
|
33
|
-
- **Use only options documented here, in [TESTOMATIO_CLI.md](./references/TESTOMATIO_CLI.md), or listed by `npx check-tests --help`. Do not invent options** (e.g. `--pattern`, `--force`).
|
|
34
|
-
|
|
35
|
-
## Pull
|
|
36
|
-
|
|
37
|
-
Downloads test scenarios from Testomat.io and saves them as local Markdown files.
|
|
38
|
-
|
|
39
|
-
Directory selection — if the `testDir` input is provided or the user passes `-d <path>`, use that path. Otherwise:
|
|
40
|
-
- Workspace is empty or for manual tests only: pull to root.
|
|
41
|
-
- End-to-end testing project: pull to the `manual-tests` directory.
|
|
42
|
-
- Any other case: pull to `.testeiya/manual-tests` (ensure `.testeiya/` exists and is gitignored).
|
|
43
|
-
|
|
44
|
-
Cache-folder rules:
|
|
45
|
-
- Default pull target is the gitignored cache `.testeiya/manual-tests/`. Add `.testeiya/` to the project `.gitignore` if it is not there yet.
|
|
46
|
-
- **Pulled cases must never land in a tracked folder** (`manual-tests/`, etc.) — that pollutes the repo.
|
|
47
|
-
- Being gitignored does not block editing the files or pushing them back.
|
|
48
|
-
- If the repo already keeps its `*.test.md` files in a tracked folder, don't pull — work with them in place, or pass `-d <that folder>` for an in-place refresh.
|
|
49
|
-
- This matches `scan-automation-project`, which pulls the *code* into `.testeiya/code/` when it runs inside a manual-tests repo.
|
|
50
|
-
|
|
51
|
-
```bash
|
|
52
|
-
npx check-tests pull -d .testeiya/manual-tests
|
|
53
|
-
```
|
|
54
|
-
|
|
55
|
-
- To pull only specific suites (user names a suite or gives suite IDs): `npx check-tests pull --suite-ids "@S12345678,@S87654321"`.
|
|
56
|
-
- More pull options: [TESTOMATIO_CLI.md](./references/TESTOMATIO_CLI.md).
|
|
57
|
-
|
|
58
|
-
## Push
|
|
59
|
-
|
|
60
|
-
Uploads local Markdown tests to Testomat.io.
|
|
61
|
-
|
|
62
|
-
Pre-push file filtering — push only test case files, never project docs or requirements:
|
|
63
|
-
- Include files matching `*.test.md`, or Markdown files with valid `<!-- test ... -->` blocks.
|
|
64
|
-
- Ignore all other Markdown (`README.md`, `CHANGELOG.md`, documentation).
|
|
65
|
-
- If test cases live alongside other files, copy or move the test files into `.testeiya/manual-tests/` first.
|
|
66
|
-
|
|
67
|
-
Pre-push validation:
|
|
68
|
-
1. At least one `*.test.md` file exists.
|
|
69
|
-
2. Each file contains a valid test block:
|
|
70
|
-
|
|
71
|
-
```md
|
|
72
|
-
<!-- test
|
|
73
|
-
priority: ...
|
|
74
|
-
creator: ...
|
|
75
|
-
tags: ...
|
|
76
|
-
labels: ...
|
|
77
|
-
-->
|
|
78
|
-
# ... (test case title)
|
|
79
|
-
|
|
80
|
-
... (test case description)
|
|
81
|
-
```
|
|
82
|
-
|
|
83
|
-
```bash
|
|
84
|
-
# Specific files (preferred when known)
|
|
85
|
-
npx check-tests push --files login.test.md checkout.test.md
|
|
86
|
-
|
|
87
|
-
# Testeiya cache folder
|
|
88
|
-
npx check-tests push -d .testeiya/manual-tests
|
|
89
|
-
```
|
|
90
|
-
|
|
91
|
-
- **When the files to push are known** (e.g. just produced by `qa-write-test-cases` / `improve-test-cases`), **pass them explicitly via `--files`** (alias `-f`). Without `--files` the CLI falls back to the default glob `**/*.test.md`, which may pick up unrelated files.
|
|
92
|
-
- Quote glob patterns. Paths resolve relative to `--dir`.
|
|
93
|
-
- Use `-d` when `.testeiya` or `manual-tests` directories exist.
|
|
94
|
-
- **Push only the test cases directory** (e.g. `.testeiya/manual-tests`, not `.testeiya/`).
|
|
95
|
-
- More push options and examples: [TESTOMATIO_CLI.md](./references/TESTOMATIO_CLI.md).
|
|
96
|
-
|
|
97
|
-
## Summary Output
|
|
98
|
-
|
|
99
|
-
After syncing, print a short log-style summary:
|
|
100
|
-
|
|
101
|
-
```
|
|
102
|
-
Sync Complete:
|
|
103
|
-
- Action: pull/push
|
|
104
|
-
- Directory: <path>
|
|
105
|
-
- Tests synced: 15
|
|
106
|
-
- Status: Success
|
|
107
|
-
```
|
package/skills/testomatio/test-management/sync-test-cases-with-tms/references/TESTOMATIO_CLI.md
DELETED
|
@@ -1,140 +0,0 @@
|
|
|
1
|
-
# Testomat.io CLI Documentation
|
|
2
|
-
|
|
3
|
-
This document provides comprehensive information about the `check-tests` CLI commands, which synchronizes test scenarios, and interacts with Testomat.io test cases from your local project with TMS.
|
|
4
|
-
|
|
5
|
-
---
|
|
6
|
-
|
|
7
|
-
## Prerequisites
|
|
8
|
-
|
|
9
|
-
### Run check-tests via npx (always latest)
|
|
10
|
-
|
|
11
|
-
Invoke `check-tests` through `npx` so users automatically pick up the newest published version:
|
|
12
|
-
|
|
13
|
-
```bash
|
|
14
|
-
# First invocation in the agent session — forces resolve of latest
|
|
15
|
-
npx check-tests@latest <command>
|
|
16
|
-
|
|
17
|
-
# Subsequent invocations in the same session could be used without @latest
|
|
18
|
-
npx check-tests <command>
|
|
19
|
-
```
|
|
20
|
-
|
|
21
|
-
Do not install `check-tests` as a project dependency. The first call (with `@latest` version specified) refreshes the npx cache; next calls in the same session reuse it without an extra registry round-trip. A new agent session re-triggers the `@latest` check so users use the latest version over time.
|
|
22
|
-
|
|
23
|
-
---
|
|
24
|
-
|
|
25
|
-
## Environment Variables
|
|
26
|
-
|
|
27
|
-
The tool supports loading environment variables from `.env` files using dotenv.
|
|
28
|
-
|
|
29
|
-
### Testomat.io Configuration
|
|
30
|
-
|
|
31
|
-
| Variable | Description | Required |
|
|
32
|
-
| ------------------------ | ------------------------------------------------------ | ------------------------------------- |
|
|
33
|
-
| `TESTOMATIO` | API key for Testomat.io (format: tstmt_xxxxx) | Yes (for sync operations) |
|
|
34
|
-
| `TESTOMATIO_URL` | Testomat.io server URL | No (default: https://app.testomat.io) |
|
|
35
|
-
| `TESTOMATIO_WORKDIR` | Working directory for relative file paths | No |
|
|
36
|
-
| `TESTOMATIO_PREPEND_DIR` | Directory to prepend to test paths | No |
|
|
37
|
-
| `TESTOMATIO_LABELS` | Comma-separated labels. Supports `label:value` | No |
|
|
38
|
-
|
|
39
|
-
### Configuration File
|
|
40
|
-
|
|
41
|
-
Save credentials to `.env` file:
|
|
42
|
-
|
|
43
|
-
```env
|
|
44
|
-
TESTOMATIO=tstmt_xxxxx
|
|
45
|
-
TESTOMATIO_URL=https://app.testomat.io
|
|
46
|
-
...
|
|
47
|
-
```
|
|
48
|
-
|
|
49
|
-
---
|
|
50
|
-
|
|
51
|
-
## CLI Options
|
|
52
|
-
|
|
53
|
-
### Basic "check-tests" Options
|
|
54
|
-
|
|
55
|
-
| Option | Description | Default |
|
|
56
|
-
| --------------------- | ------------------------------------------- | ----------------------------|
|
|
57
|
-
| `-h, --help` | Display help information | - |
|
|
58
|
-
| `-d, --dir <dir>` | Test directory to scan | Current dir (default: `.`) |
|
|
59
|
-
| `--suite-ids <ids>` | Comma-separated suite IDs to pull (e.g. `@S12345678, @S456r4342`) | - |
|
|
60
|
-
|
|
61
|
-
### Testomat.io Integration Specific Project Options
|
|
62
|
-
|
|
63
|
-
| Option | Description | Default |
|
|
64
|
-
| ----------------------------- | ------------------------------------------------------------- | ------- |
|
|
65
|
-
| `--update-ids` | Update test and suite with Testomat.io IDs | false |
|
|
66
|
-
| `--keep-structure` | Prefer structure of source code over structure in Testomat.io | false |
|
|
67
|
-
| `--no-empty` | Remove empty suites after import | false |
|
|
68
|
-
| `--clean-ids` | Remove Testomat.io IDs from test and suite | false |
|
|
69
|
-
|
|
70
|
-
---
|
|
71
|
-
|
|
72
|
-
## Commands
|
|
73
|
-
|
|
74
|
-
### Pull
|
|
75
|
-
|
|
76
|
-
Retrieve the latest test scenarios from Testomat.io and save them as Markdown files locally.
|
|
77
|
-
|
|
78
|
-
```bash
|
|
79
|
-
npx check-tests pull [options]
|
|
80
|
-
```
|
|
81
|
-
|
|
82
|
-
**Examples:**
|
|
83
|
-
|
|
84
|
-
```bash
|
|
85
|
-
# Export tests to current directory
|
|
86
|
-
npx check-tests pull
|
|
87
|
-
|
|
88
|
-
# Export tests to manual-tests folder
|
|
89
|
-
npx check-tests pull -d manual-tests
|
|
90
|
-
|
|
91
|
-
# Keep source structure
|
|
92
|
-
npx check-tests pull -d manual-tests --keep-structure
|
|
93
|
-
|
|
94
|
-
# Pull specific suites only
|
|
95
|
-
npx check-tests pull --suite-ids "@S12345678,@S87654321"
|
|
96
|
-
```
|
|
97
|
-
|
|
98
|
-
### Push
|
|
99
|
-
|
|
100
|
-
Send local Markdown test updates to Testomat.io. (Equivalent to `check-tests manual <files> --update-ids`.)
|
|
101
|
-
|
|
102
|
-
```bash
|
|
103
|
-
npx check-tests push [options]
|
|
104
|
-
```
|
|
105
|
-
|
|
106
|
-
`--files` (alias `-f`) accepts file paths, glob patterns, or a mix; defaults to `**/*.test.md`. Paths resolve relative to `--dir`. Quote globs.
|
|
107
|
-
|
|
108
|
-
**Best practice:** when the files to push are known, list them explicitly via `--files` rather than relying on the default glob.
|
|
109
|
-
|
|
110
|
-
**Examples:**
|
|
111
|
-
|
|
112
|
-
```bash
|
|
113
|
-
# Default glob (**/*.test.md)
|
|
114
|
-
npx check-tests push
|
|
115
|
-
|
|
116
|
-
# Specific files
|
|
117
|
-
npx check-tests push -f docs/login.test.md docs/checkout.test.md
|
|
118
|
-
|
|
119
|
-
# Glob (quoted)
|
|
120
|
-
npx check-tests push --files "manual-tests/**/*.test.md"
|
|
121
|
-
|
|
122
|
-
# Multiple globs
|
|
123
|
-
npx check-tests push -f "smoke/**/*.test.md" "regression/**/*.test.md"
|
|
124
|
-
|
|
125
|
-
# With labels
|
|
126
|
-
TESTOMATIO_LABELS=smoke,updated npx check-tests push
|
|
127
|
-
```
|
|
128
|
-
|
|
129
|
-
---
|
|
130
|
-
|
|
131
|
-
## Quick Reference
|
|
132
|
-
|
|
133
|
-
| Action | Command |
|
|
134
|
-
| --------------- | -------------------------------------------------------------- |
|
|
135
|
-
| Pull tests | `npx check-tests pull -d <dir>` |
|
|
136
|
-
| Push files | `npx check-tests push --files <file1.test.md> <file2.test.md>` |
|
|
137
|
-
| Push glob | `npx check-tests push --files "<dir>/**/*.test.md"` |
|
|
138
|
-
| Push directory | `npx check-tests push -d <dir>` (glob: `**/*.test.md`) |
|
|
139
|
-
| With labels | `TESTOMATIO_LABELS=smoke npx check-tests push` |
|
|
140
|
-
| Keep structure | `npx check-tests pull --keep-structure` |
|