testeiya 0.2.0 → 0.3.9

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (412) hide show
  1. package/LICENSE +21 -0
  2. package/README.md +37 -175
  3. package/dist/prompt/context.js +79 -0
  4. package/dist/prompt/context.js.map +1 -0
  5. package/dist/prompt/index.js +56 -0
  6. package/dist/prompt/index.js.map +1 -0
  7. package/dist/prompt/print.js +22 -0
  8. package/dist/prompt/print.js.map +1 -0
  9. package/dist/prompt/project-info.js +2 -0
  10. package/dist/prompt/project-info.js.map +1 -0
  11. package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +24 -21
  12. package/dist/prompt/system-prompt.js.map +1 -0
  13. package/dist/prompt/testomatio.js +264 -0
  14. package/dist/prompt/testomatio.js.map +1 -0
  15. package/dist/prompt/tools.js +49 -0
  16. package/dist/prompt/tools.js.map +1 -0
  17. package/dist/prompt/vocab.js +8 -0
  18. package/dist/prompt/vocab.js.map +1 -0
  19. package/dist/src/args.js +72 -0
  20. package/dist/src/args.js.map +1 -0
  21. package/dist/src/cli.js +61 -0
  22. package/dist/src/cli.js.map +1 -0
  23. package/dist/src/env.js +69 -0
  24. package/dist/src/env.js.map +1 -0
  25. package/dist/src/mcp-extension.js +9 -0
  26. package/dist/src/mcp-extension.js.map +1 -0
  27. package/dist/src/mcp.js +139 -0
  28. package/dist/src/mcp.js.map +1 -0
  29. package/dist/src/model.js +66 -0
  30. package/dist/src/model.js.map +1 -0
  31. package/dist/src/result.js +41 -0
  32. package/dist/src/result.js.map +1 -0
  33. package/dist/src/run.js +199 -0
  34. package/dist/src/run.js.map +1 -0
  35. package/dist/src/session.js +77 -0
  36. package/dist/src/session.js.map +1 -0
  37. package/dist/vendor/mcp.js +14801 -0
  38. package/mcp-tools.json +2967 -0
  39. package/package.json +29 -41
  40. package/prompt/context.ts +101 -0
  41. package/prompt/index.ts +93 -0
  42. package/prompt/print.ts +23 -0
  43. package/prompt/project-info.ts +30 -0
  44. package/prompt/system-prompt.ts +173 -0
  45. package/{src/prompt → prompt}/testomatio.ts +119 -8
  46. package/{src/prompt → prompt}/tools.ts +30 -8
  47. package/prompt/vocab.ts +7 -0
  48. package/{skills.lock.json → skills/skills.lock.json} +11 -7
  49. package/skills/skills.yaml +34 -0
  50. package/models.catalog.json +0 -6963
  51. package/skills/codeceptjs/ci-fix-tests/SKILL.md +0 -120
  52. package/skills/codeceptjs/codeceptjs-auth/SKILL.md +0 -158
  53. package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +0 -91
  54. package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +0 -158
  55. package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +0 -90
  56. package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +0 -234
  57. package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +0 -110
  58. package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +0 -306
  59. package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +0 -352
  60. package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +0 -472
  61. package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +0 -350
  62. package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +0 -81
  63. package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +0 -206
  64. package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
  65. package/skills/playwright-best-practices-skill/README.md +0 -147
  66. package/skills/playwright-best-practices-skill/SKILL.md +0 -303
  67. package/skills/playwright-best-practices-skill/advanced/authentication-flows.md +0 -360
  68. package/skills/playwright-best-practices-skill/advanced/authentication.md +0 -871
  69. package/skills/playwright-best-practices-skill/advanced/clock-mocking.md +0 -364
  70. package/skills/playwright-best-practices-skill/advanced/mobile-testing.md +0 -409
  71. package/skills/playwright-best-practices-skill/advanced/multi-context.md +0 -288
  72. package/skills/playwright-best-practices-skill/advanced/multi-user.md +0 -393
  73. package/skills/playwright-best-practices-skill/advanced/network-advanced.md +0 -452
  74. package/skills/playwright-best-practices-skill/advanced/third-party.md +0 -464
  75. package/skills/playwright-best-practices-skill/architecture/pom-vs-fixtures.md +0 -363
  76. package/skills/playwright-best-practices-skill/architecture/test-architecture.md +0 -369
  77. package/skills/playwright-best-practices-skill/architecture/when-to-mock.md +0 -383
  78. package/skills/playwright-best-practices-skill/browser-apis/browser-apis.md +0 -391
  79. package/skills/playwright-best-practices-skill/browser-apis/iframes.md +0 -403
  80. package/skills/playwright-best-practices-skill/browser-apis/service-workers.md +0 -504
  81. package/skills/playwright-best-practices-skill/browser-apis/websockets.md +0 -403
  82. package/skills/playwright-best-practices-skill/core/annotations.md +0 -424
  83. package/skills/playwright-best-practices-skill/core/assertions-waiting.md +0 -361
  84. package/skills/playwright-best-practices-skill/core/configuration.md +0 -452
  85. package/skills/playwright-best-practices-skill/core/fixtures-hooks.md +0 -417
  86. package/skills/playwright-best-practices-skill/core/global-setup.md +0 -434
  87. package/skills/playwright-best-practices-skill/core/locators.md +0 -242
  88. package/skills/playwright-best-practices-skill/core/page-object-model.md +0 -315
  89. package/skills/playwright-best-practices-skill/core/projects-dependencies.md +0 -453
  90. package/skills/playwright-best-practices-skill/core/test-data.md +0 -492
  91. package/skills/playwright-best-practices-skill/core/test-suite-structure.md +0 -361
  92. package/skills/playwright-best-practices-skill/core/test-tags.md +0 -298
  93. package/skills/playwright-best-practices-skill/debugging/console-errors.md +0 -420
  94. package/skills/playwright-best-practices-skill/debugging/debugging.md +0 -504
  95. package/skills/playwright-best-practices-skill/debugging/error-testing.md +0 -360
  96. package/skills/playwright-best-practices-skill/debugging/flaky-tests.md +0 -496
  97. package/skills/playwright-best-practices-skill/frameworks/angular.md +0 -530
  98. package/skills/playwright-best-practices-skill/frameworks/nextjs.md +0 -469
  99. package/skills/playwright-best-practices-skill/frameworks/react.md +0 -531
  100. package/skills/playwright-best-practices-skill/frameworks/vue.md +0 -574
  101. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/ci-cd.md +0 -468
  102. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/docker.md +0 -283
  103. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/github-actions.md +0 -546
  104. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/gitlab.md +0 -397
  105. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/other-providers.md +0 -521
  106. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/parallel-sharding.md +0 -371
  107. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/performance.md +0 -453
  108. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/reporting.md +0 -424
  109. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/test-coverage.md +0 -497
  110. package/skills/playwright-best-practices-skill/testing-patterns/accessibility.md +0 -359
  111. package/skills/playwright-best-practices-skill/testing-patterns/api-testing.md +0 -719
  112. package/skills/playwright-best-practices-skill/testing-patterns/browser-extensions.md +0 -506
  113. package/skills/playwright-best-practices-skill/testing-patterns/canvas-webgl.md +0 -493
  114. package/skills/playwright-best-practices-skill/testing-patterns/component-testing.md +0 -500
  115. package/skills/playwright-best-practices-skill/testing-patterns/drag-drop.md +0 -576
  116. package/skills/playwright-best-practices-skill/testing-patterns/electron.md +0 -509
  117. package/skills/playwright-best-practices-skill/testing-patterns/file-operations.md +0 -377
  118. package/skills/playwright-best-practices-skill/testing-patterns/file-upload-download.md +0 -562
  119. package/skills/playwright-best-practices-skill/testing-patterns/forms-validation.md +0 -561
  120. package/skills/playwright-best-practices-skill/testing-patterns/graphql-testing.md +0 -331
  121. package/skills/playwright-best-practices-skill/testing-patterns/i18n.md +0 -508
  122. package/skills/playwright-best-practices-skill/testing-patterns/performance-testing.md +0 -476
  123. package/skills/playwright-best-practices-skill/testing-patterns/security-testing.md +0 -430
  124. package/skills/playwright-best-practices-skill/testing-patterns/visual-regression.md +0 -634
  125. package/skills/playwright-cli/SKILL.md +0 -420
  126. package/skills/playwright-cli/references/element-attributes.md +0 -23
  127. package/skills/playwright-cli/references/playwright-tests.md +0 -39
  128. package/skills/playwright-cli/references/request-mocking.md +0 -87
  129. package/skills/playwright-cli/references/running-code.md +0 -241
  130. package/skills/playwright-cli/references/session-management.md +0 -225
  131. package/skills/playwright-cli/references/storage-state.md +0 -275
  132. package/skills/playwright-cli/references/test-generation.md +0 -433
  133. package/skills/playwright-cli/references/tracing.md +0 -139
  134. package/skills/playwright-cli/references/video-recording.md +0 -143
  135. package/skills/testeiya/README.md +0 -29
  136. package/skills/testeiya/answer-formatting/SKILL.md +0 -30
  137. package/skills/testeiya/check-cucumber/SKILL.md +0 -200
  138. package/skills/testeiya/check-tests/SKILL.md +0 -260
  139. package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
  140. package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
  141. package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
  142. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
  143. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
  144. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
  145. package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
  146. package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
  147. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
  148. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
  149. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
  150. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
  151. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
  152. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
  153. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
  154. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
  155. package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
  156. package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
  157. package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
  158. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
  159. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
  160. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
  161. package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
  162. package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
  163. package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
  164. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
  165. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
  166. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
  167. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
  168. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
  169. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
  170. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
  171. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
  172. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
  173. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
  174. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
  175. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
  176. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
  177. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
  178. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
  179. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
  180. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
  181. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
  182. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
  183. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
  184. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
  185. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
  186. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
  187. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
  188. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
  189. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
  190. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
  191. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
  192. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
  193. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
  194. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
  195. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
  196. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
  197. package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
  198. package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
  199. package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
  200. package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
  201. package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
  202. package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
  203. package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
  204. package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
  205. package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
  206. package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
  207. package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
  208. package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
  209. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
  210. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
  211. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
  212. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
  213. package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
  214. package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
  215. package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
  216. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
  217. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
  218. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
  219. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
  220. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
  221. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
  222. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
  223. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
  224. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
  225. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
  226. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
  227. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
  228. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
  229. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
  230. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
  231. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
  232. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
  233. package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
  234. package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
  235. package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
  236. package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
  237. package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
  238. package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
  239. package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
  240. package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
  241. package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
  242. package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
  243. package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
  244. package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
  245. package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
  246. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
  247. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
  248. package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
  249. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
  250. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
  251. package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
  252. package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
  253. package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
  254. package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
  255. package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
  256. package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
  257. package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
  258. package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
  259. package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
  260. package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
  261. package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
  262. package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
  263. package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
  264. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
  265. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
  266. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
  267. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
  268. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
  269. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
  270. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
  271. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
  272. package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
  273. package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
  274. package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
  275. package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
  276. package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
  277. package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
  278. package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
  279. package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
  280. package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
  281. package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
  282. package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
  283. package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
  284. package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +0 -88
  285. package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +0 -95
  286. package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +0 -334
  287. package/skills/testomatio/test-automation/automate-manual-test-cases/CLAUDE.md +0 -56
  288. package/skills/testomatio/test-automation/automate-manual-test-cases/SKILL.md +0 -242
  289. package/skills/testomatio/test-automation/automate-manual-test-cases/references/CODECEPTJS_BEST_PRACTICES.md +0 -182
  290. package/skills/testomatio/test-automation/automate-manual-test-cases/references/FINAL_SUMMARY_TEMPLATE.md +0 -22
  291. package/skills/testomatio/test-automation/automate-manual-test-cases/references/PLAYWRIGHT_BEST_PRACTICES.md +0 -90
  292. package/skills/testomatio/test-automation/automate-manual-test-cases/references/POM_BEST_PRACTICES.md +0 -53
  293. package/skills/testomatio/test-automation/automate-manual-test-cases/references/TEST_DATA_MANAGEMENT.md +0 -52
  294. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/SKILL.md +0 -107
  295. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/references/DEBUGGING_QUICK_REFERENCE.md +0 -113
  296. package/skills/testomatio/test-automation/qa-automation-test-consolidation/SKILL.md +0 -29
  297. package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +0 -151
  298. package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
  299. package/skills/testomatio/test-automation/testomat-allure-adapter/SKILL.md +0 -289
  300. package/skills/testomatio/test-management/detect-duplicate-test-cases/SKILL.md +0 -86
  301. package/skills/testomatio/test-management/detect-duplicate-test-cases/references/DUPLICATE_INSTRUCTIONS.md +0 -54
  302. package/skills/testomatio/test-management/improve-test-cases/SKILL.md +0 -114
  303. package/skills/testomatio/test-management/improve-test-cases/references/TESTOMAT_MARKDOWN_EXAMPLE.md +0 -66
  304. package/skills/testomatio/test-management/pull-request-diff-analyzer/SKILL.md +0 -141
  305. package/skills/testomatio/test-management/qa-e2e-tests-reporting/SKILL.md +0 -354
  306. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_ARTIFACTS.md +0 -82
  307. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_HTML_REPORT.md +0 -37
  308. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_REPORTERS_CONFIG.md +0 -118
  309. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/SKILL.md +0 -149
  310. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/references/summary-example.md +0 -54
  311. package/skills/testomatio/test-management/qa-requirement-reviewer/SKILL.md +0 -126
  312. package/skills/testomatio/test-management/qa-requirement-reviewer/references/requirements_reviewer_examples.md +0 -128
  313. package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +0 -174
  314. package/skills/testomatio/test-management/qa-test-code-coverage/references/COVERAGE_FILE_FORMAT.md +0 -138
  315. package/skills/testomatio/test-management/qa-test-code-coverage/references/E2E_FRAMEWORKS.md +0 -65
  316. package/skills/testomatio/test-management/qa-test-code-coverage/scripts/check-coverage.mjs +0 -40
  317. package/skills/testomatio/test-management/qa-thinking/SKILL.md +0 -36
  318. package/skills/testomatio/test-management/qa-write-test-cases/SKILL.md +0 -267
  319. package/skills/testomatio/test-management/qa-write-test-cases/references/test-case-format.md +0 -387
  320. package/skills/testomatio/test-management/qa-write-test-cases/references/testomat-tms-guide.md +0 -72
  321. package/skills/testomatio/test-management/qa-write-test-cases/references/writing-rule.md +0 -159
  322. package/skills/testomatio/test-management/scan-automation-project/SKILL.md +0 -152
  323. package/skills/testomatio/test-management/sync-test-cases-with-tms/SKILL.md +0 -107
  324. package/skills/testomatio/test-management/sync-test-cases-with-tms/references/TESTOMATIO_CLI.md +0 -140
  325. package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +0 -182
  326. package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +0 -169
  327. package/skills.yaml +0 -21
  328. package/src/ai-debug.ts +0 -188
  329. package/src/api/agent-get.ts +0 -22
  330. package/src/api/agent-start.ts +0 -384
  331. package/src/api/client-log.ts +0 -29
  332. package/src/api/context.ts +0 -332
  333. package/src/api/debug-layout.ts +0 -47
  334. package/src/api/debug-report.ts +0 -29
  335. package/src/api/debug-snapshot.ts +0 -30
  336. package/src/api/debug-stream.ts +0 -52
  337. package/src/api/files-delete.ts +0 -184
  338. package/src/api/files-read.ts +0 -41
  339. package/src/api/files-rename.ts +0 -99
  340. package/src/api/files-tree.ts +0 -292
  341. package/src/api/files-write.ts +0 -41
  342. package/src/api/mcp.ts +0 -603
  343. package/src/api/memory.ts +0 -69
  344. package/src/api/open-external.ts +0 -39
  345. package/src/api/playwright-cli.ts +0 -606
  346. package/src/api/providers.ts +0 -457
  347. package/src/api/read-env-token.ts +0 -33
  348. package/src/api/sessions.ts +0 -79
  349. package/src/api/settings.ts +0 -120
  350. package/src/api/skills.ts +0 -58
  351. package/src/api/testomatio-attachment.ts +0 -89
  352. package/src/api/testomatio-auth.ts +0 -284
  353. package/src/api/testomatio-proxy.ts +0 -197
  354. package/src/api/testomatio-run-stats.ts +0 -81
  355. package/src/api/testomatio-target.ts +0 -225
  356. package/src/api/testomatio-transcription.ts +0 -82
  357. package/src/api/workspace-search.ts +0 -96
  358. package/src/api/workspace-sync.ts +0 -151
  359. package/src/api/workspace.ts +0 -165
  360. package/src/app-server.ts +0 -556
  361. package/src/bridge.ts +0 -251
  362. package/src/check-tests.ts +0 -156
  363. package/src/cli.ts +0 -17
  364. package/src/commands.ts +0 -244
  365. package/src/config.ts +0 -183
  366. package/src/connection.ts +0 -658
  367. package/src/context-store.ts +0 -265
  368. package/src/debug-bus.ts +0 -405
  369. package/src/extensions/tool-gate.ts +0 -220
  370. package/src/extensions/webui/ask-channel.ts +0 -52
  371. package/src/extensions/webui/index.ts +0 -184
  372. package/src/extensions/webui/tools/ask-question.ts +0 -88
  373. package/src/extensions/webui/tools/query-result.ts +0 -79
  374. package/src/extensions/webui/tools/render-chart.ts +0 -53
  375. package/src/extensions/webui/tools/render-item.ts +0 -61
  376. package/src/extensions/webui/tools/render-list.ts +0 -170
  377. package/src/extensions/webui/tools/render-result.ts +0 -85
  378. package/src/extensions/webui/tools/render-tree.ts +0 -71
  379. package/src/extensions/webui/tools/ui-widget.ts +0 -54
  380. package/src/extensions/webui/tools/widget-result.ts +0 -13
  381. package/src/extensions/webui/widget-channel.ts +0 -50
  382. package/src/file-log.ts +0 -196
  383. package/src/git-tracked.ts +0 -68
  384. package/src/gitignore.ts +0 -53
  385. package/src/json-store.ts +0 -43
  386. package/src/load-env.ts +0 -70
  387. package/src/loader-style.ts +0 -96
  388. package/src/main.ts +0 -140
  389. package/src/mcp-catalog.ts +0 -96
  390. package/src/models-catalog.ts +0 -72
  391. package/src/permissions.ts +0 -120
  392. package/src/project-dir.ts +0 -189
  393. package/src/project-info.ts +0 -108
  394. package/src/prompt/app-ui.ts +0 -59
  395. package/src/prompt/browser.ts +0 -27
  396. package/src/prompt/index.ts +0 -62
  397. package/src/server-info.ts +0 -62
  398. package/src/session-factory.ts +0 -442
  399. package/src/session-store.ts +0 -115
  400. package/src/shell-env.ts +0 -45
  401. package/src/skills.ts +0 -163
  402. package/src/sync-snapshot.ts +0 -140
  403. package/src/telemetry.ts +0 -239
  404. package/src/testomatio-auth.ts +0 -299
  405. package/src/testomatio.ts +0 -98
  406. package/src/theme.ts +0 -30
  407. package/src/user-env.ts +0 -94
  408. package/src/welcome.ts +0 -127
  409. package/src/workspace/safe-path.ts +0 -85
  410. package/src/workspace/test-md.ts +0 -70
  411. package/src/workspace-model.ts +0 -440
  412. package/testeiya.config.json +0 -14
@@ -1,871 +0,0 @@
1
- # Authentication Testing
2
-
3
- ## Table of Contents
4
-
5
- 1. [Quick Reference](#quick-reference)
6
- 2. [Patterns](#patterns)
7
- 3. [Decision Guide](#decision-guide)
8
- 4. [Anti-Patterns](#anti-patterns)
9
- 5. [Troubleshooting](#troubleshooting)
10
- 6. [Related](#related)
11
-
12
- > **When to use**: Apps with login, session management, or protected routes. Authentication is the most common source of slow test suites.
13
-
14
- ## Quick Reference
15
-
16
- ```typescript
17
- // Storage state reuse — the #1 pattern for fast auth
18
- await page.goto("/login");
19
- await page.getByLabel("Username").fill("testuser@example.com");
20
- await page.getByLabel("Password").fill("secretPass123");
21
- await page.getByRole("button", { name: "Log in" }).click();
22
- await page.context().storageState({ path: ".auth/session.json" });
23
-
24
- // Reuse in config — every test starts authenticated
25
- {
26
- use: {
27
- storageState: ".auth/session.json"
28
- }
29
- }
30
-
31
- // API login — skip the UI entirely
32
- const context = await browser.newContext();
33
- const response = await context.request.post("/api/auth/login", {
34
- data: { email: "testuser@example.com", password: "secretPass123" },
35
- });
36
- await context.storageState({ path: ".auth/session.json" });
37
- ```
38
-
39
- ## Patterns
40
-
41
- ### Storage State Reuse
42
-
43
- **Use when**: You need authenticated tests and want to avoid logging in before every test.
44
- **Avoid when**: Tests require completely fresh sessions, or you are testing the login flow itself.
45
-
46
- `storageState` serializes cookies and localStorage to a JSON file. Load it in any browser context to start authenticated instantly.
47
-
48
- ```typescript
49
- // scripts/generate-auth.ts — run once to generate the state file
50
- import { chromium } from "@playwright/test";
51
-
52
- async function generateAuthState() {
53
- const browser = await chromium.launch();
54
- const context = await browser.newContext();
55
- const page = await context.newPage();
56
-
57
- await page.goto("http://localhost:4000/login");
58
- await page.getByLabel("Username").fill("testuser@example.com");
59
- await page.getByLabel("Password").fill("secretPass123");
60
- await page.getByRole("button", { name: "Log in" }).click();
61
- await page.waitForURL("/home");
62
-
63
- await context.storageState({ path: ".auth/session.json" });
64
- await browser.close();
65
- }
66
-
67
- generateAuthState();
68
- ```
69
-
70
- ```typescript
71
- // playwright.config.ts — load saved state for all tests
72
- import { defineConfig } from "@playwright/test";
73
-
74
- export default defineConfig({
75
- use: {
76
- baseURL: "http://localhost:4000",
77
- storageState: ".auth/session.json",
78
- },
79
- });
80
- ```
81
-
82
- ```typescript
83
- // tests/home.spec.ts — test starts already logged in
84
- import { test, expect } from "@playwright/test";
85
-
86
- test("authenticated user sees home page", async ({ page }) => {
87
- await page.goto("/home");
88
- await expect(page.getByRole("heading", { name: "Home" })).toBeVisible();
89
- });
90
- ```
91
-
92
- ### Global Setup Authentication
93
-
94
- **Use when**: You want to authenticate once before the entire test suite runs.
95
- **Avoid when**: Different tests need different users, or your tokens expire faster than your suite runs.
96
-
97
- ```typescript
98
- // global-setup.ts
99
- import { chromium, type FullConfig } from "@playwright/test";
100
-
101
- async function globalSetup(config: FullConfig) {
102
- const { baseURL } = config.projects[0].use;
103
- const browser = await chromium.launch();
104
- const context = await browser.newContext();
105
- const page = await context.newPage();
106
-
107
- await page.goto(`${baseURL}/login`);
108
- await page.getByLabel("Username").fill(process.env.TEST_USER_EMAIL!);
109
- await page.getByLabel("Password").fill(process.env.TEST_USER_PASSWORD!);
110
- await page.getByRole("button", { name: "Log in" }).click();
111
- await page.waitForURL("**/home");
112
-
113
- await context.storageState({ path: ".auth/session.json" });
114
- await browser.close();
115
- }
116
-
117
- export default globalSetup;
118
- ```
119
-
120
- ```typescript
121
- // playwright.config.ts
122
- import { defineConfig } from "@playwright/test";
123
-
124
- export default defineConfig({
125
- globalSetup: require.resolve("./global-setup"),
126
- use: {
127
- baseURL: "http://localhost:4000",
128
- storageState: ".auth/session.json",
129
- },
130
- });
131
- ```
132
-
133
- Add `.auth/` to `.gitignore`. Auth state files contain session tokens and should never be committed.
134
-
135
- ### Per-Worker Authentication
136
-
137
- **Use when**: Each parallel worker needs its own authenticated session to avoid race conditions for tests that modify server-side state.
138
- **Avoid when**: Tests are read-only and a modifying shared session is safe, you can use a single shared account.
139
-
140
- > **Sharded runs**: `parallelIndex` resets per shard, so different shards can have workers with the same index. To avoid collisions, include the shard identifier in the username (e.g., `worker-${SHARD_INDEX}-${parallelIndex}@example.com`) by passing a `SHARD_INDEX` environment variable from your CI matrix.
141
-
142
- ```typescript
143
- // fixtures/auth.ts
144
- import { test as base, type BrowserContext } from "@playwright/test";
145
-
146
- type AuthFixtures = {
147
- authenticatedContext: BrowserContext;
148
- };
149
-
150
- export const test = base.extend<{}, AuthFixtures>({
151
- authenticatedContext: [
152
- async ({ browser }, use) => {
153
- const context = await browser.newContext();
154
- const page = await context.newPage();
155
-
156
- await page.goto("/login");
157
- await page
158
- .getByLabel("Username")
159
- .fill(`worker-${test.info().parallelIndex}@example.com`);
160
- await page.getByLabel("Password").fill("secretPass123");
161
- await page.getByRole("button", { name: "Log in" }).click();
162
- await page.waitForURL("/home");
163
- await page.close();
164
-
165
- await use(context);
166
- await context.close();
167
- },
168
- { scope: "worker" },
169
- ],
170
- });
171
-
172
- export { expect } from "@playwright/test";
173
- ```
174
-
175
- ```typescript
176
- // tests/settings.spec.ts
177
- import { test, expect } from "../fixtures/auth";
178
-
179
- test("update display name", async ({ authenticatedContext }) => {
180
- const page = await authenticatedContext.newPage();
181
- await page.goto("/settings/profile");
182
- await page.getByLabel("Display name").fill("Updated Name");
183
- await page.getByRole("button", { name: "Save" }).click();
184
- await expect(page.getByText("Profile saved")).toBeVisible();
185
- });
186
- ```
187
-
188
- ### Multiple Roles
189
-
190
- **Use when**: Your app has role-based access control and you need to test different permission levels.
191
- **Avoid when**: Your app has a single user role.
192
-
193
- ```typescript
194
- // global-setup.ts — authenticate all roles
195
- import { chromium, type FullConfig } from "@playwright/test";
196
-
197
- const accounts = [
198
- {
199
- role: "admin",
200
- email: "admin@example.com",
201
- password: process.env.ADMIN_PASSWORD!,
202
- },
203
- {
204
- role: "member",
205
- email: "member@example.com",
206
- password: process.env.MEMBER_PASSWORD!,
207
- },
208
- {
209
- role: "guest",
210
- email: "guest@example.com",
211
- password: process.env.GUEST_PASSWORD!,
212
- },
213
- ];
214
-
215
- async function globalSetup(config: FullConfig) {
216
- const { baseURL } = config.projects[0].use;
217
-
218
- for (const { role, email, password } of accounts) {
219
- const browser = await chromium.launch();
220
- const context = await browser.newContext();
221
- const page = await context.newPage();
222
-
223
- await page.goto(`${baseURL}/login`);
224
- await page.getByLabel("Username").fill(email);
225
- await page.getByLabel("Password").fill(password);
226
- await page.getByRole("button", { name: "Log in" }).click();
227
- await page.waitForURL("**/home");
228
-
229
- await context.storageState({ path: `.auth/${role}.json` });
230
- await browser.close();
231
- }
232
- }
233
-
234
- export default globalSetup;
235
- ```
236
-
237
- ```typescript
238
- // playwright.config.ts — one project per role
239
- import { defineConfig } from "@playwright/test";
240
-
241
- export default defineConfig({
242
- globalSetup: require.resolve("./global-setup"),
243
- projects: [
244
- {
245
- name: "admin",
246
- use: { storageState: ".auth/admin.json" },
247
- testMatch: "**/*.admin.spec.ts",
248
- },
249
- {
250
- name: "member",
251
- use: { storageState: ".auth/member.json" },
252
- testMatch: "**/*.member.spec.ts",
253
- },
254
- {
255
- name: "guest",
256
- use: { storageState: ".auth/guest.json" },
257
- testMatch: "**/*.guest.spec.ts",
258
- },
259
- {
260
- name: "anonymous",
261
- use: { storageState: { cookies: [], origins: [] } },
262
- testMatch: "**/*.anon.spec.ts",
263
- },
264
- ],
265
- });
266
- ```
267
-
268
- ```typescript
269
- // tests/admin-panel.admin.spec.ts
270
- import { test, expect } from "@playwright/test";
271
-
272
- test("admin can access user management", async ({ page }) => {
273
- await page.goto("/admin/users");
274
- await expect(
275
- page.getByRole("heading", { name: "User Management" })
276
- ).toBeVisible();
277
- await expect(page.getByRole("button", { name: "Remove user" })).toBeEnabled();
278
- });
279
- ```
280
-
281
- ```typescript
282
- // tests/admin-panel.guest.spec.ts
283
- import { test, expect } from "@playwright/test";
284
-
285
- test("guest cannot access admin panel", async ({ page }) => {
286
- await page.goto("/admin/users");
287
- await expect(page.getByText("Access denied")).toBeVisible();
288
- });
289
- ```
290
-
291
- **Alternative**: Use a fixture that accepts a role parameter when you need role switching within a single spec file.
292
-
293
- ```typescript
294
- // fixtures/auth.ts — role-based fixture
295
- import { test as base, type Page } from "@playwright/test";
296
- import fs from "fs";
297
-
298
- type RoleFixtures = {
299
- loginAs: (role: "admin" | "member" | "guest") => Promise<Page>;
300
- };
301
-
302
- export const test = base.extend<RoleFixtures>({
303
- loginAs: async ({ browser }, use) => {
304
- const pages: Page[] = [];
305
-
306
- await use(async (role) => {
307
- const statePath = `.auth/${role}.json`;
308
- if (!fs.existsSync(statePath)) {
309
- throw new Error(
310
- `Auth state for role "${role}" not found at ${statePath}`
311
- );
312
- }
313
- const context = await browser.newContext({ storageState: statePath });
314
- const page = await context.newPage();
315
- pages.push(page);
316
- return page;
317
- });
318
-
319
- for (const page of pages) {
320
- await page.context().close();
321
- }
322
- },
323
- });
324
-
325
- export { expect } from "@playwright/test";
326
- ```
327
-
328
- ```typescript
329
- // tests/role-comparison.spec.ts
330
- import { test, expect } from "../fixtures/auth";
331
-
332
- test("admin sees remove button, guest does not", async ({ loginAs }) => {
333
- const adminPage = await loginAs("admin");
334
- await adminPage.goto("/admin/users");
335
- await expect(
336
- adminPage.getByRole("button", { name: "Remove user" })
337
- ).toBeVisible();
338
-
339
- const guestPage = await loginAs("guest");
340
- await guestPage.goto("/admin/users");
341
- await expect(guestPage.getByText("Access denied")).toBeVisible();
342
- });
343
- ```
344
-
345
- ### OAuth/SSO Mocking
346
-
347
- **Use when**: Your app authenticates via a third-party OAuth provider and you cannot hit the real provider in tests.
348
- **Avoid when**: You have a dedicated test tenant on the OAuth provider.
349
-
350
- A typical OAuth flow works like this:
351
-
352
- 1. User clicks "Sign in with Provider" → browser navigates to `https://accounts.provider.com/authorize?...`
353
- 2. User authenticates on the provider's page → provider redirects back to your app's **callback route** (e.g. `http://localhost:4000/auth/callback?code=ABC&state=XYZ`)
354
- 3. Your backend exchanges the `code` for an access token, creates a session, and redirects the user to a logged-in page
355
-
356
- In tests you can short-circuit step 2 with `page.route()`: intercept the outbound request to the provider and respond with a `302` redirect straight to your callback route, supplying a mock `code` and `state`. Your backend still executes its normal callback handler — the only part that's mocked is the provider's authorization page.
357
-
358
- For cases where you want to skip the browser redirect entirely, a second approach calls a **test-only API endpoint** that creates the session server-side and returns the session cookie directly.
359
-
360
- ```typescript
361
- // tests/oauth-login.spec.ts — mock the callback route
362
- import { test, expect } from "@playwright/test";
363
-
364
- test("login via mocked OAuth flow", async ({ page }) => {
365
- await page.route("https://accounts.provider.com/**", async (route) => {
366
- const callbackUrl = new URL("http://localhost:4000/auth/callback");
367
- callbackUrl.searchParams.set("code", "mock-auth-code-xyz");
368
- callbackUrl.searchParams.set("state", "expected-state-value");
369
- await route.fulfill({
370
- status: 302,
371
- headers: { location: callbackUrl.toString() },
372
- });
373
- });
374
-
375
- await page.goto("/login");
376
- await page.getByRole("button", { name: "Sign in with Provider" }).click();
377
-
378
- await page.waitForURL("/home");
379
- await expect(page.getByRole("heading", { name: "Home" })).toBeVisible();
380
- });
381
- ```
382
-
383
- ```typescript
384
- // tests/oauth-login.spec.ts — API-based session injection
385
- import { test, expect } from "@playwright/test";
386
-
387
- test("bypass OAuth entirely via API session injection", async ({
388
- page,
389
- }) => {
390
- // Call a test-only endpoint that creates a session without OAuth
391
- const response = await page.request.post("/api/test/create-session", {
392
- data: {
393
- email: "oauth-user@example.com",
394
- provider: "provider",
395
- role: "member",
396
- },
397
- });
398
- expect(response.ok()).toBeTruthy();
399
-
400
- await page.context().storageState({ path: ".auth/oauth-user.json" });
401
- await page.goto("/home");
402
- await expect(page.getByRole("heading", { name: "Home" })).toBeVisible();
403
- });
404
- ```
405
-
406
- **Backend requirement**: Your backend must expose a test-only session creation endpoint (guarded by `NODE_ENV=test`) or accept a known test OAuth code.
407
-
408
- ### MFA Handling
409
-
410
- **Use when**: Your app requires two-factor authentication (TOTP, SMS, email codes).
411
- **Avoid when**: MFA is optional and you can disable it for test accounts.
412
-
413
- **Strategy 1**: Generate real TOTP codes from a shared secret.
414
-
415
- ```typescript
416
- // helpers/totp.ts
417
- import * as OTPAuth from "otpauth";
418
-
419
- export function generateTOTP(secret: string): string {
420
- const totp = new OTPAuth.TOTP({
421
- secret: OTPAuth.Secret.fromBase32(secret),
422
- digits: 6,
423
- period: 30,
424
- algorithm: "SHA1",
425
- });
426
- return totp.generate();
427
- }
428
- ```
429
-
430
- ```typescript
431
- // tests/mfa-login.spec.ts
432
- import { test, expect } from "@playwright/test";
433
- import { generateTOTP } from "../helpers/totp";
434
-
435
- test("login with TOTP two-factor auth", async ({ page }) => {
436
- await page.goto("/login");
437
- await page.getByLabel("Username").fill("mfa-user@example.com");
438
- await page.getByLabel("Password").fill("secretPass123");
439
- await page.getByRole("button", { name: "Log in" }).click();
440
-
441
- await expect(page.getByText("Enter your authentication code")).toBeVisible();
442
-
443
- const code = generateTOTP(process.env.MFA_TOTP_SECRET!);
444
- await page.getByLabel("Authentication code").fill(code);
445
- await page.getByRole("button", { name: "Verify" }).click();
446
-
447
- await page.waitForURL("/home");
448
- await expect(page.getByRole("heading", { name: "Home" })).toBeVisible();
449
- });
450
- ```
451
-
452
- **Strategy 2**: Mock MFA at the backend level. Have your backend accept a known bypass code (e.g., `000000`) when `NODE_ENV=test`.
453
-
454
- **Strategy 3**: Disable MFA for test accounts at the infrastructure level.
455
-
456
- ### Session Refresh
457
-
458
- **Use when**: Your tokens expire during long test runs.
459
- **Avoid when**: Your test suite runs quickly and tokens outlast the entire run.
460
-
461
- ```typescript
462
- // fixtures/auth-with-refresh.ts
463
- import { test as base, type BrowserContext } from "@playwright/test";
464
- import fs from "fs";
465
-
466
- type AuthFixtures = {
467
- authenticatedPage: import("@playwright/test").Page;
468
- };
469
-
470
- export const test = base.extend<AuthFixtures>({
471
- authenticatedPage: async ({ browser }, use) => {
472
- const statePath = ".auth/session.json";
473
-
474
- let context: BrowserContext;
475
- if (fs.existsSync(statePath)) {
476
- context = await browser.newContext({ storageState: statePath });
477
- const page = await context.newPage();
478
-
479
- const response = await page.request.get("/api/auth/me");
480
- if (response.ok()) {
481
- await use(page);
482
- await context.close();
483
- return;
484
- }
485
- await context.close();
486
- }
487
-
488
- context = await browser.newContext();
489
- const page = await context.newPage();
490
- await page.goto("/login");
491
- await page.getByLabel("Username").fill(process.env.TEST_USER_EMAIL!);
492
- await page.getByLabel("Password").fill(process.env.TEST_USER_PASSWORD!);
493
- await page.getByRole("button", { name: "Log in" }).click();
494
- await page.waitForURL("/home");
495
-
496
- await context.storageState({ path: statePath });
497
-
498
- await use(page);
499
- await context.close();
500
- },
501
- });
502
-
503
- export { expect } from "@playwright/test";
504
- ```
505
-
506
- ### Login Page Object
507
-
508
- **Use when**: Multiple test files need to log in and you want consistent, maintainable login logic.
509
- **Avoid when**: You use `storageState` everywhere and never navigate through the login UI in tests.
510
-
511
- ```typescript
512
- // page-objects/LoginPage.ts
513
- import { type Page, type Locator, expect } from "@playwright/test";
514
-
515
- export class LoginPage {
516
- readonly page: Page;
517
- readonly usernameInput: Locator;
518
- readonly passwordInput: Locator;
519
- readonly loginButton: Locator;
520
- readonly errorMessage: Locator;
521
- readonly forgotPasswordLink: Locator;
522
-
523
- constructor(page: Page) {
524
- this.page = page;
525
- this.usernameInput = page.getByLabel("Username");
526
- this.passwordInput = page.getByLabel("Password");
527
- this.loginButton = page.getByRole("button", { name: "Log in" });
528
- this.errorMessage = page.getByRole("alert");
529
- this.forgotPasswordLink = page.getByRole("link", {
530
- name: "Forgot password",
531
- });
532
- }
533
-
534
- async goto() {
535
- await this.page.goto("/login");
536
- await expect(this.loginButton).toBeVisible();
537
- }
538
-
539
- async login(username: string, password: string) {
540
- await this.usernameInput.fill(username);
541
- await this.passwordInput.fill(password);
542
- await this.loginButton.click();
543
- }
544
-
545
- async loginAndWaitForHome(username: string, password: string) {
546
- await this.login(username, password);
547
- await this.page.waitForURL("/home");
548
- }
549
-
550
- async expectError(message: string | RegExp) {
551
- await expect(this.errorMessage).toContainText(message);
552
- }
553
-
554
- async expectFieldError(field: "username" | "password", message: string) {
555
- const input =
556
- field === "username" ? this.usernameInput : this.passwordInput;
557
- await expect(input).toHaveAttribute("aria-invalid", "true");
558
- const errorId = await input.getAttribute("aria-describedby");
559
- if (errorId) {
560
- await expect(this.page.locator(`#${errorId}`)).toContainText(message);
561
- }
562
- }
563
- }
564
- ```
565
-
566
- ```typescript
567
- // tests/login.spec.ts
568
- import { test, expect } from "@playwright/test";
569
- import { LoginPage } from "../page-objects/LoginPage";
570
-
571
- test.use({ storageState: { cookies: [], origins: [] } });
572
-
573
- test.describe("login page", () => {
574
- let loginPage: LoginPage;
575
-
576
- test.beforeEach(async ({ page }) => {
577
- loginPage = new LoginPage(page);
578
- await loginPage.goto();
579
- });
580
-
581
- test("successful login redirects to home", async ({ page }) => {
582
- await loginPage.loginAndWaitForHome(
583
- "testuser@example.com",
584
- "secretPass123"
585
- );
586
- await expect(page.getByRole("heading", { name: "Home" })).toBeVisible();
587
- });
588
-
589
- test("wrong password shows error", async () => {
590
- await loginPage.login("testuser@example.com", "wrong-password");
591
- await loginPage.expectError("Invalid username or password");
592
- });
593
-
594
- test("empty fields show validation errors", async () => {
595
- await loginPage.loginButton.click();
596
- await loginPage.expectFieldError("username", "Username is required");
597
- });
598
-
599
- test("forgot password link navigates correctly", async ({ page }) => {
600
- await loginPage.forgotPasswordLink.click();
601
- await page.waitForURL("/forgot-password");
602
- await expect(
603
- page.getByRole("heading", { name: "Reset password" })
604
- ).toBeVisible();
605
- });
606
- });
607
- ```
608
-
609
- ### API-Based Login
610
-
611
- **Use when**: You want the fastest possible authentication without any browser interaction.
612
- **Avoid when**: You are specifically testing the login UI.
613
-
614
- API login is typically 5-10x faster than UI login.
615
-
616
- ```typescript
617
- // global-setup.ts — API-based login (fastest)
618
- import { request, type FullConfig } from "@playwright/test";
619
-
620
- async function globalSetup(config: FullConfig) {
621
- const { baseURL } = config.projects[0].use;
622
-
623
- const requestContext = await request.newContext({ baseURL });
624
-
625
- const response = await requestContext.post("/api/auth/login", {
626
- data: {
627
- email: process.env.TEST_USER_EMAIL!,
628
- password: process.env.TEST_USER_PASSWORD!,
629
- },
630
- });
631
-
632
- if (!response.ok()) {
633
- throw new Error(
634
- `API login failed: ${response.status()} ${await response.text()}`
635
- );
636
- }
637
-
638
- await requestContext.storageState({ path: ".auth/session.json" });
639
- await requestContext.dispose();
640
- }
641
-
642
- export default globalSetup;
643
- ```
644
-
645
- ```typescript
646
- // fixtures/api-auth.ts — fixture version for per-test authentication
647
- import { test as base } from "@playwright/test";
648
-
649
- export const test = base.extend({
650
- authenticatedPage: async ({ browser, playwright }, use) => {
651
- const apiContext = await playwright.request.newContext({
652
- baseURL: "http://localhost:4000",
653
- });
654
-
655
- await apiContext.post("/api/auth/login", {
656
- data: {
657
- email: "testuser@example.com",
658
- password: "secretPass123",
659
- },
660
- });
661
-
662
- const state = await apiContext.storageState();
663
- const context = await browser.newContext({ storageState: state });
664
- const page = await context.newPage();
665
-
666
- await use(page);
667
-
668
- await context.close();
669
- await apiContext.dispose();
670
- },
671
- });
672
-
673
- export { expect } from "@playwright/test";
674
- ```
675
-
676
- ### Unauthenticated Tests
677
-
678
- **Use when**: Testing the login page, signup flow, password reset, public pages, or redirect behavior for unauthenticated users.
679
- **Avoid when**: The test requires a logged-in user.
680
-
681
- When your config sets a default `storageState`, you must explicitly clear it for unauthenticated tests.
682
-
683
- ```typescript
684
- // tests/public-pages.spec.ts
685
- import { test, expect } from "@playwright/test";
686
-
687
- test.use({ storageState: { cookies: [], origins: [] } });
688
-
689
- test.describe("unauthenticated access", () => {
690
- test("homepage is accessible without login", async ({ page }) => {
691
- await page.goto("/");
692
- await expect(page.getByRole("heading", { name: "Welcome" })).toBeVisible();
693
- await expect(page.getByRole("link", { name: "Log in" })).toBeVisible();
694
- });
695
-
696
- test("protected route redirects to login", async ({ page }) => {
697
- await page.goto("/home");
698
- await page.waitForURL("**/login**");
699
- expect(page.url()).toContain("redirect=%2Fhome");
700
- });
701
-
702
- test("expired session shows re-login prompt", async ({ page, context }) => {
703
- await page.goto("/home");
704
- await context.clearCookies();
705
-
706
- await page.goto("/settings");
707
- await page.waitForURL("**/login**");
708
- await expect(page.getByText("Your session has expired")).toBeVisible();
709
- });
710
-
711
- test("signup flow creates account", async ({ page }) => {
712
- await page.goto("/signup");
713
- await page.getByLabel("Name").fill("New User");
714
- await page.getByLabel("Email").fill(`test-${Date.now()}@example.com`);
715
- await page.getByLabel("Password", { exact: true }).fill("secretPass123");
716
- await page.getByLabel("Confirm password").fill("secretPass123");
717
- await page.getByRole("button", { name: "Create account" }).click();
718
-
719
- await page.waitForURL("/onboarding");
720
- await expect(page.getByText("Welcome, New User")).toBeVisible();
721
- });
722
- });
723
- ```
724
-
725
- ## Decision Guide
726
-
727
- | Scenario | Approach | Speed | Isolation | When to Choose |
728
- | -------------------------------- | ------------------------------ | -------- | -------------- | -------------------------------------------------------------- |
729
- | Most tests need auth | Global setup + `storageState` | Fastest | Shared session | Default for nearly every project |
730
- | Tests modify user state | Per-worker fixture | Fast | Per worker | Tests update profile, change settings, or mutate data |
731
- | Multiple user roles | Per-project `storageState` | Fastest | Per role | App has admin/member/guest roles |
732
- | Testing the login page | No `storageState` | N/A | Full | Use `test.use({ storageState: { cookies: [], origins: [] } })` |
733
- | OAuth/SSO provider | Mock the callback | Fast | Per test | Never hit real OAuth providers in CI |
734
- | MFA is required | TOTP generation or bypass | Moderate | Per test | Generate real TOTP codes or use a test-mode bypass |
735
- | Token expires mid-suite | Session refresh fixture | Fast | Per check | Fixture validates the session before use |
736
- | Single test needs different user | `loginAs(role)` fixture | Moderate | Per call | Rare: prefer per-project roles |
737
- | API-first app (no login UI) | API login via `request.post()` | Fastest | Per test | No browser needed for auth |
738
-
739
- ### UI Login vs API Login vs Storage State
740
-
741
- ```text
742
- Need to test the login page itself?
743
- ├── Yes → UI login with LoginPage POM, no storageState
744
- └── No → Do you have a login API endpoint?
745
- ├── Yes → API login in global setup, save storageState (fastest)
746
- └── No → UI login in global setup, save storageState
747
- └── Tokens expire quickly?
748
- ├── Yes → Add session refresh fixture
749
- └── No → Standard storageState reuse is fine
750
- ```
751
-
752
- ## Anti-Patterns
753
-
754
- | Don't Do This | Problem | Do This Instead |
755
- | ------------------------------------------------------------------------- | ------------------------------------------- | ------------------------------------------------------------------------- |
756
- | Log in via UI before every test | Adds 2-5 seconds per test | Use `storageState` to skip login entirely |
757
- | Share a single auth state file across parallel workers that mutate state | Race conditions | Use per-worker fixtures with `{ scope: 'worker' }` |
758
- | Hardcode credentials in test files | Security risk | Use environment variables and `.env` files |
759
- | Ignore token expiration | Tests fail intermittently with 401 errors | Add a session validity check in your auth fixture |
760
- | Hit real OAuth providers in CI | Flaky: rate limits, CAPTCHA, network issues | Mock the OAuth callback or use API session injection |
761
- | Use `page.waitForTimeout(2000)` after login | Arbitrary delay | `await page.waitForURL('/home')` or `await expect(heading).toBeVisible()` |
762
- | Store `.auth/*.json` files in git | Tokens in version control | Add `.auth/` to `.gitignore` |
763
- | Create one "god" test account with all permissions | Cannot test role-based access control | Create separate accounts per role |
764
- | Use `browser.newContext()` without `storageState` for authenticated tests | Every context starts unauthenticated | Pass `storageState` when creating the context |
765
- | Test MFA by disabling it everywhere | You never test the MFA flow | Use TOTP generation for at least one test |
766
-
767
- ## Troubleshooting
768
-
769
- ### Global setup fails with "Target page, context or browser has been closed"
770
-
771
- **Cause**: The login page redirected unexpectedly, or the browser closed before `storageState()` was called.
772
-
773
- **Fix**:
774
-
775
- - Add `await page.waitForURL()` after the login action
776
- - Check that `baseURL` in your config matches the actual server URL and protocol
777
- - Add error handling to global setup:
778
-
779
- ```typescript
780
- const response = await page.waitForResponse("**/api/auth/**");
781
- if (!response.ok()) {
782
- throw new Error(
783
- `Login failed in global setup: ${response.status()} ${await response.text()}`
784
- );
785
- }
786
- ```
787
-
788
- ### Tests fail with 401 Unauthorized after running for a while
789
-
790
- **Cause**: The session token saved in `storageState` has expired.
791
-
792
- **Fix**:
793
-
794
- - Use the session refresh fixture pattern
795
- - Increase token expiry in test environment configuration
796
- - Switch to API-based login in a worker-scoped fixture
797
-
798
- ### `storageState` file is empty or contains no cookies
799
-
800
- **Cause**: `storageState()` was called before the login response set cookies.
801
-
802
- **Fix**:
803
-
804
- - Wait for the post-login page to load: `await page.waitForURL('/home')`
805
- - Verify cookies exist before saving:
806
-
807
- ```typescript
808
- const cookies = await context.cookies();
809
- if (cookies.length === 0) {
810
- throw new Error("No cookies found after login");
811
- }
812
- await context.storageState({ path: ".auth/session.json" });
813
- ```
814
-
815
- ### Different browsers get different cookies
816
-
817
- **Cause**: Some auth flows set cookies with `SameSite=Strict` or use browser-specific cookie behavior.
818
-
819
- **Fix**:
820
-
821
- - Generate separate auth state files per browser project
822
- - Check if your auth uses `SameSite=None; Secure` cookies that require HTTPS:
823
-
824
- ```typescript
825
- projects: [
826
- {
827
- name: 'chromium',
828
- use: { ...devices['Desktop Chrome'], storageState: '.auth/chromium-session.json' },
829
- },
830
- {
831
- name: 'firefox',
832
- use: { ...devices['Desktop Firefox'], storageState: '.auth/firefox-session.json' },
833
- },
834
- ],
835
- ```
836
-
837
- ### Parallel tests interfere with each other's sessions
838
-
839
- **Cause**: Multiple workers share the same test account and one worker's actions affect others.
840
-
841
- **Fix**:
842
-
843
- - Use per-worker test accounts: `worker-${test.info().parallelIndex}@example.com`
844
- - Use the per-worker authentication fixture pattern
845
- - Make tests idempotent
846
-
847
- ### OAuth mock does not work — still redirects to real provider
848
-
849
- **Cause**: `page.route()` was registered after the navigation that triggers the OAuth redirect.
850
-
851
- **Fix**:
852
-
853
- - Register route handlers before any navigation: call `page.route()` before `page.goto()`
854
- - Log the actual redirect URL to verify the pattern:
855
-
856
- ```typescript
857
- page.on("request", (req) => {
858
- if (req.url().includes("oauth") || req.url().includes("accounts.provider")) {
859
- console.log("OAuth request:", req.url());
860
- }
861
- });
862
- ```
863
-
864
- ## Related
865
-
866
- - [fixtures-hooks.md](../core/fixtures-hooks.md) — custom fixtures for auth setup and teardown
867
- - [configuration.md](../core/configuration.md) — `storageState`, projects, and global setup configuration
868
- - [global-setup.md](../core/global-setup.md) — global setup patterns and project dependencies
869
- - [network-advanced.md](network-advanced.md) — route interception patterns used in OAuth mocking
870
- - [api-testing.md](../testing-patterns/api-testing.md) — API request context used in API-based login
871
- - [flaky-tests.md](../debugging/flaky-tests.md) — diagnosing auth-related flakiness