testeiya 0.2.1 → 0.3.9

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (414) hide show
  1. package/LICENSE +21 -0
  2. package/README.md +41 -213
  3. package/dist/prompt/context.js +79 -0
  4. package/dist/prompt/context.js.map +1 -0
  5. package/dist/prompt/index.js +56 -0
  6. package/dist/prompt/index.js.map +1 -0
  7. package/dist/prompt/print.js +22 -0
  8. package/dist/prompt/print.js.map +1 -0
  9. package/dist/prompt/project-info.js +2 -0
  10. package/dist/prompt/project-info.js.map +1 -0
  11. package/{src/prompt/system-prompt.ts → dist/prompt/system-prompt.js} +24 -21
  12. package/dist/prompt/system-prompt.js.map +1 -0
  13. package/dist/prompt/testomatio.js +264 -0
  14. package/dist/prompt/testomatio.js.map +1 -0
  15. package/dist/prompt/tools.js +49 -0
  16. package/dist/prompt/tools.js.map +1 -0
  17. package/dist/prompt/vocab.js +8 -0
  18. package/dist/prompt/vocab.js.map +1 -0
  19. package/dist/src/args.js +72 -0
  20. package/dist/src/args.js.map +1 -0
  21. package/dist/src/cli.js +61 -0
  22. package/dist/src/cli.js.map +1 -0
  23. package/dist/src/env.js +69 -0
  24. package/dist/src/env.js.map +1 -0
  25. package/dist/src/mcp-extension.js +9 -0
  26. package/dist/src/mcp-extension.js.map +1 -0
  27. package/dist/src/mcp.js +139 -0
  28. package/dist/src/mcp.js.map +1 -0
  29. package/dist/src/model.js +66 -0
  30. package/dist/src/model.js.map +1 -0
  31. package/dist/src/result.js +41 -0
  32. package/dist/src/result.js.map +1 -0
  33. package/dist/src/run.js +199 -0
  34. package/dist/src/run.js.map +1 -0
  35. package/dist/src/session.js +77 -0
  36. package/dist/src/session.js.map +1 -0
  37. package/dist/vendor/mcp.js +14801 -0
  38. package/mcp-tools.json +2967 -0
  39. package/package.json +29 -42
  40. package/prompt/context.ts +101 -0
  41. package/prompt/index.ts +93 -0
  42. package/prompt/print.ts +23 -0
  43. package/prompt/project-info.ts +30 -0
  44. package/prompt/system-prompt.ts +173 -0
  45. package/{src/prompt → prompt}/testomatio.ts +119 -8
  46. package/{src/prompt → prompt}/tools.ts +30 -8
  47. package/prompt/vocab.ts +7 -0
  48. package/{skills.lock.json → skills/skills.lock.json} +11 -7
  49. package/skills/skills.yaml +34 -0
  50. package/assets/testeiya-logo-dark.svg +0 -16
  51. package/assets/testeiya-logo.svg +0 -15
  52. package/models.catalog.json +0 -6963
  53. package/skills/codeceptjs/ci-fix-tests/SKILL.md +0 -120
  54. package/skills/codeceptjs/codeceptjs-auth/SKILL.md +0 -158
  55. package/skills/codeceptjs/codeceptjs-exploration/SKILL.md +0 -91
  56. package/skills/codeceptjs/codeceptjs-fundamentals/SKILL.md +0 -158
  57. package/skills/codeceptjs/codeceptjs-run-analysis/SKILL.md +0 -90
  58. package/skills/codeceptjs/debugging-codeceptjs-tests/SKILL.md +0 -234
  59. package/skills/codeceptjs/migrate-codeceptjs-4/SKILL.md +0 -110
  60. package/skills/codeceptjs/migrate-cypress-to-codeceptjs/SKILL.md +0 -306
  61. package/skills/codeceptjs/migrate-protractor-to-codeceptjs/SKILL.md +0 -352
  62. package/skills/codeceptjs/migrate-selenium-java-to-codeceptjs/SKILL.md +0 -472
  63. package/skills/codeceptjs/migrate-testcafe-to-codeceptjs/SKILL.md +0 -350
  64. package/skills/codeceptjs/refactoring-codeceptjs-tests/SKILL.md +0 -81
  65. package/skills/codeceptjs/writing-codeceptjs-tests/SKILL.md +0 -206
  66. package/skills/playwright-best-practices-skill/LICENSE.md +0 -7
  67. package/skills/playwright-best-practices-skill/README.md +0 -147
  68. package/skills/playwright-best-practices-skill/SKILL.md +0 -303
  69. package/skills/playwright-best-practices-skill/advanced/authentication-flows.md +0 -360
  70. package/skills/playwright-best-practices-skill/advanced/authentication.md +0 -871
  71. package/skills/playwright-best-practices-skill/advanced/clock-mocking.md +0 -364
  72. package/skills/playwright-best-practices-skill/advanced/mobile-testing.md +0 -409
  73. package/skills/playwright-best-practices-skill/advanced/multi-context.md +0 -288
  74. package/skills/playwright-best-practices-skill/advanced/multi-user.md +0 -393
  75. package/skills/playwright-best-practices-skill/advanced/network-advanced.md +0 -452
  76. package/skills/playwright-best-practices-skill/advanced/third-party.md +0 -464
  77. package/skills/playwright-best-practices-skill/architecture/pom-vs-fixtures.md +0 -363
  78. package/skills/playwright-best-practices-skill/architecture/test-architecture.md +0 -369
  79. package/skills/playwright-best-practices-skill/architecture/when-to-mock.md +0 -383
  80. package/skills/playwright-best-practices-skill/browser-apis/browser-apis.md +0 -391
  81. package/skills/playwright-best-practices-skill/browser-apis/iframes.md +0 -403
  82. package/skills/playwright-best-practices-skill/browser-apis/service-workers.md +0 -504
  83. package/skills/playwright-best-practices-skill/browser-apis/websockets.md +0 -403
  84. package/skills/playwright-best-practices-skill/core/annotations.md +0 -424
  85. package/skills/playwright-best-practices-skill/core/assertions-waiting.md +0 -361
  86. package/skills/playwright-best-practices-skill/core/configuration.md +0 -452
  87. package/skills/playwright-best-practices-skill/core/fixtures-hooks.md +0 -417
  88. package/skills/playwright-best-practices-skill/core/global-setup.md +0 -434
  89. package/skills/playwright-best-practices-skill/core/locators.md +0 -242
  90. package/skills/playwright-best-practices-skill/core/page-object-model.md +0 -315
  91. package/skills/playwright-best-practices-skill/core/projects-dependencies.md +0 -453
  92. package/skills/playwright-best-practices-skill/core/test-data.md +0 -492
  93. package/skills/playwright-best-practices-skill/core/test-suite-structure.md +0 -361
  94. package/skills/playwright-best-practices-skill/core/test-tags.md +0 -298
  95. package/skills/playwright-best-practices-skill/debugging/console-errors.md +0 -420
  96. package/skills/playwright-best-practices-skill/debugging/debugging.md +0 -504
  97. package/skills/playwright-best-practices-skill/debugging/error-testing.md +0 -360
  98. package/skills/playwright-best-practices-skill/debugging/flaky-tests.md +0 -496
  99. package/skills/playwright-best-practices-skill/frameworks/angular.md +0 -530
  100. package/skills/playwright-best-practices-skill/frameworks/nextjs.md +0 -469
  101. package/skills/playwright-best-practices-skill/frameworks/react.md +0 -531
  102. package/skills/playwright-best-practices-skill/frameworks/vue.md +0 -574
  103. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/ci-cd.md +0 -468
  104. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/docker.md +0 -283
  105. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/github-actions.md +0 -546
  106. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/gitlab.md +0 -397
  107. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/other-providers.md +0 -521
  108. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/parallel-sharding.md +0 -371
  109. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/performance.md +0 -453
  110. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/reporting.md +0 -424
  111. package/skills/playwright-best-practices-skill/infrastructure-ci-cd/test-coverage.md +0 -497
  112. package/skills/playwright-best-practices-skill/testing-patterns/accessibility.md +0 -359
  113. package/skills/playwright-best-practices-skill/testing-patterns/api-testing.md +0 -719
  114. package/skills/playwright-best-practices-skill/testing-patterns/browser-extensions.md +0 -506
  115. package/skills/playwright-best-practices-skill/testing-patterns/canvas-webgl.md +0 -493
  116. package/skills/playwright-best-practices-skill/testing-patterns/component-testing.md +0 -500
  117. package/skills/playwright-best-practices-skill/testing-patterns/drag-drop.md +0 -576
  118. package/skills/playwright-best-practices-skill/testing-patterns/electron.md +0 -509
  119. package/skills/playwright-best-practices-skill/testing-patterns/file-operations.md +0 -377
  120. package/skills/playwright-best-practices-skill/testing-patterns/file-upload-download.md +0 -562
  121. package/skills/playwright-best-practices-skill/testing-patterns/forms-validation.md +0 -561
  122. package/skills/playwright-best-practices-skill/testing-patterns/graphql-testing.md +0 -331
  123. package/skills/playwright-best-practices-skill/testing-patterns/i18n.md +0 -508
  124. package/skills/playwright-best-practices-skill/testing-patterns/performance-testing.md +0 -476
  125. package/skills/playwright-best-practices-skill/testing-patterns/security-testing.md +0 -430
  126. package/skills/playwright-best-practices-skill/testing-patterns/visual-regression.md +0 -634
  127. package/skills/playwright-cli/SKILL.md +0 -420
  128. package/skills/playwright-cli/references/element-attributes.md +0 -23
  129. package/skills/playwright-cli/references/playwright-tests.md +0 -39
  130. package/skills/playwright-cli/references/request-mocking.md +0 -87
  131. package/skills/playwright-cli/references/running-code.md +0 -241
  132. package/skills/playwright-cli/references/session-management.md +0 -225
  133. package/skills/playwright-cli/references/storage-state.md +0 -275
  134. package/skills/playwright-cli/references/test-generation.md +0 -433
  135. package/skills/playwright-cli/references/tracing.md +0 -139
  136. package/skills/playwright-cli/references/video-recording.md +0 -143
  137. package/skills/testeiya/README.md +0 -29
  138. package/skills/testeiya/answer-formatting/SKILL.md +0 -30
  139. package/skills/testeiya/check-cucumber/SKILL.md +0 -200
  140. package/skills/testeiya/check-tests/SKILL.md +0 -260
  141. package/skills/testeiya/manual-run-assistant/SKILL.md +0 -61
  142. package/skills/testeiya/testomatio-docs/INDEX.md +0 -175
  143. package/skills/testeiya/testomatio-docs/SKILL.md +0 -102
  144. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-agents.md +0 -144
  145. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-powered-features.md +0 -531
  146. package/skills/testeiya/testomatio-docs/docs/advanced/ai-powered-features/ai-requirements.md +0 -437
  147. package/skills/testeiya/testomatio-docs/docs/advanced/api-access/index.md +0 -191
  148. package/skills/testeiya/testomatio-docs/docs/advanced/branches-folder/index.md +0 -277
  149. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-demos.mdx +0 -39
  150. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/bulk-edit-on-suite-and-test-level.md +0 -122
  151. package/skills/testeiya/testomatio-docs/docs/advanced/bulk-edit-folder/what-is-bulk-edit.md +0 -170
  152. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/branches.md +0 -53
  153. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/index.mdx +0 -98
  154. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/jira-issue.md +0 -151
  155. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/runs-and-reports.md +0 -377
  156. package/skills/testeiya/testomatio-docs/docs/advanced/jira-plugin/work-in-jira.md +0 -267
  157. package/skills/testeiya/testomatio-docs/docs/advanced/living-doc/index.md +0 -138
  158. package/skills/testeiya/testomatio-docs/docs/advanced/milestones/index.md +0 -220
  159. package/skills/testeiya/testomatio-docs/docs/advanced/shortcuts/index.md +0 -48
  160. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/labels-and-custom-fields.md +0 -201
  161. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags-or-labels.md +0 -94
  162. package/skills/testeiya/testomatio-docs/docs/advanced/tags-labels/tags.md +0 -243
  163. package/skills/testeiya/testomatio-docs/docs/advanced/test-artifacts/index.md +0 -135
  164. package/skills/testeiya/testomatio-docs/docs/advanced/tql/index.md +0 -394
  165. package/skills/testeiya/testomatio-docs/docs/getting-started/index.md +0 -290
  166. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/azure.md +0 -96
  167. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bamboo.md +0 -94
  168. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/bitbucket.md +0 -106
  169. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/circle.md +0 -115
  170. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/github.md +0 -120
  171. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/gitlab.md +0 -88
  172. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/index.mdx +0 -151
  173. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/jenkins.md +0 -121
  174. package/skills/testeiya/testomatio-docs/docs/integrations/continuous-integration/teamcity.md +0 -96
  175. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/azure.md +0 -31
  176. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/clickup.md +0 -54
  177. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/confluence.md +0 -34
  178. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/github.md +0 -31
  179. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/gitlab.md +0 -93
  180. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/index.md +0 -131
  181. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/jira.md +0 -164
  182. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/linear.md +0 -29
  183. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/shortcut.md +0 -67
  184. package/skills/testeiya/testomatio-docs/docs/integrations/issues-management/youtrack.md +0 -94
  185. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/azure-devops.md +0 -53
  186. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/email.md +0 -71
  187. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/jira.md +0 -52
  188. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/ms-teams.md +0 -60
  189. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/rules.md +0 -267
  190. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/slack.md +0 -82
  191. package/skills/testeiya/testomatio-docs/docs/integrations/report-notifications/telegram.md +0 -73
  192. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/index.mdx +0 -207
  193. package/skills/testeiya/testomatio-docs/docs/integrations/scim-provisioning/okta.md +0 -204
  194. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/azure.md +0 -95
  195. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/google.md +0 -75
  196. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/index.mdx +0 -33
  197. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/okta.md +0 -108
  198. package/skills/testeiya/testomatio-docs/docs/integrations/single-sign-on/saml.md +0 -66
  199. package/skills/testeiya/testomatio-docs/docs/legal/compliance/gdpr.md +0 -95
  200. package/skills/testeiya/testomatio-docs/docs/legal/compliance/index.mdx +0 -94
  201. package/skills/testeiya/testomatio-docs/docs/legal/compliance/privacy.md +0 -26
  202. package/skills/testeiya/testomatio-docs/docs/legal/compliance/terms.md +0 -32
  203. package/skills/testeiya/testomatio-docs/docs/legal/security/index.mdx +0 -242
  204. package/skills/testeiya/testomatio-docs/docs/legal/security/jira.md +0 -140
  205. package/skills/testeiya/testomatio-docs/docs/legal/security/subprocessors.md +0 -76
  206. package/skills/testeiya/testomatio-docs/docs/management/company/administration.md +0 -363
  207. package/skills/testeiya/testomatio-docs/docs/management/company/audit-log.md +0 -41
  208. package/skills/testeiya/testomatio-docs/docs/management/company/plan-features-comparison.md +0 -240
  209. package/skills/testeiya/testomatio-docs/docs/management/company/subscriptions.md +0 -326
  210. package/skills/testeiya/testomatio-docs/docs/management/company/trials.md +0 -75
  211. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/accountant.md +0 -49
  212. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/index.mdx +0 -285
  213. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/read-only-user.md +0 -67
  214. package/skills/testeiya/testomatio-docs/docs/management/company/users-and-permissions/teams.md +0 -138
  215. package/skills/testeiya/testomatio-docs/docs/management/project/settings.md +0 -87
  216. package/skills/testeiya/testomatio-docs/docs/management/project/templates.md +0 -546
  217. package/skills/testeiya/testomatio-docs/docs/project/analytics/index.md +0 -326
  218. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/classical-tests-markdown-format.md +0 -386
  219. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/download-manual-tests-as-files.md +0 -378
  220. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-obsidian.md +0 -112
  221. package/skills/testeiya/testomatio-docs/docs/project/import-export/export-tests/export-to-spreadsheet.md +0 -127
  222. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/auto-import.md +0 -63
  223. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Allure-TestOps.md +0 -49
  224. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-QTest.md +0 -41
  225. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Qase.md +0 -39
  226. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-Zephyr.md +0 -37
  227. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-csv-xlsx.md +0 -117
  228. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-cucumber.md +0 -93
  229. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-qmetry.md +0 -44
  230. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-source-code.md +0 -117
  231. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testcaselabs.md +0 -44
  232. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testmo.md +0 -47
  233. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-testrail.md +0 -82
  234. package/skills/testeiya/testomatio-docs/docs/project/import-export/import/import-tests-from-xray.md +0 -55
  235. package/skills/testeiya/testomatio-docs/docs/project/plans/index.md +0 -334
  236. package/skills/testeiya/testomatio-docs/docs/project/pulse/index.md +0 -104
  237. package/skills/testeiya/testomatio-docs/docs/project/runs/archive-runs-and-groups.md +0 -176
  238. package/skills/testeiya/testomatio-docs/docs/project/runs/custom-statuses.md +0 -195
  239. package/skills/testeiya/testomatio-docs/docs/project/runs/environments.md +0 -203
  240. package/skills/testeiya/testomatio-docs/docs/project/runs/managing-runs.md +0 -455
  241. package/skills/testeiya/testomatio-docs/docs/project/runs/merge-strategies.md +0 -137
  242. package/skills/testeiya/testomatio-docs/docs/project/runs/reports.md +0 -329
  243. package/skills/testeiya/testomatio-docs/docs/project/runs/rungroups.md +0 -342
  244. package/skills/testeiya/testomatio-docs/docs/project/runs/running-automated-tests.md +0 -256
  245. package/skills/testeiya/testomatio-docs/docs/project/runs/running-manual-and-automated-tests.md +0 -331
  246. package/skills/testeiya/testomatio-docs/docs/project/runs/running-tests-manually.md +0 -633
  247. package/skills/testeiya/testomatio-docs/docs/project/runs/temporary-tests-notes.md +0 -223
  248. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/snippets.md +0 -68
  249. package/skills/testeiya/testomatio-docs/docs/project/steps-snippets/steps.md +0 -181
  250. package/skills/testeiya/testomatio-docs/docs/project/tests/bdd-test-case-editor.md +0 -98
  251. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-test-case-editor.md +0 -354
  252. package/skills/testeiya/testomatio-docs/docs/project/tests/classical-vs-bdd.md +0 -169
  253. package/skills/testeiya/testomatio-docs/docs/project/tests/copy-and-move-your-tests.md +0 -156
  254. package/skills/testeiya/testomatio-docs/docs/project/tests/other-features-for-test-case-design.md +0 -412
  255. package/skills/testeiya/testomatio-docs/docs/project/tests/test-case-creation-and-editing.md +0 -527
  256. package/skills/testeiya/testomatio-docs/docs/support/index.md +0 -75
  257. package/skills/testeiya/testomatio-docs/docs/test-reporting/artifacts.md +0 -388
  258. package/skills/testeiya/testomatio-docs/docs/test-reporting/cli.md +0 -215
  259. package/skills/testeiya/testomatio-docs/docs/test-reporting/configuration.md +0 -247
  260. package/skills/testeiya/testomatio-docs/docs/test-reporting/frameworks.md +0 -490
  261. package/skills/testeiya/testomatio-docs/docs/test-reporting/functions.md +0 -144
  262. package/skills/testeiya/testomatio-docs/docs/test-reporting/index.mdx +0 -48
  263. package/skills/testeiya/testomatio-docs/docs/test-reporting/junit.md +0 -248
  264. package/skills/testeiya/testomatio-docs/docs/test-reporting/logger.md +0 -138
  265. package/skills/testeiya/testomatio-docs/docs/test-reporting/php.md +0 -77
  266. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/bitbucket.md +0 -72
  267. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/csv.md +0 -23
  268. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/debug.md +0 -18
  269. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/github.md +0 -63
  270. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/gitlab.md +0 -29
  271. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/html.md +0 -80
  272. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/index.mdx +0 -57
  273. package/skills/testeiya/testomatio-docs/docs/test-reporting/pipes/testomatio.md +0 -331
  274. package/skills/testeiya/testomatio-docs/docs/test-reporting/python.md +0 -229
  275. package/skills/testeiya/testomatio-docs/docs/test-reporting/workflows.md +0 -325
  276. package/skills/testeiya/testomatio-docs/docs/tutorials/Interacting-via-API.md +0 -159
  277. package/skills/testeiya/testomatio-docs/docs/tutorials/Manual-Testing-Classic.md +0 -164
  278. package/skills/testeiya/testomatio-docs/docs/tutorials/Set-Up-Read-Only-Access.md +0 -85
  279. package/skills/testeiya/testomatio-docs/docs/tutorials/Using-AI-in-Testing.md +0 -163
  280. package/skills/testeiya/testomatio-docs/docs/tutorials/Working-with-Jira.md +0 -125
  281. package/skills/testeiya/testomatio-docs/docs/tutorials/java.md +0 -478
  282. package/skills/testeiya/testomatio-docs/docs/tutorials/playwright.md +0 -207
  283. package/skills/testeiya/testomatio-docs/docs/tutorials/webdriver.md +0 -218
  284. package/skills/testeiya/testomatio-docs/docs.lock.json +0 -6
  285. package/skills/testeiya/testomatio-reporter/SKILL.md +0 -307
  286. package/skills/testomatio/explorbot/explorbot-fundamentals/SKILL.md +0 -88
  287. package/skills/testomatio/explorbot/explorbot-plan/SKILL.md +0 -95
  288. package/skills/testomatio/explorbot/explorbot-setup/SKILL.md +0 -334
  289. package/skills/testomatio/test-automation/automate-manual-test-cases/CLAUDE.md +0 -56
  290. package/skills/testomatio/test-automation/automate-manual-test-cases/SKILL.md +0 -242
  291. package/skills/testomatio/test-automation/automate-manual-test-cases/references/CODECEPTJS_BEST_PRACTICES.md +0 -182
  292. package/skills/testomatio/test-automation/automate-manual-test-cases/references/FINAL_SUMMARY_TEMPLATE.md +0 -22
  293. package/skills/testomatio/test-automation/automate-manual-test-cases/references/PLAYWRIGHT_BEST_PRACTICES.md +0 -90
  294. package/skills/testomatio/test-automation/automate-manual-test-cases/references/POM_BEST_PRACTICES.md +0 -53
  295. package/skills/testomatio/test-automation/automate-manual-test-cases/references/TEST_DATA_MANAGEMENT.md +0 -52
  296. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/SKILL.md +0 -107
  297. package/skills/testomatio/test-automation/debug-fix-failed-flaky-autotests/references/DEBUGGING_QUICK_REFERENCE.md +0 -113
  298. package/skills/testomatio/test-automation/qa-automation-test-consolidation/SKILL.md +0 -29
  299. package/skills/testomatio/test-automation/run-tests-with-testomatio-reporter/SKILL.md +0 -151
  300. package/skills/testomatio/test-automation/setup-pr-testing/SKILL.md +0 -199
  301. package/skills/testomatio/test-automation/testomat-allure-adapter/SKILL.md +0 -289
  302. package/skills/testomatio/test-management/detect-duplicate-test-cases/SKILL.md +0 -86
  303. package/skills/testomatio/test-management/detect-duplicate-test-cases/references/DUPLICATE_INSTRUCTIONS.md +0 -54
  304. package/skills/testomatio/test-management/improve-test-cases/SKILL.md +0 -114
  305. package/skills/testomatio/test-management/improve-test-cases/references/TESTOMAT_MARKDOWN_EXAMPLE.md +0 -66
  306. package/skills/testomatio/test-management/pull-request-diff-analyzer/SKILL.md +0 -141
  307. package/skills/testomatio/test-management/qa-e2e-tests-reporting/SKILL.md +0 -354
  308. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_ARTIFACTS.md +0 -82
  309. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_HTML_REPORT.md +0 -37
  310. package/skills/testomatio/test-management/qa-e2e-tests-reporting/references/TESTOMATIO_REPORTERS_CONFIG.md +0 -118
  311. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/SKILL.md +0 -149
  312. package/skills/testomatio/test-management/qa-pr-requirements-analyzer/references/summary-example.md +0 -54
  313. package/skills/testomatio/test-management/qa-requirement-reviewer/SKILL.md +0 -126
  314. package/skills/testomatio/test-management/qa-requirement-reviewer/references/requirements_reviewer_examples.md +0 -128
  315. package/skills/testomatio/test-management/qa-test-code-coverage/SKILL.md +0 -174
  316. package/skills/testomatio/test-management/qa-test-code-coverage/references/COVERAGE_FILE_FORMAT.md +0 -138
  317. package/skills/testomatio/test-management/qa-test-code-coverage/references/E2E_FRAMEWORKS.md +0 -65
  318. package/skills/testomatio/test-management/qa-test-code-coverage/scripts/check-coverage.mjs +0 -40
  319. package/skills/testomatio/test-management/qa-thinking/SKILL.md +0 -36
  320. package/skills/testomatio/test-management/qa-write-test-cases/SKILL.md +0 -267
  321. package/skills/testomatio/test-management/qa-write-test-cases/references/test-case-format.md +0 -387
  322. package/skills/testomatio/test-management/qa-write-test-cases/references/testomat-tms-guide.md +0 -72
  323. package/skills/testomatio/test-management/qa-write-test-cases/references/writing-rule.md +0 -159
  324. package/skills/testomatio/test-management/scan-automation-project/SKILL.md +0 -152
  325. package/skills/testomatio/test-management/sync-test-cases-with-tms/SKILL.md +0 -107
  326. package/skills/testomatio/test-management/sync-test-cases-with-tms/references/TESTOMATIO_CLI.md +0 -140
  327. package/skills/testomatio/test-management/testomatio-mcp/SKILL.md +0 -182
  328. package/skills/testomatio/test-management/testomatio-mcp/references/MCP_SETUP.md +0 -169
  329. package/skills.yaml +0 -21
  330. package/src/ai-debug.ts +0 -188
  331. package/src/api/agent-get.ts +0 -22
  332. package/src/api/agent-start.ts +0 -384
  333. package/src/api/client-log.ts +0 -29
  334. package/src/api/context.ts +0 -332
  335. package/src/api/debug-layout.ts +0 -47
  336. package/src/api/debug-report.ts +0 -29
  337. package/src/api/debug-snapshot.ts +0 -30
  338. package/src/api/debug-stream.ts +0 -52
  339. package/src/api/files-delete.ts +0 -184
  340. package/src/api/files-read.ts +0 -41
  341. package/src/api/files-rename.ts +0 -99
  342. package/src/api/files-tree.ts +0 -292
  343. package/src/api/files-write.ts +0 -41
  344. package/src/api/mcp.ts +0 -603
  345. package/src/api/memory.ts +0 -69
  346. package/src/api/open-external.ts +0 -39
  347. package/src/api/playwright-cli.ts +0 -606
  348. package/src/api/providers.ts +0 -457
  349. package/src/api/read-env-token.ts +0 -33
  350. package/src/api/sessions.ts +0 -79
  351. package/src/api/settings.ts +0 -120
  352. package/src/api/skills.ts +0 -58
  353. package/src/api/testomatio-attachment.ts +0 -89
  354. package/src/api/testomatio-auth.ts +0 -284
  355. package/src/api/testomatio-proxy.ts +0 -197
  356. package/src/api/testomatio-run-stats.ts +0 -81
  357. package/src/api/testomatio-target.ts +0 -225
  358. package/src/api/testomatio-transcription.ts +0 -82
  359. package/src/api/workspace-search.ts +0 -96
  360. package/src/api/workspace-sync.ts +0 -151
  361. package/src/api/workspace.ts +0 -165
  362. package/src/app-server.ts +0 -556
  363. package/src/bridge.ts +0 -251
  364. package/src/check-tests.ts +0 -156
  365. package/src/cli.ts +0 -17
  366. package/src/commands.ts +0 -244
  367. package/src/config.ts +0 -183
  368. package/src/connection.ts +0 -658
  369. package/src/context-store.ts +0 -265
  370. package/src/debug-bus.ts +0 -405
  371. package/src/extensions/tool-gate.ts +0 -220
  372. package/src/extensions/webui/ask-channel.ts +0 -52
  373. package/src/extensions/webui/index.ts +0 -184
  374. package/src/extensions/webui/tools/ask-question.ts +0 -88
  375. package/src/extensions/webui/tools/query-result.ts +0 -79
  376. package/src/extensions/webui/tools/render-chart.ts +0 -53
  377. package/src/extensions/webui/tools/render-item.ts +0 -61
  378. package/src/extensions/webui/tools/render-list.ts +0 -170
  379. package/src/extensions/webui/tools/render-result.ts +0 -85
  380. package/src/extensions/webui/tools/render-tree.ts +0 -71
  381. package/src/extensions/webui/tools/ui-widget.ts +0 -54
  382. package/src/extensions/webui/tools/widget-result.ts +0 -13
  383. package/src/extensions/webui/widget-channel.ts +0 -50
  384. package/src/file-log.ts +0 -196
  385. package/src/git-tracked.ts +0 -68
  386. package/src/gitignore.ts +0 -53
  387. package/src/json-store.ts +0 -43
  388. package/src/load-env.ts +0 -70
  389. package/src/loader-style.ts +0 -96
  390. package/src/main.ts +0 -140
  391. package/src/mcp-catalog.ts +0 -96
  392. package/src/models-catalog.ts +0 -72
  393. package/src/permissions.ts +0 -120
  394. package/src/project-dir.ts +0 -189
  395. package/src/project-info.ts +0 -108
  396. package/src/prompt/app-ui.ts +0 -59
  397. package/src/prompt/browser.ts +0 -27
  398. package/src/prompt/index.ts +0 -62
  399. package/src/server-info.ts +0 -62
  400. package/src/session-factory.ts +0 -442
  401. package/src/session-store.ts +0 -115
  402. package/src/shell-env.ts +0 -45
  403. package/src/skills.ts +0 -163
  404. package/src/sync-snapshot.ts +0 -140
  405. package/src/telemetry.ts +0 -239
  406. package/src/testomatio-auth.ts +0 -299
  407. package/src/testomatio.ts +0 -98
  408. package/src/theme.ts +0 -30
  409. package/src/user-env.ts +0 -94
  410. package/src/welcome.ts +0 -194
  411. package/src/workspace/safe-path.ts +0 -85
  412. package/src/workspace/test-md.ts +0 -70
  413. package/src/workspace-model.ts +0 -440
  414. package/testeiya.config.json +0 -14
@@ -1,871 +0,0 @@
1
- # Authentication Testing
2
-
3
- ## Table of Contents
4
-
5
- 1. [Quick Reference](#quick-reference)
6
- 2. [Patterns](#patterns)
7
- 3. [Decision Guide](#decision-guide)
8
- 4. [Anti-Patterns](#anti-patterns)
9
- 5. [Troubleshooting](#troubleshooting)
10
- 6. [Related](#related)
11
-
12
- > **When to use**: Apps with login, session management, or protected routes. Authentication is the most common source of slow test suites.
13
-
14
- ## Quick Reference
15
-
16
- ```typescript
17
- // Storage state reuse — the #1 pattern for fast auth
18
- await page.goto("/login");
19
- await page.getByLabel("Username").fill("testuser@example.com");
20
- await page.getByLabel("Password").fill("secretPass123");
21
- await page.getByRole("button", { name: "Log in" }).click();
22
- await page.context().storageState({ path: ".auth/session.json" });
23
-
24
- // Reuse in config — every test starts authenticated
25
- {
26
- use: {
27
- storageState: ".auth/session.json"
28
- }
29
- }
30
-
31
- // API login — skip the UI entirely
32
- const context = await browser.newContext();
33
- const response = await context.request.post("/api/auth/login", {
34
- data: { email: "testuser@example.com", password: "secretPass123" },
35
- });
36
- await context.storageState({ path: ".auth/session.json" });
37
- ```
38
-
39
- ## Patterns
40
-
41
- ### Storage State Reuse
42
-
43
- **Use when**: You need authenticated tests and want to avoid logging in before every test.
44
- **Avoid when**: Tests require completely fresh sessions, or you are testing the login flow itself.
45
-
46
- `storageState` serializes cookies and localStorage to a JSON file. Load it in any browser context to start authenticated instantly.
47
-
48
- ```typescript
49
- // scripts/generate-auth.ts — run once to generate the state file
50
- import { chromium } from "@playwright/test";
51
-
52
- async function generateAuthState() {
53
- const browser = await chromium.launch();
54
- const context = await browser.newContext();
55
- const page = await context.newPage();
56
-
57
- await page.goto("http://localhost:4000/login");
58
- await page.getByLabel("Username").fill("testuser@example.com");
59
- await page.getByLabel("Password").fill("secretPass123");
60
- await page.getByRole("button", { name: "Log in" }).click();
61
- await page.waitForURL("/home");
62
-
63
- await context.storageState({ path: ".auth/session.json" });
64
- await browser.close();
65
- }
66
-
67
- generateAuthState();
68
- ```
69
-
70
- ```typescript
71
- // playwright.config.ts — load saved state for all tests
72
- import { defineConfig } from "@playwright/test";
73
-
74
- export default defineConfig({
75
- use: {
76
- baseURL: "http://localhost:4000",
77
- storageState: ".auth/session.json",
78
- },
79
- });
80
- ```
81
-
82
- ```typescript
83
- // tests/home.spec.ts — test starts already logged in
84
- import { test, expect } from "@playwright/test";
85
-
86
- test("authenticated user sees home page", async ({ page }) => {
87
- await page.goto("/home");
88
- await expect(page.getByRole("heading", { name: "Home" })).toBeVisible();
89
- });
90
- ```
91
-
92
- ### Global Setup Authentication
93
-
94
- **Use when**: You want to authenticate once before the entire test suite runs.
95
- **Avoid when**: Different tests need different users, or your tokens expire faster than your suite runs.
96
-
97
- ```typescript
98
- // global-setup.ts
99
- import { chromium, type FullConfig } from "@playwright/test";
100
-
101
- async function globalSetup(config: FullConfig) {
102
- const { baseURL } = config.projects[0].use;
103
- const browser = await chromium.launch();
104
- const context = await browser.newContext();
105
- const page = await context.newPage();
106
-
107
- await page.goto(`${baseURL}/login`);
108
- await page.getByLabel("Username").fill(process.env.TEST_USER_EMAIL!);
109
- await page.getByLabel("Password").fill(process.env.TEST_USER_PASSWORD!);
110
- await page.getByRole("button", { name: "Log in" }).click();
111
- await page.waitForURL("**/home");
112
-
113
- await context.storageState({ path: ".auth/session.json" });
114
- await browser.close();
115
- }
116
-
117
- export default globalSetup;
118
- ```
119
-
120
- ```typescript
121
- // playwright.config.ts
122
- import { defineConfig } from "@playwright/test";
123
-
124
- export default defineConfig({
125
- globalSetup: require.resolve("./global-setup"),
126
- use: {
127
- baseURL: "http://localhost:4000",
128
- storageState: ".auth/session.json",
129
- },
130
- });
131
- ```
132
-
133
- Add `.auth/` to `.gitignore`. Auth state files contain session tokens and should never be committed.
134
-
135
- ### Per-Worker Authentication
136
-
137
- **Use when**: Each parallel worker needs its own authenticated session to avoid race conditions for tests that modify server-side state.
138
- **Avoid when**: Tests are read-only and a modifying shared session is safe, you can use a single shared account.
139
-
140
- > **Sharded runs**: `parallelIndex` resets per shard, so different shards can have workers with the same index. To avoid collisions, include the shard identifier in the username (e.g., `worker-${SHARD_INDEX}-${parallelIndex}@example.com`) by passing a `SHARD_INDEX` environment variable from your CI matrix.
141
-
142
- ```typescript
143
- // fixtures/auth.ts
144
- import { test as base, type BrowserContext } from "@playwright/test";
145
-
146
- type AuthFixtures = {
147
- authenticatedContext: BrowserContext;
148
- };
149
-
150
- export const test = base.extend<{}, AuthFixtures>({
151
- authenticatedContext: [
152
- async ({ browser }, use) => {
153
- const context = await browser.newContext();
154
- const page = await context.newPage();
155
-
156
- await page.goto("/login");
157
- await page
158
- .getByLabel("Username")
159
- .fill(`worker-${test.info().parallelIndex}@example.com`);
160
- await page.getByLabel("Password").fill("secretPass123");
161
- await page.getByRole("button", { name: "Log in" }).click();
162
- await page.waitForURL("/home");
163
- await page.close();
164
-
165
- await use(context);
166
- await context.close();
167
- },
168
- { scope: "worker" },
169
- ],
170
- });
171
-
172
- export { expect } from "@playwright/test";
173
- ```
174
-
175
- ```typescript
176
- // tests/settings.spec.ts
177
- import { test, expect } from "../fixtures/auth";
178
-
179
- test("update display name", async ({ authenticatedContext }) => {
180
- const page = await authenticatedContext.newPage();
181
- await page.goto("/settings/profile");
182
- await page.getByLabel("Display name").fill("Updated Name");
183
- await page.getByRole("button", { name: "Save" }).click();
184
- await expect(page.getByText("Profile saved")).toBeVisible();
185
- });
186
- ```
187
-
188
- ### Multiple Roles
189
-
190
- **Use when**: Your app has role-based access control and you need to test different permission levels.
191
- **Avoid when**: Your app has a single user role.
192
-
193
- ```typescript
194
- // global-setup.ts — authenticate all roles
195
- import { chromium, type FullConfig } from "@playwright/test";
196
-
197
- const accounts = [
198
- {
199
- role: "admin",
200
- email: "admin@example.com",
201
- password: process.env.ADMIN_PASSWORD!,
202
- },
203
- {
204
- role: "member",
205
- email: "member@example.com",
206
- password: process.env.MEMBER_PASSWORD!,
207
- },
208
- {
209
- role: "guest",
210
- email: "guest@example.com",
211
- password: process.env.GUEST_PASSWORD!,
212
- },
213
- ];
214
-
215
- async function globalSetup(config: FullConfig) {
216
- const { baseURL } = config.projects[0].use;
217
-
218
- for (const { role, email, password } of accounts) {
219
- const browser = await chromium.launch();
220
- const context = await browser.newContext();
221
- const page = await context.newPage();
222
-
223
- await page.goto(`${baseURL}/login`);
224
- await page.getByLabel("Username").fill(email);
225
- await page.getByLabel("Password").fill(password);
226
- await page.getByRole("button", { name: "Log in" }).click();
227
- await page.waitForURL("**/home");
228
-
229
- await context.storageState({ path: `.auth/${role}.json` });
230
- await browser.close();
231
- }
232
- }
233
-
234
- export default globalSetup;
235
- ```
236
-
237
- ```typescript
238
- // playwright.config.ts — one project per role
239
- import { defineConfig } from "@playwright/test";
240
-
241
- export default defineConfig({
242
- globalSetup: require.resolve("./global-setup"),
243
- projects: [
244
- {
245
- name: "admin",
246
- use: { storageState: ".auth/admin.json" },
247
- testMatch: "**/*.admin.spec.ts",
248
- },
249
- {
250
- name: "member",
251
- use: { storageState: ".auth/member.json" },
252
- testMatch: "**/*.member.spec.ts",
253
- },
254
- {
255
- name: "guest",
256
- use: { storageState: ".auth/guest.json" },
257
- testMatch: "**/*.guest.spec.ts",
258
- },
259
- {
260
- name: "anonymous",
261
- use: { storageState: { cookies: [], origins: [] } },
262
- testMatch: "**/*.anon.spec.ts",
263
- },
264
- ],
265
- });
266
- ```
267
-
268
- ```typescript
269
- // tests/admin-panel.admin.spec.ts
270
- import { test, expect } from "@playwright/test";
271
-
272
- test("admin can access user management", async ({ page }) => {
273
- await page.goto("/admin/users");
274
- await expect(
275
- page.getByRole("heading", { name: "User Management" })
276
- ).toBeVisible();
277
- await expect(page.getByRole("button", { name: "Remove user" })).toBeEnabled();
278
- });
279
- ```
280
-
281
- ```typescript
282
- // tests/admin-panel.guest.spec.ts
283
- import { test, expect } from "@playwright/test";
284
-
285
- test("guest cannot access admin panel", async ({ page }) => {
286
- await page.goto("/admin/users");
287
- await expect(page.getByText("Access denied")).toBeVisible();
288
- });
289
- ```
290
-
291
- **Alternative**: Use a fixture that accepts a role parameter when you need role switching within a single spec file.
292
-
293
- ```typescript
294
- // fixtures/auth.ts — role-based fixture
295
- import { test as base, type Page } from "@playwright/test";
296
- import fs from "fs";
297
-
298
- type RoleFixtures = {
299
- loginAs: (role: "admin" | "member" | "guest") => Promise<Page>;
300
- };
301
-
302
- export const test = base.extend<RoleFixtures>({
303
- loginAs: async ({ browser }, use) => {
304
- const pages: Page[] = [];
305
-
306
- await use(async (role) => {
307
- const statePath = `.auth/${role}.json`;
308
- if (!fs.existsSync(statePath)) {
309
- throw new Error(
310
- `Auth state for role "${role}" not found at ${statePath}`
311
- );
312
- }
313
- const context = await browser.newContext({ storageState: statePath });
314
- const page = await context.newPage();
315
- pages.push(page);
316
- return page;
317
- });
318
-
319
- for (const page of pages) {
320
- await page.context().close();
321
- }
322
- },
323
- });
324
-
325
- export { expect } from "@playwright/test";
326
- ```
327
-
328
- ```typescript
329
- // tests/role-comparison.spec.ts
330
- import { test, expect } from "../fixtures/auth";
331
-
332
- test("admin sees remove button, guest does not", async ({ loginAs }) => {
333
- const adminPage = await loginAs("admin");
334
- await adminPage.goto("/admin/users");
335
- await expect(
336
- adminPage.getByRole("button", { name: "Remove user" })
337
- ).toBeVisible();
338
-
339
- const guestPage = await loginAs("guest");
340
- await guestPage.goto("/admin/users");
341
- await expect(guestPage.getByText("Access denied")).toBeVisible();
342
- });
343
- ```
344
-
345
- ### OAuth/SSO Mocking
346
-
347
- **Use when**: Your app authenticates via a third-party OAuth provider and you cannot hit the real provider in tests.
348
- **Avoid when**: You have a dedicated test tenant on the OAuth provider.
349
-
350
- A typical OAuth flow works like this:
351
-
352
- 1. User clicks "Sign in with Provider" → browser navigates to `https://accounts.provider.com/authorize?...`
353
- 2. User authenticates on the provider's page → provider redirects back to your app's **callback route** (e.g. `http://localhost:4000/auth/callback?code=ABC&state=XYZ`)
354
- 3. Your backend exchanges the `code` for an access token, creates a session, and redirects the user to a logged-in page
355
-
356
- In tests you can short-circuit step 2 with `page.route()`: intercept the outbound request to the provider and respond with a `302` redirect straight to your callback route, supplying a mock `code` and `state`. Your backend still executes its normal callback handler — the only part that's mocked is the provider's authorization page.
357
-
358
- For cases where you want to skip the browser redirect entirely, a second approach calls a **test-only API endpoint** that creates the session server-side and returns the session cookie directly.
359
-
360
- ```typescript
361
- // tests/oauth-login.spec.ts — mock the callback route
362
- import { test, expect } from "@playwright/test";
363
-
364
- test("login via mocked OAuth flow", async ({ page }) => {
365
- await page.route("https://accounts.provider.com/**", async (route) => {
366
- const callbackUrl = new URL("http://localhost:4000/auth/callback");
367
- callbackUrl.searchParams.set("code", "mock-auth-code-xyz");
368
- callbackUrl.searchParams.set("state", "expected-state-value");
369
- await route.fulfill({
370
- status: 302,
371
- headers: { location: callbackUrl.toString() },
372
- });
373
- });
374
-
375
- await page.goto("/login");
376
- await page.getByRole("button", { name: "Sign in with Provider" }).click();
377
-
378
- await page.waitForURL("/home");
379
- await expect(page.getByRole("heading", { name: "Home" })).toBeVisible();
380
- });
381
- ```
382
-
383
- ```typescript
384
- // tests/oauth-login.spec.ts — API-based session injection
385
- import { test, expect } from "@playwright/test";
386
-
387
- test("bypass OAuth entirely via API session injection", async ({
388
- page,
389
- }) => {
390
- // Call a test-only endpoint that creates a session without OAuth
391
- const response = await page.request.post("/api/test/create-session", {
392
- data: {
393
- email: "oauth-user@example.com",
394
- provider: "provider",
395
- role: "member",
396
- },
397
- });
398
- expect(response.ok()).toBeTruthy();
399
-
400
- await page.context().storageState({ path: ".auth/oauth-user.json" });
401
- await page.goto("/home");
402
- await expect(page.getByRole("heading", { name: "Home" })).toBeVisible();
403
- });
404
- ```
405
-
406
- **Backend requirement**: Your backend must expose a test-only session creation endpoint (guarded by `NODE_ENV=test`) or accept a known test OAuth code.
407
-
408
- ### MFA Handling
409
-
410
- **Use when**: Your app requires two-factor authentication (TOTP, SMS, email codes).
411
- **Avoid when**: MFA is optional and you can disable it for test accounts.
412
-
413
- **Strategy 1**: Generate real TOTP codes from a shared secret.
414
-
415
- ```typescript
416
- // helpers/totp.ts
417
- import * as OTPAuth from "otpauth";
418
-
419
- export function generateTOTP(secret: string): string {
420
- const totp = new OTPAuth.TOTP({
421
- secret: OTPAuth.Secret.fromBase32(secret),
422
- digits: 6,
423
- period: 30,
424
- algorithm: "SHA1",
425
- });
426
- return totp.generate();
427
- }
428
- ```
429
-
430
- ```typescript
431
- // tests/mfa-login.spec.ts
432
- import { test, expect } from "@playwright/test";
433
- import { generateTOTP } from "../helpers/totp";
434
-
435
- test("login with TOTP two-factor auth", async ({ page }) => {
436
- await page.goto("/login");
437
- await page.getByLabel("Username").fill("mfa-user@example.com");
438
- await page.getByLabel("Password").fill("secretPass123");
439
- await page.getByRole("button", { name: "Log in" }).click();
440
-
441
- await expect(page.getByText("Enter your authentication code")).toBeVisible();
442
-
443
- const code = generateTOTP(process.env.MFA_TOTP_SECRET!);
444
- await page.getByLabel("Authentication code").fill(code);
445
- await page.getByRole("button", { name: "Verify" }).click();
446
-
447
- await page.waitForURL("/home");
448
- await expect(page.getByRole("heading", { name: "Home" })).toBeVisible();
449
- });
450
- ```
451
-
452
- **Strategy 2**: Mock MFA at the backend level. Have your backend accept a known bypass code (e.g., `000000`) when `NODE_ENV=test`.
453
-
454
- **Strategy 3**: Disable MFA for test accounts at the infrastructure level.
455
-
456
- ### Session Refresh
457
-
458
- **Use when**: Your tokens expire during long test runs.
459
- **Avoid when**: Your test suite runs quickly and tokens outlast the entire run.
460
-
461
- ```typescript
462
- // fixtures/auth-with-refresh.ts
463
- import { test as base, type BrowserContext } from "@playwright/test";
464
- import fs from "fs";
465
-
466
- type AuthFixtures = {
467
- authenticatedPage: import("@playwright/test").Page;
468
- };
469
-
470
- export const test = base.extend<AuthFixtures>({
471
- authenticatedPage: async ({ browser }, use) => {
472
- const statePath = ".auth/session.json";
473
-
474
- let context: BrowserContext;
475
- if (fs.existsSync(statePath)) {
476
- context = await browser.newContext({ storageState: statePath });
477
- const page = await context.newPage();
478
-
479
- const response = await page.request.get("/api/auth/me");
480
- if (response.ok()) {
481
- await use(page);
482
- await context.close();
483
- return;
484
- }
485
- await context.close();
486
- }
487
-
488
- context = await browser.newContext();
489
- const page = await context.newPage();
490
- await page.goto("/login");
491
- await page.getByLabel("Username").fill(process.env.TEST_USER_EMAIL!);
492
- await page.getByLabel("Password").fill(process.env.TEST_USER_PASSWORD!);
493
- await page.getByRole("button", { name: "Log in" }).click();
494
- await page.waitForURL("/home");
495
-
496
- await context.storageState({ path: statePath });
497
-
498
- await use(page);
499
- await context.close();
500
- },
501
- });
502
-
503
- export { expect } from "@playwright/test";
504
- ```
505
-
506
- ### Login Page Object
507
-
508
- **Use when**: Multiple test files need to log in and you want consistent, maintainable login logic.
509
- **Avoid when**: You use `storageState` everywhere and never navigate through the login UI in tests.
510
-
511
- ```typescript
512
- // page-objects/LoginPage.ts
513
- import { type Page, type Locator, expect } from "@playwright/test";
514
-
515
- export class LoginPage {
516
- readonly page: Page;
517
- readonly usernameInput: Locator;
518
- readonly passwordInput: Locator;
519
- readonly loginButton: Locator;
520
- readonly errorMessage: Locator;
521
- readonly forgotPasswordLink: Locator;
522
-
523
- constructor(page: Page) {
524
- this.page = page;
525
- this.usernameInput = page.getByLabel("Username");
526
- this.passwordInput = page.getByLabel("Password");
527
- this.loginButton = page.getByRole("button", { name: "Log in" });
528
- this.errorMessage = page.getByRole("alert");
529
- this.forgotPasswordLink = page.getByRole("link", {
530
- name: "Forgot password",
531
- });
532
- }
533
-
534
- async goto() {
535
- await this.page.goto("/login");
536
- await expect(this.loginButton).toBeVisible();
537
- }
538
-
539
- async login(username: string, password: string) {
540
- await this.usernameInput.fill(username);
541
- await this.passwordInput.fill(password);
542
- await this.loginButton.click();
543
- }
544
-
545
- async loginAndWaitForHome(username: string, password: string) {
546
- await this.login(username, password);
547
- await this.page.waitForURL("/home");
548
- }
549
-
550
- async expectError(message: string | RegExp) {
551
- await expect(this.errorMessage).toContainText(message);
552
- }
553
-
554
- async expectFieldError(field: "username" | "password", message: string) {
555
- const input =
556
- field === "username" ? this.usernameInput : this.passwordInput;
557
- await expect(input).toHaveAttribute("aria-invalid", "true");
558
- const errorId = await input.getAttribute("aria-describedby");
559
- if (errorId) {
560
- await expect(this.page.locator(`#${errorId}`)).toContainText(message);
561
- }
562
- }
563
- }
564
- ```
565
-
566
- ```typescript
567
- // tests/login.spec.ts
568
- import { test, expect } from "@playwright/test";
569
- import { LoginPage } from "../page-objects/LoginPage";
570
-
571
- test.use({ storageState: { cookies: [], origins: [] } });
572
-
573
- test.describe("login page", () => {
574
- let loginPage: LoginPage;
575
-
576
- test.beforeEach(async ({ page }) => {
577
- loginPage = new LoginPage(page);
578
- await loginPage.goto();
579
- });
580
-
581
- test("successful login redirects to home", async ({ page }) => {
582
- await loginPage.loginAndWaitForHome(
583
- "testuser@example.com",
584
- "secretPass123"
585
- );
586
- await expect(page.getByRole("heading", { name: "Home" })).toBeVisible();
587
- });
588
-
589
- test("wrong password shows error", async () => {
590
- await loginPage.login("testuser@example.com", "wrong-password");
591
- await loginPage.expectError("Invalid username or password");
592
- });
593
-
594
- test("empty fields show validation errors", async () => {
595
- await loginPage.loginButton.click();
596
- await loginPage.expectFieldError("username", "Username is required");
597
- });
598
-
599
- test("forgot password link navigates correctly", async ({ page }) => {
600
- await loginPage.forgotPasswordLink.click();
601
- await page.waitForURL("/forgot-password");
602
- await expect(
603
- page.getByRole("heading", { name: "Reset password" })
604
- ).toBeVisible();
605
- });
606
- });
607
- ```
608
-
609
- ### API-Based Login
610
-
611
- **Use when**: You want the fastest possible authentication without any browser interaction.
612
- **Avoid when**: You are specifically testing the login UI.
613
-
614
- API login is typically 5-10x faster than UI login.
615
-
616
- ```typescript
617
- // global-setup.ts — API-based login (fastest)
618
- import { request, type FullConfig } from "@playwright/test";
619
-
620
- async function globalSetup(config: FullConfig) {
621
- const { baseURL } = config.projects[0].use;
622
-
623
- const requestContext = await request.newContext({ baseURL });
624
-
625
- const response = await requestContext.post("/api/auth/login", {
626
- data: {
627
- email: process.env.TEST_USER_EMAIL!,
628
- password: process.env.TEST_USER_PASSWORD!,
629
- },
630
- });
631
-
632
- if (!response.ok()) {
633
- throw new Error(
634
- `API login failed: ${response.status()} ${await response.text()}`
635
- );
636
- }
637
-
638
- await requestContext.storageState({ path: ".auth/session.json" });
639
- await requestContext.dispose();
640
- }
641
-
642
- export default globalSetup;
643
- ```
644
-
645
- ```typescript
646
- // fixtures/api-auth.ts — fixture version for per-test authentication
647
- import { test as base } from "@playwright/test";
648
-
649
- export const test = base.extend({
650
- authenticatedPage: async ({ browser, playwright }, use) => {
651
- const apiContext = await playwright.request.newContext({
652
- baseURL: "http://localhost:4000",
653
- });
654
-
655
- await apiContext.post("/api/auth/login", {
656
- data: {
657
- email: "testuser@example.com",
658
- password: "secretPass123",
659
- },
660
- });
661
-
662
- const state = await apiContext.storageState();
663
- const context = await browser.newContext({ storageState: state });
664
- const page = await context.newPage();
665
-
666
- await use(page);
667
-
668
- await context.close();
669
- await apiContext.dispose();
670
- },
671
- });
672
-
673
- export { expect } from "@playwright/test";
674
- ```
675
-
676
- ### Unauthenticated Tests
677
-
678
- **Use when**: Testing the login page, signup flow, password reset, public pages, or redirect behavior for unauthenticated users.
679
- **Avoid when**: The test requires a logged-in user.
680
-
681
- When your config sets a default `storageState`, you must explicitly clear it for unauthenticated tests.
682
-
683
- ```typescript
684
- // tests/public-pages.spec.ts
685
- import { test, expect } from "@playwright/test";
686
-
687
- test.use({ storageState: { cookies: [], origins: [] } });
688
-
689
- test.describe("unauthenticated access", () => {
690
- test("homepage is accessible without login", async ({ page }) => {
691
- await page.goto("/");
692
- await expect(page.getByRole("heading", { name: "Welcome" })).toBeVisible();
693
- await expect(page.getByRole("link", { name: "Log in" })).toBeVisible();
694
- });
695
-
696
- test("protected route redirects to login", async ({ page }) => {
697
- await page.goto("/home");
698
- await page.waitForURL("**/login**");
699
- expect(page.url()).toContain("redirect=%2Fhome");
700
- });
701
-
702
- test("expired session shows re-login prompt", async ({ page, context }) => {
703
- await page.goto("/home");
704
- await context.clearCookies();
705
-
706
- await page.goto("/settings");
707
- await page.waitForURL("**/login**");
708
- await expect(page.getByText("Your session has expired")).toBeVisible();
709
- });
710
-
711
- test("signup flow creates account", async ({ page }) => {
712
- await page.goto("/signup");
713
- await page.getByLabel("Name").fill("New User");
714
- await page.getByLabel("Email").fill(`test-${Date.now()}@example.com`);
715
- await page.getByLabel("Password", { exact: true }).fill("secretPass123");
716
- await page.getByLabel("Confirm password").fill("secretPass123");
717
- await page.getByRole("button", { name: "Create account" }).click();
718
-
719
- await page.waitForURL("/onboarding");
720
- await expect(page.getByText("Welcome, New User")).toBeVisible();
721
- });
722
- });
723
- ```
724
-
725
- ## Decision Guide
726
-
727
- | Scenario | Approach | Speed | Isolation | When to Choose |
728
- | -------------------------------- | ------------------------------ | -------- | -------------- | -------------------------------------------------------------- |
729
- | Most tests need auth | Global setup + `storageState` | Fastest | Shared session | Default for nearly every project |
730
- | Tests modify user state | Per-worker fixture | Fast | Per worker | Tests update profile, change settings, or mutate data |
731
- | Multiple user roles | Per-project `storageState` | Fastest | Per role | App has admin/member/guest roles |
732
- | Testing the login page | No `storageState` | N/A | Full | Use `test.use({ storageState: { cookies: [], origins: [] } })` |
733
- | OAuth/SSO provider | Mock the callback | Fast | Per test | Never hit real OAuth providers in CI |
734
- | MFA is required | TOTP generation or bypass | Moderate | Per test | Generate real TOTP codes or use a test-mode bypass |
735
- | Token expires mid-suite | Session refresh fixture | Fast | Per check | Fixture validates the session before use |
736
- | Single test needs different user | `loginAs(role)` fixture | Moderate | Per call | Rare: prefer per-project roles |
737
- | API-first app (no login UI) | API login via `request.post()` | Fastest | Per test | No browser needed for auth |
738
-
739
- ### UI Login vs API Login vs Storage State
740
-
741
- ```text
742
- Need to test the login page itself?
743
- ├── Yes → UI login with LoginPage POM, no storageState
744
- └── No → Do you have a login API endpoint?
745
- ├── Yes → API login in global setup, save storageState (fastest)
746
- └── No → UI login in global setup, save storageState
747
- └── Tokens expire quickly?
748
- ├── Yes → Add session refresh fixture
749
- └── No → Standard storageState reuse is fine
750
- ```
751
-
752
- ## Anti-Patterns
753
-
754
- | Don't Do This | Problem | Do This Instead |
755
- | ------------------------------------------------------------------------- | ------------------------------------------- | ------------------------------------------------------------------------- |
756
- | Log in via UI before every test | Adds 2-5 seconds per test | Use `storageState` to skip login entirely |
757
- | Share a single auth state file across parallel workers that mutate state | Race conditions | Use per-worker fixtures with `{ scope: 'worker' }` |
758
- | Hardcode credentials in test files | Security risk | Use environment variables and `.env` files |
759
- | Ignore token expiration | Tests fail intermittently with 401 errors | Add a session validity check in your auth fixture |
760
- | Hit real OAuth providers in CI | Flaky: rate limits, CAPTCHA, network issues | Mock the OAuth callback or use API session injection |
761
- | Use `page.waitForTimeout(2000)` after login | Arbitrary delay | `await page.waitForURL('/home')` or `await expect(heading).toBeVisible()` |
762
- | Store `.auth/*.json` files in git | Tokens in version control | Add `.auth/` to `.gitignore` |
763
- | Create one "god" test account with all permissions | Cannot test role-based access control | Create separate accounts per role |
764
- | Use `browser.newContext()` without `storageState` for authenticated tests | Every context starts unauthenticated | Pass `storageState` when creating the context |
765
- | Test MFA by disabling it everywhere | You never test the MFA flow | Use TOTP generation for at least one test |
766
-
767
- ## Troubleshooting
768
-
769
- ### Global setup fails with "Target page, context or browser has been closed"
770
-
771
- **Cause**: The login page redirected unexpectedly, or the browser closed before `storageState()` was called.
772
-
773
- **Fix**:
774
-
775
- - Add `await page.waitForURL()` after the login action
776
- - Check that `baseURL` in your config matches the actual server URL and protocol
777
- - Add error handling to global setup:
778
-
779
- ```typescript
780
- const response = await page.waitForResponse("**/api/auth/**");
781
- if (!response.ok()) {
782
- throw new Error(
783
- `Login failed in global setup: ${response.status()} ${await response.text()}`
784
- );
785
- }
786
- ```
787
-
788
- ### Tests fail with 401 Unauthorized after running for a while
789
-
790
- **Cause**: The session token saved in `storageState` has expired.
791
-
792
- **Fix**:
793
-
794
- - Use the session refresh fixture pattern
795
- - Increase token expiry in test environment configuration
796
- - Switch to API-based login in a worker-scoped fixture
797
-
798
- ### `storageState` file is empty or contains no cookies
799
-
800
- **Cause**: `storageState()` was called before the login response set cookies.
801
-
802
- **Fix**:
803
-
804
- - Wait for the post-login page to load: `await page.waitForURL('/home')`
805
- - Verify cookies exist before saving:
806
-
807
- ```typescript
808
- const cookies = await context.cookies();
809
- if (cookies.length === 0) {
810
- throw new Error("No cookies found after login");
811
- }
812
- await context.storageState({ path: ".auth/session.json" });
813
- ```
814
-
815
- ### Different browsers get different cookies
816
-
817
- **Cause**: Some auth flows set cookies with `SameSite=Strict` or use browser-specific cookie behavior.
818
-
819
- **Fix**:
820
-
821
- - Generate separate auth state files per browser project
822
- - Check if your auth uses `SameSite=None; Secure` cookies that require HTTPS:
823
-
824
- ```typescript
825
- projects: [
826
- {
827
- name: 'chromium',
828
- use: { ...devices['Desktop Chrome'], storageState: '.auth/chromium-session.json' },
829
- },
830
- {
831
- name: 'firefox',
832
- use: { ...devices['Desktop Firefox'], storageState: '.auth/firefox-session.json' },
833
- },
834
- ],
835
- ```
836
-
837
- ### Parallel tests interfere with each other's sessions
838
-
839
- **Cause**: Multiple workers share the same test account and one worker's actions affect others.
840
-
841
- **Fix**:
842
-
843
- - Use per-worker test accounts: `worker-${test.info().parallelIndex}@example.com`
844
- - Use the per-worker authentication fixture pattern
845
- - Make tests idempotent
846
-
847
- ### OAuth mock does not work — still redirects to real provider
848
-
849
- **Cause**: `page.route()` was registered after the navigation that triggers the OAuth redirect.
850
-
851
- **Fix**:
852
-
853
- - Register route handlers before any navigation: call `page.route()` before `page.goto()`
854
- - Log the actual redirect URL to verify the pattern:
855
-
856
- ```typescript
857
- page.on("request", (req) => {
858
- if (req.url().includes("oauth") || req.url().includes("accounts.provider")) {
859
- console.log("OAuth request:", req.url());
860
- }
861
- });
862
- ```
863
-
864
- ## Related
865
-
866
- - [fixtures-hooks.md](../core/fixtures-hooks.md) — custom fixtures for auth setup and teardown
867
- - [configuration.md](../core/configuration.md) — `storageState`, projects, and global setup configuration
868
- - [global-setup.md](../core/global-setup.md) — global setup patterns and project dependencies
869
- - [network-advanced.md](network-advanced.md) — route interception patterns used in OAuth mocking
870
- - [api-testing.md](../testing-patterns/api-testing.md) — API request context used in API-based login
871
- - [flaky-tests.md](../debugging/flaky-tests.md) — diagnosing auth-related flakiness