@camunda/e2e-test-suite 0.0.737 → 0.0.738
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/dist/resources/workspace-templates/camunda-nightlies/camunda-nightlies.guidance.md +2 -2
- package/dist/resources/workspace-templates/camunda-nightlies-saas/camunda-nightlies-saas.guidance.md +4 -2
- package/package.json +1 -1
- package/resources/workspace-templates/camunda-nightlies/camunda-nightlies.guidance.md +2 -2
- package/resources/workspace-templates/camunda-nightlies-saas/camunda-nightlies-saas.guidance.md +4 -2
|
@@ -85,7 +85,7 @@ The monorepo is checked out at `{{.WorkspacePath}}/camunda-{version}/` (e.g. `ca
|
|
|
85
85
|
- The c8Run binary is built from `{{.WorkspacePath}}/camunda-{version}/c8run/`. Read `c8run/start.sh`, `c8run/package.sh`, and the Go source under `c8run/cmd/` and `c8run/internal/` to understand startup and packaging behavior.
|
|
86
86
|
- Cross-reference `c8run/e2e_tests/tests/` — the c8Run team's own Playwright smoke tests — to understand what baseline behavior is expected from the binary.
|
|
87
87
|
- Read `qa/c8-orchestration-cluster-e2e-test-suite/` for deeper Zeebe/Operate integration test context.
|
|
88
|
-
- If the root cause is
|
|
88
|
+
- If the root cause is a confirmed product bug (not a test bug), follow the **Product-Bug Escalation** section of `AGENTS.md`: file (or reuse) a tracking issue in the owning repo and skip the failing test with the `// Skipped due to bug #<number>: <url>` annotation in one PR (recorded as `prs` + `product_bugs` in fix-meta). Do not mask it with a viewport/timeout/selector tweak, and do not leave a bare `{"prs": []}`.
|
|
89
89
|
- If there is a valid test-side workaround (e.g., retry a flaky assertion that product will eventually fix), apply it.
|
|
90
90
|
|
|
91
91
|
4. **Ship a c8Run fix.**
|
|
@@ -108,7 +108,7 @@ A change is considered done only when all of the following hold:
|
|
|
108
108
|
- **Branching**: `fix/nightly-{version}-<slug>` for SM; `fix/c8run-nightly-{version}-<slug>` for c8Run. Feature branches off `main`.
|
|
109
109
|
- **Commits and PR titles**: Conventional Commits. `fix(nightly):` for SM; `fix(c8run-nightly):` for c8Run.
|
|
110
110
|
- **Version awareness**: SM chart layout differs across versions (8.8+ uses unified `templates/orchestration/`). E2E tests follow the same split via `tests/SM-8.x/` and `tests/c8Run-8.x/`.
|
|
111
|
-
- **
|
|
111
|
+
- **Skipping is forbidden EXCEPT for a confirmed product bug**: skip only with a filed/linked ticket and the `// Skipped due to bug #<number>: <url>` annotation (see **Product-Bug Escalation** in `AGENTS.md`). For flakiness or any other reason, never use `test.skip()` / `test.fixme()`.
|
|
112
112
|
- **Goldens** (SM only): regenerate with `make` targets only; hand-edits are rejected on review.
|
|
113
113
|
- **c8Run — no cluster after nightly**: the binary ran locally on the CI runner and is gone. Never attempt `kubectl`, Teleport, or cluster credential steps for c8Run failures.
|
|
114
114
|
- **Credentials** (SM only): nightly clusters live under `*.ci.distro.ultrawombat.com`; never commit `.env` files. Generate on demand with `scripts/render-e2e-env.sh`.
|
package/dist/resources/workspace-templates/camunda-nightlies-saas/camunda-nightlies-saas.guidance.md
CHANGED
|
@@ -61,5 +61,7 @@ Component → repo (also encoded in `scripts/inject-saas-manifest.py`):
|
|
|
61
61
|
|
|
62
62
|
Edit the test code, lint, open a draft PR labelled `failing-test-fix`, and write
|
|
63
63
|
`/tmp/fix-meta.json`. See the `## SaaS Nightly Fix Agent` section of `AGENTS.md`
|
|
64
|
-
for the exact PR/commit conventions and the hard constraints (
|
|
65
|
-
|
|
64
|
+
for the exact PR/commit conventions and the hard constraints (skip allowed ONLY
|
|
65
|
+
for a confirmed product bug via the `// Skipped due to bug #<number>: <url>`
|
|
66
|
+
annotation per **Product-Bug Escalation** — forbidden otherwise; minimal diff;
|
|
67
|
+
the narrow `{"prs":[]}` exit cases).
|
package/package.json
CHANGED
|
@@ -85,7 +85,7 @@ The monorepo is checked out at `{{.WorkspacePath}}/camunda-{version}/` (e.g. `ca
|
|
|
85
85
|
- The c8Run binary is built from `{{.WorkspacePath}}/camunda-{version}/c8run/`. Read `c8run/start.sh`, `c8run/package.sh`, and the Go source under `c8run/cmd/` and `c8run/internal/` to understand startup and packaging behavior.
|
|
86
86
|
- Cross-reference `c8run/e2e_tests/tests/` — the c8Run team's own Playwright smoke tests — to understand what baseline behavior is expected from the binary.
|
|
87
87
|
- Read `qa/c8-orchestration-cluster-e2e-test-suite/` for deeper Zeebe/Operate integration test context.
|
|
88
|
-
- If the root cause is
|
|
88
|
+
- If the root cause is a confirmed product bug (not a test bug), follow the **Product-Bug Escalation** section of `AGENTS.md`: file (or reuse) a tracking issue in the owning repo and skip the failing test with the `// Skipped due to bug #<number>: <url>` annotation in one PR (recorded as `prs` + `product_bugs` in fix-meta). Do not mask it with a viewport/timeout/selector tweak, and do not leave a bare `{"prs": []}`.
|
|
89
89
|
- If there is a valid test-side workaround (e.g., retry a flaky assertion that product will eventually fix), apply it.
|
|
90
90
|
|
|
91
91
|
4. **Ship a c8Run fix.**
|
|
@@ -108,7 +108,7 @@ A change is considered done only when all of the following hold:
|
|
|
108
108
|
- **Branching**: `fix/nightly-{version}-<slug>` for SM; `fix/c8run-nightly-{version}-<slug>` for c8Run. Feature branches off `main`.
|
|
109
109
|
- **Commits and PR titles**: Conventional Commits. `fix(nightly):` for SM; `fix(c8run-nightly):` for c8Run.
|
|
110
110
|
- **Version awareness**: SM chart layout differs across versions (8.8+ uses unified `templates/orchestration/`). E2E tests follow the same split via `tests/SM-8.x/` and `tests/c8Run-8.x/`.
|
|
111
|
-
- **
|
|
111
|
+
- **Skipping is forbidden EXCEPT for a confirmed product bug**: skip only with a filed/linked ticket and the `// Skipped due to bug #<number>: <url>` annotation (see **Product-Bug Escalation** in `AGENTS.md`). For flakiness or any other reason, never use `test.skip()` / `test.fixme()`.
|
|
112
112
|
- **Goldens** (SM only): regenerate with `make` targets only; hand-edits are rejected on review.
|
|
113
113
|
- **c8Run — no cluster after nightly**: the binary ran locally on the CI runner and is gone. Never attempt `kubectl`, Teleport, or cluster credential steps for c8Run failures.
|
|
114
114
|
- **Credentials** (SM only): nightly clusters live under `*.ci.distro.ultrawombat.com`; never commit `.env` files. Generate on demand with `scripts/render-e2e-env.sh`.
|
package/resources/workspace-templates/camunda-nightlies-saas/camunda-nightlies-saas.guidance.md
CHANGED
|
@@ -61,5 +61,7 @@ Component → repo (also encoded in `scripts/inject-saas-manifest.py`):
|
|
|
61
61
|
|
|
62
62
|
Edit the test code, lint, open a draft PR labelled `failing-test-fix`, and write
|
|
63
63
|
`/tmp/fix-meta.json`. See the `## SaaS Nightly Fix Agent` section of `AGENTS.md`
|
|
64
|
-
for the exact PR/commit conventions and the hard constraints (
|
|
65
|
-
|
|
64
|
+
for the exact PR/commit conventions and the hard constraints (skip allowed ONLY
|
|
65
|
+
for a confirmed product bug via the `// Skipped due to bug #<number>: <url>`
|
|
66
|
+
annotation per **Product-Bug Escalation** — forbidden otherwise; minimal diff;
|
|
67
|
+
the narrow `{"prs":[]}` exit cases).
|