@flakiness/vitest 1.8.0 → 1.9.1

package/README.md

@@ -13,6 +13,7 @@ A custom Vitest reporter that generates Flakiness Reports from your Vitest test
 - [Viewing Reports](#viewing-reports)
 - [Features](#features)
   - [Test Location Tracking](#test-location-tracking)
+  - [Attachments](#attachments)
   - [Handling Test Duplicates](#handling-test-duplicates)
   - [Environment Detection](#environment-detection)
   - [CI Integration](#ci-integration)
@@ -29,6 +30,7 @@ A custom Vitest reporter that generates Flakiness Reports from your Vitest test
 
 ## Requirements
 
+- Node.js 20.17.0 or higher (22.9.0 or higher on Node 22)
 - Vitest 4.0 or higher
 - Node.js project with a git repository (for commit information)
 - Valid Flakiness.io access token (for uploads)
@@ -77,14 +79,27 @@ npx flakiness show ./flakiness-report
 
 ## Uploading Reports
 
-Reports are automatically uploaded to Flakiness.io after test completion. Authentication can be done in two ways:
+Reports are automatically uploaded to Flakiness.io after test completion. Authentication is resolved in the following order, and the first available method wins:
 
 - **Access token**: Provide a token via the `token` option or the `FLAKINESS_ACCESS_TOKEN` environment variable.
-- **GitHub OIDC**: When running in GitHub Actions, the reporter can authenticate using GitHub's OIDC token - no access token needed. This requires two conditions:
+- **GitHub OIDC**: When running in GitHub Actions with no access token, the reporter can authenticate using GitHub's OIDC token. This requires three conditions:
   1. The `flakinessProject` option must be set to your Flakiness.io project identifier (`org/project`).
   2. The Flakiness.io project must be bound to the GitHub repository that runs the GitHub Actions workflow.
+  3. The workflow must grant the `id-token: write` permission.
+- **GitLab OIDC**: When running in GitLab CI/CD with no access token, the reporter can authenticate using a GitLab ID token. GitLab mints ID tokens when the job starts, so the job must declare one named `FLAKINESS_ID_TOKEN` whose audience is your project identifier:
 
-If upload fails, the report is still available locally in the output folder.
+  ```yaml
+  test:
+    id_tokens:
+      FLAKINESS_ID_TOKEN:
+        aud: my-org/my-project   # must match the `flakinessProject` option
+    script:
+      - npx vitest run
+  ```
+
+  The `flakinessProject` option must be set, and the Flakiness.io project must be bound to the GitLab project running the pipeline.
+
+If no method is available the upload is skipped, and if an upload fails the report is still available locally in the output folder. Either way the test run is unaffected.
 
 ## Viewing Reports
 
@@ -102,6 +117,17 @@ See [features.md](./features.md) for this reporter's status against the [Flakine
 
 When `includeTaskLocation: true` is set in your Vitest config, the reporter records the exact file, line, and column for each test. This enables precise navigation from the Flakiness.io dashboard back to your source code.
 
+### Attachments
+
+[Browser Mode](https://vitest.dev/guide/browser/) records screenshots as Vitest artifacts. The reporter writes them into the local Flakiness report and uploads them along with it. Identical content is stored only once, no matter how many tests attach it.
+
+Two kinds of screenshot are captured:
+
+- **Failure screenshots.** Vitest screenshots every failing test when [`browser.screenshotFailures`](https://vitest.dev/config/browser/screenshotfailures) is enabled — which is the default outside of the Vitest UI. It is reported as `failure-screenshot.png`, and needs no changes to your tests.
+- **Visual regressions.** Each failed `toMatchScreenshot()` comparison contributes `screenshot-1-expected.png`, `screenshot-1-actual.png` and `screenshot-1-diff.png`, numbered per comparison within the test. Vitest does not take a failure screenshot for these, since the comparison images already show the page.
+
+Attachments of custom artifacts recorded through Vitest's `recordArtifact()` are named after the artifact type (`my-plugin:artifact-1`). Attachments of test annotations (`context.annotate()`) are not collected.
+
 ### Handling Test Duplicates
 
 Vitest allows creating tests with identical names:
@@ -175,7 +201,7 @@ reporters: [
 
 ### `flakinessProject?: string`
 
-The Flakiness.io project identifier in `org/project` format. Used for GitHub OIDC authentication — when set, and the Flakiness.io project is bound to the GitHub repository running the workflow, the reporter authenticates uploads via GitHub Actions OIDC token with no access token required.
+The Flakiness.io project identifier in `org/project` format. Required for CI OIDC authentication. When set, and when the Flakiness.io project is bound to the repository running the pipeline, the reporter authenticates uploads via a GitHub Actions or GitLab CI/CD OIDC token with no access token required. See [Uploading Reports](#uploading-reports) for the per-provider requirements.
 
 ```typescript
 reporters: [
@@ -199,7 +225,7 @@ reporters: [
 
 Access token for authenticating with Flakiness.io when uploading reports. Defaults to the `FLAKINESS_ACCESS_TOKEN` environment variable.
 
-If no token is provided, reporter will attempt to authenticate using Github OIDC.
+If no token is provided, the reporter falls back to CI OIDC on GitHub Actions and GitLab CI/CD. If that is unavailable too, the report is still generated locally but won't be uploaded automatically.
 
 ```typescript
 reporters: [
@@ -253,6 +279,7 @@ The reporter respects the following environment variables:
 - **`FLAKINESS_ENDPOINT`**: Custom Flakiness.io endpoint URL (equivalent to `endpoint` option)
 - **`FLAKINESS_OUTPUT_DIR`**: Output directory for reports (equivalent to `outputFolder` option)
 - **`FLAKINESS_DISABLE_UPLOAD`**: When set, disables report uploads (equivalent to `disableUpload` option)
+- **`FLAKINESS_ID_TOKEN`**: GitLab CI/CD ID token used for OIDC authentication. Set by GitLab for jobs that declare it under `id_tokens:` (see [Uploading Reports](#uploading-reports))
 
 ## Example Configuration
 

package/lib/reporter.js

@@ -12,7 +12,11 @@ var __require = /* @__PURE__ */ ((x) => typeof require !== "undefined" ? require
   throw Error('Dynamic require of "' + x + '" is not supported');
 });
 var __commonJS = (cb, mod) => function __require2() {
-  return mod || (0, cb[__getOwnPropNames(cb)[0]])((mod = { exports: {} }).exports, mod), mod.exports;
+  try {
+    return mod || (0, cb[__getOwnPropNames(cb)[0]])((mod = { exports: {} }).exports, mod), mod.exports;
+  } catch (e) {
+    throw mod = 0, e;
+  }
 };
 var __export = (target, all) => {
   for (var name in all)
@@ -807,9 +811,9 @@ var require_index_min = __commonJS({
   }
 });
 
-// node_modules/.pnpm/which@6.0.1/node_modules/which/lib/index.js
+// node_modules/.pnpm/which@7.0.0/node_modules/which/lib/index.js
 var require_lib = __commonJS({
-  "node_modules/.pnpm/which@6.0.1/node_modules/which/lib/index.js"(exports, module) {
+  "node_modules/.pnpm/which@7.0.0/node_modules/which/lib/index.js"(exports, module) {
     var { isexe, sync: isexeSync } = require_index_min();
     var { join, delimiter, sep, posix } = __require("path");
     var isWindows = process.platform === "win32";
@@ -895,14 +899,14 @@ var require_lib = __commonJS({
   }
 });
 
-// node_modules/.pnpm/@flakiness+flakiness-report@0.34.0_zod@4.4.3/node_modules/@flakiness/flakiness-report/lib/flakinessReport.js
+// node_modules/.pnpm/@flakiness+flakiness-report@0.36.0_zod@4.4.3/node_modules/@flakiness/flakiness-report/lib/flakinessReport.js
 var FlakinessReport;
-((FlakinessReport2) => {
-  FlakinessReport2.CATEGORY_PLAYWRIGHT = "playwright";
-  FlakinessReport2.CATEGORY_PYTEST = "pytest";
-  FlakinessReport2.CATEGORY_JUNIT = "junit";
-  FlakinessReport2.STREAM_STDOUT = 1;
-  FlakinessReport2.STREAM_STDERR = 2;
+((FlakinessReport22) => {
+  FlakinessReport22.CATEGORY_PLAYWRIGHT = "playwright";
+  FlakinessReport22.CATEGORY_PYTEST = "pytest";
+  FlakinessReport22.CATEGORY_JUNIT = "junit";
+  FlakinessReport22.STREAM_STDOUT = 1;
+  FlakinessReport22.STREAM_STDERR = 2;
 })(FlakinessReport || (FlakinessReport = {}));
 
 // node_modules/.pnpm/zod@4.4.3/node_modules/zod/v4/classic/external.js
@@ -15425,7 +15429,7 @@ var classic_default = external_exports;
 // node_modules/.pnpm/zod@4.4.3/node_modules/zod/v4/index.js
 var v4_default = classic_default;
 
-// node_modules/.pnpm/@flakiness+flakiness-report@0.34.0_zod@4.4.3/node_modules/@flakiness/flakiness-report/lib/schema.js
+// node_modules/.pnpm/@flakiness+flakiness-report@0.36.0_zod@4.4.3/node_modules/@flakiness/flakiness-report/lib/schema.js
 var Schema;
 ((Schema2) => {
   Schema2.CommitId = v4_default.string().min(40).max(40);
@@ -15498,7 +15502,7 @@ var Schema;
     environmentIdx: v4_default.number().min(0).optional(),
     expectedStatus: Schema2.TestStatus.optional(),
     status: Schema2.TestStatus.optional(),
-    startTimestamp: Schema2.UnixTimestampMS,
+    startTimestamp: Schema2.UnixTimestampMS.optional(),
     duration: Schema2.DurationMS.optional(),
     timeout: Schema2.DurationMS.optional(),
     annotations: v4_default.array(Schema2.Annotation).optional(),
@@ -15586,7 +15590,7 @@ var Schema;
   });
 })(Schema || (Schema = {}));
 
-// node_modules/.pnpm/@flakiness+sdk@3.3.1_@flakiness+flakiness-report@0.34.0_zod@4.4.3_/node_modules/@flakiness/sdk/lib/index.js
+// node_modules/.pnpm/@flakiness+sdk@3.6.0_@flakiness+flakiness-report@0.36.0_zod@4.4.3_/node_modules/@flakiness/sdk/lib/index.js
 var import_debug = __toESM(require_src(), 1);
 import os from "os";
 import assert2 from "assert";
@@ -15629,7 +15633,7 @@ function stableHash(t) {
 }
 var dist_default = stableHash;
 
-// node_modules/.pnpm/@flakiness+sdk@3.3.1_@flakiness+flakiness-report@0.34.0_zod@4.4.3_/node_modules/@flakiness/sdk/lib/index.js
+// node_modules/.pnpm/@flakiness+sdk@3.6.0_@flakiness+flakiness-report@0.36.0_zod@4.4.3_/node_modules/@flakiness/sdk/lib/index.js
 import assert22 from "assert";
 import fs4 from "fs";
 import { URL as URL2 } from "url";
@@ -15637,8 +15641,10 @@ var import_debug2 = __toESM(require_src(), 1);
 var import_which = __toESM(require_lib(), 1);
 import fs7 from "node:fs";
 import path3 from "node:path";
+import path4 from "node:path";
+import { styleText as styleText2 } from "node:util";
 import fs8 from "fs";
-import path4 from "path";
+import path5 from "path";
 var __defProp2 = Object.defineProperty;
 var __export2 = (target, all) => {
   for (var name in all)
@@ -15768,31 +15774,50 @@ async function compressTextAsync(text) {
     }
   });
 }
-async function retryWithBackoff(job, backoff = []) {
-  for (const timeout of backoff) {
+async function retryWithBackoff(job, backoff) {
+  for (let i = 0; i < 100; ++i) {
     try {
       return await job();
-    } catch (e) {
+    } catch (error51) {
+      const timeout = backoff(error51, i);
+      if (timeout === void 0)
+        throw error51;
       await new Promise((x) => setTimeout(x, timeout));
     }
   }
   return await job();
 }
 var HTTP_BACKOFF = [100, 500, 1e3, 1e3, 1e3, 1e3];
+var HTTPResponseError = class extends Error {
+  constructor(message, status) {
+    super(message);
+    this.status = status;
+  }
+  status;
+};
+function isRetryableHTTPError(error51, extraRetryableStatuses) {
+  if (error51 instanceof HTTPResponseError) {
+    return error51.status === 408 || error51.status === 425 || error51.status === 429 || error51.status >= 500 && error51.status <= 599 || extraRetryableStatuses.includes(error51.status);
+  }
+  return !(error51 instanceof Error && error51.name === "AbortError");
+}
 async function fetchOk(input, init) {
   const response = await fetch(input, init);
   if (!response.ok) {
-    const url2 = response.url || (input instanceof URL ? input.href : typeof input === "string" ? input : input.url);
     const body = await response.text().catch(() => "");
-    throw new Error(response.status + " " + url2 + " " + body);
+    throw new HTTPResponseError(response.status + " " + response.url + " " + body, response.status);
   }
   return response;
 }
-async function getJSON(input, init, backoff = HTTP_BACKOFF) {
+async function getJSON(input, init, backoff = HTTP_BACKOFF, extraRetryableStatuses = []) {
+  backoff = backoff.slice();
   return await retryWithBackoff(async () => {
     const response = await fetchOk(input, init);
-    return await response.json();
-  }, backoff);
+    const text = await response.text();
+    return text.trim() ? JSON.parse(text) : void 0;
+  }, (error51, retryIdx) => {
+    return retryIdx < backoff.length && isRetryableHTTPError(error51, extraRetryableStatuses) ? backoff[retryIdx] : void 0;
+  });
 }
 async function putBuffer(input, body, headers, backoff = HTTP_BACKOFF) {
   await retryWithBackoff(async () => {
@@ -15802,7 +15827,9 @@ async function putBuffer(input, body, headers, backoff = HTTP_BACKOFF) {
       body: new Uint8Array(body)
     });
     await response.arrayBuffer();
-  }, backoff);
+  }, (error51, retryIdx) => {
+    return retryIdx < backoff.length && isRetryableHTTPError(error51, []) ? backoff[retryIdx] : void 0;
+  });
 }
 function shell(command, args, options) {
   try {
@@ -15836,6 +15863,10 @@ function sha1File(filePath) {
     });
   });
 }
+function isCI() {
+  const ci = (process.env.CI ?? "").toLowerCase();
+  return ci !== "" && ci !== "false" && ci !== "0";
+}
 var log = (0, import_debug.default)("fk:git");
 var execAsync = promisify(exec);
 var GIT_SAFE_ENV = {
@@ -15869,6 +15900,7 @@ var GitWorktree = class _GitWorktree {
     this._gitRoot = _gitRoot;
     this._posixGitRoot = toPosixAbsolutePath(this._gitRoot);
   }
+  _gitRoot;
   /**
    * Initializes a GitWorktree for any path inside a git repository and resolves the
    * HEAD commit id in a single call.
@@ -16089,6 +16121,8 @@ var GithubOIDC = class _GithubOIDC {
     this._requestUrl = _requestUrl;
     this._requestToken = _requestToken;
   }
+  _requestUrl;
+  _requestToken;
   /**
    * Creates a GithubOIDC instance from GitHub Actions environment variables.
    *
@@ -16103,6 +16137,13 @@ var GithubOIDC = class _GithubOIDC {
     const requestToken = process.env.ACTIONS_ID_TOKEN_REQUEST_TOKEN;
     return requestUrl && requestToken ? new _GithubOIDC(requestUrl, requestToken) : void 0;
   }
+  /**
+   * Human-readable name of the CI provider, suitable for log messages.
+   *
+   * To branch on the provider, use `oidc instanceof GithubOIDC` instead — this string is meant
+   * for humans and may be reworded.
+   */
+  name = "GitHub Actions";
   /**
    * Mints a Flakiness access token for the specified project via GitHub OIDC.
    *
@@ -16131,11 +16172,98 @@ var GithubOIDC = class _GithubOIDC {
     } catch (error51) {
       throw new Error(`Failed to request GitHub OIDC token: ${error51.message || String(error51)}`);
     }
-    if (!json2.value)
+    if (!json2?.value)
       throw new Error("GitHub OIDC token response did not contain a token value.");
     return json2.value;
   }
 };
+var GitlabOIDC = class _GitlabOIDC {
+  constructor(_idToken) {
+    this._idToken = _idToken;
+  }
+  _idToken;
+  /**
+   * Creates a GitlabOIDC instance from GitLab CI/CD environment variables.
+   *
+   * Reads the `FLAKINESS_ID_TOKEN` environment variable, which GitLab CI/CD sets for jobs
+   * that declare an `id_tokens: FLAKINESS_ID_TOKEN:` entry in `.gitlab-ci.yml`.
+   *
+   * @returns {GitlabOIDC | undefined} A GitlabOIDC instance if the environment variable is
+   *   present, or `undefined` if not running in GitLab CI/CD with an ID token configured.
+   */
+  static initializeFromEnv() {
+    const idToken = process.env.FLAKINESS_ID_TOKEN;
+    return idToken ? new _GitlabOIDC(idToken) : void 0;
+  }
+  /**
+   * Human-readable name of the CI provider, suitable for log messages.
+   *
+   * To branch on the provider, use `oidc instanceof GitlabOIDC` instead — this string is meant
+   * for humans and may be reworded.
+   */
+  name = "GitLab CI/CD";
+  /**
+   * Returns the Flakiness access token for the specified project — the GitLab ID token itself.
+   *
+   * This method succeeds as long as the ID token names `flakinessProject` in its `aud` claim.
+   * However, the returned token can only be used to upload reports if the Flakiness.io project
+   * is bound to the GitLab project running the pipeline. If the project is not bound,
+   * Flakiness.io will reject the token on upload.
+   *
+   * @param {string} flakinessProject - The flakiness project identifier in `"org/project"` format.
+   *
+   * @returns {Promise<string>} A Flakiness access token.
+   *
+   * @throws {Error} If the ID token is not a JWT, carries no `aud` claim, or its `aud` claim
+   *   does not include `flakinessProject`. GitLab mints the token when the job starts, so all
+   *   three can only be fixed in `.gitlab-ci.yml`.
+   */
+  async createFlakinessAccessToken(flakinessProject) {
+    const payload = jwtPayload(this._idToken);
+    if (!payload) {
+      throw new Error([
+        `GitLab ID token is not a JWT.`,
+        `Check that FLAKINESS_ID_TOKEN comes from an id_tokens entry with \`aud: ${flakinessProject}\` in .gitlab-ci.yml.`
+      ].join(" "));
+    }
+    const audience = audienceClaim(payload);
+    if (!audience.length) {
+      throw new Error([
+        `GitLab ID token has no audience, so it cannot upload to "${flakinessProject}".`,
+        `Declare the FLAKINESS_ID_TOKEN id_token with \`aud: ${flakinessProject}\` in .gitlab-ci.yml.`
+      ].join(" "));
+    }
+    if (!audience.includes(flakinessProject)) {
+      throw new Error([
+        `GitLab ID token audience is ${audience.map((aud) => JSON.stringify(aud)).join(", ")}, but the report uploads to "${flakinessProject}".`,
+        `Set the audience of the FLAKINESS_ID_TOKEN id_token in .gitlab-ci.yml to "${flakinessProject}".`
+      ].join(" "));
+    }
+    return this._idToken;
+  }
+};
+function jwtPayload(jwt2) {
+  const payload = jwt2.split(".")[1];
+  if (!payload)
+    return void 0;
+  try {
+    const json2 = JSON.parse(Buffer.from(payload, "base64url").toString("utf8"));
+    return json2 && typeof json2 === "object" && !Array.isArray(json2) ? json2 : void 0;
+  } catch {
+    return void 0;
+  }
+}
+function audienceClaim(payload) {
+  const aud = payload["aud"];
+  if (typeof aud === "string")
+    return [aud];
+  if (Array.isArray(aud))
+    return aud.filter((entry) => typeof entry === "string");
+  return [];
+}
+function initializeOIDCFromEnv() {
+  return GithubOIDC.initializeFromEnv() ?? GitlabOIDC.initializeFromEnv();
+}
 var reportUtils_exports = {};
 __export2(reportUtils_exports, {
   collectSources: () => collectSources,
@@ -16488,21 +16616,21 @@ async function createDataAttachment(contentType, data) {
 async function uploadReport(report, attachments, options) {
   let flakinessAccessToken = options?.flakinessAccessToken ?? process.env["FLAKINESS_ACCESS_TOKEN"];
   const logger = options?.logger ?? console;
-  const githubOIDC = GithubOIDC.initializeFromEnv();
-  if (!flakinessAccessToken && githubOIDC) {
+  const oidc = initializeOIDCFromEnv();
+  if (!flakinessAccessToken && oidc) {
     if (!report.flakinessProject) {
-      const reason = "`flakinessProject` is not configured to upload using Github OIDC.";
-      if (process.env.CI)
+      const reason = `\`flakinessProject\` is not configured to upload using ${oidc.name} OIDC.`;
+      if (isCI())
         logger.warn(`[flakiness.io] \u26A0 Skipping upload: ${reason}`);
       return { status: "skipped", reason };
     }
     try {
-      flakinessAccessToken = await githubOIDC.createFlakinessAccessToken(report.flakinessProject);
+      flakinessAccessToken = await oidc.createFlakinessAccessToken(report.flakinessProject);
       if (!flakinessAccessToken)
         throw new Error("token is empty");
     } catch (e) {
       const errorMessage = e.message || String(e);
-      logger.error(`[flakiness.io] \u2715 Unexpected error while fetching Github OIDC token: ${errorMessage}`);
+      logger.error(`[flakiness.io] \u2715 Unexpected error while fetching ${oidc.name} OIDC token: ${errorMessage}`);
       if (options?.throwOnFailure)
         throw e;
       return { status: "failed", error: errorMessage };
@@ -16510,7 +16638,7 @@ async function uploadReport(report, attachments, options) {
   }
   if (!flakinessAccessToken) {
     const reason = "No FLAKINESS_ACCESS_TOKEN found";
-    if (process.env.CI)
+    if (isCI())
       logger.warn(`[flakiness.io] \u26A0 Skipping upload: ${reason}`);
     return { status: "skipped", reason };
   }
@@ -16582,12 +16710,16 @@ var ReportUpload = class {
     if (response?.error || !response.result)
       return { success: false, message: response.error };
     const webUrl = new URL2(response.result.webUrl, this._options.flakinessEndpoint).toString();
-    const attachmentsPresignedUrls = await this._api("/api/upload/attachments", response.result.uploadToken, {
-      attachmentIds: this._attachments.map((a) => a.id)
-    });
-    if (attachmentsPresignedUrls?.error || !attachmentsPresignedUrls.result)
-      return { success: false, message: attachmentsPresignedUrls.error };
-    const attachments = new Map(attachmentsPresignedUrls.result.map((a) => [a.attachmentId, a.presignedUrl]));
+    const attachments = /* @__PURE__ */ new Map();
+    if (this._attachments.length) {
+      const attachmentsPresignedUrls = await this._api("/api/upload/attachments", response.result.uploadToken, {
+        attachmentIds: this._attachments.map((a) => a.id)
+      });
+      if (attachmentsPresignedUrls?.error || !attachmentsPresignedUrls.result)
+        return { success: false, message: attachmentsPresignedUrls.error };
+      for (const attachment of attachmentsPresignedUrls.result)
+        attachments.set(attachment.attachmentId, attachment.presignedUrl);
+    }
     await Promise.all([
       this._uploadReport(JSON.stringify(this._report), response.result.presignedReportUrl),
       ...this._attachments.map((attachment) => {
@@ -16597,7 +16729,9 @@ var ReportUpload = class {
         return this._uploadAttachment(attachment, uploadURL);
       })
     ]);
-    await this._api("/api/upload/finish", response.result.uploadToken);
+    const finishResponse = await this._api("/api/upload/finish", response.result.uploadToken);
+    if (finishResponse.error)
+      return { success: false, message: finishResponse.error };
     return { success: true, reportUrl: webUrl };
   }
   async _uploadReport(data, uploadUrl) {
@@ -16745,9 +16879,17 @@ function quoteShellArgument(argument) {
     return argument;
   return JSON.stringify(argument);
 }
+function showReportMessage(reportFolder) {
+  if (isCI())
+    return `Flakiness report written to ${path4.resolve(reportFolder)}`;
+  const command = showReportCommand(reportFolder);
+  return `To open last Flakiness report, run:
+
+  ${styleText2("cyan", command)}`;
+}
 async function writeReport(report, attachments, outputFolder) {
-  const reportPath = path4.join(outputFolder, "report.json");
-  const attachmentsFolder = path4.join(outputFolder, "attachments");
+  const reportPath = path5.join(outputFolder, "report.json");
+  const attachmentsFolder = path5.join(outputFolder, "attachments");
   await fs8.promises.rm(outputFolder, { recursive: true, force: true });
   await fs8.promises.mkdir(outputFolder, { recursive: true });
   await fs8.promises.writeFile(reportPath, JSON.stringify(report), "utf-8");
@@ -16755,7 +16897,7 @@ async function writeReport(report, attachments, outputFolder) {
     await fs8.promises.mkdir(attachmentsFolder);
   const movedAttachments = [];
   for (const attachment of attachments) {
-    const attachmentPath = path4.join(attachmentsFolder, attachment.id);
+    const attachmentPath = path5.join(attachmentsFolder, attachment.id);
     if (attachment.type === "file")
       await fs8.promises.cp(attachment.path, attachmentPath);
     else if (attachment.type === "buffer")
@@ -16779,7 +16921,7 @@ import * as nodeUtil from "node:util";
 // package.json
 var package_default = {
   name: "@flakiness/vitest",
-  version: "1.8.0",
+  version: "1.9.1",
   packageManager: "pnpm@11.5.0",
   description: "",
   main: "lib/reporter.js",
@@ -16799,22 +16941,32 @@ var package_default = {
   engines: {
     node: "^20.17.0 || >=22.9.0"
   },
+  devEngines: {
+    runtime: {
+      name: "node",
+      version: "^20.17.0",
+      onFail: "download"
+    }
+  },
   devDependencies: {
-    "@flakiness/flakiness-report": "^0.34.0",
-    "@flakiness/sdk": "^3.2.0",
-    "@flakiness/vitest": "1.6.0",
+    "@flakiness/flakiness-report": "^0.36.0",
+    "@flakiness/sdk": "^3.6.0",
+    "@flakiness/vitest": "1.8.0",
     "@types/node": "^25.6.2",
-    "@vitest/utils": "^4.1.5",
-    esbuild: "^0.27.7",
+    "@vitest/browser": "^4.1.10",
+    "@vitest/browser-playwright": "^4.1.10",
+    "@vitest/utils": "^4.1.10",
+    esbuild: "^0.28.1",
     kubik: "^0.24.0",
+    playwright: "^1.61.1",
     tsx: "^4.21.0",
     typescript: "^5.9.3",
-    vitest: "^4.1.5"
+    vitest: "^4.1.10"
   }
 };
 
 // src/reporter.ts
-var styleText2 = (format, text) => nodeUtil.styleText?.(format, text) ?? text;
+var styleText3 = (format, text) => nodeUtil.styleText?.(format, text) ?? text;
 var FKVitestReporter = class {
   constructor(_options) {
     this._options = _options;
@@ -16823,8 +16975,8 @@ var FKVitestReporter = class {
   _impl;
   _vitest;
   _logger = {
-    warn: (txt) => console.warn(styleText2("yellow", txt)),
-    error: (txt) => console.error(styleText2("red", txt)),
+    warn: (txt) => console.warn(styleText3("yellow", txt)),
+    error: (txt) => console.error(styleText3("red", txt)),
     log: (txt) => console.log(txt)
   };
   setLoggerForTest(logger) {
@@ -16870,6 +17022,7 @@ var ReporterImpl = class _ReporterImpl {
   _cpuUtilization = new CPUUtilization({ precision: 10 });
   _ramUtilization = new RAMUtilization({ precision: 10 });
   _startTimestamp = Date.now();
+  _attachments = /* @__PURE__ */ new Map();
   _stdio = /* @__PURE__ */ new Map();
   _environments = [];
   static create(rootPath, projects, options, logger, vitestVersion, config2) {
@@ -16907,7 +17060,7 @@ var ReporterImpl = class _ReporterImpl {
       column: frame.column
     } : void 0;
   }
-  _collectSuite(fkParent, suite) {
+  async _collectSuite(fkParent, suite) {
     const fkSuite = {
       type: "suite",
       title: suite.name,
@@ -16920,9 +17073,42 @@ var ReporterImpl = class _ReporterImpl {
     fkParent.suites ??= [];
     fkParent.suites.push(fkSuite);
     for (const s of suite.children.suites())
-      this._collectSuite(fkSuite, s);
+      await this._collectSuite(fkSuite, s);
     for (const t of suite.children.tests())
-      this._collectTest(fkSuite, t);
+      await this._collectTest(fkSuite, t);
+  }
+  async _collectAttachments(testCase) {
+    const attachments = [];
+    const add = async (attachment, name) => {
+      const fkAttachment = await createFKAttachment(attachment);
+      this._attachments.set(fkAttachment.id, fkAttachment);
+      attachments.push({
+        contentType: fkAttachment.contentType,
+        id: fkAttachment.id,
+        name: name + extension(attachment)
+      });
+    };
+    let visualRegressionIndex = 0;
+    let failureScreenshotIndex = 0;
+    for (const artifact of testCase.artifacts?.() ?? []) {
+      if (artifact.type === "internal:annotation")
+        continue;
+      if (artifact.type === "internal:toMatchScreenshot") {
+        const prefix = `screenshot-${++visualRegressionIndex}`;
+        for (const attachment of artifact.attachments)
+          await add(attachment, `${prefix}-${VISUAL_REGRESSION_NAMES[attachment.name]}`);
+      } else if (artifact.type === "internal:failureScreenshot") {
+        for (const attachment of artifact.attachments) {
+          ++failureScreenshotIndex;
+          await add(attachment, failureScreenshotIndex === 1 ? "failure-screenshot" : `failure-screenshot-${failureScreenshotIndex}`);
+        }
+      } else {
+        const custom2 = artifact;
+        for (const [index, attachment] of (custom2.attachments ?? []).entries())
+          await add(attachment, `${custom2.type}-${index + 1}`);
+      }
+    }
+    return attachments;
   }
   async _collectTest(fkParent, testCase) {
     const environmentIdx = this._environments.findIndex((env) => env.name === this._envName(testCase.project));
@@ -16961,9 +17147,12 @@ var ReporterImpl = class _ReporterImpl {
       stdio.push({
         text: entry.content,
         stream: entry.type === "stdout" ? FlakinessReport.STREAM_STDOUT : FlakinessReport.STREAM_STDERR,
-        dts: entry.time - ts
+        // Older Vitest versions can report a stale timestamp when output
+        // switches between stdout and stderr. Preserve the emitted order, but
+        // never serialize an invalid negative DurationMS.
+        dts: Math.max(0, entry.time - ts)
       });
-      ts = entry.time;
+      ts = Math.max(ts, entry.time);
     }
     this._stdio.delete(testCase.id);
     const testFile = this._worktree.gitPath(testCase.module.moduleId);
@@ -16983,6 +17172,7 @@ var ReporterImpl = class _ReporterImpl {
     }));
     if (testCase.options.fails)
       annotations.push({ type: "fail" });
+    const attachments = await this._collectAttachments(testCase);
     const expectedStatus = testCase.options.fails ? "failed" : "passed";
     const oppositeStatus = expectedStatus === "failed" ? "passed" : "failed";
     for (let i = 0; i < retryCount; ++i) {
@@ -17001,7 +17191,8 @@ var ReporterImpl = class _ReporterImpl {
         // decides to push a new annotation, then they can do it per-attempt safely.
         stdio: stdio.slice(),
         errors: errors.slice(),
-        annotations: annotations.slice()
+        annotations: annotations.slice(),
+        attachments: attachments.slice()
       });
     }
     fkTest.attempts.push({
@@ -17015,7 +17206,8 @@ var ReporterImpl = class _ReporterImpl {
       // See https://github.com/vitest-dev/vitest/issues/10303
       stdio,
       errors,
-      annotations
+      annotations,
+      attachments
     });
   }
   _warnDuplicates(duplicates) {
@@ -17109,7 +17301,7 @@ var ReporterImpl = class _ReporterImpl {
     return { duplicates, testIdToTests };
   }
   async onTestRunEnd(testModules, unhandledErrors, reason) {
-    const fileSuites = testModules.map((file2) => {
+    const fileSuites = await Promise.all(testModules.map(async (file2) => {
       const fkFileSuite = {
         type: "file",
         title: file2.relativeModuleId,
@@ -17120,11 +17312,11 @@ var ReporterImpl = class _ReporterImpl {
         }
       };
       for (const suite of file2.children.suites())
-        this._collectSuite(fkFileSuite, suite);
+        await this._collectSuite(fkFileSuite, suite);
       for (const test of file2.children.tests())
-        this._collectTest(fkFileSuite, test);
+        await this._collectTest(fkFileSuite, test);
       return fkFileSuite;
-    });
+    }));
     clearTimeout(this._telemetryTimer);
     this._cpuUtilization.sample();
     this._ramUtilization.sample();
@@ -17168,26 +17360,41 @@ var ReporterImpl = class _ReporterImpl {
       process.cwd(),
       process.env.FLAKINESS_OUTPUT_DIR ?? "flakiness-report"
     );
-    await writeReport(report, [], outputFolder);
+    const attachments = await writeReport(report, Array.from(this._attachments.values()), outputFolder);
     const disableUpload = !!this._options.disableUpload || !!process.env.FLAKINESS_DISABLE_UPLOAD;
     if (!disableUpload) {
-      await uploadReport(report, [], {
+      await uploadReport(report, attachments, {
         flakinessAccessToken: this._options.token,
         flakinessEndpoint: this._options.endpoint,
         logger: this._logger
       });
     }
-    const command = showReportCommand(outputFolder);
     this._logger.log(`
-To open last Flakiness report, run:
-
-  ${styleText2("cyan", command)}
-    `);
+${showReportMessage(outputFolder)}
+`);
   }
 };
 function dupeSuffix(dupeIndex) {
   return ` \u2013 dupe #${dupeIndex}`;
 }
+async function createFKAttachment(attachment) {
+  const contentType = attachment.contentType ?? "application/octet-stream";
+  if (attachment.path)
+    return await reportUtils_exports.createFileAttachment(contentType, attachment.path);
+  if (typeof attachment.body === "string")
+    return reportUtils_exports.createDataAttachment(contentType, Buffer.from(attachment.body, attachment.bodyEncoding === "utf-8" ? "utf8" : "base64"));
+  if (attachment.body)
+    return reportUtils_exports.createDataAttachment(contentType, Buffer.from(attachment.body));
+  throw new Error(`Failed to parse attachment: it has neither path to body. This is likely a bug; please report to https://github.com/flakiness/vitest/issues/new`);
+}
+var VISUAL_REGRESSION_NAMES = {
+  reference: "expected",
+  actual: "actual",
+  diff: "diff"
+};
+function extension(attachment) {
+  return attachment.path ? path.extname(attachment.path) : "";
+}
 export {
   FKVitestReporter as default
 };

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@flakiness/vitest",
-  "version": "1.8.0",
+  "version": "1.9.1",
   "description": "",
   "main": "lib/reporter.js",
   "keywords": [],
@@ -14,17 +14,28 @@
   "engines": {
     "node": "^20.17.0 || >=22.9.0"
   },
+  "devEngines": {
+    "runtime": {
+      "name": "node",
+      "version": "^20.17.0",
+      "onFail": "download"
+    }
+  },
   "devDependencies": {
-    "@flakiness/flakiness-report": "^0.34.0",
-    "@flakiness/sdk": "^3.2.0",
-    "@flakiness/vitest": "1.6.0",
+    "@flakiness/flakiness-report": "^0.36.0",
+    "@flakiness/sdk": "^3.6.0",
+    "@flakiness/vitest": "1.8.0",
     "@types/node": "^25.6.2",
-    "@vitest/utils": "^4.1.5",
-    "esbuild": "^0.27.7",
+    "@vitest/browser": "^4.1.10",
+    "@vitest/browser-playwright": "^4.1.10",
+    "@vitest/utils": "^4.1.10",
+    "esbuild": "^0.28.1",
     "kubik": "^0.24.0",
+    "playwright": "^1.61.1",
     "tsx": "^4.21.0",
     "typescript": "^5.9.3",
-    "vitest": "^4.1.5"
+    "vitest": "^4.1.10",
+    "node": "runtime:^20.17.0"
   },
   "scripts": {
     "build": "kubik build.mts",

package/types/src/reporter.d.ts

@@ -1,6 +1,6 @@
+import type { UserConsoleLog } from 'vitest';
 import type { SerializedError, TestModule, TestRunEndReason, Vitest } from 'vitest/node';
 import type { Reporter } from 'vitest/reporters';
-import type { UserConsoleLog } from 'vitest';
 export type FKVitestReporterOptions = {
     disableUpload?: boolean;
     flakinessProject?: string;