sitespeed.io 36.0.0-alpha.1 → 36.0.0

package/CHANGELOG.md

@@ -1,20 +1,23 @@
 # CHANGELOG - sitespeed.io  (we use [semantic versioning](https://semver.org))
 
-## 36.0.0 - UNRELEASED
+## 36.0.0 - 2025-01-21
 
-36.0.0 will be released late January 2025.
+The 36.0.0 release remove a lot of dependencies. Since we implemented sitespeed.io the first time, there are many things that are easy to do in modern NodeJS. Those things have now been implemented directly in sitespeed.io.
+
+This release contains a couple of breaking changes. Please read the breaking section before you upgrade!
 
 ### Breaking
-* Only download green2url data when you specifically ask for it [#4354](https://github.com/sitespeedio/sitespeed.io/pull/4354). To install you need to run `DOWNLOAD_URL2GREEN=true npm install sitespeed.io`. The green2url is also updated to use the latest availible data by late 2024. This saves 80 mb in default downloading.
-* Make sure you can't run with both `--cpu` and `--collectProfileRun` since that do not make any sense [#4298](https://github.com/sitespeedio/sitespeed.io/pull/4298)
-* Use correct name in Browsertime: userTimingAllowList instead of whitelist [#4346](https://github.com/sitespeedio/sitespeed.io/pull/4346).
-* Plugins need to update the plugin dependency to @sitespeed.io/plugin 1.0.0 or higher.
-* Replace intel (log) with sitespeed.io/log [#4381](https://github.com/sitespeedio/sitespeed.io/pull/4381). This remove the logToFile option in the cli. Instead of use that option, pipe the output to the file you want.
+* **Sustainability plugin**: Before when you installed sitespeed.io we automatically installed the green2URL data (mapping servername to green data). With this change you inly download green2url data when you specifically ask for it [#4354](https://github.com/sitespeedio/sitespeed.io/pull/4354). To install you need to run `DOWNLOAD_URL2GREEN=true npm install sitespeed.io`. The green2url is also updated to use the latest availible data by late 2024. This saves 80 mb in default downloading. You can also get the data directly from the green hosting API using `--sustainable.useGreenWebHostingAPI true`, that's the easiest way to make sure you use the current availble data.
+* **CPU**: Make sure you can't run with both `--cpu` and `--collectProfileRun` since that do not make any sense [#4298](https://github.com/sitespeedio/sitespeed.io/pull/4298). If you used to have that configuration, sitespeed.io will not exit with an error.
+* **Block User Timings**: Use correct name in Browsertime: `userTimingAllowList` instead of whitelist [#4346](https://github.com/sitespeedio/sitespeed.io/pull/4346). There was a missmtach bug on how to disable UserTimings, please make sure you use `userTimingAllowList`.
+* **Plugins**: If you created your own plugin for sitespeed.io you need to update the plugin dependency to @sitespeed.io/plugin 1.0.0 or higher.
+* **Log to file**: Replace intel (log) with sitespeed.io/log [#4381](https://github.com/sitespeedio/sitespeed.io/pull/4381). This remove the logToFile option in the cli. Instead of use that option, pipe the output to the file you want.
 
 ### Added
 * Update to Coach-core 8.1.1 [#4363](https://github.com/sitespeedio/sitespeed.io/pull/4363)
 * Use the offical Slack plugin instead of node-slack [#4360](https://github.com/sitespeedio/sitespeed.io/pull/4360).
-* Firefox 134 and NodeJS 22 in the Docker container [#4395](https://github.com/sitespeedio/sitespeed.io/pull/4395) and [#4396](https://github.com/sitespeedio/sitespeed.io/pull/4396).
+* Firefox 134, Chrome 132 and NodeJS 22 in the Docker container [#4395](https://github.com/sitespeedio/sitespeed.io/pull/4395), [#4396](https://github.com/sitespeedio/sitespeed.io/pull/4396) and [#4405](https://github.com/sitespeedio/sitespeed.io/pull/4405)
+* Let the Docker container output the CPU architecture for easier error reporting [#4404](https://github.com/sitespeedio/sitespeed.io/pull/4404).
 
 ### Fixed
 * Replace dependencies with local code:
@@ -44,6 +47,7 @@
 * Ugrade to google-cloud/storage-7.14.0 [#4361](https://github.com/sitespeedio/sitespeed.io/pull/4361).
 * Upgrade to AWS client 3.717.0 [#4368](https://github.com/sitespeedio/sitespeed.io/pull/4368)
 * Removed the webdriver manager in the Docker container [4390](https://github.com/sitespeedio/sitespeed.io/pull/4390). We don't use it but on MacOS Selenium still uses it to find the driver for Safari so we can only remove it in Docker.
+* Fix Wilcoxon NaN values when running the compare plugin [#4402](https://github.com/sitespeedio/sitespeed.io/pull/4402).
 
 ### Tech
 * New GitHub actions that test uploading to S3, GCS and SCP.

package/Dockerfile

@@ -1,4 +1,4 @@
-FROM sitespeedio/webbrowsers:chrome-131.0-firefox-134.0-edge-131.0-b
+FROM sitespeedio/webbrowsers:chrome-132.0-firefox-134.0-edge-132.0
 
 ARG TARGETPLATFORM=linux/amd64
 
@@ -12,7 +12,7 @@ COPY docker/webpagereplay/wpr_key.pem /webpagereplay/certs/
 COPY docker/webpagereplay/deterministic.js /webpagereplay/scripts/deterministic.js
 COPY docker/webpagereplay/LICENSE /webpagereplay/
 
-RUN sudo apt-get update && sudo apt-get install libnss3-tools python2 \
+RUN sudo apt-get update && sudo apt-get install libnss3-tools \
     net-tools \
     build-essential \
     iproute2 -y && \

package/README.md

@@ -1,10 +1,12 @@
 # sitespeed.io
 
-![Unit tests](https://github.com/sitespeedio/sitespeed.io/workflows/Unit%20tests/badge.svg?branch=main)
-![Linux browsers](https://github.com/sitespeedio/sitespeed.io/workflows/Linux%20browsers/badge.svg?branch=main)
-![Docker](https://github.com/sitespeedio/sitespeed.io/workflows/Docker/badge.svg?branch=main)
-![Windows Edge](https://github.com/sitespeedio/sitespeed.io/workflows/Windows%20Edge/badge.svg?branch=main)
-![OSX Safari](https://github.com/sitespeedio/sitespeed.io/workflows/OSX%20Safari/badge.svg?branch=main)
+[![Unit tests](https://github.com/sitespeedio/sitespeed.io/actions/workflows/unittests.yml/badge.svg)](https://github.com/sitespeedio/sitespeed.io/actions/workflows/unittests.yml)
+[![Linux browsers](https://github.com/sitespeedio/sitespeed.io/actions/workflows/linux.yml/badge.svg)](https://github.com/sitespeedio/sitespeed.io/actions/workflows/linux.yml)
+[![Docker](https://github.com/sitespeedio/sitespeed.io/actions/workflows/docker.yml/badge.svg)](https://github.com/sitespeedio/sitespeed.io/actions/workflows/docker.yml)
+[![Docker security scan](https://github.com/sitespeedio/sitespeed.io/actions/workflows/docker-scan.yml/badge.svg)](https://github.com/sitespeedio/sitespeed.io/actions/workflows/docker-scan.yml)
+[![Windows Edge](https://github.com/sitespeedio/sitespeed.io/actions/workflows/windows.yml/badge.svg)](https://github.com/sitespeedio/sitespeed.io/actions/workflows/windows.yml)
+[![OSX Safari](https://github.com/sitespeedio/sitespeed.io/actions/workflows/safari.yml/badge.svg)](https://github.com/sitespeedio/sitespeed.io/actions/workflows/safari.yml)
+[![Test upload functionality](https://github.com/sitespeedio/sitespeed.io/actions/workflows/upload.yml/badge.svg)](https://github.com/sitespeedio/sitespeed.io/actions/workflows/upload.yml)
 [![Downloads][downloads-image]][downloads-url]
 [![Docker][docker-image]][docker-url]
 [![Stars][stars-image]][stars-url]

package/docs/README.md

@@ -0,0 +1,10 @@
+Documentation for sitespeed.io
+================
+
+First make sure you have Bundler: <code>gem install bundler</code>
+
+If you run on a Mac OS make sure you have xcode-select installed: <code>xcode-select --install</code>
+
+To run it locally: <code>bundle install && bundle exec jekyll serve --baseurl ''</code>
+
+Checkout http://localhost:4000/

package/lib/plugins/compare/pug/index.pug

@@ -144,7 +144,7 @@ table
             td
               a(href=createGraphLink(groupName, metricName)) 
                 b #{groupName + '.' + metricName}
-            if values.statisticalTestU === "N/A" || values.statisticalTestU === "Datasets are identical" || values.statisticalTestU === "No variability"
+            if values.statisticalTestU === "N/A" || values.statisticalTestU === "Datasets are identical" || values.statisticalTestU === "No variability" || values.statisticalTestU === "Datasets have different lengths"
               td #{values.statisticalTestU}
             else
               td #{h.decimals(values.statisticalTestU)}

package/lib/plugins/compare/statistical.py

@@ -13,7 +13,7 @@ def perform_test(test_type, baseline, current, **kwargs):
             return None, "Datasets are identical"
         else:
             return None, "No variability"
-    if (len(set(baseline)) != len(set(current))) and test_type == 'wilcoxon':
+    if (len(baseline) != len(current)) and test_type == 'wilcoxon':
         return None, "Datasets have different lengths"
 
     if test_type == 'wilcoxon':

package/npm-shrinkwrap.json

@@ -1,24 +1,24 @@
 {
   "name": "sitespeed.io",
-  "version": "36.0.0-alpha.1",
+  "version": "36.0.0",
   "lockfileVersion": 3,
   "requires": true,
   "packages": {
     "": {
       "name": "sitespeed.io",
-      "version": "36.0.0-alpha.1",
+      "version": "36.0.0",
       "hasInstallScript": true,
       "license": "MIT",
       "dependencies": {
         "@aws-sdk/client-s3": "3.717.0",
         "@google-cloud/storage": "7.14.0",
         "@influxdata/influxdb-client": "1.33.2",
-        "@sitespeed.io/log": "0.2.3",
+        "@sitespeed.io/log": "0.2.4",
         "@sitespeed.io/plugin": "1.0.0",
         "@slack/webhook": "7.0.4",
         "@tgwf/co2": "0.16.4",
         "axe-core": "4.10.2",
-        "browsertime": "24.0.0-alpha.3",
+        "browsertime": "24.0.0",
         "coach-core": "8.1.1",
         "dayjs": "1.11.11",
         "fast-crc32c": "2.0.0",
@@ -1821,9 +1821,9 @@
       }
     },
     "node_modules/@sitespeed.io/chromedriver": {
-      "version": "131.0.6778-69",
-      "resolved": "https://registry.npmjs.org/@sitespeed.io/chromedriver/-/chromedriver-131.0.6778-69.tgz",
-      "integrity": "sha512-1XAGXWC8cvxG8yQ8iWCpY+CRkoUm36jbRWB0ia6YYXpm34KHTIXBbLYZtGEf2luQ6BJIFAOh4If5pH2q1KijEw==",
+      "version": "132.0.6834-83",
+      "resolved": "https://registry.npmjs.org/@sitespeed.io/chromedriver/-/chromedriver-132.0.6834-83.tgz",
+      "integrity": "sha512-JHyO6MHW8t6fZwkpTpSqSk1w18YRJxg0Joym00GHlnB6uH15+//PBYeKuvnjdZTROlp/6FK3Pqo4hTE2Kql45g==",
       "hasInstallScript": true,
       "dependencies": {
         "node-downloader-helper": "2.1.9",
@@ -1831,11 +1831,10 @@
       }
     },
     "node_modules/@sitespeed.io/edgedriver": {
-      "version": "131.0.2903-112",
-      "resolved": "https://registry.npmjs.org/@sitespeed.io/edgedriver/-/edgedriver-131.0.2903-112.tgz",
-      "integrity": "sha512-OgwH9qSb3Kh3NfZBGR2+ZoeHzuxx4aRAvbLVVp/jRvrm+lExIQ+qYyOZzaJhi3lvGMDaFaRnMwbLDl9wVZu15A==",
+      "version": "132.0.2957-115",
+      "resolved": "https://registry.npmjs.org/@sitespeed.io/edgedriver/-/edgedriver-132.0.2957-115.tgz",
+      "integrity": "sha512-Fdgo2fD39r1PibE1PiCL8qM6vIVuCIvS/vvpbaKTV5sEveOegCYO6mH0gIocY0OOWyQtqphXWp04USR59xctvA==",
       "hasInstallScript": true,
-      "license": "MIT",
       "dependencies": {
         "node-downloader-helper": "2.1.9",
         "node-stream-zip": "1.15.0"
@@ -1864,9 +1863,9 @@
       }
     },
     "node_modules/@sitespeed.io/log": {
-      "version": "0.2.3",
-      "resolved": "https://registry.npmjs.org/@sitespeed.io/log/-/log-0.2.3.tgz",
-      "integrity": "sha512-m8uFubqYAbwM/cu0WmXt2w/mMZIr/WL0wGASLZgDZSJm/BvspumNfbqwYvHZvmKr8+EPt9N3ArFVG9vmB49DRg==",
+      "version": "0.2.4",
+      "resolved": "https://registry.npmjs.org/@sitespeed.io/log/-/log-0.2.4.tgz",
+      "integrity": "sha512-rXQhH+RJiMxSZB3+JYhHEzfm8KruFkDOAxAuh4yDo03zeOyD4BvLOtvkpKXFP2V6egJKev0w+SSXa4RkNTuunw==",
       "license": "Apache-2.0",
       "engines": {
         "node": ">=20.0.0"
@@ -3331,16 +3330,15 @@
       }
     },
     "node_modules/browsertime": {
-      "version": "24.0.0-alpha.3",
-      "resolved": "https://registry.npmjs.org/browsertime/-/browsertime-24.0.0-alpha.3.tgz",
-      "integrity": "sha512-F3sSiSe/99iJN0SJk/IGzzlQELTsKDzc73vy7ScriXB59AvRDxRW8/aiMZQ9YAG1DYSJFYbIy3xqe+JC5XkVSg==",
-      "license": "MIT",
+      "version": "24.0.0",
+      "resolved": "https://registry.npmjs.org/browsertime/-/browsertime-24.0.0.tgz",
+      "integrity": "sha512-Bc8eV3Uu/U+TnW+nWy1BwZXyvNlPCmRwH7Y5yj98WF91iQ9tpGxHy9PUAc1s9Y4B7h0A2Qzer4UPgC3Iw508aQ==",
       "dependencies": {
         "@devicefarmer/adbkit": "3.3.8",
-        "@sitespeed.io/chromedriver": "131.0.6778-69",
-        "@sitespeed.io/edgedriver": "131.0.2903-112",
+        "@sitespeed.io/chromedriver": "132.0.6834-83",
+        "@sitespeed.io/edgedriver": "132.0.2957-115",
         "@sitespeed.io/geckodriver": "0.35.0-1",
-        "@sitespeed.io/log": "0.2.3",
+        "@sitespeed.io/log": "0.2.4",
         "@sitespeed.io/throttle": "5.0.1",
         "@sitespeed.io/tracium": "0.3.3",
         "chrome-har": "1.0.1",
@@ -3348,9 +3346,7 @@
         "execa": "9.5.2",
         "fast-stats": "0.0.7",
         "ff-test-bidi-har-export": "0.0.17",
-        "lodash.get": "4.4.2",
         "lodash.merge": "4.6.2",
-        "lodash.set": "4.3.2",
         "selenium-webdriver": "4.27.0",
         "yargs": "17.7.2"
       },

package/package.json

@@ -5,7 +5,7 @@
     "sitespeed.io": "./bin/sitespeed.js",
     "sitespeed.io-wpr": "./bin/browsertimeWebPageReplay.js"
   },
-  "version": "36.0.0-alpha.1",
+  "version": "36.0.0",
   "description": "sitespeed.io is an open-source tool for comprehensive web performance analysis, enabling you to test, monitor, and optimize your website’s speed using real browsers in various environments.",
   "keywords": [
     "performance",
@@ -84,12 +84,12 @@
     "@aws-sdk/client-s3": "3.717.0",
     "@google-cloud/storage": "7.14.0",
     "@influxdata/influxdb-client": "1.33.2",
-    "@sitespeed.io/log": "0.2.3",
+    "@sitespeed.io/log": "0.2.4",
     "@sitespeed.io/plugin": "1.0.0",
     "@tgwf/co2": "0.16.4",
     "@slack/webhook": "7.0.4",
     "axe-core": "4.10.2",
-    "browsertime": "24.0.0-alpha.3",
+    "browsertime": "24.0.0",
     "coach-core": "8.1.1",
     "dayjs": "1.11.11",
     "fast-crc32c": "2.0.0",