@duckduckgo/autoconsent 14.77.0 → 14.77.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
|
@@ -0,0 +1,54 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: publicwww-search
|
|
3
|
+
description: Search PublicWWW to find websites using specific HTML/JS/CSS snippets. Use this skill to check if a cookie popup is from a widespread third-party CMP, to find additional test URLs for a CMP rule, or to discover how many sites use a particular consent banner pattern.
|
|
4
|
+
---
|
|
5
|
+
|
|
6
|
+
# PublicWWW Source Code Search
|
|
7
|
+
|
|
8
|
+
Search website source code via the [PublicWWW](https://publicwww.com) API. Requires `PUBLICWWW_KEY` env var.
|
|
9
|
+
|
|
10
|
+
**Caveat:** PublicWWW indexes server-rendered HTML source only. CMPs injected purely via client-side JavaScript (e.g. tag managers, async script loaders) may not appear in results.
|
|
11
|
+
|
|
12
|
+
## API
|
|
13
|
+
|
|
14
|
+
Download search results as CSV:
|
|
15
|
+
|
|
16
|
+
```
|
|
17
|
+
https://publicwww.com/websites/SEARCH_QUERY/?export=csvsnippetsu&key=$PUBLICWWW_KEY
|
|
18
|
+
```
|
|
19
|
+
|
|
20
|
+
CSV format: `url;rank;snippet` (one site per line, sorted by popularity rank).
|
|
21
|
+
|
|
22
|
+
Use `export=csv` instead of `csvsnippetsu` to get `domain;rank` without snippets.
|
|
23
|
+
|
|
24
|
+
## Query Syntax
|
|
25
|
+
|
|
26
|
+
- Exact phrase: `"onetrust-banner-sdk"`
|
|
27
|
+
- Combine terms: `"cookie-banner" "reject-all"`
|
|
28
|
+
- Exclude: `"cookie-banner" -wordpress`
|
|
29
|
+
- TLD filter: `"sd-cmp" site:de`
|
|
30
|
+
- File type: `"__cmp" filetype:js` (also `filetype:css`)
|
|
31
|
+
- Page depth: `depth:all "math.min.js"` (0–5, default homepage only)
|
|
32
|
+
- Escape inner quotes: `"data-testid=\"cookie-reject\""`
|
|
33
|
+
|
|
34
|
+
Full syntax: https://publicwww.com/syntax.html
|
|
35
|
+
|
|
36
|
+
## Examples
|
|
37
|
+
|
|
38
|
+
Check if a banner ID is from a shared CMP:
|
|
39
|
+
|
|
40
|
+
```bash
|
|
41
|
+
curl -s "https://publicwww.com/websites/%22sd-cmp%22/?export=csv&key=$PUBLICWWW_KEY" | head -20
|
|
42
|
+
```
|
|
43
|
+
|
|
44
|
+
Find German sites using OneTrust:
|
|
45
|
+
|
|
46
|
+
```bash
|
|
47
|
+
curl -s "https://publicwww.com/websites/%22onetrust-banner-sdk%22+site%3Ade/?export=csv&key=$PUBLICWWW_KEY" | head -10
|
|
48
|
+
```
|
|
49
|
+
|
|
50
|
+
Search JS files for a CMP API:
|
|
51
|
+
|
|
52
|
+
```bash
|
|
53
|
+
curl -s "https://publicwww.com/js/%22__cmp%22+filetype%3Ajs/?export=csv&key=$PUBLICWWW_KEY" | head -10
|
|
54
|
+
```
|
package/AGENTS.md
CHANGED
|
@@ -347,6 +347,12 @@ E2E tests hit live sites and are inherently flaky due to site changes, regional
|
|
|
347
347
|
- Playwright is configured with retries (2 retries in CI)
|
|
348
348
|
- Verify the site still has the same cookie consent popup by visiting it manually
|
|
349
349
|
|
|
350
|
+
## CMP Discovery with PublicWWW
|
|
351
|
+
|
|
352
|
+
Use the `/publicwww-search` skill to search website source code for CMP-specific identifiers. This helps determine if a cookie popup is from a shared third-party CMP (warranting a generic rule) or is site-specific. It also helps find additional test URLs for existing rules and region-specific test sites.
|
|
353
|
+
|
|
354
|
+
Requires `PUBLICWWW_KEY` environment variable.
|
|
355
|
+
|
|
350
356
|
## Verification
|
|
351
357
|
|
|
352
358
|
| Step | Command |
|
package/CHANGELOG.md
CHANGED
|
@@ -1,3 +1,16 @@
|
|
|
1
|
+
# v14.77.1 (Thu May 07 2026)
|
|
2
|
+
|
|
3
|
+
#### 🐛 Bug Fix
|
|
4
|
+
|
|
5
|
+
- Add PublicWWW source code search agent skill for CMP discovery [#1277](https://github.com/duckduckgo/autoconsent/pull/1277) ([@cursoragent](https://github.com/cursoragent) [@muodov](https://github.com/muodov))
|
|
6
|
+
|
|
7
|
+
#### Authors: 2
|
|
8
|
+
|
|
9
|
+
- Cursor Agent ([@cursoragent](https://github.com/cursoragent))
|
|
10
|
+
- Maxim Tsoy ([@muodov](https://github.com/muodov))
|
|
11
|
+
|
|
12
|
+
---
|
|
13
|
+
|
|
1
14
|
# v14.77.0 (Tue May 05 2026)
|
|
2
15
|
|
|
3
16
|
#### 🚀 Enhancement
|