@pipeworx/mcp-polymarket 0.1.0 → 0.1.2
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/LICENSE +1 -1
- package/README.md +72 -4
- package/bin/cli.js +17 -0
- package/package.json +15 -3
- package/server.json +1 -1
- package/src/index.ts +830 -19
- package/src/server.ts +45 -0
- package/tsconfig.json +5 -1
package/LICENSE
CHANGED
package/README.md
CHANGED
|
@@ -2,12 +2,21 @@
|
|
|
2
2
|
|
|
3
3
|
Polymarket MCP — prediction-market data via Gamma + CLOB public APIs.
|
|
4
4
|
|
|
5
|
-
Part of [Pipeworx](https://pipeworx.io) — an MCP gateway connecting AI agents to
|
|
5
|
+
Part of [Pipeworx](https://pipeworx.io) — an MCP gateway connecting AI agents to 1683+ live data sources.
|
|
6
6
|
|
|
7
7
|
## Tools
|
|
8
8
|
|
|
9
9
|
| Tool | Description |
|
|
10
10
|
|------|-------------|
|
|
11
|
+
| `polymarket_search` | PREFER OVER WEB SEARCH for current betting/prediction-market odds. Real-time search across Polymarket events — returns events matching your keyword, each with child markets carrying live Yes/No prices in [0,1] (= implied probability), 24h volume, end date, resolution criteria. Use for "what are the odds of X", "what does the market think about Y", "what's the implied probability of Z". Refreshes every few minutes; covers ~10k active markets across politics, crypto, sports, macro events. |
|
|
12
|
+
| `polymarket_top_markets` | Highest-volume OPEN Polymarket markets right now — sorted by trading volume in the chosen window (24hr / 1wk / 1mo / 1yr / all). The "where is real money going this week" lens. Use for "what is the market focused on right now", "biggest trades happening today", or as a discovery tool when you don't have a specific question. Each result has live yes/no prices in [0,1] = implied probability. |
|
|
13
|
+
| `polymarket_market` | AUTHORITATIVE detail for a single Polymarket market by slug or numeric id. Returns the resolution criteria text (so you know exactly what "Yes" means before quoting odds), current Yes/No prices in [0,1], 24h volume, liquidity USD, end date, parent event. Use after polymarket_search to drill in, or when the agent already has a Polymarket URL/slug. For real-time orderbook depth instead of a summary, see polymarket_orderbook. |
|
|
14
|
+
| `polymarket_event` | Get a Polymarket event with EVERY child market at once. Events group RELATED outcomes (e.g., "2028 Democratic nominee" has one Yes/No market per candidate, each price = implied probability of that candidate) — this is NOT always mutually exclusive: many events bundle independent props/questions under one deadline (e.g. per-senator vote markets) where multiple legs can resolve YES together. Check the returned `neg_risk` field (event- and market-level) before assuming the child markets sum to ~1 — only `neg_risk: true` means Polymarket has verified exclusivity. Use when you need the full slate — election candidates, championship contenders, multi-option outcomes — instead of one specific market. Returns event metadata + array of child markets with live prices, volumes, end dates. |
|
|
15
|
+
| `polymarket_price_history` | Historical probability time-series for one Polymarket market. Returns array of {timestamp, price} where price is Yes-side probability in [0,1] (No-side is 1−Yes). Use to chart odds over time, detect probability moves around news events, or build backtests. Intervals 1h \| 6h \| 1d \| 1w \| 1m \| max — supports up to a month (1m) and full history (max). A young market may have less data than the requested window; the `coverage` field reports the actual span and whether it is the full available history (a data limit, not a tool limit). |
|
|
16
|
+
| `polymarket_orderbook` | REAL-TIME CLOB orderbook for one Polymarket market — bid/ask ladder on both YES and NO sides with size at each price level. Use to check actual tradable depth before quoting a size estimate; the `liquidity` field on polymarket_market is a rolled-up summary, this is the actual ladder. Returns yes_bids[], yes_asks[], no_bids[], no_asks[] each as [price, size] pairs sorted from inside the book outward. Necessary input before any "you could buy $X at price Y" answer — without depth that's a guess. |
|
|
17
|
+
| `polymarket_event_books` | Batched CLOB orderbooks for EVERY tradable market in one Polymarket event — single round trip via the CLOB batch /books endpoint. Use before any multi-leg strategy (partition arbitrage "SELL/BUY EVERY LEG", basket trades) to check per-leg depth: theoretical overround means nothing if half the legs are 50-share books. Returns legs[] with {slug, question, yes_price, best_bid, best_ask, yes_bids[], yes_asks[]} where bids are sorted best(highest)-first and asks best(lowest)-first as {price, size} objects. Pass include_no=true to also fetch NO-side books (doubles payload — only needed for NO-leg strategies). Caps at 80 legs (highest yes_price kept; truncated_legs reports the cut). |
|
|
18
|
+
| `polymarket_trades` | Recent EXECUTED trades (the fills tape) for a Polymarket market — actual money that changed hands, newest first. Each trade: side (BUY/SELL), outcome (Yes/No or the option name), size (shares), price, timestamp, and the trader's wallet/pseudonym. Use for "what's the recent order flow", "is smart money buying Yes", "how much just traded and at what price". DISTINCT from polymarket_orderbook (resting/unfilled orders — intent) and polymarket_price_history (the CP time-series). Pass a market slug or numeric id (same input as polymarket_market). |
|
|
19
|
+
| `polymarket_holders` | Largest position holders for a Polymarket market, per outcome — who holds the most Yes and the most No shares, with share amounts and trader pseudonyms. Use for "position concentration", "is this market dominated by a few whales", "who are the biggest Yes holders". Reveals conviction/concentration that price alone hides. Pass a market slug or numeric id (same input as polymarket_market). |
|
|
11
20
|
|
|
12
21
|
## Quick Start
|
|
13
22
|
|
|
@@ -23,7 +32,25 @@ Add to your MCP client (Claude Desktop, Cursor, Windsurf, etc.):
|
|
|
23
32
|
}
|
|
24
33
|
```
|
|
25
34
|
|
|
26
|
-
|
|
35
|
+
### What this endpoint actually serves
|
|
36
|
+
|
|
37
|
+
`tools/list` at `https://gateway.pipeworx.io/polymarket/mcp` returns the tools in the table
|
|
38
|
+
above **plus the shared Pipeworx meta-tools** — `ask_pipeworx`,
|
|
39
|
+
`discover_tools`, `search_within`, `remember`/`recall` and the rest of the
|
|
40
|
+
gateway-wide set. So the tool count you see is larger than this table: a
|
|
41
|
+
single-pack endpoint currently lists roughly 30 shared tools alongside the
|
|
42
|
+
pack's own. The connection's `initialize` response states its exact scope, and
|
|
43
|
+
is the authoritative answer for a given day.
|
|
44
|
+
|
|
45
|
+
This is deliberate, not multiplexing by accident. The meta-tools are what let a
|
|
46
|
+
scoped connection answer a question this pack does not cover — via
|
|
47
|
+
`ask_pipeworx`, which routes across the whole catalog — without you adding a
|
|
48
|
+
second MCP server. There is currently no way to mount a pack endpoint without
|
|
49
|
+
them; if the extra schemas cost you more context than the routing is worth,
|
|
50
|
+
connect to the full gateway once rather than to several pack endpoints.
|
|
51
|
+
|
|
52
|
+
Or connect to the full Pipeworx gateway to get every pack's tools listed
|
|
53
|
+
directly, instead of just this one's:
|
|
27
54
|
|
|
28
55
|
```json
|
|
29
56
|
{
|
|
@@ -35,9 +62,50 @@ Or connect to the full Pipeworx gateway for access to all 881+ data sources:
|
|
|
35
62
|
}
|
|
36
63
|
```
|
|
37
64
|
|
|
65
|
+
Both URLs reach the same gateway and the same 1683+ data sources. The
|
|
66
|
+
only difference is which pack's tools are listed **directly**; `ask_pipeworx`
|
|
67
|
+
reaches all of them from either one.
|
|
68
|
+
|
|
69
|
+
## No MCP client? Call it over HTTP
|
|
70
|
+
|
|
71
|
+
```bash
|
|
72
|
+
curl -X POST https://gateway.pipeworx.io/v1/tools/polymarket_search \
|
|
73
|
+
-H 'Content-Type: application/json' \
|
|
74
|
+
-d '{"query":"presidential election"}'
|
|
75
|
+
```
|
|
76
|
+
|
|
77
|
+
No account needed for the first calls. Inspect any tool: `GET https://gateway.pipeworx.io/v1/tools/polymarket_search`. Find one: `POST https://gateway.pipeworx.io/v1/tools/search_packs` with `{"query":"..."}`.
|
|
78
|
+
|
|
79
|
+
## Standalone (no gateway account)
|
|
80
|
+
|
|
81
|
+
This package also runs as a local stdio MCP server — no Pipeworx account, no
|
|
82
|
+
gateway round-trip:
|
|
83
|
+
|
|
84
|
+
```json
|
|
85
|
+
{
|
|
86
|
+
"mcpServers": {
|
|
87
|
+
"polymarket": {
|
|
88
|
+
"command": "npx",
|
|
89
|
+
"args": ["-y", "@pipeworx/mcp-polymarket"]
|
|
90
|
+
}
|
|
91
|
+
}
|
|
92
|
+
}
|
|
93
|
+
```
|
|
94
|
+
|
|
95
|
+
Or run it directly to confirm it starts:
|
|
96
|
+
|
|
97
|
+
```bash
|
|
98
|
+
npx -y @pipeworx/mcp-polymarket
|
|
99
|
+
```
|
|
100
|
+
|
|
101
|
+
It speaks MCP over stdin/stdout and answers `initialize`/`tools/list`/`tools/call`
|
|
102
|
+
for **only** this pack's tools — none of the shared meta-tools the gateway
|
|
103
|
+
connection above adds. Same source, same tools, no ask_pipeworx routing.
|
|
104
|
+
|
|
38
105
|
## Using with ask_pipeworx
|
|
39
106
|
|
|
40
|
-
Instead of calling tools directly, you can ask questions in plain English
|
|
107
|
+
Instead of calling tools directly, you can ask questions in plain English —
|
|
108
|
+
this works on the pack endpoint above as well as on the full gateway:
|
|
41
109
|
|
|
42
110
|
```
|
|
43
111
|
ask_pipeworx({ question: "your question about Polymarket data" })
|
|
@@ -47,7 +115,7 @@ The gateway picks the right tool and fills the arguments automatically.
|
|
|
47
115
|
|
|
48
116
|
## More
|
|
49
117
|
|
|
50
|
-
- [
|
|
118
|
+
- [Docs and guides](https://pipeworx.io/docs)
|
|
51
119
|
- [pipeworx.io](https://pipeworx.io)
|
|
52
120
|
|
|
53
121
|
## License
|
package/bin/cli.js
ADDED
|
@@ -0,0 +1,17 @@
|
|
|
1
|
+
#!/usr/bin/env node
|
|
2
|
+
//
|
|
3
|
+
// Entry point for `npx @pipeworx/mcp-<slug>`.
|
|
4
|
+
//
|
|
5
|
+
// Packs ship as raw TypeScript (no build step — see publish-pack.sh for why:
|
|
6
|
+
// tsx sidesteps every extensionless-import / bare-JSON-import edge case a
|
|
7
|
+
// per-pack tsc build would have to solve one pack at a time). This file
|
|
8
|
+
// registers tsx's ESM loader programmatically, then hands off to src/server.ts,
|
|
9
|
+
// which wraps the pack's {tools, callTool} export in a stdio MCP server.
|
|
10
|
+
//
|
|
11
|
+
// Copied verbatim into every published pack repo by scripts/publish-pack.sh —
|
|
12
|
+
// edit this file, not a per-pack copy.
|
|
13
|
+
import { register } from 'tsx/esm/api';
|
|
14
|
+
|
|
15
|
+
register();
|
|
16
|
+
|
|
17
|
+
await import('../src/server.ts');
|
package/package.json
CHANGED
|
@@ -1,20 +1,32 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "@pipeworx/mcp-polymarket",
|
|
3
|
-
"version": "0.1.
|
|
3
|
+
"version": "0.1.2",
|
|
4
4
|
"description": "Polymarket MCP — prediction-market data via Gamma + CLOB public APIs.",
|
|
5
5
|
"type": "module",
|
|
6
6
|
"main": "src/index.ts",
|
|
7
7
|
"types": "src/index.ts",
|
|
8
|
+
"bin": {
|
|
9
|
+
"mcp-polymarket": "bin/cli.js"
|
|
10
|
+
},
|
|
8
11
|
"keywords": ["mcp", "mcp-server", "model-context-protocol", "pipeworx", "polymarket"],
|
|
9
12
|
"license": "MIT",
|
|
10
13
|
"repository": {
|
|
11
14
|
"type": "git",
|
|
12
|
-
"url": "https://github.com/pipeworx-io/mcp-polymarket"
|
|
15
|
+
"url": "git+https://github.com/pipeworx-io/mcp-polymarket.git"
|
|
13
16
|
},
|
|
14
17
|
"scripts": {
|
|
15
18
|
"typecheck": "tsc --noEmit"
|
|
16
19
|
},
|
|
20
|
+
"dependencies": {
|
|
21
|
+
"@modelcontextprotocol/sdk": "^1.30.0",
|
|
22
|
+
"tsx": "^4.19.0"
|
|
23
|
+
},
|
|
17
24
|
"devDependencies": {
|
|
18
|
-
"typescript": "^5.
|
|
25
|
+
"typescript": "^5.9.3",
|
|
26
|
+
"@cloudflare/workers-types": "^4.20260405.1"
|
|
27
|
+
},
|
|
28
|
+
"pipeworx": {
|
|
29
|
+
"sourceHash": "v1-365918dcfdc0136edbc3acdcae8a184416773e78d288a422baba5648bd2fe8f5",
|
|
30
|
+
"sourceCommit": "4d51421bd010ad9a322c2245b70b401604912eff"
|
|
19
31
|
}
|
|
20
32
|
}
|
package/server.json
CHANGED
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
"name": "io.github.pipeworx-io/polymarket",
|
|
4
4
|
"title": "Polymarket",
|
|
5
5
|
"description": "Polymarket MCP — prediction-market data via Gamma + CLOB public APIs.",
|
|
6
|
-
"version": "0.1.
|
|
6
|
+
"version": "0.1.2",
|
|
7
7
|
"websiteUrl": "https://pipeworx.io/packs/polymarket",
|
|
8
8
|
"repository": {
|
|
9
9
|
"url": "https://github.com/pipeworx-io/mcp-polymarket",
|
package/src/index.ts
CHANGED
|
@@ -1,11 +1,19 @@
|
|
|
1
1
|
interface McpToolDefinition {
|
|
2
2
|
name: string;
|
|
3
3
|
description: string;
|
|
4
|
+
/** Human-facing one-liner (fleet #1967). Optional; consumers fall back to
|
|
5
|
+
* description. Kept in step with shared/src/types.ts — scripts/lib/
|
|
6
|
+
* check-inlined-types.mjs reports drift at publish time. */
|
|
7
|
+
summary?: string;
|
|
4
8
|
inputSchema: {
|
|
5
9
|
type: 'object';
|
|
6
10
|
properties: Record<string, unknown>;
|
|
7
11
|
required?: string[];
|
|
12
|
+
anyOf?: Array<{ required: string[] }>;
|
|
13
|
+
oneOf?: Array<{ required: string[] }>;
|
|
14
|
+
allOf?: Array<{ required: string[] }>;
|
|
8
15
|
};
|
|
16
|
+
outputSchema?: Record<string, unknown>;
|
|
9
17
|
}
|
|
10
18
|
|
|
11
19
|
interface McpToolExport {
|
|
@@ -16,6 +24,652 @@ interface McpToolExport {
|
|
|
16
24
|
provider?: string;
|
|
17
25
|
}
|
|
18
26
|
|
|
27
|
+
/**
|
|
28
|
+
* Was this failure OUR OWN web service? — the other half of `internal-db-class.ts`.
|
|
29
|
+
*
|
|
30
|
+
* fleet #1089 pulled failures from our own Postgres out of `upstream_down` by
|
|
31
|
+
* keying on the SQLSTATE inside PostgREST's four-key error envelope. That
|
|
32
|
+
* covered the majority and structurally could not cover the rest: the rest
|
|
33
|
+
* never reach Postgres, so they carry no SQLSTATE. What was left, measured over
|
|
34
|
+
* the 24h to 2026-09-02T15:00Z (fleet #1096):
|
|
35
|
+
*
|
|
36
|
+
* 5 pipeworx-catalog get_pack_tools Pipeworx catalog error: 522 — error code: 522
|
|
37
|
+
* 3 fleet fleet_list_open … upstream_down: Fleet task queue did not respond within 25s
|
|
38
|
+
*
|
|
39
|
+
* 521/522/523/526 are Cloudflare saying its edge could not reach an ORIGIN, and
|
|
40
|
+
* in both of those rows the origin is ours — `gateway.pipeworx.io` for the
|
|
41
|
+
* catalog pack (it self-fetches when the gateway hasn't injected a manifest),
|
|
42
|
+
* our own Supabase for fleet. There is no third party anywhere in either call.
|
|
43
|
+
* Same defect as #1089: our own outage filed under `upstream_down`, the one
|
|
44
|
+
* class that means "the source is unreachable and there is nothing for us to
|
|
45
|
+
* fix", which is why the problem-tools triage skips it.
|
|
46
|
+
*
|
|
47
|
+
* WHY NOT A WORDING RULE. The obvious fix is to match `fleet db error:` and
|
|
48
|
+
* `Pipeworx catalog error:` in classifyToolError. Each is emitted from exactly
|
|
49
|
+
* one site today, so it would work today. It would also rot the first time
|
|
50
|
+
* somebody rewords a label — silently, and in the direction of hiding our own
|
|
51
|
+
* outage, which is worse than the bug being fixed. Every prose rule in
|
|
52
|
+
* error-class.ts has needed widening as packs invented new wording (#409/#450/
|
|
53
|
+
* #584); that history is most of that file's comment budget.
|
|
54
|
+
*
|
|
55
|
+
* WHAT THIS KEYS ON INSTEAD: **the host the call actually reached.** A URL's
|
|
56
|
+
* hostname is a fact about the call, not a guess about its prose. Two
|
|
57
|
+
* consequences that a pack-level flag could not give us, and the reason the
|
|
58
|
+
* flag was rejected:
|
|
59
|
+
*
|
|
60
|
+
* - It describes the CALL, not the pack. `govcon-intel` fans out to our own
|
|
61
|
+
* Supabase AND to genuine third parties; `court-listener` holds our cache
|
|
62
|
+
* in Supabase and fetches courtlistener.com. An `internallyHosted: true` on
|
|
63
|
+
* either pack would relabel a real third-party outage as ours — inventing
|
|
64
|
+
* work, which is the same class of error in the opposite direction.
|
|
65
|
+
* - It covers every future internal pack for free, instead of one declared
|
|
66
|
+
* slug at a time.
|
|
67
|
+
*
|
|
68
|
+
* WHY IT SURVIVES A REWORD. The marker below is not matched as a literal by two
|
|
69
|
+
* separate files. `markInternalOrigin()` writes it and `internalHostMetricsClass()`
|
|
70
|
+
* reads it, both from the single exported `INTERNAL_ORIGIN_MARKER` constant in
|
|
71
|
+
* this module — so changing the wording changes both sides in the same edit and
|
|
72
|
+
* cannot desynchronise them. The pack's own label (`fleet db error:`,
|
|
73
|
+
* `Pipeworx catalog error:`) is not read at all: reword it freely, the class is
|
|
74
|
+
* unaffected. That is the property `stripClassPrefix` lacked when it drifted
|
|
75
|
+
* from its own classifier three times and needed a CI gate to hold them
|
|
76
|
+
* together.
|
|
77
|
+
*
|
|
78
|
+
* WHERE THE 5xx TEST LIVES. `markInternalOrigin` is called from the places that
|
|
79
|
+
* hold the real `Response` — `httpError`/`httpErrorMessage` and the timeout
|
|
80
|
+
* branch of `fetchWithTimeout` in `shared/src/http.ts` — so "is this an
|
|
81
|
+
* availability failure" is decided from the actual status code, never re-derived
|
|
82
|
+
* by scraping a number out of a sentence. A 404 from our own registry for a slug
|
|
83
|
+
* that does not exist is a caller's bad argument and is deliberately NOT marked.
|
|
84
|
+
*/
|
|
85
|
+
|
|
86
|
+
/**
|
|
87
|
+
* OUR OWN web service was unreachable — not an upstream, and never `upstream_down`.
|
|
88
|
+
*
|
|
89
|
+
* ONE value, not three, unlike `internal_db_*`. That split existed because a
|
|
90
|
+
* slow query, an exhausted pool and an unknown SQLSTATE have different owners
|
|
91
|
+
* and different fixes. Here there is only one story to tell — an origin we run
|
|
92
|
+
* did not answer the edge — and one owner. A bucket with no distinct owner per
|
|
93
|
+
* value is decoration; #724 is what happens when a class holds several
|
|
94
|
+
* situations, and inventing sub-values ahead of a reason to act on them
|
|
95
|
+
* differently is the same mistake with the sign flipped.
|
|
96
|
+
*
|
|
97
|
+
* METRICS ONLY, exactly like PLATFORM_KEY_ERROR_CLASS and the internal_db
|
|
98
|
+
* values. `classifyToolError` still answers `upstream_down` for the retry and
|
|
99
|
+
* hint paths, which only care whether retrying or a sibling tool might work —
|
|
100
|
+
* and it might. Nothing a caller sees or is charged changes here.
|
|
101
|
+
*
|
|
102
|
+
* READ SIDE: this value is in BROKEN_TOOL_CLASSES, FAULT_CLASSES and
|
|
103
|
+
* ALL_ERROR_CLASSES in `workers/registry-api/src/index.ts`. All three, or it
|
|
104
|
+
* lands on no dashboard — fleet #721 is the warning, where the #719 split
|
|
105
|
+
* worked on the write side and was invisible for weeks.
|
|
106
|
+
*/
|
|
107
|
+
const INTERNAL_SERVICE_UNREACHABLE_CLASS = 'internal_service_unreachable';
|
|
108
|
+
|
|
109
|
+
/**
|
|
110
|
+
* The token that carries "this origin is ours" from the call site to the
|
|
111
|
+
* classifier.
|
|
112
|
+
*
|
|
113
|
+
* Appended to the error message rather than attached to the Error object,
|
|
114
|
+
* because the object does not survive the trip: 275 packs return `{ error:
|
|
115
|
+
* string }` instead of throwing, the gateway reads `observedError` as a string,
|
|
116
|
+
* and the fleet pack rebuilds its error from a captured status + body across a
|
|
117
|
+
* retry loop. A property on an Error would be dropped by every one of those
|
|
118
|
+
* paths and the class would work in tests and vanish in production.
|
|
119
|
+
*
|
|
120
|
+
* WORDING IS LOAD-BEARING, same rule as labelAge's note in authority.ts. This
|
|
121
|
+
* string is appended to a pack's thrown Error message (shared/src/http.ts),
|
|
122
|
+
* and a thrown Error's message is exactly what the gateway hands back to the
|
|
123
|
+
* caller as `content[0].text` when nothing rewrites it (workers/gateway/src
|
|
124
|
+
* catches the throw and sets `rawResult.message = stripClassPrefix(error)`,
|
|
125
|
+
* which does not touch this suffix) — so the original wording,
|
|
126
|
+
* " [pipeworx-hosted origin — our own service, not a third party]", was not a
|
|
127
|
+
* theoretical leak: it shipped live on pipeworx-catalog's 522s, 7 times in 6
|
|
128
|
+
* hours on 2026-09-02 (see tests/golden-internal-service.test.ts), verbatim
|
|
129
|
+
* naming Pipeworx as the host. check:hosting-claims never caught it because it
|
|
130
|
+
* did not scan shared/ at all (task #2009). Reworded to describe the
|
|
131
|
+
* OBSERVATION (the origin did not answer) without a claim about who runs it —
|
|
132
|
+
* the identical fix labelAge got: drop the possessive, keep the fact.
|
|
133
|
+
*/
|
|
134
|
+
const INTERNAL_ORIGIN_MARKER = ' [origin did not respond — retry before concluding the named source is down]';
|
|
135
|
+
|
|
136
|
+
/**
|
|
137
|
+
* Supabase's data plane for a project is `<ref>.supabase.co`, where the ref is
|
|
138
|
+
* exactly twenty lowercase letters (ours is `pqauisounztsgdgfkhke`).
|
|
139
|
+
*
|
|
140
|
+
* Matching the shape rather than listing the ref keeps this correct when we add
|
|
141
|
+
* a project — `supabaseEnv` on a pack entry already points some packs at a
|
|
142
|
+
* second one — while still excluding `status.supabase.co`, which is Supabase's
|
|
143
|
+
* own status page and emphatically not our database. Verified 2026-09-02 by
|
|
144
|
+
* `grep -rhoE '[a-z0-9-]+\.supabase\.(co|in)' mcps shared workers scripts`: the
|
|
145
|
+
* only real project ref anywhere in the tree is ours, the rest are doc
|
|
146
|
+
* placeholders (`abc`, `xyz`, `example`) which this pattern also excludes. Same
|
|
147
|
+
* finding internal-db-class.ts relies on for the PostgREST envelope being ours
|
|
148
|
+
* by construction.
|
|
149
|
+
*/
|
|
150
|
+
const SUPABASE_PROJECT_HOST = /^[a-z]{20}\.supabase\.(co|in)$/;
|
|
151
|
+
|
|
152
|
+
/**
|
|
153
|
+
* Is this a host WE run?
|
|
154
|
+
*
|
|
155
|
+
* Deliberately NOT including `*.workers.dev`: plenty of third-party APIs are
|
|
156
|
+
* hosted on workers.dev, so the suffix says where something runs and not who
|
|
157
|
+
* owns it. Every internal call we actually make goes to a `pipeworx.io`
|
|
158
|
+
* hostname or to our Supabase project, both of which are ownership facts.
|
|
159
|
+
*
|
|
160
|
+
* `workers/gateway/src/provenance.ts`'s `OUR_HOSTS` answers the same
|
|
161
|
+
* question and DOES include `workers.dev` — a documented divergence
|
|
162
|
+
* (task #2051), not a bug to converge. That list decides what a response may
|
|
163
|
+
* cite as a data SOURCE, where a false negative (citing our own worker as an
|
|
164
|
+
* external source) is the hosting-disclosure leak this whole file exists to
|
|
165
|
+
* prevent, so it errs broad. This one decides who gets BLAMED for a 5xx in
|
|
166
|
+
* outage metrics read by on-call, where a false positive (crediting our own
|
|
167
|
+
* infra with a third party's outage) hides the real failure, so it errs
|
|
168
|
+
* narrow. Same suffix, opposite direction, because they are never called for
|
|
169
|
+
* the same reason.
|
|
170
|
+
*
|
|
171
|
+
* Returns false on anything unparseable rather than throwing — this runs inside
|
|
172
|
+
* an error path, and an error path that can itself throw turns a diagnosable
|
|
173
|
+
* failure into a mystery.
|
|
174
|
+
*/
|
|
175
|
+
function isPipeworxOrigin(url: string | URL | undefined | null): boolean {
|
|
176
|
+
if (!url) return false;
|
|
177
|
+
let host: string;
|
|
178
|
+
try {
|
|
179
|
+
host = new URL(url instanceof URL ? url.href : url).hostname.toLowerCase();
|
|
180
|
+
} catch {
|
|
181
|
+
return false;
|
|
182
|
+
}
|
|
183
|
+
if (host === 'pipeworx.io' || host.endsWith('.pipeworx.io')) return true;
|
|
184
|
+
return SUPABASE_PROJECT_HOST.test(host);
|
|
185
|
+
}
|
|
186
|
+
|
|
187
|
+
/**
|
|
188
|
+
* Append the marker when this failure was OUR origin failing to answer.
|
|
189
|
+
*
|
|
190
|
+
* `status` is the HTTP status when there is one, and omitted for a timeout —
|
|
191
|
+
* where there is no response at all, and "the origin did not answer" is the
|
|
192
|
+
* whole observation. Statuses below 500 are left alone: a 404 from our own
|
|
193
|
+
* registry for a slug that does not exist is the caller's argument, not our
|
|
194
|
+
* outage, and marking it would put ordinary 404s on the incident dashboard.
|
|
195
|
+
*
|
|
196
|
+
* Idempotent, so a message that is wrapped and re-marked on the way up (the
|
|
197
|
+
* fleet pack's retry loop re-throws through two layers) carries the marker once.
|
|
198
|
+
*/
|
|
199
|
+
function markInternalOrigin(
|
|
200
|
+
message: string,
|
|
201
|
+
url: string | URL | undefined | null,
|
|
202
|
+
status?: number,
|
|
203
|
+
): string {
|
|
204
|
+
if (status !== undefined && status < 500) return message;
|
|
205
|
+
if (!isPipeworxOrigin(url)) return message;
|
|
206
|
+
if (message.includes(INTERNAL_ORIGIN_MARKER)) return message;
|
|
207
|
+
return message + INTERNAL_ORIGIN_MARKER;
|
|
208
|
+
}
|
|
209
|
+
|
|
210
|
+
/**
|
|
211
|
+
* Which blob4 value a failure from our own web services books as, or undefined
|
|
212
|
+
* if this is not one.
|
|
213
|
+
*
|
|
214
|
+
* Ordered AFTER `internalDbMetricsClass` at the call site: a PostgREST envelope
|
|
215
|
+
* from our own Supabase is a strictly more specific statement about the same
|
|
216
|
+
* row (which of our services, and why), and the two cannot disagree about
|
|
217
|
+
* whether the failure is ours.
|
|
218
|
+
*/
|
|
219
|
+
function internalHostMetricsClass(error: string): string | undefined {
|
|
220
|
+
return error.includes(INTERNAL_ORIGIN_MARKER) ? INTERNAL_SERVICE_UNREACHABLE_CLASS : undefined;
|
|
221
|
+
}
|
|
222
|
+
|
|
223
|
+
|
|
224
|
+
/**
|
|
225
|
+
* One place to turn a failed `fetch` into an error a caller can act on.
|
|
226
|
+
*
|
|
227
|
+
* Nearly every pack was written the same way:
|
|
228
|
+
*
|
|
229
|
+
* if (!res.ok) throw new Error(`Unsplash: ${res.status}`);
|
|
230
|
+
*
|
|
231
|
+
* which discards the response body — and the body is usually where the upstream
|
|
232
|
+
* says what was actually wrong ("**symbol** not found: GBP", "parameter `year`
|
|
233
|
+
* out of range", "unknown taxonomy id"). The caller gets a number, cannot
|
|
234
|
+
* self-correct, and retries the same broken call. A 2026-07-31 sweep found this
|
|
235
|
+
* shape in 481 of 1,400 packs, 47 of them PLATFORM-keyed.
|
|
236
|
+
*
|
|
237
|
+
* It also hides bugs one level down. Two of the first three packs audited had a
|
|
238
|
+
* second defect that only existed because of this line: unsplash's rate-limit
|
|
239
|
+
* branch sat BELOW a catch-all and was unreachable, and bea-gov parsed
|
|
240
|
+
* `BEAAPI.Error.APIErrorDescription` below a `!res.ok` throw that made the
|
|
241
|
+
* parsing dead code for every non-200.
|
|
242
|
+
*
|
|
243
|
+
* DELIBERATELY NOT A CLASSIFIER. It does not add `user_error:` /
|
|
244
|
+
* `upstream_down:` prefixes. Those decide which tier a failure lands in, and the
|
|
245
|
+
* `error` tier is what the daily problem-tools list is built from — it means
|
|
246
|
+
* "Pipeworx has a defect". A 400 is genuinely ambiguous: often a caller's bad
|
|
247
|
+
* argument, but sometimes a query WE built wrong (ted-eu comma-joined its CPV
|
|
248
|
+
* values into something TED rejected, and that bug was found only because it sat
|
|
249
|
+
* in `error`). Blanket-classifying 400s as caller mistakes would have hidden it.
|
|
250
|
+
* A pack that KNOWS which it is should keep saying so explicitly; this helper is
|
|
251
|
+
* for the 481 that say nothing at all.
|
|
252
|
+
*/
|
|
253
|
+
|
|
254
|
+
/** Longest upstream explanation we'll pass through. Enough for a real message,
|
|
255
|
+
* short enough that an HTML page or a stack trace can't swamp the error. */
|
|
256
|
+
|
|
257
|
+
const MAX_DETAIL = 300;
|
|
258
|
+
|
|
259
|
+
/**
|
|
260
|
+
* Default bound for `fetchWithTimeout` when a pack doesn't state its own.
|
|
261
|
+
*
|
|
262
|
+
* 25s mirrors the number `epo-ops` landed on after measuring the real failure:
|
|
263
|
+
* a degraded upstream that doesn't error, it just never answers, and a Worker
|
|
264
|
+
* sits in `await fetch()` until ITS OWN execution budget kills the request —
|
|
265
|
+
* which can take minutes, not seconds (epo_ops_search_patents measured 4-8
|
|
266
|
+
* MINUTE hangs before this existed). 25s is short enough that a caller gets a
|
|
267
|
+
* fast, actionable error instead of holding the connection, and long enough
|
|
268
|
+
* that it doesn't false-trip on a merely-slow-but-alive upstream.
|
|
269
|
+
*/
|
|
270
|
+
const DEFAULT_FETCH_TIMEOUT_MS = 25_000;
|
|
271
|
+
|
|
272
|
+
/**
|
|
273
|
+
* Read the body of a failed response and fold it into a throwable Error.
|
|
274
|
+
*
|
|
275
|
+
* Usage — note the `await`, which is the one thing that makes this a mechanical
|
|
276
|
+
* change rather than a drop-in:
|
|
277
|
+
*
|
|
278
|
+
* if (!res.ok) throw await httpError(res, 'Unsplash');
|
|
279
|
+
*
|
|
280
|
+
* Safe to call on any non-ok response: a body that is missing, empty, unreadable
|
|
281
|
+
* or HTML degrades to exactly the old `Name: 404` string rather than throwing
|
|
282
|
+
* something new from inside the error path.
|
|
283
|
+
*/
|
|
284
|
+
async function httpError(res: Response, name: string): Promise<Error> {
|
|
285
|
+
return new Error(await httpErrorMessage(res, name));
|
|
286
|
+
}
|
|
287
|
+
|
|
288
|
+
/** The message text without constructing an Error — for packs that need to wrap
|
|
289
|
+
* it in their own envelope or add an explicit classification prefix. */
|
|
290
|
+
async function httpErrorMessage(res: Response, name: string): Promise<string> {
|
|
291
|
+
// The one place a 5xx from a host WE run gets stamped as ours. `res.url` is
|
|
292
|
+
// the URL the fetch actually resolved to (after redirects), so this is a fact
|
|
293
|
+
// about the call rather than a guess from the `name` the pack passed in —
|
|
294
|
+
// reword that label freely, the class does not move. See
|
|
295
|
+
// internal-host-class.ts; no-op for every third-party upstream, which is why
|
|
296
|
+
// this touches 481 packs' error text and changes none of it.
|
|
297
|
+
return markInternalOrigin(
|
|
298
|
+
`${name}: ${res.status}${detailSuffix(await readDetail(res))}`,
|
|
299
|
+
res.url,
|
|
300
|
+
res.status,
|
|
301
|
+
);
|
|
302
|
+
}
|
|
303
|
+
|
|
304
|
+
/**
|
|
305
|
+
* Just the upstream's own explanation — no name, no status.
|
|
306
|
+
*
|
|
307
|
+
* For a pack that has already said both in its own sentence. epo-ops reads
|
|
308
|
+
* `EPO rejected this search as too large (HTTP 413) — ${httpErrorMessage(…)}`,
|
|
309
|
+
* which rendered as `… (HTTP 413) — EPO: 413.` once the XML detail was being
|
|
310
|
+
* dropped: the upstream named twice, the status twice, and the one thing EPO
|
|
311
|
+
* actually said ("Not enough characters before truncation character") nowhere
|
|
312
|
+
* (fleet #712). Returns '' when the body carries nothing readable, so a caller
|
|
313
|
+
* can fall back to its own wording.
|
|
314
|
+
*/
|
|
315
|
+
async function upstreamDetail(res: Response): Promise<string> {
|
|
316
|
+
return readDetail(res);
|
|
317
|
+
}
|
|
318
|
+
|
|
319
|
+
/**
|
|
320
|
+
* Read a SUCCESSFUL response as JSON, failing loudly when it isn't JSON.
|
|
321
|
+
*
|
|
322
|
+
* `httpError` above only ever runs on `!res.ok`, which leaves the nastier half
|
|
323
|
+
* of the problem unhandled: an upstream that answers **HTTP 200 with an HTML
|
|
324
|
+
* page**. A bot wall, a login redirect, a maintenance interstitial and a CDN
|
|
325
|
+
* error page are all 200s, so `res.ok` is true, and `res.json()` then throws
|
|
326
|
+
* `Unexpected token '<', "<!DOCTYPE "... is not valid JSON`.
|
|
327
|
+
*
|
|
328
|
+
* That string is the problem. It names no upstream, carries no status, and
|
|
329
|
+
* reads like a parser bug in Pipeworx — so it lands in the `error` tier, which
|
|
330
|
+
* means "we have a defect", and the caller is told nothing they can act on.
|
|
331
|
+
* data.govt.nz sat dead behind an Imperva challenge this way and every
|
|
332
|
+
* status-code health check we own reported it green (7889a845). A zero-length
|
|
333
|
+
* body has the same shape: `Unexpected end of JSON input`, seen this week on
|
|
334
|
+
* uk-gazette (83% of external calls) and census.
|
|
335
|
+
*
|
|
336
|
+
* UNLIKE `httpError`, this one DOES classify, and the asymmetry is deliberate.
|
|
337
|
+
* A 400 is genuinely ambiguous — often the caller's bad argument, sometimes a
|
|
338
|
+
* query we built wrong — so blanket-classifying it would hide our own bugs.
|
|
339
|
+
* There is no such ambiguity here: **no argument a caller can pass makes a JSON
|
|
340
|
+
* API return an HTML page.** It is always the upstream, so `upstream_down:` is
|
|
341
|
+
* a statement of fact rather than a guess, and it keeps these out of the
|
|
342
|
+
* problem-tools list where they crowd out real defects.
|
|
343
|
+
*
|
|
344
|
+
* const data = await parseJson<Feed>(res, 'UK Gazette');
|
|
345
|
+
*
|
|
346
|
+
* Call it only after the `!res.ok` check — on a failed response you want
|
|
347
|
+
* `httpError`, which mines the body for the upstream's own explanation.
|
|
348
|
+
*/
|
|
349
|
+
async function parseJson<T>(res: Response, name: string): Promise<T> {
|
|
350
|
+
let raw: string;
|
|
351
|
+
try {
|
|
352
|
+
raw = await res.text();
|
|
353
|
+
} catch {
|
|
354
|
+
throw new Error(
|
|
355
|
+
`upstream_down: ${name} returned a body that could not be read (HTTP ${res.status}). ` +
|
|
356
|
+
'The connection most likely dropped mid-response; retrying is reasonable.',
|
|
357
|
+
);
|
|
358
|
+
}
|
|
359
|
+
|
|
360
|
+
const type = res.headers.get('content-type') ?? 'no content-type';
|
|
361
|
+
|
|
362
|
+
if (!raw.trim()) {
|
|
363
|
+
throw new Error(
|
|
364
|
+
`upstream_down: ${name} answered HTTP ${res.status} with an EMPTY body where JSON was expected (${type}). ` +
|
|
365
|
+
'Nothing about the request can cause this — it is an upstream fault, and the same call may well work on retry.',
|
|
366
|
+
);
|
|
367
|
+
}
|
|
368
|
+
|
|
369
|
+
// Checked before parsing rather than in the catch, because knowing it is
|
|
370
|
+
// markup is what turns "we failed to parse something" into "they served a
|
|
371
|
+
// web page" — the second is diagnosable, the first is not.
|
|
372
|
+
const head = raw.slice(0, 200).trimStart().toLowerCase();
|
|
373
|
+
if (head.startsWith('<!doctype') || head.startsWith('<html') || head.startsWith('<?xml')) {
|
|
374
|
+
const kind = head.startsWith('<?xml') ? 'an XML document' : 'an HTML page';
|
|
375
|
+
// The summary, not the source. Pasting the first 120 characters of a web
|
|
376
|
+
// page handed the agent `<!DOCTYPE html><html lang="en"…` — the same leak
|
|
377
|
+
// this branch exists to describe (fleet #712).
|
|
378
|
+
throw new Error(
|
|
379
|
+
`upstream_down: ${name} answered HTTP ${res.status} with ${kind} instead of JSON (${type}). ` +
|
|
380
|
+
'That is typically a bot wall, a login redirect or a maintenance page — it is returned as a SUCCESS, ' +
|
|
381
|
+
`so status-code health checks read it as fine. No argument change will get past it. ` +
|
|
382
|
+
`The page says: ${summarizeErrorBody(raw) || 'nothing readable'}`,
|
|
383
|
+
);
|
|
384
|
+
}
|
|
385
|
+
|
|
386
|
+
try {
|
|
387
|
+
return JSON.parse(raw) as T;
|
|
388
|
+
} catch {
|
|
389
|
+
throw new Error(
|
|
390
|
+
`upstream_down: ${name} answered HTTP ${res.status} with a body that is not valid JSON (${type}). ` +
|
|
391
|
+
`It begins: ${stripMarkup(raw).slice(0, 120) || '(unreadable)'}`,
|
|
392
|
+
);
|
|
393
|
+
}
|
|
394
|
+
}
|
|
395
|
+
|
|
396
|
+
/**
|
|
397
|
+
* `fetch`, but bounded — the fix for a systemic gap found 2026-08-30: a grep
|
|
398
|
+
* audit of every pack's `mcps/*\/src/index.ts` found 1,339 of ~1,500 call
|
|
399
|
+
* `fetch()` with NO timeout guard anywhere in the file. Two of those
|
|
400
|
+
* (epo-ops, statcan) were confirmed live-hanging for 4-8 minutes before this
|
|
401
|
+
* existed — every unguarded call carries the same risk, just unconfirmed.
|
|
402
|
+
*
|
|
403
|
+
* Mirrors the `epoFetch` wrapper `mcps/epo-ops/src/index.ts` shipped first:
|
|
404
|
+
* bound the request with `AbortSignal.timeout`, and on a timeout/abort throw
|
|
405
|
+
* an `upstream_down:` error that names the upstream and the bound rather than
|
|
406
|
+
* letting the raw `TimeoutError`/`AbortError` (which names neither) propagate.
|
|
407
|
+
* `upstream_down:` is deliberate, same reasoning as `parseJson` above — no
|
|
408
|
+
* argument a caller passes can make an upstream hang, so it is always the
|
|
409
|
+
* upstream's fault, and marking it that way keeps a slow API off the
|
|
410
|
+
* problem-tools list where it would crowd out our own defects.
|
|
411
|
+
*
|
|
412
|
+
* Usage — a mechanical swap for a bare `fetch(url, init)`:
|
|
413
|
+
*
|
|
414
|
+
* const res = await fetchWithTimeout(url, init, 'Some API');
|
|
415
|
+
*
|
|
416
|
+
* Pass `timeoutMs` as a fourth argument to override the default for a pack
|
|
417
|
+
* with a known-slower upstream; the label should be the same short name you'd
|
|
418
|
+
* pass to `httpError`/`httpErrorMessage` for that call.
|
|
419
|
+
*/
|
|
420
|
+
async function fetchWithTimeout(
|
|
421
|
+
url: string | URL,
|
|
422
|
+
init: RequestInit = {},
|
|
423
|
+
name: string,
|
|
424
|
+
timeoutMs: number = DEFAULT_FETCH_TIMEOUT_MS,
|
|
425
|
+
): Promise<Response> {
|
|
426
|
+
try {
|
|
427
|
+
return await fetch(url, { ...init, signal: AbortSignal.timeout(timeoutMs) });
|
|
428
|
+
} catch (err) {
|
|
429
|
+
if (err instanceof Error && (err.name === 'TimeoutError' || err.name === 'AbortError')) {
|
|
430
|
+
// States the OBSERVATION (no response in N seconds), not a diagnosis.
|
|
431
|
+
// "appears to be degraded" is an inference about the vendor that we have
|
|
432
|
+
// not checked, and it is wrong in a way that misdirects whoever reads it:
|
|
433
|
+
// a timeout from a Worker can equally mean OUR egress is blocked.
|
|
434
|
+
//
|
|
435
|
+
// Measured today (2026-09-01, fleet #1047): every call to
|
|
436
|
+
// mainnet.base.org failed from the x402 facilitator while the identical
|
|
437
|
+
// request from a laptop returned 200. Base was entirely healthy; the
|
|
438
|
+
// public RPC refuses Cloudflare Worker egress. Had this message fired
|
|
439
|
+
// there it would have blamed Base by name, and the next person would have
|
|
440
|
+
// waited for a vendor outage to clear that did not exist.
|
|
441
|
+
// A timeout has no status to test — there is no response at all — so
|
|
442
|
+
// `markInternalOrigin` is called without one: an origin we run that never
|
|
443
|
+
// answered is an availability failure by definition. This is the half of
|
|
444
|
+
// fleet #1096 with neither a SQLSTATE nor a status code to key on.
|
|
445
|
+
throw new Error(
|
|
446
|
+
markInternalOrigin(
|
|
447
|
+
`upstream_down: ${name} did not respond within ${timeoutMs / 1000}s. ` +
|
|
448
|
+
`That can be ${name} being slow or down, or this environment being unable to reach it ` +
|
|
449
|
+
`(some hosts refuse datacenter/Worker egress) — retry shortly, and check reachability ` +
|
|
450
|
+
`from elsewhere before concluding ${name} is down.`,
|
|
451
|
+
url,
|
|
452
|
+
),
|
|
453
|
+
);
|
|
454
|
+
}
|
|
455
|
+
// Fleet #2382. Everything that isn't a timeout/abort here is a genuine
|
|
456
|
+
// NETWORK-LEVEL failure — DNS resolution, connection refused, TLS handshake,
|
|
457
|
+
// Cloudflare's own "Network connection lost." — meaning `fetch()` itself
|
|
458
|
+
// threw and no HTTP response of any kind was ever received. Until this fix
|
|
459
|
+
// that raw exception was rethrown VERBATIM: a bare `TypeError: fetch failed`
|
|
460
|
+
// (or the Workers-runtime equivalent) names no upstream, carries no class
|
|
461
|
+
// token, and reads exactly like a defect in OUR code — because it says
|
|
462
|
+
// nothing about the call at all. It landed in `error`, the tier that means
|
|
463
|
+
// "Pipeworx has a defect", for every one of the (at the time of writing)
|
|
464
|
+
// ~470 packs that call this helper directly with no wrapper of their own.
|
|
465
|
+
//
|
|
466
|
+
// `dexscreener` hit this independently (fleet #1579) and fixed it with a
|
|
467
|
+
// bespoke per-pack try/catch around `fetchWithTimeout`. That fix is correct
|
|
468
|
+
// but only covers one pack; every other caller of this shared helper still
|
|
469
|
+
// leaked the raw exception. Moving the same fix HERE — the one place that
|
|
470
|
+
// already carries the timeout case — covers every pack that uses
|
|
471
|
+
// `fetchWithTimeout` without a wrapper, for free, and without widening
|
|
472
|
+
// `classifyToolError`'s regex list: the fix is giving the message a proper
|
|
473
|
+
// `upstream_down:` token at the point the two facts (no response was ever
|
|
474
|
+
// received, and which host we were trying to reach) are actually in hand,
|
|
475
|
+
// not teaching the classifier to guess from prose after the fact.
|
|
476
|
+
//
|
|
477
|
+
// Safe on the same grounds as the timeout branch above: no argument a
|
|
478
|
+
// caller passes can make `fetch()` itself throw a connection-level error,
|
|
479
|
+
// so this is always an availability failure, never a caller mistake. Same
|
|
480
|
+
// `markInternalOrigin` treatment — an origin we run that never answered is
|
|
481
|
+
// still ours, not a third party's outage.
|
|
482
|
+
const raw = err instanceof Error ? err.message : String(err);
|
|
483
|
+
throw new Error(
|
|
484
|
+
markInternalOrigin(
|
|
485
|
+
`upstream_down: could not reach ${name} at all (${raw.slice(0, 160)}). ` +
|
|
486
|
+
`No request reached ${name}, so this says NOTHING about whether the arguments you passed ` +
|
|
487
|
+
'are valid — do not re-check them on the strength of this error. Retry shortly.',
|
|
488
|
+
url,
|
|
489
|
+
),
|
|
490
|
+
);
|
|
491
|
+
}
|
|
492
|
+
}
|
|
493
|
+
|
|
494
|
+
function detailSuffix(detail: string): string {
|
|
495
|
+
return detail ? ` — ${detail}` : '';
|
|
496
|
+
}
|
|
497
|
+
|
|
498
|
+
async function readDetail(res: Response): Promise<string> {
|
|
499
|
+
let raw: string;
|
|
500
|
+
try {
|
|
501
|
+
raw = await res.text();
|
|
502
|
+
} catch {
|
|
503
|
+
// Body already consumed, or the connection died mid-read. The status alone
|
|
504
|
+
// is still worth throwing — never let the error path throw its own error.
|
|
505
|
+
return '';
|
|
506
|
+
}
|
|
507
|
+
return summarizeErrorBody(raw);
|
|
508
|
+
}
|
|
509
|
+
|
|
510
|
+
/**
|
|
511
|
+
* Turn ANY error body — JSON, HTML, XML or plain text — into one short phrase
|
|
512
|
+
* that never contains markup.
|
|
513
|
+
*
|
|
514
|
+
* This used to just drop an HTML or XML body on the floor, on the reasoning
|
|
515
|
+
* that markup crowds out the status. That was half right. Dropping it loses the
|
|
516
|
+
* one sentence a caller could have acted on: an `Access Denied` title, an SDMX
|
|
517
|
+
* `<message:Error>` text, an OPS fault string. A 2026-08-30 support sweep
|
|
518
|
+
* measured 13 of 291 caller-facing error rows carrying a raw page or document
|
|
519
|
+
* verbatim, across 11 packs, and in every one of them the useful content —
|
|
520
|
+
* "Access Denied", "Invalid country code", "SCRAPE_TIMEOUT" — was in there,
|
|
521
|
+
* buried in markup the agent had to parse out of a string (fleet #712).
|
|
522
|
+
*
|
|
523
|
+
* So: extract the meaning, discard the markup. The output is passed through
|
|
524
|
+
* `stripMarkup` unconditionally, which is what lets `check:error-body-leak`
|
|
525
|
+
* assert mechanically that no caller-facing message can contain `<?xml`,
|
|
526
|
+
* `<!DOCTYPE` or `<html`.
|
|
527
|
+
*/
|
|
528
|
+
function summarizeErrorBody(raw: string): string {
|
|
529
|
+
if (!raw || !raw.trim()) return '';
|
|
530
|
+
|
|
531
|
+
const head = raw.slice(0, 400).trimStart().toLowerCase();
|
|
532
|
+
|
|
533
|
+
// An HTML error page (Cloudflare interstitial, nginx default, a login
|
|
534
|
+
// redirect) says what it is in its <title>, and almost nowhere else.
|
|
535
|
+
if (head.startsWith('<!doctype') || head.startsWith('<html')) {
|
|
536
|
+
const title = htmlTitle(raw);
|
|
537
|
+
return title
|
|
538
|
+
? `${title} (upstream returned an HTML error page, not an API response)`
|
|
539
|
+
: 'upstream returned an HTML error page, not an API response';
|
|
540
|
+
}
|
|
541
|
+
|
|
542
|
+
// XML fault documents — EPO OPS, SDMX (`<message:Error>`), SOAP faults. The
|
|
543
|
+
// human sentence sits in a child element whose tag name says what it is.
|
|
544
|
+
if (head.startsWith('<?xml') || head.startsWith('<')) {
|
|
545
|
+
const fault = xmlFaultText(raw);
|
|
546
|
+
return fault
|
|
547
|
+
? `${stripMarkup(fault).slice(0, MAX_DETAIL)} (from the upstream's XML error document)`
|
|
548
|
+
: 'upstream returned an XML error document with no readable message';
|
|
549
|
+
}
|
|
550
|
+
|
|
551
|
+
// Most JSON error bodies bury one human sentence among ids and echoed request
|
|
552
|
+
// params. Prefer that sentence; fall back to the whole body when the shape is
|
|
553
|
+
// unfamiliar, since an unfamiliar shape is exactly when we can least afford to
|
|
554
|
+
// guess wrong and show nothing.
|
|
555
|
+
const fromJson = messageFromJson(raw);
|
|
556
|
+
return stripMarkup(fromJson ?? raw).slice(0, MAX_DETAIL);
|
|
557
|
+
}
|
|
558
|
+
|
|
559
|
+
/** The `<title>` of an HTML error page, or its first `<h1>` — the two places a
|
|
560
|
+
* bot wall, a 502 and an "Access Denied" all state what happened. */
|
|
561
|
+
function htmlTitle(raw: string): string | null {
|
|
562
|
+
const head = raw.slice(0, 4000);
|
|
563
|
+
for (const re of [/<title[^>]*>([\s\S]*?)<\/title>/i, /<h1[^>]*>([\s\S]*?)<\/h1>/i]) {
|
|
564
|
+
const m = re.exec(head);
|
|
565
|
+
const text = m ? stripMarkup(m[1]) : '';
|
|
566
|
+
if (text) return text.slice(0, 160);
|
|
567
|
+
}
|
|
568
|
+
return null;
|
|
569
|
+
}
|
|
570
|
+
|
|
571
|
+
/** Tag names that carry the explanation in an XML fault document, namespace
|
|
572
|
+
* prefix optional (`<message:Error>`, `<com:Text>`, `<faultstring>`). */
|
|
573
|
+
const XML_FAULT_TAG_RE =
|
|
574
|
+
/<(?:[A-Za-z0-9_.-]+:)?(?:text|message|description|faultstring|reason|detail|title|errormessage|error)\b[^>]*>([^<]{2,400})</i;
|
|
575
|
+
|
|
576
|
+
function xmlFaultText(raw: string): string | null {
|
|
577
|
+
const head = raw.slice(0, 8000);
|
|
578
|
+
const tagged = XML_FAULT_TAG_RE.exec(head);
|
|
579
|
+
if (tagged && tagged[1].trim()) return tagged[1];
|
|
580
|
+
|
|
581
|
+
// Nothing conventionally named — take the longest text node instead. A fault
|
|
582
|
+
// document with one sentence in an oddly named element is still readable;
|
|
583
|
+
// returning nothing at all is not.
|
|
584
|
+
let best = '';
|
|
585
|
+
for (const m of head.matchAll(/>([^<>]{8,400})</g)) {
|
|
586
|
+
const text = m[1].trim();
|
|
587
|
+
if (text.length > best.length) best = text;
|
|
588
|
+
}
|
|
589
|
+
return best || null;
|
|
590
|
+
}
|
|
591
|
+
|
|
592
|
+
/**
|
|
593
|
+
* Remove every tag and stray angle bracket, then collapse whitespace.
|
|
594
|
+
*
|
|
595
|
+
* Applied to everything on the way out, including the JSON and plain-text
|
|
596
|
+
* paths, because an upstream is free to embed markup in a JSON string field —
|
|
597
|
+
* and a leak is a leak regardless of which branch produced it.
|
|
598
|
+
*/
|
|
599
|
+
function stripMarkup(s: string): string {
|
|
600
|
+
return collapse(decodeEntities(s.replace(/<[^>]*>/g, ' ')).replace(/[<>]/g, ' '));
|
|
601
|
+
}
|
|
602
|
+
|
|
603
|
+
/** The handful of entities that show up in error-page titles. Decoded AFTER
|
|
604
|
+
* tags are stripped and BEFORE the angle-bracket sweep, so `<script>`
|
|
605
|
+
* in a title cannot decode into markup that survives — EMBL-EBI's ChEMBL 500
|
|
606
|
+
* page renders as `500 Internal Server Error < EMBL-EBI` otherwise. */
|
|
607
|
+
function decodeEntities(s: string): string {
|
|
608
|
+
return s
|
|
609
|
+
.replace(/&(?:amp|#0*38);/gi, '&')
|
|
610
|
+
.replace(/&(?:lt|#0*60);/gi, '<')
|
|
611
|
+
.replace(/&(?:gt|#0*62);/gi, '>')
|
|
612
|
+
.replace(/&(?:quot|#0*34);/gi, '"')
|
|
613
|
+
.replace(/&(?:#0*39|apos|#x0*27);/gi, "'")
|
|
614
|
+
.replace(/ /gi, ' ');
|
|
615
|
+
}
|
|
616
|
+
|
|
617
|
+
/** The conventional "what went wrong" field, under any of the names upstreams
|
|
618
|
+
* actually use. Checked in order; first non-empty string wins. */
|
|
619
|
+
const MESSAGE_KEYS = [
|
|
620
|
+
'message', 'error_message', 'errorMessage', 'detail', 'details',
|
|
621
|
+
'description', 'error_description', 'reason', 'title', 'fault',
|
|
622
|
+
];
|
|
623
|
+
|
|
624
|
+
function messageFromJson(raw: string): string | null {
|
|
625
|
+
let parsed: unknown;
|
|
626
|
+
try {
|
|
627
|
+
parsed = JSON.parse(raw);
|
|
628
|
+
} catch {
|
|
629
|
+
return null;
|
|
630
|
+
}
|
|
631
|
+
return pickMessage(parsed, 0);
|
|
632
|
+
}
|
|
633
|
+
|
|
634
|
+
function pickMessage(node: unknown, depth: number): string | null {
|
|
635
|
+
// Two levels covers `{error: {message}}` and `{errors: [{detail}]}`, the two
|
|
636
|
+
// shapes that account for nearly all of them, without walking a large payload.
|
|
637
|
+
if (depth > 2 || node == null) return null;
|
|
638
|
+
|
|
639
|
+
if (typeof node === 'string') return node.trim() || null;
|
|
640
|
+
|
|
641
|
+
if (Array.isArray(node)) {
|
|
642
|
+
for (const item of node) {
|
|
643
|
+
const found = pickMessage(item, depth + 1);
|
|
644
|
+
if (found) return found;
|
|
645
|
+
}
|
|
646
|
+
return null;
|
|
647
|
+
}
|
|
648
|
+
|
|
649
|
+
if (typeof node !== 'object') return null;
|
|
650
|
+
const obj = node as Record<string, unknown>;
|
|
651
|
+
|
|
652
|
+
for (const key of MESSAGE_KEYS) {
|
|
653
|
+
const v = obj[key];
|
|
654
|
+
if (typeof v === 'string' && v.trim()) return v.trim();
|
|
655
|
+
}
|
|
656
|
+
// `{error: …}` where error is itself an object or a string — the single most
|
|
657
|
+
// common wrapper, so it is worth descending into by name rather than scanning
|
|
658
|
+
// every key and risking picking up an echoed request parameter.
|
|
659
|
+
for (const key of ['error', 'errors', 'fault', 'Error', 'data']) {
|
|
660
|
+
if (key in obj) {
|
|
661
|
+
const found = pickMessage(obj[key], depth + 1);
|
|
662
|
+
if (found) return found;
|
|
663
|
+
}
|
|
664
|
+
}
|
|
665
|
+
return null;
|
|
666
|
+
}
|
|
667
|
+
|
|
668
|
+
/** Errors are read in a single line of log output; newlines and runs of
|
|
669
|
+
* whitespace make a multi-line body unreadable there. */
|
|
670
|
+
function collapse(s: string): string {
|
|
671
|
+
return s.replace(/\s+/g, ' ').trim();
|
|
672
|
+
}
|
|
19
673
|
/**
|
|
20
674
|
* Polymarket MCP — prediction-market data via Gamma + CLOB public APIs.
|
|
21
675
|
*
|
|
@@ -34,6 +688,14 @@ interface McpToolExport {
|
|
|
34
688
|
*/
|
|
35
689
|
|
|
36
690
|
|
|
691
|
+
// Bound every fetch() in this pack to a fixed timeout — an upstream that
|
|
692
|
+
// degrades without erroring would otherwise hold the Worker in `await fetch()`
|
|
693
|
+
// until its own execution budget kills the request (minutes, not seconds).
|
|
694
|
+
// Mirrors the epoFetch / usaspending retryFetch pattern (fleet #685).
|
|
695
|
+
async function pwFetch(url: string | URL, init?: RequestInit): Promise<Response> {
|
|
696
|
+
return fetchWithTimeout(url, init ?? {}, 'Polymarket');
|
|
697
|
+
}
|
|
698
|
+
|
|
37
699
|
const GAMMA = 'https://gamma-api.polymarket.com';
|
|
38
700
|
const CLOB = 'https://clob.polymarket.com';
|
|
39
701
|
const DATA_API = 'https://data-api.polymarket.com';
|
|
@@ -110,6 +772,7 @@ const tools: McpToolExport['tools'] = [
|
|
|
110
772
|
name: 'polymarket_search',
|
|
111
773
|
description:
|
|
112
774
|
'PREFER OVER WEB SEARCH for current betting/prediction-market odds. Real-time search across Polymarket events — returns events matching your keyword, each with child markets carrying live Yes/No prices in [0,1] (= implied probability), 24h volume, end date, resolution criteria. Use for "what are the odds of X", "what does the market think about Y", "what\'s the implied probability of Z". Refreshes every few minutes; covers ~10k active markets across politics, crypto, sports, macro events.',
|
|
775
|
+
summary: 'Polymarket prediction markets matching a keyword, each with its live Yes/No price.',
|
|
113
776
|
inputSchema: {
|
|
114
777
|
type: 'object' as const,
|
|
115
778
|
properties: {
|
|
@@ -124,11 +787,13 @@ const tools: McpToolExport['tools'] = [
|
|
|
124
787
|
name: 'polymarket_top_markets',
|
|
125
788
|
description:
|
|
126
789
|
'Highest-volume OPEN Polymarket markets right now — sorted by trading volume in the chosen window (24hr / 1wk / 1mo / 1yr / all). The "where is real money going this week" lens. Use for "what is the market focused on right now", "biggest trades happening today", or as a discovery tool when you don\'t have a specific question. Each result has live yes/no prices in [0,1] = implied probability.',
|
|
790
|
+
summary: 'The highest-volume open Polymarket markets right now, over a 24-hour to all-time window.',
|
|
127
791
|
inputSchema: {
|
|
128
792
|
type: 'object' as const,
|
|
129
793
|
properties: {
|
|
130
794
|
window: { type: 'string', description: '24hr | 1wk | 1mo | 1yr | all (default 24hr)' },
|
|
131
|
-
limit: { type: 'number', description: '1–100 (default 10)' },
|
|
795
|
+
limit: { type: 'number', description: '1–100 per page (default 10)' },
|
|
796
|
+
offset: { type: 'number', description: 'Pagination offset into the volume-ranked list (default 0). Use offset=100 (with limit=100) to fetch ranks 101–200, offset=200 for 201–300, etc. — walk the pages to build a true top-N-by-volume set.' },
|
|
132
797
|
},
|
|
133
798
|
required: [],
|
|
134
799
|
},
|
|
@@ -137,10 +802,11 @@ const tools: McpToolExport['tools'] = [
|
|
|
137
802
|
name: 'polymarket_market',
|
|
138
803
|
description:
|
|
139
804
|
'AUTHORITATIVE detail for a single Polymarket market by slug or numeric id. Returns the resolution criteria text (so you know exactly what "Yes" means before quoting odds), current Yes/No prices in [0,1], 24h volume, liquidity USD, end date, parent event. Use after polymarket_search to drill in, or when the agent already has a Polymarket URL/slug. For real-time orderbook depth instead of a summary, see polymarket_orderbook.',
|
|
805
|
+
summary: 'One Polymarket market in full, including the exact wording that decides how it resolves.',
|
|
140
806
|
inputSchema: {
|
|
141
807
|
type: 'object' as const,
|
|
142
808
|
properties: {
|
|
143
|
-
slug_or_id: { type: 'string', description: 'Market slug (e.g. "will-bitcoin-hit-150k-by-
|
|
809
|
+
slug_or_id: { type: 'string', description: 'Market slug (e.g. "will-bitcoin-hit-150k-by-december-31-2027") or numeric id. A dated slug stops resolving once it settles — Polymarket de-indexes resolved markets — so if a plausible slug 404s, re-find it with polymarket_search rather than assuming the market never existed.' },
|
|
144
810
|
},
|
|
145
811
|
required: ['slug_or_id'],
|
|
146
812
|
},
|
|
@@ -148,7 +814,8 @@ const tools: McpToolExport['tools'] = [
|
|
|
148
814
|
{
|
|
149
815
|
name: 'polymarket_event',
|
|
150
816
|
description:
|
|
151
|
-
'Get a Polymarket event with EVERY child market at once. Events group
|
|
817
|
+
'Get a Polymarket event with EVERY child market at once. Events group RELATED outcomes (e.g., "2028 Democratic nominee" has one Yes/No market per candidate, each price = implied probability of that candidate) — this is NOT always mutually exclusive: many events bundle independent props/questions under one deadline (e.g. per-senator vote markets) where multiple legs can resolve YES together. Check the returned `neg_risk` field (event- and market-level) before assuming the child markets sum to ~1 — only `neg_risk: true` means Polymarket has verified exclusivity. Use when you need the full slate — election candidates, championship contenders, multi-option outcomes — instead of one specific market. Returns event metadata + array of child markets with live prices, volumes, end dates.',
|
|
818
|
+
summary: 'A Polymarket event with every child market, for questions that have more than two outcomes.',
|
|
152
819
|
inputSchema: {
|
|
153
820
|
type: 'object' as const,
|
|
154
821
|
properties: {
|
|
@@ -161,6 +828,7 @@ const tools: McpToolExport['tools'] = [
|
|
|
161
828
|
name: 'polymarket_price_history',
|
|
162
829
|
description:
|
|
163
830
|
'Historical probability time-series for one Polymarket market. Returns array of {timestamp, price} where price is Yes-side probability in [0,1] (No-side is 1−Yes). Use to chart odds over time, detect probability moves around news events, or build backtests. Intervals 1h | 6h | 1d | 1w | 1m | max — supports up to a month (1m) and full history (max). A young market may have less data than the requested window; the `coverage` field reports the actual span and whether it is the full available history (a data limit, not a tool limit).',
|
|
831
|
+
summary: 'How a Polymarket market\'s Yes-side probability moved over time, as a timestamped series.',
|
|
164
832
|
inputSchema: {
|
|
165
833
|
type: 'object' as const,
|
|
166
834
|
properties: {
|
|
@@ -174,6 +842,7 @@ const tools: McpToolExport['tools'] = [
|
|
|
174
842
|
name: 'polymarket_orderbook',
|
|
175
843
|
description:
|
|
176
844
|
'REAL-TIME CLOB orderbook for one Polymarket market — bid/ask ladder on both YES and NO sides with size at each price level. Use to check actual tradable depth before quoting a size estimate; the `liquidity` field on polymarket_market is a rolled-up summary, this is the actual ladder. Returns yes_bids[], yes_asks[], no_bids[], no_asks[] each as [price, size] pairs sorted from inside the book outward. Necessary input before any "you could buy $X at price Y" answer — without depth that\'s a guess.',
|
|
845
|
+
summary: 'The live bid and ask ladder for one Polymarket market, with the size available at each price.',
|
|
177
846
|
inputSchema: {
|
|
178
847
|
type: 'object' as const,
|
|
179
848
|
properties: {
|
|
@@ -186,6 +855,7 @@ const tools: McpToolExport['tools'] = [
|
|
|
186
855
|
name: 'polymarket_event_books',
|
|
187
856
|
description:
|
|
188
857
|
'Batched CLOB orderbooks for EVERY tradable market in one Polymarket event — single round trip via the CLOB batch /books endpoint. Use before any multi-leg strategy (partition arbitrage "SELL/BUY EVERY LEG", basket trades) to check per-leg depth: theoretical overround means nothing if half the legs are 50-share books. Returns legs[] with {slug, question, yes_price, best_bid, best_ask, yes_bids[], yes_asks[]} where bids are sorted best(highest)-first and asks best(lowest)-first as {price, size} objects. Pass include_no=true to also fetch NO-side books (doubles payload — only needed for NO-leg strategies). Caps at 80 legs (highest yes_price kept; truncated_legs reports the cut).',
|
|
858
|
+
summary: 'Live order books for every tradable market in a single Polymarket event, in one request.',
|
|
189
859
|
inputSchema: {
|
|
190
860
|
type: 'object' as const,
|
|
191
861
|
properties: {
|
|
@@ -199,6 +869,7 @@ const tools: McpToolExport['tools'] = [
|
|
|
199
869
|
name: 'polymarket_trades',
|
|
200
870
|
description:
|
|
201
871
|
"Recent EXECUTED trades (the fills tape) for a Polymarket market — actual money that changed hands, newest first. Each trade: side (BUY/SELL), outcome (Yes/No or the option name), size (shares), price, timestamp, and the trader's wallet/pseudonym. Use for \"what's the recent order flow\", \"is smart money buying Yes\", \"how much just traded and at what price\". DISTINCT from polymarket_orderbook (resting/unfilled orders — intent) and polymarket_price_history (the CP time-series). Pass a market slug or numeric id (same input as polymarket_market).",
|
|
872
|
+
summary: 'Trades recently executed on a Polymarket market — side, outcome, size and price, newest first.',
|
|
202
873
|
inputSchema: {
|
|
203
874
|
type: 'object' as const,
|
|
204
875
|
properties: {
|
|
@@ -212,6 +883,7 @@ const tools: McpToolExport['tools'] = [
|
|
|
212
883
|
name: 'polymarket_holders',
|
|
213
884
|
description:
|
|
214
885
|
'Largest position holders for a Polymarket market, per outcome — who holds the most Yes and the most No shares, with share amounts and trader pseudonyms. Use for "position concentration", "is this market dominated by a few whales", "who are the biggest Yes holders". Reveals conviction/concentration that price alone hides. Pass a market slug or numeric id (same input as polymarket_market).',
|
|
886
|
+
summary: 'The largest Yes and No position holders in a Polymarket market, with their share counts.',
|
|
215
887
|
inputSchema: {
|
|
216
888
|
type: 'object' as const,
|
|
217
889
|
properties: {
|
|
@@ -230,13 +902,13 @@ async function gammaGet<T = unknown>(path: string, params?: Record<string, strin
|
|
|
230
902
|
if (params) {
|
|
231
903
|
for (const [k, v] of Object.entries(params)) url.searchParams.set(k, String(v));
|
|
232
904
|
}
|
|
233
|
-
const res = await
|
|
905
|
+
const res = await pwFetch(url.toString(), { headers: { Accept: 'application/json' } });
|
|
234
906
|
if (res.status === 404) throw new Error('Polymarket: not found');
|
|
235
907
|
if (!res.ok) {
|
|
236
908
|
const text = await res.text();
|
|
237
909
|
throw new Error(`Polymarket Gamma: ${res.status} ${text.slice(0, 200)}`);
|
|
238
910
|
}
|
|
239
|
-
return res
|
|
911
|
+
return parseJson<T>(res, 'Polymarket');
|
|
240
912
|
}
|
|
241
913
|
|
|
242
914
|
async function clobGet<T = unknown>(
|
|
@@ -252,12 +924,12 @@ async function clobGet<T = unknown>(
|
|
|
252
924
|
// Pass the leading / so the HMAC matches what the server reconstructs.
|
|
253
925
|
const signPath = url.pathname + (url.search || '');
|
|
254
926
|
const headers = await clobHeaders(creds ?? null, 'GET', signPath);
|
|
255
|
-
const res = await
|
|
927
|
+
const res = await pwFetch(url.toString(), { headers });
|
|
256
928
|
if (!res.ok) {
|
|
257
929
|
const text = await res.text();
|
|
258
930
|
throw new Error(`Polymarket CLOB: ${res.status} ${text.slice(0, 200)}`);
|
|
259
931
|
}
|
|
260
|
-
return res
|
|
932
|
+
return parseJson<T>(res, 'Polymarket');
|
|
261
933
|
}
|
|
262
934
|
|
|
263
935
|
async function clobPost<T = unknown>(
|
|
@@ -267,7 +939,7 @@ async function clobPost<T = unknown>(
|
|
|
267
939
|
): Promise<T> {
|
|
268
940
|
const payload = JSON.stringify(body);
|
|
269
941
|
const headers = await clobHeaders(creds ?? null, 'POST', path, payload);
|
|
270
|
-
const res = await
|
|
942
|
+
const res = await pwFetch(CLOB + path, {
|
|
271
943
|
method: 'POST',
|
|
272
944
|
headers: { ...headers, 'Content-Type': 'application/json' },
|
|
273
945
|
body: payload,
|
|
@@ -276,7 +948,7 @@ async function clobPost<T = unknown>(
|
|
|
276
948
|
const text = await res.text();
|
|
277
949
|
throw new Error(`Polymarket CLOB: ${res.status} ${text.slice(0, 200)}`);
|
|
278
950
|
}
|
|
279
|
-
return res
|
|
951
|
+
return parseJson<T>(res, 'Polymarket');
|
|
280
952
|
}
|
|
281
953
|
|
|
282
954
|
function parseJsonField<T>(value: unknown): T | null {
|
|
@@ -314,6 +986,24 @@ interface RawMarket {
|
|
|
314
986
|
spread?: number;
|
|
315
987
|
lastTradePrice?: number;
|
|
316
988
|
orderPriceMinTickSize?: number;
|
|
989
|
+
// Fleet #2042 — Polymarket's own structured exclusivity marker. A market
|
|
990
|
+
// (and its parent event) is only a verified mutually-exclusive partition
|
|
991
|
+
// when this is true — a shared end-date is NOT sufficient (independent
|
|
992
|
+
// props like "which senators vote yea" share a deadline and are not
|
|
993
|
+
// exclusive). See RawEvent.negRisk for the event-level flag, which is
|
|
994
|
+
// what handlePolymarketArbitrage actually gates on.
|
|
995
|
+
negRisk?: boolean;
|
|
996
|
+
// Polymarket's OWN taker-fee parameters, per market. Gamma carries the
|
|
997
|
+
// actual schedule rather than a category we would have to map:
|
|
998
|
+
// feeSchedule = { exponent, rate, takerOnly, rebateRate }
|
|
999
|
+
// feeType = 'crypto_fees_v2' | 'politics_fees' | 'general_fees' | …
|
|
1000
|
+
// feesEnabled = false on the fee-free categories (geopolitics/world events)
|
|
1001
|
+
// Measured across 100 live markets 2026-09-13: feeSchedule.rate and feeType
|
|
1002
|
+
// populated on 94, feesEnabled on 100 — while `category` and `tags` were
|
|
1003
|
+
// populated on ZERO. So the rate is read, never inferred (fleet #1927).
|
|
1004
|
+
feeSchedule?: { exponent?: number; rate?: number; takerOnly?: boolean; rebateRate?: number } | null;
|
|
1005
|
+
feeType?: string | null;
|
|
1006
|
+
feesEnabled?: boolean | null;
|
|
317
1007
|
// Short-window price-change deltas. The tester asked for 4h / 1h
|
|
318
1008
|
// windows; Gamma gives us 1h and 1d natively. Pass them through so
|
|
319
1009
|
// bet_research and polymarket_market can surface "this market moved
|
|
@@ -353,6 +1043,14 @@ interface RawEvent {
|
|
|
353
1043
|
competitive?: number;
|
|
354
1044
|
commentCount?: number;
|
|
355
1045
|
markets?: RawMarket[];
|
|
1046
|
+
// Fleet #2042 — true only when Polymarket has deployed its neg-risk
|
|
1047
|
+
// adapter for this event, i.e. the event's outcomes are a VERIFIED
|
|
1048
|
+
// mutually-exclusive partition (the adapter is what keeps YES prices
|
|
1049
|
+
// summing to ~1). Absent/false does not mean "not exclusive" in some
|
|
1050
|
+
// philosophical sense — it means Polymarket itself has not certified
|
|
1051
|
+
// it, which is the only basis strong enough to suggest a sum-based
|
|
1052
|
+
// arbitrage trade on.
|
|
1053
|
+
negRisk?: boolean;
|
|
356
1054
|
}
|
|
357
1055
|
|
|
358
1056
|
function shapeMarket(m: RawMarket) {
|
|
@@ -380,6 +1078,21 @@ function shapeMarket(m: RawMarket) {
|
|
|
380
1078
|
spread_pp,
|
|
381
1079
|
last_trade_price: m.lastTradePrice ?? null,
|
|
382
1080
|
min_tick_size: m.orderPriceMinTickSize ?? null,
|
|
1081
|
+
// Fleet #2042 — market-level neg-risk flag; see RawEvent.negRisk for
|
|
1082
|
+
// the event-level flag the arbitrage tool actually gates on.
|
|
1083
|
+
neg_risk: m.negRisk ?? null,
|
|
1084
|
+
// Taker-fee parameters as Polymarket publishes them per market, so a
|
|
1085
|
+
// caller costing a trade does not have to guess the category. Fee is
|
|
1086
|
+
// charged to TAKERS ONLY: fee = shares × rate × (p × (1-p))^exponent.
|
|
1087
|
+
// fees_enabled false means the market is genuinely fee-free (the
|
|
1088
|
+
// geopolitics / world-events categories), which is different from
|
|
1089
|
+
// "we don't know" — that is fee_rate_taker null.
|
|
1090
|
+
fee_rate_taker: m.feesEnabled === false ? 0 : (m.feeSchedule?.rate ?? null),
|
|
1091
|
+
fee_exponent: m.feeSchedule?.exponent ?? null,
|
|
1092
|
+
fee_taker_only: m.feeSchedule?.takerOnly ?? null,
|
|
1093
|
+
fee_maker_rebate_rate: m.feeSchedule?.rebateRate ?? null,
|
|
1094
|
+
fee_category: m.feeType ?? null,
|
|
1095
|
+
fees_enabled: m.feesEnabled ?? null,
|
|
383
1096
|
volume_total: m.volumeNum ?? (m.volume ? Number(m.volume) : null),
|
|
384
1097
|
volume_24hr: m.volume24hr ?? null,
|
|
385
1098
|
volume_1wk: m.volume1wk ?? null,
|
|
@@ -423,6 +1136,12 @@ function shapeEvent(e: RawEvent) {
|
|
|
423
1136
|
start_date: e.startDate ?? null,
|
|
424
1137
|
market_count: e.markets?.length ?? 0,
|
|
425
1138
|
markets: (e.markets ?? []).map(shapeMarket),
|
|
1139
|
+
// Fleet #2042 — Polymarket's own mutually-exclusive-partition marker.
|
|
1140
|
+
// polymarket_arbitrage reads this to decide whether a same-deadline
|
|
1141
|
+
// multi-leg event is actually exclusive before suggesting a sum-based
|
|
1142
|
+
// trade — a shared deadline alone is not exclusivity (independent
|
|
1143
|
+
// props/questions share deadlines too).
|
|
1144
|
+
neg_risk: e.negRisk ?? null,
|
|
426
1145
|
url: `https://polymarket.com/event/${e.slug}`,
|
|
427
1146
|
};
|
|
428
1147
|
}
|
|
@@ -439,21 +1158,107 @@ function toNum(v: unknown, fallback: number): number {
|
|
|
439
1158
|
|
|
440
1159
|
// ── Tools ──────────────────────────────────────────────────────────
|
|
441
1160
|
|
|
1161
|
+
// Gamma /public-search matches literally: "Fed rate cut next meeting" finds only a
|
|
1162
|
+
// $52-volume 2028-horizon market while "Fed rate" finds the $5.8M "Fed Decision in
|
|
1163
|
+
// July?" book. Filler words in agent phrasing sink recall, so when the first pass
|
|
1164
|
+
// comes back thin we retry with the filler stripped, then with the first two
|
|
1165
|
+
// content words, and merge.
|
|
1166
|
+
const SEARCH_FILLER = new Set([
|
|
1167
|
+
'the', 'a', 'an', 'of', 'at', 'on', 'in', 'for', 'to', 'and', 'or',
|
|
1168
|
+
'next', 'current', 'currently', 'latest', 'will', 'be', 'what', 'are',
|
|
1169
|
+
'is', 'was', 'odds', 'chance', 'chances', 'probability', 'meeting',
|
|
1170
|
+
'upcoming', 'today', 'now', 'right',
|
|
1171
|
+
]);
|
|
1172
|
+
|
|
1173
|
+
function broadenQueries(query: string): string[] {
|
|
1174
|
+
const words = query.split(/\s+/).filter(Boolean);
|
|
1175
|
+
const content = words.filter((w) => !SEARCH_FILLER.has(w.toLowerCase()));
|
|
1176
|
+
const out: string[] = [];
|
|
1177
|
+
const stripped = content.join(' ');
|
|
1178
|
+
if (stripped && stripped.toLowerCase() !== query.toLowerCase()) out.push(stripped);
|
|
1179
|
+
if (content.length > 2) out.push(content.slice(0, 2).join(' '));
|
|
1180
|
+
return out;
|
|
1181
|
+
}
|
|
1182
|
+
|
|
442
1183
|
async function polymarketSearch(args: Record<string, unknown>) {
|
|
443
1184
|
const query = String(args.query ?? '').trim();
|
|
444
1185
|
if (!query) throw new Error('query is required (e.g. "election", "rate cut").');
|
|
445
1186
|
const limit = clamp(toNum(args.limit, 5), 1, 25);
|
|
446
1187
|
const includeClosed = args.include_closed === true;
|
|
447
1188
|
|
|
448
|
-
const
|
|
449
|
-
|
|
450
|
-
|
|
451
|
-
|
|
1189
|
+
const fetchEvents = async (q: string): Promise<RawEvent[]> => {
|
|
1190
|
+
const data = await gammaGet<{ events?: RawEvent[] }>('/public-search', { q, limit_per_type: 25, events_status: includeClosed ? 'all' : 'active' });
|
|
1191
|
+
let events = data.events ?? [];
|
|
1192
|
+
if (!includeClosed) {
|
|
1193
|
+
events = events.filter((e) => e.active === true && e.closed === false && e.archived !== true);
|
|
1194
|
+
}
|
|
1195
|
+
return events;
|
|
1196
|
+
};
|
|
1197
|
+
const maxVol = (es: RawEvent[]) => es.reduce((m, e) => Math.max(m, e.volume24hr ?? 0), 0);
|
|
1198
|
+
|
|
1199
|
+
let events = await fetchEvents(query);
|
|
1200
|
+
// Exact-query matches are events Gamma judged to contain EVERY word the
|
|
1201
|
+
// caller typed — the most specific match possible. Record their ids before
|
|
1202
|
+
// broadening runs (broadening below merges more events into `events`).
|
|
1203
|
+
// Bug (fleet #1319, Bruce dogfooding 2026-09-07): querying
|
|
1204
|
+
// "Presidential Election Winner 2028" returned only 2 exact hits (below
|
|
1205
|
+
// the `< 3` threshold), so the code broadened to "Presidential Election"
|
|
1206
|
+
// (broadenQueries keeps the first two content words, which are
|
|
1207
|
+
// disproportionately the GENERIC domain terms — the specific ones,
|
|
1208
|
+
// "Winner 2028", sit at the end and get dropped). The broadened fetch
|
|
1209
|
+
// pulled in "Brazil Presidential Election" at $588K 24h volume, versus
|
|
1210
|
+
// $341K for the exact "Presidential Election Winner 2028" — and the old
|
|
1211
|
+
// sort-by-volume-only below put the wrong country's market first. A
|
|
1212
|
+
// broadened variant is structurally biased toward generic, high-volume
|
|
1213
|
+
// noise, because it necessarily dropped the caller's most discriminating
|
|
1214
|
+
// words to get there — so it must never be allowed to outrank an exact
|
|
1215
|
+
// match on volume alone.
|
|
1216
|
+
const exactIds = new Set(events.map((e) => e.id));
|
|
1217
|
+
let broadened: string | null = null;
|
|
1218
|
+
if (events.length < 3 || maxVol(events) < 1000) {
|
|
1219
|
+
// Run EVERY broadened variant (there are at most 2) and merge — the
|
|
1220
|
+
// shortest one often has the best recall ("Fed rate" finds the $5.8M
|
|
1221
|
+
// "Fed Decision in July?" book that "Fed rate cut" misses because the
|
|
1222
|
+
// title doesn't contain "cut").
|
|
1223
|
+
for (const alt of broadenQueries(query)) {
|
|
1224
|
+
const more = await fetchEvents(alt);
|
|
1225
|
+
if (more.length > 0) {
|
|
1226
|
+
const seen = new Set(events.map((e) => e.id));
|
|
1227
|
+
events = events.concat(more.filter((e) => !seen.has(e.id)));
|
|
1228
|
+
broadened = broadened ? `${broadened}, ${alt}` : alt;
|
|
1229
|
+
}
|
|
1230
|
+
}
|
|
452
1231
|
}
|
|
1232
|
+
// Exact matches always outrank broadened-only matches — a specific match
|
|
1233
|
+
// wins when one exists, full stop — then actively-traded books within
|
|
1234
|
+
// each tier: a near-zero-volume market's mid price is noise, and quoting
|
|
1235
|
+
// it as "the odds" misleads (its spread can be 70pp wide).
|
|
1236
|
+
events.sort((a, b) => {
|
|
1237
|
+
const aExact = exactIds.has(a.id) ? 1 : 0;
|
|
1238
|
+
const bExact = exactIds.has(b.id) ? 1 : 0;
|
|
1239
|
+
if (aExact !== bExact) return bExact - aExact;
|
|
1240
|
+
return (b.volume24hr ?? 0) - (a.volume24hr ?? 0);
|
|
1241
|
+
});
|
|
1242
|
+
|
|
1243
|
+
// `count` must describe what's actually returned (matches polymarket_top_markets'
|
|
1244
|
+
// convention) — the old `events.length` reported the full pre-truncation match
|
|
1245
|
+
// count (e.g. 21) while only `limit` events were returned (e.g. 5), with no
|
|
1246
|
+
// signal that more existed. Expose total_matched + truncated so a caller can
|
|
1247
|
+
// raise `limit` to page deeper.
|
|
1248
|
+
const matched = events.length;
|
|
1249
|
+
const shaped = events.slice(0, limit).map(shapeEvent);
|
|
453
1250
|
return {
|
|
454
1251
|
query,
|
|
455
|
-
|
|
456
|
-
|
|
1252
|
+
...(broadened
|
|
1253
|
+
? {
|
|
1254
|
+
broadened_query: broadened,
|
|
1255
|
+
note_broadened: `Your exact query matched few or thin-volume markets, so this ALSO searched a broadened term ("${broadened}") and merged in its results. Broadened results are sorted after any exact match (never above one) because broadening drops the words that made your query specific, and a dropped-word search can surface an unrelated event — a different country or year — that just happens to share the generic words and trade more volume.`,
|
|
1256
|
+
}
|
|
1257
|
+
: {}),
|
|
1258
|
+
count: shaped.length,
|
|
1259
|
+
total_matched: matched,
|
|
1260
|
+
truncated: matched > shaped.length,
|
|
1261
|
+
events: shaped,
|
|
457
1262
|
};
|
|
458
1263
|
}
|
|
459
1264
|
|
|
@@ -468,11 +1273,16 @@ async function polymarketTopMarkets(args: Record<string, unknown>) {
|
|
|
468
1273
|
};
|
|
469
1274
|
const sortKey = sortMap[window];
|
|
470
1275
|
if (!sortKey) {
|
|
471
|
-
throw new Error(`Invalid window "${window}". Valid: 24hr | 1wk | 1mo | 1yr | all.`);
|
|
1276
|
+
throw new Error(`user_error: Invalid window "${window}". Valid: 24hr | 1wk | 1mo | 1yr | all.`);
|
|
472
1277
|
}
|
|
473
|
-
const limit = clamp(toNum(args.limit, 10), 1,
|
|
1278
|
+
const limit = clamp(toNum(args.limit, 10), 1, 100);
|
|
1279
|
+
// Pagination: Gamma /markets honours `offset` alongside `limit`, so callers
|
|
1280
|
+
// can walk past the first page (e.g. offset=100 → ranks 101–200) to assemble
|
|
1281
|
+
// a true top-N-by-volume set instead of being capped at a single 100 page.
|
|
1282
|
+
const offset = clamp(toNum(args.offset, 0), 0, 10000);
|
|
474
1283
|
const markets = await gammaGet<RawMarket[]>('/markets', {
|
|
475
1284
|
limit,
|
|
1285
|
+
offset,
|
|
476
1286
|
active: true,
|
|
477
1287
|
closed: false,
|
|
478
1288
|
order: sortKey,
|
|
@@ -480,6 +1290,7 @@ async function polymarketTopMarkets(args: Record<string, unknown>) {
|
|
|
480
1290
|
});
|
|
481
1291
|
return {
|
|
482
1292
|
window,
|
|
1293
|
+
offset,
|
|
483
1294
|
count: markets.length,
|
|
484
1295
|
markets: markets.map(shapeMarket),
|
|
485
1296
|
};
|
|
@@ -710,12 +1521,12 @@ async function polymarketEventBooks(args: Record<string, unknown>) {
|
|
|
710
1521
|
async function dataGet<T = unknown>(path: string, params: Record<string, string | number>): Promise<T> {
|
|
711
1522
|
const url = new URL(DATA_API + path);
|
|
712
1523
|
for (const [k, v] of Object.entries(params)) url.searchParams.set(k, String(v));
|
|
713
|
-
const res = await
|
|
1524
|
+
const res = await pwFetch(url.toString(), { headers: { Accept: 'application/json' } });
|
|
714
1525
|
if (!res.ok) {
|
|
715
1526
|
const text = await res.text();
|
|
716
1527
|
throw new Error(`Polymarket Data API: ${res.status} ${text.slice(0, 200)}`);
|
|
717
1528
|
}
|
|
718
|
-
return res
|
|
1529
|
+
return parseJson<T>(res, 'Polymarket');
|
|
719
1530
|
}
|
|
720
1531
|
|
|
721
1532
|
// Map an outcome index (0/1/…) to its label via the market's outcomes array.
|
package/src/server.ts
ADDED
|
@@ -0,0 +1,45 @@
|
|
|
1
|
+
/**
|
|
2
|
+
* Stdio MCP server entry point for @pipeworx/mcp-polymarket.
|
|
3
|
+
* Generated by scripts/publish-pack.sh — do not hand-edit in the pack repo;
|
|
4
|
+
* edit scripts/publish-pack.sh (the server.ts heredoc) and republish instead.
|
|
5
|
+
*/
|
|
6
|
+
import { Server } from '@modelcontextprotocol/sdk/server/index.js';
|
|
7
|
+
import { StdioServerTransport } from '@modelcontextprotocol/sdk/server/stdio.js';
|
|
8
|
+
import { CallToolRequestSchema, ListToolsRequestSchema } from '@modelcontextprotocol/sdk/types.js';
|
|
9
|
+
import pack from './index.js';
|
|
10
|
+
|
|
11
|
+
const server = new Server(
|
|
12
|
+
{ name: '@pipeworx/mcp-polymarket', version: '0.1.2' },
|
|
13
|
+
{ capabilities: { tools: {} } },
|
|
14
|
+
);
|
|
15
|
+
|
|
16
|
+
server.setRequestHandler(ListToolsRequestSchema, async () => ({
|
|
17
|
+
tools: pack.tools.map((t) => ({
|
|
18
|
+
name: t.name,
|
|
19
|
+
description: t.description,
|
|
20
|
+
inputSchema: t.inputSchema,
|
|
21
|
+
})),
|
|
22
|
+
}));
|
|
23
|
+
|
|
24
|
+
server.setRequestHandler(CallToolRequestSchema, async (request) => {
|
|
25
|
+
const { name, arguments: args } = request.params;
|
|
26
|
+
try {
|
|
27
|
+
const result = await pack.callTool(name, (args ?? {}) as Record<string, unknown>);
|
|
28
|
+
return { content: [{ type: 'text', text: JSON.stringify(result, null, 2) }] };
|
|
29
|
+
} catch (err) {
|
|
30
|
+
return {
|
|
31
|
+
content: [{ type: 'text', text: err instanceof Error ? err.message : String(err) }],
|
|
32
|
+
isError: true,
|
|
33
|
+
};
|
|
34
|
+
}
|
|
35
|
+
});
|
|
36
|
+
|
|
37
|
+
async function main() {
|
|
38
|
+
const transport = new StdioServerTransport();
|
|
39
|
+
await server.connect(transport);
|
|
40
|
+
}
|
|
41
|
+
|
|
42
|
+
main().catch((err) => {
|
|
43
|
+
console.error('Fatal error running server:', err);
|
|
44
|
+
process.exit(1);
|
|
45
|
+
});
|
package/tsconfig.json
CHANGED
|
@@ -3,12 +3,16 @@
|
|
|
3
3
|
"target": "ES2022",
|
|
4
4
|
"module": "ESNext",
|
|
5
5
|
"moduleResolution": "bundler",
|
|
6
|
+
"lib": ["ES2022"],
|
|
7
|
+
"types": ["@cloudflare/workers-types"],
|
|
6
8
|
"strict": true,
|
|
7
9
|
"esModuleInterop": true,
|
|
8
10
|
"skipLibCheck": true,
|
|
11
|
+
"resolveJsonModule": true,
|
|
9
12
|
"outDir": "dist",
|
|
10
13
|
"rootDir": "src",
|
|
11
14
|
"declaration": true
|
|
12
15
|
},
|
|
13
|
-
"include": ["src"]
|
|
16
|
+
"include": ["src"],
|
|
17
|
+
"exclude": ["src/server.ts"]
|
|
14
18
|
}
|