@x402scan/mcp 0.2.1-beta.1 → 0.2.2

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/README.md CHANGED
@@ -125,6 +125,41 @@ pnpm dev install --dev
125
125
  pnpm build:mcpb
126
126
  ```
127
127
 
128
+ ## Evaluations
129
+
130
+ MCP changes are automatically tested via CI. Comprehensive evaluations run in the [x402-evals](https://github.com/merit-systems/x402-evals) repository.
131
+
132
+ ### Automatic Checks
133
+
134
+ - **PR Smoke Test** - Automatically runs when you modify MCP source code
135
+ - **Release Eval** - Full evaluation suite runs when a new version is published
136
+
137
+ ### Manual Evaluation
138
+
139
+ Comment on your PR to trigger evaluations:
140
+
141
+ | Command | Description |
142
+ | ------------------------ | ---------------------------------------- |
143
+ | `/eval` or `/eval smoke` | Quick validation (~2-3 min) |
144
+ | `/eval full` | Comprehensive testing (~10 min) |
145
+ | `/eval regression` | Known edge cases and historical failures |
146
+
147
+ Results are posted back to your PR with a link to detailed metrics.
148
+
149
+ ### Local Evaluation
150
+
151
+ ```bash
152
+ # In x402-evals repo
153
+ MCP_SERVER_DIR=/path/to/x402scan/packages/external/mcp/dist/esm pnpm --filter @x402-evals/promptfoo eval
154
+ ```
155
+
156
+ ### Evals on changes to enrichx402 or stablestudio
157
+
158
+ 1. Make a PR in enrichx402 and generate a preview URL with vercel
159
+ 2. Make a branch in the x402scan repo
160
+ 3. Replace the enrichx402.com URL in `src/shared/origins.ts` with your preview URL
161
+ 4. Push and make a PR, then comment on it with "/eval full" (or smoke, regression)
162
+
128
163
  ## Publishing
129
164
 
130
165
  This package uses [changesets](https://github.com/changesets/changesets) for versioning and publishing.