@x402scan/mcp 0.2.1-beta.0 → 0.2.1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/README.md CHANGED
@@ -125,6 +125,46 @@ pnpm dev install --dev
125
125
  pnpm build:mcpb
126
126
  ```
127
127
 
128
+ ## Evaluations
129
+
130
+ MCP changes are automatically tested via CI. Comprehensive evaluations run in the [x402-evals](https://github.com/merit-systems/x402-evals) repository.
131
+
132
+ ### Automatic Checks
133
+
134
+ - **PR Smoke Test** - Automatically runs when you modify MCP source code
135
+ - **Release Eval** - Full evaluation suite runs when a new version is published
136
+
137
+ ### Manual Evaluation
138
+
139
+ Comment on your PR to trigger evaluations:
140
+
141
+ | Command | Description |
142
+ | ------------------------ | ---------------------------------------- |
143
+ | `/eval` or `/eval smoke` | Quick validation (~2-3 min) |
144
+ | `/eval full` | Comprehensive testing (~10 min) |
145
+ | `/eval regression` | Known edge cases and historical failures |
146
+
147
+ Results are posted back to your PR with a link to detailed metrics.
148
+
149
+ ### Local Evaluation
150
+
151
+ For local development, you can run evals directly:
152
+
153
+ ```bash
154
+ # Run local evals in this package
155
+ pnpm evals
156
+
157
+ # Or run smoke tests
158
+ pnpm evals:single-prompt
159
+ ```
160
+
161
+ For the full CI/CD eval suite, clone [x402-evals](https://github.com/merit-systems/x402-evals) and run:
162
+
163
+ ```bash
164
+ # In x402-evals repo
165
+ MCP_SERVER_DIR=/path/to/x402scan/packages/external/mcp/dist/esm pnpm --filter @x402-evals/promptfoo eval
166
+ ```
167
+
128
168
  ## Publishing
129
169
 
130
170
  This package uses [changesets](https://github.com/changesets/changesets) for versioning and publishing.