@dotsetlabs/bellwether 0.12.0 → 1.0.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +87 -0
- package/README.md +107 -665
- package/dist/baseline/accessors.d.ts +1 -1
- package/dist/baseline/baseline-hash.js +23 -6
- package/dist/baseline/cloud-types.d.ts +281 -0
- package/dist/baseline/cloud-types.js +12 -0
- package/dist/baseline/converter.d.ts +1 -1
- package/dist/baseline/pr-comment-generator.js +2 -2
- package/dist/baseline/types.d.ts +1 -1
- package/dist/benchmark/benchmarker.d.ts +30 -0
- package/dist/benchmark/benchmarker.js +309 -0
- package/dist/benchmark/index.d.ts +6 -0
- package/dist/benchmark/index.js +5 -0
- package/dist/benchmark/types.d.ts +133 -0
- package/dist/benchmark/types.js +5 -0
- package/dist/cli/commands/auth.d.ts +0 -1
- package/dist/cli/commands/auth.js +0 -1
- package/dist/cli/commands/benchmark.d.ts +11 -0
- package/dist/cli/commands/benchmark.js +260 -0
- package/dist/cli/commands/cloud/badge.js +2 -2
- package/dist/cli/index.js +2 -28
- package/dist/cli/output/terminal-reporter.d.ts +1 -1
- package/dist/cli/output/terminal-reporter.js +4 -24
- package/dist/cloud/http-client.d.ts +2 -2
- package/dist/cloud/http-client.js +6 -6
- package/dist/cloud/mock-client.d.ts +2 -2
- package/dist/cloud/mock-client.js +26 -26
- package/dist/cloud/types.d.ts +28 -28
- package/dist/config/defaults.d.ts +0 -14
- package/dist/config/defaults.js +0 -14
- package/dist/config/template.js +0 -40
- package/dist/config/validator.d.ts +6 -146
- package/dist/config/validator.js +0 -85
- package/dist/constants/cloud.d.ts +0 -36
- package/dist/constants/cloud.js +1 -38
- package/dist/constants/core.d.ts +4 -20
- package/dist/constants/core.js +4 -20
- package/dist/constants/testing.d.ts +4 -8
- package/dist/constants/testing.js +4 -8
- package/dist/docs/contract.js +1 -2
- package/dist/index.d.ts +0 -2
- package/dist/index.js +0 -2
- package/dist/logging/logger.js +4 -2
- package/dist/transport/mcp-client.d.ts +2 -0
- package/dist/transport/mcp-client.js +10 -5
- package/dist/utils/timeout.d.ts +1 -1
- package/dist/utils/timeout.js +2 -2
- package/dist/version.js +1 -1
- package/package.json +6 -3
package/CHANGELOG.md
CHANGED
|
@@ -2,6 +2,93 @@
|
|
|
2
2
|
|
|
3
3
|
All notable changes to this project will be documented in this file.
|
|
4
4
|
|
|
5
|
+
## [1.0.0] - 2026-01-27
|
|
6
|
+
|
|
7
|
+
### Breaking Changes
|
|
8
|
+
|
|
9
|
+
- **Removed cloud commands**: The following commands have been removed: `login`, `upload`, `projects`, `history`, `diff`, `link`, `teams`, `badge`
|
|
10
|
+
- **Removed benchmark command**: The `benchmark` command and "Tested with Bellwether" certification program have been removed
|
|
11
|
+
- **Removed cloud module**: All cloud integration code has been removed from the CLI
|
|
12
|
+
|
|
13
|
+
### Changed
|
|
14
|
+
|
|
15
|
+
- **Fully open source**: Bellwether is now a completely free, open-source tool with no cloud dependencies
|
|
16
|
+
- **Simplified configuration**: Removed cloud-related settings from `bellwether.yaml` template
|
|
17
|
+
- **Updated documentation**: Removed all cloud-related documentation
|
|
18
|
+
|
|
19
|
+
### Migration Guide
|
|
20
|
+
|
|
21
|
+
If you were using cloud features:
|
|
22
|
+
|
|
23
|
+
1. **Baselines**: Store baselines in git instead of uploading to cloud
|
|
24
|
+
```bash
|
|
25
|
+
bellwether baseline save
|
|
26
|
+
git add bellwether-baseline.json
|
|
27
|
+
git commit -m "Add baseline"
|
|
28
|
+
```
|
|
29
|
+
|
|
30
|
+
2. **CI/CD**: Use local baseline comparison instead of cloud upload
|
|
31
|
+
```bash
|
|
32
|
+
# Old
|
|
33
|
+
bellwether upload --ci --fail-on-drift
|
|
34
|
+
|
|
35
|
+
# New
|
|
36
|
+
bellwether check --fail-on-drift
|
|
37
|
+
bellwether baseline compare ./bellwether-baseline.json
|
|
38
|
+
```
|
|
39
|
+
|
|
40
|
+
3. **Environment variables**: Remove `BELLWETHER_SESSION`, `BELLWETHER_API_URL`, `BELLWETHER_TEAM_ID` from your CI/CD configuration
|
|
41
|
+
|
|
42
|
+
## [0.13.0] - 2026-01-27
|
|
43
|
+
|
|
44
|
+
### Breaking Changes
|
|
45
|
+
|
|
46
|
+
- **Renamed `bellwether verify` to `bellwether benchmark`**: The verification command has been renamed to better reflect its purpose
|
|
47
|
+
- Old: `bellwether verify <server-command>`
|
|
48
|
+
- New: `bellwether benchmark <server-command>`
|
|
49
|
+
- **Renamed "Verified by Bellwether" to "Tested with Bellwether"**: Updated branding throughout the CLI and documentation
|
|
50
|
+
- Badge text now shows "Tested with Bellwether"
|
|
51
|
+
- Status values changed: `verified` → `passed`, `not_verified` → `not_tested`
|
|
52
|
+
- **Config section renamed**: The `verify:` section in `bellwether.yaml` is now `benchmark:`
|
|
53
|
+
- Old: `verify: { timeout: 30000 }`
|
|
54
|
+
- New: `benchmark: { timeout: 30000 }`
|
|
55
|
+
- **Output file renamed**: Default benchmark report file changed from `bellwether-verification.json` to `bellwether-benchmark.json`
|
|
56
|
+
- **Cloud API changes**: Benchmark-related API endpoints have been renamed
|
|
57
|
+
- `/verifications` → `/benchmarks`
|
|
58
|
+
- Activity events: `verification.completed` → `benchmark.completed`, `verification.failed` → `benchmark.failed`
|
|
59
|
+
|
|
60
|
+
### Changed
|
|
61
|
+
|
|
62
|
+
- All CLI output messages updated to use "benchmark" terminology
|
|
63
|
+
- Documentation updated throughout to reflect new naming
|
|
64
|
+
- Badge command description updated to reference "benchmark badge"
|
|
65
|
+
- Constants renamed: `VERIFICATION_TIERS` → `BENCHMARK_TIERS`, `DEFAULT_VERIFICATION_REPORT_FILE` → `DEFAULT_BENCHMARK_REPORT_FILE`
|
|
66
|
+
|
|
67
|
+
### Migration Guide
|
|
68
|
+
|
|
69
|
+
1. Update your `bellwether.yaml` config file:
|
|
70
|
+
```yaml
|
|
71
|
+
# Old
|
|
72
|
+
verify:
|
|
73
|
+
timeout: 30000
|
|
74
|
+
|
|
75
|
+
# New
|
|
76
|
+
benchmark:
|
|
77
|
+
timeout: 30000
|
|
78
|
+
```
|
|
79
|
+
|
|
80
|
+
2. Update any CI/CD scripts:
|
|
81
|
+
```bash
|
|
82
|
+
# Old
|
|
83
|
+
bellwether verify npx @mcp/server
|
|
84
|
+
|
|
85
|
+
# New
|
|
86
|
+
bellwether benchmark npx @mcp/server
|
|
87
|
+
```
|
|
88
|
+
|
|
89
|
+
3. Update any references to the output file:
|
|
90
|
+
- `bellwether-verification.json` → `bellwether-benchmark.json`
|
|
91
|
+
|
|
5
92
|
## [0.12.0] - 2026-01-26
|
|
6
93
|
|
|
7
94
|
### Features
|