@dotsetlabs/bellwether 0.12.0 → 1.0.1

package/.dockerignore

@@ -0,0 +1,25 @@
+node_modules
+npm-debug.log
+.git
+.gitignore
+README.md
+CHANGELOG.md
+.eslintrc.json
+.prettierrc
+.github
+.nyc_output
+coverage
+.vscode
+.idea
+test/
+src/
+*.test.ts
+*.spec.ts
+tsconfig.json
+typedoc.json
+vitest.config.ts
+.dccache
+*.md
+!LICENSE
+!README.md
+!CHANGELOG.md

package/CHANGELOG.md

@@ -2,6 +2,129 @@
 
 All notable changes to this project will be documented in this file.
 
+The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
+and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
+
+## [Unreleased]
+
+## [1.0.1] - 2026-01-29
+
+### Added
+
+- Added `$VAR` syntax support for environment variable interpolation in config files
+- Added rate limiting to registry client (5 req/s default)
+- Added `AnthropicClient` and `OllamaClient` exports to public API
+- Added `repository.directory` and `funding` fields to package.json
+- Added required permissions documentation to GitHub Action
+- Added debug logging for all credential operations
+- Added warning when environment variables in config are not resolved
+
+### Changed
+
+- Optimized GitHub Action to run check once; SARIF and JUnit are now converted from JSON output
+- Removed test coverage exclusion for CLI entry point
+- Removed unnecessary type casts in check.ts and security-tester.ts
+- Replaced magic number 100 with PERCENTAGE_CONVERSION.DIVISOR constant
+- Removed dead code sections from constants
+- Refactored string concatenation to template literals in CLI output modules
+
+### Fixed
+
+- Fixed version fallback inconsistency (0.13.0 → 1.0.1)
+- Fixed missing pino-pretty dependency
+- Fixed non-null assertion for remoteUrl in check.ts (added proper null check)
+- Fixed non-null assertion for incrementalResult in check.ts
+- Added debug logging to catch blocks in keychain.ts (graceful degradation with visibility)
+- Fixed flaky test in workflow executor (timing assertion)
+- Fixed test failures in baseline-accept tests (process.exit mock)
+
+## [1.0.0] - 2026-01-27
+
+### Breaking Changes
+
+- **Removed cloud commands**: The following commands have been removed: `login`, `upload`, `projects`, `history`, `diff`, `link`, `teams`, `badge`
+- **Removed benchmark command**: The `benchmark` command and "Tested with Bellwether" certification program have been removed
+- **Removed cloud module**: All cloud integration code has been removed from the CLI
+
+### Changed
+
+- **Fully open source**: Bellwether is now a completely free, open-source tool with no cloud dependencies
+- **Simplified configuration**: Removed cloud-related settings from `bellwether.yaml` template
+- **Updated documentation**: Removed all cloud-related documentation
+
+### Migration Guide
+
+If you were using cloud features:
+
+1. **Baselines**: Store baselines in git instead of uploading to cloud
+   ```bash
+   bellwether baseline save
+   git add bellwether-baseline.json
+   git commit -m "Add baseline"
+   ```
+
+2. **CI/CD**: Use local baseline comparison instead of cloud upload
+   ```bash
+   # Old
+   bellwether upload --ci --fail-on-drift
+
+   # New
+   bellwether check --fail-on-drift
+   bellwether baseline compare ./bellwether-baseline.json
+   ```
+
+3. **Environment variables**: Remove `BELLWETHER_SESSION`, `BELLWETHER_API_URL`, `BELLWETHER_TEAM_ID` from your CI/CD configuration
+
+## [0.13.0] - 2026-01-27
+
+### Breaking Changes
+
+- **Renamed `bellwether verify` to `bellwether benchmark`**: The verification command has been renamed to better reflect its purpose
+  - Old: `bellwether verify <server-command>`
+  - New: `bellwether benchmark <server-command>`
+- **Renamed "Verified by Bellwether" to "Tested with Bellwether"**: Updated branding throughout the CLI and documentation
+  - Badge text now shows "Tested with Bellwether"
+  - Status values changed: `verified` → `passed`, `not_verified` → `not_tested`
+- **Config section renamed**: The `verify:` section in `bellwether.yaml` is now `benchmark:`
+  - Old: `verify: { timeout: 30000 }`
+  - New: `benchmark: { timeout: 30000 }`
+- **Output file renamed**: Default benchmark report file changed from `bellwether-verification.json` to `bellwether-benchmark.json`
+- **Cloud API changes**: Benchmark-related API endpoints have been renamed
+  - `/verifications` → `/benchmarks`
+  - Activity events: `verification.completed` → `benchmark.completed`, `verification.failed` → `benchmark.failed`
+
+### Changed
+
+- All CLI output messages updated to use "benchmark" terminology
+- Documentation updated throughout to reflect new naming
+- Badge command description updated to reference "benchmark badge"
+- Constants renamed: `VERIFICATION_TIERS` → `BENCHMARK_TIERS`, `DEFAULT_VERIFICATION_REPORT_FILE` → `DEFAULT_BENCHMARK_REPORT_FILE`
+
+### Migration Guide
+
+1. Update your `bellwether.yaml` config file:
+   ```yaml
+   # Old
+   verify:
+     timeout: 30000
+
+   # New
+   benchmark:
+     timeout: 30000
+   ```
+
+2. Update any CI/CD scripts:
+   ```bash
+   # Old
+   bellwether verify npx @mcp/server
+
+   # New
+   bellwether benchmark npx @mcp/server
+   ```
+
+3. Update any references to the output file:
+   - `bellwether-verification.json` → `bellwether-benchmark.json`
+
 ## [0.12.0] - 2026-01-26
 
 ### Features

package/Dockerfile

@@ -0,0 +1,43 @@
+# Bellwether MCP Testing Tool
+# https://github.com/dotsetlabs/bellwether
+
+FROM node:20-alpine
+
+LABEL maintainer="Dotset Labs <hello@dotsetlabs.com>"
+LABEL description="Bellwether - MCP Server Testing & Validation"
+LABEL org.opencontainers.image.source="https://github.com/dotsetlabs/bellwether"
+
+# Install git for npm dependencies that may need it
+RUN apk add --no-cache git
+
+# Create app directory
+WORKDIR /app
+
+# Copy package files
+COPY package*.json ./
+
+# Install production dependencies only
+RUN npm ci --omit=dev
+
+# Copy built application
+COPY dist/ ./dist/
+COPY schemas/ ./schemas/
+COPY LICENSE README.md CHANGELOG.md ./
+
+# Create non-root user
+RUN addgroup -g 1001 -S bellwether && \
+    adduser -S bellwether -u 1001
+
+# Set proper permissions
+RUN chown -R bellwether:bellwether /app
+
+# Switch to non-root user
+USER bellwether
+
+# Set environment
+ENV NODE_ENV=production
+ENV BELLWETHER_DOCKER=1
+
+# Entry point
+ENTRYPOINT ["node", "dist/cli/index.js"]
+CMD ["--help"]