@slbdn/mcp-tester 1.7.0 → 1.8.0

package/CHANGELOG.md

@@ -7,6 +7,14 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ## [Unreleased]
 
+## [1.8.0] - 2026-10-23
+
+### Added
+- End-to-end test suites under `src/__tests__/e2e/` covering complete server workflows: lifecycle (start/connect/discover with drift-free repeated discovery, stop, double-stop no-op, restart with fresh process state, zombie-process proof via pidfile, env passthrough, server→client logging notifications), error recovery (mid-session crash → clean teardown, `MCPTimeoutError` with `.timeout`/`.operation` on a hung tool with the server surviving, exact retry accounting via per-tool call stats, `MCPServerError` with `serverCode` preserved), concurrency (20 parallel `echo` calls with per-request pairing, quick-calls-complete-before-large-response ordering, 25 concurrent counter increments serializing to 25, state isolation across two server processes, concurrent stdio + HTTP sessions on one shared HTTP server, `Promise.allSettled` batch isolation), and payload handling (100 KB argument and 1 MB result byte-exact round-trips hashed, 10,000-element array sum, depth-100 nesting, unicode with tabs/newlines, 500 sequential calls within budget). Deterministic env-driven fixture server (`src/__tests__/e2e/fixtures/e2e-server.mjs`) — crash (`E2E_CRASH_ON_TOOL`) / hang (`E2E_HANG_ON_TOOL`) / fail-once (`E2E_FAIL_ONCE`) chaos via env, no randomness. 30 new E2E tests; full suite now 896 tests / 28 suites, added wall time ~9 s.
+
+### Fixed
+- The npm package no longer ships stale compiled test artifacts. `tsc` never cleans `dist/`, so test files compiled by long-ago builds (`dist/__tests__/*.js`, mock-server copies, source maps) lingered and were published in every package despite `src/__tests__` being excluded from compilation for a long time. `npm run build` now runs a `prebuild` clean step (`scripts/clean-dist.mjs`, cross-platform); `npm pack` contains zero `__tests__` files.
+
 ## [1.7.0] - 2026-10-23
 
 ### Added

package/README.md

@@ -589,9 +589,15 @@ mcp-tester/
 │   │   ├── validation.ts        # Input validation
 │   │   ├── stdio-transport.ts   # Node-only stdio loader (stubbed for browser)
 │   │   └── env.ts               # Environment utilities
-│   └── __tests__/               # 866 tests
+│   └── __tests__/               # 896 tests / 28 suites
 │       ├── everything-server.test.ts  # Integration tests (server-everything)
 │       ├── real-server.test.ts        # Integration tests (stdio transport)
+│       ├── e2e/                        # End-to-end tests (real spawned servers, deterministic)
+│       │   ├── fixtures/e2e-server.mjs # Deterministic E2E MCP server fixture
+│       │   ├── lifecycle.e2e.test.ts  # Start/stop, restart, zombie, env, notifications
+│       │   ├── recovery.e2e.test.ts   # Crash, timeout, retry accounting, serverCode
+│       │   ├── concurrency.e2e.test.ts # Fan-out, order, counter integrity, multi-client
+│       │   └── payloads.e2e.test.ts   # 1MB, 10k-array, deep-nest, unicode, 500-seq
 │       ├── websocket-transport.test.ts # WebSocket transport (in-process double)
 │       ├── cli.test.ts                # CLI tool tests
 │       └── fixtures/mock-server.ts    # In-memory mock server

package/docs/testing.md

@@ -21,6 +21,14 @@ src/__tests__/
 ├── advanced.test.ts             # Sampling, elicitation
 ├── real-server.test.ts          # Integration tests (stdio transport)
 ├── everything-server.test.ts    # Full integration (server-everything)
+├── e2e/                         # End-to-end tests (real spawned servers)
+│   ├── helpers.ts               # startE2EClient / stopE2EClient / waitForPidGone
+│   ├── fixtures/
+│   │   └── e2e-server.mjs       # Deterministic E2E MCP server fixture
+│   ├── lifecycle.e2e.test.ts    # Start/stop, restart, zombie, env, notifications
+│   ├── recovery.e2e.test.ts     # Crash, timeout, retry accounting, serverCode
+│   ├── concurrency.e2e.test.ts  # Fan-out, order, counter integrity, multi-client
+│   └── payloads.e2e.test.ts     # 1MB, 10k-array, deep-nest, unicode, 500-seq
 ├── http-transport.test.ts       # Streamable HTTP / SSE transport
 ├── websocket-transport.test.ts  # WebSocket transport (in-process double)
 ├── cli.test.ts                  # CLI tool tests
@@ -28,6 +36,35 @@ src/__tests__/
     └── mock-server.ts           # In-memory mock MCP server
 ```
 
+## End-to-End Tests
+
+The `e2e/` suites spawn **real server processes** over stdio and exercise complete
+workflows: lifecycle, error recovery, concurrency, and large payloads.
+
+The fixture server (`src/__tests__/e2e/fixtures/e2e-server.mjs`) is deterministic —
+chaos is selected purely through environment variables, so tests never sleep-and-pray:
+
+| Env var | Effect |
+| --- | --- |
+| `E2E_CRASH_ON_TOOL=<name>` | Server calls `process.exit(70)` when that tool is invoked |
+| `E2E_HANG_ON_TOOL=<name>` | Server never responds to that tool |
+| `E2E_FAIL_ONCE=<name>` | First call to that tool fails, later calls succeed |
+| `E2E_PID_FILE=<path>` | Server writes its pid to the file at startup |
+| `E2E_TOKEN=<value>` | Value returned by the `env_dump` tool |
+
+Reuse the helpers in your own suites:
+
+```typescript
+import { startE2EClient, stopE2EClient, waitForPidGone } from './e2e/helpers.js';
+
+const client = await startE2EClient({ env: { E2E_TOKEN: 'x' }, timeout: 30_000 });
+// ... callTool / listTools against the real process ...
+await stopE2EClient(client);
+```
+
+Each E2E file raises Jest's per-test timeout to 60 s (process spawns are slow on CI
+runners); the suites add ~9 s to `npm test` end-to-end.
+
 ## Writing Tests
 
 ### Jest

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@slbdn/mcp-tester",
-  "version": "1.7.0",
+  "version": "1.8.0",
   "description": "Minimal MCP client implementation for CI/CD testing of MCP servers",
   "main": "dist/index.js",
   "browser": {
@@ -21,6 +21,7 @@
   ],
   "scripts": {
     "build": "tsc && node scripts/copy-templates.mjs",
+    "prebuild": "node scripts/clean-dist.mjs",
     "predev": "node scripts/copy-templates.mjs",
     "dev": "tsc --watch",
     "docs": "typedoc",