prompt-injection-bench 1.0.1

package/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2025 prompt-injection-bench contributors
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

package/README.md

@@ -0,0 +1,174 @@
+# prompt-injection-bench
+
+[![npm version](https://img.shields.io/npm/v/prompt-injection-bench.svg)](https://www.npmjs.com/package/prompt-injection-bench)
+[![License: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](https://github.com/reaatech/prompt-injection-bench/blob/main/LICENSE)
+[![CI](https://img.shields.io/github/actions/workflow/status/reaatech/prompt-injection-bench/ci.yml?branch=main&label=CI)](https://github.com/reaatech/prompt-injection-bench/actions/workflows/ci.yml)
+
+> **Status:** Pre-1.0 — APIs may change in minor versions. Pin to a specific version in production.
+
+Umbrella package and CLI for the prompt-injection-bench suite. Re-exports the full public API from all `@reaatech/pi-bench-*` packages and provides the `prompt-injection-bench` CLI for running benchmarks from the command line.
+
+## Installation
+
+```bash
+npm install prompt-injection-bench
+# or
+pnpm add prompt-injection-bench
+```
+
+```bash
+# Global install for CLI usage
+npm install -g prompt-injection-bench
+```
+
+## Feature Overview
+
+- **Full API re-export** — Single import for all `@reaatech/pi-bench-*` packages
+- **CLI tool** — `prompt-injection-bench` command with 6 subcommands
+- **9 adapters** — All defense adapters available via `--defense` flag
+- **Dual ESM/CJS output** — works with `import` and `require`
+
+## CLI Quick Start
+
+```bash
+# Run a benchmark with the mock adapter
+prompt-injection-bench benchmark --defense mock
+
+# Compare two defense results
+prompt-injection-bench compare --results rebuff.json lakera.json
+
+# View leaderboard
+prompt-injection-bench leaderboard view
+
+# Generate an HTML report
+prompt-injection-bench report --results latest.json --format html --output report.html
+```
+
+## CLI Commands
+
+### `benchmark`
+
+Run a full benchmark against a defense adapter:
+
+```bash
+prompt-injection-bench benchmark \
+  --defense rebuff \
+  --corpus default \
+  --categories direct-injection,role-playing \
+  --parallel 10 \
+  --timeout 30000 \
+  --output results/benchmark.json
+```
+
+| Flag | Description |
+|------|-------------|
+| `--defense` | Defense adapter name (mock, rebuff, lakera, llm-guard, garak, moderation-openai, etc.) |
+| `--corpus` | Corpus source: `default` or path to corpus directory |
+| `--categories` | Comma-separated attack categories (default: all) |
+| `--parallel` | Max parallel attack executions (default: 10) |
+| `--timeout` | Per-attack timeout in ms (default: 30000) |
+| `--output` | JSON output file path |
+
+### `attack`
+
+Run attacks from a single category:
+
+```bash
+prompt-injection-bench attack \
+  --category direct-injection \
+  --defense mock \
+  --count 100
+```
+
+### `compare`
+
+Compare two defense result files:
+
+```bash
+prompt-injection-bench compare \
+  --results results/rebuff.json results/lakera.json \
+  --significance 0.05
+```
+
+### `corpus`
+
+Manage attack corpora:
+
+```bash
+# List available categories
+prompt-injection-bench corpus list
+
+# Generate a new corpus
+prompt-injection-bench corpus generate --output corpus/v2026.05
+
+# Validate an existing corpus
+prompt-injection-bench corpus validate --input corpus/v2026.04
+
+# Export corpus to JSON
+prompt-injection-bench corpus export --input corpus/v2026.04 --format json
+```
+
+### `leaderboard`
+
+View and manage the leaderboard:
+
+```bash
+prompt-injection-bench leaderboard view
+prompt-injection-bench leaderboard submit \
+  --results results/latest.json \
+  --defense my-defense \
+  --version 1.0.0
+```
+
+### `report`
+
+Generate reports from benchmark results:
+
+```bash
+prompt-injection-bench report \
+  --results results/latest.json \
+  --format html \
+  --output reports/benchmark.html
+```
+
+Supported formats: `json`, `html`, `markdown`.
+
+## Library Quick Start
+
+```typescript
+import { createBenchmarkEngine, createMockAdapter, generateDefaultCorpus } from "prompt-injection-bench";
+
+const adapter = createMockAdapter(0.95, 0.03);
+const corpus = generateDefaultCorpus();
+const engine = createBenchmarkEngine({ defense: adapter });
+
+const result = await engine.runBenchmark(corpus);
+console.log(`Detection rate: ${(result.attackResults.filter(r => r.detected).length / result.attackResults.length * 100).toFixed(1)}%`);
+```
+
+## Re-exported Packages
+
+| Package | Description |
+|---------|-------------|
+| `@reaatech/pi-bench-core` | Core types, taxonomy, Zod schemas |
+| `@reaatech/pi-bench-observability` | Logging, tracing, and metrics |
+| `@reaatech/pi-bench-corpus` | Corpus builder, validator, template engine |
+| `@reaatech/pi-bench-adapters` | Defense adapter implementations |
+| `@reaatech/pi-bench-scoring` | Scoring engine and statistical analysis |
+| `@reaatech/pi-bench-runner` | Benchmark execution engine |
+| `@reaatech/pi-bench-leaderboard` | Leaderboard management |
+| `@reaatech/pi-bench-mcp-server` | MCP server and reproducibility tools |
+
+## Related Packages
+
+Each package can also be installed individually:
+
+```bash
+pnpm add @reaatech/pi-bench-core
+pnpm add @reaatech/pi-bench-adapters
+pnpm add @reaatech/pi-bench-scoring
+```
+
+## License
+
+[MIT](https://github.com/reaatech/prompt-injection-bench/blob/main/LICENSE)