@telnyx/voice-agent-tester 0.2.1 → 0.2.3

package/CHANGELOG.md

@@ -1,5 +1,13 @@
 # Changelog
 
+## [0.2.3](https://github.com/team-telnyx/voice-agent-tester/compare/v0.2.2...v0.2.3) (2026-01-21)
+
+### Features
+
+* resolve cli config files via npm cli usage ([2b12952](https://github.com/team-telnyx/voice-agent-tester/commit/2b1295284f7dff6f2a91df743b69f7905246d97b))
+
+## [0.2.2](https://github.com/team-telnyx/voice-agent-tester/compare/v0.2.1...v0.2.2) (2026-01-20)
+
 ## [0.2.1](https://github.com/team-telnyx/voice-agent-tester/compare/v0.2.0...v0.2.1) (2026-01-20)
 
 ### Features

package/README.md

@@ -16,67 +16,70 @@ npm install -g @telnyx/voice-agent-tester
 ## Quick Start
 
 ```bash
-voice-agent-tester --help
+voice-agent-tester -a benchmarks/applications/telnyx.yaml -s benchmarks/scenarios/appointment.yaml --assistant-id <YOUR_ASSISTANT_ID>
 ```
 
+The CLI includes bundled application and scenario configs that you can use directly.
+
 ## CLI Options
 
 | Option | Description |
 |--------|-------------|
-| `-a, --applications` | Application config paths (required) |
-| `-s, --scenarios` | Scenario config paths (required) |
-| `--assistant-id` | Telnyx assistant ID for direct benchmarking |
-| `--agent-id` | ElevenLabs agent ID for direct benchmarking |
+| `-a, --applications` | Application config path(s) (required) |
+| `-s, --scenarios` | Scenario config path(s) (required) |
+| `--assistant-id` | Telnyx assistant ID |
+| `--agent-id` | ElevenLabs agent ID |
 | `--branch-id` | ElevenLabs branch ID |
-| `--share-key` | Vapi share key for embedded widget |
-| `--api-key` | Telnyx API key for authentication |
+| `--share-key` | Vapi share key |
+| `--api-key` | Telnyx API key |
 | `--provider` | Import from external provider (`vapi`, `elevenlabs`, `retell`) |
-| `--provider-api-key` | External provider API key (required with `--provider`) |
+| `--provider-api-key` | External provider API key |
 | `--provider-import-id` | Provider assistant/agent ID to import |
-| `--params` | Additional URL template params (e.g., `--params key=value`) |
-| `--debug` | Enable detailed timeout diagnostics with WebRTC stats |
+| `--params` | Additional URL template params |
+| `--debug` | Enable detailed timeout diagnostics |
 | `--headless` | Run browser in headless mode (default: true) |
-| `--repeat` | Number of repetitions per combination |
+| `--repeat` | Number of repetitions |
 | `-v, --verbose` | Show browser console logs |
 
+## Bundled Configs
+
+The following application configs are included:
+
+| Config | Provider |
+|--------|----------|
+| `benchmarks/applications/telnyx.yaml` | Telnyx AI Widget |
+| `benchmarks/applications/elevenlabs.yaml` | ElevenLabs |
+| `benchmarks/applications/vapi.yaml` | Vapi |
+
+Scenario configs:
+- `benchmarks/scenarios/appointment.yaml` - Appointment scheduling test
+
 ## Usage Examples
 
 ### Telnyx Assistant
 
 ```bash
-voice-agent-tester -a apps/telnyx.yaml -s scenarios/test.yaml --assistant-id <TELNYX_ASSISTANT_ID>
+voice-agent-tester -a benchmarks/applications/telnyx.yaml -s benchmarks/scenarios/appointment.yaml --assistant-id <TELNYX_ASSISTANT_ID>
 ```
 
 ### ElevenLabs Agent
 
 ```bash
-voice-agent-tester -a apps/elevenlabs.yaml -s scenarios/test.yaml --agent-id <ELEVENLABS_AGENT_ID> --branch-id <BRANCH_ID>
+voice-agent-tester -a benchmarks/applications/elevenlabs.yaml -s benchmarks/scenarios/appointment.yaml --agent-id <ELEVENLABS_AGENT_ID> --branch-id <BRANCH_ID>
 ```
 
 ### Vapi Assistant
 
 ```bash
-voice-agent-tester -a apps/vapi.yaml -s scenarios/test.yaml --assistant-id <VAPI_ASSISTANT_ID> --share-key <SHARE_KEY>
+voice-agent-tester -a benchmarks/applications/vapi.yaml -s benchmarks/scenarios/appointment.yaml --assistant-id <VAPI_ASSISTANT_ID> --share-key <SHARE_KEY>
 ```
 
 ### Import from Provider to Telnyx
 
-Import an assistant from Vapi/ElevenLabs/Retell into Telnyx and benchmark:
-
 ```bash
-voice-agent-tester -a apps/telnyx.yaml -s scenarios/test.yaml --provider vapi --api-key <TELNYX_API_KEY> --provider-api-key <VAPI_API_KEY> --provider-import-id <VAPI_ASSISTANT_ID>
+voice-agent-tester -a benchmarks/applications/telnyx.yaml -s benchmarks/scenarios/appointment.yaml --provider vapi --api-key <TELNYX_API_KEY> --provider-api-key <VAPI_API_KEY> --provider-import-id <VAPI_ASSISTANT_ID>
 ```
 
-## Multi-Provider Support
-
-- **Direct benchmarking**: Use provider-specific options (`--assistant-id`, `--agent-id`, `--share-key`)
-- **Provider import**: Import assistants from Vapi/ElevenLabs/Retell into Telnyx via `--provider`
-- **Auto-configuration**: Automatic integration secret management and web call enablement
-
-## Debug & Diagnostics
-
-When `--debug` is enabled, timeout events include WebRTC RTP statistics (packets received, bytes transferred, jitter, packet loss).
-
 ## License
 
 MIT

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@telnyx/voice-agent-tester",
-  "version": "0.2.1",
+  "version": "0.2.3",
   "description": "A command-line tool to test voice agents using Puppeteer",
   "main": "src/index.js",
   "type": "module",

package/src/index.js

@@ -14,14 +14,25 @@ import { importAssistantsFromProvider, getAssistant, enableWebCalls, SUPPORTED_P
 
 const __filename = fileURLToPath(import.meta.url);
 const __dirname = path.dirname(__filename);
+const __packageDir = path.resolve(__dirname, '..');
 
 // Helper function to resolve file paths from comma-separated input or folder
+// First tries to resolve relative to cwd, then falls back to package directory
 function resolveConfigPaths(input) {
   const paths = [];
   const items = input.split(',').map(s => s.trim());
 
   for (const item of items) {
-    const resolvedPath = path.resolve(item);
+    // Try resolving relative to current working directory first
+    let resolvedPath = path.resolve(item);
+    
+    // If not found in cwd, try resolving relative to package directory
+    if (!fs.existsSync(resolvedPath)) {
+      const packagePath = path.resolve(__packageDir, item);
+      if (fs.existsSync(packagePath)) {
+        resolvedPath = packagePath;
+      }
+    }
 
     if (fs.existsSync(resolvedPath)) {
       const stat = fs.statSync(resolvedPath);
@@ -36,7 +47,7 @@ function resolveConfigPaths(input) {
         paths.push(resolvedPath);
       }
     } else {
-      throw new Error(`Path not found: ${resolvedPath}`);
+      throw new Error(`Path not found: ${item}`);
     }
   }