@infersec/conduit 1.68.0 → 1.69.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +15 -14
- package/dist/cli.js +11948 -20019
- package/dist/configuration.d.ts +2 -2
- package/dist/utils/portAllocator.d.ts +1 -0
- package/dist/utils/stripImages.d.ts +1 -0
- package/package.json +1 -1
package/README.md
CHANGED
|
@@ -19,9 +19,9 @@ npx @infersec/conduit inference start --engine <type> --key <api-key> --source <
|
|
|
19
19
|
| Flag | Required | Default | Notes |
|
|
20
20
|
| --------------- | -------- | ------------------------------ | -------------------------------------------------------------------------------------- |
|
|
21
21
|
| `--engine` | Yes | - | Engine type (matches `ENGINE`). |
|
|
22
|
-
| `--engine-port` | No | `
|
|
22
|
+
| `--engine-port` | No | `9700` | Engine port (matches `ENGINE_PORT`). |
|
|
23
23
|
| `--key` | Yes | - | API key (matches `API_KEY`). |
|
|
24
|
-
| `--port` | No | `
|
|
24
|
+
| `--port` | No | `9600` | Port to listen on (matches `PORT`). |
|
|
25
25
|
| `--root` | No | `$HOME/.cache/infersec/iagent` | Root directory (matches `ROOT_DIRECTORY`). |
|
|
26
26
|
| `--source` | Yes | - | Inference source ID (matches `SOURCE`). |
|
|
27
27
|
| `--api-url` | No | `https://api.infersec.ai` | API base URL (matches `API_URL`). |
|
|
@@ -32,20 +32,21 @@ npx @infersec/conduit inference start --engine <type> --key <api-key> --source <
|
|
|
32
32
|
| Scenario | Command |
|
|
33
33
|
| ------------------ | ---------------------------------------------------------------------------------------------------------------------------- |
|
|
34
34
|
| Required only | `npx @infersec/conduit inference start --engine vllm --key <api-key> --source <source-id>` |
|
|
35
|
-
| Custom root/port | `npx @infersec/conduit inference start --engine vllm --key <api-key> --source <source-id> --root /data/infersec --port
|
|
36
|
-
| Custom engine/port | `npx @infersec/conduit inference start --engine vllm --key <api-key> --source <source-id> --port
|
|
35
|
+
| Custom root/port | `npx @infersec/conduit inference start --engine vllm --key <api-key> --source <source-id> --root /data/infersec --port 9601` |
|
|
36
|
+
| Custom engine/port | `npx @infersec/conduit inference start --engine vllm --key <api-key> --source <source-id> --port 9601 --engine-port 9701` |
|
|
37
37
|
|
|
38
38
|
## Environment variables
|
|
39
39
|
|
|
40
|
-
| Variable | Required | Default | Notes
|
|
41
|
-
| ---------------- | -------- | ------------------------------ |
|
|
42
|
-
| `
|
|
43
|
-
| `
|
|
44
|
-
| `
|
|
45
|
-
| `
|
|
46
|
-
| `
|
|
47
|
-
| `
|
|
48
|
-
| `
|
|
49
|
-
| `
|
|
40
|
+
| Variable | Required | Default | Notes |
|
|
41
|
+
| ---------------- | -------- | ------------------------------ | ---------------------------------------------------------------------------- |
|
|
42
|
+
| `AUTO_PORTS` | No | `false` | Auto-allocate conduit and engine ports. Conflicts with `PORT`/`ENGINE_PORT`. |
|
|
43
|
+
| `ENGINE` | Yes | - | Engine type (matches `--engine`). |
|
|
44
|
+
| `ENGINE_PORT` | No | `9700` | Engine port (matches `--engine-port`). |
|
|
45
|
+
| `API_KEY` | Yes | - | API key (matches `--key`). |
|
|
46
|
+
| `SOURCE` | Yes | - | Inference source ID (matches `--source`). |
|
|
47
|
+
| `API_URL` | No | `https://api.infersec.ai` | API base URL (matches `--api-url`). |
|
|
48
|
+
| `PORT` | No | `9600` | Port to listen on (matches `--port`). |
|
|
49
|
+
| `ROOT_DIRECTORY` | No | `$HOME/.cache/infersec/iagent` | Root directory (matches `--root`). |
|
|
50
|
+
| `START_MODE` | No | `auto` | Startup mode (matches `--start-mode`). |
|
|
50
51
|
|
|
51
52
|
CLI flags override environment variables when both are provided.
|