@infersec/conduit 1.42.3 → 1.43.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +12 -6
- package/dist/cli.js +124783 -118
- package/dist/commands/inference.d.ts +6 -0
- package/package.json +5 -5
- package/dist/index.d.ts +0 -1
- package/dist/index.js +0 -65
- package/dist/start-DvCDrX-V.js +0 -120618
package/README.md
CHANGED
|
@@ -5,9 +5,15 @@ Conduit agent for connecting local LLMs to the Infersec cloud.
|
|
|
5
5
|
## Usage
|
|
6
6
|
|
|
7
7
|
```bash
|
|
8
|
-
npx @infersec/conduit --engine <type> --key <api-key> --source <source-id>
|
|
8
|
+
npx @infersec/conduit inference start --engine <type> --key <api-key> --source <source-id>
|
|
9
9
|
```
|
|
10
10
|
|
|
11
|
+
### Commands
|
|
12
|
+
|
|
13
|
+
| Command | Description |
|
|
14
|
+
| ----------------- | ------------------------- |
|
|
15
|
+
| `inference start` | Start the inference agent |
|
|
16
|
+
|
|
11
17
|
### Flags
|
|
12
18
|
|
|
13
19
|
| Flag | Required | Default | Notes |
|
|
@@ -23,11 +29,11 @@ npx @infersec/conduit --engine <type> --key <api-key> --source <source-id>
|
|
|
23
29
|
|
|
24
30
|
### Examples
|
|
25
31
|
|
|
26
|
-
| Scenario | Command
|
|
27
|
-
| ------------------ |
|
|
28
|
-
| Required only | `npx @infersec/conduit --engine vllm --key <api-key> --source <source-id>` |
|
|
29
|
-
| Custom root/port | `npx @infersec/conduit --engine vllm --key <api-key> --source <source-id> --root /data/infersec --port 9506` |
|
|
30
|
-
| Custom engine/port | `npx @infersec/conduit --engine vllm --key <api-key> --source <source-id> --port 9506 --engine-port 8989` |
|
|
32
|
+
| Scenario | Command |
|
|
33
|
+
| ------------------ | ---------------------------------------------------------------------------------------------------------------------------- |
|
|
34
|
+
| Required only | `npx @infersec/conduit inference start --engine vllm --key <api-key> --source <source-id>` |
|
|
35
|
+
| Custom root/port | `npx @infersec/conduit inference start --engine vllm --key <api-key> --source <source-id> --root /data/infersec --port 9506` |
|
|
36
|
+
| Custom engine/port | `npx @infersec/conduit inference start --engine vllm --key <api-key> --source <source-id> --port 9506 --engine-port 8989` |
|
|
31
37
|
|
|
32
38
|
## Environment variables
|
|
33
39
|
|