llmasaservice-client 0.0.2 → 0.0.3
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +6 -0
- package/README.md +6 -4
- package/package.json +1 -1
package/CHANGELOG.md
CHANGED
package/README.md
CHANGED
|
@@ -1,4 +1,6 @@
|
|
|
1
1
|
# LLMAsAService.io for Client Side Code
|
|
2
|
+
|
|
3
|
+
Control panel: ([app.llmasaservice.io](https://app.llmasaservice.io))
|
|
2
4
|
A product by CASEy, Inc ([heycasey.io](https://heycasey.io))
|
|
3
5
|
|
|
4
6
|
## What is LLMAsAService.io?
|
|
@@ -54,11 +56,11 @@ The settings you need are the same settings you would pass to the vendor using t
|
|
|
54
56
|
|
|
55
57
|
After logging into the control panel, choose LLMServices from the right panel menu
|
|
56
58
|
|
|
57
|
-
|
|
59
|
+
|
|
58
60
|
|
|
59
61
|
1. Click the Add Service box to create your first or another LLM Service Endpoint
|
|
60
62
|
|
|
61
|
-
|
|
63
|
+
|
|
62
64
|
|
|
63
65
|
2. Name and choose your Vendor. We will boilerplate that vendors endpoint URL, header and body as a starting point. These will vary based on your needs and the vendor chosen (we are documenting each vendor now, until then email us if you have difficulty). Tip: We use the streaming features for each vendor. So, make sure that the streaming options are enabled. For example, for OpenAI add these at the end of the rest of the body JSON:
|
|
64
66
|
|
|
@@ -92,11 +94,11 @@ Bad (no quotes on names, and trailing , before ending brace):
|
|
|
92
94
|
6. Click on the Edit button for the new service. The Add or Update API Key and Test buttons will now be enabled. Click **Add or Update API Key**
|
|
93
95
|
7. We properly encrypt and save your API key (we cannot retrieve it for you, if lost, create a new key from your vendor). Get the API key from your LLM Vendor's developer control panel and paste it into the dialog box and click Save. (one of the advantages of using LLMAsAService is that safe key management is in one place, we found this convenient and safer than using command line tools and config files)
|
|
94
96
|
|
|
95
|
-
|
|
97
|
+
|
|
96
98
|
|
|
97
99
|
8. Make a test call. Click the **Test Call** button and confirm you get a response
|
|
98
100
|
|
|
99
|
-
|
|
101
|
+
|
|
100
102
|
|
|
101
103
|
Repeat those steps for your other providers and configurations (one n north america, one in the EU, one for Azure or Anthropic, etc.)
|
|
102
104
|
|