@isdk/ai-tool 0.5.2 → 0.5.3
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/dist/funcs.js +1 -1
- package/dist/index.js +1 -1
- package/docs/README.md +250 -0
- package/docs/_media/CONTRIBUTING.md +18 -0
- package/docs/_media/LICENSE-MIT +22 -0
- package/docs/classes/AbortError.md +366 -0
- package/docs/classes/AlreadyExistsError.md +346 -0
- package/docs/classes/BaseError.md +359 -0
- package/docs/classes/BinarySemaphore.md +418 -0
- package/docs/classes/CancelableAbility.md +467 -0
- package/docs/classes/ClientTools.md +2715 -0
- package/docs/classes/CommonError.md +377 -0
- package/docs/classes/ConfigFile.md +353 -0
- package/docs/classes/EnvPromptTemplate.md +1158 -0
- package/docs/classes/EventClient.md +3149 -0
- package/docs/classes/EventEmitter.md +299 -0
- package/docs/classes/EventServer.md +3175 -0
- package/docs/classes/EventToolFunc.md +2557 -0
- package/docs/classes/FStringPromptTemplate.md +1158 -0
- package/docs/classes/FewShotPromptTemplate.md +1180 -0
- package/docs/classes/GolangPromptTemplate.md +1158 -0
- package/docs/classes/HFEnvironment.md +184 -0
- package/docs/classes/HFInterpreter.md +77 -0
- package/docs/classes/HFTemplate.md +67 -0
- package/docs/classes/HfPromptTemplate.md +1158 -0
- package/docs/classes/IntSet.md +216 -0
- package/docs/classes/LRUCache.md +601 -0
- package/docs/classes/NotFoundError.md +346 -0
- package/docs/classes/NotImplementationError.md +346 -0
- package/docs/classes/PromptExampleSelector.md +195 -0
- package/docs/classes/PromptTemplate.md +1088 -0
- package/docs/classes/ReadableStreamError.md +366 -0
- package/docs/classes/ResClientTools.md +2431 -0
- package/docs/classes/ResServerTools.md +2407 -0
- package/docs/classes/SSEChannel.md +270 -0
- package/docs/classes/Semaphore.md +538 -0
- package/docs/classes/ServerTools.md +2623 -0
- package/docs/classes/SignalGate.md +182 -0
- package/docs/classes/TaskAbortController.md +131 -0
- package/docs/classes/ToolFunc.md +2177 -0
- package/docs/classes/YamlTypeBaseObject.md +31 -0
- package/docs/enumerations/AsyncFeatureBits.md +33 -0
- package/docs/enumerations/AsyncFeatures.md +33 -0
- package/docs/enumerations/ErrorCode.md +177 -0
- package/docs/enumerations/HashAlgorithm.md +97 -0
- package/docs/functions/AIArgProcessor.md +33 -0
- package/docs/functions/AIStream.md +52 -0
- package/docs/functions/ChoiceArgProcessor.md +33 -0
- package/docs/functions/ObjectArgsToArgsInfo.md +29 -0
- package/docs/functions/RateLimit.md +37 -0
- package/docs/functions/TemplateArgProcessor.md +33 -0
- package/docs/functions/assignDirs.md +33 -0
- package/docs/functions/backendEventable.md +29 -0
- package/docs/functions/beforeShutdown.md +29 -0
- package/docs/functions/canonicalize.md +21 -0
- package/docs/functions/completeSentences.md +25 -0
- package/docs/functions/concatText.md +25 -0
- package/docs/functions/countLLMTokens.md +25 -0
- package/docs/functions/countRegexMatches.md +35 -0
- package/docs/functions/createAbilityInjector.md +119 -0
- package/docs/functions/createCallbacksTransformer.md +49 -0
- package/docs/functions/createEmptyReadableStream.md +21 -0
- package/docs/functions/createEndWithRepetitionDetector.md +31 -0
- package/docs/functions/createError.md +39 -0
- package/docs/functions/createEventStreamTransformer.md +33 -0
- package/docs/functions/createHfValueFunc.md +31 -0
- package/docs/functions/createLRUCache.md +25 -0
- package/docs/functions/createYamlObjectTag.md +25 -0
- package/docs/functions/dateToText.md +25 -0
- package/docs/functions/decodeCharset.md +25 -0
- package/docs/functions/detectCharset.md +25 -0
- package/docs/functions/encodeLLMTokens.md +25 -0
- package/docs/functions/ensureQuoted.md +25 -0
- package/docs/functions/eventable.md +82 -0
- package/docs/functions/expandConfig.md +25 -0
- package/docs/functions/expandEnv.md +40 -0
- package/docs/functions/expandObjEnv.md +58 -0
- package/docs/functions/expandPath.md +25 -0
- package/docs/functions/extNameLevel.md +43 -0
- package/docs/functions/fileIsExists.md +34 -0
- package/docs/functions/filenameReservedRegex.md +20 -0
- package/docs/functions/filterValidFnScope.md +21 -0
- package/docs/functions/findIndexNonEmptyFrom.md +25 -0
- package/docs/functions/findPort.md +25 -0
- package/docs/functions/formatISO.md +69 -0
- package/docs/functions/formatTextWithSpace.md +63 -0
- package/docs/functions/getAllEnumKeys.md +31 -0
- package/docs/functions/getConfigFileNames.md +25 -0
- package/docs/functions/getConfigs.md +25 -0
- package/docs/functions/getEnvVairables.md +21 -0
- package/docs/functions/getFileMetaInfo.md +21 -0
- package/docs/functions/getHashAlgoBySize.md +21 -0
- package/docs/functions/getKeysPath.md +38 -0
- package/docs/functions/getLLMTokenizer.md +21 -0
- package/docs/functions/getMultiLevelExtname.md +33 -0
- package/docs/functions/getPackageDir.md +39 -0
- package/docs/functions/getRealFilepath.md +34 -0
- package/docs/functions/getResponseErrorReadableStream.md +21 -0
- package/docs/functions/getXDGConfigs.md +37 -0
- package/docs/functions/hasDirectoryIn.md +40 -0
- package/docs/functions/hash.md +25 -0
- package/docs/functions/hashFile.md +25 -0
- package/docs/functions/hashStream.md +25 -0
- package/docs/functions/hfParse.md +24 -0
- package/docs/functions/hfTokenize.md +27 -0
- package/docs/functions/initShutdown.md +15 -0
- package/docs/functions/interpolateEnv.md +29 -0
- package/docs/functions/interpolateFString.md +29 -0
- package/docs/functions/interpolateGolangTemplate.md +35 -0
- package/docs/functions/isLangUsingSpaces.md +21 -0
- package/docs/functions/isListItemString.md +21 -0
- package/docs/functions/isModelNameMatched.md +47 -0
- package/docs/functions/isPunctuationChar.md +36 -0
- package/docs/functions/isQuoted.md +21 -0
- package/docs/functions/isRegExp.md +21 -0
- package/docs/functions/isSameString.md +36 -0
- package/docs/functions/isSectionString.md +25 -0
- package/docs/functions/isSentenceEnding.md +21 -0
- package/docs/functions/isSepLineString.md +21 -0
- package/docs/functions/isStrWrapped.md +25 -0
- package/docs/functions/isSubdirectory.md +41 -0
- package/docs/functions/isTitleString.md +25 -0
- package/docs/functions/isValidFilename.md +38 -0
- package/docs/functions/isValidFilepath.md +27 -0
- package/docs/functions/isWebStream.md +21 -0
- package/docs/functions/jsonFilterToWhere.md +47 -0
- package/docs/functions/jsonToMarkdownStr.md +39 -0
- package/docs/functions/loadAIConfig.md +21 -0
- package/docs/functions/loadConfig.md +25 -0
- package/docs/functions/loadConfigFile.md +25 -0
- package/docs/functions/loadFileFromPaths.md +64 -0
- package/docs/functions/loadTextFromPaths.md +37 -0
- package/docs/functions/lrucache.md +35 -0
- package/docs/functions/makeToolFuncCancelable.md +29 -0
- package/docs/functions/matchUrlProtocol.md +48 -0
- package/docs/functions/memoize.md +29 -0
- package/docs/functions/messagesToText.md +21 -0
- package/docs/functions/paramsSizeToScaleStr.md +34 -0
- package/docs/functions/parseCommand.md +29 -0
- package/docs/functions/parseDateFormat.md +362 -0
- package/docs/functions/parseFString.md +26 -0
- package/docs/functions/parseISO.md +70 -0
- package/docs/functions/parseJsJson.md +40 -0
- package/docs/functions/parseJsJsonSimpleSync.md +25 -0
- package/docs/functions/parseObjectArgInfo.md +33 -0
- package/docs/functions/parseObjectArgumentInfos.md +29 -0
- package/docs/functions/parseObjectArguments.md +72 -0
- package/docs/functions/parseObjectArgumentsAsArgInfos.md +46 -0
- package/docs/functions/parseYaml.md +25 -0
- package/docs/functions/quoteStr.md +21 -0
- package/docs/functions/reControlCharsRegex.md +19 -0
- package/docs/functions/readFilenamesRecursiveSync.md +53 -0
- package/docs/functions/readTextFileChunks.md +53 -0
- package/docs/functions/readTextFileChunksEx.md +25 -0
- package/docs/functions/readableFromAsyncIterable.md +28 -0
- package/docs/functions/registerCoreTools.md +15 -0
- package/docs/functions/registerYamlTag.md +21 -0
- package/docs/functions/removeMarkdownBold.md +25 -0
- package/docs/functions/removeMarkdownBoldAndItalic.md +25 -0
- package/docs/functions/removeMarkdownItalic.md +25 -0
- package/docs/functions/replaceWithPlaceholder.md +43 -0
- package/docs/functions/restoreFromPlacehoders.md +49 -0
- package/docs/functions/sanitizeFilename.md +39 -0
- package/docs/functions/sanitizeFilepath.md +33 -0
- package/docs/functions/saveConfigFile.md +29 -0
- package/docs/functions/scaleStrToParamsSize.md +27 -0
- package/docs/functions/shutdown.md +33 -0
- package/docs/functions/simplifyObjectArguments.md +21 -0
- package/docs/functions/sortedValues.md +25 -0
- package/docs/functions/splitChunks.md +25 -0
- package/docs/functions/splitParagraph.md +34 -0
- package/docs/functions/splitSentence.md +39 -0
- package/docs/functions/stringifyYaml.md +25 -0
- package/docs/functions/stripConsoleColor.md +21 -0
- package/docs/functions/textToDate.md +25 -0
- package/docs/functions/throwError.md +41 -0
- package/docs/functions/toDate.md +74 -0
- package/docs/functions/toDateTime.md +21 -0
- package/docs/functions/toRegExp.md +34 -0
- package/docs/functions/trimStartOfStreamHelper.md +41 -0
- package/docs/functions/truncTo.md +51 -0
- package/docs/functions/truncateByToken.md +25 -0
- package/docs/functions/truncateToTokenLimit.md +46 -0
- package/docs/functions/truncateToTokenLimitEx.md +25 -0
- package/docs/functions/uuid.md +25 -0
- package/docs/functions/uuidParse.md +21 -0
- package/docs/functions/uuidStringify.md +25 -0
- package/docs/functions/uuidValidate.md +21 -0
- package/docs/functions/uuidVersion.md +21 -0
- package/docs/functions/uuidv1.md +55 -0
- package/docs/functions/uuidv4.md +55 -0
- package/docs/functions/uuidv5.md +63 -0
- package/docs/functions/wait.md +21 -0
- package/docs/functions/wrapEventEmitter.md +27 -0
- package/docs/functions/xxhash.md +29 -0
- package/docs/functions/xxhash32.md +25 -0
- package/docs/functions/xxhash64.md +25 -0
- package/docs/functions/xxhashAsStr.md +29 -0
- package/docs/globals.md +329 -0
- package/docs/interfaces/AIChatAssistantMessageParam.md +129 -0
- package/docs/interfaces/AIChatContentPartImage.md +29 -0
- package/docs/interfaces/AIChatContentPartText.md +25 -0
- package/docs/interfaces/AIChatMessageParamBase.md +68 -0
- package/docs/interfaces/AIChatMessageToolCall.md +41 -0
- package/docs/interfaces/AIChatSystemMessageParam.md +105 -0
- package/docs/interfaces/AIChatToolChoiceFuncObject.md +37 -0
- package/docs/interfaces/AIChatToolChoiceObject.md +25 -0
- package/docs/interfaces/AIChatToolFunc.md +41 -0
- package/docs/interfaces/AIChatToolFuncParam.md +37 -0
- package/docs/interfaces/AIChatToolMessageParam.md +113 -0
- package/docs/interfaces/AIChatToolParam.md +25 -0
- package/docs/interfaces/AIChatToolTypeObject.md +17 -0
- package/docs/interfaces/AIChatUserMessageParam.md +137 -0
- package/docs/interfaces/AIChoiceConfig.md +65 -0
- package/docs/interfaces/AIResult.md +65 -0
- package/docs/interfaces/AIStreamParser.md +43 -0
- package/docs/interfaces/AIStreamParserOptions.md +21 -0
- package/docs/interfaces/BaseFunc.md +145 -0
- package/docs/interfaces/BaseFuncItem.md +93 -0
- package/docs/interfaces/BinarySemaphoreAcquireOptions.md +25 -0
- package/docs/interfaces/BinarySemaphoreOptions.md +57 -0
- package/docs/interfaces/BinarySemaphoreReleaseOptions.md +25 -0
- package/docs/interfaces/BinarySemaphoreReleaserFunc.md +37 -0
- package/docs/interfaces/CancelableAbilityOptions.md +113 -0
- package/docs/interfaces/ClientFuncItem.md +163 -0
- package/docs/interfaces/DotenvExpandOptions.md +43 -0
- package/docs/interfaces/DotenvExpandOutput.md +25 -0
- package/docs/interfaces/DotenvParseInput.md +13 -0
- package/docs/interfaces/DotenvParseOutput.md +13 -0
- package/docs/interfaces/DotenvPopulateInput.md +13 -0
- package/docs/interfaces/EventClientFuncParams.md +51 -0
- package/docs/interfaces/EventServerFuncParams.md +67 -0
- package/docs/interfaces/FewShotPromptTemplateOptions.md +147 -0
- package/docs/interfaces/FuncItem.md +131 -0
- package/docs/interfaces/FuncParam.md +61 -0
- package/docs/interfaces/FuncParams.md +13 -0
- package/docs/interfaces/Funcs.md +13 -0
- package/docs/interfaces/HashAlgoParams.md +33 -0
- package/docs/interfaces/IFileMetaInfo.md +65 -0
- package/docs/interfaces/IReadTextFileChunksOptions.md +143 -0
- package/docs/interfaces/ITruncateToTokenLimitOptions.md +99 -0
- package/docs/interfaces/JsonFilter.md +13 -0
- package/docs/interfaces/ParseObjectArgumentOptions.md +89 -0
- package/docs/interfaces/PromptExampleSelectorOptions.md +34 -0
- package/docs/interfaces/PromptTemplateOptions.md +65 -0
- package/docs/interfaces/RemoteFuncItem.md +152 -0
- package/docs/interfaces/ReplacePlacehoderOptions.md +41 -0
- package/docs/interfaces/ResClientFuncParams.md +37 -0
- package/docs/interfaces/ResServerFuncParams.md +69 -0
- package/docs/interfaces/SanitizeFilenameOptions.md +25 -0
- package/docs/interfaces/SectionStringOptions.md +25 -0
- package/docs/interfaces/SemaphoreOptions.md +89 -0
- package/docs/interfaces/SemaphoreTaskItem.md +73 -0
- package/docs/interfaces/ServerFuncItem.md +171 -0
- package/docs/interfaces/ServerFuncParams.md +35 -0
- package/docs/interfaces/SplitSentenceOptions.md +41 -0
- package/docs/interfaces/StreamCallbacksAndOptions.md +99 -0
- package/docs/interfaces/TaskAbortControllers.md +13 -0
- package/docs/interfaces/TaskPromise.md +138 -0
- package/docs/interfaces/ToolFuncPackage.md +47 -0
- package/docs/namespaces/EventStates/README.md +14 -0
- package/docs/namespaces/EventStates/variables/ABORT.md +11 -0
- package/docs/namespaces/EventStates/variables/CONTINUE.md +11 -0
- package/docs/namespaces/EventStates/variables/DONE.md +11 -0
- package/docs/namespaces/EventStates/variables/STOPPED.md +11 -0
- package/docs/namespaces/uuidv5/README.md +12 -0
- package/docs/namespaces/uuidv5/variables/DNS.md +11 -0
- package/docs/namespaces/uuidv5/variables/URL.md +11 -0
- package/docs/type-aliases/AIChatContentPart.md +11 -0
- package/docs/type-aliases/AIChatMessageParam.md +11 -0
- package/docs/type-aliases/AIChatRole.md +11 -0
- package/docs/type-aliases/AIChatToolChoiceParam.md +11 -0
- package/docs/type-aliases/AIMessageType.md +11 -0
- package/docs/type-aliases/AIModelNameRule.md +11 -0
- package/docs/type-aliases/AIModelNameRuleFn.md +21 -0
- package/docs/type-aliases/AIModelNameRules.md +11 -0
- package/docs/type-aliases/AITextGenerationFinishReason.md +11 -0
- package/docs/type-aliases/ActionName.md +11 -0
- package/docs/type-aliases/AsyncTaskId.md +11 -0
- package/docs/type-aliases/BeforeShutdownListener.md +23 -0
- package/docs/type-aliases/EventErrorListenerFn.md +33 -0
- package/docs/type-aliases/EventListenerFn.md +29 -0
- package/docs/type-aliases/FStringPromptTemplateNode.md +14 -0
- package/docs/type-aliases/FuncParamType.md +11 -0
- package/docs/type-aliases/PromptExamples.md +15 -0
- package/docs/type-aliases/PromptTemplateType.md +11 -0
- package/docs/type-aliases/PromptType.md +11 -0
- package/docs/type-aliases/SemaphoreIsReadyFuncType.md +15 -0
- package/docs/type-aliases/TFunc.md +25 -0
- package/docs/variables/AIChatRoles.md +11 -0
- package/docs/variables/AIMessageTypes.md +11 -0
- package/docs/variables/AITextGenerationFinishReasons.md +11 -0
- package/docs/variables/AbortErrorCode.md +11 -0
- package/docs/variables/ActionNames.md +11 -0
- package/docs/variables/AlreadyExistsErrorCode.md +11 -0
- package/docs/variables/ClientToolFuncSchema.md +101 -0
- package/docs/variables/DEFAULT_CONFIG_NAME.md +11 -0
- package/docs/variables/DefaultAsyncSemaphoreCapacity.md +11 -0
- package/docs/variables/EventBusName.md +11 -0
- package/docs/variables/EventName.md +11 -0
- package/docs/variables/FilenameReservedRegex.md +14 -0
- package/docs/variables/HFBuiltins.md +122 -0
- package/docs/variables/InternalErrorCode.md +11 -0
- package/docs/variables/LLM_TOKENIZER_NAMES.md +81 -0
- package/docs/variables/LLM_TOKENIZER_NAMES_MAP.md +11 -0
- package/docs/variables/NotFoundErrorCode.md +11 -0
- package/docs/variables/NotImplementedErrorCode.md +11 -0
- package/docs/variables/PASSING_SCORE.md +11 -0
- package/docs/variables/PromptTemplateTypes.md +11 -0
- package/docs/variables/PromptTypes.md +14 -0
- package/docs/variables/RStreamErrCode.md +11 -0
- package/docs/variables/RemoteToolFuncSchema.md +101 -0
- package/docs/variables/ResponseRStreamErrCode.md +11 -0
- package/docs/variables/SHUTDOWN_SIGNALS.md +17 -0
- package/docs/variables/SSEChannelAlreadyClosedErrCode.md +11 -0
- package/docs/variables/SecondaryCache.md +11 -0
- package/docs/variables/ServerToolFuncSchema.md +101 -0
- package/docs/variables/ToolAsyncCancelableBit.md +11 -0
- package/docs/variables/ToolAsyncMultiTaskBit.md +11 -0
- package/docs/variables/ToolAsyncPriorityBit.md +11 -0
- package/docs/variables/ToolFuncSchema.md +133 -0
- package/docs/variables/WindowsReservedNameRegex.md +13 -0
- package/docs/variables/base32768.md +11 -0
- package/docs/variables/defaultTemplateFormat.md +11 -0
- package/docs/variables/event.md +11 -0
- package/docs/variables/eventClient.md +11 -0
- package/docs/variables/eventServer.md +11 -0
- package/docs/variables/lrucache.md +11 -0
- package/docs/variables/mimeType.md +11 -0
- package/docs/variables/uuidNIL.md +11 -0
- package/package.json +2 -2
|
@@ -0,0 +1,21 @@
|
|
|
1
|
+
[**@isdk/ai-tool**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/ai-tool](../globals.md) / canonicalize
|
|
6
|
+
|
|
7
|
+
# Function: canonicalize()
|
|
8
|
+
|
|
9
|
+
> **canonicalize**(`obj`): `string`
|
|
10
|
+
|
|
11
|
+
Defined in: node\_modules/.pnpm/json-canonicalize@1.0.6/node\_modules/json-canonicalize/types/canonicalize.d.ts:1
|
|
12
|
+
|
|
13
|
+
## Parameters
|
|
14
|
+
|
|
15
|
+
### obj
|
|
16
|
+
|
|
17
|
+
`any`
|
|
18
|
+
|
|
19
|
+
## Returns
|
|
20
|
+
|
|
21
|
+
`string`
|
|
@@ -0,0 +1,25 @@
|
|
|
1
|
+
[**@isdk/ai-tool**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/ai-tool](../globals.md) / completeSentences
|
|
6
|
+
|
|
7
|
+
# Function: completeSentences()
|
|
8
|
+
|
|
9
|
+
> **completeSentences**(`sentences`, `__namedParameters`): `string`[]
|
|
10
|
+
|
|
11
|
+
Defined in: [packages/ai-tool/src/utils/split-sentence.ts:123](https://github.com/isdk/ai-tool.js/blob/79d5773fa454dc7789b1291b1ebd73e4c1b93154/src/utils/split-sentence.ts#L123)
|
|
12
|
+
|
|
13
|
+
## Parameters
|
|
14
|
+
|
|
15
|
+
### sentences
|
|
16
|
+
|
|
17
|
+
`string`[]
|
|
18
|
+
|
|
19
|
+
### \_\_namedParameters
|
|
20
|
+
|
|
21
|
+
[`SplitSentenceOptions`](../interfaces/SplitSentenceOptions.md) = `{}`
|
|
22
|
+
|
|
23
|
+
## Returns
|
|
24
|
+
|
|
25
|
+
`string`[]
|
|
@@ -0,0 +1,25 @@
|
|
|
1
|
+
[**@isdk/ai-tool**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/ai-tool](../globals.md) / concatText
|
|
6
|
+
|
|
7
|
+
# Function: concatText()
|
|
8
|
+
|
|
9
|
+
> **concatText**(`left`, `right`): `string`
|
|
10
|
+
|
|
11
|
+
Defined in: [packages/ai-tool/src/utils/split-sentence.ts:168](https://github.com/isdk/ai-tool.js/blob/79d5773fa454dc7789b1291b1ebd73e4c1b93154/src/utils/split-sentence.ts#L168)
|
|
12
|
+
|
|
13
|
+
## Parameters
|
|
14
|
+
|
|
15
|
+
### left
|
|
16
|
+
|
|
17
|
+
`string`
|
|
18
|
+
|
|
19
|
+
### right
|
|
20
|
+
|
|
21
|
+
`string`
|
|
22
|
+
|
|
23
|
+
## Returns
|
|
24
|
+
|
|
25
|
+
`string`
|
|
@@ -0,0 +1,25 @@
|
|
|
1
|
+
[**@isdk/ai-tool**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/ai-tool](../globals.md) / countLLMTokens
|
|
6
|
+
|
|
7
|
+
# Function: countLLMTokens()
|
|
8
|
+
|
|
9
|
+
> **countLLMTokens**(`text`, `modelId`): `Promise`\<`number`\>
|
|
10
|
+
|
|
11
|
+
Defined in: [packages/ai-tool/src/utils/llm-tokenizer.ts:74](https://github.com/isdk/ai-tool.js/blob/79d5773fa454dc7789b1291b1ebd73e4c1b93154/src/utils/llm-tokenizer.ts#L74)
|
|
12
|
+
|
|
13
|
+
## Parameters
|
|
14
|
+
|
|
15
|
+
### text
|
|
16
|
+
|
|
17
|
+
`string`
|
|
18
|
+
|
|
19
|
+
### modelId
|
|
20
|
+
|
|
21
|
+
`string` = `'qwen2.5'`
|
|
22
|
+
|
|
23
|
+
## Returns
|
|
24
|
+
|
|
25
|
+
`Promise`\<`number`\>
|
|
@@ -0,0 +1,35 @@
|
|
|
1
|
+
[**@isdk/ai-tool**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/ai-tool](../globals.md) / countRegexMatches
|
|
6
|
+
|
|
7
|
+
# Function: countRegexMatches()
|
|
8
|
+
|
|
9
|
+
> **countRegexMatches**(`content`, `regex`): `number`
|
|
10
|
+
|
|
11
|
+
Defined in: [packages/ai-tool/src/utils/count-regex-matches.ts:10](https://github.com/isdk/ai-tool.js/blob/79d5773fa454dc7789b1291b1ebd73e4c1b93154/src/utils/count-regex-matches.ts#L10)
|
|
12
|
+
|
|
13
|
+
Counts the number of matches for a given regular expression in a specified string.
|
|
14
|
+
This function ensures that the regular expression is used globally by adding the 'g' flag,
|
|
15
|
+
if it is not already present.
|
|
16
|
+
|
|
17
|
+
## Parameters
|
|
18
|
+
|
|
19
|
+
### content
|
|
20
|
+
|
|
21
|
+
`string`
|
|
22
|
+
|
|
23
|
+
The string to search within.
|
|
24
|
+
|
|
25
|
+
### regex
|
|
26
|
+
|
|
27
|
+
`RegExp`
|
|
28
|
+
|
|
29
|
+
The regular expression to use for matching.
|
|
30
|
+
|
|
31
|
+
## Returns
|
|
32
|
+
|
|
33
|
+
`number`
|
|
34
|
+
|
|
35
|
+
The total number of matches found.
|
|
@@ -0,0 +1,119 @@
|
|
|
1
|
+
[**@isdk/ai-tool**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/ai-tool](../globals.md) / createAbilityInjector
|
|
6
|
+
|
|
7
|
+
# Function: createAbilityInjector()
|
|
8
|
+
|
|
9
|
+
## Call Signature
|
|
10
|
+
|
|
11
|
+
> **createAbilityInjector**\<`A`\>(`abilityClass`, `isGetClassFunc`?, `injectorOpts`?): `ClassAbilityFn`\<`A`\>
|
|
12
|
+
|
|
13
|
+
Defined in: node\_modules/.pnpm/custom-ability@2.0.1/node\_modules/custom-ability/lib/custom-ability.d.ts:35
|
|
14
|
+
|
|
15
|
+
### Type Parameters
|
|
16
|
+
|
|
17
|
+
• **A** *extends* `ClassEx`
|
|
18
|
+
|
|
19
|
+
### Parameters
|
|
20
|
+
|
|
21
|
+
#### abilityClass
|
|
22
|
+
|
|
23
|
+
`A`
|
|
24
|
+
|
|
25
|
+
#### isGetClassFunc?
|
|
26
|
+
|
|
27
|
+
`boolean`
|
|
28
|
+
|
|
29
|
+
#### injectorOpts?
|
|
30
|
+
|
|
31
|
+
`AbilityInjectorOptions`
|
|
32
|
+
|
|
33
|
+
### Returns
|
|
34
|
+
|
|
35
|
+
`ClassAbilityFn`\<`A`\>
|
|
36
|
+
|
|
37
|
+
## Call Signature
|
|
38
|
+
|
|
39
|
+
> **createAbilityInjector**\<`A`\>(`abilityClass`, `aCoreMethod`?, `isGetClassFunc`?, `injectorOpts`?): `ClassAbilityFn`\<`A`\>
|
|
40
|
+
|
|
41
|
+
Defined in: node\_modules/.pnpm/custom-ability@2.0.1/node\_modules/custom-ability/lib/custom-ability.d.ts:36
|
|
42
|
+
|
|
43
|
+
### Type Parameters
|
|
44
|
+
|
|
45
|
+
• **A** *extends* `ClassEx`
|
|
46
|
+
|
|
47
|
+
### Parameters
|
|
48
|
+
|
|
49
|
+
#### abilityClass
|
|
50
|
+
|
|
51
|
+
`A`
|
|
52
|
+
|
|
53
|
+
#### aCoreMethod?
|
|
54
|
+
|
|
55
|
+
`string` | `string`[]
|
|
56
|
+
|
|
57
|
+
#### isGetClassFunc?
|
|
58
|
+
|
|
59
|
+
`boolean`
|
|
60
|
+
|
|
61
|
+
#### injectorOpts?
|
|
62
|
+
|
|
63
|
+
`AbilityInjectorOptions`
|
|
64
|
+
|
|
65
|
+
### Returns
|
|
66
|
+
|
|
67
|
+
`ClassAbilityFn`\<`A`\>
|
|
68
|
+
|
|
69
|
+
## Call Signature
|
|
70
|
+
|
|
71
|
+
> **createAbilityInjector**\<`A`\>(`abilityClass`, `aCoreMethod`?, `injectorOpts`?): `ClassAbilityFn`\<`A`\>
|
|
72
|
+
|
|
73
|
+
Defined in: node\_modules/.pnpm/custom-ability@2.0.1/node\_modules/custom-ability/lib/custom-ability.d.ts:37
|
|
74
|
+
|
|
75
|
+
### Type Parameters
|
|
76
|
+
|
|
77
|
+
• **A** *extends* `ClassEx`
|
|
78
|
+
|
|
79
|
+
### Parameters
|
|
80
|
+
|
|
81
|
+
#### abilityClass
|
|
82
|
+
|
|
83
|
+
`A`
|
|
84
|
+
|
|
85
|
+
#### aCoreMethod?
|
|
86
|
+
|
|
87
|
+
`string` | `string`[]
|
|
88
|
+
|
|
89
|
+
#### injectorOpts?
|
|
90
|
+
|
|
91
|
+
`AbilityInjectorOptions`
|
|
92
|
+
|
|
93
|
+
### Returns
|
|
94
|
+
|
|
95
|
+
`ClassAbilityFn`\<`A`\>
|
|
96
|
+
|
|
97
|
+
## Call Signature
|
|
98
|
+
|
|
99
|
+
> **createAbilityInjector**\<`A`\>(`abilityClass`, `injectorOpts`?): `ClassAbilityFn`\<`A`\>
|
|
100
|
+
|
|
101
|
+
Defined in: node\_modules/.pnpm/custom-ability@2.0.1/node\_modules/custom-ability/lib/custom-ability.d.ts:38
|
|
102
|
+
|
|
103
|
+
### Type Parameters
|
|
104
|
+
|
|
105
|
+
• **A** *extends* `ClassEx`
|
|
106
|
+
|
|
107
|
+
### Parameters
|
|
108
|
+
|
|
109
|
+
#### abilityClass
|
|
110
|
+
|
|
111
|
+
`A`
|
|
112
|
+
|
|
113
|
+
#### injectorOpts?
|
|
114
|
+
|
|
115
|
+
`AbilityInjectorOptions`
|
|
116
|
+
|
|
117
|
+
### Returns
|
|
118
|
+
|
|
119
|
+
`ClassAbilityFn`\<`A`\>
|
|
@@ -0,0 +1,49 @@
|
|
|
1
|
+
[**@isdk/ai-tool**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/ai-tool](../globals.md) / createCallbacksTransformer
|
|
6
|
+
|
|
7
|
+
# Function: createCallbacksTransformer()
|
|
8
|
+
|
|
9
|
+
> **createCallbacksTransformer**\<`I`, `O`\>(`cb`): `TransformStream`\<`I`, `O`\>
|
|
10
|
+
|
|
11
|
+
Defined in: [packages/ai-tool/src/utils/stream/create-callbacks-stream.ts:36](https://github.com/isdk/ai-tool.js/blob/79d5773fa454dc7789b1291b1ebd73e4c1b93154/src/utils/stream/create-callbacks-stream.ts#L36)
|
|
12
|
+
|
|
13
|
+
Creates a transform stream that invokes optional callback functions.
|
|
14
|
+
The transform stream uses the provided callbacks to execute custom logic at different stages of the stream's lifecycle.
|
|
15
|
+
- `onStart`: Called once when the stream is initialized.
|
|
16
|
+
- `onTransform`: Called for each tokenized message.
|
|
17
|
+
- `onCompletion`: Called every time an AIStream completion message is received. This can occur multiple times when using e.g. OpenAI functions
|
|
18
|
+
- `onFinal`: Called once when the stream is closed with the final completion message.
|
|
19
|
+
|
|
20
|
+
This function is useful when you want to process a stream of messages and perform specific actions during the stream's lifecycle.
|
|
21
|
+
|
|
22
|
+
## Type Parameters
|
|
23
|
+
|
|
24
|
+
• **I** = `any`
|
|
25
|
+
|
|
26
|
+
• **O** = `any`
|
|
27
|
+
|
|
28
|
+
## Parameters
|
|
29
|
+
|
|
30
|
+
### cb
|
|
31
|
+
|
|
32
|
+
`undefined` | [`StreamCallbacksAndOptions`](../interfaces/StreamCallbacksAndOptions.md)\<`I`, `O`\>
|
|
33
|
+
|
|
34
|
+
## Returns
|
|
35
|
+
|
|
36
|
+
`TransformStream`\<`I`, `O`\>
|
|
37
|
+
|
|
38
|
+
A transform stream that encodes input messages as Uint8Array and allows the execution of custom logic through callbacks.
|
|
39
|
+
|
|
40
|
+
## Example
|
|
41
|
+
|
|
42
|
+
```ts
|
|
43
|
+
const callbacks = {
|
|
44
|
+
onStart: async () => console.log('Stream started'),
|
|
45
|
+
onTransform: async (chunk) => console.log('Token:',chunk),
|
|
46
|
+
onFinal: async () => data.close()
|
|
47
|
+
};
|
|
48
|
+
const transformer = createCallbacksTransformer(callbacks);
|
|
49
|
+
```
|
|
@@ -0,0 +1,21 @@
|
|
|
1
|
+
[**@isdk/ai-tool**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/ai-tool](../globals.md) / createEmptyReadableStream
|
|
6
|
+
|
|
7
|
+
# Function: createEmptyReadableStream()
|
|
8
|
+
|
|
9
|
+
> **createEmptyReadableStream**(): `ReadableStream`
|
|
10
|
+
|
|
11
|
+
Defined in: [packages/ai-tool/src/utils/stream/create-empty-stream.ts:8](https://github.com/isdk/ai-tool.js/blob/79d5773fa454dc7789b1291b1ebd73e4c1b93154/src/utils/stream/create-empty-stream.ts#L8)
|
|
12
|
+
|
|
13
|
+
Creates an empty ReadableStream that immediately closes upon creation.
|
|
14
|
+
This function is used as a fallback for creating a ReadableStream when the response body is null or undefined,
|
|
15
|
+
ensuring that the subsequent pipeline processing doesn't fail due to a lack of a stream.
|
|
16
|
+
|
|
17
|
+
## Returns
|
|
18
|
+
|
|
19
|
+
`ReadableStream`
|
|
20
|
+
|
|
21
|
+
An empty and closed ReadableStream instance.
|
|
@@ -0,0 +1,31 @@
|
|
|
1
|
+
[**@isdk/ai-tool**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/ai-tool](../globals.md) / createEndWithRepetitionDetector
|
|
6
|
+
|
|
7
|
+
# Function: createEndWithRepetitionDetector()
|
|
8
|
+
|
|
9
|
+
> **createEndWithRepetitionDetector**(`repetitionThreshold`): (`value`) => `null` \| `RegExpExecArray`
|
|
10
|
+
|
|
11
|
+
Defined in: [packages/ai-tool/src/utils/end-with-repeated-sequence.ts:3](https://github.com/isdk/ai-tool.js/blob/79d5773fa454dc7789b1291b1ebd73e4c1b93154/src/utils/end-with-repeated-sequence.ts#L3)
|
|
12
|
+
|
|
13
|
+
## Parameters
|
|
14
|
+
|
|
15
|
+
### repetitionThreshold
|
|
16
|
+
|
|
17
|
+
`number`
|
|
18
|
+
|
|
19
|
+
## Returns
|
|
20
|
+
|
|
21
|
+
`Function`
|
|
22
|
+
|
|
23
|
+
### Parameters
|
|
24
|
+
|
|
25
|
+
#### value
|
|
26
|
+
|
|
27
|
+
`string`
|
|
28
|
+
|
|
29
|
+
### Returns
|
|
30
|
+
|
|
31
|
+
`null` \| `RegExpExecArray`
|
|
@@ -0,0 +1,39 @@
|
|
|
1
|
+
[**@isdk/ai-tool**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/ai-tool](../globals.md) / createError
|
|
6
|
+
|
|
7
|
+
# Function: createError()
|
|
8
|
+
|
|
9
|
+
> **createError**(`message`, `name`?, `status`?): [`CommonError`](../classes/CommonError.md)
|
|
10
|
+
|
|
11
|
+
Defined in: node\_modules/.pnpm/@isdk+common-error@0.1.3/node\_modules/@isdk/common-error/dist/index.d.ts:153
|
|
12
|
+
|
|
13
|
+
Create an error object
|
|
14
|
+
|
|
15
|
+
## Parameters
|
|
16
|
+
|
|
17
|
+
### message
|
|
18
|
+
|
|
19
|
+
`string`
|
|
20
|
+
|
|
21
|
+
Error message
|
|
22
|
+
|
|
23
|
+
### name?
|
|
24
|
+
|
|
25
|
+
Error name, optional
|
|
26
|
+
|
|
27
|
+
`string` | `Record`\<`string`, `any`\>
|
|
28
|
+
|
|
29
|
+
### status?
|
|
30
|
+
|
|
31
|
+
Error status code, default to 500
|
|
32
|
+
|
|
33
|
+
`string` | `number`
|
|
34
|
+
|
|
35
|
+
## Returns
|
|
36
|
+
|
|
37
|
+
[`CommonError`](../classes/CommonError.md)
|
|
38
|
+
|
|
39
|
+
Error object
|
|
@@ -0,0 +1,33 @@
|
|
|
1
|
+
[**@isdk/ai-tool**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/ai-tool](../globals.md) / createEventStreamTransformer
|
|
6
|
+
|
|
7
|
+
# Function: createEventStreamTransformer()
|
|
8
|
+
|
|
9
|
+
> **createEventStreamTransformer**\<`TValue`, `TOptions`\>(`customParser`?): `TransformStream`\<`Uint8Array`\<`ArrayBufferLike`\>, [`AIResult`](../interfaces/AIResult.md)\<`TValue`, `TOptions`\>\>
|
|
10
|
+
|
|
11
|
+
Defined in: [packages/ai-tool/src/utils/stream/ai-stream.ts:36](https://github.com/isdk/ai-tool.js/blob/79d5773fa454dc7789b1291b1ebd73e4c1b93154/src/utils/stream/ai-stream.ts#L36)
|
|
12
|
+
|
|
13
|
+
Creates a TransformStream that parses events from an EventSource stream using a custom parser.
|
|
14
|
+
|
|
15
|
+
## Type Parameters
|
|
16
|
+
|
|
17
|
+
• **TValue** = `any`
|
|
18
|
+
|
|
19
|
+
• **TOptions** = `any`
|
|
20
|
+
|
|
21
|
+
## Parameters
|
|
22
|
+
|
|
23
|
+
### customParser?
|
|
24
|
+
|
|
25
|
+
[`AIStreamParser`](../interfaces/AIStreamParser.md)\<`any`, `any`\>
|
|
26
|
+
|
|
27
|
+
Function to handle event data.
|
|
28
|
+
|
|
29
|
+
## Returns
|
|
30
|
+
|
|
31
|
+
`TransformStream`\<`Uint8Array`\<`ArrayBufferLike`\>, [`AIResult`](../interfaces/AIResult.md)\<`TValue`, `TOptions`\>\>
|
|
32
|
+
|
|
33
|
+
TransformStream parsing events.
|
|
@@ -0,0 +1,31 @@
|
|
|
1
|
+
[**@isdk/ai-tool**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/ai-tool](../globals.md) / createHfValueFunc
|
|
6
|
+
|
|
7
|
+
# Function: createHfValueFunc()
|
|
8
|
+
|
|
9
|
+
> **createHfValueFunc**(`fn`): (`_data`) => `Function`
|
|
10
|
+
|
|
11
|
+
Defined in: [packages/ai-tool/src/utils/prompt/hf-prompt-template.ts:140](https://github.com/isdk/ai-tool.js/blob/79d5773fa454dc7789b1291b1ebd73e4c1b93154/src/utils/prompt/hf-prompt-template.ts#L140)
|
|
12
|
+
|
|
13
|
+
## Parameters
|
|
14
|
+
|
|
15
|
+
### fn
|
|
16
|
+
|
|
17
|
+
`Function`
|
|
18
|
+
|
|
19
|
+
## Returns
|
|
20
|
+
|
|
21
|
+
`Function`
|
|
22
|
+
|
|
23
|
+
### Parameters
|
|
24
|
+
|
|
25
|
+
#### \_data
|
|
26
|
+
|
|
27
|
+
`any`
|
|
28
|
+
|
|
29
|
+
### Returns
|
|
30
|
+
|
|
31
|
+
`Function`
|
|
@@ -0,0 +1,25 @@
|
|
|
1
|
+
[**@isdk/ai-tool**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/ai-tool](../globals.md) / createLRUCache
|
|
6
|
+
|
|
7
|
+
# Function: createLRUCache()
|
|
8
|
+
|
|
9
|
+
> **createLRUCache**(`name`, `options`?): [`ToolFunc`](../classes/ToolFunc.md)
|
|
10
|
+
|
|
11
|
+
Defined in: [packages/ai-tool/src/funcs/lrucache.ts:24](https://github.com/isdk/ai-tool.js/blob/79d5773fa454dc7789b1291b1ebd73e4c1b93154/src/funcs/lrucache.ts#L24)
|
|
12
|
+
|
|
13
|
+
## Parameters
|
|
14
|
+
|
|
15
|
+
### name
|
|
16
|
+
|
|
17
|
+
`string`
|
|
18
|
+
|
|
19
|
+
### options?
|
|
20
|
+
|
|
21
|
+
`number` | `ICacheOptions`
|
|
22
|
+
|
|
23
|
+
## Returns
|
|
24
|
+
|
|
25
|
+
[`ToolFunc`](../classes/ToolFunc.md)
|
|
@@ -0,0 +1,25 @@
|
|
|
1
|
+
[**@isdk/ai-tool**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/ai-tool](../globals.md) / createYamlObjectTag
|
|
6
|
+
|
|
7
|
+
# Function: createYamlObjectTag()
|
|
8
|
+
|
|
9
|
+
> **createYamlObjectTag**(`tag`, `BaseObject`): `any`
|
|
10
|
+
|
|
11
|
+
Defined in: [packages/ai-tool/src/utils/yaml-type-base-object.ts:10](https://github.com/isdk/ai-tool.js/blob/79d5773fa454dc7789b1291b1ebd73e4c1b93154/src/utils/yaml-type-base-object.ts#L10)
|
|
12
|
+
|
|
13
|
+
## Parameters
|
|
14
|
+
|
|
15
|
+
### tag
|
|
16
|
+
|
|
17
|
+
`string`
|
|
18
|
+
|
|
19
|
+
### BaseObject
|
|
20
|
+
|
|
21
|
+
*typeof* [`YamlTypeBaseObject`](../classes/YamlTypeBaseObject.md)
|
|
22
|
+
|
|
23
|
+
## Returns
|
|
24
|
+
|
|
25
|
+
`any`
|
|
@@ -0,0 +1,25 @@
|
|
|
1
|
+
[**@isdk/ai-tool**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/ai-tool](../globals.md) / dateToText
|
|
6
|
+
|
|
7
|
+
# Function: dateToText()
|
|
8
|
+
|
|
9
|
+
> **dateToText**(`date`, `format`): `string`
|
|
10
|
+
|
|
11
|
+
Defined in: [packages/ai-tool/src/utils/to-datetime.ts:29](https://github.com/isdk/ai-tool.js/blob/79d5773fa454dc7789b1291b1ebd73e4c1b93154/src/utils/to-datetime.ts#L29)
|
|
12
|
+
|
|
13
|
+
## Parameters
|
|
14
|
+
|
|
15
|
+
### date
|
|
16
|
+
|
|
17
|
+
`Date`
|
|
18
|
+
|
|
19
|
+
### format
|
|
20
|
+
|
|
21
|
+
`string` = `FormatDateStr`
|
|
22
|
+
|
|
23
|
+
## Returns
|
|
24
|
+
|
|
25
|
+
`string`
|
|
@@ -0,0 +1,25 @@
|
|
|
1
|
+
[**@isdk/ai-tool**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/ai-tool](../globals.md) / decodeCharset
|
|
6
|
+
|
|
7
|
+
# Function: decodeCharset()
|
|
8
|
+
|
|
9
|
+
> **decodeCharset**(`result`, `encoding`?): `string`
|
|
10
|
+
|
|
11
|
+
Defined in: [packages/ai-tool/src/utils/load-file-from-paths.ts:113](https://github.com/isdk/ai-tool.js/blob/79d5773fa454dc7789b1291b1ebd73e4c1b93154/src/utils/load-file-from-paths.ts#L113)
|
|
12
|
+
|
|
13
|
+
## Parameters
|
|
14
|
+
|
|
15
|
+
### result
|
|
16
|
+
|
|
17
|
+
`Buffer`
|
|
18
|
+
|
|
19
|
+
### encoding?
|
|
20
|
+
|
|
21
|
+
`BufferEncoding`
|
|
22
|
+
|
|
23
|
+
## Returns
|
|
24
|
+
|
|
25
|
+
`string`
|
|
@@ -0,0 +1,25 @@
|
|
|
1
|
+
[**@isdk/ai-tool**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/ai-tool](../globals.md) / detectCharset
|
|
6
|
+
|
|
7
|
+
# Function: detectCharset()
|
|
8
|
+
|
|
9
|
+
> **detectCharset**(`content`, `options`?): `string`
|
|
10
|
+
|
|
11
|
+
Defined in: [packages/ai-tool/src/utils/load-file-from-paths.ts:248](https://github.com/isdk/ai-tool.js/blob/79d5773fa454dc7789b1291b1ebd73e4c1b93154/src/utils/load-file-from-paths.ts#L248)
|
|
12
|
+
|
|
13
|
+
## Parameters
|
|
14
|
+
|
|
15
|
+
### content
|
|
16
|
+
|
|
17
|
+
`string` | `Buffer`\<`ArrayBufferLike`\>
|
|
18
|
+
|
|
19
|
+
### options?
|
|
20
|
+
|
|
21
|
+
`any`
|
|
22
|
+
|
|
23
|
+
## Returns
|
|
24
|
+
|
|
25
|
+
`string`
|
|
@@ -0,0 +1,25 @@
|
|
|
1
|
+
[**@isdk/ai-tool**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/ai-tool](../globals.md) / encodeLLMTokens
|
|
6
|
+
|
|
7
|
+
# Function: encodeLLMTokens()
|
|
8
|
+
|
|
9
|
+
> **encodeLLMTokens**(`text`, `modelId`): `Promise`\<`number`[]\>
|
|
10
|
+
|
|
11
|
+
Defined in: [packages/ai-tool/src/utils/llm-tokenizer.ts:68](https://github.com/isdk/ai-tool.js/blob/79d5773fa454dc7789b1291b1ebd73e4c1b93154/src/utils/llm-tokenizer.ts#L68)
|
|
12
|
+
|
|
13
|
+
## Parameters
|
|
14
|
+
|
|
15
|
+
### text
|
|
16
|
+
|
|
17
|
+
`string`
|
|
18
|
+
|
|
19
|
+
### modelId
|
|
20
|
+
|
|
21
|
+
`string` = `'qwen2.5'`
|
|
22
|
+
|
|
23
|
+
## Returns
|
|
24
|
+
|
|
25
|
+
`Promise`\<`number`[]\>
|
|
@@ -0,0 +1,25 @@
|
|
|
1
|
+
[**@isdk/ai-tool**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/ai-tool](../globals.md) / ensureQuoted
|
|
6
|
+
|
|
7
|
+
# Function: ensureQuoted()
|
|
8
|
+
|
|
9
|
+
> **ensureQuoted**(`s`, `quoteChar`): `string`
|
|
10
|
+
|
|
11
|
+
Defined in: [packages/ai-tool/src/utils/parse-command.ts:204](https://github.com/isdk/ai-tool.js/blob/79d5773fa454dc7789b1291b1ebd73e4c1b93154/src/utils/parse-command.ts#L204)
|
|
12
|
+
|
|
13
|
+
## Parameters
|
|
14
|
+
|
|
15
|
+
### s
|
|
16
|
+
|
|
17
|
+
`string`
|
|
18
|
+
|
|
19
|
+
### quoteChar
|
|
20
|
+
|
|
21
|
+
`string` = `'"'`
|
|
22
|
+
|
|
23
|
+
## Returns
|
|
24
|
+
|
|
25
|
+
`string`
|