xinference 0.10.3__py3-none-any.whl → 0.11.1__py3-none-any.whl
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Potentially problematic release.
This version of xinference might be problematic. Click here for more details.
- xinference/_version.py +3 -3
- xinference/api/oauth2/auth_service.py +1 -1
- xinference/api/restful_api.py +53 -61
- xinference/client/restful/restful_client.py +52 -57
- xinference/conftest.py +1 -1
- xinference/core/cache_tracker.py +1 -1
- xinference/core/chat_interface.py +10 -4
- xinference/core/event.py +1 -1
- xinference/core/model.py +17 -6
- xinference/core/status_guard.py +1 -1
- xinference/core/supervisor.py +58 -72
- xinference/core/worker.py +68 -101
- xinference/deploy/cmdline.py +166 -1
- xinference/deploy/test/test_cmdline.py +2 -0
- xinference/deploy/utils.py +1 -1
- xinference/device_utils.py +29 -3
- xinference/fields.py +7 -1
- xinference/model/audio/whisper.py +88 -12
- xinference/model/core.py +2 -2
- xinference/model/image/__init__.py +29 -0
- xinference/model/image/core.py +6 -0
- xinference/model/image/custom.py +109 -0
- xinference/model/llm/__init__.py +92 -32
- xinference/model/llm/core.py +57 -102
- xinference/model/llm/ggml/chatglm.py +98 -13
- xinference/model/llm/ggml/llamacpp.py +49 -2
- xinference/model/llm/ggml/tools/convert_ggml_to_gguf.py +2 -2
- xinference/model/llm/llm_family.json +438 -7
- xinference/model/llm/llm_family.py +45 -41
- xinference/model/llm/llm_family_modelscope.json +258 -5
- xinference/model/llm/pytorch/chatglm.py +48 -0
- xinference/model/llm/pytorch/core.py +23 -6
- xinference/model/llm/pytorch/deepseek_vl.py +115 -33
- xinference/model/llm/pytorch/internlm2.py +32 -1
- xinference/model/llm/pytorch/qwen_vl.py +94 -12
- xinference/model/llm/pytorch/utils.py +38 -1
- xinference/model/llm/pytorch/yi_vl.py +96 -51
- xinference/model/llm/sglang/core.py +31 -9
- xinference/model/llm/utils.py +54 -20
- xinference/model/llm/vllm/core.py +101 -7
- xinference/thirdparty/omnilmm/chat.py +2 -1
- xinference/thirdparty/omnilmm/model/omnilmm.py +2 -1
- xinference/types.py +11 -0
- xinference/web/ui/build/asset-manifest.json +6 -3
- xinference/web/ui/build/index.html +1 -1
- xinference/web/ui/build/static/css/main.54bca460.css +2 -0
- xinference/web/ui/build/static/css/main.54bca460.css.map +1 -0
- xinference/web/ui/build/static/js/main.551aa479.js +3 -0
- xinference/web/ui/build/static/js/{main.26fdbfbe.js.LICENSE.txt → main.551aa479.js.LICENSE.txt} +7 -0
- xinference/web/ui/build/static/js/main.551aa479.js.map +1 -0
- xinference/web/ui/node_modules/.cache/babel-loader/0b11a5339468c13b2d31ac085e7effe4303259b2071abd46a0a8eb8529233a5e.json +1 -0
- xinference/web/ui/node_modules/.cache/babel-loader/1fa824d82b2af519de7700c594e50bde4bbca60d13bd3fabff576802e4070304.json +1 -0
- xinference/web/ui/node_modules/.cache/babel-loader/23caf6f1e52c43e983ca3bfd4189f41dbd645fa78f2dfdcd7f6b69bc41678665.json +1 -0
- xinference/web/ui/node_modules/.cache/babel-loader/29dda700ab913cf7f2cfabe450ddabfb283e96adfa3ec9d315b2fa6c63cd375c.json +1 -0
- xinference/web/ui/node_modules/.cache/babel-loader/2c63e940b945fd5817157e08a42b889b30d668ea4c91332f48ef2b1b9d26f520.json +1 -0
- xinference/web/ui/node_modules/.cache/babel-loader/4135fe8745434cbce6438d1ebfa47422e0c77d884db4edc75c8bf32ea1d50621.json +1 -0
- xinference/web/ui/node_modules/.cache/babel-loader/46b6dd1f6d1109cd0e2455a0ea0be3e9bda1097cd4ebec9c4040070372671cfc.json +1 -0
- xinference/web/ui/node_modules/.cache/babel-loader/4de0a71074f9cbe1e7862750dcdd08cbc1bae7d9d9849a78b1783ca670017b3c.json +1 -0
- xinference/web/ui/node_modules/.cache/babel-loader/53f6c0c0afb51265cd8fb940daeb65523501879ac2a8c03a1ead22b9793c5041.json +1 -0
- xinference/web/ui/node_modules/.cache/babel-loader/8ccbb839002bc5bc03e0a0e7612362bf92f6ae64f87e094f8682d6a6fe4619bb.json +1 -0
- xinference/web/ui/node_modules/.cache/babel-loader/97ed30d6e22cf76f0733651e2c18364689a01665d0b5fe811c1b7ca3eb713c82.json +1 -0
- xinference/web/ui/node_modules/.cache/babel-loader/9c0c70f1838913aaa792a0d2260f17f90fd177b95698ed46b7bc3050eb712c1c.json +1 -0
- xinference/web/ui/node_modules/.cache/babel-loader/9cfd33238ca43e5bf9fc7e442690e8cc6027c73553db36de87e3597ed524ee4b.json +1 -0
- xinference/web/ui/node_modules/.cache/babel-loader/a6da6bc3d0d2191adebee87fb58ecebe82d071087bd2f7f3a9c7fdd2ada130f2.json +1 -0
- xinference/web/ui/node_modules/.cache/babel-loader/ada71518a429f821a9b1dea38bc951447f03c8db509887e0980b893acac938f3.json +1 -0
- xinference/web/ui/node_modules/.cache/babel-loader/b6c9558d28b5972bb8b2691c5a76a2c8814a815eb3443126da9f49f7d6a0c118.json +1 -0
- xinference/web/ui/node_modules/.cache/babel-loader/bb0f721c084a4d85c09201c984f02ee8437d3b6c5c38a57cb4a101f653daef1b.json +1 -0
- xinference/web/ui/node_modules/.package-lock.json +33 -0
- xinference/web/ui/node_modules/clipboard/.babelrc.json +11 -0
- xinference/web/ui/node_modules/clipboard/.eslintrc.json +24 -0
- xinference/web/ui/node_modules/clipboard/.prettierrc.json +9 -0
- xinference/web/ui/node_modules/clipboard/bower.json +18 -0
- xinference/web/ui/node_modules/clipboard/composer.json +25 -0
- xinference/web/ui/node_modules/clipboard/package.json +63 -0
- xinference/web/ui/node_modules/delegate/package.json +31 -0
- xinference/web/ui/node_modules/good-listener/bower.json +11 -0
- xinference/web/ui/node_modules/good-listener/package.json +35 -0
- xinference/web/ui/node_modules/select/bower.json +13 -0
- xinference/web/ui/node_modules/select/package.json +29 -0
- xinference/web/ui/node_modules/tiny-emitter/package.json +53 -0
- xinference/web/ui/package-lock.json +34 -0
- xinference/web/ui/package.json +1 -0
- {xinference-0.10.3.dist-info → xinference-0.11.1.dist-info}/METADATA +13 -12
- {xinference-0.10.3.dist-info → xinference-0.11.1.dist-info}/RECORD +88 -67
- xinference/client/oscar/__init__.py +0 -13
- xinference/client/oscar/actor_client.py +0 -611
- xinference/model/llm/pytorch/spec_decoding_utils.py +0 -531
- xinference/model/llm/pytorch/spec_model.py +0 -186
- xinference/web/ui/build/static/js/main.26fdbfbe.js +0 -3
- xinference/web/ui/build/static/js/main.26fdbfbe.js.map +0 -1
- xinference/web/ui/node_modules/.cache/babel-loader/1870cd6f7054d04e049e363c0a85526584fe25519378609d2838e28d7492bbf1.json +0 -1
- xinference/web/ui/node_modules/.cache/babel-loader/5393569d846332075b93b55656716a34f50e0a8c970be789502d7e6c49755fd7.json +0 -1
- xinference/web/ui/node_modules/.cache/babel-loader/63a4c48f0326d071c7772c46598215c006ae41fd3d4ff3577fe717de66ad6e89.json +0 -1
- xinference/web/ui/node_modules/.cache/babel-loader/de0299226173b0662b573f49e3992220f6611947073bd66ac079728a8bc8837d.json +0 -1
- xinference/web/ui/node_modules/.cache/babel-loader/e9b52d171223bb59fb918316297a051cdfd42dd453e8260fd918e90bc0a4ebdf.json +0 -1
- xinference/web/ui/node_modules/.cache/babel-loader/f4d5d1a41892a754c1ee0237450d804b20612d1b657945b59e564161ea47aa7a.json +0 -1
- xinference/web/ui/node_modules/.cache/babel-loader/fad4cd70de36ef6e6d5f8fd74a10ded58d964a8a91ef7681693fbb8376552da7.json +0 -1
- {xinference-0.10.3.dist-info → xinference-0.11.1.dist-info}/LICENSE +0 -0
- {xinference-0.10.3.dist-info → xinference-0.11.1.dist-info}/WHEEL +0 -0
- {xinference-0.10.3.dist-info → xinference-0.11.1.dist-info}/entry_points.txt +0 -0
- {xinference-0.10.3.dist-info → xinference-0.11.1.dist-info}/top_level.txt +0 -0
|
@@ -0,0 +1 @@
|
|
|
1
|
+
{"ast":null,"code":"\"use strict\";\n\"use client\";\n\nvar _interopRequireDefault = require(\"@babel/runtime/helpers/interopRequireDefault\");\nObject.defineProperty(exports, \"__esModule\", {\n value: true\n});\nexports.default = void 0;\nvar _createSvgIcon = _interopRequireDefault(require(\"./utils/createSvgIcon\"));\nvar _jsxRuntime = require(\"react/jsx-runtime\");\nvar _default = (0, _createSvgIcon.default)( /*#__PURE__*/(0, _jsxRuntime.jsx)(\"path\", {\n d: \"M3 5H1v16c0 1.1.9 2 2 2h16v-2H3V5zm18-4H7c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V3c0-1.1-.9-2-2-2zm0 16H7V3h14v14z\"\n}), 'FilterNone');\nexports.default = _default;","map":{"version":3,"names":["_interopRequireDefault","require","Object","defineProperty","exports","value","default","_createSvgIcon","_jsxRuntime","_default","jsx","d"],"sources":["/home/runner/work/inference/inference/xinference/web/ui/node_modules/@mui/icons-material/FilterNone.js"],"sourcesContent":["\"use strict\";\n\"use client\";\n\nvar _interopRequireDefault = require(\"@babel/runtime/helpers/interopRequireDefault\");\nObject.defineProperty(exports, \"__esModule\", {\n value: true\n});\nexports.default = void 0;\nvar _createSvgIcon = _interopRequireDefault(require(\"./utils/createSvgIcon\"));\nvar _jsxRuntime = require(\"react/jsx-runtime\");\nvar _default = (0, _createSvgIcon.default)( /*#__PURE__*/(0, _jsxRuntime.jsx)(\"path\", {\n d: \"M3 5H1v16c0 1.1.9 2 2 2h16v-2H3V5zm18-4H7c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V3c0-1.1-.9-2-2-2zm0 16H7V3h14v14z\"\n}), 'FilterNone');\nexports.default = _default;"],"mappings":"AAAA,YAAY;AACZ,YAAY;;AAEZ,IAAIA,sBAAsB,GAAGC,OAAO,CAAC,8CAA8C,CAAC;AACpFC,MAAM,CAACC,cAAc,CAACC,OAAO,EAAE,YAAY,EAAE;EAC3CC,KAAK,EAAE;AACT,CAAC,CAAC;AACFD,OAAO,CAACE,OAAO,GAAG,KAAK,CAAC;AACxB,IAAIC,cAAc,GAAGP,sBAAsB,CAACC,OAAO,CAAC,uBAAuB,CAAC,CAAC;AAC7E,IAAIO,WAAW,GAAGP,OAAO,CAAC,mBAAmB,CAAC;AAC9C,IAAIQ,QAAQ,GAAG,CAAC,CAAC,EAAEF,cAAc,CAACD,OAAO,GAAG,aAAa,CAAC,CAAC,EAAEE,WAAW,CAACE,GAAG,EAAE,MAAM,EAAE;EACpFC,CAAC,EAAE;AACL,CAAC,CAAC,EAAE,YAAY,CAAC;AACjBP,OAAO,CAACE,OAAO,GAAGG,QAAQ"},"metadata":{},"sourceType":"script","externalDependencies":[]}
|
|
@@ -0,0 +1 @@
|
|
|
1
|
+
{"ast":null,"code":"\"use strict\";\n\"use client\";\n\nvar _interopRequireDefault = require(\"@babel/runtime/helpers/interopRequireDefault\");\nObject.defineProperty(exports, \"__esModule\", {\n value: true\n});\nexports.default = void 0;\nvar _createSvgIcon = _interopRequireDefault(require(\"./utils/createSvgIcon\"));\nvar _jsxRuntime = require(\"react/jsx-runtime\");\nvar _default = (0, _createSvgIcon.default)( /*#__PURE__*/(0, _jsxRuntime.jsx)(\"path\", {\n d: \"M19 13h-6v6h-2v-6H5v-2h6V5h2v6h6v2z\"\n}), 'Add');\nexports.default = _default;","map":{"version":3,"names":["_interopRequireDefault","require","Object","defineProperty","exports","value","default","_createSvgIcon","_jsxRuntime","_default","jsx","d"],"sources":["/home/runner/work/inference/inference/xinference/web/ui/node_modules/@mui/icons-material/Add.js"],"sourcesContent":["\"use strict\";\n\"use client\";\n\nvar _interopRequireDefault = require(\"@babel/runtime/helpers/interopRequireDefault\");\nObject.defineProperty(exports, \"__esModule\", {\n value: true\n});\nexports.default = void 0;\nvar _createSvgIcon = _interopRequireDefault(require(\"./utils/createSvgIcon\"));\nvar _jsxRuntime = require(\"react/jsx-runtime\");\nvar _default = (0, _createSvgIcon.default)( /*#__PURE__*/(0, _jsxRuntime.jsx)(\"path\", {\n d: \"M19 13h-6v6h-2v-6H5v-2h6V5h2v6h6v2z\"\n}), 'Add');\nexports.default = _default;"],"mappings":"AAAA,YAAY;AACZ,YAAY;;AAEZ,IAAIA,sBAAsB,GAAGC,OAAO,CAAC,8CAA8C,CAAC;AACpFC,MAAM,CAACC,cAAc,CAACC,OAAO,EAAE,YAAY,EAAE;EAC3CC,KAAK,EAAE;AACT,CAAC,CAAC;AACFD,OAAO,CAACE,OAAO,GAAG,KAAK,CAAC;AACxB,IAAIC,cAAc,GAAGP,sBAAsB,CAACC,OAAO,CAAC,uBAAuB,CAAC,CAAC;AAC7E,IAAIO,WAAW,GAAGP,OAAO,CAAC,mBAAmB,CAAC;AAC9C,IAAIQ,QAAQ,GAAG,CAAC,CAAC,EAAEF,cAAc,CAACD,OAAO,GAAG,aAAa,CAAC,CAAC,EAAEE,WAAW,CAACE,GAAG,EAAE,MAAM,EAAE;EACpFC,CAAC,EAAE;AACL,CAAC,CAAC,EAAE,KAAK,CAAC;AACVP,OAAO,CAACE,OAAO,GAAGG,QAAQ"},"metadata":{},"sourceType":"script","externalDependencies":[]}
|
|
@@ -7018,6 +7018,16 @@
|
|
|
7018
7018
|
"node": ">=0.10.0"
|
|
7019
7019
|
}
|
|
7020
7020
|
},
|
|
7021
|
+
"node_modules/clipboard": {
|
|
7022
|
+
"version": "2.0.11",
|
|
7023
|
+
"resolved": "https://registry.npmjs.org/clipboard/-/clipboard-2.0.11.tgz",
|
|
7024
|
+
"integrity": "sha512-C+0bbOqkezLIsmWSvlsXS0Q0bmkugu7jcfMIACB+RDEntIzQIkdr148we28AfSloQLRdZlYL/QYyrq05j/3Faw==",
|
|
7025
|
+
"dependencies": {
|
|
7026
|
+
"good-listener": "^1.2.2",
|
|
7027
|
+
"select": "^1.1.2",
|
|
7028
|
+
"tiny-emitter": "^2.0.0"
|
|
7029
|
+
}
|
|
7030
|
+
},
|
|
7021
7031
|
"node_modules/cliui": {
|
|
7022
7032
|
"version": "7.0.4",
|
|
7023
7033
|
"resolved": "https://registry.npmjs.org/cliui/-/cliui-7.0.4.tgz",
|
|
@@ -7953,6 +7963,11 @@
|
|
|
7953
7963
|
"node": ">=0.4.0"
|
|
7954
7964
|
}
|
|
7955
7965
|
},
|
|
7966
|
+
"node_modules/delegate": {
|
|
7967
|
+
"version": "3.2.0",
|
|
7968
|
+
"resolved": "https://registry.npmjs.org/delegate/-/delegate-3.2.0.tgz",
|
|
7969
|
+
"integrity": "sha512-IofjkYBZaZivn0V8nnsMJGBr4jVLxHDheKSW88PyxS5QC4Vo9ZbZVvhzlSxY87fVq3STR6r+4cGepyHkcWOQSw=="
|
|
7970
|
+
},
|
|
7956
7971
|
"node_modules/depd": {
|
|
7957
7972
|
"version": "2.0.0",
|
|
7958
7973
|
"resolved": "https://registry.npmjs.org/depd/-/depd-2.0.0.tgz",
|
|
@@ -10034,6 +10049,14 @@
|
|
|
10034
10049
|
"url": "https://github.com/sponsors/sindresorhus"
|
|
10035
10050
|
}
|
|
10036
10051
|
},
|
|
10052
|
+
"node_modules/good-listener": {
|
|
10053
|
+
"version": "1.2.2",
|
|
10054
|
+
"resolved": "https://registry.npmjs.org/good-listener/-/good-listener-1.2.2.tgz",
|
|
10055
|
+
"integrity": "sha512-goW1b+d9q/HIwbVYZzZ6SsTr4IgE+WA44A0GmPIQstuOrgsFcT7VEJ48nmr9GaRtNu0XTKacFLGnBPAM6Afouw==",
|
|
10056
|
+
"dependencies": {
|
|
10057
|
+
"delegate": "^3.1.2"
|
|
10058
|
+
}
|
|
10059
|
+
},
|
|
10037
10060
|
"node_modules/gopd": {
|
|
10038
10061
|
"version": "1.0.1",
|
|
10039
10062
|
"resolved": "https://registry.npmjs.org/gopd/-/gopd-1.0.1.tgz",
|
|
@@ -16982,6 +17005,11 @@
|
|
|
16982
17005
|
"url": "https://opencollective.com/webpack"
|
|
16983
17006
|
}
|
|
16984
17007
|
},
|
|
17008
|
+
"node_modules/select": {
|
|
17009
|
+
"version": "1.1.2",
|
|
17010
|
+
"resolved": "https://registry.npmjs.org/select/-/select-1.1.2.tgz",
|
|
17011
|
+
"integrity": "sha512-OwpTSOfy6xSs1+pwcNrv0RBMOzI39Lp3qQKUTPVVPRjCdNa5JH/oPRiqsesIskK8TVgmRiHwO4KXlV2Li9dANA=="
|
|
17012
|
+
},
|
|
16985
17013
|
"node_modules/select-hose": {
|
|
16986
17014
|
"version": "2.0.0",
|
|
16987
17015
|
"resolved": "https://registry.npmjs.org/select-hose/-/select-hose-2.0.0.tgz",
|
|
@@ -18097,6 +18125,11 @@
|
|
|
18097
18125
|
"resolved": "https://registry.npmjs.org/tiny-case/-/tiny-case-1.0.3.tgz",
|
|
18098
18126
|
"integrity": "sha512-Eet/eeMhkO6TX8mnUteS9zgPbUMQa4I6Kkp5ORiBD5476/m+PIRiumP5tmh5ioJpH7k51Kehawy2UDfsnxxY8Q=="
|
|
18099
18127
|
},
|
|
18128
|
+
"node_modules/tiny-emitter": {
|
|
18129
|
+
"version": "2.1.0",
|
|
18130
|
+
"resolved": "https://registry.npmjs.org/tiny-emitter/-/tiny-emitter-2.1.0.tgz",
|
|
18131
|
+
"integrity": "sha512-NB6Dk1A9xgQPMoGqC5CVXn123gWyte215ONT5Pp5a0yt4nlEoO1ZWeCwpncaekPHXO60i47ihFnZPiRPjRMq4Q=="
|
|
18132
|
+
},
|
|
18100
18133
|
"node_modules/tiny-warning": {
|
|
18101
18134
|
"version": "1.0.3",
|
|
18102
18135
|
"resolved": "https://registry.npmjs.org/tiny-warning/-/tiny-warning-1.0.3.tgz",
|
|
@@ -0,0 +1,24 @@
|
|
|
1
|
+
{
|
|
2
|
+
"env": {
|
|
3
|
+
"browser": true,
|
|
4
|
+
"es2021": true,
|
|
5
|
+
"mocha": true
|
|
6
|
+
},
|
|
7
|
+
"extends": ["airbnb-base", "plugin:prettier/recommended"],
|
|
8
|
+
"parserOptions": {
|
|
9
|
+
"ecmaVersion": 12,
|
|
10
|
+
"sourceType": "module"
|
|
11
|
+
},
|
|
12
|
+
"plugins": ["prettier"],
|
|
13
|
+
"rules": {
|
|
14
|
+
"prettier/prettier": "error",
|
|
15
|
+
"prefer-const": "off",
|
|
16
|
+
"camelcase": "off",
|
|
17
|
+
"no-underscore-dangle": "off",
|
|
18
|
+
"consistent-return": "off",
|
|
19
|
+
/* Remove the necessity to use this on classes */
|
|
20
|
+
"class-methods-use-this": "off",
|
|
21
|
+
/* Enable variables declarations from shadowing variables declared in the outer scope */
|
|
22
|
+
"no-shadow": "off"
|
|
23
|
+
}
|
|
24
|
+
}
|
|
@@ -0,0 +1,18 @@
|
|
|
1
|
+
{
|
|
2
|
+
"name": "clipboard",
|
|
3
|
+
"version": "2.0.11",
|
|
4
|
+
"description": "Modern copy to clipboard. No Flash. Just 3kb",
|
|
5
|
+
"license": "MIT",
|
|
6
|
+
"main": "dist/clipboard.js",
|
|
7
|
+
"ignore": [
|
|
8
|
+
"/.*/",
|
|
9
|
+
"/demo/",
|
|
10
|
+
"/test/",
|
|
11
|
+
"/.*",
|
|
12
|
+
"/bower.json",
|
|
13
|
+
"/karma.conf.js",
|
|
14
|
+
"/src",
|
|
15
|
+
"/lib"
|
|
16
|
+
],
|
|
17
|
+
"keywords": ["clipboard", "copy", "cut"]
|
|
18
|
+
}
|
|
@@ -0,0 +1,25 @@
|
|
|
1
|
+
{
|
|
2
|
+
"name": "zenorocha/clipboardjs",
|
|
3
|
+
"description": "Modern copy to clipboard. No Flash. Just 3kb gzipped https://clipboardjs.com",
|
|
4
|
+
"type": "component",
|
|
5
|
+
"homepage": "https://clipboardjs.com/",
|
|
6
|
+
"authors": [
|
|
7
|
+
{
|
|
8
|
+
"name": "Zeno Rocha",
|
|
9
|
+
"homepage": "http://zenorocha.com/"
|
|
10
|
+
}
|
|
11
|
+
],
|
|
12
|
+
"require": {
|
|
13
|
+
"oomphinc/composer-installers-extender": "*"
|
|
14
|
+
},
|
|
15
|
+
"extra": {
|
|
16
|
+
"component": {
|
|
17
|
+
"scripts": [
|
|
18
|
+
"dist/clipboard.js"
|
|
19
|
+
],
|
|
20
|
+
"files": [
|
|
21
|
+
"dist/clipboard.min.js"
|
|
22
|
+
]
|
|
23
|
+
}
|
|
24
|
+
}
|
|
25
|
+
}
|
|
@@ -0,0 +1,63 @@
|
|
|
1
|
+
{
|
|
2
|
+
"name": "clipboard",
|
|
3
|
+
"version": "2.0.11",
|
|
4
|
+
"description": "Modern copy to clipboard. No Flash. Just 2kb",
|
|
5
|
+
"homepage": "https://clipboardjs.com",
|
|
6
|
+
"repository": "zenorocha/clipboard.js",
|
|
7
|
+
"license": "MIT",
|
|
8
|
+
"main": "dist/clipboard.js",
|
|
9
|
+
"types": "src/clipboard.d.ts",
|
|
10
|
+
"keywords": [
|
|
11
|
+
"clipboard",
|
|
12
|
+
"copy",
|
|
13
|
+
"cut"
|
|
14
|
+
],
|
|
15
|
+
"dependencies": {
|
|
16
|
+
"good-listener": "^1.2.2",
|
|
17
|
+
"select": "^1.1.2",
|
|
18
|
+
"tiny-emitter": "^2.0.0"
|
|
19
|
+
},
|
|
20
|
+
"devDependencies": {
|
|
21
|
+
"@babel/core": "^7.12.10",
|
|
22
|
+
"@babel/preset-env": "^7.12.11",
|
|
23
|
+
"babel-loader": "^8.2.2",
|
|
24
|
+
"chai": "^4.2.0",
|
|
25
|
+
"cross-env": "^7.0.3",
|
|
26
|
+
"eslint": "^7.20.0",
|
|
27
|
+
"eslint-config-airbnb-base": "^14.2.1",
|
|
28
|
+
"eslint-config-prettier": "^7.2.0",
|
|
29
|
+
"eslint-plugin-import": "^2.22.1",
|
|
30
|
+
"eslint-plugin-prettier": "^3.3.1",
|
|
31
|
+
"husky": "^5.0.9",
|
|
32
|
+
"karma": "^6.0.0",
|
|
33
|
+
"karma-chai": "^0.1.0",
|
|
34
|
+
"karma-chrome-launcher": "^3.1.0",
|
|
35
|
+
"karma-mocha": "^2.0.1",
|
|
36
|
+
"karma-sinon": "^1.0.4",
|
|
37
|
+
"karma-webpack": "^5.0.0-alpha.5",
|
|
38
|
+
"lint-staged": "^10.5.3",
|
|
39
|
+
"mocha": "^8.2.1",
|
|
40
|
+
"prettier": "2.2.1",
|
|
41
|
+
"sinon": "^9.2.3",
|
|
42
|
+
"tsd": "^0.7.2",
|
|
43
|
+
"uglifyjs-webpack-plugin": "^2.2.0",
|
|
44
|
+
"webpack": "^5.15.0",
|
|
45
|
+
"webpack-cli": "^4.4.0"
|
|
46
|
+
},
|
|
47
|
+
"scripts": {
|
|
48
|
+
"test:types": "tsd",
|
|
49
|
+
"build": "npm run build-debug && npm run build-min",
|
|
50
|
+
"build-debug": "webpack",
|
|
51
|
+
"build-min": "cross-env NODE_ENV=production webpack",
|
|
52
|
+
"build-watch": "webpack --watch",
|
|
53
|
+
"test": "karma start --single-run",
|
|
54
|
+
"prepublish": "npm run build",
|
|
55
|
+
"lint": "eslint --ext .js src/"
|
|
56
|
+
},
|
|
57
|
+
"lint-staged": {
|
|
58
|
+
"*.{js,css,md}": [
|
|
59
|
+
"prettier --write",
|
|
60
|
+
"eslint --fix"
|
|
61
|
+
]
|
|
62
|
+
}
|
|
63
|
+
}
|
|
@@ -0,0 +1,31 @@
|
|
|
1
|
+
{
|
|
2
|
+
"name": "delegate",
|
|
3
|
+
"description": "Lightweight event delegation",
|
|
4
|
+
"version": "3.2.0",
|
|
5
|
+
"repository": "zenorocha/delegate",
|
|
6
|
+
"license": "MIT",
|
|
7
|
+
"main": "src/delegate.js",
|
|
8
|
+
"keywords": [
|
|
9
|
+
"event",
|
|
10
|
+
"delegate",
|
|
11
|
+
"delegation"
|
|
12
|
+
],
|
|
13
|
+
"devDependencies": {
|
|
14
|
+
"browserify": "^13.1.0",
|
|
15
|
+
"chai": "^3.5.0",
|
|
16
|
+
"karma": "^1.3.0",
|
|
17
|
+
"karma-browserify": "^5.1.0",
|
|
18
|
+
"karma-chai": "^0.1.0",
|
|
19
|
+
"karma-mocha": "^1.2.0",
|
|
20
|
+
"karma-phantomjs-launcher": "^1.0.2",
|
|
21
|
+
"karma-sinon": "^1.0.4",
|
|
22
|
+
"mocha": "^3.1.2",
|
|
23
|
+
"phantomjs-polyfill": "0.0.2",
|
|
24
|
+
"simulant": "^0.2.2",
|
|
25
|
+
"sinon": "^1.17.6"
|
|
26
|
+
},
|
|
27
|
+
"scripts": {
|
|
28
|
+
"build": "browserify src/delegate.js -s delegate -o dist/delegate.js",
|
|
29
|
+
"test": "karma start --single-run"
|
|
30
|
+
}
|
|
31
|
+
}
|
|
@@ -0,0 +1,35 @@
|
|
|
1
|
+
{
|
|
2
|
+
"name": "good-listener",
|
|
3
|
+
"description": "A more versatile way of adding & removing event listeners",
|
|
4
|
+
"version": "1.2.2",
|
|
5
|
+
"repository": "zenorocha/good-listener",
|
|
6
|
+
"license": "MIT",
|
|
7
|
+
"main": "src/listen.js",
|
|
8
|
+
"keywords": [
|
|
9
|
+
"event",
|
|
10
|
+
"listener"
|
|
11
|
+
],
|
|
12
|
+
"dependencies": {
|
|
13
|
+
"delegate": "^3.1.2"
|
|
14
|
+
},
|
|
15
|
+
"devDependencies": {
|
|
16
|
+
"browserify": "^13.0.0",
|
|
17
|
+
"chai": "^3.5.0",
|
|
18
|
+
"karma": "^1.3.0",
|
|
19
|
+
"karma-browserify": "^5.0.1",
|
|
20
|
+
"karma-chai": "^0.1.0",
|
|
21
|
+
"karma-mocha": "^1.2.0",
|
|
22
|
+
"karma-phantomjs-launcher": "^1.0.0",
|
|
23
|
+
"karma-sinon": "^1.0.4",
|
|
24
|
+
"mocha": "^3.1.2",
|
|
25
|
+
"phantomjs-polyfill": "0.0.2",
|
|
26
|
+
"phantomjs-prebuilt": "^2.1.3",
|
|
27
|
+
"simulant": "^0.2.2",
|
|
28
|
+
"sinon": "^1.17.3",
|
|
29
|
+
"watchify": "^3.7.0"
|
|
30
|
+
},
|
|
31
|
+
"scripts": {
|
|
32
|
+
"build": "browserify src/listen.js -s listen -o dist/good-listener.js",
|
|
33
|
+
"test": "karma start --single-run"
|
|
34
|
+
}
|
|
35
|
+
}
|
|
@@ -0,0 +1,29 @@
|
|
|
1
|
+
{
|
|
2
|
+
"name": "select",
|
|
3
|
+
"description": "Programmatically select the text of a HTML element",
|
|
4
|
+
"version": "1.1.2",
|
|
5
|
+
"license": "MIT",
|
|
6
|
+
"main": "src/select.js",
|
|
7
|
+
"repository": "zenorocha/select",
|
|
8
|
+
"keywords": [
|
|
9
|
+
"range",
|
|
10
|
+
"select",
|
|
11
|
+
"selecting",
|
|
12
|
+
"selection"
|
|
13
|
+
],
|
|
14
|
+
"devDependencies": {
|
|
15
|
+
"browserify": "^14.0.0",
|
|
16
|
+
"chai": "^3.3.0",
|
|
17
|
+
"karma": "^1.4.1",
|
|
18
|
+
"karma-browserify": "^5.1.1",
|
|
19
|
+
"karma-chai": "^0.1.0",
|
|
20
|
+
"karma-mocha": "^1.3.0",
|
|
21
|
+
"karma-phantomjs-launcher": "^1.0.2",
|
|
22
|
+
"mocha": "^3.2.0",
|
|
23
|
+
"phantomjs": "^2.1.7"
|
|
24
|
+
},
|
|
25
|
+
"scripts": {
|
|
26
|
+
"build": "browserify src/select.js -s select -o dist/select.js",
|
|
27
|
+
"test": "karma start --single-run"
|
|
28
|
+
}
|
|
29
|
+
}
|
|
@@ -0,0 +1,53 @@
|
|
|
1
|
+
{
|
|
2
|
+
"name": "tiny-emitter",
|
|
3
|
+
"version": "2.1.0",
|
|
4
|
+
"description": "A tiny (less than 1k) event emitter library",
|
|
5
|
+
"main": "index.js",
|
|
6
|
+
"scripts": {
|
|
7
|
+
"test-node": "tape test/index.js | tap-format-spec",
|
|
8
|
+
"test": "testling | tap-format-spec",
|
|
9
|
+
"bundle": "node_modules/.bin/browserify index.js > dist/tinyemitter.js -s TinyEmitter && echo 'Bundled'",
|
|
10
|
+
"minify": "node_modules/.bin/uglifyjs dist/tinyemitter.js -o dist/tinyemitter.min.js -m && echo 'Minified'",
|
|
11
|
+
"build": "npm test && npm run bundle && npm run minify",
|
|
12
|
+
"size": "node_modules/.bin/uglifyjs index.js -o minified.js -m && ls -l && rm minified.js"
|
|
13
|
+
},
|
|
14
|
+
"repository": {
|
|
15
|
+
"type": "git",
|
|
16
|
+
"url": "https://github.com/scottcorgan/tiny-emitter.git"
|
|
17
|
+
},
|
|
18
|
+
"keywords": [
|
|
19
|
+
"event",
|
|
20
|
+
"emitter",
|
|
21
|
+
"pubsub",
|
|
22
|
+
"tiny",
|
|
23
|
+
"events",
|
|
24
|
+
"bind"
|
|
25
|
+
],
|
|
26
|
+
"author": "Scott Corgan",
|
|
27
|
+
"license": "MIT",
|
|
28
|
+
"bugs": {
|
|
29
|
+
"url": "https://github.com/scottcorgan/tiny-emitter/issues"
|
|
30
|
+
},
|
|
31
|
+
"devDependencies": {
|
|
32
|
+
"@tap-format/spec": "0.2.0",
|
|
33
|
+
"browserify": "11.2.0",
|
|
34
|
+
"tape": "4.2.1",
|
|
35
|
+
"testling": "1.7.1",
|
|
36
|
+
"uglify-js": "2.5.0"
|
|
37
|
+
},
|
|
38
|
+
"testling": {
|
|
39
|
+
"files": [
|
|
40
|
+
"test/index.js"
|
|
41
|
+
],
|
|
42
|
+
"browsers": [
|
|
43
|
+
"iexplore/10.0",
|
|
44
|
+
"iexplore/9.0",
|
|
45
|
+
"firefox/16..latest",
|
|
46
|
+
"chrome/22..latest",
|
|
47
|
+
"safari/5.1..latest",
|
|
48
|
+
"ipad/6.0..latest",
|
|
49
|
+
"iphone/6.0..latest",
|
|
50
|
+
"android-browser/4.2..latest"
|
|
51
|
+
]
|
|
52
|
+
}
|
|
53
|
+
}
|
|
@@ -27,6 +27,7 @@
|
|
|
27
27
|
"@testing-library/jest-dom": "^5.16.5",
|
|
28
28
|
"@testing-library/react": "^13.4.0",
|
|
29
29
|
"@testing-library/user-event": "^13.5.0",
|
|
30
|
+
"clipboard": "^2.0.11",
|
|
30
31
|
"formik": "^2.4.2",
|
|
31
32
|
"prop-types": "^15.8.1",
|
|
32
33
|
"react": "^18.2.0",
|
|
@@ -7064,6 +7065,16 @@
|
|
|
7064
7065
|
"node": ">=0.10.0"
|
|
7065
7066
|
}
|
|
7066
7067
|
},
|
|
7068
|
+
"node_modules/clipboard": {
|
|
7069
|
+
"version": "2.0.11",
|
|
7070
|
+
"resolved": "https://registry.npmjs.org/clipboard/-/clipboard-2.0.11.tgz",
|
|
7071
|
+
"integrity": "sha512-C+0bbOqkezLIsmWSvlsXS0Q0bmkugu7jcfMIACB+RDEntIzQIkdr148we28AfSloQLRdZlYL/QYyrq05j/3Faw==",
|
|
7072
|
+
"dependencies": {
|
|
7073
|
+
"good-listener": "^1.2.2",
|
|
7074
|
+
"select": "^1.1.2",
|
|
7075
|
+
"tiny-emitter": "^2.0.0"
|
|
7076
|
+
}
|
|
7077
|
+
},
|
|
7067
7078
|
"node_modules/cliui": {
|
|
7068
7079
|
"version": "7.0.4",
|
|
7069
7080
|
"resolved": "https://registry.npmjs.org/cliui/-/cliui-7.0.4.tgz",
|
|
@@ -7999,6 +8010,11 @@
|
|
|
7999
8010
|
"node": ">=0.4.0"
|
|
8000
8011
|
}
|
|
8001
8012
|
},
|
|
8013
|
+
"node_modules/delegate": {
|
|
8014
|
+
"version": "3.2.0",
|
|
8015
|
+
"resolved": "https://registry.npmjs.org/delegate/-/delegate-3.2.0.tgz",
|
|
8016
|
+
"integrity": "sha512-IofjkYBZaZivn0V8nnsMJGBr4jVLxHDheKSW88PyxS5QC4Vo9ZbZVvhzlSxY87fVq3STR6r+4cGepyHkcWOQSw=="
|
|
8017
|
+
},
|
|
8002
8018
|
"node_modules/depd": {
|
|
8003
8019
|
"version": "2.0.0",
|
|
8004
8020
|
"resolved": "https://registry.npmjs.org/depd/-/depd-2.0.0.tgz",
|
|
@@ -10093,6 +10109,14 @@
|
|
|
10093
10109
|
"url": "https://github.com/sponsors/sindresorhus"
|
|
10094
10110
|
}
|
|
10095
10111
|
},
|
|
10112
|
+
"node_modules/good-listener": {
|
|
10113
|
+
"version": "1.2.2",
|
|
10114
|
+
"resolved": "https://registry.npmjs.org/good-listener/-/good-listener-1.2.2.tgz",
|
|
10115
|
+
"integrity": "sha512-goW1b+d9q/HIwbVYZzZ6SsTr4IgE+WA44A0GmPIQstuOrgsFcT7VEJ48nmr9GaRtNu0XTKacFLGnBPAM6Afouw==",
|
|
10116
|
+
"dependencies": {
|
|
10117
|
+
"delegate": "^3.1.2"
|
|
10118
|
+
}
|
|
10119
|
+
},
|
|
10096
10120
|
"node_modules/gopd": {
|
|
10097
10121
|
"version": "1.0.1",
|
|
10098
10122
|
"resolved": "https://registry.npmjs.org/gopd/-/gopd-1.0.1.tgz",
|
|
@@ -17041,6 +17065,11 @@
|
|
|
17041
17065
|
"url": "https://opencollective.com/webpack"
|
|
17042
17066
|
}
|
|
17043
17067
|
},
|
|
17068
|
+
"node_modules/select": {
|
|
17069
|
+
"version": "1.1.2",
|
|
17070
|
+
"resolved": "https://registry.npmjs.org/select/-/select-1.1.2.tgz",
|
|
17071
|
+
"integrity": "sha512-OwpTSOfy6xSs1+pwcNrv0RBMOzI39Lp3qQKUTPVVPRjCdNa5JH/oPRiqsesIskK8TVgmRiHwO4KXlV2Li9dANA=="
|
|
17072
|
+
},
|
|
17044
17073
|
"node_modules/select-hose": {
|
|
17045
17074
|
"version": "2.0.0",
|
|
17046
17075
|
"resolved": "https://registry.npmjs.org/select-hose/-/select-hose-2.0.0.tgz",
|
|
@@ -18156,6 +18185,11 @@
|
|
|
18156
18185
|
"resolved": "https://registry.npmjs.org/tiny-case/-/tiny-case-1.0.3.tgz",
|
|
18157
18186
|
"integrity": "sha512-Eet/eeMhkO6TX8mnUteS9zgPbUMQa4I6Kkp5ORiBD5476/m+PIRiumP5tmh5ioJpH7k51Kehawy2UDfsnxxY8Q=="
|
|
18158
18187
|
},
|
|
18188
|
+
"node_modules/tiny-emitter": {
|
|
18189
|
+
"version": "2.1.0",
|
|
18190
|
+
"resolved": "https://registry.npmjs.org/tiny-emitter/-/tiny-emitter-2.1.0.tgz",
|
|
18191
|
+
"integrity": "sha512-NB6Dk1A9xgQPMoGqC5CVXn123gWyte215ONT5Pp5a0yt4nlEoO1ZWeCwpncaekPHXO60i47ihFnZPiRPjRMq4Q=="
|
|
18192
|
+
},
|
|
18159
18193
|
"node_modules/tiny-warning": {
|
|
18160
18194
|
"version": "1.0.3",
|
|
18161
18195
|
"resolved": "https://registry.npmjs.org/tiny-warning/-/tiny-warning-1.0.3.tgz",
|
xinference/web/ui/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
Metadata-Version: 2.1
|
|
2
2
|
Name: xinference
|
|
3
|
-
Version: 0.
|
|
3
|
+
Version: 0.11.1
|
|
4
4
|
Summary: Model Serving Made Easy
|
|
5
5
|
Home-page: https://github.com/xorbitsai/inference
|
|
6
6
|
Author: Qin Xuye
|
|
@@ -20,7 +20,7 @@ Classifier: Topic :: Software Development :: Libraries
|
|
|
20
20
|
Description-Content-Type: text/markdown
|
|
21
21
|
License-File: LICENSE
|
|
22
22
|
Requires-Dist: xoscar >=0.3.0
|
|
23
|
-
Requires-Dist: torch
|
|
23
|
+
Requires-Dist: torch <2.3.0
|
|
24
24
|
Requires-Dist: gradio >=3.39.0
|
|
25
25
|
Requires-Dist: typer[all] <0.12.0
|
|
26
26
|
Requires-Dist: pillow
|
|
@@ -31,7 +31,7 @@ Requires-Dist: requests
|
|
|
31
31
|
Requires-Dist: pydantic
|
|
32
32
|
Requires-Dist: fastapi
|
|
33
33
|
Requires-Dist: uvicorn
|
|
34
|
-
Requires-Dist: huggingface-hub <
|
|
34
|
+
Requires-Dist: huggingface-hub <0.23.0,>=0.19.4
|
|
35
35
|
Requires-Dist: typing-extensions
|
|
36
36
|
Requires-Dist: fsspec <=2023.10.0,>=2023.1.0
|
|
37
37
|
Requires-Dist: s3fs
|
|
@@ -50,7 +50,7 @@ Provides-Extra: all
|
|
|
50
50
|
Requires-Dist: chatglm-cpp >=0.3.0 ; extra == 'all'
|
|
51
51
|
Requires-Dist: llama-cpp-python !=0.2.58,>=0.2.25 ; extra == 'all'
|
|
52
52
|
Requires-Dist: transformers >=4.34.1 ; extra == 'all'
|
|
53
|
-
Requires-Dist: torch ; extra == 'all'
|
|
53
|
+
Requires-Dist: torch <2.3.0 ; extra == 'all'
|
|
54
54
|
Requires-Dist: accelerate >=0.27.2 ; extra == 'all'
|
|
55
55
|
Requires-Dist: sentencepiece ; extra == 'all'
|
|
56
56
|
Requires-Dist: transformers-stream-generator ; extra == 'all'
|
|
@@ -70,7 +70,7 @@ Requires-Dist: torchvision ; extra == 'all'
|
|
|
70
70
|
Requires-Dist: FlagEmbedding ; extra == 'all'
|
|
71
71
|
Requires-Dist: auto-gptq ; (sys_platform != "darwin") and extra == 'all'
|
|
72
72
|
Requires-Dist: autoawq ; (sys_platform != "darwin") and extra == 'all'
|
|
73
|
-
Requires-Dist: vllm
|
|
73
|
+
Requires-Dist: vllm <0.4.2,>=0.2.6 ; (sys_platform == "linux") and extra == 'all'
|
|
74
74
|
Requires-Dist: sglang[all] ; (sys_platform == "linux") and extra == 'all'
|
|
75
75
|
Provides-Extra: benchmark
|
|
76
76
|
Requires-Dist: psutil ; extra == 'benchmark'
|
|
@@ -122,7 +122,7 @@ Provides-Extra: sglang
|
|
|
122
122
|
Requires-Dist: sglang[all] ; extra == 'sglang'
|
|
123
123
|
Provides-Extra: transformers
|
|
124
124
|
Requires-Dist: transformers >=4.34.1 ; extra == 'transformers'
|
|
125
|
-
Requires-Dist: torch ; extra == 'transformers'
|
|
125
|
+
Requires-Dist: torch <2.3.0 ; extra == 'transformers'
|
|
126
126
|
Requires-Dist: accelerate >=0.27.2 ; extra == 'transformers'
|
|
127
127
|
Requires-Dist: sentencepiece ; extra == 'transformers'
|
|
128
128
|
Requires-Dist: transformers-stream-generator ; extra == 'transformers'
|
|
@@ -130,15 +130,15 @@ Requires-Dist: bitsandbytes ; extra == 'transformers'
|
|
|
130
130
|
Requires-Dist: protobuf ; extra == 'transformers'
|
|
131
131
|
Requires-Dist: einops ; extra == 'transformers'
|
|
132
132
|
Requires-Dist: tiktoken ; extra == 'transformers'
|
|
133
|
-
Requires-Dist: auto-gptq ; extra == 'transformers'
|
|
134
|
-
Requires-Dist: autoawq ; extra == 'transformers'
|
|
135
133
|
Requires-Dist: optimum ; extra == 'transformers'
|
|
136
134
|
Requires-Dist: attrdict ; extra == 'transformers'
|
|
137
135
|
Requires-Dist: timm >=0.9.16 ; extra == 'transformers'
|
|
138
136
|
Requires-Dist: torchvision ; extra == 'transformers'
|
|
139
137
|
Requires-Dist: peft ; extra == 'transformers'
|
|
138
|
+
Requires-Dist: auto-gptq ; (sys_platform != "darwin") and extra == 'transformers'
|
|
139
|
+
Requires-Dist: autoawq ; (sys_platform != "darwin") and extra == 'transformers'
|
|
140
140
|
Provides-Extra: vllm
|
|
141
|
-
Requires-Dist: vllm
|
|
141
|
+
Requires-Dist: vllm <0.4.2,>=0.2.6 ; extra == 'vllm'
|
|
142
142
|
|
|
143
143
|
<div align="center">
|
|
144
144
|
<img src="./assets/xorbits-logo.png" width="180px" alt="xorbits" />
|
|
@@ -177,15 +177,16 @@ potential of cutting-edge AI models.
|
|
|
177
177
|
- Support multimodal: [#829](https://github.com/xorbitsai/inference/pull/829)
|
|
178
178
|
### New Models
|
|
179
179
|
- Built-in support for [Llama 3](https://github.com/meta-llama/llama3): [#1332](https://github.com/xorbitsai/inference/pull/1332)
|
|
180
|
+
- Built-in support for [Qwen1.5 110B](https://huggingface.co/Qwen/Qwen1.5-110B-Chat): [#1388](https://github.com/xorbitsai/inference/pull/1388)
|
|
181
|
+
- Built-in support for [Mixtral-8x22B-instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x22B-Instruct-v0.1): [#1340](https://github.com/xorbitsai/inference/pull/1340)
|
|
180
182
|
- Built-in support for [Command-R](https://huggingface.co/CohereForAI/c4ai-command-r-v01): [#1310](https://github.com/xorbitsai/inference/pull/1310)
|
|
181
183
|
- Built-in support for [Qwen1.5 MOE](https://huggingface.co/Qwen/Qwen1.5-MoE-A2.7B-Chat): [#1263](https://github.com/xorbitsai/inference/pull/1263)
|
|
182
184
|
- Built-in support for [Qwen1.5 32B](https://huggingface.co/Qwen/Qwen1.5-32B-Chat): [#1249](https://github.com/xorbitsai/inference/pull/1249)
|
|
183
|
-
- Built-in support for [OmniLMM](https://github.com/OpenBMB/OmniLMM): [#1171](https://github.com/xorbitsai/inference/pull/1171)
|
|
184
|
-
- Built-in support for [Gemma](https://github.com/google-deepmind/gemma): [#1024](https://github.com/xorbitsai/inference/pull/1024)
|
|
185
185
|
### Integrations
|
|
186
|
-
- [FastGPT](https://github.com/labring/FastGPT): a knowledge-based platform built on the LLM, offers out-of-the-box data processing and model invocation capabilities, allows for workflow orchestration through Flow visualization.
|
|
187
186
|
- [Dify](https://docs.dify.ai/advanced/model-configuration/xinference): an LLMOps platform that enables developers (and even non-developers) to quickly build useful applications based on large language models, ensuring they are visual, operable, and improvable.
|
|
187
|
+
- [FastGPT](https://github.com/labring/FastGPT): a knowledge-based platform built on the LLM, offers out-of-the-box data processing and model invocation capabilities, allows for workflow orchestration through Flow visualization.
|
|
188
188
|
- [Chatbox](https://chatboxai.app/): a desktop client for multiple cutting-edge LLM models, available on Windows, Mac and Linux.
|
|
189
|
+
- [RAGFlow](https://github.com/infiniflow/ragflow): is an open-source RAG engine based on deep document understanding.
|
|
189
190
|
|
|
190
191
|
|
|
191
192
|
## Key Features
|