@jsonstudio/rcc 0.89.1205 → 0.89.1348
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +17 -0
- package/configsamples/config.json +426 -0
- package/configsamples/config.reference.json +58 -0
- package/configsamples/provider/crs/config.v1.json +46 -0
- package/configsamples/provider/glm/config.v1.json +81 -0
- package/configsamples/provider/glm-anthropic/config.v1.json +45 -0
- package/configsamples/provider/iflow/config.v1.json +74 -0
- package/configsamples/provider/kimi/config.v1.json +41 -0
- package/configsamples/provider/lmstudio/config.v1.json +101 -0
- package/configsamples/provider/mimo/config.v1.json +35 -0
- package/configsamples/provider/modelscope/config.v1.json +96 -0
- package/configsamples/provider/qwen/config.v1.json +38 -0
- package/configsamples/provider/tab/config.v1.json +50 -0
- package/configsamples/provider/tabglm/config.v1.json +49 -0
- package/dist/build-info.js +2 -2
- package/dist/cli/commands/code.js +12 -6
- package/dist/cli/commands/code.js.map +1 -1
- package/dist/cli/commands/config.d.ts +2 -1
- package/dist/cli/commands/config.js +74 -103
- package/dist/cli/commands/config.js.map +1 -1
- package/dist/cli/commands/examples.js +6 -6
- package/dist/cli/commands/examples.js.map +1 -1
- package/dist/cli/commands/init.d.ts +28 -0
- package/dist/cli/commands/init.js +91 -0
- package/dist/cli/commands/init.js.map +1 -0
- package/dist/cli/commands/port.js +10 -2
- package/dist/cli/commands/port.js.map +1 -1
- package/dist/cli/commands/restart.js +5 -2
- package/dist/cli/commands/restart.js.map +1 -1
- package/dist/cli/commands/start.js +25 -22
- package/dist/cli/commands/start.js.map +1 -1
- package/dist/cli/commands/status.js +1 -0
- package/dist/cli/commands/status.js.map +1 -1
- package/dist/cli/commands/stop.js +1 -0
- package/dist/cli/commands/stop.js.map +1 -1
- package/dist/cli/config/bundled-docs.d.ts +20 -0
- package/dist/cli/config/bundled-docs.js +91 -0
- package/dist/cli/config/bundled-docs.js.map +1 -0
- package/dist/cli/config/init-config.d.ts +36 -0
- package/dist/cli/config/init-config.js +180 -0
- package/dist/cli/config/init-config.js.map +1 -0
- package/dist/cli/config/init-provider-catalog.d.ts +8 -0
- package/dist/cli/config/init-provider-catalog.js +187 -0
- package/dist/cli/config/init-provider-catalog.js.map +1 -0
- package/dist/cli/register/init-command.d.ts +3 -0
- package/dist/cli/register/init-command.js +5 -0
- package/dist/cli/register/init-command.js.map +1 -0
- package/dist/cli.js +28 -3
- package/dist/cli.js.map +1 -1
- package/dist/client/gemini-cli/gemini-cli-protocol-client.js +1 -1
- package/dist/client/gemini-cli/gemini-cli-protocol-client.js.map +1 -1
- package/dist/config/risk-control-config.d.ts +94 -0
- package/dist/config/risk-control-config.js +196 -0
- package/dist/config/risk-control-config.js.map +1 -0
- package/dist/constants/index.d.ts +6 -0
- package/dist/constants/index.js +13 -0
- package/dist/constants/index.js.map +1 -1
- package/dist/docs/daemon-admin-ui.html +2113 -190
- package/dist/index.js +0 -1
- package/dist/index.js.map +1 -1
- package/dist/manager/modules/health/index.d.ts +1 -1
- package/dist/manager/modules/quota/antigravity-quota-manager.d.ts +70 -0
- package/dist/manager/modules/quota/antigravity-quota-manager.js +442 -0
- package/dist/manager/modules/quota/antigravity-quota-manager.js.map +1 -0
- package/dist/manager/modules/quota/index.d.ts +3 -127
- package/dist/manager/modules/quota/index.js +2 -1093
- package/dist/manager/modules/quota/index.js.map +1 -1
- package/dist/manager/modules/quota/provider-key-normalization.d.ts +3 -0
- package/dist/manager/modules/quota/provider-key-normalization.js +155 -0
- package/dist/manager/modules/quota/provider-key-normalization.js.map +1 -0
- package/dist/manager/modules/quota/provider-quota-daemon.cooldown.d.ts +9 -0
- package/dist/manager/modules/quota/provider-quota-daemon.cooldown.js +115 -0
- package/dist/manager/modules/quota/provider-quota-daemon.cooldown.js.map +1 -0
- package/dist/manager/modules/quota/provider-quota-daemon.d.ts +77 -0
- package/dist/manager/modules/quota/provider-quota-daemon.events.d.ts +12 -0
- package/dist/manager/modules/quota/provider-quota-daemon.events.js +237 -0
- package/dist/manager/modules/quota/provider-quota-daemon.events.js.map +1 -0
- package/dist/manager/modules/quota/provider-quota-daemon.js +404 -0
- package/dist/manager/modules/quota/provider-quota-daemon.js.map +1 -0
- package/dist/manager/modules/quota/provider-quota-daemon.model-backoff.d.ts +11 -0
- package/dist/manager/modules/quota/provider-quota-daemon.model-backoff.js +189 -0
- package/dist/manager/modules/quota/provider-quota-daemon.model-backoff.js.map +1 -0
- package/dist/manager/modules/quota/provider-quota-daemon.snapshot.d.ts +8 -0
- package/dist/manager/modules/quota/provider-quota-daemon.snapshot.js +96 -0
- package/dist/manager/modules/quota/provider-quota-daemon.snapshot.js.map +1 -0
- package/dist/manager/modules/quota/provider-quota-daemon.view.d.ts +19 -0
- package/dist/manager/modules/quota/provider-quota-daemon.view.js +37 -0
- package/dist/manager/modules/quota/provider-quota-daemon.view.js.map +1 -0
- package/dist/manager/modules/routing/index.d.ts +1 -0
- package/dist/manager/modules/routing/index.js +11 -25
- package/dist/manager/modules/routing/index.js.map +1 -1
- package/dist/manager/quota/provider-quota-center.d.ts +2 -0
- package/dist/manager/quota/provider-quota-center.js +80 -82
- package/dist/manager/quota/provider-quota-center.js.map +1 -1
- package/dist/modules/llmswitch/bridge.d.ts +16 -18
- package/dist/modules/llmswitch/bridge.js +293 -94
- package/dist/modules/llmswitch/bridge.js.map +1 -1
- package/dist/modules/llmswitch/core-loader.d.ts +4 -2
- package/dist/modules/llmswitch/core-loader.js +32 -20
- package/dist/modules/llmswitch/core-loader.js.map +1 -1
- package/dist/modules/pipeline/utils/colored-logger.js +3 -2
- package/dist/modules/pipeline/utils/colored-logger.js.map +1 -1
- package/dist/modules/pipeline/utils/debug-logger.js +1 -1
- package/dist/modules/pipeline/utils/debug-logger.js.map +1 -1
- package/dist/providers/auth/iflow-cookie-auth.js +0 -2
- package/dist/providers/auth/iflow-cookie-auth.js.map +1 -1
- package/dist/providers/auth/oauth-lifecycle.js +2 -23
- package/dist/providers/auth/oauth-lifecycle.js.map +1 -1
- package/dist/providers/core/config/camoufox-launcher.js +35 -4
- package/dist/providers/core/config/camoufox-launcher.js.map +1 -1
- package/dist/providers/core/runtime/antigravity-quota-client.js +6 -3
- package/dist/providers/core/runtime/antigravity-quota-client.js.map +1 -1
- package/dist/providers/core/runtime/base-provider.d.ts +2 -2
- package/dist/providers/core/runtime/base-provider.js +74 -69
- package/dist/providers/core/runtime/base-provider.js.map +1 -1
- package/dist/providers/core/runtime/gemini-cli-http-provider.js +6 -4
- package/dist/providers/core/runtime/gemini-cli-http-provider.js.map +1 -1
- package/dist/providers/core/runtime/http-request-executor.js +2 -2
- package/dist/providers/core/runtime/http-request-executor.js.map +1 -1
- package/dist/providers/core/runtime/http-transport-provider.d.ts +14 -0
- package/dist/providers/core/runtime/http-transport-provider.js +111 -5
- package/dist/providers/core/runtime/http-transport-provider.js.map +1 -1
- package/dist/providers/core/runtime/provider-error-classifier.js +10 -0
- package/dist/providers/core/runtime/provider-error-classifier.js.map +1 -1
- package/dist/providers/core/runtime/provider-factory.js +7 -5
- package/dist/providers/core/runtime/provider-factory.js.map +1 -1
- package/dist/providers/core/runtime/provider-runtime-metadata.d.ts +6 -0
- package/dist/providers/core/runtime/provider-runtime-metadata.js.map +1 -1
- package/dist/providers/core/runtime/responses-provider.d.ts +1 -7
- package/dist/providers/core/runtime/responses-provider.js +12 -93
- package/dist/providers/core/runtime/responses-provider.js.map +1 -1
- package/dist/providers/core/strategies/oauth-auth-code-flow.js +12 -8
- package/dist/providers/core/strategies/oauth-auth-code-flow.js.map +1 -1
- package/dist/providers/core/utils/http-client.js +16 -3
- package/dist/providers/core/utils/http-client.js.map +1 -1
- package/dist/providers/core/utils/provider-error-logger.d.ts +1 -1
- package/dist/providers/core/utils/provider-error-reporter.d.ts +3 -1
- package/dist/providers/core/utils/provider-error-reporter.js +3 -0
- package/dist/providers/core/utils/provider-error-reporter.js.map +1 -1
- package/dist/providers/core/utils/snapshot-writer.js +1 -4
- package/dist/providers/core/utils/snapshot-writer.js.map +1 -1
- package/dist/providers/mock/mock-provider-runtime.js +57 -27
- package/dist/providers/mock/mock-provider-runtime.js.map +1 -1
- package/dist/scripts/camoufox/launch-auth.mjs +193 -58
- package/dist/server/handlers/handler-utils.js +3 -2
- package/dist/server/handlers/handler-utils.js.map +1 -1
- package/dist/server/runtime/http-server/daemon-admin/auth-handler.d.ts +2 -0
- package/dist/server/runtime/http-server/daemon-admin/auth-handler.js +103 -0
- package/dist/server/runtime/http-server/daemon-admin/auth-handler.js.map +1 -0
- package/dist/server/runtime/http-server/daemon-admin/auth-session.d.ts +5 -0
- package/dist/server/runtime/http-server/daemon-admin/auth-session.js +77 -0
- package/dist/server/runtime/http-server/daemon-admin/auth-session.js.map +1 -0
- package/dist/server/runtime/http-server/daemon-admin/auth-store.d.ts +18 -0
- package/dist/server/runtime/http-server/daemon-admin/auth-store.js +89 -0
- package/dist/server/runtime/http-server/daemon-admin/auth-store.js.map +1 -0
- package/dist/server/runtime/http-server/daemon-admin/credentials-handler.js +1 -2
- package/dist/server/runtime/http-server/daemon-admin/credentials-handler.js.map +1 -1
- package/dist/server/runtime/http-server/daemon-admin/providers-handler.js +226 -24
- package/dist/server/runtime/http-server/daemon-admin/providers-handler.js.map +1 -1
- package/dist/server/runtime/http-server/daemon-admin/quota-handler.js +47 -8
- package/dist/server/runtime/http-server/daemon-admin/quota-handler.js.map +1 -1
- package/dist/server/runtime/http-server/daemon-admin/restart-handler.js +1 -1
- package/dist/server/runtime/http-server/daemon-admin/restart-handler.js.map +1 -1
- package/dist/server/runtime/http-server/daemon-admin/stats-handler.js +1 -1
- package/dist/server/runtime/http-server/daemon-admin/stats-handler.js.map +1 -1
- package/dist/server/runtime/http-server/daemon-admin/status-handler.js +68 -4
- package/dist/server/runtime/http-server/daemon-admin/status-handler.js.map +1 -1
- package/dist/server/runtime/http-server/daemon-admin-routes.d.ts +3 -4
- package/dist/server/runtime/http-server/daemon-admin-routes.js +9 -14
- package/dist/server/runtime/http-server/daemon-admin-routes.js.map +1 -1
- package/dist/server/runtime/http-server/executor-metadata.js +1 -1
- package/dist/server/runtime/http-server/executor-metadata.js.map +1 -1
- package/dist/server/runtime/http-server/executor-response.js +0 -16
- package/dist/server/runtime/http-server/executor-response.js.map +1 -1
- package/dist/server/runtime/http-server/hub-shadow-compare.js +110 -34
- package/dist/server/runtime/http-server/hub-shadow-compare.js.map +1 -1
- package/dist/server/runtime/http-server/index.d.ts +5 -3
- package/dist/server/runtime/http-server/index.js +215 -109
- package/dist/server/runtime/http-server/index.js.map +1 -1
- package/dist/server/runtime/http-server/middleware.js +19 -1
- package/dist/server/runtime/http-server/middleware.js.map +1 -1
- package/dist/server/runtime/http-server/request-executor.js +10 -19
- package/dist/server/runtime/http-server/request-executor.js.map +1 -1
- package/dist/server/runtime/http-server/routes.js +8 -2
- package/dist/server/runtime/http-server/routes.js.map +1 -1
- package/dist/server/runtime/http-server/session-dir.d.ts +2 -0
- package/dist/server/runtime/http-server/session-dir.js +59 -0
- package/dist/server/runtime/http-server/session-dir.js.map +1 -0
- package/dist/server/runtime/http-server/types.d.ts +0 -4
- package/dist/server/utils/utf8-chunk-buffer.js +6 -3
- package/dist/server/utils/utf8-chunk-buffer.js.map +1 -1
- package/dist/server/utils/warmup-storm-tracker.js +1 -1
- package/dist/server/utils/warmup-storm-tracker.js.map +1 -1
- package/dist/server-factory.d.ts +6 -28
- package/dist/server-factory.js +8 -93
- package/dist/server-factory.js.map +1 -1
- package/dist/token-daemon/index.js +2 -2
- package/dist/token-daemon/index.js.map +1 -1
- package/dist/token-daemon/provider-registry.js +0 -1
- package/dist/token-daemon/provider-registry.js.map +1 -1
- package/dist/token-daemon/server-utils.js +8 -9
- package/dist/token-daemon/server-utils.js.map +1 -1
- package/dist/token-daemon/token-utils.js +1 -1
- package/dist/token-daemon/token-utils.js.map +1 -1
- package/dist/tools/semantic-replay.js +2 -2
- package/dist/tools/semantic-replay.js.map +1 -1
- package/dist/tools/stats-request-events.d.ts +1 -1
- package/dist/tools/stats-usage.js +6 -3
- package/dist/tools/stats-usage.js.map +1 -1
- package/dist/utils/llms-engine-shadow.d.ts +19 -0
- package/dist/utils/llms-engine-shadow.js +209 -0
- package/dist/utils/llms-engine-shadow.js.map +1 -0
- package/dist/utils/runtime-versions.js +2 -1
- package/dist/utils/runtime-versions.js.map +1 -1
- package/docs/ARCHITECTURE.md +402 -0
- package/docs/CODEX_AND_CLAUDE_CODE.md +69 -0
- package/docs/CONFIG_ARCHITECTURE.md +517 -0
- package/docs/ERROR_HANDLING_AUDIT.md +0 -0
- package/docs/GCLI2API_PARITY_GAPS.md +98 -0
- package/docs/INSTALLATION_AND_QUICKSTART.md +74 -0
- package/docs/INSTRUCTION_MARKUP.md +89 -0
- package/docs/MODULE_ENHANCEMENT_SYSTEM.md +666 -0
- package/docs/PORTS.md +36 -0
- package/docs/PROVIDERS_BUILTIN.md +111 -0
- package/docs/PROVIDER_TYPES.md +55 -0
- package/docs/SERVERTOOL_CLOCK_DESIGN.md +233 -0
- package/docs/USAGE_HANDLING_ANALYSIS.md +335 -0
- package/docs/USER_CONFIG_PARSER_CHANGES.md +175 -0
- package/docs/V3_INBOUND_OUTBOUND_DESIGN.md +86 -0
- package/docs/VIRTUAL_ROUTER_PRIORITY_AND_HEALTH.md +125 -0
- package/docs/anthropic-request-golden-samples.md +50 -0
- package/docs/ccr-alignment-enhancetool.md +105 -0
- package/docs/chat-glm-500-analysis.md +79 -0
- package/docs/chat-request-golden-samples.md +42 -0
- package/docs/chat-semantic-expansion-plan.md +82 -0
- package/docs/cli-command-inventory.md +76 -0
- package/docs/codex-samples-replay.md +50 -0
- package/docs/daemon-admin-api-design.md +350 -0
- package/docs/daemon-admin-module-structure.md +169 -0
- package/docs/daemon-admin-ui.html +3394 -0
- package/docs/debug-system-design.md +734 -0
- package/docs/debugging/gemini-sse-root-cause.md +52 -0
- package/docs/debugging/sse_encoding_failure_analysis.md +53 -0
- package/docs/dry-run/README.md +721 -0
- package/docs/error-handling-v2.md +92 -0
- package/docs/exec-command-guard-policy.example.v1.json +42 -0
- package/docs/fixes/gemini-protocol-mapping.md +57 -0
- package/docs/fixes/oauth-portal-timing-fix.md +202 -0
- package/docs/fixes/web-search-hop3-fix.md +265 -0
- package/docs/glm-api-reference.md +390 -0
- package/docs/glm-chat-completions.md +1779 -0
- package/docs/glm-history-inline-images.md +44 -0
- package/docs/golden-ci-library.md +66 -0
- package/docs/lmstudio-dry-run-summary.md +203 -0
- package/docs/lmstudio-tool-calling.md +214 -0
- package/docs/mapping-tables/anthropic-to-openai.json +290 -0
- package/docs/mapping-tables/iflow-to-openai.json +215 -0
- package/docs/mapping-tables/openai-passthrough.json +190 -0
- package/docs/mapping-tables/openai-to-iflow.json +227 -0
- package/docs/monitoring/Design.md +61 -0
- package/docs/multi-token-auth-guide.md +66 -0
- package/docs/oauth-authentication-guide.md +168 -0
- package/docs/oauth-iflow-implementation.md +153 -0
- package/docs/pipeline-routing-report.md +209 -0
- package/docs/plans/manager-daemon/PLAN.md +86 -0
- package/docs/plans/provider-config-v2-plan.md +176 -0
- package/docs/plans/provider-runtime-manager-plan.md +209 -0
- package/docs/plans/transparent-429-failover.md +89 -0
- package/docs/plans/unified-hub-framework-v1.md +245 -0
- package/docs/provider-config-v2-ui-design.md +181 -0
- package/docs/provider-quota-design.md +129 -0
- package/docs/providers/gemini-provider.md +62 -0
- package/docs/providers/lmstudio-v2-migration-report.md +102 -0
- package/docs/providers/provider-composite-design.md +142 -0
- package/docs/providers/provider-composite-testing.md +98 -0
- package/docs/providers/provider-type-only-migration.md +111 -0
- package/docs/rccx-wasm-migration.md +74 -0
- package/docs/refactoring/architecture-comparison-diagram.md +140 -0
- package/docs/refactoring/compatibility-v2-architecture-design.md +738 -0
- package/docs/refactoring/workflow-compatibility-refactoring-design.md +361 -0
- package/docs/reports/routing-classification-report.json +24 -0
- package/docs/reports/routing-classification-report.md +18 -0
- package/docs/reports/thinking-keywords-report.json +19 -0
- package/docs/responses/README.md +156 -0
- package/docs/responses-generic-provider.md +86 -0
- package/docs/responses-passthrough-provider-design.md +202 -0
- package/docs/routing-awrr-health-weighted-round-robin.md +179 -0
- package/docs/routing-instructions.md +393 -0
- package/docs/stop-message-auto.md +225 -0
- package/docs/streaming-flow.html +30 -0
- package/docs/streaming-flow.md +182 -0
- package/docs/token-daemon-preview.html +490 -0
- package/docs/token-refresh-daemon-plan.md +269 -0
- package/docs/transformation-tables/Gemini-FinishReason/345/256/214/346/225/264/350/275/254/346/215/242/350/241/250.json +233 -0
- package/docs/transformation-tables/README.md +225 -0
- package/docs/transformation-tables/claude-code-router-anthropic-to-gemini.json +283 -0
- package/docs/transformation-tables/claude-code-router-anthropic-to-openai.json +208 -0
- package/docs/transformation-tables/claude-code-router-openai-to-anthropic.json +261 -0
- package/docs/transformation-tables/claude-code-router-openai-to-gemini.json +208 -0
- package/docs/transformation-tables/claude-code-router-openai-to-lmstudio.json +182 -0
- package/docs/transformation-tables/claude-code-router-openai-to-ollama.json +250 -0
- package/docs/transformation-tables/claude-code-router-openai-to-textgenwebui.json +295 -0
- package/docs/transformation-tables/claude-code-router-provider-conversions.json +193 -0
- package/docs/transformation-tables//345/256/214/346/225/264/347/232/204/345/267/245/345/205/267/346/211/247/350/241/214/346/265/201/347/250/213/350/275/254/346/215/242/350/241/250.json +299 -0
- package/docs/transformation-tables//345/257/271/350/257/235/345/216/206/345/217/262/347/273/264/346/212/244/345/210/206/346/236/220.md +134 -0
- package/docs/transformation-tables//345/267/245/345/205/267/350/260/203/347/224/250/346/250/241/345/274/217/345/210/206/346/236/220.md +158 -0
- package/docs/transformation-tables//347/212/266/346/200/201/347/256/241/347/220/206/351/234/200/346/261/202/345/210/206/346/236/220.md +175 -0
- package/docs/transformation-tables//351/235/231/346/200/201/350/241/250vs/345/212/250/346/200/201/345/210/206/346/236/220.md +189 -0
- package/docs/transformation-tables//351/235/231/346/200/201/350/241/250/345/207/206/347/241/256/346/200/247/350/257/204/344/274/260.md +179 -0
- package/docs/transformation-tables//351/235/236/346/265/201/345/274/217/345/234/272/346/231/257/345/210/206/346/236/220.md +189 -0
- package/docs/v2-architecture/IMPLEMENTATION-ROADMAP.md +367 -0
- package/docs/v2-architecture/OPTIMIZED-DESIGN.md +827 -0
- package/docs/v2-architecture/PRERUN-CONNECTION-DESIGN.md +716 -0
- package/docs/v2-architecture/README.md +551 -0
- package/docs/verification/modelscope-verify.md +59 -0
- package/docs/web-search-service-design.md +322 -0
- package/package.json +12 -7
- package/scripts/camoufox/launch-auth.mjs +193 -58
- package/scripts/monitor-diff.mjs +126 -0
- package/scripts/pack-mode.mjs +19 -1
- package/scripts/pack-rcc.mjs +63 -0
- package/scripts/unified-hub-shadow-compare.mjs +33 -13
- package/scripts/verify-e2e-toolcall.mjs +115 -26
- package/dist/modules/llmswitch/pipeline-registry.d.ts +0 -57
- package/dist/modules/llmswitch/pipeline-registry.js +0 -229
- package/dist/modules/llmswitch/pipeline-registry.js.map +0 -1
- package/dist/server/RouteCodexServer.d.ts +0 -13
- package/dist/server/RouteCodexServer.js +0 -25
- package/dist/server/RouteCodexServer.js.map +0 -1
- package/dist/v2/conversion/hub/snapshot-recorder.d.ts +0 -12
- package/dist/v2/conversion/hub/snapshot-recorder.js +0 -22
- package/dist/v2/conversion/hub/snapshot-recorder.js.map +0 -1
|
@@ -0,0 +1,402 @@
|
|
|
1
|
+
# RouteCodex 系统架构文档
|
|
2
|
+
|
|
3
|
+
## 概述
|
|
4
|
+
|
|
5
|
+
RouteCodex 是一个多 Provider OpenAI 代理服务器,支持动态路由、负载均衡和兼容性处理。系统采用模块化设计,支持主题订阅、错误处理、调试中心等高级功能。
|
|
6
|
+
|
|
7
|
+
## 与 sharedmodule/llmswitch-core 的职责边界
|
|
8
|
+
|
|
9
|
+
| 责任层 | RouteCodex Host (本仓库) | sharedmodule/llmswitch-core |
|
|
10
|
+
| --- | --- | --- |
|
|
11
|
+
| 配置解析 | 读取用户配置文件,调用 `bootstrapVirtualRouterConfig`,将 `virtualRouterArtifacts.config` 传给 `HubPipeline` | 验证 routing/providers/classifier,展开 provider.keyAlias.model,输出 `targetRuntime` |
|
|
12
|
+
| HTTP 请求 | `/v1/chat`/`/v1/responses`/`/v1/messages` handler 将 HTTP/SSE 载荷封装为 `HubPipelineRequest` | SSE Input → Chat Process → Virtual Router → Output,生成 `providerPayload` + `target` |
|
|
13
|
+
| Provider 初始化 | 根据 `virtualRouterArtifacts.targetRuntime` 初始化 Provider 实例,绑定 auth/baseURL/compat profile | 不直接创建 Provider 客户端,仅输出 runtime 元数据 |
|
|
14
|
+
| Provider 调用 | 使用 runtimeKey 查找 Provider 实例,向上游发送请求,记录日志/快照 | 输出 `target.runtimeKey`,供 host 查表;捕获 `ProviderErrorEvent` 以管理熔断 |
|
|
15
|
+
| 错误处理 | Provider/Compatibility 抛错 → `errorHandlingCenter.handleError` → 上报 `providerErrorCenter`,并映射为 HTTP 响应 | Virtual Router 接收 `ProviderErrorEvent`、执行熔断/降级;Hub Pipeline 将错误冒泡给 host |
|
|
16
|
+
| 热更新 | 监听配置变更 → 调用 `hubPipeline.updateVirtualRouterConfig(newArtifacts.config)`,并刷新 Provider runtime | 在内部替换 Virtual Router 配置并继续输出最新的 routing/runtime 状态 |
|
|
17
|
+
|
|
18
|
+
> **落地要求**:Host 不再解析旧的“合并配置”蓝图,也不在 Provider 层做“模型选择”;所有模型替换/目标决策由 Virtual Router 执行,Host 仅负责“把 HTTP/SSE 转交给 Hub Pipeline + 根据 runtimeKey 调用 Provider”,从而保证单一职责和无兜底策略。
|
|
19
|
+
|
|
20
|
+
## 系统架构
|
|
21
|
+
|
|
22
|
+
### 核心组件
|
|
23
|
+
|
|
24
|
+
```
|
|
25
|
+
┌─────────────────────────────────────────────────────────────────┐
|
|
26
|
+
│ RouteCodex 架构 │
|
|
27
|
+
├─────────────────────────────────────────────────────────────────┤
|
|
28
|
+
│ │
|
|
29
|
+
│ ┌─────────────────┐ ┌─────────────────┐ ┌─────────────────┐ │
|
|
30
|
+
│ │ HTTP Server │ │ Config Mgr │ │ Provider Mgr │ │
|
|
31
|
+
│ │ │ │ │ │ │ │
|
|
32
|
+
│ │ • 请求处理 │ │ • 配置管理 │ │ • Provider管理 │ │
|
|
33
|
+
│ │ • 路由分发 │ │ • 验证器 │ │ • 负载均衡 │ │
|
|
34
|
+
│ │ • 响应格式化 │ │ • 热重载 │ │ • 故障转移 │ │
|
|
35
|
+
│ └─────────────────┘ └─────────────────┘ └─────────────────┘ │
|
|
36
|
+
│ │ │ │ │
|
|
37
|
+
│ └─────────────────────┼─────────────────────┘ │
|
|
38
|
+
│ │ │
|
|
39
|
+
│ ┌─────────────────┐ ┌─────────────────┐ ┌─────────────────┐ │
|
|
40
|
+
│ │ Core Logic │ │ MessageCenter │ │ DebugCenter │ │
|
|
41
|
+
│ │ │ │ │ │ │ │
|
|
42
|
+
│ │ • 请求转发 │ │ • 主题订阅 │ │ • 调试记录 │ │
|
|
43
|
+
│ │ • 响应处理 │ │ • 消息路由 │ │ • 性能监控 │ │
|
|
44
|
+
│ │ • 错误处理 │ │ • 模块通信 │ │ • 会话管理 │ │
|
|
45
|
+
│ └─────────────────┘ └─────────────────┘ └─────────────────┘ │
|
|
46
|
+
│ │ │ │ │
|
|
47
|
+
│ └─────────────────────┼─────────────────────┘ │
|
|
48
|
+
│ │ │
|
|
49
|
+
│ ┌─────────────────┐ ┌─────────────────┐ ┌─────────────────┐ │
|
|
50
|
+
│ │ Utilities │ │ ErrorHandling │ │ Patches │ │
|
|
51
|
+
│ │ │ │ │ │ │ │
|
|
52
|
+
│ │ • 日志工具 │ │ • 错误处理 │ │ • 兼容性补丁 │ │
|
|
53
|
+
│ │ • 负载均衡 │ │ • 重试机制 │ │ • 响应转换 │ │
|
|
54
|
+
│ │ • 故障转移 │ │ • 异常恢复 │ │ • 格式适配 │ │
|
|
55
|
+
│ └─────────────────┘ └─────────────────┘ └─────────────────┘ │
|
|
56
|
+
│ │
|
|
57
|
+
└─────────────────────────────────────────────────────────────────┘
|
|
58
|
+
```
|
|
59
|
+
|
|
60
|
+
### 主题订阅系统
|
|
61
|
+
|
|
62
|
+
#### MessageCenter 架构
|
|
63
|
+
|
|
64
|
+
```
|
|
65
|
+
┌─────────────────────────────────────────────────────────────────┐
|
|
66
|
+
│ MessageCenter │
|
|
67
|
+
├─────────────────────────────────────────────────────────────────┤
|
|
68
|
+
│ │
|
|
69
|
+
│ ┌─────────────────┐ ┌─────────────────┐ ┌─────────────────┐ │
|
|
70
|
+
│ │ Module Mgr │ │TopicSubscription │ │MessageProcessor │ │
|
|
71
|
+
│ │ │ │ Manager │ │ │ │
|
|
72
|
+
│ │ • 模块注册 │ │ • 主题订阅 │ │ • 消息验证 │ │
|
|
73
|
+
│ │ • 生命周期 │ │ • 通配符支持 │ │ • 消息处理 │ │
|
|
74
|
+
│ │ • 状态管理 │ │ • 订阅管理 │ │ • 路由分发 │ │
|
|
75
|
+
│ └─────────────────┘ └─────────────────┘ └─────────────────┘ │
|
|
76
|
+
│ │ │ │ │
|
|
77
|
+
│ └─────────────────────┼─────────────────────┘ │
|
|
78
|
+
│ │ │
|
|
79
|
+
│ ┌─────────────────┐ ┌─────────────────┐ ┌─────────────────┐ │
|
|
80
|
+
│ │Request Mgr │ │Statistics Mgr │ │ Broadcast Mgr │ │
|
|
81
|
+
│ │ │ │ │ │ │ │
|
|
82
|
+
│ │ • 请求管理 │ │ • 性能统计 │ │ • 消息广播 │ │
|
|
83
|
+
│ │ • 响应处理 │ │ • 监控指标 │ │ • 多播分发 │ │
|
|
84
|
+
│ │ • 超时控制 │ │ • 报告生成 │ │ • 订阅通知 │ │
|
|
85
|
+
│ └─────────────────┘ └─────────────────┘ └─────────────────┘ │
|
|
86
|
+
│ │
|
|
87
|
+
└─────────────────────────────────────────────────────────────────┘
|
|
88
|
+
```
|
|
89
|
+
|
|
90
|
+
#### 主题订阅特性
|
|
91
|
+
|
|
92
|
+
1. **主题订阅**
|
|
93
|
+
- 支持模块订阅特定主题
|
|
94
|
+
- 动态订阅/取消订阅
|
|
95
|
+
- 订阅状态管理
|
|
96
|
+
|
|
97
|
+
2. **通配符支持**
|
|
98
|
+
- 支持通配符订阅所有主题
|
|
99
|
+
- 灵活的消息路由
|
|
100
|
+
- 订阅者过滤
|
|
101
|
+
|
|
102
|
+
3. **消息路由**
|
|
103
|
+
- 基于主题的消息分发
|
|
104
|
+
- 多播消息传递
|
|
105
|
+
- 订阅者隔离
|
|
106
|
+
|
|
107
|
+
4. **统计监控**
|
|
108
|
+
- 订阅统计信息
|
|
109
|
+
- 消息传递统计
|
|
110
|
+
- 性能指标收集
|
|
111
|
+
|
|
112
|
+
### 调试中心集成
|
|
113
|
+
|
|
114
|
+
#### DebugCenter 主题订阅集成
|
|
115
|
+
|
|
116
|
+
```
|
|
117
|
+
┌─────────────────────────────────────────────────────────────────┐
|
|
118
|
+
│ DebugCenter │
|
|
119
|
+
├─────────────────────────────────────────────────────────────────┤
|
|
120
|
+
│ │
|
|
121
|
+
│ ┌─────────────────┐ ┌─────────────────┐ ┌─────────────────┐ │
|
|
122
|
+
│ │ Event Bus │ │ Session Mgr │ │ Topic Sub │ │
|
|
123
|
+
│ │ │ │ │ │ │ │
|
|
124
|
+
│ │ • 事件总线 │ │ • 会话管理 │ │ • 主题订阅 │ │
|
|
125
|
+
│ │ • 事件处理 │ │ • 状态跟踪 │ │ • 消息发布 │ │
|
|
126
|
+
│ │ • 订阅管理 │ │ • 生命周期 │ │ • 跨模块通信 │ │
|
|
127
|
+
│ └─────────────────┘ └─────────────────┘ └─────────────────┘ │
|
|
128
|
+
│ │ │ │ │
|
|
129
|
+
│ └─────────────────────┼─────────────────────┘ │
|
|
130
|
+
│ │ │
|
|
131
|
+
│ ┌─────────────────┐ ┌─────────────────┐ ┌─────────────────┐ │
|
|
132
|
+
│ │ Pipeline │ │ Message Ctr │ │ Statistics │ │
|
|
133
|
+
│ │ │ │ │ │ │ │
|
|
134
|
+
│ │ • 流水线处理 │ │ • 消息中心 │ │ • 统计信息 │ │
|
|
135
|
+
│ │ • 事件记录 │ │ • 集成通信 │ │ • 性能监控 │ │
|
|
136
|
+
│ │ • 协调调度 │ │ • 全局实例 │ │ • 报告生成 │ │
|
|
137
|
+
│ └─────────────────┘ └─────────────────┘ └─────────────────┘ │
|
|
138
|
+
│ │
|
|
139
|
+
└─────────────────────────────────────────────────────────────────┘
|
|
140
|
+
```
|
|
141
|
+
|
|
142
|
+
### 模块依赖关系
|
|
143
|
+
|
|
144
|
+
```
|
|
145
|
+
┌─────────────────────────────────────────────────────────────────┐
|
|
146
|
+
│ 模块依赖关系 │
|
|
147
|
+
├─────────────────────────────────────────────────────────────────┤
|
|
148
|
+
│ │
|
|
149
|
+
│ ┌─────────────────┐ ┌─────────────────┐ ┌─────────────────┐ │
|
|
150
|
+
│ │ RouteCodex │ │ rcc-errorhandling │ │
|
|
151
|
+
│ │ │ │ │ │ │ │
|
|
152
|
+
│ │ • 主应用 │ │ • 调试中心 │ │ • 错误处理 │ │
|
|
153
|
+
│ │ • 服务器 │ │ • 主题订阅 │ │ • 异常管理 │ │
|
|
154
|
+
│ │ • 路由管理 │ │ • 会话跟踪 │ │ • 重试机制 │ │
|
|
155
|
+
│ └─────────────────┘ └─────────────────┘ └─────────────────┘ │
|
|
156
|
+
│ │ │ │ │
|
|
157
|
+
│ └───────────────────────┼───────────────────────┘ │
|
|
158
|
+
│ │ │
|
|
159
|
+
│ ┌─────────────────────────────────────────────────────────────────┐ │
|
|
160
|
+
│ │ rcc-basemodule │ │
|
|
161
|
+
│ │ │ │
|
|
162
|
+
│ │ ┌─────────────────┐ ┌─────────────────┐ ┌─────────────────┐ │ │
|
|
163
|
+
│ │ │ MessageCenter │ │ Interfaces │ │ Utilities │ │ │
|
|
164
|
+
│ │ │ │ │ │ │ │ │
|
|
165
|
+
│ │ │ • 主题订阅 │ │ • 类型定义 │ │ • 工具函数 │ │
|
|
166
|
+
│ │ │ • 消息路由 │ │ • 接口规范 │ │ • 辅助方法 │ │
|
|
167
|
+
│ │ │ • 模块通信 │ │ • 数据结构 │ │ • 通用模块 │ │
|
|
168
|
+
│ │ └─────────────────┘ └─────────────────┘ └─────────────────┘ │ │
|
|
169
|
+
│ │ │ │
|
|
170
|
+
│ └─────────────────────────────────────────────────────────────────┘ │
|
|
171
|
+
│ │
|
|
172
|
+
└─────────────────────────────────────────────────────────────────┘
|
|
173
|
+
```
|
|
174
|
+
|
|
175
|
+
## Hub Pipeline 集成(llmswitch-core)
|
|
176
|
+
|
|
177
|
+
RouteCodex 现在完全依赖 sharedmodule/llmswitch-core 的 Hub Pipeline,实现“HTTP ↔ 标准化请求 ↔ Virtual Router ↔ Provider”全链路处理:
|
|
178
|
+
|
|
179
|
+
- **唯一入口**:服务器通过 `RouteCodexHttpServer` 调用 `sharedmodule/llmswitch-core/dist/conversion/hub/pipeline/hub-pipeline`,禁止旁路加载核心模块。
|
|
180
|
+
- **配置来源**:`routecodex-config-loader` 读取用户配置后调用 `bootstrapVirtualRouterConfig`。该工具会校验 routing/providers、展开 `provider.keyAlias.model`、生成 `targetRuntime` 映射(endpoint、headers、auth、compat profile),Hub Pipeline 构造函数直接接受该结果。
|
|
181
|
+
- **节点链路**:Hub Pipeline 在内部组成 `SSE Input → Input Node → Chat Process → Virtual Router → (Compatibility,可选) → Output/SSE`。Host 不关心节点细节,只需要把 HTTP 请求封装成标准化的 Hub 请求。
|
|
182
|
+
- **工具治理**:唯一的工具治理点位于 `chat-process-node`。Compatibility 层已完全下沉到 llmswitch-core(`sharedmodule/llmswitch-core/src/conversion/compat`),仅做 Provider 特定的最小字段修剪。
|
|
183
|
+
- **Provider 调度**:Virtual Router 负责分类、熔断、负载均衡,并把 `target.runtimeKey` 写入请求。Host 使用 `bootstrapVirtualRouterConfig` 输出的 `targetRuntime` 把 runtimeKey 映射到具体 Provider 实例(包含 OAuth/apiKey 配置、baseURL、compat profile)。
|
|
184
|
+
- **错误流**:Provider/Compatibility 报错后调用 `errorHandlingCenter.handleError`,同时通过 `providerErrorCenter.emit` 把 `ProviderErrorEvent` 交还给 Virtual Router,以便执行熔断和健康统计。
|
|
185
|
+
|
|
186
|
+
借助 Hub Pipeline,HTTP 层只需关注请求封装与 Provider runtime 生命周期,核心能力全部收敛在 sharedmodule 中,实现“入口单一、无兜底”的目标。
|
|
187
|
+
|
|
188
|
+
## 技术栈
|
|
189
|
+
|
|
190
|
+
### 核心技术
|
|
191
|
+
|
|
192
|
+
- **Node.js**: 运行时环境
|
|
193
|
+
- **TypeScript**: 类型安全的JavaScript
|
|
194
|
+
- **ESM**: 纯ES模块系统
|
|
195
|
+
- **Rollup**: 模块打包工具
|
|
196
|
+
|
|
197
|
+
### 构建工具
|
|
198
|
+
|
|
199
|
+
- **TypeScript**: 编译时类型检查
|
|
200
|
+
- **Rollup**: ESM模块打包
|
|
201
|
+
- **Jest**: 单元测试框架
|
|
202
|
+
- **ESLint**: 代码质量检查
|
|
203
|
+
|
|
204
|
+
### 发布工具
|
|
205
|
+
|
|
206
|
+
- **NPM**: 包管理器
|
|
207
|
+
- **Semantic Versioning**: 版本管理
|
|
208
|
+
- **CI/CD**: 自动化构建和发布
|
|
209
|
+
|
|
210
|
+
## 消息流程
|
|
211
|
+
|
|
212
|
+
### 主题订阅消息流程
|
|
213
|
+
|
|
214
|
+
```
|
|
215
|
+
┌─────────────────────────────────────────────────────────────────┐
|
|
216
|
+
│ 主题订阅消息流程 │
|
|
217
|
+
├─────────────────────────────────────────────────────────────────┤
|
|
218
|
+
│ │
|
|
219
|
+
│ Publisher → MessageCenter → TopicSubscription → Subscribers │
|
|
220
|
+
│ │ │ │ │ │
|
|
221
|
+
│ │ │ │ │ │
|
|
222
|
+
│ ┌─────┐ ┌──────┐ ┌──────┐ ┌──────┐ │
|
|
223
|
+
│ │Publish│ │Route │ │Topic │ │Receive│ │
|
|
224
|
+
│ │Message│ │Message│ │Match │ │Message│ │
|
|
225
|
+
│ └─────┘ └──────┘ └──────┘ └──────┘ │
|
|
226
|
+
│ │ │ │ │ │
|
|
227
|
+
│ │ │ │ │ │
|
|
228
|
+
│ ▼ ▼ ▼ ▼ │
|
|
229
|
+
│ ┌─────┐ ┌──────┐ ┌──────┐ ┌──────┐ │
|
|
230
|
+
│ │Create│ │Validate│ │Filter│ │Process│ │
|
|
231
|
+
│ │Message│ │Message│ │Subs │ │Message│ │
|
|
232
|
+
│ └─────┘ └──────┘ └──────┘ └──────┘ │
|
|
233
|
+
│ │
|
|
234
|
+
└─────────────────────────────────────────────────────────────────┘
|
|
235
|
+
```
|
|
236
|
+
|
|
237
|
+
### 错误处理流程
|
|
238
|
+
|
|
239
|
+
```
|
|
240
|
+
┌─────────────────────────────────────────────────────────────────┐
|
|
241
|
+
│ 错误处理流程 │
|
|
242
|
+
├─────────────────────────────────────────────────────────────────┤
|
|
243
|
+
│ │
|
|
244
|
+
│ Error → ErrorHandling → Recovery → Retry/Fallback → Success │
|
|
245
|
+
│ │ │ │ │ │ │
|
|
246
|
+
│ │ │ │ │ │ │
|
|
247
|
+
│ ┌───┐ ┌─────┐ ┌─────┐ ┌─────┐ ┌─────┐ ┌─────┐ │
|
|
248
|
+
│ │Cap│ │Class│ │Analyze│ │Retry│ │Fallback│ │Result│ │
|
|
249
|
+
│ │ture│ │ify │ │Error │ │Logic│ │Handler │ │Log │ │
|
|
250
|
+
│ └───┘ └─────┘ └─────┘ └─────┘ └─────┘ └─────┘ │
|
|
251
|
+
│ │ │ │ │ │ │
|
|
252
|
+
│ │ │ │ │ │ │
|
|
253
|
+
│ ▼ ▼ ▼ ▼ ▼ │
|
|
254
|
+
│ ┌───┐ ┌─────┐ ┌─────┐ ┌─────┐ ┌─────┐ ┌─────┐ │
|
|
255
|
+
│ │Log │ │Track│ │Recover│ │Attempt│ │Alternative││End │ │
|
|
256
|
+
│ │Error│ │Error│ │State │ │Count │ │Solution│ │Flow │ │
|
|
257
|
+
│ └───┘ └─────┘ └─────┘ └─────┘ └─────┘ └─────┘ │
|
|
258
|
+
│ │
|
|
259
|
+
└─────────────────────────────────────────────────────────────────┘
|
|
260
|
+
```
|
|
261
|
+
|
|
262
|
+
## 配置管理
|
|
263
|
+
|
|
264
|
+
### 系统配置
|
|
265
|
+
|
|
266
|
+
```json
|
|
267
|
+
{
|
|
268
|
+
"server": {
|
|
269
|
+
"port": 5506,
|
|
270
|
+
"host": "localhost",
|
|
271
|
+
"cors": {
|
|
272
|
+
"enabled": true,
|
|
273
|
+
"origins": ["*"]
|
|
274
|
+
}
|
|
275
|
+
},
|
|
276
|
+
"providers": {
|
|
277
|
+
"openai-provider": {
|
|
278
|
+
"type": "openai",
|
|
279
|
+
"enabled": true,
|
|
280
|
+
"baseUrl": "https://api.openai.com/v1",
|
|
281
|
+
"apiKey": "your-api-key",
|
|
282
|
+
"models": {
|
|
283
|
+
"gpt-4": {
|
|
284
|
+
"maxTokens": 8192,
|
|
285
|
+
"temperature": 0.7
|
|
286
|
+
}
|
|
287
|
+
}
|
|
288
|
+
}
|
|
289
|
+
},
|
|
290
|
+
"messageCenter": {
|
|
291
|
+
"enableTopicSubscription": true,
|
|
292
|
+
"topics": {
|
|
293
|
+
"debug-events": "Debug events topic",
|
|
294
|
+
"system-events": "System events topic"
|
|
295
|
+
},
|
|
296
|
+
"wildcardSubscription": true
|
|
297
|
+
},
|
|
298
|
+
"debugCenter": {
|
|
299
|
+
"outputDirectory": "./debug-logs",
|
|
300
|
+
"enableTopicSubscription": true,
|
|
301
|
+
"topicSubscriptionConfig": {
|
|
302
|
+
"debugTopic": "debug-events",
|
|
303
|
+
"systemTopic": "system-events",
|
|
304
|
+
"enableWildcardSubscription": true
|
|
305
|
+
}
|
|
306
|
+
}
|
|
307
|
+
}
|
|
308
|
+
```
|
|
309
|
+
|
|
310
|
+
### 主题订阅配置
|
|
311
|
+
|
|
312
|
+
```json
|
|
313
|
+
{
|
|
314
|
+
"topicSubscription": {
|
|
315
|
+
"enabled": true,
|
|
316
|
+
"topics": {
|
|
317
|
+
"debug-events": {
|
|
318
|
+
"description": "Debug events topic",
|
|
319
|
+
"subscribers": ["monitoring"]
|
|
320
|
+
},
|
|
321
|
+
"system-events": {
|
|
322
|
+
"description": "System events topic",
|
|
323
|
+
"subscribers": ["errorhandler"]
|
|
324
|
+
},
|
|
325
|
+
"user-events": {
|
|
326
|
+
"description": "User events topic",
|
|
327
|
+
"subscribers": ["analytics", "monitoring"]
|
|
328
|
+
}
|
|
329
|
+
},
|
|
330
|
+
"wildcardEnabled": true,
|
|
331
|
+
"wildcardSubscribers": []
|
|
332
|
+
}
|
|
333
|
+
}
|
|
334
|
+
```
|
|
335
|
+
|
|
336
|
+
## 部署架构
|
|
337
|
+
|
|
338
|
+
### 开发环境
|
|
339
|
+
|
|
340
|
+
```
|
|
341
|
+
┌─────────────────────────────────────────────────────────────────┐
|
|
342
|
+
│ 开发环境 │
|
|
343
|
+
├─────────────────────────────────────────────────────────────────┤
|
|
344
|
+
│ │
|
|
345
|
+
│ ┌─────────────────┐ ┌─────────────────┐ ┌─────────────────┐ │
|
|
346
|
+
│ │ Development │ │ Testing │ │ Debugging │ │
|
|
347
|
+
│ │ │ │ │ │ │ │
|
|
348
|
+
│ │ • 热重载 │ │ • 单元测试 │ │ • 调试工具 │ │
|
|
349
|
+
│ │ • 源码映射 │ │ • 集成测试 │ │ • 性能分析 │ │
|
|
350
|
+
│ │ • 开发日志 │ │ • 端到端测试 │ │ • 日志查看 │ │
|
|
351
|
+
│ └─────────────────┘ └─────────────────┘ └─────────────────┘ │
|
|
352
|
+
│ │
|
|
353
|
+
└─────────────────────────────────────────────────────────────────┘
|
|
354
|
+
```
|
|
355
|
+
|
|
356
|
+
### 生产环境
|
|
357
|
+
|
|
358
|
+
```
|
|
359
|
+
┌─────────────────────────────────────────────────────────────────┐
|
|
360
|
+
│ 生产环境 │
|
|
361
|
+
├─────────────────────────────────────────────────────────────────┤
|
|
362
|
+
│ │
|
|
363
|
+
│ ┌─────────────────┐ ┌─────────────────┐ ┌─────────────────┐ │
|
|
364
|
+
│ │ Load Balancer │ │ RouteCodex │ │ Monitoring │ │
|
|
365
|
+
│ │ │ │ │ │ │ │
|
|
366
|
+
│ │ • 负载均衡 │ │ • 多实例 │ │ • 性能监控 │ │
|
|
367
|
+
│ │ • 健康检查 │ │ • 容器化 │ │ • 日志收集 │ │
|
|
368
|
+
│ │ • 故障转移 │ │ • 自动扩展 │ │ • 告警通知 │ │
|
|
369
|
+
│ └─────────────────┘ └─────────────────┘ └─────────────────┘ │
|
|
370
|
+
│ │ │ │ │
|
|
371
|
+
│ └───────────────────────┼───────────────────────┘ │
|
|
372
|
+
│ │ │
|
|
373
|
+
│ ┌─────────────────────────────────────────────────────────────────┐ │
|
|
374
|
+
│ │ Infrastructure │ │
|
|
375
|
+
│ │ │ │
|
|
376
|
+
│ │ ┌─────────────────┐ ┌─────────────────┐ ┌─────────────────┐ │ │
|
|
377
|
+
│ │ │ Database │ │ Cache │ │ Queue │ │ │
|
|
378
|
+
│ │ │ │ │ │ │ │ │
|
|
379
|
+
│ │ │ • 数据存储 │ │ • 缓存管理 │ │ • 消息队列 │ │
|
|
380
|
+
│ │ │ • 会话存储 │ │ • 性能优化 │ │ • 异步处理 │ │
|
|
381
|
+
│ │ │ • 配置存储 │ │ • 数据同步 │ │ • 任务调度 │ │
|
|
382
|
+
│ │ └─────────────────┘ └─────────────────┘ └─────────────────┘ │ │
|
|
383
|
+
│ │ │ │
|
|
384
|
+
│ └─────────────────────────────────────────────────────────────────┘ │
|
|
385
|
+
│ │
|
|
386
|
+
└─────────────────────────────────────────────────────────────────┘
|
|
387
|
+
```
|
|
388
|
+
|
|
389
|
+
## 版本信息
|
|
390
|
+
|
|
391
|
+
- **当前版本**: 0.0.1
|
|
392
|
+
- **最后更新**: 2025-01-22
|
|
393
|
+
- **维护团队**: RouteCodex 开发团队
|
|
394
|
+
- **文档版本**: 1.0.0
|
|
395
|
+
|
|
396
|
+
## 相关文档
|
|
397
|
+
|
|
398
|
+
- [README.md](./README.md) - 项目概述和快速开始
|
|
399
|
+
- [CONTRIBUTING.md](./CONTRIBUTING.md) - 贡献指南
|
|
400
|
+
- [CHANGELOG.md](./CHANGELOG.md) - 变更日志
|
|
401
|
+
- [API 文档](./docs/api/) - API 接口文档
|
|
402
|
+
- [部署指南](./docs/deployment/) - 部署相关文档
|
|
@@ -0,0 +1,69 @@
|
|
|
1
|
+
# Codex / Claude Code 接入 RouteCodex
|
|
2
|
+
|
|
3
|
+
## 1) Codex(~/.codex/config.toml)
|
|
4
|
+
|
|
5
|
+
Codex 支持在 `~/.codex/config.toml` 里声明多个 `model_providers`。你可以把 RouteCodex 当作“上游 base_url”,让 Codex 的所有请求走本地代理。
|
|
6
|
+
|
|
7
|
+
一个参考写法(与当前常见的 `tc/tcm` 命名保持一致):
|
|
8
|
+
|
|
9
|
+
```toml
|
|
10
|
+
[model_providers.tc]
|
|
11
|
+
name = "rc"
|
|
12
|
+
base_url = "http://127.0.0.1:5555/v1"
|
|
13
|
+
wire_api = "chat"
|
|
14
|
+
env_key = "ROUTECODEX_APIKEY"
|
|
15
|
+
|
|
16
|
+
[model_providers.tcm]
|
|
17
|
+
name = "rc"
|
|
18
|
+
base_url = "http://127.0.0.1:5555/v1"
|
|
19
|
+
wire_api = "responses"
|
|
20
|
+
env_key = "ROUTECODEX_APIKEY"
|
|
21
|
+
|
|
22
|
+
[profiles.tc]
|
|
23
|
+
model_provider = "tc"
|
|
24
|
+
model = "gpt-5.2"
|
|
25
|
+
|
|
26
|
+
[profiles.tcm]
|
|
27
|
+
model_provider = "tcm"
|
|
28
|
+
model = "gpt-5.2"
|
|
29
|
+
```
|
|
30
|
+
|
|
31
|
+
如果你在 `~/.routecodex/config.json` 中设置了服务端访问密钥(`httpserver.apikey`),则需要在环境变量里提供同样的值:
|
|
32
|
+
|
|
33
|
+
```bash
|
|
34
|
+
export ROUTECODEX_APIKEY="your-server-apikey"
|
|
35
|
+
```
|
|
36
|
+
|
|
37
|
+
> RouteCodex 会接受 `Authorization: Bearer ...` 与 `x-api-key: ...` 等多种 header;Codex 侧如何出 header 取决于其实现与 `wire_api` 行为。
|
|
38
|
+
|
|
39
|
+
## 2) RouteCodex 启动建议
|
|
40
|
+
|
|
41
|
+
### 标准启动
|
|
42
|
+
|
|
43
|
+
```bash
|
|
44
|
+
rcc start
|
|
45
|
+
```
|
|
46
|
+
|
|
47
|
+
### 针对 Codex / Claude 的系统提示词与 UA(可选)
|
|
48
|
+
|
|
49
|
+
```bash
|
|
50
|
+
rcc start --codex
|
|
51
|
+
# 或
|
|
52
|
+
rcc start --claude
|
|
53
|
+
```
|
|
54
|
+
|
|
55
|
+
## 3) Claude Code(rcc code)
|
|
56
|
+
|
|
57
|
+
RouteCodex CLI 内置了 `rcc code` 来启动 Claude Code,并把 Claude Code 的请求代理到本地 RouteCodex:
|
|
58
|
+
|
|
59
|
+
```bash
|
|
60
|
+
rcc code --ensure-server
|
|
61
|
+
```
|
|
62
|
+
|
|
63
|
+
常用参数:
|
|
64
|
+
|
|
65
|
+
- 指定 Claude Code 可执行文件:`rcc code --claude-path /path/to/claude`
|
|
66
|
+
- 指定模型:`rcc code --model <model>`
|
|
67
|
+
- 指定 profile:`rcc code --profile <profile>`
|
|
68
|
+
- 指定 server apikey:`rcc code --apikey <your-server-apikey>`
|
|
69
|
+
|